Skip to main content
Top
Published in: BMC Health Services Research 1/2020

Open Access 01-12-2020 | Research article

Selecting and tailoring implementation interventions: a concept mapping approach

Authors: Elaine Yuen Ling Kwok, Sheila T. F. Moodie, Barbara Jane Cunningham, Janis E. Oram Cardy

Published in: BMC Health Services Research | Issue 1/2020

Login to get access

Abstract

Background

To improve the uptake of research into practice, knowledge translation frameworks recommend tailoring implementation strategies to address practice barriers. This study reports our experience pairing the Theoretical Domains Framework with information from multiple stakeholder groups to co-develop practice-informed strategies for improving the implementation of an evidence-based outcome measurement tool across a large community health system for preschoolers with communication impairments.

Methods

Concept mapping was used to identify strategies for improving implementation of the Focus on the Outcomes of Communication Under Six (FOCUS) in Ontario Canada’s Preschool Speech and Language Program. This work was done in five stages. First, we interviewed 37 speech-language pathologists (clinicians) who identified 90 unique strategies to resolve practice barriers to FOCUS implementation. Second, clinicians (n = 34), policy-makers (n = 3), and members of the FOCUS research team (n = 6) sorted and rated the strategies by importance and feasibility. Third, stakeholders’ sorting data were analyzed to generate a two-dimensional concept map. Based on the rating data from stakeholders, we prioritized a list of strategies that were rated as highly important and highly feasible, and summarized the practice barriers addressed by each of the prioritized strategies. Fourth, we validated these findings with stakeholders via an online survey. Fifth, the mechanisms of action of the prioritized list of strategies were considered based on available evidence from the Theoretical Domains Framework and associated behavior change literature.

Results

Stakeholders categorized the 90 unique implementation strategies into a six-cluster concept map. Based on stakeholders’ ratings, a list of 14 implementation strategies were prioritized. These implementation strategies were reported to resolve barriers within the environmental context and resources and beliefs about consequences domains of the Theoretical Domains Framework. All but one of the prioritized strategies have a demonstrated link in resolving existing barriers according to the behavioral change literature.

Conclusions

Our study contributes to a growing literature that demonstrates the process of tailoring implementation strategies to specific barriers. Practical drawbacks and benefits of using concept mapping as a way to engage stakeholders in implementation research are discussed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26(1):13–24.CrossRef Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26(1):13–24.CrossRef
2.
go back to reference Proctor EK, Powell BJ, McMillen J. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):1–11.CrossRef Proctor EK, Powell BJ, McMillen J. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):1–11.CrossRef
3.
go back to reference Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10(1):1–14.CrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10(1):1–14.CrossRef
4.
go back to reference Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the expert recommendations for implementing change (ERIC) study. Implement Sci. 2015;10(1):1–8.CrossRef Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the expert recommendations for implementing change (ERIC) study. Implement Sci. 2015;10(1):1–8.CrossRef
5.
go back to reference Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5(1):1–6.CrossRef Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5(1):1–6.CrossRef
6.
go back to reference Kok G, Schaalma H, Ruiter RAC, Van Empelen P, Brug J. Intervention mapping: a protocol for applying health psychology theory to prevention programmes. J Health Psychol. 2004;9(1):85–98.CrossRef Kok G, Schaalma H, Ruiter RAC, Van Empelen P, Brug J. Intervention mapping: a protocol for applying health psychology theory to prevention programmes. J Health Psychol. 2004;9(1):85–98.CrossRef
7.
go back to reference Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Heal Ment Heal Serv Res. 2016;43(5):783–98.CrossRef Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Heal Ment Heal Serv Res. 2016;43(5):783–98.CrossRef
8.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Heal Care. 2005;14(1):26–33.CrossRef Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Heal Care. 2005;14(1):26–33.CrossRef
9.
go back to reference Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):1–18.CrossRef Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):1–18.CrossRef
10.
go back to reference Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):1–17.CrossRef Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):1–17.CrossRef
11.
go back to reference Cane J, Richardson M, Johnston M, Ladha R, Michie S. From lists of behaviour change techniques (BCTs) to structured hierarchies: comparison of two methods of developing a hierarchy of BCTs. Br J Health Psychol. 2015;20(1):130–50.CrossRef Cane J, Richardson M, Johnston M, Ladha R, Michie S. From lists of behaviour change techniques (BCTs) to structured hierarchies: comparison of two methods of developing a hierarchy of BCTs. Br J Health Psychol. 2015;20(1):130–50.CrossRef
12.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.CrossRef
13.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francies J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRef Michie S, Richardson M, Johnston M, Abraham C, Francies J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRef
14.
go back to reference Connell LE, Carey RN, De Bruin M, Rothman AJ, Johnston M, Kelly MP, et al. Links between behavior change techniques and mechanisms of action: an expert consensus study. Ann Behav Med. 2018;53(8):708–20.CrossRef Connell LE, Carey RN, De Bruin M, Rothman AJ, Johnston M, Kelly MP, et al. Links between behavior change techniques and mechanisms of action: an expert consensus study. Ann Behav Med. 2018;53(8):708–20.CrossRef
15.
go back to reference Bhattacharyya O, Reeves S, Garfinkel S, Zwarenstein M. Designing theoretically-informed implementation interventions: fine in theory, but evidence of effectiveness in practice is needed. Implement Sci. 2006;1(1):3–5.CrossRef Bhattacharyya O, Reeves S, Garfinkel S, Zwarenstein M. Designing theoretically-informed implementation interventions: fine in theory, but evidence of effectiveness in practice is needed. Implement Sci. 2006;1(1):3–5.CrossRef
16.
go back to reference Moodie ST, Kothari A, Bagatto MP, Seewald R, Miller LT, Scollie SD. Knowledge translation in audiology: promoting the clinical application of best evidence. Trends Amplif. 2011;15(1–2):5–22.CrossRef Moodie ST, Kothari A, Bagatto MP, Seewald R, Miller LT, Scollie SD. Knowledge translation in audiology: promoting the clinical application of best evidence. Trends Amplif. 2011;15(1–2):5–22.CrossRef
17.
go back to reference Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. In: Straus S, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care: Moving from Evidence to Practice. Hoboken:NJ: Blackwell Publishing Ltd; 2009. p. 94–112. Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. In: Straus S, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care: Moving from Evidence to Practice. Hoboken:NJ: Blackwell Publishing Ltd; 2009. p. 94–112.
18.
go back to reference Gagliardi AR, Kothari A, Graham ID. Research agenda for integrated knowledge translation (IKT) in healthcare: what we know and do not yet know. J Epidemiol Community Health. 2016;71(2):105–6.CrossRef Gagliardi AR, Kothari A, Graham ID. Research agenda for integrated knowledge translation (IKT) in healthcare: what we know and do not yet know. J Epidemiol Community Health. 2016;71(2):105–6.CrossRef
19.
go back to reference Denis JL, Hébert Y, Langley A, Lozeau D, Trottier LH. Explaining diffusion patterns for complex health care innovations. Health Care Manag Rev. 2002;27(3):60–73.CrossRef Denis JL, Hébert Y, Langley A, Lozeau D, Trottier LH. Explaining diffusion patterns for complex health care innovations. Health Care Manag Rev. 2002;27(3):60–73.CrossRef
20.
go back to reference Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94.CrossRef Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94.CrossRef
21.
go back to reference Kane M, Trochim WM. Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage Publications, Inc.; 2007.CrossRef Kane M, Trochim WM. Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage Publications, Inc.; 2007.CrossRef
22.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. In R. Baker (Ed.), Cochrane Database of Systematic Reviews. Chichester: Wiley; 2010. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. In R. Baker (Ed.), Cochrane Database of Systematic Reviews. Chichester: Wiley; 2010.
23.
go back to reference Thomas-Stonell NL, Robertson B, Walker J, Oddson B, Washington K, Rosenbaum P. FOCUS©: Focus on the outcomes of communication under six manual. Toronto: Holland Bloorview Kids Rehabilitation Hospital; 2015. Thomas-Stonell NL, Robertson B, Walker J, Oddson B, Washington K, Rosenbaum P. FOCUS©: Focus on the outcomes of communication under six manual. Toronto: Holland Bloorview Kids Rehabilitation Hospital; 2015.
24.
go back to reference Thomas-Stonell NL, Oddson B, Robertson B, Rosenbaum PL. Development of the FOCUS (Focus on the outcomes of communication under six), a communication outcome measure for preschool children. Dev Med Child Neurol. 2010;52(1):47–53.CrossRef Thomas-Stonell NL, Oddson B, Robertson B, Rosenbaum PL. Development of the FOCUS (Focus on the outcomes of communication under six), a communication outcome measure for preschool children. Dev Med Child Neurol. 2010;52(1):47–53.CrossRef
25.
go back to reference Thomas-Stonell NL, Oddson B, Robertson B, Rosenbaum PL. Validation of the focus on the outcomes of communication under six outcome measure. Dev Med Child Neurol. 2013;55(6):546–52.CrossRef Thomas-Stonell NL, Oddson B, Robertson B, Rosenbaum PL. Validation of the focus on the outcomes of communication under six outcome measure. Dev Med Child Neurol. 2013;55(6):546–52.CrossRef
26.
go back to reference Oddson B, Thomas-Stonell NL, Robertson B, Rosenbaum P. Validity of a streamlined version of the Focus on the Outcomes of Communication Under Six: Process and outcome. Child Care Health Dev. 2019;45(April):600–5.PubMed Oddson B, Thomas-Stonell NL, Robertson B, Rosenbaum P. Validity of a streamlined version of the Focus on the Outcomes of Communication Under Six: Process and outcome. Child Care Health Dev. 2019;45(April):600–5.PubMed
27.
go back to reference Cunningham BJ, Hanna SE, Rosenbaum P, Thomas-Stonell NL, Oddson B. Factors contributing to preschoolers’ communicative participation outcomes: findings from a population-based longitudinal cohort study in Ontario, Canada. Am J Speech-Language Pathol. 2018;27(2):737–50.CrossRef Cunningham BJ, Hanna SE, Rosenbaum P, Thomas-Stonell NL, Oddson B. Factors contributing to preschoolers’ communicative participation outcomes: findings from a population-based longitudinal cohort study in Ontario, Canada. Am J Speech-Language Pathol. 2018;27(2):737–50.CrossRef
28.
go back to reference Kwok EYL, Jane Cunningham B, Oram CJ. Effectiveness of a parent-implemented language intervention for late-to-talk children: a real-world retrospective clinical chart review. Int J Speech Lang Pathol. 2019;21:1–11.CrossRef Kwok EYL, Jane Cunningham B, Oram CJ. Effectiveness of a parent-implemented language intervention for late-to-talk children: a real-world retrospective clinical chart review. Int J Speech Lang Pathol. 2019;21:1–11.CrossRef
29.
go back to reference Trochim WM. An introduction to concept mapping for planning and evaluation. Eval Program Plann. 1989;12:1–16.CrossRef Trochim WM. An introduction to concept mapping for planning and evaluation. Eval Program Plann. 1989;12:1–16.CrossRef
30.
go back to reference Powell BJ, Stanick CF, Halko HM, Dorsey CN, Weiner BJ, Barwick MA, et al. Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping. Implement Sci. 2017;12(1):1–7.CrossRef Powell BJ, Stanick CF, Halko HM, Dorsey CN, Weiner BJ, Barwick MA, et al. Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping. Implement Sci. 2017;12(1):1–7.CrossRef
31.
go back to reference O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Heal Serv Res Policy. 2008;13(2):92–8.CrossRef O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Heal Serv Res Policy. 2008;13(2):92–8.CrossRef
33.
go back to reference Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.CrossRef Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.CrossRef
34.
go back to reference Bosch M, Van Der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRef Bosch M, Van Der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRef
35.
go back to reference Powell BJ, Haley AD, Patel SV, Amaya-jackson L, Glienke B, Blythe M, et al. Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the collaborative organizational approach to selecting and tailoring. Implemenration Sci Commun. 2020;5:1–13. Powell BJ, Haley AD, Patel SV, Amaya-jackson L, Glienke B, Blythe M, et al. Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the collaborative organizational approach to selecting and tailoring. Implemenration Sci Commun. 2020;5:1–13.
36.
go back to reference Lewis CC, Scott K, Marriott BR. A methodology for generating a tailored implementation blueprint: an exemplar from a youth residential setting. Implement Sci. 2018;13(1):1–13.CrossRef Lewis CC, Scott K, Marriott BR. A methodology for generating a tailored implementation blueprint: an exemplar from a youth residential setting. Implement Sci. 2018;13(1):1–13.CrossRef
37.
go back to reference Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Heal Res Policy Syst. 2019;3:1–10. Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Heal Res Policy Syst. 2019;3:1–10.
38.
go back to reference Mansell I, Bennett G, Northway R, Mead D. The learning curve: the advantages and disadvantages in the use of focus groups as a method of data collection. Nurse Res. 2004 Jul 1;11(4):79–88.CrossRef Mansell I, Bennett G, Northway R, Mead D. The learning curve: the advantages and disadvantages in the use of focus groups as a method of data collection. Nurse Res. 2004 Jul 1;11(4):79–88.CrossRef
39.
go back to reference Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76.CrossRef Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76.CrossRef
Metadata
Title
Selecting and tailoring implementation interventions: a concept mapping approach
Authors
Elaine Yuen Ling Kwok
Sheila T. F. Moodie
Barbara Jane Cunningham
Janis E. Oram Cardy
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2020
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-020-05270-x

Other articles of this Issue 1/2020

BMC Health Services Research 1/2020 Go to the issue