Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Study protocol

Expert recommendations for implementing change (ERIC): protocol for a mixed methods study

Authors: Thomas J Waltz, Byron J Powell, Matthew J Chinman, Jeffrey L Smith, Monica M Matthieu, Enola K Proctor, Laura J Damschroder, JoAnn E Kirchner

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Identifying feasible and effective implementation strategies that are contextually appropriate is a challenge for researchers and implementers, exacerbated by the lack of conceptual clarity surrounding terms and definitions for implementation strategies, as well as a literature that provides imperfect guidance regarding how one might select strategies for a given healthcare quality improvement effort. In this study, we will engage an Expert Panel comprising implementation scientists and mental health clinical managers to: establish consensus on a common nomenclature for implementation strategy terms, definitions and categories; and develop recommendations to enhance the match between implementation strategies selected to facilitate the use of evidence-based programs and the context of certain service settings, in this case the U.S. Department of Veterans Affairs (VA) mental health services.

Methods/Design

This study will use purposive sampling to recruit an Expert Panel comprising implementation science experts and VA mental health clinical managers. A novel, four-stage sequential mixed methods design will be employed. During Stage 1, the Expert Panel will participate in a modified Delphi process in which a published taxonomy of implementation strategies will be used to establish consensus on terms and definitions for implementation strategies. In Stage 2, the panelists will complete a concept mapping task, which will yield conceptually distinct categories of implementation strategies as well as ratings of the feasibility and effectiveness of each strategy. Utilizing the common nomenclature developed in Stages 1 and 2, panelists will complete an innovative menu-based choice task in Stage 3 that involves matching implementation strategies to hypothetical implementation scenarios with varying contexts. This allows for quantitative characterizations of the relative necessity of each implementation strategy for a given scenario. In Stage 4, a live web-based facilitated expert recommendation process will be employed to establish expert recommendations about which implementations strategies are essential for each phase of implementation in each scenario.

Discussion

Using a novel method of selecting implementation strategies for use within specific contexts, this study contributes to our understanding of implementation science and practice by sharpening conceptual distinctions among a comprehensive collection of implementation strategies.
Appendix
Available only for authorised users
Literature
2.
go back to reference Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP: A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013, 8: 1-11. 10.1186/1748-5908-8-1.CrossRef Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP: A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013, 8: 1-11. 10.1186/1748-5908-8-1.CrossRef
3.
go back to reference Department of Veterans Affairs: Uniform Mental Health Services in VA Medical Centers and Clinics. 2008, Washington, D.C: Department of Veterans Affairs, 1-43. Department of Veterans Affairs: Uniform Mental Health Services in VA Medical Centers and Clinics. 2008, Washington, D.C: Department of Veterans Affairs, 1-43.
4.
go back to reference Stetler CB, Mittman BS, Francis J: Overview of the VA quality enhancement research initiative (QUERI) and QUERI theme articles: QUERI series. Implement Sci. 2008, 3: 8-10.1186/1748-5908-3-8.CrossRefPubMedPubMedCentral Stetler CB, Mittman BS, Francis J: Overview of the VA quality enhancement research initiative (QUERI) and QUERI theme articles: QUERI series. Implement Sci. 2008, 3: 8-10.1186/1748-5908-3-8.CrossRefPubMedPubMedCentral
5.
go back to reference McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus S: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: A Tower of Babel?. Implement Sci. 2010, 5: 1-11. 10.1186/1748-5908-5-1.CrossRef McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus S: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: A Tower of Babel?. Implement Sci. 2010, 5: 1-11. 10.1186/1748-5908-5-1.CrossRef
6.
go back to reference Michie S, Fixsen DL, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 1-6. 10.1186/1748-5908-4-1.CrossRef Michie S, Fixsen DL, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 1-6. 10.1186/1748-5908-4-1.CrossRef
7.
go back to reference Rabin BA, Brownson RC, Joshu-Haire D, Kreuter MW, Weaver NL: A glossary of dissemination and implementation research in health. J Public Health Manag. 2008, 14: 117-123. 10.1097/01.PHH.0000311888.06252.bb.CrossRef Rabin BA, Brownson RC, Joshu-Haire D, Kreuter MW, Weaver NL: A glossary of dissemination and implementation research in health. J Public Health Manag. 2008, 14: 117-123. 10.1097/01.PHH.0000311888.06252.bb.CrossRef
8.
go back to reference Rabin BA, Brownson RC: Developing terminology for dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press, 23-51.CrossRef Rabin BA, Brownson RC: Developing terminology for dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press, 23-51.CrossRef
9.
go back to reference Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012, 69: 123-157. 10.1177/1077558711430690.CrossRefPubMed Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012, 69: 123-157. 10.1177/1077558711430690.CrossRefPubMed
10.
go back to reference Proctor EK, Powell BJ, McMillen JC: Implementation strategies: Recommendations for specifying and reporting. Implement Sci. 2013, 8: 1-11. 10.1186/1748-5908-8-1.CrossRef Proctor EK, Powell BJ, McMillen JC: Implementation strategies: Recommendations for specifying and reporting. Implement Sci. 2013, 8: 1-11. 10.1186/1748-5908-8-1.CrossRef
11.
go back to reference Gerring J: Social Science Methodology: A Criterial Framework. 2001, Cambridge: Cambridge University PressCrossRef Gerring J: Social Science Methodology: A Criterial Framework. 2001, Cambridge: Cambridge University PressCrossRef
12.
go back to reference Kauth MR, Sullivan G, Cully J, Blevins D: Facilitating practice changes in mental health clinics: A guide for implementation development in health care systems. Psychol Serv. 2011, 8: 36-47.CrossRef Kauth MR, Sullivan G, Cully J, Blevins D: Facilitating practice changes in mental health clinics: A guide for implementation development in health care systems. Psychol Serv. 2011, 8: 36-47.CrossRef
13.
go back to reference Brouwers MC, De Vito C, Bahirathan L, Carol A, Carroll JC, Cotterchio M, Dobbins M, Lent B, Levitt C, Lewis N, McGregor SE, Paszat L, Rand C, Wathen N: What implementation efforts increase cancer screening rates? A systematic review. Implement Sci. 2011, 6: 1-17. 10.1186/1748-5908-6-1.CrossRef Brouwers MC, De Vito C, Bahirathan L, Carol A, Carroll JC, Cotterchio M, Dobbins M, Lent B, Levitt C, Lewis N, McGregor SE, Paszat L, Rand C, Wathen N: What implementation efforts increase cancer screening rates? A systematic review. Implement Sci. 2011, 6: 1-17. 10.1186/1748-5908-6-1.CrossRef
15.
go back to reference Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, Kunnamo I: Refining a taxonomy for guideline implementation: Results of an exercise in abstract classification. Implement Sci. 2013, 8: 1-10. 10.1186/1748-5908-8-1.CrossRef Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, Kunnamo I: Refining a taxonomy for guideline implementation: Results of an exercise in abstract classification. Implement Sci. 2013, 8: 1-10. 10.1186/1748-5908-8-1.CrossRef
16.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013, 46: 81-95. 10.1007/s12160-013-9486-6.CrossRefPubMed Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013, 46: 81-95. 10.1007/s12160-013-9486-6.CrossRefPubMed
18.
go back to reference Albrecht L, Archibald M, Arseneau D, Scott SD: Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013, 8: 1-5. 10.1186/1748-5908-8-1.CrossRef Albrecht L, Archibald M, Arseneau D, Scott SD: Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013, 8: 1-5. 10.1186/1748-5908-8-1.CrossRef
19.
go back to reference Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE: Knowledge translation of research findings. Implement Sci. 2012, 7: 1-17. 10.1186/1748-5908-7-1.CrossRef Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE: Knowledge translation of research findings. Implement Sci. 2012, 7: 1-17. 10.1186/1748-5908-7-1.CrossRef
21.
go back to reference Landsverk J, Brown CH, Rolls Reutz J, Palinkas LA, Horwitz SM: Design elements in implementation research: A structured review of child welfare and child mental health studies. Adm Policy Ment Health Ment Health Serv Res. 2011, 38: 54-63. 10.1007/s10488-010-0315-y.CrossRef Landsverk J, Brown CH, Rolls Reutz J, Palinkas LA, Horwitz SM: Design elements in implementation research: A structured review of child welfare and child mental health studies. Adm Policy Ment Health Ment Health Serv Res. 2011, 38: 54-63. 10.1007/s10488-010-0315-y.CrossRef
22.
go back to reference Goldner EM, Jeffries V, Bilsker D, Jenkins E, Menear M, Petermann L: Knowledge translation in mental health: A scoping review. Healthcare Policy. 2011, 7: 83-98.PubMedPubMedCentral Goldner EM, Jeffries V, Bilsker D, Jenkins E, Menear M, Petermann L: Knowledge translation in mental health: A scoping review. Healthcare Policy. 2011, 7: 83-98.PubMedPubMedCentral
23.
go back to reference Powell BJ, Proctor EK, Glass JE: A systematic review of strategies for implementing empirically supported mental health interventions. Res Soc Work Pract. 2014, 24: 192-212. 10.1177/1049731513505778.CrossRefPubMed Powell BJ, Proctor EK, Glass JE: A systematic review of strategies for implementing empirically supported mental health interventions. Res Soc Work Pract. 2014, 24: 192-212. 10.1177/1049731513505778.CrossRefPubMed
24.
go back to reference Novins DK, Green AE, Legha RK, Aarons GA: Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. J Am Acad Child Adolesc Psychiatry. 2013, 52: 1009-1025. 10.1016/j.jaac.2013.07.012. e18CrossRefPubMedPubMedCentral Novins DK, Green AE, Legha RK, Aarons GA: Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. J Am Acad Child Adolesc Psychiatry. 2013, 52: 1009-1025. 10.1016/j.jaac.2013.07.012. e18CrossRefPubMedPubMedCentral
25.
go back to reference Herschell AD, Kolko DJ, Baumann BL, Davis AC: The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clin Psychol Rev. 2010, 30: 448-466. 10.1016/j.cpr.2010.02.005.CrossRefPubMedPubMedCentral Herschell AD, Kolko DJ, Baumann BL, Davis AC: The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clin Psychol Rev. 2010, 30: 448-466. 10.1016/j.cpr.2010.02.005.CrossRefPubMedPubMedCentral
26.
go back to reference McHugh RK, Barlow DH: Training in evidence-based psychological interventions. Dissemination and Implementation of Evidence-Based Psychological Interventions. Edited by: McHugh RK, Barlow DH. 2012, New York: Oxford University Press, 43-58. McHugh RK, Barlow DH: Training in evidence-based psychological interventions. Dissemination and Implementation of Evidence-Based Psychological Interventions. Edited by: McHugh RK, Barlow DH. 2012, New York: Oxford University Press, 43-58.
27.
go back to reference Vale L, Thomas R, MacLennan G, Grimshaw J: Systematic review of economic evaluations and cost analyses of guideline implementation strategies. Eur J Health Econ. 2007, 8: 111-121. 10.1007/s10198-007-0043-8.CrossRefPubMed Vale L, Thomas R, MacLennan G, Grimshaw J: Systematic review of economic evaluations and cost analyses of guideline implementation strategies. Eur J Health Econ. 2007, 8: 111-121. 10.1007/s10198-007-0043-8.CrossRefPubMed
28.
go back to reference Raghavan R: The role of economic evaluation in dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press, 94-113.CrossRef Raghavan R: The role of economic evaluation in dissemination and implementation research. Dissemination and implementation research in health: Translating science to practice. Edited by: Brownson RC, Colditz GA, Proctor EK. 2012, New York: Oxford University Press, 94-113.CrossRef
29.
go back to reference Fogliatto FS, da Silveira GJC, Borenstein D: The mass customization decade: An updated review of the literature. Int J Prod Econ. 2012, 138: 14-25. 10.1016/j.ijpe.2012.03.002.CrossRef Fogliatto FS, da Silveira GJC, Borenstein D: The mass customization decade: An updated review of the literature. Int J Prod Econ. 2012, 138: 14-25. 10.1016/j.ijpe.2012.03.002.CrossRef
30.
go back to reference Sonsino D, Mandelbaum M: On preference for flexibility and complexity aversion: Experimental evidence. Implement Sci. 2001, 51: 197-216. Sonsino D, Mandelbaum M: On preference for flexibility and complexity aversion: Experimental evidence. Implement Sci. 2001, 51: 197-216.
31.
go back to reference Dallaert BGC, Stremersh S: Marketing mass-customized products: Striking a balance between utility and complexity. J Mark Res. 2005, 42: 219-227. 10.1509/jmkr.42.2.219.62293.CrossRef Dallaert BGC, Stremersh S: Marketing mass-customized products: Striking a balance between utility and complexity. J Mark Res. 2005, 42: 219-227. 10.1509/jmkr.42.2.219.62293.CrossRef
32.
go back to reference Grol R, Bosch MC, Hulscher MEJ, Eccles MP, Wensing M: Planning and studying improvement in patient care: The use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral Grol R, Bosch MC, Hulscher MEJ, Eccles MP, Wensing M: Planning and studying improvement in patient care: The use of theoretical perspectives. Milbank Q. 2007, 85: 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral
33.
go back to reference Tabak RG, Khoong EC, Chambers DA, Brownson RC: Bridging research and practice: Models for dissemination and implementation research. Am J Prev Med. 2012, 43: 337-350. 10.1016/j.amepre.2012.05.024.CrossRefPubMedPubMedCentral Tabak RG, Khoong EC, Chambers DA, Brownson RC: Bridging research and practice: Models for dissemination and implementation research. Am J Prev Med. 2012, 43: 337-350. 10.1016/j.amepre.2012.05.024.CrossRefPubMedPubMedCentral
34.
go back to reference Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 1-6. 10.1186/1748-5908-5-1.CrossRef Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 1-6. 10.1186/1748-5908-5-1.CrossRef
35.
go back to reference Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Cahlifoux M, Eva KW: A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013, 8: 1-8. 10.1186/1748-5908-8-1.CrossRef Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Cahlifoux M, Eva KW: A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013, 8: 1-8. 10.1186/1748-5908-8-1.CrossRef
36.
go back to reference Bhattacharyya O, Reeves S, Garfinkel S, Zwarenstein M: Designing theoretically-informed implementation interventions: Fine in theory, but evidence of effectiveness in practice is needed. Implement Sci. 2006, 1: 1-3. 10.1186/1748-5908-1-1.CrossRef Bhattacharyya O, Reeves S, Garfinkel S, Zwarenstein M: Designing theoretically-informed implementation interventions: Fine in theory, but evidence of effectiveness in practice is needed. Implement Sci. 2006, 1: 1-3. 10.1186/1748-5908-1-1.CrossRef
37.
go back to reference Oxman AD, Fretheim A, Flottorp S: The OFF theory of research utilization. J Clin Epidemiol. 2005, 58: 113-116. 10.1016/j.jclinepi.2004.10.002.CrossRefPubMed Oxman AD, Fretheim A, Flottorp S: The OFF theory of research utilization. J Clin Epidemiol. 2005, 58: 113-116. 10.1016/j.jclinepi.2004.10.002.CrossRefPubMed
38.
go back to reference Rogers EM: Diffusion of Innovations. 2003, New York: Free Press, 5 Rogers EM: Diffusion of Innovations. 2003, New York: Free Press, 5
40.
go back to reference Isett KR, Burnam MA, Coleman-Beattie B, Hyde PS, Morrissey JP, Magnabosco J, Rapp CA, Ganju V, Goldman HH: The state policy context of implementation issues for evidence-based practices in mental health. Psychiatr Serv. 2007, 58: 914-921. 10.1176/appi.ps.58.7.914.CrossRefPubMed Isett KR, Burnam MA, Coleman-Beattie B, Hyde PS, Morrissey JP, Magnabosco J, Rapp CA, Ganju V, Goldman HH: The state policy context of implementation issues for evidence-based practices in mental health. Psychiatr Serv. 2007, 58: 914-921. 10.1176/appi.ps.58.7.914.CrossRefPubMed
41.
go back to reference Magnabosco JL: Innovations in mental health services implementation: A report on state-level data from the U.S. evidence-based practices project. Implement Sci. 2006, 1: 1-11. 10.1186/1748-5908-1-1.CrossRef Magnabosco JL: Innovations in mental health services implementation: A report on state-level data from the U.S. evidence-based practices project. Implement Sci. 2006, 1: 1-11. 10.1186/1748-5908-1-1.CrossRef
43.
go back to reference Spring B: Health decision making: Lynchpin of evidence-based practice. Med Decis Mak. 2008, 28: 866-874. 10.1177/0272989X08326146.CrossRef Spring B: Health decision making: Lynchpin of evidence-based practice. Med Decis Mak. 2008, 28: 866-874. 10.1177/0272989X08326146.CrossRef
44.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 1-15. 10.1186/1748-5908-4-1.CrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 1-15. 10.1186/1748-5908-4-1.CrossRef
45.
go back to reference Aarons GA, Cafri G, Lugo L, Sawitzky A: Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Attitudes Scale-50. Adm Policy Ment Health Ment Health Serv Res. 2012, 39: 331-340. 10.1007/s10488-010-0302-3.CrossRef Aarons GA, Cafri G, Lugo L, Sawitzky A: Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Attitudes Scale-50. Adm Policy Ment Health Ment Health Serv Res. 2012, 39: 331-340. 10.1007/s10488-010-0302-3.CrossRef
46.
go back to reference Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, Green P: Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health Ment Health Serv Res. 2008, 35: 98-113. 10.1007/s10488-007-0148-5.CrossRef Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, Green P: Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health Ment Health Serv Res. 2008, 35: 98-113. 10.1007/s10488-007-0148-5.CrossRef
47.
go back to reference Weiner BJ, Belden CM, Bergmire DM, Johnston M: The meaning and measurement of implementation climate. Implement Sci. 2011, 6: 1-12. 10.1186/1748-5908-6-1.CrossRef Weiner BJ, Belden CM, Bergmire DM, Johnston M: The meaning and measurement of implementation climate. Implement Sci. 2011, 6: 1-12. 10.1186/1748-5908-6-1.CrossRef
48.
go back to reference Weiner BJ, Amick H, Lee S-YD YD: Conceptualization and measurement of organizational readiness for change: A review of the literature in health services research and other fields. Med Care Res Rev. 2008, 65: 379-436. 10.1177/1077558708317802.CrossRefPubMed Weiner BJ, Amick H, Lee S-YD YD: Conceptualization and measurement of organizational readiness for change: A review of the literature in health services research and other fields. Med Care Res Rev. 2008, 65: 379-436. 10.1177/1077558708317802.CrossRefPubMed
49.
go back to reference Aarons GA, Sommerfeld DH: Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012, 51: 423-431. 10.1016/j.jaac.2012.01.018.CrossRefPubMed Aarons GA, Sommerfeld DH: Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012, 51: 423-431. 10.1016/j.jaac.2012.01.018.CrossRefPubMed
50.
go back to reference Corrigan PW, Lickey SE, Campion J, Rashid F: Mental health team leadership and consumers’ satisfaction and quality of life. Psychiatr Serv. 2000, 51: 781-785. 10.1176/appi.ps.51.6.781.CrossRefPubMed Corrigan PW, Lickey SE, Campion J, Rashid F: Mental health team leadership and consumers’ satisfaction and quality of life. Psychiatr Serv. 2000, 51: 781-785. 10.1176/appi.ps.51.6.781.CrossRefPubMed
51.
go back to reference Schell SF, Luke DA, Schooley MW, Elliott MB, Herbers SH, Mueller NB, Bunger AC: Public health program capacity for sustainability: A new framework. Implement Sci. 2013, 8: 1-9. 10.1186/1748-5908-8-1.CrossRef Schell SF, Luke DA, Schooley MW, Elliott MB, Herbers SH, Mueller NB, Bunger AC: Public health program capacity for sustainability: A new framework. Implement Sci. 2013, 8: 1-9. 10.1186/1748-5908-8-1.CrossRef
53.
go back to reference Kimberly JR, Cook JM: Organizational measurement and the implementation of innovations in mental health services. Adm Policy Ment Health Ment Health Serv Res. 2008, 35: 11-20. 10.1007/s10488-007-0143-x.CrossRef Kimberly JR, Cook JM: Organizational measurement and the implementation of innovations in mental health services. Adm Policy Ment Health Ment Health Serv Res. 2008, 35: 11-20. 10.1007/s10488-007-0143-x.CrossRef
54.
go back to reference Raghavan R, Bright CL, Shadoin AL: Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008, 3: 1-9. 10.1186/1748-5908-3-1.CrossRef Raghavan R, Bright CL, Shadoin AL: Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008, 3: 1-9. 10.1186/1748-5908-3-1.CrossRef
55.
go back to reference Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, Grimshaw J, Eccles M: Tailored implementation for chronic diseases (TICD): A project protocol. Implement Sci. 2011, 6: 1-8. 10.1186/1748-5908-6-1.CrossRef Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, Grimshaw J, Eccles M: Tailored implementation for chronic diseases (TICD): A project protocol. Implement Sci. 2011, 6: 1-8. 10.1186/1748-5908-6-1.CrossRef
56.
go back to reference Baker R, Cammosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, 3: 1-77. Art. No.: CD005470 Baker R, Cammosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, 3: 1-77. Art. No.: CD005470
57.
go back to reference Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J: Mixed methods designs in implementation research. Adm Policy Ment Health Ment Health Serv Res. 2011, 38: 44-53. 10.1007/s10488-010-0314-z.CrossRef Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J: Mixed methods designs in implementation research. Adm Policy Ment Health Ment Health Serv Res. 2011, 38: 44-53. 10.1007/s10488-010-0314-z.CrossRef
58.
go back to reference Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, Glisson CA, Chambers D: The implementation research institute: Training mental health implementation researchers in the United States. Implement Sci. 2013, 8: 1-12. 10.1186/1748-5908-8-1.CrossRef Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, Glisson CA, Chambers D: The implementation research institute: Training mental health implementation researchers in the United States. Implement Sci. 2013, 8: 1-12. 10.1186/1748-5908-8-1.CrossRef
59.
go back to reference Sanders IT: The Community: An Introduction to a Social System. 1966, New York: Ronald Press, 2 Sanders IT: The Community: An Introduction to a Social System. 1966, New York: Ronald Press, 2
60.
go back to reference Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K: Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health. 2013, in press Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K: Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health. 2013, in press
61.
go back to reference Murphy MK, Black N, Lamping DL, McKee CM, Sanderson CFB, Askham J, Marteau T: Consensus development methods and their use in clinical guideline development. Health Technol Assess. 1998, 2: 1-88. Murphy MK, Black N, Lamping DL, McKee CM, Sanderson CFB, Askham J, Marteau T: Consensus development methods and their use in clinical guideline development. Health Technol Assess. 1998, 2: 1-88.
62.
go back to reference Collins KMT: Advanced sampling designs in mixed research: Current practices and emerging trends in the social and behavioral sciences. Sage handbook of mixed methods in social and beavhioral research. Edited by: Tachakkori A, Teddlie C. 2010, Thousand Oaks, CA: Sage, 353-377. 2CrossRef Collins KMT: Advanced sampling designs in mixed research: Current practices and emerging trends in the social and behavioral sciences. Sage handbook of mixed methods in social and beavhioral research. Edited by: Tachakkori A, Teddlie C. 2010, Thousand Oaks, CA: Sage, 353-377. 2CrossRef
63.
go back to reference Hasson F, Keeney S: Enhancing rigor in the Delphi technique research. Technological Forecasting Soc Change. 2011, 78: 1695-1704. 10.1016/j.techfore.2011.04.005.CrossRef Hasson F, Keeney S: Enhancing rigor in the Delphi technique research. Technological Forecasting Soc Change. 2011, 78: 1695-1704. 10.1016/j.techfore.2011.04.005.CrossRef
64.
go back to reference Nambisan S, Agarwal R, Tanniru M: Organizational mechanisms for enhancing user innovation in information technology. MIS Q. 1999, 23: 365-395. 10.2307/249468.CrossRef Nambisan S, Agarwal R, Tanniru M: Organizational mechanisms for enhancing user innovation in information technology. MIS Q. 1999, 23: 365-395. 10.2307/249468.CrossRef
65.
go back to reference Fishburn PC, Brams SJ: Expected utility and approval voting. Syst Res Behav Sci. 1981, 26: 136-142.CrossRef Fishburn PC, Brams SJ: Expected utility and approval voting. Syst Res Behav Sci. 1981, 26: 136-142.CrossRef
66.
go back to reference Burke JK, O’Campo P, Peak GL, Gielen AC, McDonnel KA, Trochim WMK: An introduction to concept mapping as a participatory public health research method. Qual Health Res. 2005, 15: 1392-1410. 10.1177/1049732305278876.CrossRefPubMed Burke JK, O’Campo P, Peak GL, Gielen AC, McDonnel KA, Trochim WMK: An introduction to concept mapping as a participatory public health research method. Qual Health Res. 2005, 15: 1392-1410. 10.1177/1049732305278876.CrossRefPubMed
68.
go back to reference Trochim WMK, Kane M: Concept mapping: An introduction to structured conceptualization in health care. Int J Qual Health Care. 2005, 17: 187-191. 10.1093/intqhc/mzi038.CrossRefPubMed Trochim WMK, Kane M: Concept mapping: An introduction to structured conceptualization in health care. Int J Qual Health Care. 2005, 17: 187-191. 10.1093/intqhc/mzi038.CrossRefPubMed
69.
go back to reference Brownson RC, Kelly CM, Eyler AA, Carnoske C, Grost L, Handy SL, Maddock JE, Pluto D, Ritacco BA, Sallis JF, Schmid TL: Environmental and policy approaches for promoting physical activity in the United States: A research agenda. J Phys Act Health. 2008, 5: 488-503.PubMed Brownson RC, Kelly CM, Eyler AA, Carnoske C, Grost L, Handy SL, Maddock JE, Pluto D, Ritacco BA, Sallis JF, Schmid TL: Environmental and policy approaches for promoting physical activity in the United States: A research agenda. J Phys Act Health. 2008, 5: 488-503.PubMed
70.
go back to reference Green AE, Aarons GA: A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011, 6: 1-12. 10.1186/1748-5908-6-1.CrossRef Green AE, Aarons GA: A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011, 6: 1-12. 10.1186/1748-5908-6-1.CrossRef
71.
go back to reference Trochim WMK: The reliability of concept mapping. 1993, Dallas, Texas Trochim WMK: The reliability of concept mapping. 1993, Dallas, Texas
72.
go back to reference Orme BK: Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research. 2010, Madison, WI: Research Publishers Orme BK: Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research. 2010, Madison, WI: Research Publishers
73.
go back to reference Johnson RB, Orme B, Pinnell J: Simulating market preference with “build your own” data. Sawtooth Software Conference Proceedings: 29-31 March 2006. 2006, Delray Beach, FL: Oren, UT: Sawtooth Software, Inc., 239-253. Johnson RB, Orme B, Pinnell J: Simulating market preference with “build your own” data. Sawtooth Software Conference Proceedings: 29-31 March 2006. 2006, Delray Beach, FL: Oren, UT: Sawtooth Software, Inc., 239-253.
74.
go back to reference Orme B: Menu-Based Choice (MBC) for Multi-Check Choice Experiments. 2012, Oren, UT: Sawtooth Software, Inc. Orme B: Menu-Based Choice (MBC) for Multi-Check Choice Experiments. 2012, Oren, UT: Sawtooth Software, Inc.
Metadata
Title
Expert recommendations for implementing change (ERIC): protocol for a mixed methods study
Authors
Thomas J Waltz
Byron J Powell
Matthew J Chinman
Jeffrey L Smith
Monica M Matthieu
Enola K Proctor
Laura J Damschroder
JoAnn E Kirchner
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-39

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue