Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project

Authors: Byron J Powell, Thomas J Waltz, Matthew J Chinman, Laura J Damschroder, Jeffrey L Smith, Monica M Matthieu, Enola K Proctor, JoAnn E Kirchner

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Identifying, developing, and testing implementation strategies are important goals of implementation science. However, these efforts have been complicated by the use of inconsistent language and inadequate descriptions of implementation strategies in the literature. The Expert Recommendations for Implementing Change (ERIC) study aimed to refine a published compilation of implementation strategy terms and definitions by systematically gathering input from a wide range of stakeholders with expertise in implementation science and clinical practice.

Methods

Purposive sampling was used to recruit a panel of experts in implementation and clinical practice who engaged in three rounds of a modified Delphi process to generate consensus on implementation strategies and definitions. The first and second rounds involved Web-based surveys soliciting comments on implementation strategy terms and definitions. After each round, iterative refinements were made based upon participant feedback. The third round involved a live polling and consensus process via a Web-based platform and conference call.

Results

Participants identified substantial concerns with 31% of the terms and/or definitions and suggested five additional strategies. Seventy-five percent of definitions from the originally published compilation of strategies were retained after voting. Ultimately, the expert panel reached consensus on a final compilation of 73 implementation strategies.

Conclusions

This research advances the field by improving the conceptual clarity, relevance, and comprehensiveness of implementation strategies that can be used in isolation or combination in implementation research and practice. Future phases of ERIC will focus on developing conceptually distinct categories of strategies as well as ratings for each strategy’s importance and feasibility. Next, the expert panel will recommend multifaceted strategies for hypothetical yet real-world scenarios that vary by sites’ endorsement of evidence-based programs and practices and the strength of contextual supports that surround the effort.
Appendix
Available only for authorised users
Literature
1.
Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:1–11.CrossRef
2.
Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001.
3.
Institute of Medicine. Improving the quality of health care for mental and substance-use conditions. Washington, DC: National Academy Press; 2006.
4.
Institute of Medicine. Initial national priorities for comparative effectiveness research. Washington, DC: The National Academies Press; 2009.
5.
Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, et al. An implementation research agenda. Implement Sci. 2009;4:1–7.CrossRef
6.
Michie S, Fixsen DL, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:1–6.CrossRef
7.
McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, et al. A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a tower of Babel? Implement Sci. 2010;5:1–11.CrossRef
8.
Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:1–6.CrossRef
9.
Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert Recommendations for Implementing Change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9:1–12.CrossRef
10.
Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57.CrossRefPubMed
11.
Gerring J. Social science methodology: a criterial framework. Cambridge: Cambridge University Press; 2001.CrossRef
12.
Rabin BA, Brownson RC. Developing terminology for dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2012. p. 23–51.CrossRef
13.
Albrecht L, Archibald M, Arseneau D, Scott SD. Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013;8:1–5.CrossRef
14.
Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S. Publication guidelines for quality improvement in health care: evolution of the SQUIRE project. Qual Saf Health Care. 2008;17(Supplement 1):i3–9.CrossRefPubMedPubMedCentral
15.
Cochrane Effective Practice and Organisation of Care Group. Data collection checklist. 2002. p. 1–30.
16.
Leeman J, Baernholdt M, Sandelowski M. Developing a theory-based taxonomy of methods for implementing change in practice. J Adv Nurs. 2007;58:191–200.CrossRefPubMed
17.
Walter I, Nutley S, Davies H. Developing a taxonomy of interventions used to increase the impact of research. Andrews: University of St. Andrews of St. Andrews; 2003.
18.
Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci. 2013;8:1–10.CrossRef
19.
Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998;317:465–8.CrossRef
20.
Grimshaw JM, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006;21 Suppl 2:S14–20.PubMedPubMedCentral
21.
Grol R, Grimshaw JM. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.CrossRefPubMed
22.
Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, et al. Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006;296:427–40.CrossRefPubMed
23.
Cabana MD, Rushton JL, Rush J. Implementing practice guidelines for depression: applying a new framework to an old problem. Gen Hosp Psychiatry. 2002;24:35–42.CrossRefPubMed
24.
Gilbody S, Whitty P, Grimshaw JM, Thomas R. Educational and organizational interventions to improve the management of depression in primary care: a systematic review. JAMA. 2003;289:3145–51.CrossRefPubMed
25.
Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, et al. Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002;136:641–51.CrossRefPubMed
26.
Hysong SJ, Best RG, Pugh JA. Clinical practice guideline implementation strategy patterns in veterans affairs primary care clinics. Health Serv Res. 2007;42:84–103.CrossRefPubMedPubMedCentral
27.
Magnabosco JL. Innovations in mental health services implementation: a report on state-level data from the U.S. evidence-based practices project. Implement Sci. 2006;1:1–11.CrossRef
28.
Katon WJ, Zatzick D, Bond G, Williams J. Dissemination of evidence-based mental health interventions: importance to the trauma field. J Trauma Stress. 2006;19:611–23.CrossRefPubMed
29.
McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. Am Psychol. 2010;65:73–84.CrossRefPubMed
30.
Ryan R, Lowe D, Santesso N, Hill S. Development of a taxonomy of interventions directed at consumers to promote evidence-based prescribing and medicines use: a tool for evidence-based decision-making. Melbourne, Australia: In National Medicines Symposium; 2010.
31.
Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008;3:1–9.CrossRef
32.
Mathew D, McKibbon KA, Lokker C, Colquhoun H. Engaging with a wiki related to knowledge translation: a survey of WhatisKT Wiki user. J Med Internet Res. 2014;16:e21.CrossRefPubMedPubMedCentral
33.
Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health. 2013. doi:10.1007/s10488-013-0528-y.
34.
Stetler CB, Mittman BS, Francis J. Overview of the VA Quality Enhancement Research Initiative (QUERI) and QUERI theme articles: QUERI series. Implement Sci. 2008;3:1–9.CrossRef
35.
Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:1–12.CrossRef
36.
Hasson F, Keeney S. Enhancing rigor in the Delphi technique research. Technol Forecast Soc Change. 2011;78:1695–704.CrossRef
37.
Fishburn PC, Brams SJ. Expected utility and approval voting. Syst Res Behav Sci. 1981;26:136–42.CrossRef
38.
Brams SJ, Fishburn PC. Approval voting. Am Polit Sci Rev. 1978;72:831–47.CrossRef
39.
Oleszek WJ. Super-majority votes in the Senate. Washington, D.C.: Congressional Research Service; 2008. p. 1–3.
40.
41.
Davidoff F, Batalden P. Toward stronger evidence on quality improvement. Draft publication guidelines: the beginning of a consensus project. Qual Saf Health Care. 2005;14:319–25.CrossRefPubMedPubMedCentral
42.
Proctor EK, Rosen A. From knowledge production to implementation: research challenges and imperatives. Res Soc Work Pract. 2008;18:285–91.CrossRefPubMed
43.
Kane M, Trochim WMK. Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage; 2007.CrossRef
44.
Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more “business as usual” with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:1–8.CrossRef
45.
Nadeem E, Olin S, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91:354–94.CrossRefPubMedPubMedCentral
46.
Dorsey S, Pullman MD, Deblinger E, Berliner L, Kerns SE, Thompson K, et al. Improving practice in community-based settings: a randomized trial of supervision—study protocol. Implement Sci. 2013;8:1–11.CrossRef
47.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:1–15.CrossRef
48.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33.CrossRefPubMedPubMedCentral
49.
Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:1–17.CrossRef
50.
Rycroft-Malone J. The PARiHS framework: a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19:297–304.CrossRefPubMed
51.
52.
Shojania KG, McDonald KM, Wachter RM, Owens DK. Closing the quality gap: a critical analysis of quality improvement strategies, volume 1—series overview and methodology. Technical review 9. Agency for Healthcare Research and Quality: Rockville, MD; 2004.
53.
Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. In: Straus S, Tetroe J, Graham ID, editors. Knowledge translation in health care: moving from evidence to practice. Oxford, UK: Wiley-Blackwell; 2009. p. 94–113.
Metadata
Title
A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project
Authors
Byron J Powell
Thomas J Waltz
Matthew J Chinman
Laura J Damschroder
Jeffrey L Smith
Monica M Matthieu
Enola K Proctor
JoAnn E Kirchner
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0209-1

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue

Methodology

Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop

Research

Implementation of a cystic fibrosis lung transplant referral patient decision aid in routine clinical practice: an observational study

Research

A detailed report of the resource use and costs associated with implementation of a short stay programme for breast cancer surgery

Systematic review

The effectiveness of knowledge translation interventions for promoting evidence-informed decision-making among nurses in tertiary care: a systematic review and meta-analysis

Debate

Hiding in plain sight: communication theory in implementation science

Research

Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts