Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Methodology

Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation

Authors: Rosalind E. Keith, Jesse C. Crosson, Ann S. O’Malley, DeAnn Cromp, Erin Fries Taylor

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

Much research does not address the practical needs of stakeholders responsible for introducing health care delivery interventions into organizations working to achieve better outcomes. In this article, we present an approach to using the Consolidated Framework for Implementation Research (CFIR) to guide systematic research that supports rapid-cycle evaluation of the implementation of health care delivery interventions and produces actionable evaluation findings intended to improve implementation in a timely manner.

Methods

To present our approach, we describe a formative cross-case qualitative investigation of 21 primary care practices participating in the Comprehensive Primary Care (CPC) initiative, a multi-payer supported primary care practice transformation intervention led by the Centers for Medicare and Medicaid Services. Qualitative data include observational field notes and semi-structured interviews with primary care practice leadership, clinicians, and administrative and medical support staff. We use intervention-specific codes, and CFIR constructs to reduce and organize the data to support cross-case analysis of patterns of barriers and facilitators relating to different CPC components.

Results

Using the CFIR to guide data collection, coding, analysis, and reporting of findings supported a systematic, comprehensive, and timely understanding of barriers and facilitators to practice transformation. Our approach to using the CFIR produced actionable findings for improving implementation effectiveness during this initiative and for identifying improvements to implementation strategies for future practice transformation efforts.

Conclusions

The CFIR is a useful tool for guiding rapid-cycle evaluation of the implementation of practice transformation initiatives. Using the approach described here, we systematically identified where adjustments and refinements to the intervention could be made in the second year of the 4-year intervention. We think the approach we describe has broad application and encourage others to use the CFIR, along with intervention-specific codes, to guide the efficient and rigorous analysis of rich qualitative data.

Trial registration

Appendix
Available only for authorised users
Literature
2.
go back to reference Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48–55.CrossRefPubMed Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48–55.CrossRefPubMed
3.
go back to reference Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2014;11(S1):S115–23. Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2014;11(S1):S115–23.
4.
go back to reference Kessler R, Glasgow RE. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med. 2011;40(6):637–44.CrossRefPubMed Kessler R, Glasgow RE. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med. 2011;40(6):637–44.CrossRefPubMed
5.
go back to reference Peek CJ, Glasgow RE, Stange KC, Klesge LM, Purcell EP, Kessler RS. The 5 R’s: an emerging bold standard for conducting relevant research in a changing world. Ann Fam Med. 2014;12(5):447–55.CrossRefPubMedPubMedCentral Peek CJ, Glasgow RE, Stange KC, Klesge LM, Purcell EP, Kessler RS. The 5 R’s: an emerging bold standard for conducting relevant research in a changing world. Ann Fam Med. 2014;12(5):447–55.CrossRefPubMedPubMedCentral
6.
go back to reference Shrank W. The Center for Medicare and Medicaid Innovation’s blueprint for rapid-cycle evaluation of new care and payment models. Health Aff. 2013;32(4):807–12.CrossRef Shrank W. The Center for Medicare and Medicaid Innovation’s blueprint for rapid-cycle evaluation of new care and payment models. Health Aff. 2013;32(4):807–12.CrossRef
7.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRefPubMedPubMedCentral Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRefPubMedPubMedCentral
8.
go back to reference Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks: Sage Publications; 1994. Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks: Sage Publications; 1994.
9.
go back to reference Center for Clinical Management Research. Consolidated framework for implementation research. Ann Arbor: Center for Clinical Management Research; 2014. Available from: http://cfirguide.org/. Accessed 3 Feb 2016 Center for Clinical Management Research. Consolidated framework for implementation research. Ann Arbor: Center for Clinical Management Research; 2014. Available from: http://​cfirguide.​org/​.​ Accessed 3 Feb 2016
10.
go back to reference Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51.CrossRefPubMedPubMedCentral Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51.CrossRefPubMedPubMedCentral
12.
go back to reference Taylor EF, Dale S, Peikes D, Brown R, Ghosh A, Crosson J, Anglin G, Keith R, Shapiro R. Evaluation of the Comprehensive Primary Care Initiative: first annual report. Princeton: Mathematica Policy Research; 2015. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services. Taylor EF, Dale S, Peikes D, Brown R, Ghosh A, Crosson J, Anglin G, Keith R, Shapiro R. Evaluation of the Comprehensive Primary Care Initiative: first annual report. Princeton: Mathematica Policy Research; 2015. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services.
13.
go back to reference Dale SB, Ghosh A, Peikes DN, Day TJ, Yoon FB, Taylor EF, Swankoski K, O’Malley AS, Conway PH, Rajkumar R, Press MJ, Sessums L, Brown R. Two-year costs and quality in the Comprehensive Primary Care Initiative. N Engl J Med. 2016;374(24):2345–56.CrossRefPubMed Dale SB, Ghosh A, Peikes DN, Day TJ, Yoon FB, Taylor EF, Swankoski K, O’Malley AS, Conway PH, Rajkumar R, Press MJ, Sessums L, Brown R. Two-year costs and quality in the Comprehensive Primary Care Initiative. N Engl J Med. 2016;374(24):2345–56.CrossRefPubMed
14.
go back to reference Peikes D, Taylor EF, Dale S, O’Malley A, Ghosh A, Anglin G, Swankoski K, Zutshi A, Converse L, Brown R. Evaluation of the Comprehensive Primary Care Initiative: second annual report. Princeton: v; 2016. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services. Peikes D, Taylor EF, Dale S, O’Malley A, Ghosh A, Anglin G, Swankoski K, Zutshi A, Converse L, Brown R. Evaluation of the Comprehensive Primary Care Initiative: second annual report. Princeton: v; 2016. Report prepared for the U.S. Department of Health and Human Services, Centers for Medicare & Medicaid Services.
15.
go back to reference King N. Doing template analysis. In: Cassell C, Symon G, editors. Qualitative organizational research: core methods and current challenges. London: Sage; 2012. p. 426–50. King N. Doing template analysis. In: Cassell C, Symon G, editors. Qualitative organizational research: core methods and current challenges. London: Sage; 2012. p. 426–50.
16.
go back to reference Sinkovics RR, Alfoldi EA. Facilitating the interaction between theory and data in qualitative research using CAQDAS. In: Cassell C, Symon G, editors. Qualitative organizational research: core methods and current challenges. London: Sage; 2012. p. 109–31. Sinkovics RR, Alfoldi EA. Facilitating the interaction between theory and data in qualitative research using CAQDAS. In: Cassell C, Symon G, editors. Qualitative organizational research: core methods and current challenges. London: Sage; 2012. p. 109–31.
17.
go back to reference Mason J. Qualitative researching. 2nd ed. London: Sage Publications; 2002. Mason J. Qualitative researching. 2nd ed. London: Sage Publications; 2002.
18.
go back to reference Friese S. ATLAS.ti 7.5.Version 7. Berlin: ATLAS.ti Scientific Software Development GmbH; 2015. Available from: http://atlasti.com/. Accessed 23 Mar 2016 Friese S. ATLAS.ti 7.5.Version 7. Berlin: ATLAS.ti Scientific Software Development GmbH; 2015. Available from: http://​atlasti.​com/​.​ Accessed 23 Mar 2016
19.
go back to reference Miles MB, Huberman AM, Saldaña J. Qualitative data analysis: a methods sourcebook. 3rd ed. Thousand Oaks: Sage Publications; 2014. Miles MB, Huberman AM, Saldaña J. Qualitative data analysis: a methods sourcebook. 3rd ed. Thousand Oaks: Sage Publications; 2014.
20.
go back to reference Etz RS, Keith RE, Maternick AM, Stein KL, Sabo RT, Hayes MS, Sevak P, Holland J, Crosson JC. Supporting practices to adopt registry-based care (SPARC): protocol for a randomized controlled trial. Implement Sci. 2015;10:46.CrossRefPubMedPubMedCentral Etz RS, Keith RE, Maternick AM, Stein KL, Sabo RT, Hayes MS, Sevak P, Holland J, Crosson JC. Supporting practices to adopt registry-based care (SPARC): protocol for a randomized controlled trial. Implement Sci. 2015;10:46.CrossRefPubMedPubMedCentral
21.
go back to reference Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008;35(1):21–37.CrossRefPubMed Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008;35(1):21–37.CrossRefPubMed
22.
go back to reference Kottke TE, Solberg LI, Nelson AF, Belcher DW, Caplan W, Green LW, et al. Optimizing practice through research: a new perspective to solve an old problem. Ann Fam Med. 2008;6(5):459–62.CrossRefPubMedPubMedCentral Kottke TE, Solberg LI, Nelson AF, Belcher DW, Caplan W, Green LW, et al. Optimizing practice through research: a new perspective to solve an old problem. Ann Fam Med. 2008;6(5):459–62.CrossRefPubMedPubMedCentral
Metadata
Title
Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation
Authors
Rosalind E. Keith
Jesse C. Crosson
Ann S. O’Malley
DeAnn Cromp
Erin Fries Taylor
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0550-7

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue