Skip to main content
Top
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support

Authors: Enola Proctor, Douglas Luke, Annaliese Calhoun, Curtis McMillen, Ross Brownson, Stacey McCrary, Margaret Padek

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Little is known about how well or under what conditions health innovations are sustained and their gains maintained once they are put into practice. Implementation science typically focuses on uptake by early adopters of one healthcare innovation at a time. The later-stage challenges of scaling up and sustaining evidence-supported interventions receive too little attention. This project identifies the challenges associated with sustainability research and generates recommendations for accelerating and strengthening this work.

Methods

A multi-method, multi-stage approach, was used: (1) identifying and recruiting experts in sustainability as participants, (2) conducting research on sustainability using concept mapping, (3) action planning during an intensive working conference of sustainability experts to expand the concept mapping quantitative results, and (4) consolidating results into a set of recommendations for research, methodological advances, and infrastructure building to advance understanding of sustainability. Participants comprised researchers, funders, and leaders in health, mental health, and public health with shared interest in the sustainability of evidence-based health care.

Results

Prompted to identify important issues for sustainability research, participants generated 91 distinct statements, for which a concept mapping process produced 11 conceptually distinct clusters. During the conference, participants built upon the concept mapping clusters to generate recommendations for sustainability research. The recommendations fell into three domains: (1) pursue high priority research questions as a unified agenda on sustainability; (2) advance methods for sustainability research; (3) advance infrastructure to support sustainability research.

Conclusions

Implementation science needs to pursue later-stage translation research questions required for population impact. Priorities include conceptual consistency and operational clarity for measuring sustainability, developing evidence about the value of sustaining interventions over time, identifying correlates of sustainability along with strategies for sustaining evidence-supported interventions, advancing the theoretical base and research designs for sustainability research, and advancing the workforce capacity, research culture, and funding mechanisms for this important work.
Literature
1.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635–45.CrossRefPubMed McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635–45.CrossRefPubMed
2.
go back to reference Wang PS, Lane M, Olfson M, Pincus HA, Wells KB, Kessler RC. Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey. Arch Gen Psychiatry. 2005;62(6):629–40.CrossRefPubMed Wang PS, Lane M, Olfson M, Pincus HA, Wells KB, Kessler RC. Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey. Arch Gen Psychiatry. 2005;62(6):629–40.CrossRefPubMed
3.
go back to reference Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.CrossRefPubMed Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.CrossRefPubMed
4.
go back to reference Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid, and relevant science. Clin Transl Sci. 2012. In Press Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid, and relevant science. Clin Transl Sci. 2012. In Press
5.
go back to reference Spoth R, Guyll M, Redmond C, Greenberg M, Feinberg M. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: the PROSPER study. Am J Community Psychol. 2011;48:412–25.CrossRefPubMedPubMedCentral Spoth R, Guyll M, Redmond C, Greenberg M, Feinberg M. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: the PROSPER study. Am J Community Psychol. 2011;48:412–25.CrossRefPubMedPubMedCentral
7.
go back to reference Nease DE, Nutting PA, Graham DG, Dickinson WP, Gallagher KA, Jeffcott-Pera M. Sustainability of depression care improvements: success of a practice change improvement collaborative. J Am Board Fam Med. 2010;23(5):598–605.CrossRefPubMed Nease DE, Nutting PA, Graham DG, Dickinson WP, Gallagher KA, Jeffcott-Pera M. Sustainability of depression care improvements: success of a practice change improvement collaborative. J Am Board Fam Med. 2010;23(5):598–605.CrossRefPubMed
8.
go back to reference Forsner T, Aberg Wistedt A, Brommels M, Janszky I, Ponce de Leon A, Forsell Y. Supported local implementation of clinical guidelines in psychiatry: a two year follow-up. Implement Sci. 2010;5:4.CrossRefPubMedPubMedCentral Forsner T, Aberg Wistedt A, Brommels M, Janszky I, Ponce de Leon A, Forsell Y. Supported local implementation of clinical guidelines in psychiatry: a two year follow-up. Implement Sci. 2010;5:4.CrossRefPubMedPubMedCentral
9.
go back to reference Lyon AR, Frazier SL, Mehta T, Atkins MS, Weisbach J. Easier said than done: intervention sustainability in an urban after-school program. Adm Policy Ment Health. 2011;38:504–17.CrossRefPubMedPubMedCentral Lyon AR, Frazier SL, Mehta T, Atkins MS, Weisbach J. Easier said than done: intervention sustainability in an urban after-school program. Adm Policy Ment Health. 2011;38:504–17.CrossRefPubMedPubMedCentral
10.
go back to reference Druss B, von Esenwein S, Compton M, Zhao L, Leslie D. Budget impact and sustainability of medical care management for persons with serious mental illnesses. Am J Psychiatry. 2011;168(11):1171–8.CrossRefPubMedPubMedCentral Druss B, von Esenwein S, Compton M, Zhao L, Leslie D. Budget impact and sustainability of medical care management for persons with serious mental illnesses. Am J Psychiatry. 2011;168(11):1171–8.CrossRefPubMedPubMedCentral
11.
go back to reference Stange KC, Goodwin MA, Zyanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003;25(4):296–300. doi:10.1016/S0749-3797(03)00219-8. Stange KC, Goodwin MA, Zyanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003;25(4):296–300. doi:10.​1016/​S0749-3797(03)00219-8.
12.
go back to reference Mayer H, Mooney B, Gundlapalli A, Harbarth S, Stoddard FJ, Rubin MA, et al. Dissemination and sustainability of a hospital-wide hand hygiene program emphasizing positive reinforcement. Infect Control Hosp Epidemiol. 2011;32:59–66.CrossRefPubMed Mayer H, Mooney B, Gundlapalli A, Harbarth S, Stoddard FJ, Rubin MA, et al. Dissemination and sustainability of a hospital-wide hand hygiene program emphasizing positive reinforcement. Infect Control Hosp Epidemiol. 2011;32:59–66.CrossRefPubMed
13.
go back to reference Campbell S, Pieters K, Mullen K, Reece R, Reid R. Examining sustainability in a hospital setting: case of smoking cessation. Implement Sci. 2011;6:108.CrossRefPubMedPubMedCentral Campbell S, Pieters K, Mullen K, Reece R, Reid R. Examining sustainability in a hospital setting: case of smoking cessation. Implement Sci. 2011;6:108.CrossRefPubMedPubMedCentral
14.
15.
go back to reference Cozart H, Horvath M, Long A, Whitehurst J, Eckstrand J, Ferranti J. Culture counts—sustainable inpatient computerized surveillance across Duke University Health System. Qual Manag Health Care. 2010;19(4):282–91.CrossRefPubMed Cozart H, Horvath M, Long A, Whitehurst J, Eckstrand J, Ferranti J. Culture counts—sustainable inpatient computerized surveillance across Duke University Health System. Qual Manag Health Care. 2010;19(4):282–91.CrossRefPubMed
16.
go back to reference Seow H, Phillips C, Rich M, Spertus J, Krumholz H, Lynn J. Isolation of health services research from practice and policy: the example of chronic heart failure, management. J Am Geriatr Soc. 2006;54(3):535–40.CrossRefPubMed Seow H, Phillips C, Rich M, Spertus J, Krumholz H, Lynn J. Isolation of health services research from practice and policy: the example of chronic heart failure, management. J Am Geriatr Soc. 2006;54(3):535–40.CrossRefPubMed
18.
go back to reference Simpson D. A framework for implementing sustainable oral health promotion interventions. J Public Health Dent. 2011;71:S84–94.CrossRefPubMedCentral Simpson D. A framework for implementing sustainable oral health promotion interventions. J Public Health Dent. 2011;71:S84–94.CrossRefPubMedCentral
20.
22.
go back to reference Emmons KM, Weiner B, Fernandez ME, Tu SP. Systems antecedents for dissemination and implementation: a review and analysis of measures. Health Educ Behav. 2012;39(1):87–105.CrossRefPubMed Emmons KM, Weiner B, Fernandez ME, Tu SP. Systems antecedents for dissemination and implementation: a review and analysis of measures. Health Educ Behav. 2012;39(1):87–105.CrossRefPubMed
23.
go back to reference Chambers DA, Glasgow RE, Stange KC. The dynamic systainabililty framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.CrossRefPubMedPubMedCentral Chambers DA, Glasgow RE, Stange KC. The dynamic systainabililty framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.CrossRefPubMedPubMedCentral
24.
go back to reference Brownson RC, Kelly CM, Eyler AA, Carnoske C, Grost L, Handy SL, et al. Environmental and policy approaches for promoting physical activity in the United States: a research agenda. J Phys Act Health. 2008;5:488–503.CrossRefPubMed Brownson RC, Kelly CM, Eyler AA, Carnoske C, Grost L, Handy SL, et al. Environmental and policy approaches for promoting physical activity in the United States: a research agenda. J Phys Act Health. 2008;5:488–503.CrossRefPubMed
25.
go back to reference Anderson LA, Gwaltney MK, Sundra DL, Brownson RC, Kane M, Cross AW, et al. Using concept mapping to develop a logic model for the Prevention Research Centers Program. Prev Chronic Dis. 2006;3(1):A06.PubMed Anderson LA, Gwaltney MK, Sundra DL, Brownson RC, Kane M, Cross AW, et al. Using concept mapping to develop a logic model for the Prevention Research Centers Program. Prev Chronic Dis. 2006;3(1):A06.PubMed
26.
go back to reference Rosas S. Concept mapping as a technique for program theory development: an illustration using family support programs. Am J Eval. 2005;26(3):389–401.CrossRef Rosas S. Concept mapping as a technique for program theory development: an illustration using family support programs. Am J Eval. 2005;26(3):389–401.CrossRef
27.
go back to reference Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011;6:104.CrossRefPubMedPubMedCentral Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011;6:104.CrossRefPubMedPubMedCentral
28.
go back to reference Trochim WM. An introduction to concept mapping for planning and evaluation. Evl Program Plann. 1989;12:1–16.CrossRef Trochim WM. An introduction to concept mapping for planning and evaluation. Evl Program Plann. 1989;12:1–16.CrossRef
30.
go back to reference Kane M, Trochim WMK. Concept mapping for planning and evaluation. Thousand Oaks: Sage Publications; 2007. p. 98.CrossRef Kane M, Trochim WMK. Concept mapping for planning and evaluation. Thousand Oaks: Sage Publications; 2007. p. 98.CrossRef
31.
go back to reference Rogers EM. Diffusion of innovations. 6th ed. New York: Free Press; 2003. Rogers EM. Diffusion of innovations. 6th ed. New York: Free Press; 2003.
32.
go back to reference Stirman S, Miller C, Toder K. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.CrossRefPubMedPubMedCentral Stirman S, Miller C, Toder K. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.CrossRefPubMedPubMedCentral
33.
go back to reference Damschroder L, Lowery J. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51.CrossRefPubMedPubMedCentral Damschroder L, Lowery J. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51.CrossRefPubMedPubMedCentral
34.
go back to reference Massatti RR, Sweeney HA, Panzanno PC, Roth D. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMPH. Adm Policy Ment Health. 2008;35:50–65.CrossRefPubMed Massatti RR, Sweeney HA, Panzanno PC, Roth D. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMPH. Adm Policy Ment Health. 2008;35:50–65.CrossRefPubMed
35.
go back to reference Rabin B, Purcell P, Naveed S, Moser R, Henton M, Proctor E, et al. Advancing the application, quality and harmonization of implementation science measures. Implement Sci. 2012;7:119.CrossRefPubMedPubMedCentral Rabin B, Purcell P, Naveed S, Moser R, Henton M, Proctor E, et al. Advancing the application, quality and harmonization of implementation science measures. Implement Sci. 2012;7:119.CrossRefPubMedPubMedCentral
36.
go back to reference Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014;41(3):337–46.CrossRefPubMed Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014;41(3):337–46.CrossRefPubMed
37.
go back to reference Edwards N. Scaling-up health innovations and interventions in public health: a brief review of the current state-of-the-science. Conference to Advance the State of the Science and Practice on Scale-up and Spread of Effective Health Programs; 2010. p. 1–45 Edwards N. Scaling-up health innovations and interventions in public health: a brief review of the current state-of-the-science. Conference to Advance the State of the Science and Practice on Scale-up and Spread of Effective Health Programs; 2010. p. 145
38.
go back to reference Kleinman M, Mold J. Defining the components of the research pipeline. Clin Transl Sci. 2009;2(4):312–4.CrossRefPubMed Kleinman M, Mold J. Defining the components of the research pipeline. Clin Transl Sci. 2009;2(4):312–4.CrossRefPubMed
Metadata
Title
Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support
Authors
Enola Proctor
Douglas Luke
Annaliese Calhoun
Curtis McMillen
Ross Brownson
Stacey McCrary
Margaret Padek
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0274-5

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue