Skip to main content
Top
Published in: The Journal of Behavioral Health Services & Research 3/2014

01-07-2014

Predicting the Long-Term Sustainability of Evidence-Based Practices in Mental Health Care: An 8-Year Longitudinal Analysis

Authors: Alison E. Peterson, MPH, Gary R. Bond, PhD, Robert E. Drake, MD, PhD, Gregory J. McHugo, PhD, Amanda M. Jones, PhD, Jessica R. Williams, PhD, MPH, RN

Published in: The Journal of Behavioral Health Services & Research | Issue 3/2014

Login to get access

Abstract

Few studies have examined predictors of long-term sustainability of evidence-based practices in mental health. This study used assessments of five evidence-based practices implemented in 49 sites in eight states at baseline and years 2, 4, and 8. Program characteristics, implementation characteristics, reinforcement activities, and sustainability factors were used to predict program survival status. The majority of predictors were not significant. Supervisor turnover in year 4 predicted survival status in year 8, but site characteristics, fidelity at implementation, quality improvement activities, and post-implementation activities had little impact on long-term program survival. This study extends previous sustainability research by examining the long-term impact of internal program factors over a substantial period of time using longitudinal prediction. Future research should also consider the influence of external factors such as financial policies.
Literature
1.
go back to reference Drake RE, Torrey WC, McHugo GJ. Strategies for implementing evidence-based practices in routine mental health settings. Evidence-Based Mental Health. 2003;6: 6–7. Drake RE, Torrey WC, McHugo GJ. Strategies for implementing evidence-based practices in routine mental health settings. Evidence-Based Mental Health. 2003;6: 6–7.
2.
go back to reference Frey WD, Azrin ST, Goldman HH, et al.. The Mental Health Treatment Study. Psychiatric Rehabilitation Journal. 2008;31 (4):306–12.PubMedCrossRef Frey WD, Azrin ST, Goldman HH, et al.. The Mental Health Treatment Study. Psychiatric Rehabilitation Journal. 2008;31 (4):306–12.PubMedCrossRef
3.
go back to reference Mancini AD, Moser LL, Whitley R, et al. Assertive community treatment: facilitators and barriers to implementation in routine mental health settings. Psychiatric Services. 2009;60:189–95.PubMedCrossRef Mancini AD, Moser LL, Whitley R, et al. Assertive community treatment: facilitators and barriers to implementation in routine mental health settings. Psychiatric Services. 2009;60:189–95.PubMedCrossRef
4.
go back to reference Moser LL, DeLuca NL, Bond GR, et al. Implementing evidence based psychosocial practices: lessons learned from statewide implementation of two practices. CNS Spectrums. 2004;9(926–936). Moser LL, DeLuca NL, Bond GR, et al. Implementing evidence based psychosocial practices: lessons learned from statewide implementation of two practices. CNS Spectrums. 2004;9(926–936).
5.
go back to reference Bjorklund RW, Monroe-DeVita M, Reed D, et al. Washington State's initiative to disseminate and implement high-fidelity ACT teams. Psychiatric Services. 2009;60:24–7.PubMedCrossRef Bjorklund RW, Monroe-DeVita M, Reed D, et al. Washington State's initiative to disseminate and implement high-fidelity ACT teams. Psychiatric Services. 2009;60:24–7.PubMedCrossRef
6.
go back to reference McFarlane WR, McNary S, Dixon L, et al. Predictors of dissemination of family psychoeducation in community mental health centers in Maine and Illinois. Psychiatric Services. 2001;52:935–42.PubMedCrossRef McFarlane WR, McNary S, Dixon L, et al. Predictors of dissemination of family psychoeducation in community mental health centers in Maine and Illinois. Psychiatric Services. 2001;52:935–42.PubMedCrossRef
7.
go back to reference Wilson DC, Crisanti AS. Psychometric properties of the Dual-Disorder Treatment Fidelity Scale: Inter-rater reliability and concurrent validity. Community Mental Health Journal. 2009;45(3):171–8.PubMedCrossRef Wilson DC, Crisanti AS. Psychometric properties of the Dual-Disorder Treatment Fidelity Scale: Inter-rater reliability and concurrent validity. Community Mental Health Journal. 2009;45(3):171–8.PubMedCrossRef
8.
go back to reference Becker DR, Drake RE, Bond GR, et al. A mental health learning collaborative on supported employment. Psychiatric Services. 2011;62(7):704–6.PubMedCrossRef Becker DR, Drake RE, Bond GR, et al. A mental health learning collaborative on supported employment. Psychiatric Services. 2011;62(7):704–6.PubMedCrossRef
9.
go back to reference Fixsen DL, Naoom SF, Blase KA, et al. Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida; 2005. Fixsen DL, Naoom SF, Blase KA, et al. Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida; 2005.
10.
go back to reference Bhattacharyya O, Reeves S, Zwarenstein M. What is implementation research? Rationale, concepts, and practices. Research on Social Work Practice. 2009;19(5):491–502.CrossRef Bhattacharyya O, Reeves S, Zwarenstein M. What is implementation research? Rationale, concepts, and practices. Research on Social Work Practice. 2009;19(5):491–502.CrossRef
11.
12.
go back to reference Proctor EK, Landsverk J, Aarons GA, et al. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research. 2009;36:24–34.PubMedCrossRef Proctor EK, Landsverk J, Aarons GA, et al. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research. 2009;36:24–34.PubMedCrossRef
13.
go back to reference Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health. 2011;38:65–76.PubMedCentralPubMedCrossRef Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health. 2011;38:65–76.PubMedCentralPubMedCrossRef
14.
go back to reference Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Education Research. 1998;13(1):87–108.PubMedCrossRef Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Education Research. 1998;13(1):87–108.PubMedCrossRef
15.
go back to reference Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7(17). Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7(17).
16.
go back to reference Damschroder LJ, Hagedorn HJ. A guiding framework and approach for implementation research in substance use disorders treatment. Psychology of Addictive Behaviors. 2011;25(2):194–205.PubMedCrossRef Damschroder LJ, Hagedorn HJ. A guiding framework and approach for implementation research in substance use disorders treatment. Psychology of Addictive Behaviors. 2011;25(2):194–205.PubMedCrossRef
17.
go back to reference Gruen RL, Elliott JH, Nolan ML, et al. Sustainability science: an integrated approach for health programme planning. Lancet. 2008;372(9649):1579–89.PubMedCrossRef Gruen RL, Elliott JH, Nolan ML, et al. Sustainability science: an integrated approach for health programme planning. Lancet. 2008;372(9649):1579–89.PubMedCrossRef
18.
go back to reference Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38:4–23.PubMedCentralPubMedCrossRef Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38:4–23.PubMedCentralPubMedCrossRef
19.
go back to reference Glanz K, Bishop DB. The role of behavioral science theory in development and implementation of public health interventions. Annual Review of Public Health. 2010;31:399–418.PubMedCrossRef Glanz K, Bishop DB. The role of behavioral science theory in development and implementation of public health interventions. Annual Review of Public Health. 2010;31:399–418.PubMedCrossRef
20.
go back to reference Johnson K, Hays C, Center H, et al. Building capacity and sustainable prevention innovations: a sustainability planning model. Evaluation and Program Planning. 2004;27:135–49.CrossRef Johnson K, Hays C, Center H, et al. Building capacity and sustainable prevention innovations: a sustainability planning model. Evaluation and Program Planning. 2004;27:135–49.CrossRef
21.
go back to reference McHugo GJ, Drake RE, Whitley R, et al. Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatric Services. 2007;58:1279.PubMedCrossRef McHugo GJ, Drake RE, Whitley R, et al. Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatric Services. 2007;58:1279.PubMedCrossRef
22.
go back to reference Torrey WC, Lynde DW, Gorman P. Promoting the implementation of practices that are supported by research: the National Implementing Evidence-Based Practices Project. Child and Adolescent Psychiatric Clinics of North America. 2005;14:297–306.PubMedCrossRef Torrey WC, Lynde DW, Gorman P. Promoting the implementation of practices that are supported by research: the National Implementing Evidence-Based Practices Project. Child and Adolescent Psychiatric Clinics of North America. 2005;14:297–306.PubMedCrossRef
23.
go back to reference Swain K, Whitley R, McHugo G, et al. The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal. 2009. Swain K, Whitley R, McHugo G, et al. The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal. 2009.
24.
go back to reference Bond GR, Drake RE, McHugo GJ, et al. Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health. 2012 [online ahead of print]. Bond GR, Drake RE, McHugo GJ, et al. Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health. 2012 [online ahead of print].
25.
go back to reference Massatti R, Sweeney H, Panzano P, et al. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Administration and Policy in Mental Health [serial on the Internet]. 2008; 35. Massatti R, Sweeney H, Panzano P, et al. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Administration and Policy in Mental Health [serial on the Internet]. 2008; 35.
26.
go back to reference Torrey WC, Bond GR, McHugo GJ, et al. Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research. 2012;39:353–364.PubMedCrossRef Torrey WC, Bond GR, McHugo GJ, et al. Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research. 2012;39:353–364.PubMedCrossRef
27.
go back to reference Bond G, Drake R, Rapp C, et al. Individualization and quality improvement: two new scales to complement measurement of program fidelity. Administration and Policy in Mental Health. 2009;36:349–57.PubMedCrossRef Bond G, Drake R, Rapp C, et al. Individualization and quality improvement: two new scales to complement measurement of program fidelity. Administration and Policy in Mental Health. 2009;36:349–57.PubMedCrossRef
28.
go back to reference Wiltsey Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7:17 doi:10.1186/1748-5908-7-17. Wiltsey Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7:17 doi:10.​1186/​1748-5908-7-17.
29.
go back to reference Pluye P, Potvin L, Denis J. Making public health programs last: conceptualizing sustainability. Evaluation and Program Planning. 2004;27:121–33.CrossRef Pluye P, Potvin L, Denis J. Making public health programs last: conceptualizing sustainability. Evaluation and Program Planning. 2004;27:121–33.CrossRef
30.
go back to reference Pluye P, Potvin L, Denis J, et al. Program sustainability begins with the first events. Evaluation and Program Planning. 2005;28:123–37.CrossRef Pluye P, Potvin L, Denis J, et al. Program sustainability begins with the first events. Evaluation and Program Planning. 2005;28:123–37.CrossRef
31.
go back to reference Yin RK. Life histories of innovations: how new practices become routinized. Public Administration Review. 1981;41:21–8.CrossRef Yin RK. Life histories of innovations: how new practices become routinized. Public Administration Review. 1981;41:21–8.CrossRef
32.
go back to reference Becker D, Baker S, Carlson L, et al. Critical strategies for implementing supported employment. Journal of Vocational Rehabilitation. 2007;27:13–20. Becker D, Baker S, Carlson L, et al. Critical strategies for implementing supported employment. Journal of Vocational Rehabilitation. 2007;27:13–20.
33.
go back to reference Carlson L, Rapp CA, Eichler MS. The experts rate: supervisory behaviors that impact the implementation of evidence-based practices. Community Mental Health Journal. 2012;48:179–86.PubMedCrossRef Carlson L, Rapp CA, Eichler MS. The experts rate: supervisory behaviors that impact the implementation of evidence-based practices. Community Mental Health Journal. 2012;48:179–86.PubMedCrossRef
34.
go back to reference Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003. Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
Metadata
Title
Predicting the Long-Term Sustainability of Evidence-Based Practices in Mental Health Care: An 8-Year Longitudinal Analysis
Authors
Alison E. Peterson, MPH
Gary R. Bond, PhD
Robert E. Drake, MD, PhD
Gregory J. McHugo, PhD
Amanda M. Jones, PhD
Jessica R. Williams, PhD, MPH, RN
Publication date
01-07-2014
Publisher
Springer US
Published in
The Journal of Behavioral Health Services & Research / Issue 3/2014
Print ISSN: 1094-3412
Electronic ISSN: 2168-6793
DOI
https://doi.org/10.1007/s11414-013-9347-x

Other articles of this Issue 3/2014

The Journal of Behavioral Health Services & Research 3/2014 Go to the issue