Skip to main content
Top
Published in: Community Mental Health Journal 2/2010

01-04-2010 | Original Paper

The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies

Authors: Karin Swain, Rob Whitley, Gregory J. McHugo, Robert E. Drake

Published in: Community Mental Health Journal | Issue 2/2010

Login to get access

Abstract

The research presented here reports on sustainability of the practices within the National Implementing Evidence Based Practices Project for people with serious mental illness. Forty-nine sites completed the initial 2-year implementation phase and were the focus of our study. Our aims were to discern the number of sites that sustained practices 2 years after implementation, the reasons for sustaining or not sustaining, differences in characteristics between the two groups, and the extent and nature of practice adaptations. We used a mixed-methods approach, based on a telephone survey that gathered qualitative and quantitative data from site representatives and others familiar with the sites and practices during the follow-up period. We found that 80% of sites sustained their practices for 2 years post-implementation, that sustainers differed from non-sustainers in several domains: financing, training, fidelity and agency leadership, and that most sites adapted practices moderately to meet state and local needs.
Literature
go back to reference Battistich, V., Schaps, E., Watson, M., & Solomon, D. (1996). Prevention effects of the child development project: Early findings from an ongoing multisite demonstration trial. Journal of Adolescent Research, 11(1), 12–35. doi:10.1177/0743554896111003.CrossRef Battistich, V., Schaps, E., Watson, M., & Solomon, D. (1996). Prevention effects of the child development project: Early findings from an ongoing multisite demonstration trial. Journal of Adolescent Research, 11(1), 12–35. doi:10.​1177/​0743554896111003​.CrossRef
go back to reference Blasinski, M., Goldman, H. H., & Unutzer, J. (2006). Project IMPACT: A report on barriers and facilitators to sustainability. Administration and Policy in Mental Health and Mental Health Services Research, 33, 718–729. doi:10.1007/s10488-006-0086-7.CrossRef Blasinski, M., Goldman, H. H., & Unutzer, J. (2006). Project IMPACT: A report on barriers and facilitators to sustainability. Administration and Policy in Mental Health and Mental Health Services Research, 33, 718–729. doi:10.​1007/​s10488-006-0086-7.CrossRef
go back to reference Bond, G. R., McHugo, G. J., Becker, D. R., Rapp, C. A., & Whitley, R. (2008). Fidelity of supported employment: Lessons learned from the national evidence-based practice project. Psychiatric Rehabilitation Journal, 31(4), 300–305. doi:10.2975/31.4.2008.300.305.CrossRefPubMed Bond, G. R., McHugo, G. J., Becker, D. R., Rapp, C. A., & Whitley, R. (2008). Fidelity of supported employment: Lessons learned from the national evidence-based practice project. Psychiatric Rehabilitation Journal, 31(4), 300–305. doi:10.​2975/​31.​4.​2008.​300.​305.CrossRefPubMed
go back to reference Botvin, G. J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association, 273(14), 1106–1112. doi:10.1001/jama.273.14.1106.CrossRefPubMed Botvin, G. J., Baker, E., Dusenbury, L., Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. Journal of the American Medical Association, 273(14), 1106–1112. doi:10.​1001/​jama.​273.​14.​1106.CrossRefPubMed
go back to reference Botvin, G. J., Griffin, K. W., Diaz, T., & Ifill-Williams, M. (2001). Drug abuse prevention among minority adolescents: Posttest and one-year follow-up of a school-based preventive intervention. Prevention Science, 2(1), 1–13. doi:10.1023/A:1010025311161.CrossRefPubMed Botvin, G. J., Griffin, K. W., Diaz, T., & Ifill-Williams, M. (2001). Drug abuse prevention among minority adolescents: Posttest and one-year follow-up of a school-based preventive intervention. Prevention Science, 2(1), 1–13. doi:10.​1023/​A:​1010025311161.CrossRefPubMed
go back to reference Brunette, M., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorder treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59(9), 989–995. doi:10.1176/appi.ps.59.9.989.CrossRefPubMed Brunette, M., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorder treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59(9), 989–995. doi:10.​1176/​appi.​ps.​59.​9.​989.CrossRefPubMed
go back to reference Carpinello, S. E., Rosenberg, L., Stone, J., Schwager, M., & Felton, C. J. (2002). New York State’s campaign to implement evidence-based practices for people with serious mental disorders. Psychiatric Services, 53(2), 153–155. doi:10.1176/appi.ps.53.2.153.CrossRefPubMed Carpinello, S. E., Rosenberg, L., Stone, J., Schwager, M., & Felton, C. J. (2002). New York State’s campaign to implement evidence-based practices for people with serious mental disorders. Psychiatric Services, 53(2), 153–155. doi:10.​1176/​appi.​ps.​53.​2.​153.CrossRefPubMed
go back to reference Drake, R. E., Merrens, M. R., & Lynde, D. W. (Eds.). (2005). Evidenced-based mental health practice: A textbook (1st ed.). New York: W.W. Norton & Company. Drake, R. E., Merrens, M. R., & Lynde, D. W. (Eds.). (2005). Evidenced-based mental health practice: A textbook (1st ed.). New York: W.W. Norton & Company.
go back to reference Isett, K. R., Burnman, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., et al. (2007). Implementation issues for evidence-based practices: The state policy context. Psychiatric Services, 58(7), 914–921. doi:10.1176/appi.ps.58.7.914.CrossRefPubMed Isett, K. R., Burnman, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J., et al. (2007). Implementation issues for evidence-based practices: The state policy context. Psychiatric Services, 58(7), 914–921. doi:10.​1176/​appi.​ps.​58.​7.​914.CrossRefPubMed
go back to reference Jerrel, J. M., & Ridgely, M. S. (1999). Impact of robustness of program implementation on outcomes of clients in dual diagnosis programs. Psychiatric Services, 50(1), 109–112. Jerrel, J. M., & Ridgely, M. S. (1999). Impact of robustness of program implementation on outcomes of clients in dual diagnosis programs. Psychiatric Services, 50(1), 109–112.
go back to reference Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60(2), 189–195. doi:10.1176/appi.ps.60.2.189. Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60(2), 189–195. doi:10.​1176/​appi.​ps.​60.​2.​189.
go back to reference Marty, D., Rapp, C., & McHugo, G. J. (2007). Factors influencing consumer outcome monitoring in implementation of evidence-based practices, results from the national EBP implementation project. Administration and Policy in Mental Health. doi:10.1007/s10488-007-0157-4. Marty, D., Rapp, C., & McHugo, G. J. (2007). Factors influencing consumer outcome monitoring in implementation of evidence-based practices, results from the national EBP implementation project. Administration and Policy in Mental Health. doi:10.​1007/​s10488-007-0157-4.
go back to reference Maryland Department of Health and Mental Hygiene (2006). Evidence-based practice in supported employment policy implementation memorandum. Retrieved from http:/www.dhmh.state.md.us. Maryland Department of Health and Mental Hygiene (2006). Evidence-based practice in supported employment policy implementation memorandum. Retrieved from http:/www.​dhmh.​state.​md.​us.
go back to reference Massati, R. R., Sweeney, H. A., Panzano, P. C., & Roth, D. (2007). The de-adoption of innovative mental health practices (IMHP): Why organizations choose not to sustain an IMHP. Administration and Policy in Mental Health, 35, 50–65. doi:10.1007/s10488-007-0141-z. Massati, R. R., Sweeney, H. A., Panzano, P. C., & Roth, D. (2007). The de-adoption of innovative mental health practices (IMHP): Why organizations choose not to sustain an IMHP. Administration and Policy in Mental Health, 35, 50–65. doi:10.​1007/​s10488-007-0141-z.
go back to reference McDonnell, J., Nofs, D., Hardman, J., & Chambless, C. (1989). An analysis of the procedural components of supported employment programs associated with employment outcomes. Journal of Applied Behavior Analysis, 22(4), 417–428. doi:10.1901/jaba.1989.22-417.CrossRefPubMed McDonnell, J., Nofs, D., Hardman, J., & Chambless, C. (1989). An analysis of the procedural components of supported employment programs associated with employment outcomes. Journal of Applied Behavior Analysis, 22(4), 417–428. doi:10.​1901/​jaba.​1989.​22-417.CrossRefPubMed
go back to reference McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50(6), 818–824.PubMed McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50(6), 818–824.PubMed
go back to reference McHugo, G. M., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services, 58(10), 1279–1284.CrossRefPubMed McHugo, G. M., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services, 58(10), 1279–1284.CrossRefPubMed
go back to reference Meredith, L. S., Mendel, P., Pearson, M., Wu, S. Y., Joyce, G., Straus, J. B., et al. (2006). Implementation and maintenance of quality improvement for treating depression in primary care. Psychiatric Services, 57(1), 48–55. doi:10.1176/appi.ps.57.1.48.CrossRefPubMed Meredith, L. S., Mendel, P., Pearson, M., Wu, S. Y., Joyce, G., Straus, J. B., et al. (2006). Implementation and maintenance of quality improvement for treating depression in primary care. Psychiatric Services, 57(1), 48–55. doi:10.​1176/​appi.​ps.​57.​1.​48.CrossRefPubMed
go back to reference Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.
go back to reference Rapp, C. A., Etzel-Wise, D., Marty, D., Coffman, M., Carlson, L., Asher, D., Callaghan, J., & Whitley, R. (2007). Evidence-based practice implementation strategies, results of a qualitative study. Community Mental Health Journal. doi:10.1007/s10597-007-9109-4. Rapp, C. A., Etzel-Wise, D., Marty, D., Coffman, M., Carlson, L., Asher, D., Callaghan, J., & Whitley, R. (2007). Evidence-based practice implementation strategies, results of a qualitative study. Community Mental Health Journal. doi:10.​1007/​s10597-007-9109-4.
go back to reference Salyers, M. P., McKasson, M., Bond, G. R., McGrew, J. H., Rollins, A. L., & Boyle, C. (2007). The role of technical assistance centers in implementing evidence-based practices: Lessons learned. American Journal of Psychiatric Rehabilitation, 10(2), 85–101. doi:10.1080/15487760701345968.CrossRef Salyers, M. P., McKasson, M., Bond, G. R., McGrew, J. H., Rollins, A. L., & Boyle, C. (2007). The role of technical assistance centers in implementing evidence-based practices: Lessons learned. American Journal of Psychiatric Rehabilitation, 10(2), 85–101. doi:10.​1080/​1548776070134596​8.CrossRef
go back to reference Unutzer, J., Katon, W. J., Callahan, C. M., Williams, J. W., Hunkeler, E., Harpole, L., et al. (2002). Collaborative care management of late-life depression in primary care: A randomized controlled trial. Journal of the American Medical Association, 288(22), 2836–2845. doi:10.1001/jama.288.22.2836.CrossRefPubMed Unutzer, J., Katon, W. J., Callahan, C. M., Williams, J. W., Hunkeler, E., Harpole, L., et al. (2002). Collaborative care management of late-life depression in primary care: A randomized controlled trial. Journal of the American Medical Association, 288(22), 2836–2845. doi:10.​1001/​jama.​288.​22.​2836.CrossRefPubMed
go back to reference US Department of Health and Human Services Center for Substance Abuse Prevention (CSAP) (2002). Finding the balance: Program fidelity and adaptation in substance abuse. Rockville, MD. Retrieved from http:/www.samhsa.gov. US Department of Health and Human Services Center for Substance Abuse Prevention (CSAP) (2002). Finding the balance: Program fidelity and adaptation in substance abuse. Rockville, MD. Retrieved from http:/www.​samhsa.​gov.
go back to reference US Department of Health and Human Services. The President’s New Freedom Commission on Mental Health (2003). Achieving the promise: Transforming mental health care in America. Rockville, MD: Pub. No. SMA-03-3832. US Department of Health and Human Services. The President’s New Freedom Commission on Mental Health (2003). Achieving the promise: Transforming mental health care in America. Rockville, MD: Pub. No. SMA-03-3832.
go back to reference Whitley, R., Gingerich, S., Lutz, W., et al. (2009). Implementing the Illness Management and Recovery Program in Community Mental Health Settings: Facilitators and Barriers. Psychiatric Services, 60(2), 209–209. doi:10.1176/appi.ps.60.2.202. Whitley, R., Gingerich, S., Lutz, W., et al. (2009). Implementing the Illness Management and Recovery Program in Community Mental Health Settings: Facilitators and Barriers. Psychiatric Services, 60(2), 209–209. doi:10.​1176/​appi.​ps.​60.​2.​202.
go back to reference Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., et al. (2008). The role of team turnover in implementation of evidence-based practices in mental health care. Psychiatric Services, 59(7), 732–737. doi:10.1176/appi.ps.59.7.732.CrossRefPubMed Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., et al. (2008). The role of team turnover in implementation of evidence-based practices in mental health care. Psychiatric Services, 59(7), 732–737. doi:10.​1176/​appi.​ps.​59.​7.​732.CrossRefPubMed
Metadata
Title
The Sustainability of Evidence-Based Practices in Routine Mental Health Agencies
Authors
Karin Swain
Rob Whitley
Gregory J. McHugo
Robert E. Drake
Publication date
01-04-2010
Publisher
Springer US
Published in
Community Mental Health Journal / Issue 2/2010
Print ISSN: 0010-3853
Electronic ISSN: 1573-2789
DOI
https://doi.org/10.1007/s10597-009-9202-y

Other articles of this Issue 2/2010

Community Mental Health Journal 2/2010 Go to the issue