Skip to main content
Top
Published in: Implementation Science 1/2006

Open Access 01-12-2006 | Research article

Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project

Author: Jennifer L Magnabosco

Published in: Implementation Science | Issue 1/2006

Login to get access

Abstract

Background

The Evidence-Based Practice (EBP) Project has been investigating the implementation of evidence-based mental health practices (Assertive Community Treatment, Family Psychoeducation, Integrated Dual Diagnosis Treatment, Illness Management and Recovery, and Supported Employment) in state public mental health systems in the United States since 2001. To date, Project findings have yielded valuable insights into implementation strategy characteristics and effectiveness. This paper reports results of an effort to identify and classify state-level implementation activities and strategies employed across the eight states participating in the Project.

Methods

Content analysis and Greenhalgh et al's (2004) definition of innovation were used to identify and classify state-level activities employed during three phases of EBP implementation: Pre-Implementation, Initial Implementation and Sustainability Planning. Activities were coded from site visit reports created from documents and notes from key informant interviews conducted during two periods, Fall 2002 – Spring 2003, and Spring 2004. Frequency counts and rank-order analyses were used to examine patterns of implementation activities and strategies employed across the three phases of implementation.

Results

One hundred and six discreet implementation activities and strategies were identified as innovative and were classified into five categories: 1) state infrastructure building and commitment, 2) stakeholder relationship building and communications, 3) financing, 4) continuous quality management, and 5) service delivery practices and training. Implementation activities from different categories were employed at different phases of implementation.

Conclusion

Insights into effective strategies for implementing EBPs in mental health and other health sectors require qualitative and quantitative research that seeks to: a) empirically test the effects of tools and methods used to implement EBPs, and b) establish a stronger evidence-base from which to plan, implement and sustain such efforts. This paper offers a classification scheme and list of innovative implementation activities and strategies. The classification scheme offers potential value for future studies that seek to assess the effects of various implementation processes, and helps establish widely accepted standards and criteria that can be used to assess the value of innovative activities and strategies.
Literature
1.
go back to reference Schoenwald SK, Hoagwood K: Effectiveness, transportability, and dissemination of interventions: what matters when?. Psychiatr Serv. 2001, 52: 1190-1197. 10.1176/appi.ps.52.9.1190.CrossRefPubMed Schoenwald SK, Hoagwood K: Effectiveness, transportability, and dissemination of interventions: what matters when?. Psychiatr Serv. 2001, 52: 1190-1197. 10.1176/appi.ps.52.9.1190.CrossRefPubMed
2.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
3.
go back to reference Rosenheck RA: Organizational process: a missing link between research and practice. Psychiatr Serv. 2001, 52: 1607-1612. 10.1176/appi.ps.52.12.1607.CrossRefPubMed Rosenheck RA: Organizational process: a missing link between research and practice. Psychiatr Serv. 2001, 52: 1607-1612. 10.1176/appi.ps.52.12.1607.CrossRefPubMed
4.
go back to reference McHugo GJ, Drake RE: Finding and evaluating the evidence: a critical step in evidence-based medicine. Psychiatr Clin North Am. 2003, 26: 821-831. 10.1016/S0193-953X(03)00075-3.CrossRefPubMed McHugo GJ, Drake RE: Finding and evaluating the evidence: a critical step in evidence-based medicine. Psychiatr Clin North Am. 2003, 26: 821-831. 10.1016/S0193-953X(03)00075-3.CrossRefPubMed
5.
go back to reference Drake RE, Goldman HH, Leff HS, Lehman AF, Dixon L, Mueser KT, Torrey WC: Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001, 52: 179-182. 10.1176/appi.ps.52.2.179.CrossRefPubMed Drake RE, Goldman HH, Leff HS, Lehman AF, Dixon L, Mueser KT, Torrey WC: Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001, 52: 179-182. 10.1176/appi.ps.52.2.179.CrossRefPubMed
6.
go back to reference Lehman AF, Steinwachs DM: Translating research into practice: the Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations. Schizophr Bull. 1998, 24: 1-10.CrossRefPubMed Lehman AF, Steinwachs DM: Translating research into practice: the Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations. Schizophr Bull. 1998, 24: 1-10.CrossRefPubMed
7.
go back to reference Torrey WC, Drake RE, Dixon L, Burns BJ, Flynn L, Rush AJ, Clark RE, Klatzker D: Implementing evidence-based practices for persons with severe mental illnesses. Psychiatr Serv. 2001, 52: 45-50. 10.1176/appi.ps.52.1.45.CrossRefPubMed Torrey WC, Drake RE, Dixon L, Burns BJ, Flynn L, Rush AJ, Clark RE, Klatzker D: Implementing evidence-based practices for persons with severe mental illnesses. Psychiatr Serv. 2001, 52: 45-50. 10.1176/appi.ps.52.1.45.CrossRefPubMed
8.
go back to reference Drake RE, Essock SM, Shaner A, Carey KB, Minkoff K, Kola L, Lynde D, Osher FC, Clark RE: Implementing dual diagnosis services for clients with severe mental illness. Psychiatr Serv. 2001, 52: 469-476. 10.1176/appi.ps.52.4.469.CrossRefPubMed Drake RE, Essock SM, Shaner A, Carey KB, Minkoff K, Kola L, Lynde D, Osher FC, Clark RE: Implementing dual diagnosis services for clients with severe mental illness. Psychiatr Serv. 2001, 52: 469-476. 10.1176/appi.ps.52.4.469.CrossRefPubMed
9.
go back to reference Bond GR, Becker DR, Drake RE, Rapp CA, Meisler N, Lehman AF, Bell MD, Blyler CR: Implementing supported employment as an evidence-based practice. Psychiatr Serv. 2001, 52: 313-322. 10.1176/appi.ps.52.3.313.CrossRefPubMed Bond GR, Becker DR, Drake RE, Rapp CA, Meisler N, Lehman AF, Bell MD, Blyler CR: Implementing supported employment as an evidence-based practice. Psychiatr Serv. 2001, 52: 313-322. 10.1176/appi.ps.52.3.313.CrossRefPubMed
10.
go back to reference Phillips SD, Burns BJ, Edgar ER, Mueser KT, Linkins KW, Rosenheck RA, Drake RE, McDonel Herr EC: Moving assertive community treatment into standard practice. Psychiatr Serv. 2001, 52: 771-779. 10.1176/appi.ps.52.6.771.CrossRefPubMed Phillips SD, Burns BJ, Edgar ER, Mueser KT, Linkins KW, Rosenheck RA, Drake RE, McDonel Herr EC: Moving assertive community treatment into standard practice. Psychiatr Serv. 2001, 52: 771-779. 10.1176/appi.ps.52.6.771.CrossRefPubMed
11.
go back to reference Mellman TA, Miller AL, Weissman EM, Crismon ML, Essock SM, Marder SR: Evidence-based pharmacologic treatment for people with severe mental illness: a focus on guidelines and algorithms. Psychiatr Serv. 2001, 52: 619-625. 10.1176/appi.ps.52.5.619.CrossRefPubMed Mellman TA, Miller AL, Weissman EM, Crismon ML, Essock SM, Marder SR: Evidence-based pharmacologic treatment for people with severe mental illness: a focus on guidelines and algorithms. Psychiatr Serv. 2001, 52: 619-625. 10.1176/appi.ps.52.5.619.CrossRefPubMed
12.
go back to reference Young AS, Magnabosco JL: Services for Adults with Mental Illness. Mental Health Services: A Public Health Perspective. Edited by: Lubotsky LB, Petrila J, Hennessy KD. 2004, New York, NY: Oxford University Press, 177-208. Young AS, Magnabosco JL: Services for Adults with Mental Illness. Mental Health Services: A Public Health Perspective. Edited by: Lubotsky LB, Petrila J, Hennessy KD. 2004, New York, NY: Oxford University Press, 177-208.
13.
go back to reference Birkel RC, Hall LL, Lane T, Cohan K, Miller J: Consumers and families as partners in implementing evidence-based practice. Psychiatr Clin North Am. 2003, 26: 867-881. 10.1016/S0193-953X(03)00065-0.CrossRefPubMed Birkel RC, Hall LL, Lane T, Cohan K, Miller J: Consumers and families as partners in implementing evidence-based practice. Psychiatr Clin North Am. 2003, 26: 867-881. 10.1016/S0193-953X(03)00065-0.CrossRefPubMed
14.
go back to reference NASMHPD Research Institute: State Profile Highlights: Implementation of Evidence-Based Services by State Mental Health Agencies. National Association of State Mental Health Program Directors. State Profile Highlights: New Information from the National Association of State Mental Health Program Directors Research Institute., 2001–2002 NASMHPD Research Institute: State Profile Highlights: Implementation of Evidence-Based Services by State Mental Health Agencies. National Association of State Mental Health Program Directors. State Profile Highlights: New Information from the National Association of State Mental Health Program Directors Research Institute., 2001–2002
15.
go back to reference Ganju V: Bridging the Gap between Research and Services with Evidence-Based Practices. 2001, Alexandria, VA, National Association of State Mental Health Directors Ganju V: Bridging the Gap between Research and Services with Evidence-Based Practices. 2001, Alexandria, VA, National Association of State Mental Health Directors
16.
go back to reference Ganju V: Implementation of evidence-based practices in state mental health systems: implications for research and effectiveness studies. Schizophr Bull. 2003, 29: 125-131.CrossRefPubMed Ganju V: Implementation of evidence-based practices in state mental health systems: implications for research and effectiveness studies. Schizophr Bull. 2003, 29: 125-131.CrossRefPubMed
17.
go back to reference Moser LL, Deluca NL, Bond GR, Rollins AL: Implementing evidence-based psychosocial practices: lessons learned from statewide implementation of two practices. CNS Spectr. 2004, 9: 926-36. 942PubMed Moser LL, Deluca NL, Bond GR, Rollins AL: Implementing evidence-based psychosocial practices: lessons learned from statewide implementation of two practices. CNS Spectr. 2004, 9: 926-36. 942PubMed
19.
go back to reference Morrison D: Real-world use of evidence-based treatments in community behavioral health care. Psychiatr Serv. 2004, 55: 485-487. 10.1176/appi.ps.55.5.485.CrossRefPubMed Morrison D: Real-world use of evidence-based treatments in community behavioral health care. Psychiatr Serv. 2004, 55: 485-487. 10.1176/appi.ps.55.5.485.CrossRefPubMed
20.
go back to reference Daniels AS, Adams N: From Policy to Service: A Quality Vision for Behavioral Health: Using the Quality Chasm and New Freedom Commission Reports as a Framework for Change. 2004, American College of Mental Health Administration. Daniels AS, Adams N: From Policy to Service: A Quality Vision for Behavioral Health: Using the Quality Chasm and New Freedom Commission Reports as a Framework for Change. 2004, American College of Mental Health Administration.
21.
go back to reference New Freedom Commission on Mental Health: Achieving the Promise: Transforming Mental Health in America. 2003, DHHS Pub No. SMA-03-3832. Rockville, MD New Freedom Commission on Mental Health: Achieving the Promise: Transforming Mental Health in America. 2003, DHHS Pub No. SMA-03-3832. Rockville, MD
22.
go back to reference United States Public Health Service Office of the Surgeon General: Mental Health: A Report of the Surgeon General. 1999, Rockville, MD, Department of Health and Human Services, U.S. Public Health Service United States Public Health Service Office of the Surgeon General: Mental Health: A Report of the Surgeon General. 1999, Rockville, MD, Department of Health and Human Services, U.S. Public Health Service
23.
go back to reference Essock SM, Goldman HH, Van TL, Anthony WA, Appell CR, Bond GR, Dixon LB, Dunakin LK, Ganju V, Gorman PG, Ralph RO, Rapp CA, Teague GB, Drake RE: Evidence-based practices: setting the context and responding to concerns. Psychiatr Clin North Am. 2003, 26: 919-38. 10.1016/S0193-953X(03)00069-8. ix.CrossRefPubMed Essock SM, Goldman HH, Van TL, Anthony WA, Appell CR, Bond GR, Dixon LB, Dunakin LK, Ganju V, Gorman PG, Ralph RO, Rapp CA, Teague GB, Drake RE: Evidence-based practices: setting the context and responding to concerns. Psychiatr Clin North Am. 2003, 26: 919-38. 10.1016/S0193-953X(03)00069-8. ix.CrossRefPubMed
24.
go back to reference Goldman HH, Ganju V, Drake RE, Gorman P, Hogan M, Hyde PS, Morgan O: Policy implications for implementing evidence-based practices. Psychiatr Serv. 2001, 52: 1591-1597. 10.1176/appi.ps.52.12.1591.CrossRefPubMed Goldman HH, Ganju V, Drake RE, Gorman P, Hogan M, Hyde PS, Morgan O: Policy implications for implementing evidence-based practices. Psychiatr Serv. 2001, 52: 1591-1597. 10.1176/appi.ps.52.12.1591.CrossRefPubMed
25.
go back to reference Goldman HH, Azrin ST: Public policy and evidence-based practice. Psychiatr Clin North Am. 2003, 26: 899-917. 10.1016/S0193-953X(03)00068-6.CrossRefPubMed Goldman HH, Azrin ST: Public policy and evidence-based practice. Psychiatr Clin North Am. 2003, 26: 899-917. 10.1016/S0193-953X(03)00068-6.CrossRefPubMed
26.
go back to reference Torrey WC, Finnerty M, Evans A, Wyzik P: Strategies for leading the implementation of evidence-based practices. Psychiatr Clin North Am. 2003, 26: 883-8ix. 10.1016/S0193-953X(03)00067-4.CrossRefPubMed Torrey WC, Finnerty M, Evans A, Wyzik P: Strategies for leading the implementation of evidence-based practices. Psychiatr Clin North Am. 2003, 26: 883-8ix. 10.1016/S0193-953X(03)00067-4.CrossRefPubMed
27.
go back to reference Capra F: The Web of Life: A New Synthesis of Mind and Matter. 1996, London: Harper Collins Capra F: The Web of Life: A New Synthesis of Mind and Matter. 1996, London: Harper Collins
28.
go back to reference Perrin B: How To and How Not To – Evaluate Innovation. UK Evaluation Society Conference, London. 2000 Perrin B: How To and How Not To – Evaluate Innovation. UK Evaluation Society Conference, London. 2000
29.
go back to reference Chen HT, Rossi PH: Evaluating With Sense: The Theory-Driven Approach. Evaluation Review. 1983, 7: 283-302.CrossRef Chen HT, Rossi PH: Evaluating With Sense: The Theory-Driven Approach. Evaluation Review. 1983, 7: 283-302.CrossRef
30.
31.
go back to reference Cohen S, Eimecke W: The New Effective Public Manager: Achieving Success in a Changing Environment. 1995, San Fransisco: Jossey-Bass Publishing Cohen S, Eimecke W: The New Effective Public Manager: Achieving Success in a Changing Environment. 1995, San Fransisco: Jossey-Bass Publishing
33.
go back to reference DiConsiglio J: A quality example. What it takes to receive the Malcolm Baldridge Award. Mater Manag Health Care. 2005, 14: 30-32. DiConsiglio J: A quality example. What it takes to receive the Malcolm Baldridge Award. Mater Manag Health Care. 2005, 14: 30-32.
34.
go back to reference Larson EV, Brahmakulam IT: Building a New Foundation for Innovation: Results of a Workshop for the National Science Foundation. MR-1534-NSF. RAND Corporation. 2005 Larson EV, Brahmakulam IT: Building a New Foundation for Innovation: Results of a Workshop for the National Science Foundation. MR-1534-NSF. RAND Corporation. 2005
37.
go back to reference Patton MQ: Utilization-Focused Evaluation. 1996, Thousand Oaks, CA: Sage Publications, 3 Patton MQ: Utilization-Focused Evaluation. 1996, Thousand Oaks, CA: Sage Publications, 3
38.
go back to reference Rogers EM: Diffusion of Innovations. 2003, New York, NY: Free Press, 5 Rogers EM: Diffusion of Innovations. 2003, New York, NY: Free Press, 5
39.
go back to reference Berman P: The study of macro- and micro-implementation. Public Policy. 1978, 26: 157-184.PubMed Berman P: The study of macro- and micro-implementation. Public Policy. 1978, 26: 157-184.PubMed
40.
go back to reference Majone G, Wildavsky AB: Implementation As Evolution. Implementation. Edited by: Pressman JL, Wildavsky AB. 1979, Berkeley, CA: University of California Press Majone G, Wildavsky AB: Implementation As Evolution. Implementation. Edited by: Pressman JL, Wildavsky AB. 1979, Berkeley, CA: University of California Press
41.
go back to reference Berman P: Thinking About Programmed and Adaptive Implementation. Why Policies Succeed or Fail. Edited by: Ingram H, Mann D. 1980, Beverly Hills, CA: Sage Publications Berman P: Thinking About Programmed and Adaptive Implementation. Why Policies Succeed or Fail. Edited by: Ingram H, Mann D. 1980, Beverly Hills, CA: Sage Publications
42.
go back to reference Sabatier PA, Mazamanian DA: The Implementation of Public Policy: A Framework for Analysis. Effective Policy Implementation. Edited by: Mazamanian DA, Sabatier PA. 1981, Boston, MA: Lexington Books Sabatier PA, Mazamanian DA: The Implementation of Public Policy: A Framework for Analysis. Effective Policy Implementation. Edited by: Mazamanian DA, Sabatier PA. 1981, Boston, MA: Lexington Books
43.
go back to reference Elmore RF: Backward Mapping: Implementation Research Policy Decisions. Studying Implementation: Methodological and Administrative Issues. Edited by: Wildavsky AB. 1982, Chatham, NJ: Chatham House Publishers, Inc Elmore RF: Backward Mapping: Implementation Research Policy Decisions. Studying Implementation: Methodological and Administrative Issues. Edited by: Wildavsky AB. 1982, Chatham, NJ: Chatham House Publishers, Inc
44.
go back to reference Younis T, Davidson I: The Study of Implementation. Implementation in Public Policy. Edited by: Younis T. 1990, Brookfield: Dartmouth Younis T, Davidson I: The Study of Implementation. Implementation in Public Policy. Edited by: Younis T. 1990, Brookfield: Dartmouth
45.
go back to reference Palumbo DJ, Olivero A: Implementation theory and the theory-driven approach to validity. Evaluation and Program Planning. 1989, 12: 337-344. 10.1016/0149-7189(89)90050-5.CrossRef Palumbo DJ, Olivero A: Implementation theory and the theory-driven approach to validity. Evaluation and Program Planning. 1989, 12: 337-344. 10.1016/0149-7189(89)90050-5.CrossRef
46.
go back to reference Black BL: Institutional Context and Strategy: A Framework for the Analysis of Mental Health Policy. Organizational Environments: Ritual and Rationality. Edited by: Meyer JW, Scott WR. 1983, Beverly Hills, CA: Sage Publications Black BL: Institutional Context and Strategy: A Framework for the Analysis of Mental Health Policy. Organizational Environments: Ritual and Rationality. Edited by: Meyer JW, Scott WR. 1983, Beverly Hills, CA: Sage Publications
47.
go back to reference Miller GJ: Managerial Dilemmas: The Political Economy of Hierarchy. 1992, New York, NY: Cambridge University PressCrossRef Miller GJ: Managerial Dilemmas: The Political Economy of Hierarchy. 1992, New York, NY: Cambridge University PressCrossRef
48.
go back to reference Drake RE, Goldman HH: The future of evidence-based practices in mental health care. Psychiatr Clin North Am. 2003, 26: 1011-1016. 10.1016/S0193-953X(03)00074-1.CrossRefPubMed Drake RE, Goldman HH: The future of evidence-based practices in mental health care. Psychiatr Clin North Am. 2003, 26: 1011-1016. 10.1016/S0193-953X(03)00074-1.CrossRefPubMed
49.
go back to reference Marmor TR, Gill KC: The political and economic context of mental health care in the United States. J Health Polit Policy Law. 1989, 14: 459-475.CrossRefPubMed Marmor TR, Gill KC: The political and economic context of mental health care in the United States. J Health Polit Policy Law. 1989, 14: 459-475.CrossRefPubMed
50.
go back to reference Emery BD, Glover RW, Mazade NA: The environmental trends facing state mental health agencies. Adm Policy Ment Health. 1998, 25: 337-347. 10.1023/A:1022251624938.CrossRefPubMed Emery BD, Glover RW, Mazade NA: The environmental trends facing state mental health agencies. Adm Policy Ment Health. 1998, 25: 337-347. 10.1023/A:1022251624938.CrossRefPubMed
51.
go back to reference Martin L, Kettner PM: Measuring the Performance of Human Service Programs. 1996, Thousand Oaks, CA: Sage Publications, Inc. Martin L, Kettner PM: Measuring the Performance of Human Service Programs. 1996, Thousand Oaks, CA: Sage Publications, Inc.
52.
go back to reference Mullen EJ, Magnabosco JL: Outcomes Measurement in the Human Services: Cross-Cutting Issues and Methods. 1997, Washington, D.C.: National Association of Social Workers Press Mullen EJ, Magnabosco JL: Outcomes Measurement in the Human Services: Cross-Cutting Issues and Methods. 1997, Washington, D.C.: National Association of Social Workers Press
53.
go back to reference Magnabosco JL: An Evaluation of State Public Mental Health System Performance for Adult Persons With Serious Mental Health Illness: Effects of State Political Culture and State Mental Health Planning and Implementation Characteristics on State Public Mental Health System Comprehensiveness. 2001, Ann Arbor, MI Magnabosco JL: An Evaluation of State Public Mental Health System Performance for Adult Persons With Serious Mental Health Illness: Effects of State Political Culture and State Mental Health Planning and Implementation Characteristics on State Public Mental Health System Comprehensiveness. 2001, Ann Arbor, MI
55.
go back to reference Pincus HA, Burnam A, Magnabosco JL, Dembosky JW, Greenberg MD: State Activities to improve services and systems of care for individuals with Co-Occurring Mental and Addictive Disorders. WR-119-CSAT. The RAND Corporation. 2005 Pincus HA, Burnam A, Magnabosco JL, Dembosky JW, Greenberg MD: State Activities to improve services and systems of care for individuals with Co-Occurring Mental and Addictive Disorders. WR-119-CSAT. The RAND Corporation. 2005
56.
go back to reference Gore A: Creating a Government that Works Better and Costs Less: Report of the National Performance Review. 1993, Washington, D.C.: Government Printing Office Gore A: Creating a Government that Works Better and Costs Less: Report of the National Performance Review. 1993, Washington, D.C.: Government Printing Office
Metadata
Title
Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project
Author
Jennifer L Magnabosco
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2006
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-1-13

Other articles of this Issue 1/2006

Implementation Science 1/2006 Go to the issue