Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-11-2016 | Original Paper

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study

Authors: Erum Nadeem, Dara Weiss, S. Serene Olin, Kimberly E. Hoagwood, Sarah M. Horwitz

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2016

Abstract

Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. C. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.PubMedCrossRef

Ayers, L., Beyea, S., Godfrey, M., Harper, D., Nelson, E., & Batalden, P. (2005). Quality improvement learning collaboratives. Quality Management in Healthcare, 14(4), 234–247.CrossRef

Becker, D. R., Drake, R. E., Bond, G. R., Nawaz, S., Haslett, W. R., & Martinez, R. A. (2011). Best practices: A national mental health learning collaborative on supported employment. Psychiatric Services, 62(7), 704–706.PubMedCrossRef

Beidas, R. S., Edmunds, J. E., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665.PubMedPubMedCentralCrossRef

Berwick, D. M. (1989). Continuous improvement as an ideal in health care. New England Journal of Medicine, 320(1), 53–56.PubMedCrossRef

Bunger, A. C., Hanson, R. F., Doogan, N. J., Powell, B. J., Cao, Y., & Dunn, J. (2016). Can learning collaboratives support implementation by rewiring professional networks? Administration and Policy in Mental Health and Mental Health Services Research, 43(1), 79–92.PubMedCrossRef

Cavaleri, M. A., Gopalan, G., McKay, M. M., Appel, A., Bannon, W. M., Bigley, M. F., & Thalor, S. (2006). Impact of a learning collaborative to improve child mental health service use among low-income urban youth and families. Best Practice in Mental Health, 2(2), 67–79.

Cavaleri, M. A., Gopalan, G., McKay, M. M., Messam, T., Velez, E., & Elwyn, L. (2010). The effect of a learning collaborative to improve engagement in child mental health services. Children and Youth Services Review, 32(2), 281–285.CrossRef

Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 114–123.PubMedCrossRef

Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579.PubMedCrossRef

Committee on Quality of Health Care in America-Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington: National Academies Press.

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50–64.PubMedPubMedCentralCrossRef

Davis, D., Thomson, M., Oxman, A., & Haynes, B. (1995). Changing physician performance: A systematic review of the effect of continuing medical education strategies. JAMA, 274, 700–705.PubMedCrossRef

Deming, W. E. (1986). Out of the crisis. Cambridge: MIT Press.

Dückers, M., Spreeuwenberg, P., Wagner, C., & Groenewegen, P. (2009). Exploring the black box of quality improvement collaboratives: Modelling relations between conditions, applied changes and outcomes. Implementation Science, 4(1), 74.PubMedPubMedCentralCrossRef

Ebert, L., Amaya-Jackson, L., Markiewicz, J., Kisiel, C., & Fairbank, J. (2011). Use of the Breakthrough Series Collaborative to support broad and sustained use of evidence-based trauma treatment for children in community practice settings. Administration and Policy in Mental Health and Mental Health Services Research, 39(3), 187–199.CrossRef

Ferlie, E., & Shortell, S. (2001). Improving the quality of health care in the United Kingdom and the United States: A framework for change. The Milbank Quarterly, 79(2), 281–315.PubMedPubMedCentralCrossRef

Fremont, A., Joyce, G., Anaya, H., Bowman, C., Halloran, J., Chang, S., & Asch, S. (2006). An HIV collaborative in the VHA: Do advanced HIT and one-day sessions change the collaborative experience? Joint Commission Journal on Quality and Patient Safety, 32(6), 324–336.PubMed

Gamble, J. (2008). A developmental evaluation primer. Montreal: JW McConnell Family Foundation.

Gleacher, A. A., Nadeem, E., Moy, A., Whited, A., Albano, A. M., Wang, R., & Hoagwood, K. E. (2010). The Evidence Based Treatment Dissemination Center: An innovative statewide dissemination effort. Journal of Emotional and Behavioral Disorders, 19(1), 1–11.

Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537–550.PubMedPubMedCentralCrossRef

Greenhalgh, T., Robert, G., MacFarland, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629.PubMedPubMedCentralCrossRef

Gustafson, D. H., Quanbeck, A. R., Robinson, J. M., Ford, J. H., Pulvermacher, A., French, M. T., & McCarty, D. (2013). Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction, 108(6), 1145–1157.PubMedPubMedCentralCrossRef

Honberg, R., Kimball, A., Diehl, S., Usher, L., & Fitzpatrick, M. (2011). State mental health cuts: The continuing crisis. Arlington: The National Alliance on Mental Illness.

Hopkin, C. R., Hoyle, R. H., & Gottfredson, N. C. (2015). Maximizing the yield of small samples in prevention research: A review of general strategies and best practices. Prevention Science, 16(7), 950–955.PubMedPubMedCentralCrossRef

Institute for Healthcare Improvement. (2003). The Breakthrough Series: IHI’s collaborative model for achieving breakthrough improvement: IHI Innovation Series White Paper.

Juran, J. M. (1951). Quality control handbook. New York: McGraw-Hill.

Juran, J. M. (1964). Managerial breakthrough. New York: McGraw-Hill.

Katzelnick, D. J., Von Korff, M., Chung, H., Provost, L. P., & Wagner, E. H. (2005). Applying depression-specific change concepts in a collaborative breakthrough series. Joint Commission Journal on Quality and Patient Safety, 31(7), 386–397.PubMed

Kilo, C. (1998). A framework for collaborative improvement: Lessons from the Institute for Healthcare Improvement’s Breakthrough Series. Quality Management in Health care, 6, 1–14.PubMedCrossRef

Kolb, D. A. (1984). Experiential learning. New Jersey: Prentice Hall.

Leatherman, S. (2002). Optimizing quality collaboratives. Quality and Safety in Health Care, 11(4), 307.PubMedPubMedCentralCrossRef

Markiewicz, J., Ebert, L., Ling, D., Amaya-Jackson, L., & Kisiel, C. (2006). Learning Collaborative Toolkit. Los Angeles, CA, and Durham, NC: National Center for Child Traumatic Stress.

Merriam, S. B. (2001). Andragogy and self-directed learning: Pillars of adult learning theory. New Directions for Adult and Continuing Education, 89, 3–14.CrossRef

Mittman, B. (2004). Creating the evidence base for quality improvement collaboratives. Annals of Internal Medicine, 140(11), 897–901.PubMedCrossRef

Nadeem, E., Gleacher, A., & Beidas, R. S. (2013a). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450.PubMedPubMedCentralCrossRef

Nadeem, E., Olin, S. S., Hill, L. C., Hoagwood, K. E., & Horwitz, S. M. (2013b). Understanding the components of Quality Improvement Collaboratives: A systematic literature review. The Milbank Quarterly, 91(2), 354–394.PubMedPubMedCentralCrossRef

Nadeem, E., Olin, S. S., Hill, L. C., Hoagwood, K. E., & Horwitz, S. M. (2014). Learning Collaboratives in mental health: Used but untested. Psychiatric Services, 65(9), 1088–1099.PubMedPubMedCentralCrossRef

Nembhard, I. M. (2009). Learning and improving in quality improvement collaboratives: Which collaborative features do participants value most? Health Services Research, 44(2 Pt. 1), 359–378.PubMedPubMedCentralCrossRef

Nembhard, I. M. (2012). All teach, all learn, all improve?: The role of interorganizational learning in quality improvement collaboratives. Health Care Management Review, 37(2), 154–164.PubMedPubMedCentralCrossRef

Olin, S. S., Nadeem, E., Gleacher, A. T., Weaver, J., Weiss, D., Hoagwood, K. E., & Horwitz, S. M. (2015). What predicts clinician dropout from state-sponsored managing and adapting practice training. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0709-y.

Ovretveit, J., Bate, P., Cleary, P., & Cretin, S. Gustafson. (2002). Quality collaboratives: Lessons from research. Quality & Safety in Health Care, 11(4), 345–351.CrossRef

Palinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011). Social networks and implementation of evidence-based practices in public youth-serving systems: A mixed-methods study. Implementation Science, 6(1), 113–123.PubMedPubMedCentralCrossRef

Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.

Pinto, A., Benn, J., Burnett, S., Parand, A., & Vincent, C. (2011). Predictors of the perceived impact of a patient safety collaborative: An exploratory study. International Journal for Quality in Health Care, 23(2), 173–181.PubMedCrossRef

Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., & York, J. L. (2011). A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev, 69(2), 123–157.PubMedPubMedCentralCrossRef

PracticeWise. (2014). PracticeWise Retrieved September 15, 2014, from http://www.practicewise.com.

Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8, 139.PubMedPubMedCentralCrossRef

Raghavan, R., Bright, C., & Shadoin, A. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3(1), 26.PubMedPubMedCentralCrossRef

Richardson, J. W. (2011). Technology adoption in Cambodia: Measuring factors impacting adoption rates. Journal of International Development, 23, 697–710.CrossRef

Roosa, M., Scripa, J. S., Zastowny, T. R., & Ford, J. H. (2011). Using a NIATx based local learning collaborative for performance improvement. Evaluation and Program Planning, 34(4), 390–398.PubMedPubMedCentralCrossRef

Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410.PubMedPubMedCentralCrossRef

Schouten, L., Grol, R., & Hulscher, M. (2010). Factors influencing success in quality-improvement collaboratives: Development and psychometric testing of an instrument. Implementation Science, 5(1), 84.PubMedPubMedCentralCrossRef

Schouten, L. M. T., Hulscher, M. E. J. L., Everdingen, J. J. E., Huijsman, R., & Grol, R. P. T. M. (2008). Evidence for the impact of quality improvement collaboratives: A systematic review. British Medical Journal, 336(7659), 1491–1494.PubMedPubMedCentralCrossRef

Singer, S. J., Moore, S. C., Meterko, M., & Williams, S. (2012). Development of a short-form learning organization survey: The LOS-27. Medical Care Research and Review, 69(4), 432–459.PubMedCrossRef

Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). MAPping Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43(2), 190–200.CrossRef

Substance Abuse and Mental Health Services Administration. (2012). SAMHSA is accepting applications for up to $30 million in State Adolescent Enhancement and Dissemination grants. SAMHSA Bulletin Retrieved from http://www.samhsa.gov/newsroom/advisories/1206124742.aspx.

Vannoy, S. D., Mauer, B., Kern, J., Girn, K., Ingoglia, C., Campbell, J., & Unützer, J. (2011). A learning collaborative of CMHCs and CHCs to support integration of behavioral health and general medical care. Psychiatric Services, 62(7), 753–758.PubMedCrossRef

Wilson, T., Berwick, D. M., & Cleary, P. (2004). What do collaborative improvement projects do? Experience from seven countries. Joint Commission Journal on Quality and Patient Safety, 30(Supplement 1), 25–33.

Yin, R. K. (2009). Case Study Research: Design and Methods (4th ed.). Thousand Oaks: Sage Publications.

Title: Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study
Authors: Erum Nadeem
Dara Weiss
S. Serene Olin
Kimberly E. Hoagwood
Sarah M. Horwitz
Publication date: 01-11-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-016-0735-4

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2016

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Measuring Sustainment of Multiple Practices Fiscally Mandated in Children’s Mental Health Services

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration

Advancing Implementation Research and Practice in Behavioral Health Systems

A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System