Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-11-2016 | Original Paper

A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System

Authors: Rinad S. Beidas, Rebecca E. Stewart, Danielle R. Adams, Tara Fernandez, Susanna Lustbader, Byron J. Powell, Gregory A. Aarons, Kimberly E. Hoagwood, Arthur C. Evans, Matthew O. Hurford, Ronnie Rubin, Trevor Hadley, David S. Mandell, Frances K. Barg

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2016

Abstract

Our goal was to identify barriers and facilitators to the implementation of evidence-based practices from the perspectives of multiple stakeholders in a large publicly funded mental health system. We completed 56 interviews with three stakeholder groups: treatment developers (n = 7), agency administrators (n = 33), and system leadership (n = 16). The three stakeholder groups converged on the importance of inner (e.g., agency competing resources and demands, therapist educational background) and outer context (e.g., funding) factors as barriers to implementation. Potential threats to implementation and sustainability included the fiscal landscape of community mental health clinics and an evolving workforce. Intervention characteristics were rarely endorsed as barriers. Inner context, outer context, and intervention characteristics were all seen as important facilitators. All stakeholders endorsed the importance of coordinated collaboration across stakeholder groups within the system to successfully implement evidence-based practices.

Available only for authorised users

Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science. doi:10.1186/s13012-014-0192-y.

Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. Journal of Clinical Child and Adolescent Psychology, 43(6), 915–928. doi:10.1080/15374416.2013.876642.CrossRefPubMedPubMedCentral

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011a). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.CrossRefPubMed

Aarons, G. A., Sommerfeld, D. H., & Willging, C. E. (2011b). The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychological Services, 8(4), 269–281. doi:10.1037/a002619.CrossRefPubMedPubMedCentral

Aarons, G. A., Wells, R. S., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: A multiple stakeholder analysis. American Journal of Public Health, 99(11), 2087–2095. doi:10.2105/AJPH.2009.161711.CrossRefPubMedPubMedCentral

American Psychological Association (2009) Partnering with communication scientists, collaborating across disciplines and leveraging impact to promote children’s mental health. Report of Healthy Development: A Summit on Young Children’s Mental Health. Washington, DC: Society for Research in Child Development.

American Psychological Association Presidential Task Force on Evidence-Based Practic. (2006). Evidence-based practice in psychology. The American Psychologist, 61(4), 271–285. doi:10.1037/0003-066X.61.4.271.CrossRef

Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K.,…, Mandell, D. S. (2013). Policy to implementation: Evidence-based practice in community mental health–Study protocol. Implementation Science, 8(38). doi: 10.1186/1748-5908-8-38.

Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C.,…, Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics. doi:10.1001/jamapediatrics.2014.3736.

Beidas, R. S., Marcus, S., Benjamin Wolk, C., Powell, B., Aarons, G., Evans, C.,…, Mandell, D. S. (2015). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-015-0673-6.

Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014). Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 228–236. doi:10.1007/s10488-012-0461-5.CrossRefPubMed

Bradley, E. H., Curry, L. A., & Devers, K. J. (2007). Qualitative data analysis for health services research: Developing taxonomy, themes, and theory. Health Services Research Journal, 42(4), 1758–1772. doi:10.1111/j.1475-6773.2006.00684.x.CrossRef

Casper, E. S. (2008). Using implementation intentions to teach practitioners: Changing practice behaviors via continuing education. Psychiatric Services, 59(7), 747–752. doi:10.1176/appi.ps.59.7.747.CrossRefPubMed

Chambers, D. A., & Azrin, S. T. (2013). Research and services partnerships: Partnership: A fundamental component of dissemination and implementation research. Psychiatric Services, 64(6), 509–511. doi:10.1176/appi.ps.201300032.CrossRefPubMed

Cohen, J. A., Deblinger, E., Mannarino, A. P., & Steer, R. A. (2004). A multisite, randomized controlled trial for children with sexual abuse-related PTSD symptoms. Journal of the American Academy of Child and Adolescent Psychiatry, 43(4), 393–402. doi:10.1097/00004583-200404000-00005.CrossRefPubMedPubMedCentral

Creed, T., Stirman, S., Evans, A., & Beck, A. (2014). A model for implementation of cognitive therapy in community mental health: The Beck Initiative. The Behavior Therapist, 37(3), 56–65.

Croft, B., & Parish, S. L. (2013). Care integration in the Patient Protection and Affordable Care Act: Implications for behavioral health. Administration and Policy in Mental Health and Mental Health Services Research, 40(4), 258–263. doi:10.1007/s10488-012-0405-0.CrossRefPubMed

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science. doi:10.1186/1748-5908-4-50.PubMedPubMedCentral

Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540. doi:10.1177/1049731509335549.CrossRef

Foa, E. B., Hembree, E. A., Cahill, S. P., Rauch, S. A., Riggs, D. S., Feeny, N. C., & Yadin, E. (2005). Randomized trial of prolonged exposure for posttraumatic stress disorder with and without cognitive restructuring: Outcome at academic and community clinics. Journal of Consulting and Clinical Psychology, 73(5), 953–964. doi:10.1037/0022-006X.73.5.953.CrossRefPubMed

Green, A. E., & Aarons, G. A. (2011). A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implementation Science. doi:10.1186/1748-5908-6-104.

Hoge, M. A., & Morris, J. A. (2004). Implementing best practices in behavioral health workforce education-building a change agenda. Administration and Policy in Mental Health and Mental Health Services Research, 32(2), 85–89. doi:10.1023/B:APIH.0000042741.19527.a8.CrossRefPubMed

Hoge, M. A., Morris, J. A., Stuart, G. W., Huey, L. Y., Bergeson, S., Flaherty, M. T.,…, Madenwald, K. (2009). A national action plan for workforce development in behavioral health. Psychiatric Services, 60(7), 883–887. doi:10.1176/appi.ps.60.7.883.

Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014). Interagency collaborative team model for capacity building to scale-up evidence-based practice. Children and Youth Services Review, 39, 160–168. doi:10.1016/j.childyouth2013.10.005.CrossRefPubMedPubMedCentral

Institute of Medicine Committee on the Quality of Health Care in America. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press.

Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., Morrissey, J. P., Magnabosco, J.,…, Goldman, H. H. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatric Services, 58(7), 914–921. doi:10.1176/appi.ps.58.7.914.

Kutash, K., Acri, M., Pollock, M., Armusewicz, K., Serene Olin, S. C., & Hoagwood, K. E. (2014). Quality indicators for multidisciplinary team functioning in community-based children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 41(1), 55–68. doi:10.1007/s10488-013-0508-2.CrossRefPubMedPubMedCentral

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.CrossRefPubMed

Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113. doi:10.1007/s12310-010-9038-1.CrossRefPubMedPubMedCentral

Linehan, M. M., Comtois, K. A., Murray, A. M., Brown, M. Z., Gallop, R. J., Heard, H. L.,…, Lindenboim, N. (2006). Two-year randomized controlled trial and follow-up of dialectical behavior therapy vs therapy by experts for suicidal behaviors and borderline personality disorder. Archives of General Psychiatry, 63(7), 757–766. doi: 10.1001/archpsyc.63.7.757.

Lloyd, D. (1998). How to maximize service capacity: Nuts and bolts solutions for implementing change in behavioral healthcare organizations below the senior management level. Rockville, MD: National Council for Community Behavioral Healthcare.

Lyon, A. R., Ludwig, K., Romano, E., Koltracht, J., Stoep, A. V., & McCauley, E. (2014). Using modular psychotherapy in school mental health: Provider perspectives on intervention-setting fit. Journal of Clinical Child and Adolescent Psychology, 43(6), 890–901. doi:10.1080/15374416.2013.843460.CrossRefPubMed

Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50, 370–396.CrossRef

McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. American Psychologist, 65(2), 73–84. doi:10.1037/a0018121.CrossRefPubMed

Pagoto, S. L., Spring, B., Coups, E. J., Mulvaney, S., Coutu, M. F., & Ozakinci, G. (2007). Barriers and facilitators of evidence-based practice perceived by behavioral science health professionals. Journal of Clinical Psychology, 63(7), 695–705. doi:10.1002/jclp.20376.CrossRefPubMed

Palinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011). Social networks and implementation of evidence-based practices in public youth-serving systems: A mixed-methods study. Implementation Science. doi:10.1186/1748-5908-6-113.PubMedPubMedCentral

Palinkas, L. A., Olin, S., Chor, B., Young Um, M., Hyeon Jeong, C., O’Connor, B.,…, Hoagwood, K. (2014). Influence of organizational role, consensus and innovation status on perceived facilitators and barriers to adoption of evidence-based practices. Paper presented at the 7th Annual Conference on the Science of Dissemination and Implementation, Bethesda, MD.

Palinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J., Chorpita, B. F., Weisz, J. R., & The Research Network on Youth Mental Health. (2008). An ethnographic study of implementation of evidence-based treatments in child mental health: First steps. Psychiatric Services, 59(7), 738–746. doi:10.1176/appi.ps.59.7.738.CrossRefPubMed

Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C.,…, York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.1177/1077558711430690.

Powell, B.J., Beidas, R.S., Stewart, R.E., Wolk, C.B., Rubin, R.M., Matlin, S.L., Weaver, S., Hurford, M.O., Evans, A.C., Hadley, T., & Mandell, D.S. (in review). Applying the policy ecology framework to Philadlephia’s Behavioral Health Transformation Efforts.

Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012). Writing implementation research grant proposals: Ten key ingredients. Implementation Science. doi:10.1186/1748-5908-7-96.

Rapp, C. A., Etzel-Wise, D., Marty, D., Coffman, M., Carlson, L., Asher, D.,…, Holter, M. (2010). Barriers to evidence-based practice implementation: Results of a qualitative study. Community Mental Health Journal, 46(2), 112–118. doi: 10.1007/s10597-009-9238-z.

Ringle, V., Read, K., Edmunds, J., Brodman, D., Kendall, P., Barg, F., & Beidas, R. S. (2015). Barriers and facilitators to the implementation of cognitive-behavioral therapy for youth anxiety in the community. Psychiatric Services, 66(9), 938–945. doi:10.1176/appi.ps.201400134.CrossRefPubMedPubMedCentral

Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. BMJ, 312(7023), 71–72. doi:10.1136/bmj.312.7023.71.CrossRefPubMedPubMedCentral

Scaccia, J., Cook, B., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. S. (2015). A practical implementation science heuristic for organizational readiness: R = MC2. Journal of Community Psychology, 43(4), 484–501.CrossRefPubMedPubMedCentral

Southam-Gerow, M. A., Rodriguez, A., Chorpita, B. F., & Daleiden, E. L. (2012). Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology-Research and Practice, 43(5), 527–534. doi:10.1037/a0029101.CrossRef

Staw, B. M., Sandelands, L. E., & Dutton, J. E. (1981). Threat-rigidity effects in organizational-behavior—a multilevel analysis. Administrative Science Quarterly, 26(4), 501–524. doi:10.2307/2392337.CrossRef

Stewart, R., Adams, D. R., Mandell, D., Hadley, T., Evans, A., Rubin, R., …, Beidas, R. S. (2015). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services. doi:10.1176/appi.ps.201500392.

Stirman, S. W., Gutierrez-Colina, A., Toder, K., Esposito, G., Barg, F., Castro, F.,…, Crits-Christoph, P. (2013). Clinicians’ perspectives on Cognitive Therapy in community mental health settings: Implications for training and implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(4), 274–285. doi: 10.1007/s10488-012-0418-8.

Stirman, S. W., Spokas, M., Creed, T. A., Farabaugh, D. T., Bhar, S. S., Brown, G. K.,…, Beck, A. T. (2010). Training and consultation in evidence-based psychosocial treatments in public mental health settings: The ACCESS Model. Professional Psychology, Research and Practice, 41(1), 48–56. doi:10.1037/a0018099.

Trupin, E., Weiss, N., & Kerns, S. E. U. (2014). Social impact bonds behavioral health opportunities. JAMA Pediatrics, 168(11), 985–986. doi:10.1001/jamapediatrics.2014.1157.CrossRefPubMed

Willging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2015). From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment, 20(1), 24–36. doi:10.1177/1077559514547384.CrossRefPubMed

Title: A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System
Authors: Rinad S. Beidas
Rebecca E. Stewart
Danielle R. Adams
Tara Fernandez
Susanna Lustbader
Byron J. Powell
Gregory A. Aarons
Kimberly E. Hoagwood
Arthur C. Evans
Matthew O. Hurford
Ronnie Rubin
Trevor Hadley
David S. Mandell
Frances K. Barg
Publication date: 01-11-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-015-0705-2

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2016

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study

A Supervisor-Targeted Implementation Approach to Promote System Change: The R3 Model

Applying the Policy Ecology Framework to Philadelphia’s Behavioral Health Transformation Efforts

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration