Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-01-2017 | Original Paper

Developing a Quality Assurance System for Multiple Evidence Based Practices in a Statewide Service Improvement Initiative

Authors: Georganna Sedlar, Eric J. Bruns, Sarah C. Walker, Suzanne E. U. Kerns, Andrea Negrete

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1/2017

Abstract

Efforts to implement evidence based practices (EBP) are increasingly common in child-serving systems. However, public systems undertaking comprehensive improvement efforts that aim to increase availability of multiple practices at the same time may struggle to build comprehensive and user-friendly strategies to develop the workforce and encourage adoption, faithful implementation, and sustainability of selected EBPs. Given that research shows model adherence predicts positive outcomes, one critical EBP implementation support is systematic quality, fidelity, and compliance monitoring. This paper describes the development and initial implementation of a quality assurance framework for a statewide EBP initiative within child welfare. This initiative aimed to improve provider practice and monitor provider competence and compliance across four different EBPs, and to inform funding and policy decisions. The paper presents preliminary data as an illustration of lessons learned during the quality monitoring process and concludes with a discussion of the promise and challenges of developing and applying a multi-EBP quality assurance framework for use in public systems.

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.CrossRefPubMed

Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health, 34(4), 411–419.CrossRefPubMed

Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77(2), 270–280. doi:10.1037/a0013223.CrossRefPubMedPubMedCentral

Alexander, J., Barton, C., Gordon, D., Grotpeter, J., Hansson, K., Harrison, R., & Sexton, T. (1998). Functional Family Therapy: Blueprints for violence prevention, Book Three. Blueprints for Violence Prevention Series (D.S. Elliott Eds.). Boulder: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado.

Barnoski, R. P. (2009). Providing evidence-based programs with fidelity in Washington State juvenile courts : Cost analysis. Olympia: Washington State Institute for Public Policy.

Barth, R. P. (2008). The move to evidence-based practice: how well does it fit child welfare services? (Cover story). Journal of Public Child Welfare, 2(2), 145–171. doi:10.1080/15548730802312537.CrossRef

Barth, R. P., Lee, B. R., Lindsey, M. A., Collins, K. S., Strieder, F., Chorpita, B. F., & Sparks, J. A. (2011). Evidence-based practice at a crossroads: The timely emergence of common elements and common factors. Research on Social Work Practice, 22(1), 108–119. doi:10.1177/1049731511408440.CrossRef

Bond, G. R. (2000). Introduction to a special section: Measurement of fidelity in psychiatric rehabilitation research. Mental Health Services Research, 2(2), 73.CrossRef

Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., & Whitley, R. (2009). Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice, 19(5), 569–581.CrossRef

Bruns, E. J., & Hoagwood, K. E. (2008). State implementation of evidence-based practice for youths, Part I: Responses to the state of the evidence. Journal of the American Academy of Child and Adolescent Psychiatry, 47(4), 369–373.CrossRefPubMed

Bumbarger, B. K., & Campbell, E. M. (2012). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 268–277. doi:10.1007/s10488-011-0372-x.CrossRefPubMed

Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40.CrossRefPubMedPubMedCentral

Chaffin, M. J., & Friedrich, B. (2004). Evidence-based treatments in child abuse and neglect. Children and Youth Services Review, 26(11), 1097–1113. doi:10.1016/j.childyouth.2004.08.008.CrossRef

Chaffin, M. J., Funderburk, B., Bard, D., & Valle, L. A. (2011). A combined motivation and parent–child interaction therapy package reduces child welfare recidivism in a randomized dismantling field trial. Journal of Consulting and Clinical Psychology, 79(1), 84–95. doi:10.1037/a0021227.CrossRefPubMed

Chaffin, M. J., Hecht, D. B., Bard, D., Silovsky, J. F., & Beasley, W. H. (2012). A statewide trial of the SafeCare home-based services model with parents in Child Protective Services. Pediatrics, 129(3), 509–515.CrossRefPubMedPubMedCentral

Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children’s mental health services. Journal of Consulting and Clinical Psychology, 79(4), 470–480.CrossRefPubMed

Chorpita, B. F., & Daleiden, E. L. (2014). Structuring the collaboration of science and service in pursuit of a shared vision. Journal of Clinical Child and Adolescent Psychology, 43(2), 323–338.CrossRefPubMed

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation science. doi:10.1186/1748-5908-4-50.PubMedPubMedCentral

Edwards, A., & Lutzker, J. R. (2008). Iterations of the SafeCare model: an evidence-based child maltreatment prevention program. Behavior Modification, 32(5), 736–756.CrossRefPubMed

Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540.CrossRef

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.

Garland, A. F., Hurlburt, M. S., Brookman-frazee, L., Taylor, R. M., & Accurso, E. C. (2010). Methodological challenges of characterizing usual care psychotherapeutic practice. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 208–220. doi:10.1007/s10488-009-0237-8.CrossRefPubMed

Huey, S. J, Jr, Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68(3), 451–467. doi:10.1037/0022-006X.68.3.451.CrossRefPubMed

Kaye, S., & Osteen, P. J. (2011). Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention. Children and Youth Services Review, 33(11), 2146–2151.CrossRef

Kinney, J., Haapala, D., & Booth, C. (1991). Keeping families together: The homebuilders model. New York: A. de Gruyter.

Leve, L. D., Fisher, P. A., & Chamberlain, P. (2009). Multidimensional treatment foster care as a preventive intervention to promote resiliency among youth in the child welfare system. Journal of Personality, 77(6), 1869–1902. doi:10.1111/j.1467-6494.2009.00603.x.CrossRefPubMedPubMedCentral

Marcynyszyn, L. A., Maher, E. J., & Corwin, T. W. (2011). Getting with the (evidence-based) program: An evaluation of the Incredible Years parenting training program in child welfare. Children and Youth Services Review Children and Youth Services Review, 33(5), 747–757.CrossRef

Mazzucchelli, T. G., & Sanders, M. R. (2010). Facilitating practitioner flexibility within an empirically supported intervention: Lessons from a system of parenting support. Clinical Psychology: Science and Practice, 17(3), 238–252.

McHugh, K. R., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. The American psychologist, 65(2), 73–84.CrossRefPubMed

McLeod, B. D., Southam-Gerow, M. A., Tully, C. B., Rodríguez, A., & Smith, M. M. (2013). Making a case for treatment integrity as a psychosocial treatment quality indicator for youth mental health care. Clinical Psychology: Science and Practice, 20(1), 14–32. doi:10.1111/cpsp.12020.

Price, J. M., Chamberlain, P., Landsverk, J., Reid, J. B., Leve, L. D., & Laurent, H. (2008). Effects of a foster parent training intervention on placement changes of children in foster care. Child Maltreatment, 13(1), 64–75. doi:10.1177/1077559507310612.CrossRefPubMedPubMedCentral

Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34. doi:10.1007/s10488-008-0197-4.CrossRefPubMed

Sanders, M. R., Markie-Dadds, C., & Turner, K. M. T. (2003). Theoretical, scientific and clinical foundations of the triple P-Positive Parenting Program: A population approach to the promotion of parenting competence. Queensland: The Parenting and Family Support Centre.

Schoenwald, S. K. (2011). It’s a bird, it’s a plane, It’s… fidelity measurement in the real world. Clinical Psychology: Science and Practice, 18(2), 142–147. doi:10.1111/j.1468-2850.2011.01245.x.

Schoenwald, S. K., Garland, A. F., Southam-Gerow, M. A., Chorpita, B. F., & Chapman, J. E. (2011). Adherence measurement in treatments for disruptive behavior disorders: pursuing clear vision through varied lenses. Clinical Psychology: Science and Practice, 18(4), 331–341. doi:10.1111/j.1468-2850.2011.01264.x.

Smith-Boydston, J., Holtzman, R., & Roberts, M. (2014). Transportability of multisystemic therapy to community settings: can a program sustain outcomes without MST services oversight? Child and Youth Care Forum, 43(5), 593–605. doi:10.1007/s10566-014-9255-0.CrossRef

Urquiza, A. J., & McNeil, C. B. (1996). Parent-child interaction therapy: An intensive dyadic intervention for physically abusive families. Child Maltreatment, 1(2), 134–144.CrossRef

US Department of Health and Human Services, A. f. C. a. F., Administration on Children, Youth and Families, Children’s Bureau. (2013). Child Maltreatment 2012. Available from http://www.acf.hhs.gov/programs/cb/research-data-technology/statistics-research/child-maltreatment.

Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61(4), 620–630. doi:10.1037/0022-006X.61.4.620.CrossRefPubMed

Webster-Stratton, C. (2005). Treating conduct problems and strengthening social and emotional competence in yough children: The Dina Dinosaur Treatment Program. In M. Epstein, K. Kutash, & A. J. Duchowski (Eds.), Outcome for children and youth with emotional and behavioral disorders and their families: Programs and evaluation best practices (2nd ed., pp. 597–623). Austin: Pro-Ed Inc.

Webster-Stratton, C. (2012). Achieving Fidelity of IY Program Delivery Content, Dosage and Clinical Processes through Certification/Accreditation. Retrieved November 25, 2012 from http://www.incredibleyears.com/certification/certification-accreditation_FAQ.pdf.

Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. The American Psychologist, 61(7), 671–689.CrossRefPubMed

Title: Developing a Quality Assurance System for Multiple Evidence Based Practices in a Statewide Service Improvement Initiative
Authors: Georganna Sedlar
Eric J. Bruns
Sarah C. Walker
Suzanne E. U. Kerns
Andrea Negrete
Publication date: 01-01-2017
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 1/2017
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-015-0663-8

At a glance: The STEP trials

Springer Medicine

Developing a Quality Assurance System for Multiple Evidence Based Practices in a Statewide Service Improvement Initiative

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2017

The Relationship Between Provider Competence, Content Exposure, and Consumer Outcomes in Illness Management and Recovery Programs

A Non-randomized Comparison of Strategies for Consultation in a Community-Academic Training Program to Implement an Evidence-Based Psychotherapy

Post-training Beliefs, Intentions, and Use of Prolonged Exposure Therapy by Clinicians in the Veterans Health Administration

Turnover among Community Mental Health Workers in Ohio

Impact of Mental Health Services on Resilience in Youth with First Episode Psychosis: A Qualitative Study

Reliable Change and Outcome Trajectories Across Levels of Care in a Mental Health System for Youth