Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-05-2017 | Original Article

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative

Authors: Shannon Dorsey, Aaron R. Lyon, Michael D. Pullmann, Nathaniel Jungbluth, Lucy Berliner, Rinad Beidas

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2017

Abstract

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess “analogue fidelity” in a children’s mental health quality improvement initiative. Results indicated low—but representative—clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

Available only for authorised users

Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5(2), 88.CrossRefPubMedPubMedCentral

Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331.CrossRefPubMed

Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Research Network on Youth Mental Health. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 518–529.CrossRefPubMedPubMedCentral

Beidas, R. S., Cross, W., & Dorsey, S. (2014). Show me, don’t tell me: Behavioral rehearsal asa training and analogue fidelity tool. Cognitive and Behavioral Practice, 21(1), 1–11.CrossRefPubMed

Beidas, R. S., Edmunds, J. M., Cannuscio, C. C., Gallagher, M., Downey, M. M., & Kendall, P. C. (2013). Therapists perspectives on the effective elements of consultation following training. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 507–517. doi:10.1007/s10488-013-0475-7.CrossRefPubMedPubMedCentral

Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665.CrossRefPubMedPubMedCentral

Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30.

Beidas, R. S., Koerner, K., Weingardt, K. R., & Kendall, P. C. (2011). Training research: Practical recommendations for maximum impact. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 223–237. doi:10.1007/s10488-011-0338-z.CrossRefPubMedPubMedCentral

Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., et al. (2015a). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. doi:10.1001/jamapediatrics.2014.3736.CrossRefPubMedPubMedCentral

Beidas, R. S., Marcus, S., Wolk, C. B., Powell, B., Aarons, G. A., Evans, A. C., et al. (2015b). A prospective examination of clinician and supervisor turnover within the context of implementation of evidence-based practices in a publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-015-0673-6.PubMedPubMedCentral

Bernstein, A., Chorpita, B. F., Daleiden, E. L., Ebesutani, C. K., & Rosenblatt, A. (2015). Building an evidence-informed service array: Considering evidence-based programs as well as their practice elements. Journal of Consulting and Clinical Psychology, 83(6), 1085–1096. doi:10.1037/ccp0000029.CrossRefPubMed

Brookman-Frazee, L., Garland, A. F., Taylor, R., & Zoffness, R. (2009). Therapists’ attitudes towards psychotherapeutic strategies in community-based psychotherapy with children with disruptive behavior problems. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 1–12. doi:10.1007/s10488-008-0195-6.CrossRefPubMed

Brookman-Frazee, L., Haine, R. A., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2010). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 254–269. doi:10.1007/s10488-009-0244-9.CrossRefPubMed

Chapman, J. E., McCart, M. R., Letourneau, E. J., & Sheidow, A. J. (2013). Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of Consulting and Clinical Psychology, 81(4), 674–680. doi:10.1037/a0033021.CrossRefPubMedPubMedCentral

Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566.CrossRefPubMed

Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20.CrossRefPubMed

Chorpita, B. F., Park, A., Tsai, K., Korathu-Larson, P., Higa-McMillan, C. K., Nakamura, B. J., et al. (2015). Balancing effectiveness with responsiveness: Therapist satisfaction across different treatment designs in the Child STEPs randomized effectiveness trial. Journal of Consulting and Clinical Psychology. doi:10.1037/a0039301.

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284.CrossRef

Cross, W. F., Seaburn, D., Gibbs, D., Schmeelk-Cone, K., White, A. M., & Caine, E. D. (2011). Does practice make perfect? A randomized control trial of behavioral rehearsal on suicide prevention gatekeeper skills. The Journal of Primary Prevention, 32(3–4), 195–211.CrossRefPubMedPubMedCentral

Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M., & Murray, L. K. (2014). A statewide common elements initiative for children’s mental health. Journal of Behavioral Health Services and Research. doi:10.1007/s11414-014-9430-y.

Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., et al. (2013). Improving practice in community-based settings: A randomized trial of supervision—study protocol. Implementation Science, 8(89), 1–12.

Edmunds, J. M., Kendall, P. C., Ringle, V. A., Read, K. L., Brodman, D. M., Pimentel, S. S., & Beidas, R. S. (2013). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 456–466. doi:10.1007/s10488-013-0490-8.CrossRefPubMed

Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26.CrossRefPubMedPubMedCentral

Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30, 448–466.CrossRefPubMedPubMedCentral

Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11(3), 267–288.

Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68(3), 451.CrossRefPubMed

Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 37, 230–244.CrossRefPubMed

Kazantzis, N., Deane, F. P., & Ronan, K. R. (2000). Homework assignments in cognitive and behavior therapy: A meta-analysis. Clinical Psychology: Science and Practice, 7(2), 189–202. doi:10.1093/clipsy.7.2.189.

Kazantzis, N., Deane, F. P., Ronan, K. R., & L’Abate, L. (Eds.). (2005). Using homework assignments in cognitive behavior therapy. New York: Routledge.

Kazantzis, N., Whittington, C., & Dattilio, F. (2010). Meta-analysis of homework effects in cognitive behavioral therapy: A replication and extension. Clinical Psychology: Science and Practice, 17(2), 144–156. doi:10.1111/j.1468-2850.2010.01204.x.

Lyon, A. R., Dorsey, S., Pullman, M., Silbaugh-Cowdin, J., & Berliner, L. (2014). Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Administration and Policy in Mental Health and Mental Health Services Research, 42(1), 47–60.CrossRef

McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65(2), 73.CrossRefPubMed

McLeod, B. D., Smith, M. M., Southam-Gerow, M. A., Weisz, J. R., & Kendall, P. C. (2015). Measuring treatment differentiation for implementation research: The Therapy Process Observational Coding System for Child Psychotherapy Revised Strategies Scale. Psychological Assessment, 27(1), 314–325. doi:10.1037/pas0000037.CrossRefPubMed

McLeod, B. D., & Weisz, J. R. (2010). The therapy process observational coding system for child psychotherapy strategies scale. Journal of Clinical Child & Adolescent Psychology, 39(3), 436–443.CrossRef

Merikangas, K. R., He, J. P., Brody, D., Fisher, P. W., Bourdon, K., & Koretz, D. S. (2010). Prevalence and treatment of mental disorders among US children in the 2001–2004 NHANES. Pediatrics, 125(1), 75–81.CrossRefPubMed

Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29, 457–471. doi:10.1017/S1352465801004064.CrossRef

Nakamura, B. J., Selbo-Bruns, A., Okamura, K., Chang, J., Slavin, L., & Shimabukuro, S. (2014). Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy. Behaviour Research and Therapy, 53, 10–19. doi:10.1016/j.brat.2013.12.001.CrossRefPubMed

Outcome Evaluation of Washington State’s Evidence-Based Programs for Juvenile Offenders, January 2004. Washington State Institute for Public Policy, Report #04-01-1201.

Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829.CrossRefPubMed

Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21. doi:10.1186/s13012-015-0209-1.CrossRefPubMedPubMedCentral

President’s New Freedom Commission on Mental Health. (2003). Achieving the promise: Transforming mental health care in America.

Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76.CrossRefPubMed

Rakovshik, S. G., & McManus, F. (2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496–516.CrossRefPubMed

Ringle, V. A., Read, K. L., Edmunds, J. M., Brodman, D. M., Kendall, P. C., Barg, F., & Beidas, R. S. (2015). Barriers to and facilitators in the implementation of cognitive-behavioral therapy for youth anxiety in the community. Psychiatric Services, 66(9), 938–945.CrossRefPubMedPubMedCentral

Sburlati, E. S., Schniering, C. A., Lyneham, H. J., & Rapee, R. M. (2011). A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clinical Child and Family Psychology Review, 14(1), 89–109.CrossRefPubMed

Schoenwald, S. K., & Garland, A. F. (2013). A review of treatment adherence measurement methods. Psychological Assessment, 25(1), 146–156.CrossRefPubMed

Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43.CrossRefPubMedPubMedCentral

Schulman, K. A., Berlin, J. A., Harless, W., Kerner, J. F., Sistrunk, S., Gersh, B. J., et al. (1999). The effect of race and sex on physicians’ recommendations for cardiac catheterization. New England Journal of Medicine, 340(8), 618–626. doi:10.1056/NEJM199902253400806.CrossRefPubMed

Shah, H., Rossen, B., Lok, B., Londino, D., Lind, S. D., & Foster, A. (2012). Interactive virtual-patient scenarios: An evolving tool in psychiatric education. Academic Psychiatry, 36(2), 146–150. doi:10.1176/appi.ap.10030049.CrossRefPubMed

Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis. New York: Oxford University Press.CrossRef

Ward, A. M., Regan, J., Chorpita, B. F., Starace, N., Rodriguez, A., Okamura, K., & Research Network on Youth Mental Health. (2013). Tracking evidence based practice with youth: Validity of the MATCH and Standard Manual Consultation Records. Journal of Clinical Child & Adolescent Psychology, 42(1), 44–55.CrossRef

Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282.CrossRefPubMed

Weisz, J. R., & Gray, J. S. (2008). Evidence-based psychotherapy for children and adolescents: Data from the present and a model for the future. Child and Adolescent Mental Health, 13(2), 54–65. doi:10.1111/j.1475-3588.2007.00475.x.CrossRef

Williams, C., Martinez, R., Dafters, R., Ronald, L., & Garland, A. (2011). Training the wider workforce in cognitive behavioural self-help: The SPIRIT (Structured Psychosocial Interventions in Teams) training course. Behavioural and Cognitive Psychotherapy, 39(02), 139–149.CrossRefPubMed

Young, J. & Beck, A. T. (1980). Cognitive therapy scale rating manual. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA.

Title: Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative
Authors: Shannon Dorsey
Aaron R. Lyon
Michael D. Pullmann
Nathaniel Jungbluth
Lucy Berliner
Rinad Beidas
Publication date: 01-05-2017
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2017
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-016-0727-4

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2017

Barriers to Implementing Person-Centered Recovery Planning in Public Mental Health Organizations in Texas: Results from Nine Focus Groups

Barriers to Employment for Transition-age Youth with Developmental and Psychiatric Disabilities

Individual Placement and Support for People with Autism Spectrum Disorders: A Pilot Program

Individual Placement and Support: Penetration and New Populations

Prevalence and Quality of Individual Placement and Support (IPS) Supported Employment in the United States

Barriers and Facilitators to Sustainment of an Evidence-Based Supported Employment Program