Skip to main content
Top
Published in:

13-02-2024 | Original Article

Mental Health Provider Reach and Engagement in a Countywide Training Initiative

Authors: Brigid R. Marriott, Jack H. Andrews, Evelyn Cho, Siena K. Tugendrajch, Kristin M. Hawley

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 4/2024

Login to get access

Abstract

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.
Literature
go back to reference Barnett, M. L., Brookman-Frazee, L., Gonzalez, J. C., Zhan, C., Rodriguez, A., Stadnick, N. A., & Lau, A. S. (2019). Qualitative reports of how and when therapists adapt children’s evidence-based practices during community implementation. Journal of Clinical Child & Adolescent Psychology, 48(6), 894–905. https://doi.org/10.1080/15374416.2018.1485107CrossRef Barnett, M. L., Brookman-Frazee, L., Gonzalez, J. C., Zhan, C., Rodriguez, A., Stadnick, N. A., & Lau, A. S. (2019). Qualitative reports of how and when therapists adapt children’s evidence-based practices during community implementation. Journal of Clinical Child & Adolescent Psychology, 48(6), 894–905. https://​doi.​org/​10.​1080/​15374416.​2018.​1485107CrossRef
go back to reference Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G., Hoagwood, K. E., Evans, A. C., Hurford, M. O., Rubin, R., Hadley, T., Mandell, D., & Barg, F. (2016). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system hhs public access. Administration and Policy in Mental Health, 43(6), 893–908. https://doi.org/10.1007/s10488-015-0705-2CrossRefPubMedPubMedCentral Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G., Hoagwood, K. E., Evans, A. C., Hurford, M. O., Rubin, R., Hadley, T., Mandell, D., & Barg, F. (2016). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system hhs public access. Administration and Policy in Mental Health, 43(6), 893–908. https://​doi.​org/​10.​1007/​s10488-015-0705-2CrossRefPubMedPubMedCentral
go back to reference Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., Tempesti, T., Drew-Reeves, S. E., Brannan, A. M., & Vides de Andrade, A. R. (2010). Peabody treatment progress battery. In Manual of the Peabody Treatment Progress Battery, 2nd ed. (2nd ed). Vanderbilt University. http://peabody.vanderbilt.edu/ptpb%5C Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., Tempesti, T., Drew-Reeves, S. E., Brannan, A. M., & Vides de Andrade, A. R. (2010). Peabody treatment progress battery. In Manual of the Peabody Treatment Progress Battery, 2nd ed. (2nd ed). Vanderbilt University. http://​peabody.​vanderbilt.​edu/​ptpb%5C
go back to reference Cho, E., Andrews, J. H., Woo, R., Bearman, S. K., & Hawley, K. M. (in prep). The cognitive and behavioral therapy adherence measure: A multi-informant, transdiagnostic, transmanual adherence monitoring tool Cho, E., Andrews, J. H., Woo, R., Bearman, S. K., & Hawley, K. M. (in prep). The cognitive and behavioral therapy adherence measure: A multi-informant, transdiagnostic, transmanual adherence monitoring tool
go back to reference Cho, E., Wood, P. K., Taylor, E. K., Hausman, E. M., Andrews, J. H., & Hawley, K. M. (2019). Evidence-based treatment strategies in youth mental health services: Results from a national survey of providers. Administration and Policy in Mental Health and Mental Health Services Research, 46(1), 71–81. https://doi.org/10.1007/s10488-018-0896-4 Cho, E., Wood, P. K., Taylor, E. K., Hausman, E. M., Andrews, J. H., & Hawley, K. M. (2019). Evidence-based treatment strategies in youth mental health services: Results from a national survey of providers. Administration and Policy in Mental Health and Mental Health Services Research, 46(1), 71–81. https://​doi.​org/​10.​1007/​s10488-018-0896-4
go back to reference Davis, D., Thomson, M., Oxman, A., & Haynes, R. (1995). Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA, 274(9), 700–705.CrossRefPubMed Davis, D., Thomson, M., Oxman, A., & Haynes, R. (1995). Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA, 274(9), 700–705.CrossRefPubMed
go back to reference Dillman, D. (2000). Procedures for conducting government-sponsored establishment surveys: Comparisons of the total design method (TDM), a traditional cost-compensation. Proceedings of American Statistical Association, Second International Conference on Establishment Surveys, 343–352. Dillman, D. (2000). Procedures for conducting government-sponsored establishment surveys: Comparisons of the total design method (TDM), a traditional cost-compensation. Proceedings of American Statistical Association, Second International Conference on Establishment Surveys, 343–352.
go back to reference Gale, R. C., Wu, J., Erhardt, T., Bounthavong, M., Reardon, C. M., Damschroder, L. J., & Midboe, A. M. (2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science, 14(1), 1–12. https://doi.org/10.1186/s13012-019-0853-yCrossRef Gale, R. C., Wu, J., Erhardt, T., Bounthavong, M., Reardon, C. M., Damschroder, L. J., & Midboe, A. M. (2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science, 14(1), 1–12. https://​doi.​org/​10.​1186/​s13012-019-0853-yCrossRef
go back to reference Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327.CrossRefPubMedPubMedCentral Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327.CrossRefPubMedPubMedCentral
go back to reference Gleacher, A. A., Nadeem, E., Moy, A. J., Whited, A. L., Albano, A. M., Radigan, M., Wang, R., Chassman, J., Myrhol-Clarke, B., & Hoagwood, K. E. (2011). Statewide CBT training for clinicians and supervisors treating youth: The New York State evidence based treatment dissemination center. Journal of Emotional and Behavioral Disorders, 19(3), 182–192. https://doi.org/10.1177/1063426610367793CrossRefPubMed Gleacher, A. A., Nadeem, E., Moy, A. J., Whited, A. L., Albano, A. M., Radigan, M., Wang, R., Chassman, J., Myrhol-Clarke, B., & Hoagwood, K. E. (2011). Statewide CBT training for clinicians and supervisors treating youth: The New York State evidence based treatment dissemination center. Journal of Emotional and Behavioral Disorders, 19(3), 182–192. https://​doi.​org/​10.​1177/​1063426610367793​CrossRefPubMed
go back to reference Herschell, A. D., Reed, A. J., Mecca, L. P., & Kolko, D. J. (2014). Community-based clinicians’ preferences for training in evidence-based practices: A mixed-method study. Professional Psychology: Research and Practice, 45(3), 188–199. https://doi.org/10.1037/a0036488CrossRef Herschell, A. D., Reed, A. J., Mecca, L. P., & Kolko, D. J. (2014). Community-based clinicians’ preferences for training in evidence-based practices: A mixed-method study. Professional Psychology: Research and Practice, 45(3), 188–199. https://​doi.​org/​10.​1037/​a0036488CrossRef
go back to reference Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015). Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: Correspondence between therapists and observers. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 229–243. https://doi.org/10.1007/s10488-014-0548-2CrossRefPubMed Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015). Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: Correspondence between therapists and observers. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 229–243. https://​doi.​org/​10.​1007/​s10488-014-0548-2CrossRefPubMed
go back to reference Jensen-Doss, A., Smith, A. M., Walsh, L. M., Mora Ringle, V., Casline, E., Patel, Z., Shaw, A. M., Maxwell, C., Hanson, R., & Webster, R. (2019). Preaching to the choir ? Predictors of engagement in a community-based learning collaborative. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-019-00985-4CrossRefPubMed Jensen-Doss, A., Smith, A. M., Walsh, L. M., Mora Ringle, V., Casline, E., Patel, Z., Shaw, A. M., Maxwell, C., Hanson, R., & Webster, R. (2019). Preaching to the choir ? Predictors of engagement in a community-based learning collaborative. Administration and Policy in Mental Health and Mental Health Services Research. https://​doi.​org/​10.​1007/​s10488-019-00985-4CrossRefPubMed
go back to reference McMillen, J. C., Hawley, K. M., & Proctor, E. K. (2016). Mental health clinicians’ participation in web-based training for an evidence supported intervention: Signs of encouragement and trouble ahead. Administration and Policy in Mental Health and Mental Health Services Research, 43(4), 592–603. https://doi.org/10.1007/s10488-015-0645-xCrossRefPubMed McMillen, J. C., Hawley, K. M., & Proctor, E. K. (2016). Mental health clinicians’ participation in web-based training for an evidence supported intervention: Signs of encouragement and trouble ahead. Administration and Policy in Mental Health and Mental Health Services Research, 43(4), 592–603. https://​doi.​org/​10.​1007/​s10488-015-0645-xCrossRefPubMed
go back to reference Meyer, A. E., Reilly, E. E., Daniel, K. E., Hollon, S. D., Jensen-Doss, A., Mennin, D. S., Muroff, J., Schuler, T. A., White, B. A., & Teachman, B. A. (2019). Characterizing evidence-based practice and training resource barriers: A needs assessment. Training and Education in Professional Psychology. https://doi.org/10.1037/tep0000261CrossRef Meyer, A. E., Reilly, E. E., Daniel, K. E., Hollon, S. D., Jensen-Doss, A., Mennin, D. S., Muroff, J., Schuler, T. A., White, B. A., & Teachman, B. A. (2019). Characterizing evidence-based practice and training resource barriers: A needs assessment. Training and Education in Professional Psychology. https://​doi.​org/​10.​1037/​tep0000261CrossRef
go back to reference Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-yCrossRefPubMed Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544. https://​doi.​org/​10.​1007/​s10488-013-0528-yCrossRefPubMed
go back to reference Schumacher, J., Arment, C., & Meyers, E. (2014). Community Input Report. Schumacher, J., Arment, C., & Meyers, E. (2014). Community Input Report.
go back to reference Skriner, L. C., Benjamin Wolk, C., Stewart, R. E., Adams, D. R., Rubin, R. M., Evans, A. C., & Beidas, R. S. (2018). Therapist and organizational factors associated with participation in evidence-based practice initiatives in a large urban publicly-funded mental health system HHS Public Access. The Journal of Behavioral Health Services & Research, 45(2), 174–186. https://doi.org/10.1007/s11414-017-9552-0CrossRef Skriner, L. C., Benjamin Wolk, C., Stewart, R. E., Adams, D. R., Rubin, R. M., Evans, A. C., & Beidas, R. S. (2018). Therapist and organizational factors associated with participation in evidence-based practice initiatives in a large urban publicly-funded mental health system HHS Public Access. The Journal of Behavioral Health Services & Research, 45(2), 174–186. https://​doi.​org/​10.​1007/​s11414-017-9552-0CrossRef
go back to reference Triplett, N. S., Woodard, G. S., AlRasheed, R., Meza, R. D., Robinson, S., Berliner, L., & Dorsey, S. (2021). Application of evidence-based treatment in community mental health settings: Examining EBT delivery duration and client discharge. The Journal of Behavioral Health Services & Research, 48, 617–624. https://doi.org/10.1007/s11414-021-09755-3CrossRef Triplett, N. S., Woodard, G. S., AlRasheed, R., Meza, R. D., Robinson, S., Berliner, L., & Dorsey, S. (2021). Application of evidence-based treatment in community mental health settings: Examining EBT delivery duration and client discharge. The Journal of Behavioral Health Services & Research, 48, 617–624. https://​doi.​org/​10.​1007/​s11414-021-09755-3CrossRef
go back to reference Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., Ugueto, A. M., Langer, D. A., & Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. https://doi.org/10.1037/a0023307CrossRefPubMed Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., Ugueto, A. M., Langer, D. A., & Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. https://​doi.​org/​10.​1037/​a0023307CrossRefPubMed
go back to reference Wiltsey Stirman, S., Gutiérrez-Colina, A., Toder, K., Esposito, G., Barg, F., Castro, F., Beck, A. T., & Crits-Christoph, P. (2013). Clinicians’ perspectives on cognitive therapy in community mental health settings: Implications for training and implementation NIH public access. Administration and Policy in Mental Health, 40(4), 274–285. https://doi.org/10.1007/s10488-012-0418-8CrossRef Wiltsey Stirman, S., Gutiérrez-Colina, A., Toder, K., Esposito, G., Barg, F., Castro, F., Beck, A. T., & Crits-Christoph, P. (2013). Clinicians’ perspectives on cognitive therapy in community mental health settings: Implications for training and implementation NIH public access. Administration and Policy in Mental Health, 40(4), 274–285. https://​doi.​org/​10.​1007/​s10488-012-0418-8CrossRef
Metadata
Title
Mental Health Provider Reach and Engagement in a Countywide Training Initiative
Authors
Brigid R. Marriott
Jack H. Andrews
Evelyn Cho
Siena K. Tugendrajch
Kristin M. Hawley
Publication date
13-02-2024
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 4/2024
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-024-01345-7