Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-03-2022 | Care | Original Article

Improving the Quality of Children’s Mental Health Care with Progress Measures: A Mixed-Methods Study of PCIT Therapist Attitudes

Authors: Corinna C. Klein, B. Erika Luis Sanchez, Miya L. Barnett

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 2/2022

Abstract

Progress measures are an evidence-based technique for improving the quality of mental health care, however, clinicians rarely incorporate them into treatment. Research into how measure type impacts clinician preference has been recommended to help improve measure implementation. Parent–Child Interaction Therapy (PCIT) is an assessment-driven treatment that serves as an ideal intervention through which to investigate measure preferences given its routine use of two types of assessments, a behavioral observation (the Dyadic Parent–Child Interaction Coding System) and a parent-report measure (the Eyberg Child Behavior Inventory). This study investigated PCIT therapist attitudes towards progress measures used within PCIT and children’s mental health treatment generally. A mixed-method (QUAN + QUAL) study design examined PCIT therapist attitudes towards two types of progress measures and measures used in two contexts (PCIT and general practice). Multi-level modeling of a survey distributed to 324 PCIT therapists identified predictors of therapist attitudes towards measures, while qualitative interviews with 23 therapists expanded and clarified the rationale for differing perceptions. PCIT therapists reported more positive attitudes towards a behavioral observation measure, the DPICS, than a parent-report measure, the ECBI, and towards measures used in PCIT than in general practice. Clinician race/ethnicity was significantly related to measure-specific attitudes. Qualitative interviews highlighted how perceptions of measure reliability, type of data offered, ease of use, utility in guiding sessions and motivating clients, and embeddedness in treatment protocol impact therapist preferences. Efforts to implement progress monitoring should consider preferences for particular types of measures, as well as how therapists are trained to embed measures in treatment.

Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based Practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74. https://doi.org/10.1023/B:MHSR.0000024351.12294.65CrossRefPubMedPubMedCentral

Aarons, G. A. (2005). Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America, 14(2), 255–271. https://doi.org/10.1016/j.chc.2004.04.008CrossRefPubMedPubMedCentral

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. C. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7CrossRefPubMed

American Psychological Association (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271CrossRef

Bahl, A., Spaulding, S., & McNeil, C. (1999). Treatment of noncompliance using Parent Child Interaction Therapy: A data-driven approach. Education and Treatment of Children, 22, 146–156.

Barnett, M., Brookman-Frazee, L., Regan, J., Saifan, D., Stadnick, N., & Lau, A. (2017). How intervention and implementation characteristics relate to community therapists’ attitudes toward evidence-based practices: A mixed methods study. Administration and Policy in Mental Health and Mental Health Services Research, 44(6), 824–837. https://doi.org/10.1007/s10488-017-0795-0CrossRefPubMed

Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., Hurford, M. O., Hadley, T., Barg, F. K., Walsh, L. M., Adams, D. R., & Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382. https://doi.org/10.1001/jamapediatrics.2014.3736CrossRefPubMedPubMedCentral

Beveridge, R. M., Fowles, T. R., Masse, J. J., McGoron, L., Smith, M. A., Parrish, B. P., Circo, G., & Widdoes, N. (2015). State-wide dissemination and implementation of parent–child interaction therapy (PCIT): Application of theory. Children and Youth Services Review, 48, 38–48.CrossRef

Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429. https://doi.org/10.1176/appi.ps.002052011CrossRefPubMed

Bickman, L., Lyon, A. R., & Wolpert, M. (2016). Achieving precision mental health through effective assessment, monitoring, and feedback processes. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 271–276. https://doi.org/10.1007/s10488-016-0718-5CrossRefPubMed

Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31(1), 70–74. https://doi.org/10.1037/0735-7028.31.1.70CrossRef

Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. https://doi.org/10.1080/10503307.2013.817696CrossRefPubMed

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oaCrossRef

Brookman-Frazee, L., Drahota, A., & Stadnick, N. (2012). Training community mental health therapists to deliver a package of evidence-based practice strategies for school-age children with autism spectrum disorders: A pilot study. Journal of Autism and Developmental Disorders, 42(8), 1651–1661.CrossRef

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. https://doi.org/10.1186/1748-5908-4-50CrossRefPubMedPubMedCentral

Edbrooke-Childs, J., Barry, D., Rodriguez, I. M., Papageorgiou, D., Wolpert, M., & Schulz, J. (2017). Patient reported outcome measures in child and adolescent mental health services: Associations between clinician demographic characteristics, attitudes and efficacy. Child and Adolescent Mental Health, 22(1), 36–41. https://doi.org/10.1111/camh.12189CrossRefPubMed

Ehrenreich-May, J., Southam-Gerow, M. A., Hourigan, S. E., Wright, L. R., Pincus, D. B., & Weisz, J. R. (2011). Characteristics of anxious and depressed youth seen in two different clinical contexts. Administration and Policy in Mental Health and Mental Health Services Research, 38(5), 398–411. https://doi.org/10.1007/s10488-010-0328-6CrossRefPubMed

Eyberg, S. M., Boggs, S., & Jaccard, J. (2014). Does maintenance treatment matter? Journal of Abnormal Child Psychology, 42, 355–366. https://doi.org/10.1007/s10802-013-9842-9CrossRefPubMed

Eyberg, S. M., Nelson, M. M., Ginn, N. C., Bhuiyan, N. & Boggs, S. R. (2013). Dyadic Parent-Child Interaction Coding System-Fourth Edition. PCIT International, Inc

Eyberg, S. M., & Pincus, D. (1999). Eyberg Child Behavior Inventory and Sutter-Eyberg Student Behavior Inventory-revised professional manual. Psychological Assessment Resources

Eyberg, S. M. & Funderburk, B. (2011). Parent-child interaction therapy: Treatment manual. PCIT International

Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? The Journal of Behavioral Health Services & Research, 30(4), 393–405. https://doi.org/10.1007/BF02287427CrossRef

Goodyear, R. K., Wampold, B. E., Tracey, T. J. G., & Lichtenberg, J. W. (2017). Psychotherapy expertise should mean superior outcomes and demonstrable improvement over time. The Counseling Psychologist, 45(1), 54–65. https://doi.org/10.1177/0011000016652691CrossRef

Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2009). Do we know when our clients get worse? an investigation of therapists’ ability to detect negative client change. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.656CrossRef

Hennink, M. M., Kaiser, B. N., & Marconi, V. C. (2017). Code saturation versus meaning saturation: How many interviews are enough? Qualitative Health Research, 27(4), 591–608. https://doi.org/10.1177/1049732316665344CrossRefPubMed

Jakobsen, J. C., Gluud, C., Wetterslev, J., & Winkel, P. (2017). When and how should multiple imputation be used for handling missing data in randomised clinical trials–a practical guide with flowcharts. BMC Medical Research Methodology, 17(1), 1–10.CrossRef

Jensen-Doss, A., Douglas, S., Phillips, D. A., Gencdur, O., Zalman, A., & Gomez, N. E. (2020). Measurement-based care as a practice improvement tool: Clinical and organizational applications in youth mental health. Evidence-Based Practice in Child and Adolescent Mental Health, 5(3), 233–250. https://doi.org/10.1080/23794925.2020.1784062CrossRefPubMedPubMedCentral

Jensen-Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C. F., & Hawley, K. M. (2018a). Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 48–61. https://doi.org/10.1007/s10488-016-0763-0CrossRefPubMed

Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896. https://doi.org/10.1080/15374416.2010.517169CrossRef

Jensen-Doss, A., Smith, A. M., Becker-Haimes, E. M., Mora Ringle, V., Walsh, L. M., Nanda, M., Walsh, S. L., Maxwell, C. A., & Lyon, A. R. (2018b). Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. Administration and Policy in Mental Health and Mental Health Services Research, 45(3), 392–403. https://doi.org/10.1007/s10488-017-0833-yCrossRefPubMed

Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79. https://doi.org/10.1037/a0022238CrossRefPubMed

Lieneman, C. C., Brabson, L. A., Highlander, A., Wallace, N. M., & McNeil, C. B. (2017). Parent-Child Interaction Therapy: Current perspectives. Psychology Research and Behavior Managemen, 10, 239–256.CrossRef

Little, R. J. (1988). A test of missing completely at random for multi-variate data with missing values. Journal of the American Statistical Association, 83, 1198–1202.CrossRef

Liu, F. F., Cruz, R. A., Rockhill, C. M., & Lyon, A. R. (2019). Mind the gap: Considering disparities in implementing measurement-based care. Journal of the American Academy of Child and Adolescent Psychiatry, 58(4), 459–461.CrossRef

Lyon, A. R., Stanick, C., & Pullmann, M. D. (2018). Toward high-fidelity treatment as usual: Evidence-based intervention structures to improve usual care psychotherapy. Clinical Psychology: Science and Practice, 25(4), e12265. https://doi.org/10.1111/cpsp.12265CrossRef

Merikangas, K. R., He, J., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the national comorbidity survey replication–Adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 980–989. https://doi.org/10.1016/j.jaac.2010.05.017CrossRef

Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges. Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 398–409. https://doi.org/10.1007/s10488-006-0044-4CrossRefPubMed

Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53. https://doi.org/10.1007/s10488-010-0314-zCrossRefPubMed

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-yCrossRefPubMed

Park, A. L., Tsai, K. H., Guan, K., & Chorpita, B. F. (2018). Unintended consequences of evidence-based treatment policy reform: Is implementation the goal or the strategy for higher quality care? Administration and Policy in Mental Health and Mental Health Services Research, 45(4), 649–660. https://doi.org/10.1007/s10488-018-0853-2CrossRefPubMed

Reding, M. E. J., Chorpita, B. F., Lau, A. S., & Innes-Gomberg, D. (2014). Providers’ attitudes toward evidence-based practices: Is it just about providers, or do practices matter, too? Administration and Policy in Mental Health and Mental Health Services Research, 41(6), 767–776. https://doi.org/10.1007/s10488-013-0525-1CrossRefPubMed

Rivenbark, J. G., Odgers, C. L., Caspi, A., Harrington, H., Hogan, S., Houts, R. M., Poulton, R., & Moffitt, T. E. (2018). The high societal costs of childhood conduct problems: Evidence from administrative records up to age 38 in a longitudinal birth cohort. Journal of Child Psychology and Psychiatry, 59(6), 703–710. https://doi.org/10.1111/jcpp.12850CrossRefPubMed

Rodriguez, A., Lau, A. S., Wright, B., Regan, J., & Brookman-Frazee, L. (2018). Mixed-method analysis of program leader perspectives on the sustainment of multiple child evidence-based practices in a system-driven implementation. Implementation Science, 13(1), 1–14. https://doi.org/10.1186/s13012-018-0737-6CrossRef

Rodriguez, A., Terrones, L., Brookman-Frazee, L., Regan, J., Smith, A., & Lau, A. S. (2019). Associations between cultural identity and attitudes toward routine progress monitoring in a sample of ethnically diverse community therapists. Psychological Services, 17(3), 282–290. https://doi.org/10.1037/ser0000327CrossRefPubMedPubMedCentral

Rye, M., Rognmo, K., Aarons, G. A., & Skre, I. (2019). Attitudes towards the use of routine outcome monitoring of psychological therapies among mental health providers: The EBPAS–ROM. Administration and Policy in Mental Health and Mental Health Services Research, 46(6), 833–846. https://doi.org/10.1007/s10488-019-00968-5CrossRefPubMed

Sale, R., Bearman, S. K., Woo, R., & Baker, N. (2020). Introducing a measurement feedback system for youth mental health: Predictors and impact of implementation in a community agency. Administration and Policy in Mental Health and Mental Health Services Research, 48, 327–342. https://doi.org/10.1007/s10488-020-01076-5CrossRef

Smith, A. M., & Jensen-Doss, A. (2017). Youth psychotherapy outcomes in usual care and predictors of outcome group membership. Psychological Services, 14(1), 66–76. https://doi.org/10.1037/ser0000115CrossRefPubMed

Solstad, S. M., Castonguay, L. G., & Moltu, C. (2019). Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature. Psychotherapy Research, 29(2), 157–170. https://doi.org/10.1080/10503307.2017.1326645CrossRefPubMed

Southam-Gerow, M. A., Rodríguez, A., Chorpita, B. F., & Daleiden, E. L. (2012). Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology: Research and Practice, 43(5), 527–534. https://doi.org/10.1037/a0029101CrossRef

Spradley, J. (1979). The ethnographic interview. Holt.

Timmer, S. G., Urquiza, A. J., Boys, D. K., Forte, L. A., Quick-Abdullah, D., Chan, S., & Gould, W. (2016). Filling potholes on the implementation highway: Evaluating the implementation of Parent-Child Interaction Therapy in Los Angeles County. Child Abuse and Neglect, 53, 40–50.CrossRef

Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144–155. https://doi.org/10.1037/a0018544CrossRefPubMed

Title: Improving the Quality of Children’s Mental Health Care with Progress Measures: A Mixed-Methods Study of PCIT Therapist Attitudes
Authors: Corinna C. Klein
B. Erika Luis Sanchez
Miya L. Barnett
Publication date: 01-03-2022
Publisher: Springer US
Keyword: Care
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 2/2022
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-021-01156-0

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Improving the Quality of Children’s Mental Health Care with Progress Measures: A Mixed-Methods Study of PCIT Therapist Attitudes

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2022

A Rapid Ethnographic Assessment of the Impact of the COVID-19 Pandemic on Mental Health Services Delivery in an Acute Care Medical Emergency Department and Trauma Center

A Longitudinal Qualitative Analysis of the Way Peer Support Specialist Roles Change Over Time in a Psychiatric Hospital Setting in Asia

Self-Coding of Fidelity as a Potential Active Ingredient of Consultation to Improve Clinicians’ Fidelity

Moving Towards Racial Equity in the Child and Youth Mental Health Sector in Ontario, Canada

Use of Psychics for Stress and Emotional Problems: A Descriptive Survey Comparison with Conventional Providers and Informal Helpers

Overview of Ten Child Mental Health Clinical Outcome Measures: Testing of Psychometric Properties with Diverse Client Populations in the U.S.