Top

BMC Psychiatry

Published in:

Open Access 01-12-2019 | Research article

Characterizing the heterogeneity of clinician practice use in community mental health using latent profile analysis

Authors: Emily M. Becker-Haimes, Viktor Lushin, Torrey A. Creed, Rinad S. Beidas

Published in: BMC Psychiatry | Issue 1/2019

Abstract

Background

The behavioral health service provider population is highly heterogeneous. However, it is rarely treated as such within evidence-based practice implementation efforts. This study aimed to evaluate, as a proof of concept, the utility of latent profile analysis to identify distinct profiles of clinician practices in a large sample of youth-serving community mental health clinicians. This study also aimed to identify predictors of profile membership to inform implementation efforts.

Methods

Participants were 484 practicing clinicians (79.4% female, 45.7% White, M age = 37.1 years). As part of a larger survey, clinicians reported on their use of cognitive, behavioral, family, and psychodynamic treatment techniques with a representative client on their caseload. Latent profile analysis was used to determine the presence of clinician practice profiles. Multilevel multinomial logistic regressions examined predictors of profile membership.

Results

Latent profile analysis indicated a 4-profile solution best fit the data, with clinicians who: 1) used generally low levels of all examined techniques and preferred cognitive techniques (Low Eclectics, 16%), 2) delivered moderate levels of all techniques (Moderate Eclectics, 53%), 3) demonstrated preference for use of family techniques (Family Preferred, 11%), and 4) used high levels of all techniques (Super Users, 20%). Clinician discipline (e.g., social work), education, and years of experience predicted profile membership.

Conclusions

Findings from this proof of concept study underscore the utility of latent profile analysis to characterize the complex and heterogeneous makeup of community mental health. Results extend prior work highlighting the eclectic nature of community mental health practice. Predictor analyses underscore the important influence of clinician background characteristics on practice use.

McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments: a review of current efforts. Am Psychol. 2010;65(2):73. https://doi.org/10.1037/a0018121.CrossRefPubMed

Kazdin AE. Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther. 2017;88:7–18. https://doi.org/10.1016/j.brat.2016.06.004.CrossRefPubMed

Stirman SW, Buchhofer R, McLaulin JB, Evans AC, Beck AT. Public-academic partnerships: the Beck initiative: a partnership to implement cognitive therapy in a community behavioral health system. Psychiatr Serv. 2009;60(10):1302–4. https://doi.org/10.1176/ps.2009.60.10.1302.CrossRefPubMedPubMedCentral

Beidas RS, Maclean JC, Fishman J, Dorsey S, Schoenwald SK, Mandell DS, et al. A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol. BMC Psychiatry. 2016;16(1):323. https://doi.org/10.1186/s12888-016-1034-z.CrossRefPubMedPubMedCentral

Garland AF, Hurlburt MS, Brookman-Frazee L, Taylor RM, Accurso EC. Methodological challenges of characterizing usual care psychotherapeutic practice. Adm Policy Ment Hlth. 2010;37(3):208–20. https://doi.org/10.1007/s10488-009-0237-8.CrossRef

Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Hlth. 2011;38(1):32–43. https://doi.org/10.1007/s10488-010-0321-0.CrossRef

Garland AF, Brookman-Frazee L, Hurlburt MS, Accurso EC, Zoffness RJ, Haine-Schlagel R, et al. Mental health care for children with disruptive behavior problems: a view inside therapists’ offices. Psychiatr Serv. 2010;61(8):788–95. https://doi.org/10.1176/ps.2010.61.8.788.CrossRefPubMedPubMedCentral

Warren JS, Nelson PL, Mondragon SA, Baldwin SA, Burlingame GM. Youth psychotherapy change trajectories and outcomes in usual care: community mental health versus managed care settings. J Consult Clin Psych. 2010;78(2):144. https://doi.org/10.1037/a0018544.CrossRef

Smith AM, Jensen-Doss A. Youth psychotherapy outcomes in usual care and predictors of outcome group membership. Psychol Serv. 2017;14(1):66. https://doi.org/10.1037/ser0000115.CrossRefPubMed

10.

Beidas R, Skriner L, Adams D, Wolk CB, Stewart RE, Becker-Haimes E, et al. The relationship between consumer, clinician, and organizational characteristics and use of evidence-based and non-evidence-based therapy strategies in a public mental health system. Behav Res Ther. 2017;99:1–10. https://doi.org/10.1016/j.brat.2017.08.011.CrossRefPubMedPubMedCentral

11.

Becker-Haimes E, Okamura K, Baldwin C, Wahesh E, Schmidt C, Beidas R. Understanding the landscape of behavioral health pre-service training to inform evidence-based intervention implementation. Psychiatr Serv in press. doi: https://doi.org/10.1176/appi.ps.201800220.CrossRef

12.

Weissman MM, Verdeli H, Gameroff MJ, Bledsoe SE, Betts K, Mufson L, et al. National survey of psychotherapy training in psychiatry, psychology, and social work. Arch Gen Psychiat. 2006;63(8):925–34. https://doi.org/10.1001/archpsyc.63.8.925.CrossRefPubMed

13.

Boat T, Land M, Leslie L, Hoagwood K, Hawkins-Walsh E, McCabe M, et al. Workforce development to enhance the cognitive, affective, and behavioral health of children and youth: opportunities and barriers in child health care training. National Academy of Medicine. 2017;7. https://nam.edu/workforce-development-to-enhance-the-cognitive-affective-and-behavioral-health-of-children-and-youth-opportunities-and-barriers-in-child-health-care-training/.

14.

Muthén B, Muthén LK. Integrating person-centered and variable-centered analyses: growth mixture modeling with latent trajectory classes. Alcohol Clin Exp Res. 2000;24(6):882–91. https://doi.org/10.1111/j.1530-0277.2000.tb02070.x.CrossRefPubMed

15.

Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94. https://doi.org/10.1007/s11414-015-9475-6.CrossRefPubMedPubMedCentral

16.

Cook JR, Hausman EM, Jensen-Doss A, Hawley KM. Assessment practices of child clinicians: results from a national survey. Assessment. 2017;24(2):210–21. https://doi.org/10.1177/1073191115604353.CrossRefPubMed

17.

Beidas RS, Adams DR, Kratz HE, Jackson K, Berkowitz S, Zinny A, et al. Lessons learned while building a trauma-informed public behavioral health system in the City of Philadelphia. Eval Program Plann. 2016;59:21–32. https://doi.org/10.1016/j.evalprogplan.2016.07.004.CrossRefPubMedPubMedCentral

18.

Creed TA, Frankel SA, German RE, Green KL, Jager-Hyman S, Taylor KP, et al. Implementation of transdiagnostic cognitive therapy in community behavioral health: the Beck Community initiative. J Consult Clin Psych. 2016;84(12):1116. https://doi.org/10.1037/ccp0000105.CrossRef

19.

Lanza ST, Cooper BR. Latent class analysis for developmental research. Child Dev Perspect. 2016;10(1):59–64. https://doi.org/10.1111/cdep.12163.CrossRef

20.

Beidas RS, Aarons G, Barg F, Evans A, Hadley T, Hoagwood K, et al. Policy to implementation: evidence-based practice in community mental health–study protocol. Implement Sci. 2013;8(1):38. https://doi.org/10.1186/1748-5908-8-38.CrossRefPubMedPubMedCentral

21.

Powell BJ, Beidas RS, Rubin RM, Stewart RE, Wolk CB, Matlin SL, et al. Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Adm Policy Ment Hlth. 2016;43(6):909–26. https://doi.org/10.1007/s10488-016-0733-6.CrossRef

22.

Becker-Haimes EM, Okamura KH, Wolk CB, Rubin R, Evans AC, Beidas RS. Predictors of clinician use of exposure therapy in community mental health settings. J Anxiety Disord. 2017;49:88–94. https://doi.org/10.1016/j.janxdis.2017.04.002.CrossRefPubMedPubMedCentral

23.

Weersing VR, Weisz JR, Donenberg GR. Development of the therapy procedures checklist: a therapist-report measure of technique use in child and adolescent treatment. J Clin Child Adolesc. 2002;31(2):168–80. https://doi.org/10.1207/S15374424JCCP3102_03.CrossRef

24.

Kolko DJ, Cohen JA, Mannarino AP, Baumann BL, Knudsen K. Community treatment of child sexual abuse: a survey of practitioners in the National Child Traumatic Stress Network. Adm Policy Ment Hlth. 2009;36(1):37–49. https://doi.org/10.1007/s10488-008-0180-0.CrossRef

25.

McLeod BD, Southam-Gerow MA, Weisz JR. Conceptual and methodological issues in treatment integrity measurement. School Psychol Rev. 2009;38(4):541.

26.

Do M-CW, E; Weersing, V. R.;. Examination of the psychometric properties of the Therapy Procedures Checklist– Family Revised. Association for Behavioral and Cognitive Therapies; National Harbor, 2012.

27.

Asparouhov T, Muthén B. Auxiliary variables in mixture modeling: using the BCH method in Mplus to estimate a distal outcome model and an arbitrary secondary model. Mplus Web Notes. 2014;21(2):1–22.

28.

Henry KL, Muthén B. Multilevel latent class analysis: an application of adolescent smoking typologies with individual and contextual predictors. Structural Equ Modeling. 2010;17(2):193–215.CrossRef

29.

Mäkikangas A, Tolvanen A, Aunola K, Feldt T, Mauno S, Kinnunen U. Multilevel latent profile analysis with covariates: identifying job characteristics profiles in hierarchical data as an example. Organ Res Methods. 2018:1–24. https://doi.org/10.1177/1094428118760690.CrossRef

30.

Nylund KL, Asparouhov T, Muthén BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equ Model. 2007;14(4):535–69. https://doi.org/10.1080/10705510701575396.CrossRef

31.

Benjamin Wolk C, Marcus SC, Weersing VR, Hawley KM, Evans AC, Hurford MO, et al. Therapist-and client-level predictors of use of therapy techniques during implementation in a large public mental health system. Psychiatr Serv. 2016;67(5):551–7. https://doi.org/10.1176/appi.ps.201500022.CrossRefPubMed

32.

Gitterman A, Knight C. Evidence-guided practice: integrating the science and art of social work. Fam Soc. 2013;94(2):70–8. https://doi.org/10.1606/1044-3894.4282.CrossRef

33.

Nissen SE. Reforming the continuing medical education system. JAMA. 2015;313(18):1813–4. https://doi.org/10.1001/jama.2015.4138.CrossRefPubMed

34.

Skriner LC, Wolk CB, Stewart RE, Adams DR, Rubin RM, Evans AC, et al. Therapist and organizational factors associated with participation in evidence-based practice initiatives in a large urban publicly-funded mental health system. J Behav Health Serv Res. 2018:1–13. https://doi.org/10.1007/s11414-017-9552-0.

35.

Izmirian SC, Nakamura BJ. Knowledge, attitudes, social desirability, and organizational characteristics in youth mental health services. J Behav Health Serv Res. 2016;43(4):630–47. https://doi.org/10.1007/s11414-015-9491-6.CrossRefPubMed

36.

Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. J Am Acad Child Psy. 2013;52(10):1009–25. e18. https://doi.org/10.1016/j.jaac.2013.07.012.CrossRef

37.

Bertram RM, Charnin LA, Kerns SE, Long AC. Evidence-based practices in north American MSW curricula. Res Social Work Prac. 2015;25(6):737–48. https://doi.org/10.1177/1049731514532846.CrossRef

38.

Chan M-pS, Jones CR, Hall Jamieson K, Albarracín D. Debunking: a meta-analysis of the psychological efficacy of messages countering misinformation. Psychol Sci. 2017;28(11):1531–46. https://doi.org/10.1177/0956797617714579.CrossRefPubMedPubMedCentral

39.

McLeod BD, Southam-Gerow MA, Tully CB, Rodriguez A, Smith MM. Making a case for treatment integrity as a psychosocial treatment quality indicator for youth mental health care. Clin Psychol Sci Pr. 2013;20(1):14–32.CrossRef

40.

Chorpita BF, Bernstein A, Daleiden EL. Empirically guided coordination of multiple evidence-based treatments: an illustration of relevance mapping in children's mental health services. J Consult Clin Psych. 2011;79(4):470. https://doi.org/10.1037/a0023982.CrossRef

41.

Southam-Gerow MA, Chorpita BF, Miller LM, Gleacher AA. Are children with anxiety disorders privately referred to a university clinic like those referred from the public mental health system? Adm Policy Ment Hlth. 2008;35(3):168–80. https://doi.org/10.1007/s10488-007-0154-7.CrossRef

42.

Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatr. 2015;169(4):374–82. https://doi.org/10.1001/jamapediatrics.2014.3736.CrossRefPubMedPubMedCentral

43.

Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Hlth. 2016;43(5):783–98. https://doi.org/10.1007/s10488-015-0693.CrossRef

44.

Schneider B, Goldstiein HW, Smith DB. The ASA framework: an update. Pers Psychol. 1995;48(4):747–73. https://doi.org/10.1111/j.1744-6570.1995.tb01780.x.CrossRef

45.

Hogue A, Dauber S, Lichvar E, Bobek M, Henderson CE. Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: correspondence between therapists and observers. Adm Policy Ment Hlth. 2015;42(2):229–43. https://doi.org/10.1007/s10488-014-0548-2.CrossRef

46.

Ng MY, Weisz JR. Annual research review: building a science of personalized intervention for youth mental health. J Child Psychol Psyc. 2016;57(3):216–36. https://doi.org/10.1111/jcpp.12470.CrossRef

47.

Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral

Title: Characterizing the heterogeneity of clinician practice use in community mental health using latent profile analysis
Authors: Emily M. Becker-Haimes
Viktor Lushin
Torrey A. Creed
Rinad S. Beidas
Publication date: 01-12-2019
Publisher: BioMed Central
Published in: BMC Psychiatry / Issue 1/2019
Electronic ISSN: 1471-244X
DOI: https://doi.org/10.1186/s12888-019-2234-0

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Characterizing the heterogeneity of clinician practice use in community mental health using latent profile analysis

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2019

Personal values in adolescence and suicidality: a cross-sectional study based on a retrospective recall

A randomized controlled trial of cognitive remediation for a national cohort of forensic patients with schizophrenia or schizoaffective disorder

Peer support for frequent users of inpatient mental health care in Uganda: protocol of a quasi-experimental study

Exploring mental health professionals’ practice in relation to smoke-free policy within a mental health trust: a qualitative study using the COM-B model of behaviour

Associations between childhood maltreatment and adult depression: a mediation analysis

Orthorexia nervosa, eating patterns and personality traits: a cross-cultural comparison of Italian, Polish and Spanish university students