Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-09-2008 | Original Paper

Therapist Adherence and Organizational Effects on Change in Youth Behavior Problems One Year After Multisystemic Therapy

Authors: Sonja K. Schoenwald, Rickey E. Carter, Jason E. Chapman, Ashli J. Sheidow

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 5/2008

Abstract

The current study investigated the relations among therapist adherence to an evidence-based treatment for youth with serious antisocial behavior (i.e., Multisystemic Therapy), organizational climate and structure, and improvement in youth behavior problems one-year post treatment. Participants were 1979 youth and families treated by 429 therapists across 45 provider organizations in North America. Hierarchical Linear Modeling (HLM) results showed therapist adherence predicted improvement in youth behavior. Two structure variables and one climate variable predicted changes in youth behavior, and the climate variable also predicted therapist adherence. No statistical support for formal mediation of organizational effects through adherence was found, though examination of changes in parameter estimates suggest a possible interplay of organizational climate with adherence and youth behavior change.

Refer to Table 2 for estimated equations.

Aarons, G. A., & Sawitsky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33, 289–301. doi:10.1007/s10488-006-0039-1.PubMedCrossRef

Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4–18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

Backer, T. E., David, S. L., & Soucy, G. (Eds.). (1995). Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph 155, NIH Publication No. 95-4035). Rockville, MD: National Institute on Drug Abuse.

Barber, J. P., Crits-Christoph, P., & Luborksy, L. (1996). Effects of therapist adherence and competence on patient outcome in brief dynamic therapy. Journal of Consulting and Clinical Psychology, 64, 619–622. doi:10.1037/0022-006X.64.3.619.PubMedCrossRef

Barber, J. P., Gallop, R., Crits-Christoph, P., Frank, A., Thase, M. E., Weiss, R. D., & Gibbons, M. B. C. (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the National Institute Drug Abuse Collaborative Cocaine Treatment Study. Psychotherapy Research, 16, 229–240. doi:10.1080/10503300500288951

Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173.PubMedCrossRef

Bronfenbrenner, U. (1979). The ecology of human development. Cambridge, MA: Harvard University Press.

Brown, B. S. (1995). Reducing impediments to technology transfer in drug abuse programming. In T. E. Backer, S. L. David, & G. Soucy (Eds.), Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph 155, NIH Publication No 95-4035) (pp. 169–185). Rockville, MD: National Institute on Drug Abuse.

Brown, B. S. (2000). From research to practice: The bridge is out and the water’s rising. Advances in Medical Sociology, 7, 345–365. doi:10.1016/S1057-6290(00)80017-0.CrossRef

Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. The Journal of Applied Psychology, 83, 234–246. doi:10.1037/0021-9010.83.2.234.CrossRef

Chen, H. T. (1990). Theory-driven evaluations. Newbury Park: Sage.

Damanpour, F. (1996). Organizational complexity and innovation: Developing and testing multiple contingency models. Management Science, 42, 693–716.

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi:10.1016/S0272-7358(97)00043-3.PubMedCrossRef

Drotar, D., Stein, R. E. K., & Perrin, E. C. (1995). Methodological issues in using the Child Behavior Checklist and its related instruments in clinical child psychology research. Journal of Clinical Child Psychology, 24, 184–192. doi:10.1207/s15374424jccp2402_6.CrossRef

Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis De la Parte Florida Mental Health Institute, The National Implementation Research Network.

Glisson, C. (1992). Structure and technology in human services organizations. In Y. Hasenfeld (Ed.), Human services as complex organizations (pp. 184–202). Beverly Hills: Sage.

Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253. doi:10.1023/A:1020972906177.PubMedCrossRef

Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448. doi:10.1007/s10488-005-0016-0.PubMedCrossRef

Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421. doi:10.1016/S0145-2134(98)00005-2.CrossRef

Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23, 767–794. doi:10.1002/job.162.CrossRef

Glisson, C. A., & Martin, P. Y. (1980). Productivity and efficiency in human service organizations as related to structure, size, and age. Academy of Management Journal, 21–37. doi:10.2307/255494

Glisson, C., & Schoenwald, S. K. (2005). An organizational and community development strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7, 1–17. doi:10.1007/s11020-005-7456-1.CrossRef

Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 73–92.

Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69, 32–40. doi:10.1086/223508.CrossRef

Henggeler, S. W., & Borduin, C. M. (1992). Multisystemic Therapy Adherence Scales. Unpublished instrument. Charleston, SC: Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina.

Henggeler, S. W., Borduin, C. M., Schoenwald, S. K., Huey, S. J., & Chapman, J. E. (2006). Multisystemic Therapy Adherence Scale – Revised (TAM-R). Unpublished instrument. Charleston, SC: Department of Psychiatry & Behavioral Sciences, Medical University of South Carolina.

Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821–833. doi:10.1037/0022-006X.65.5.821.PubMedCrossRef

Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171–184. doi:10.1023/A:1022373813261.PubMedCrossRef

Henggeler, S. W., & Schoenwald, S. K. (1998). The MST supervisory manual: Promoting quality assurance at the clinical level. Charleston, SC: The MST Institute.

Henggeler, S. W., & Schoenwald, S. K. (1999). The role of quality assurance in achieving outcomes in MST programs. Journal of Juvenile Justice and Detention Services, 15, 1–18.

Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998). Multisystemic treatment of antisocial behavior in children and adolescents. New York and London: Guilford Press.

Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child and Adolescent Psychology, 31, 155–167.PubMed

Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451–467. doi:10.1037/0022-006X.68.3.451.PubMedCrossRef

James, L. R., Demaree, R. G., & Wolf, G. (1993). r_WG: An assessment of within-group interrater agreement. The Journal of Applied Psychology, 75, 306–309. doi:10.1037/0021-9010.78.2.306.CrossRef

James, L. R., & Sells, S. B. (1981). Psychological climate: Theoretical perspectives and empirical research. In D. Magnussen (Ed.), The situation: An interactional perspective (pp. 275–295). Hillsdale, NJ: Lawrence Erlbaum.

Klein, K. J., & Kozlowski, S. W. J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3, 211–236. doi:10.1177/109442810033001.CrossRef

Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080. doi:10.2307/259164.CrossRef

Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1–21. doi:10.1207/s15327906mbr3001_1.CrossRef

LeBreton, J. M., James, L. R., & Lindell, M. K. (2005). Recent issues regarding r_WG, r*_WG, r_WG(J), and r* _WG(J). Organizational Research Methods, 8, 128–138. doi:10.1177/1094428104272181.CrossRef

Mihalic, S. F., & Irwin, K. (2003). Blueprints for violence prevention: From research to real-world settings–factors influencing the successful replication of model programs. Youth Violence and Juvenile Justice, 1, 307–329. doi:10.1177/1541204003255841.CrossRef

Morris, A., & Bloom, J. R. (2002). Contextual factors affecting job satisfaction and organizational commitment in community mental health centers undergoing system changes in the financing of care. Mental Health Services Research, 4, 71–83. doi:10.1023/A:1015248116246.PubMedCrossRef

Morris, A., Bloom, J. R., & Kang, S. (2007). Organizational and individual factors affecting consumer outcomes of care in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 34, 243–253. doi:10.1007/s10488-006-0104-9.PubMedCrossRef

National Institute of Mental Health. (2006). The road ahead: Research partnerships to transform services. A report by the National Advisory Mental Health Council’s Workgroup on Services and Clinical Epidemiology Research. Rockville, MD: National Institutes of Health. Department of Health and Human Services.

National Institute on Drug Abuse. (2004). Report of the Blue Ribbon Task Force on Health Services Research, National Institute of Drug Abuse. Rockville, MD: National Institutes of Health, U.S. Department of Health and Human Services.

Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage Publications.

Real, K., & Poole, M. S. (2005). Innovation implementation: Conceptualization and measurement in organizational research. Research in Organizational Change and Development, 15, 63–134. doi:10.1016/S0897-3016(04)15003-9.CrossRef

Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: The Free Press.

Schoenwald, S. K. (1998). Multisystemic therapy consultation manual. Charleston, SC: The MST Institute.

Schoenwald, S. K. (2008). Toward evidence-based implementation of evidence-based treatments: MST as an example. Journal of Child & Adolescent Substance Abuse, 17, 69–91.CrossRef

Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., Rolls Reutz, J., The Research Network on Youth Mental Health. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of Empirically Supported Treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35, 35–97.

Schoenwald, S. K., Chapman, J. E., & Sheidow, A. J. (2006, March). Implementation fidelity in MST. In S. K. Schoenwald & J. Reid, Co-Chairs, Community based model programs panel: Implementing with fidelity. Blueprints Conference, 2006: Evidence-based programs, research-to-practice conference, Denver, CO.

Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103. doi:10.1111/j.1545-5300.2000.39109.x.PubMedCrossRef

Schoenwald, S. K., & Hoagwood, K. (2001a). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services (Washington, D.C.), 52, 1179–1189. doi:10.1176/appi.ps.52.9.1190

Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. A. (2005). Predicting adherence to a transported family-based treatment for youth. Journal of Clinical Child and Adolescent Psychology, 34, 658–670. doi:10.1207/s15374424jccp3404_8.PubMedCrossRef

Schoenwald, S. K., Sheidow, A. S., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Child and Adolescent Clinical Psychology, 33, 94–104. doi:10.1207/S15374424JCCP3301_10.CrossRef

Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003). Transportability of multisystemic therapy: Evidence for multi-level influences. Mental Health Services Research, 5, 223–239. doi:10.1023/A:1026229102151.PubMedCrossRef

Southam-Gerow, M. A., Austin, A. A., & Hershberger, A. M. (2008). Transportability and dissemination of psychological treatments: Research models and methods. In D. McKay (Ed.), Handbook of research methods in abnormal and clinical psychology (pp. 203–224). Newbury Park, CA: Sage.

Weisz, J. R., Donenberg, G. R., Han, S. S., & Kauneckis, D. (1995a). Child and adolescent psychotherapy outcomes in experiments versus clinics: Why the disparity? Journal of Abnormal Child Psychology, 23, 83–106. doi:10.1007/BF01447046.PubMedCrossRef

Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995b). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688–701. doi:10.1037/0022-006X.63.5.688.PubMedCrossRef

Title: Therapist Adherence and Organizational Effects on Change in Youth Behavior Problems One Year After Multisystemic Therapy
Authors: Sonja K. Schoenwald
Rickey E. Carter
Jason E. Chapman
Ashli J. Sheidow
Publication date: 01-09-2008
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 5/2008
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-008-0181-z

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Therapist Adherence and Organizational Effects on Change in Youth Behavior Problems One Year After Multisystemic Therapy

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2008

Improving Integrated General Medical and Mental Health Services in Community-based Practices

Enhancing Schools’ Capacity to Support Children in Poverty: An Ecological Model of School-Based Mental Health Services

Juvenile Probation Officers’ Mental Health Decision Making

Results of an Innovative University-based Recovery Education Program for Adults with Psychiatric Disabilities

Travel Distance and the Use of Inpatient Care among Patients with Schizophrenia

The Psychometric Properties of the Colorado Symptom Index