Skip to main content
Top
Published in: Journal of Contemporary Psychotherapy 2/2019

01-06-2019 | Original Paper

Expanding the Conceptualization of Outcome and Clinical Effectiveness

Authors: Michael Helge Rønnestad, Helene A. Nissen-Lie, Hanne Weie Oddli, Kirsten Benum, Vidar Blokhus Ekroll, Siri E. Gullestad, Hanne Haavind, Sissel Reichelt, Marit Råbu, Erik Stänicke, Anna Louise von der Lippe, Margrethe Seeger Halvorsen

Published in: Journal of Contemporary Psychotherapy | Issue 2/2019

Login to get access

Abstract

There is a need for studies that advance our knowledge of therapist effectiveness, expanding the definition of what constitutes therapeutic success. In the present study, four aspects of clinical outcome were analyzed using a sample of highly experienced psychotherapists (mean years of experience as therapy practitioners = 30) who also serve as clinical teachers. The four aspects were: (1) overall change in different outcome domains, including long-term outcome; (2) outcome with clinically distressed clients (i.e. clients above the level of clinical disturbance at pretreatment); (3) level of drop-out; and (4) the degree to which clients re-entered treatment during the follow-up period. Participants were 48 clients treated by 18 therapists. Treatments were open-ended, ‘therapy as usual’, mostly within the setting of independent private practice. Outcome measurements included the OQ-45.2 and IIP-64, with repeated measurements during therapy and extended long-term follow up (up to 3.5 years). Cohen’s d effect sizes and multilevel growth trajectories were estimated for patient change in symptomatic and interpersonal distress. The findings indicate that these therapists obtain very good outcomes overall, particularly with clients above cut-off for clinical disturbance. Moreover, there was a high level of maintenance and increase of treatment gains over time. No clients dropped out. Overall, the findings suggest that a sample of highly experienced therapists obtains particularly good outcomes as defined in more comprehensive terms than what is typical in psychotherapy research. Implications for the understanding of therapeutic success and clinical expertise are discussed.
Literature
go back to reference Baldwin, S. A., & Imel, Z. (2013). Therapist effects. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 258–297). New York: Wiley. Baldwin, S. A., & Imel, Z. (2013). Therapist effects. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 258–297). New York: Wiley.
go back to reference Beutler, L. E., Malik, M., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., & Wong, E. (2004). Therapist variables. In M. J. Lambert (Ed.), Bergin and Garfield‘s handbook of psychotherapy and behavior change (pp. 227–306). New York: Wiley. Beutler, L. E., Malik, M., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., & Wong, E. (2004). Therapist variables. In M. J. Lambert (Ed.), Bergin and Garfield‘s handbook of psychotherapy and behavior change (pp. 227–306). New York: Wiley.
go back to reference Burlingame, G., Paul, S., Fuhriman, A., & Ogles, B. M. (1989). Implementing a time-limited therapy program: Differential effects of training and experience. Psychotherapy: Theory/Research/Practice/Training, 26, 303–313.CrossRef Burlingame, G., Paul, S., Fuhriman, A., & Ogles, B. M. (1989). Implementing a time-limited therapy program: Differential effects of training and experience. Psychotherapy: Theory/Research/Practice/Training, 26, 303–313.CrossRef
go back to reference Chi, M. T. H. (2006). Two approaches to the study of experts’ characteristics. In K. A. Ericsson, N. Charness, R. R. Hoffman & P. J. Feltovich (Eds.), Cambridge handbook of expertise and expert performance (pp. 21–30). New York: Cambridge University Press.CrossRef Chi, M. T. H. (2006). Two approaches to the study of experts’ characteristics. In K. A. Ericsson, N. Charness, R. R. Hoffman & P. J. Feltovich (Eds.), Cambridge handbook of expertise and expert performance (pp. 21–30). New York: Cambridge University Press.CrossRef
go back to reference Cohen, J. (1977). Statistical power analysis for behavioural sciences. New York: Academic Press. Cohen, J. (1977). Statistical power analysis for behavioural sciences. New York: Academic Press.
go back to reference Ekroll, V. B., & Rønnestad, M. H. (2016). Processes and changes experienced by clients during and after naturalistic good outcome therapies conducted by experienced psychotherapists. Psychotherapy Research, 27, 450–468.CrossRef Ekroll, V. B., & Rønnestad, M. H. (2016). Processes and changes experienced by clients during and after naturalistic good outcome therapies conducted by experienced psychotherapists. Psychotherapy Research, 27, 450–468.CrossRef
go back to reference Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016a). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology, 63(1), 1–11. https://doi.org/10.1037/cou0000131.CrossRefPubMed Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016a). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology, 63(1), 1–11. https://​doi.​org/​10.​1037/​cou0000131.CrossRefPubMed
go back to reference Horowitz, L. M., Alden, L. E., Wiggins, J. S., & Pincus, A. L. (2000). IIP-64/IIP-32 professional manual. San Antonio: The Psychological Corporation. Horowitz, L. M., Alden, L. E., Wiggins, J. S., & Pincus, A. L. (2000). IIP-64/IIP-32 professional manual. San Antonio: The Psychological Corporation.
go back to reference Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work (pp. 37–69). New York: Oxford University Press. Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work (pp. 37–69). New York: Oxford University Press.
go back to reference Hox, J. (2010). Multilevel analysis. Techniques and applications (2nd ed.). Mahwah: Lawrence Erlbaum Associates.CrossRef Hox, J. (2010). Multilevel analysis. Techniques and applications (2nd ed.). Mahwah: Lawrence Erlbaum Associates.CrossRef
go back to reference Hubble, M. A., Duncan, B. L., Miller, S. D., & Wampold, B. E. (2009). Introduction. In B. L. Duncan, S. D. Miller, B. E. Wampold & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 23–46). Washington, DC: American Psychological Association. Hubble, M. A., Duncan, B. L., Miller, S. D., & Wampold, B. E. (2009). Introduction. In B. L. Duncan, S. D. Miller, B. E. Wampold & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 23–46). Washington, DC: American Psychological Association.
go back to reference Jennings, L., & Skovholt, T. M. (2016). Expertise in counseling and psychotherapy: Master therapist studies from around the world. New York: Oxford University Press.CrossRef Jennings, L., & Skovholt, T. M. (2016). Expertise in counseling and psychotherapy: Master therapist studies from around the world. New York: Oxford University Press.CrossRef
go back to reference Jennings, L., Skovholt, T. M., Goh, M., & Lian, F. (2013). Master therapists: Explorations of expertise. In M. H. Rønnestad & T. M. Skovholt (Eds.), The developing practitioner: Growth and stagnation of therapists and counselors (pp. 213–264). New York: Routledge. Jennings, L., Skovholt, T. M., Goh, M., & Lian, F. (2013). Master therapists: Explorations of expertise. In M. H. Rønnestad & T. M. Skovholt (Eds.), The developing practitioner: Growth and stagnation of therapists and counselors (pp. 213–264). New York: Routledge.
go back to reference Lambert, M. J., Morton, J. J., Hatfield, D., Harmon, C., Hamilton, S., Reid, R. C., et al. (2004). Administration and scoring manual for the OQ®-45.2. OQ-Measures: Brigham Young University. Lambert, M. J., Morton, J. J., Hatfield, D., Harmon, C., Hamilton, S., Reid, R. C., et al. (2004). Administration and scoring manual for the OQ®-45.2. OQ-Measures: Brigham Young University.
go back to reference Liberman, B. L. (1978). The role of mastery in psychotherapy: Maintenance of improvement and prescriptive change. In J. D. Frank, R. S. D. Hoehn-Saric, B. L. Imber, A. Liberman & R. Stone (Eds.), Effective ingredients of successful psychotherapy (pp. 35–72). New York: Brunner/Mazel. Liberman, B. L. (1978). The role of mastery in psychotherapy: Maintenance of improvement and prescriptive change. In J. D. Frank, R. S. D. Hoehn-Saric, B. L. Imber, A. Liberman & R. Stone (Eds.), Effective ingredients of successful psychotherapy (pp. 35–72). New York: Brunner/Mazel.
go back to reference Monsen, J., Odland, T., Faugli, A., Daae, E., & Eilertsen, D. E. (1995). Personality disorders: Changes and stability after intensive psychotherapy focusing on affect consciousness. Psychotherapy Research, 5(1), 33–48.CrossRef Monsen, J., Odland, T., Faugli, A., Daae, E., & Eilertsen, D. E. (1995). Personality disorders: Changes and stability after intensive psychotherapy focusing on affect consciousness. Psychotherapy Research, 5(1), 33–48.CrossRef
go back to reference Monsen, J. T., Hagtvet, K. A., Havik, O. E., & Eilertsen, D. E. (2006). Circumplex Structure and personality disorder correlates of the Interpersonal Problems Model (IIP-C): Construct validity and clinical implications. Psychological Assessment, 18(2), 165–173.CrossRef Monsen, J. T., Hagtvet, K. A., Havik, O. E., & Eilertsen, D. E. (2006). Circumplex Structure and personality disorder correlates of the Interpersonal Problems Model (IIP-C): Construct validity and clinical implications. Psychological Assessment, 18(2), 165–173.CrossRef
go back to reference Orlinsky, D. E., Botermans, J.-F., & Rønnestad, M. H. (2001). Towards an empirically, grounded model of psychotherapy training: Four thousand therapists rate influences on their development. Australian Psychologist, 36, 139–148.CrossRef Orlinsky, D. E., Botermans, J.-F., & Rønnestad, M. H. (2001). Towards an empirically, grounded model of psychotherapy training: Four thousand therapists rate influences on their development. Australian Psychologist, 36, 139–148.CrossRef
go back to reference Orlinsky, D. E., & Rønnestad, M. H. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington DC: American Psychological Association.CrossRef Orlinsky, D. E., & Rønnestad, M. H. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington DC: American Psychological Association.CrossRef
go back to reference Orlinsky, D. E., Rønnestad, M. H., & Willutzki, U. (2004). Fifty years of psychotherapy process-outcome research: Continuity and change. In M. Lambert (Ed.), Bergin and Garfield’s hand- book of psychotherapy and behavior change (5th ed., pp. 307–389). New York: Wiley. Orlinsky, D. E., Rønnestad, M. H., & Willutzki, U. (2004). Fifty years of psychotherapy process-outcome research: Continuity and change. In M. Lambert (Ed.), Bergin and Garfield’s hand- book of psychotherapy and behavior change (5th ed., pp. 307–389). New York: Wiley.
go back to reference Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks: Sage Publications. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks: Sage Publications.
go back to reference Rønnestad, M. H. (2009). An intensive process-outcome study of the interpersonal aspects of psychotherapy. Research protocol, Department of Psychology, University of Oslo, Norway. Rønnestad, M. H. (2009). An intensive process-outcome study of the interpersonal aspects of psychotherapy. Research protocol, Department of Psychology, University of Oslo, Norway.
go back to reference Rønnestad, M. H. (2016). Is expertise in psychotherapy a useful construct? Psychotherapy Bulletin, 51(1), 11–13. Rønnestad, M. H. (2016). Is expertise in psychotherapy a useful construct? Psychotherapy Bulletin, 51(1), 11–13.
go back to reference Rønnestad, M. H., & Skovholt, T. M. (2013). The developing practitioner: Growth and stagnation of therapists and counselors. New York: Routledge. Rønnestad, M. H., & Skovholt, T. M. (2013). The developing practitioner: Growth and stagnation of therapists and counselors. New York: Routledge.
go back to reference Rosenthal, J. A. (1996). Qualitative descriptors of strength of association and effect size. Journal of Social Service Research, 21, 37–59.CrossRef Rosenthal, J. A. (1996). Qualitative descriptors of strength of association and effect size. Journal of Social Service Research, 21, 37–59.CrossRef
go back to reference Rosenthal, R., & Rosnow, R. L. (1984). Essentials of behavioral research: Methods and data analysis. New York: McGraw-Hill. Rosenthal, R., & Rosnow, R. L. (1984). Essentials of behavioral research: Methods and data analysis. New York: McGraw-Hill.
go back to reference Rousmaniere, T. (2017). Deliberate practice for psychotherapists: A Guide to Improving Clinical Effectiveness. New York: Routledge. Rousmaniere, T. (2017). Deliberate practice for psychotherapists: A Guide to Improving Clinical Effectiveness. New York: Routledge.
go back to reference Sandell, R., Blomberg, J., Lazar, A., Carlsson, J., Broberg, J., & Schubert, J. (2000). Varieties of long-term outcome among patients in psychoanalysis and long-term psycho- therapy: A review of findings in the Stockholm Outcome of Psychoanalysis and Psychotherapy Project (STOPPP). International Journal of Psychoanalysis, 81, 921–942.CrossRef Sandell, R., Blomberg, J., Lazar, A., Carlsson, J., Broberg, J., & Schubert, J. (2000). Varieties of long-term outcome among patients in psychoanalysis and long-term psycho- therapy: A review of findings in the Stockholm Outcome of Psychoanalysis and Psychotherapy Project (STOPPP). International Journal of Psychoanalysis, 81, 921–942.CrossRef
go back to reference Snijders, T. A., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London: Sage. Snijders, T. A., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London: Sage.
go back to reference Tasca, G. A., & Gallop, R. (2009). Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics. Psychotherapy Research, 19(4–5), 429–437.CrossRef Tasca, G. A., & Gallop, R. (2009). Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics. Psychotherapy Research, 19(4–5), 429–437.CrossRef
go back to reference Tschuschke, V., Crameri, A., Koehler, M., Berglar, J., Muth, K., Staczan, P., et al. (2015). The role of therapists’ treatment adherence, professional experience, therapeutic alliance, and clients’ severity of psychological problems: Prediction of treatment outcome in eight different psychotherapy approaches. Preliminary results of a naturalistic study. Psychotherapy Research, 25, 420–434. https://doi.org/10.1080/10503307.2014.896055.CrossRefPubMed Tschuschke, V., Crameri, A., Koehler, M., Berglar, J., Muth, K., Staczan, P., et al. (2015). The role of therapists’ treatment adherence, professional experience, therapeutic alliance, and clients’ severity of psychological problems: Prediction of treatment outcome in eight different psychotherapy approaches. Preliminary results of a naturalistic study. Psychotherapy Research, 25, 420–434. https://​doi.​org/​10.​1080/​10503307.​2014.​896055.CrossRefPubMed
go back to reference Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). New York: Routledge.CrossRef Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). New York: Routledge.CrossRef
go back to reference Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice, 24(2), 190–195.CrossRef Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice, 24(2), 190–195.CrossRef
Metadata
Title
Expanding the Conceptualization of Outcome and Clinical Effectiveness
Authors
Michael Helge Rønnestad
Helene A. Nissen-Lie
Hanne Weie Oddli
Kirsten Benum
Vidar Blokhus Ekroll
Siri E. Gullestad
Hanne Haavind
Sissel Reichelt
Marit Råbu
Erik Stänicke
Anna Louise von der Lippe
Margrethe Seeger Halvorsen
Publication date
01-06-2019
Publisher
Springer US
Published in
Journal of Contemporary Psychotherapy / Issue 2/2019
Print ISSN: 0022-0116
Electronic ISSN: 1573-3564
DOI
https://doi.org/10.1007/s10879-018-9405-z

Other articles of this Issue 2/2019

Journal of Contemporary Psychotherapy 2/2019 Go to the issue