Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 3/2024

Open Access 08-02-2024 | Original Article

Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions

Authors: Andrew A. McAleavey, Kim de Jong, Helene A. Nissen-Lie, James F. Boswell, Christian Moltu, Wolfgang Lutz

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2024

Login to get access

Abstract

In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to enhance the beneficial effects of ROM and feedback. In this article, we summarize trends and recent advances in the research on this topic and identify several essential directions for the field in the short to medium term. We anticipate a broadening of research from the focus on average effects to greater specificity around what kinds of feedback, provided at what time, to which individuals, in what settings, are most beneficial. We also propose that the field needs to focus on issues of health equity, ensuring that ROM can be a vehicle for increased wellbeing for those who need it most. The complexity of mental healthcare systems means that there may be multiple viable measurement solutions with varying costs and benefits to diverse stakeholders in different treatment contexts, and research is needed to identify the most influential components in each of these contexts.
Literature
go back to reference Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57.PubMedCrossRef Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57.PubMedCrossRef
go back to reference Barlow, D. H., Harris, B. A., Eustis, E. H., & Farchione, T. J. (2020). The unified protocol for transdiagnostic treatment of emotional disorders. World Psychiatry, 19(2), 245.PubMedPubMedCentralCrossRef Barlow, D. H., Harris, B. A., Eustis, E. H., & Farchione, T. J. (2020). The unified protocol for transdiagnostic treatment of emotional disorders. World Psychiatry, 19(2), 245.PubMedPubMedCentralCrossRef
go back to reference Bastiaansen, J. A., Kunkels, Y. K., Blaauw, F. J., Boker, S. M., Ceulemans, E., Chen, M., Chow, S. M., de Jonge, P., Emerencia, A. C., & Epskamp, S. (2020). Time to get personal? The impact of researchers choices on the selection of treatment targets using the experience sampling methodology. Journal of Psychosomatic Research, 137, 110211.PubMedPubMedCentralCrossRef Bastiaansen, J. A., Kunkels, Y. K., Blaauw, F. J., Boker, S. M., Ceulemans, E., Chen, M., Chow, S. M., de Jonge, P., Emerencia, A. C., & Epskamp, S. (2020). Time to get personal? The impact of researchers choices on the selection of treatment targets using the experience sampling methodology. Journal of Psychosomatic Research, 137, 110211.PubMedPubMedCentralCrossRef
go back to reference Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4(6), 561–571.PubMedCrossRef Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4(6), 561–571.PubMedCrossRef
go back to reference Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31(1), 70.CrossRef Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31(1), 70.CrossRef
go back to reference Boswell, J. F., Constantino, M. J., & Kraus, D. R. (2017). Harnessing the Therapist Effect in patient-centered Mental Health Care decision making. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 724–728.PubMedCrossRef Boswell, J. F., Constantino, M. J., & Kraus, D. R. (2017). Harnessing the Therapist Effect in patient-centered Mental Health Care decision making. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 724–728.PubMedCrossRef
go back to reference Boswell, J. F., Constantino, M. J., Oswald, J. M., Bugatti, M., Coyne, A. E., Goodwin, B., & Morrison, N. (2021). A multimethod study of mental health care patients’ attitudes toward clinician-level performance information. Psychiatric Services, 72(4), 452–456.PubMedCrossRef Boswell, J. F., Constantino, M. J., Oswald, J. M., Bugatti, M., Coyne, A. E., Goodwin, B., & Morrison, N. (2021). A multimethod study of mental health care patients’ attitudes toward clinician-level performance information. Psychiatric Services, 72(4), 452–456.PubMedCrossRef
go back to reference Boswell, J. F., Constantino, M. J., Coyne, A. E., & Kraus, D. R. (2022a). For whom does a match matter most? Patient-level moderators of evidence-based patient–therapist matching. Journal of Consulting and Clinical Psychology, 90(1), 61.PubMedCrossRef Boswell, J. F., Constantino, M. J., Coyne, A. E., & Kraus, D. R. (2022a). For whom does a match matter most? Patient-level moderators of evidence-based patient–therapist matching. Journal of Consulting and Clinical Psychology, 90(1), 61.PubMedCrossRef
go back to reference Boswell, J. F., Hepner, K. A., Lysell, K., Rothrock, N. E., Bott, N., Childs, A. W., Douglas, S., Owings-Fonner, N., Wright, C. V., & Stephens, K. A. (2022b). The need for a measurement-based care professional practice guideline. Psychotherapy. Boswell, J. F., Hepner, K. A., Lysell, K., Rothrock, N. E., Bott, N., Childs, A. W., Douglas, S., Owings-Fonner, N., Wright, C. V., & Stephens, K. A. (2022b). The need for a measurement-based care professional practice guideline. Psychotherapy.
go back to reference Bovendeerd, B., de Jong, K., de Groot, E., Moerbeek, M., & de Keijser, J. (2021). Enhancing the effect of psychotherapy through systematic client feedback in outpatient mental healthcare: A cluster randomized trial. Psychotherapy Research: Journal of the Society for Psychotherapy Research, 1–13. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=medp&NEWS=N&AN=34949156%[20211223// Bovendeerd, B., de Jong, K., de Groot, E., Moerbeek, M., & de Keijser, J. (2021). Enhancing the effect of psychotherapy through systematic client feedback in outpatient mental healthcare: A cluster randomized trial. Psychotherapy Research: Journal of the Society for Psychotherapy Research, 1–13. http://​ovidsp.​ovid.​com/​ovidweb.​cgi?​T=​JS&PAGE=reference&D=medp&NEWS=N&AN=34949156%[20211223//
go back to reference Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., Ryum, T., Wampold, B., Lara-Cabrera, M. L., & Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641.PubMedCrossRef Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., Ryum, T., Wampold, B., Lara-Cabrera, M. L., & Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641.PubMedCrossRef
go back to reference Bringmann, L. F. (2021). Person-specific networks in psychopathology: Past, present, and future. Current Opinion in Psychology, 41, 59–64.PubMedCrossRef Bringmann, L. F. (2021). Person-specific networks in psychopathology: Past, present, and future. Current Opinion in Psychology, 41, 59–64.PubMedCrossRef
go back to reference Brooks Holliday, S., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R., Smith, B. N., & Rosen, C. (2021). Discussing measurement-based care with patients: An analysis of clinician-patient dyads. Psychotherapy Research, 31(2), 211–223. https://doi.org/doi:.PubMedCrossRef Brooks Holliday, S., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R., Smith, B. N., & Rosen, C. (2021). Discussing measurement-based care with patients: An analysis of clinician-patient dyads. Psychotherapy Research, 31(2), 211–223. https://​doi.​org/​doi:.PubMedCrossRef
go back to reference Callaly, T., & Hallebone, E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. AUSTRALIAN HEALTH REVIEW, 24(1), 43–50.PubMedCrossRef Callaly, T., & Hallebone, E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. AUSTRALIAN HEALTH REVIEW, 24(1), 43–50.PubMedCrossRef
go back to reference Coalition for the Advancement and Application of Psychological Science (2018). Evidence-based Practice Decision-Making for Mental and Behavioral Health Care. In. Coalition for the Advancement and Application of Psychological Science (2018). Evidence-based Practice Decision-Making for Mental and Behavioral Health Care. In.
go back to reference Cohen, Z. D., Delgadillo, J., & DeRubeis, R. J. (2021). Personalized treatment approaches. In W. L. Michael, L. G. Barkham, & Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change: 50th anniversary edition (pp. 673–703). John Wiley & Sons, Inc. Cohen, Z. D., Delgadillo, J., & DeRubeis, R. J. (2021). Personalized treatment approaches. In W. L. Michael, L. G. Barkham, & Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change: 50th anniversary edition (pp. 673–703). John Wiley & Sons, Inc.
go back to reference De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474.PubMedCrossRef De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474.PubMedCrossRef
go back to reference Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., & Nevin, J. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet Psychiatry, 5(7), 564–572.PubMedCrossRef Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., & Nevin, J. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet Psychiatry, 5(7), 564–572.PubMedCrossRef
go back to reference Delgadillo, J., Rubel, J., & Barkham, M. (2020). Towards personalized allocation of patients to therapists. Journal of Consulting and Clinical Psychology, 88(9), 799.PubMedCrossRef Delgadillo, J., Rubel, J., & Barkham, M. (2020). Towards personalized allocation of patients to therapists. Journal of Consulting and Clinical Psychology, 88(9), 799.PubMedCrossRef
go back to reference Delgadillo, J., Deisenhofer, A. K., Probst, T., Shimokawa, K., Lambert, M. J., & Kleinstäuber, M. (2022b). Progress feedback narrows the gap between more and less effective therapists: A therapist effects meta-analysis of clinical trials. Journal of Consulting and Clinical Psychology, 90(7), 559.PubMedCrossRef Delgadillo, J., Deisenhofer, A. K., Probst, T., Shimokawa, K., Lambert, M. J., & Kleinstäuber, M. (2022b). Progress feedback narrows the gap between more and less effective therapists: A therapist effects meta-analysis of clinical trials. Journal of Consulting and Clinical Psychology, 90(7), 559.PubMedCrossRef
go back to reference Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy research: journal of the Society for Psychotherapy Research, 25(6), 678–693. Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy research: journal of the Society for Psychotherapy Research, 25(6), 678–693.
go back to reference Elliott, R., Wagner, J., Sales, C. M. D., Rodgers, B., Alves, P., & Café, M. J. (2016). Psychometrics of the personal questionnaire: A client-generated outcome measure. Psychological Assessment, 28(3), 263.PubMedCrossRef Elliott, R., Wagner, J., Sales, C. M. D., Rodgers, B., Alves, P., & Café, M. J. (2016). Psychometrics of the personal questionnaire: A client-generated outcome measure. Psychological Assessment, 28(3), 263.PubMedCrossRef
go back to reference Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47(1), 273–305.PubMedCrossRef Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47(1), 273–305.PubMedCrossRef
go back to reference Errazuriz, P., & Zilcha-Mano, S. (2018). In psychotherapy with severe patients discouraging news may be worse than no news: The impact of providing feedback to therapists on psychotherapy outcome, session attendance, and the alliance. Journal of Consulting and Clinical Psychology, 86(2), 125–139.PubMedCrossRef Errazuriz, P., & Zilcha-Mano, S. (2018). In psychotherapy with severe patients discouraging news may be worse than no news: The impact of providing feedback to therapists on psychotherapy outcome, session attendance, and the alliance. Journal of Consulting and Clinical Psychology, 86(2), 125–139.PubMedCrossRef
go back to reference Fisher, A. J. (2015). Toward a dynamic model of psychological assessment: Implications for personalized care. Journal of Consulting and Clinical Psychology, 83(4), 825.PubMedCrossRef Fisher, A. J. (2015). Toward a dynamic model of psychological assessment: Implications for personalized care. Journal of Consulting and Clinical Psychology, 83(4), 825.PubMedCrossRef
go back to reference Fornells-Ambrojo, M., Johns, L., Onwumere, J., Garety, P., Milosh, C., Iredale, C., Peters, E., Webster, A., & Jolley, S. (2017). Experiences of outcome monitoring in service users with psychosis: Findings from an improving Access to Psychological therapies for people with severe Mental Illness (IAPT-SMI) demonstration site. The British Journal of Clinical Psychology, 56(3), 253–272.PubMedCrossRef Fornells-Ambrojo, M., Johns, L., Onwumere, J., Garety, P., Milosh, C., Iredale, C., Peters, E., Webster, A., & Jolley, S. (2017). Experiences of outcome monitoring in service users with psychosis: Findings from an improving Access to Psychological therapies for people with severe Mental Illness (IAPT-SMI) demonstration site. The British Journal of Clinical Psychology, 56(3), 253–272.PubMedCrossRef
go back to reference Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J. L., Miller, S. D., & Wampold, B. E. (2016). Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice. Psychotherapy, 53(3), 367.PubMedCrossRef Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J. L., Miller, S. D., & Wampold, B. E. (2016). Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice. Psychotherapy, 53(3), 367.PubMedCrossRef
go back to reference Heinonen, E., & Nissen-Lie, H. A. (2020). The professional and personal characteristics of effective psychotherapists: A systematic review. Psychotherapy Research, 30(4), 417–432.PubMedCrossRef Heinonen, E., & Nissen-Lie, H. A. (2020). The professional and personal characteristics of effective psychotherapists: A systematic review. Psychotherapy Research, 30(4), 417–432.PubMedCrossRef
go back to reference Herzog, P., Kube, T., & Rubel, J. (2023). Why some psychotherapists benefit from feedback on treatment progress more than others: A belief updating perspective. Clinical Psychology: Science and Practice. Herzog, P., Kube, T., & Rubel, J. (2023). Why some psychotherapists benefit from feedback on treatment progress more than others: A belief updating perspective. Clinical Psychology: Science and Practice.
go back to reference Hovland, R. T., Ytrehus, S., Mellor-Clark, J., & Moltu, C. (2020). How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice. Journal of Clinical Psychology, n/a(n/a). https://doi.org/10.1002/jclp.22992. Hovland, R. T., Ytrehus, S., Mellor-Clark, J., & Moltu, C. (2020). How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice. Journal of Clinical Psychology, n/a(n/a). https://​doi.​org/​10.​1002/​jclp.​22992.
go back to reference Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059.PubMedCrossRef Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059.PubMedCrossRef
go back to reference Imel, Z. E., Sheng, E., Baldwin, S. A., & Atkins, D. C. (2015). Removing very low-performing therapists: A simulation of performance-based retention in psychotherapy. Psychotherapy, 52(3), 329.PubMedCrossRef Imel, Z. E., Sheng, E., Baldwin, S. A., & Atkins, D. C. (2015). Removing very low-performing therapists: A simulation of performance-based retention in psychotherapy. Psychotherapy, 52(3), 329.PubMedCrossRef
go back to reference Janse, P. D., Veerkamp, C., de Jong, K., van Dijk, M. K., Hutschemaekers, G. J., & Verbraak, M. J. (2023). Exploring therapist characteristics as potential moderators of the effects of client feedback on treatment outcome. Clinical Psychology & Psychotherapy, 30(3), 690–701. https://doi.org/10.1002/cpp.2828.CrossRef Janse, P. D., Veerkamp, C., de Jong, K., van Dijk, M. K., Hutschemaekers, G. J., & Verbraak, M. J. (2023). Exploring therapist characteristics as potential moderators of the effects of client feedback on treatment outcome. Clinical Psychology & Psychotherapy, 30(3), 690–701. https://​doi.​org/​10.​1002/​cpp.​2828.CrossRef
go back to reference Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78–93.PubMedCrossRef Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78–93.PubMedCrossRef
go back to reference Joint Commission (2018). Complying with Standard CTS.03.01.09 Behavioral Health Care Accreditation Program. In (Vol. STANDARD CTS.03.01.09). Joint Commission (2018). Complying with Standard CTS.03.01.09 Behavioral Health Care Accreditation Program. In (Vol. STANDARD CTS.03.01.09).
go back to reference Kaiser, T., Herzog, P., Voderholzer, U., & Brakemeier, E. L. (2022). Out of sight, out of mind? High discrepancy between observer-and patient-reported outcome after routine inpatient treatment for depression. Journal of Affective Disorders, 300, 322–325.PubMedCrossRef Kaiser, T., Herzog, P., Voderholzer, U., & Brakemeier, E. L. (2022). Out of sight, out of mind? High discrepancy between observer-and patient-reported outcome after routine inpatient treatment for depression. Journal of Affective Disorders, 300, 322–325.PubMedCrossRef
go back to reference Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brutt, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. COCHRANE DATABASE OF SYSTEMATIC REVIEWS, (7). https://doi.org/10.1002/14651858.CD011119.pub2. Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brutt, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. COCHRANE DATABASE OF SYSTEMATIC REVIEWS, (7). https://​doi.​org/​10.​1002/​14651858.​CD011119.​pub2.
go back to reference Kiesler, D. J. (1966). Some myths of psychotherapy research and the search for a paradigm. Psychological Bulletin, 65(2), 110.CrossRef Kiesler, D. J. (1966). Some myths of psychotherapy research and the search for a paradigm. Psychological Bulletin, 65(2), 110.CrossRef
go back to reference Knight, R. P. (1941). Evaluation of the results of psychoanalytic therapy. American Journal of Psychiatry, 98(3), 434–446.CrossRef Knight, R. P. (1941). Evaluation of the results of psychoanalytic therapy. American Journal of Psychiatry, 98(3), 434–446.CrossRef
go back to reference Knox, S., & Hill, C. E. (2021). Training and supervision in psychotherapy: What we know and where we need to go. Bergin’s and Garfield’s Handbook of Psychotherapy and Behavior Change, 327–349. Knox, S., & Hill, C. E. (2021). Training and supervision in psychotherapy: What we know and where we need to go. Bergin’s and Garfield’s Handbook of Psychotherapy and Behavior Change, 327–349.
go back to reference Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241.PubMedCrossRef Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241.PubMedCrossRef
go back to reference Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61(3), 285–314.PubMedCrossRef Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61(3), 285–314.PubMedCrossRef
go back to reference Kraus, D. R., Castonguay, L., Boswell, J. F., Nordberg, S. S., & Hayes, J. A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21(3), 267–276.PubMedCrossRef Kraus, D. R., Castonguay, L., Boswell, J. F., Nordberg, S. S., & Hayes, J. A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21(3), 267–276.PubMedCrossRef
go back to reference Kraus, D. R., Bentley, J. H., Alexander, P. C., Boswell, J. F., Constantino, M. J., Baxter, E. E., & Castonguay, L. G. (2016). Predicting therapist effectiveness from their own practice-based evidence. Journal of Consulting and Clinical Psychology, 84(6), 473.PubMedCrossRef Kraus, D. R., Bentley, J. H., Alexander, P. C., Boswell, J. F., Constantino, M. J., Baxter, E. E., & Castonguay, L. G. (2016). Predicting therapist effectiveness from their own practice-based evidence. Journal of Consulting and Clinical Psychology, 84(6), 473.PubMedCrossRef
go back to reference Kwan, B., Rickwood, D. J., & Brown, P. M. (2021). Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings. Psychotherapy Research, 31(2), 171–183.PubMedCrossRef Kwan, B., Rickwood, D. J., & Brown, P. M. (2021). Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings. Psychotherapy Research, 31(2), 171–183.PubMedCrossRef
go back to reference Låver, J., McAleavey, A., Valaker, I., Castonguay, L., & Moltu, C. (2023). Therapists’ and patients’ experiences of using patients’ self-reported data in ongoing psychotherapy processes—A systematic review and meta-analysis of qualitative studies. Psychotherapy Research, 1–18. https://doi.org/10.1080/10503307.2023.2222896. Låver, J., McAleavey, A., Valaker, I., Castonguay, L., & Moltu, C. (2023). Therapists’ and patients’ experiences of using patients’ self-reported data in ongoing psychotherapy processes—A systematic review and meta-analysis of qualitative studies. Psychotherapy Research, 1–18. https://​doi.​org/​10.​1080/​10503307.​2023.​2222896.
go back to reference Lavik, K. O., Veseth, M., Froysa, H., Stefansen, J., Notnes, J. C., & Moltu, C. (2020). This is what I need a clinical feedback system to do for me: A qualitative inquiry into perspectives of adolescents and their therapists. Journal of Clinical Psychology. https://doi.org/doi:. Lavik, K. O., Veseth, M., Froysa, H., Stefansen, J., Notnes, J. C., & Moltu, C. (2020). This is what I need a clinical feedback system to do for me: A qualitative inquiry into perspectives of adolescents and their therapists. Journal of Clinical Psychology. https://​doi.​org/​doi:.
go back to reference Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., & Douglas, S. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry, 76(3), 324–335.PubMedCrossRef Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., & Douglas, S. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry, 76(3), 324–335.PubMedCrossRef
go back to reference Lutz, W., Rubel, J., Schiefele, A. K., Zimmermann, D., Böhnke, J. R., & Wittmann, W. W. (2015). Feedback and therapist effects in the context of treatment outcome and treatment length. Psychotherapy Research, 25(6), 647–660.PubMedCrossRef Lutz, W., Rubel, J., Schiefele, A. K., Zimmermann, D., Böhnke, J. R., & Wittmann, W. W. (2015). Feedback and therapist effects in the context of treatment outcome and treatment length. Psychotherapy Research, 25(6), 647–660.PubMedCrossRef
go back to reference Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A. K. (2019). Towards integrating personalized feedback research into clinical practice: Development of the Trier Treatment Navigator (TTN). Behaviour Research and Therapy, 120, 103438.PubMedCrossRef Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A. K. (2019). Towards integrating personalized feedback research into clinical practice: Development of the Trier Treatment Navigator (TTN). Behaviour Research and Therapy, 120, 103438.PubMedCrossRef
go back to reference Lutz, W., de Jong, K., Rubel, J. A., & Delgadillo, J. (2021). Measuring, predicting, and tracking change in psychotherapy. In W. L. Michael, L. G. Barkham, & Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change: 50th anniversary edition (pp. 89–133). John Wiley & Sons, Inc. Lutz, W., de Jong, K., Rubel, J. A., & Delgadillo, J. (2021). Measuring, predicting, and tracking change in psychotherapy. In W. L. Michael, L. G. Barkham, & Castonguay (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change: 50th anniversary edition (pp. 89–133). John Wiley & Sons, Inc.
go back to reference Lutz, W., Deisenhofer, A. K., Rubel, J., Bennemann, B., Giesemann, J., Poster, K., & Schwartz, B. (2022a). Prospective evaluation of a clinical decision support system in psychological therapy. Journal of Consulting and Clinical Psychology, 90(1), 90.PubMedCrossRef Lutz, W., Deisenhofer, A. K., Rubel, J., Bennemann, B., Giesemann, J., Poster, K., & Schwartz, B. (2022a). Prospective evaluation of a clinical decision support system in psychological therapy. Journal of Consulting and Clinical Psychology, 90(1), 90.PubMedCrossRef
go back to reference Lutz, W., Schwartz, B., & Delgadillo, J. (2022b). Measurement-based and data-informed psychological therapy. Annual Review of Clinical Psychology, 18, 71–98.PubMedCrossRef Lutz, W., Schwartz, B., & Delgadillo, J. (2022b). Measurement-based and data-informed psychological therapy. Annual Review of Clinical Psychology, 18, 71–98.PubMedCrossRef
go back to reference Matanov, A., McNamee, P., Akther, S., Barber, N., & Bird, V. (2021). Acceptability of a technology-supported and solution-focused intervention (DIALOG+) for chronic depression: Views of service users and clinicians. Bmc Psychiatry, 21(1), 263.PubMedPubMedCentralCrossRef Matanov, A., McNamee, P., Akther, S., Barber, N., & Bird, V. (2021). Acceptability of a technology-supported and solution-focused intervention (DIALOG+) for chronic depression: Views of service users and clinicians. Bmc Psychiatry, 21(1), 263.PubMedPubMedCentralCrossRef
go back to reference McAleavey, A. A., & Moltu, C. (2023). Belief updating is an important contribution, but not the whole story. Clinical Psychology: Science and Practice, Advance online publication. McAleavey, A. A., & Moltu, C. (2023). Belief updating is an important contribution, but not the whole story. Clinical Psychology: Science and Practice, Advance online publication.
go back to reference McAleavey, A. A., Nordberg, S. S., & Moltu, C. (2021). Initial quantitative development of the norse feedback system: A novel clinical feedback system for routine mental healthcare. Quality of Life Research, 30, 3097–3115.PubMedPubMedCentralCrossRef McAleavey, A. A., Nordberg, S. S., & Moltu, C. (2021). Initial quantitative development of the norse feedback system: A novel clinical feedback system for routine mental healthcare. Quality of Life Research, 30, 3097–3115.PubMedPubMedCentralCrossRef
go back to reference Miller, S. D., Chow, D. E., Malins, S. E., & Hubble, M. A. (2023). The field guide to better results: Evidence-based exercises to improve therapeutic effectiveness. American Psychological Association. Miller, S. D., Chow, D. E., Malins, S. E., & Hubble, M. A. (2023). The field guide to better results: Evidence-based exercises to improve therapeutic effectiveness. American Psychological Association.
go back to reference Molenaar, P. C. (1987). Dynamic assessment and adaptive optimization of the psychotherapeutic process. Behavioral Assessment. Molenaar, P. C. (1987). Dynamic assessment and adaptive optimization of the psychotherapeutic process. Behavioral Assessment.
go back to reference Nissen-Lie, H. A., Goldberg, S. B., Hoyt, W. T., Falkenström, F., Holmqvist, R., Nielsen, S. L., & Wampold, B. E. (2016). Are therapists uniformly effective across patient outcome domains? A study on therapist effectiveness in two different treatment contexts. Journal of Counseling Psychology, 63(4), 367.PubMedCrossRef Nissen-Lie, H. A., Goldberg, S. B., Hoyt, W. T., Falkenström, F., Holmqvist, R., Nielsen, S. L., & Wampold, B. E. (2016). Are therapists uniformly effective across patient outcome domains? A study on therapist effectiveness in two different treatment contexts. Journal of Counseling Psychology, 63(4), 367.PubMedCrossRef
go back to reference Nissen-Lie, H. A., Heinonen, E., & Delgadillo, J. (2023). Therapist factors. In The field guide to better results: Evidence-based exercises to improve therapeutic effectiveness (pp. 79–106). American Psychological Association. https://doi.org/10.1037/0000358-005. Nissen-Lie, H. A., Heinonen, E., & Delgadillo, J. (2023). Therapist factors. In The field guide to better results: Evidence-based exercises to improve therapeutic effectiveness (pp. 79–106). American Psychological Association. https://​doi.​org/​10.​1037/​0000358-005.
go back to reference Nordberg, S. S., McAleavey, A. A., & Moltu, C. (2021). Continuous quality improvement in measure development: Lessons from building a novel clinical feedback system. Quality of life Research: An International Journal of Quality of life Aspects of Treatment care and Rehabilitation, 30(11), 3085–3096. https://doi.org/doi:.PubMedCrossRef Nordberg, S. S., McAleavey, A. A., & Moltu, C. (2021). Continuous quality improvement in measure development: Lessons from building a novel clinical feedback system. Quality of life Research: An International Journal of Quality of life Aspects of Treatment care and Rehabilitation, 30(11), 3085–3096. https://​doi.​org/​doi:.PubMedCrossRef
go back to reference Perlman, M. R., Anderson, T., Foley, V. K., Mimnaugh, S., & Safran, J. D. (2020). The impact of alliance-focused and facilitative interpersonal relationship training on therapist skills: An RCT of brief training. Psychotherapy Research, 30(7), 871–884.PubMedCrossRef Perlman, M. R., Anderson, T., Foley, V. K., Mimnaugh, S., & Safran, J. D. (2020). The impact of alliance-focused and facilitative interpersonal relationship training on therapist skills: An RCT of brief training. Psychotherapy Research, 30(7), 871–884.PubMedCrossRef
go back to reference Perlman, M. R., Anderson, T., Finkelstein, J. D., Foley, V. K., Mimnaugh, S., Gooch, C. V., David, K. C., Martin, S. J., & Safran, J. D. (2023). Facilitative interpersonal relationship training enhances novices’ therapeutic skills. COUNSELLING PSYCHOLOGY QUARTERLY, 36(1), 25–40.CrossRef Perlman, M. R., Anderson, T., Finkelstein, J. D., Foley, V. K., Mimnaugh, S., Gooch, C. V., David, K. C., Martin, S. J., & Safran, J. D. (2023). Facilitative interpersonal relationship training enhances novices’ therapeutic skills. COUNSELLING PSYCHOLOGY QUARTERLY, 36(1), 25–40.CrossRef
go back to reference Rubel, J. A., Fisher, A. J., Husen, K., & Lutz, W. (2018). Translating person-specific network models into personalized treatments: Development and demonstration of the dynamic assessment treatment algorithm for individual networks (DATA-IN). Psychotherapy and Psychosomatics, 87(4), 249–251.PubMedCrossRef Rubel, J. A., Fisher, A. J., Husen, K., & Lutz, W. (2018). Translating person-specific network models into personalized treatments: Development and demonstration of the dynamic assessment treatment algorithm for individual networks (DATA-IN). Psychotherapy and Psychosomatics, 87(4), 249–251.PubMedCrossRef
go back to reference Sales, C. M. D., Neves, I. T. D., Alves, P. G., & Ashworth, M. (2018). Capturing and missing the patient’s story through outcome measures: A thematic comparison of patient-generated items in PSYCHLOPS with CORE-OM and PHQ-9. HEALTH EXPECTATIONS, 21(3), 615–619. https://doi.org/10.1111/hex.12652.CrossRefPubMed Sales, C. M. D., Neves, I. T. D., Alves, P. G., & Ashworth, M. (2018). Capturing and missing the patient’s story through outcome measures: A thematic comparison of patient-generated items in PSYCHLOPS with CORE-OM and PHQ-9. HEALTH EXPECTATIONS, 21(3), 615–619. https://​doi.​org/​10.​1111/​hex.​12652.CrossRefPubMed
go back to reference Sales, C. M. D., Ashworth, M., Ayis, S., Barkham, M., Edbrooke-Childs, J., Faisca, L., Jacob, J., Xu, D., & Cooper, M. (2022). Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper. Journal of Clinical Psychology. https://doi.org/doi. Sales, C. M. D., Ashworth, M., Ayis, S., Barkham, M., Edbrooke-Childs, J., Faisca, L., Jacob, J., Xu, D., & Cooper, M. (2022). Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper. Journal of Clinical Psychology. https://​doi.​org/​doi.​
go back to reference Sauer-Zavala, S., Cassiello-Robbins, C., Ametaj, A. A., Wilner, J. G., & Pagan, D. (2019). Transdiagnostic treatment personalization: The feasibility of ordering unified protocol modules according to patient strengths and weaknesses. Behavior Modification, 43(4), 518–543.PubMedCrossRef Sauer-Zavala, S., Cassiello-Robbins, C., Ametaj, A. A., Wilner, J. G., & Pagan, D. (2019). Transdiagnostic treatment personalization: The feasibility of ordering unified protocol modules according to patient strengths and weaknesses. Behavior Modification, 43(4), 518–543.PubMedCrossRef
go back to reference Schwartz, B., Cohen, Z. D., Rubel, J. A., Zimmermann, D., Wittmann, W. W., & Lutz, W. (2021). Personalized treatment selection in routine care: Integrating machine learning and statistical algorithms to recommend cognitive behavioral or psychodynamic therapy. Psychotherapy Research, 31(1), 33–51.PubMedCrossRef Schwartz, B., Cohen, Z. D., Rubel, J. A., Zimmermann, D., Wittmann, W. W., & Lutz, W. (2021). Personalized treatment selection in routine care: Integrating machine learning and statistical algorithms to recommend cognitive behavioral or psychodynamic therapy. Psychotherapy Research, 31(1), 33–51.PubMedCrossRef
go back to reference Shapiro, M. (1961). A method of measuring psychological changes specific to the individual psychiatric patient. BRITISH JOURNAL OF MEDICAL PSYCHOLOGY, 34(2), 151–155.CrossRef Shapiro, M. (1961). A method of measuring psychological changes specific to the individual psychiatric patient. BRITISH JOURNAL OF MEDICAL PSYCHOLOGY, 34(2), 151–155.CrossRef
go back to reference Solstad, S. M., Solberg, G. K., Castonguay, L. G., & Moltu, C. (2020). Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences. Psychotherapy Research. Solstad, S. M., Solberg, G. K., Castonguay, L. G., & Moltu, C. (2020). Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences. Psychotherapy Research.
go back to reference Solstad, S. M., Kleiven, G. S., Castonguay, L. G., & Moltu, C. (2021a). Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences. Psychotherapy Research, 31(2), 200–210.PubMedCrossRef Solstad, S. M., Kleiven, G. S., Castonguay, L. G., & Moltu, C. (2021a). Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences. Psychotherapy Research, 31(2), 200–210.PubMedCrossRef
go back to reference Solstad, S. M., Kleiven, G. S., & Moltu, C. (2021b). Complexity and potentials of clinical feedback in mental health: An in-depth study of patient processes. Quality of Life Research, 30, 3117–3125.PubMedCrossRef Solstad, S. M., Kleiven, G. S., & Moltu, C. (2021b). Complexity and potentials of clinical feedback in mental health: An in-depth study of patient processes. Quality of Life Research, 30, 3117–3125.PubMedCrossRef
go back to reference Southward, M. W., Lane, S. P., Shroyer, S. E., & Sauer-Zavala, S. (2023). Do unified protocol modules exert general or unique effects on anxiety, depression, and transdiagnostic targets? Journal of Mood and Anxiety Disorders, 3, 100022.PubMedPubMedCentralCrossRef Southward, M. W., Lane, S. P., Shroyer, S. E., & Sauer-Zavala, S. (2023). Do unified protocol modules exert general or unique effects on anxiety, depression, and transdiagnostic targets? Journal of Mood and Anxiety Disorders, 3, 100022.PubMedPubMedCentralCrossRef
go back to reference Stiles, W. B., & Horvath, A. O. (2017). Appropriate responsiveness as a contribution to therapist effects. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others? Understanding therapist effects (pp. 71–84). American Psychological Associate. https://doi.org/10.1037/0000034-005. Stiles, W. B., & Horvath, A. O. (2017). Appropriate responsiveness as a contribution to therapist effects. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others? Understanding therapist effects (pp. 71–84). American Psychological Associate. https://​doi.​org/​10.​1037/​0000034-005.
go back to reference Sun, Q., Wu, C., Wang, C. D. C., Yu, L., She, Z., & Falkenstrom, F. (2021). Alliance-outcome relation and progress feedback: Secondary data analyses of a randomized clinical trial study in China. Psychotherapy Research, 31(2), 145–156. https://doi.org/doi:.PubMedCrossRef Sun, Q., Wu, C., Wang, C. D. C., Yu, L., She, Z., & Falkenstrom, F. (2021). Alliance-outcome relation and progress feedback: Secondary data analyses of a randomized clinical trial study in China. Psychotherapy Research, 31(2), 145–156. https://​doi.​org/​doi:.PubMedCrossRef
go back to reference Truijens, F., De Smet, M. M., Desmet, M., & Meganck, R. (2021). Validity of data as precondition for evidence: A methodological analysis of what is taken to count as evidence in psychotherapy research. Philosophy Psychiatry & Psychology, 28(2), 115–128.CrossRef Truijens, F., De Smet, M. M., Desmet, M., & Meganck, R. (2021). Validity of data as precondition for evidence: A methodological analysis of what is taken to count as evidence in psychotherapy research. Philosophy Psychiatry & Psychology, 28(2), 115–128.CrossRef
go back to reference Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644.PubMedCrossRef Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644.PubMedCrossRef
go back to reference Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914.PubMedCrossRef Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914.PubMedCrossRef
Metadata
Title
Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions
Authors
Andrew A. McAleavey
Kim de Jong
Helene A. Nissen-Lie
James F. Boswell
Christian Moltu
Wolfgang Lutz
Publication date
08-02-2024
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2024
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-024-01351-9

Other articles of this Issue 3/2024

Administration and Policy in Mental Health and Mental Health Services Research 3/2024 Go to the issue