Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-05-2016 | Original Article

Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review

Authors: Dawid Gondek, Julian Edbrooke-Childs, Elian Fink, Jessica Deighton, Miranda Wolpert

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2016

Abstract

Due to recent increases in the use of feedback from outcome measures in mental health settings, we systematically reviewed evidence regarding the impact of feedback from outcome measures on treatment effectiveness, treatment efficiency, and collaborative practice. In over half of 32 studies reviewed, the feedback condition had significantly higher levels of treatment effectiveness on at least one treatment outcome variable. Feedback was particularly effective for not-on-track patients or when it was provided to both clinicians and patients. The findings for treatment efficiency and collaborative practice were less consistent. Given the heterogeneity of studies, more research is needed to determine when and for whom feedback is most effective.

Available only for authorised users

Ackerman, S. J., & Hilsenroth, M. J. (2003). A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review, 23(1), 1–33. doi:10.1016/S0272-7358(02)00146-0.CrossRefPubMed

American Psychiatric Association. (2000). Diagnostic criteria from DSM-IV-TR. Washington, DC: American Psychiatric Association.

American Psychiatric Association. (2015). Understanding mental disorders: your guide to DSM-5 (1st ed.). Washington, DC: American Psychiatric Association.

Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693–704. doi:10.1037/a0016062.CrossRefPubMed

Ashaye, O. A., Livingston, G., & Orrell, M. W. (2003). Does standardized needs assessment improve the outcome of psychiatric day hospital care for older people? A randomized controlled trial. Aging & Mental Health, 7(3), 195–199.CrossRef

Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62(12), 1423–1429. doi:10.1176/appi.ps.002052011.CrossRefPubMed

Brodey, B. B., Cuffel, B., McCulloch, J., Tani, S., Maruish, M., Brodey, I., & Unützer, J. (2005). The acceptability and effectiveness of patient-reported assessments and feedback in a managed behavioral healthcare setting. American Journal of Managed Care, 11(12), 774–780.PubMed

Byrne, S. L., Hooke, G. R., Newnham, E. A., & Page, A. C. (2012). The effects of progress monitoring on subsequent readmission to psychiatric care: A six-month follow-up. Journal of Affective Disorders, 137(1–3), 113–116. doi:10.1016/j.jad.2011.12.005.CrossRefPubMed

Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18(1), 104–110. doi:10.1111/j.1365-2753.2010.01543.x.CrossRefPubMed

Carman, K. L., Dardess, P., Maurer, M., Sofaer, S., Adams, K., Bechtel, C., & Sweeney, J. (2013). Patient and family engagement: A framework for understanding the elements and developing interventions and policies. Health Affairs, 32(2), 223–231. doi:10.1377/hlthaff.2012.113332/2/223.CrossRefPubMed

Centre for Reviews and Dissemination. (2009). Systematic reviews: CRD’s guidance for undertaking reviews in healthcare. York: University of York.

Chen, J., Ou, L., & Hollis, S. J. (2013). A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Services Research, 13, 211. doi:10.1186/1472-6963-13-211.CrossRefPubMedPubMedCentral

Cisneros, E. P. (2010). Client/therapist feedback and the role of the alliance on psychotherapy outcomes. Unpublished doctoral dissertation, Loma Linda University, Ann Arbor, Ml.

Copeland, B. T. (2007). Outcome and process measure feedback as they effect therapy outcomes. Unpublished doctoral dissertation. George Fox University, Newberg, OR.

de Jong, K. (2014). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health,. doi:10.1007/s10488-014-0589-6.

de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474. doi:10.1080/10503307.2012.673023.CrossRefPubMed

Desroches, S., Lapointe, A., Deschenes, S. M., Gagnon, M. P., & Legare, F. (2011). Exploring dietitians’ salient beliefs about shared decision-making behaviors. Implementation Science, 6, 57. doi:10.1186/1748-5908-6-57.CrossRefPubMedPubMedCentral

Duncan, E. A., & Murray, J. (2012). The barriers and facilitators to routine outcome measurement by allied health professionals in practice: A systematic review. BMC Health Services Research, 12, 96. doi:10.1186/1472-6963-12-96.CrossRefPubMedPubMedCentral

Elwyn, G., Frosch, D., Thomson, R., Joseph-Williams, N., Lloyd, A., Kinnersley, P., & Barry, M. (2012). Shared decision making: A model for clinical practice. Journal of General Internal Medicine, 27(10), 1361–1367. doi:10.1007/s11606-012-2077-6.CrossRefPubMedPubMedCentral

Galvinhill, P. R. (2001). The effects of providing feedback regarding client symptomatology on psychotherapy outcome. Unpublished doctoral dissertation, University of Cincinnati, Ann Arbor, MI.

Garfield, S. L. (1994). Research on client variables. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change. New York: Wiley.

Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routinely administered questionnaires for depression and anxiety: Systematic review. BMJ, 322(7283), 406–409. doi:10.1136/bmj.322.7283.406.CrossRefPubMedPubMedCentral

Greenhalgh, J., Abhyankar, P., McCluskey, S., Takeuchi, E., & Velikova, G. (2013). How do doctors refer to patient-reported outcome measures (PROMS) in oncology consultations? Quality of Life Research, 22(5), 939–950. doi:10.1007/s11136-012-0218-3.CrossRefPubMed

Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research, 17(4), 379–392.CrossRef

Hawkins, E. J. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14(3), 308–327. doi:10.1093/ptr/kph027.CrossRef

Higgins, J., Altman, D., Gotzsche, P., Juni, P., Moher, D., Oxman, A., & Sterne, J. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ, 343, d5928. doi:10.1136/bmj.d5928.CrossRefPubMedPubMedCentral

Higgins, J. P. T., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions. Retrieved July 20th, 2014, from www.cochrane-handbook.org

Jones, G. M., & Delany, T. (2014). What does collaborative practice mean within mental healthcare? A qualitative study exploring understandings and proposing a definition. Journal of Research in Interprofessional Practice and Education, 3, 1–15.

Joosten, E. A., De Jong, C. A., de Weert-van Oene, G. H., Sensky, T., & van der Staak, C. P. (2011). Shared decision-making: Increases autonomy in substance-dependent patients. Substance Use and Misuse, 46(8), 1037–1038. doi:10.3109/10826084.2011.552931.CrossRefPubMed

Kluger, A. N., & De Nisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. doi:10.1037/0033-2909.119.2.254.CrossRef

Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. British Journal of Psychiatry, 195(1), 15–22. doi:10.1192/bjp.bp.108.053967.CrossRefPubMed

Lambert, M., Whipple, J., Hawkins, E., Vermeersch, D., Nielsen, S., & Smart, D. (2003). Is it time for clinicians to routinely track patient outcome? A meta-Analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. doi:10.1093/clipsy.bpg025.

Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11(1), 49–68.CrossRefPubMed

Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002). Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Clinical Psychology & Psychotherapy, 9(2), 91–103. doi:10.1002/cpp.324.CrossRef

Lester, M. C. (2012). The effectiveness of client feedback measures with adolescents in an acute psychiatric inpatient setting. Unpublished doctoral dissertation, University of Central Arkansas, Conway, AR.

Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: A structured review. Journal of Evaluation in Clinical Practice, 12(5), 559–568. doi:10.1111/j.1365-2753.2006.00650.x.CrossRefPubMed

Marshall, M., Lockwood, A., Green, G., Zajac-Roles, G., Roberts, C., & Harrison, G. (2004). Systematic assessments of need and care planning in severe mental illness. Cluster randomised controlled trial. British Journal of Psychiatry, 185, 163–168.CrossRefPubMed

Michie, S., McCaffery, K., & Henegan, C. (2008). Monitoring as a learning and motivational tool. In P. Glasziou, L. Irwig, & J. K. Aronson (Eds.), Evidence-based medical monitoring: from principles to practice (pp. 123–139). Oxford: Blackwell Publishing Ltd.CrossRef

Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology, 62(10), 1006–1012. doi:10.1016/j.jclinepi.2009.06.005.CrossRefPubMed

Murphy, K. P., Rashleigh, C. M., & Timulak, L. (2012). The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial. Counselling Psychology Quarterly, 25(1), 1–18. doi:10.1080/09515070.2012.662349.CrossRef

Newnham, E. A., Hooke, G. R., & Page, A. C. (2010). Progress monitoring and feedback in psychiatric care reduces depressive symptoms. Journal of Affective Disorders, 127(1–3), 139–146. doi:10.1016/j.jad.2010.05.003.CrossRefPubMed

Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M.,… Duffy, S. (2006). Guidance on the conduct of narrative synthesis in systematic reviews. A Product from the ESRC Methods Programme.

Priebe, S., McCabe, R., Bullenkamp, J., Hansson, L., Lauber, C., Martinez-Leal, R., & Wright, D. J. (2007). Structured patient-clinician communication and 1-year outcome in communitymental healthcare. Cluster randomised controlled trial. British Journal of Psychiatry,. doi:10.1192/bjp.bp.107.036939.

Probst, T., Lambert, M. J., Dahlbender, R. W., Loew, T. H., & Tritt, K. (2014). Providing patient progress feedback and clinical support tools to therapists: Is the therapeutic process of patients on-track to recovery enhanced in psychosomatic in-patient therapy under the conditions of routine practice? Journal of Psychosomatic Research, 76(6), 477–484. doi:10.1016/j.jpsychores.2014.03.010.CrossRefPubMed

Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Gollner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75(3), 255–261. doi:10.1016/j.jpsychores.2013.07.003.CrossRefPubMed

Puschner, B., Schofer, D., Knaup, C., & Becker, T. (2009). Outcome management in in-patient psychiatric care. Acta Psychiatrica Scandinavica, 120(4), 308–319. doi:10.1111/j.1600-0447.2009.01397.x.CrossRefPubMed

Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009a). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy, 46(4), 418–431. doi:10.1037/a0017901.CrossRefPubMed

Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy, 47(4), 616–630. doi:10.1037/a0021182.CrossRefPubMed

Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009b). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and Education in Professional Psychology, 3(3), 157–168. doi:10.1037/a0015673.CrossRef

Reeves, E. K. (2009). The use of psychotherapy feedback on client progress: Implications for training and clinical practice. New York: New York University.

Rennie, D. (2001). CONSORT revised—improving the reporting of randomized trials. JAMA, 285, 2006–2007.CrossRefPubMed

Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child & Adolescent Psychiatric Clinics of North America, 14(2), 241–254. doi:10.1016/j.chc.2004.05.002

Rise, M. B., Eriksen, L., Grimstad, H., & Steinsbekk, A. (2012). The short-term effect on alliance and satisfaction of using patient feedback scales in mental health out-patient treatment. A randomised controlled trial. BMC Health Services Research, 12, 348. doi:10.1186/1472-6963-12-348.CrossRefPubMedPubMedCentral

Rothwell, P. M., McDowell, Z., Wong, C. K., & Dorman, P. J. (1997). Doctors and patients don’t agree: Cross sectional study of patients’ and doctors’ perceptions and assessments of disability in multiple sclerosis. BMJ, 314(7094), 1580–1583.CrossRefPubMedPubMedCentral

Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology, 61(2), 145–153. doi:10.1002/jclp.20107.CrossRefPubMed

Scheier, M. F., & Carver, C. S. (2003). Goals and confidence as self-regulatory elements underlying health and illness behaviour. In L. D. Cameron & H. Leventhal (Eds.), Goals and confidence as self-regulatory elements underlying health and illness behaviour. London: Taylor Francis.

Schmidt, U., Landau, S., Pombo-Carril, M. G., Bara-Carril, N., Reid, Y., Murray, K., & Katzman, M. (2006). Does personalized feedback improve the outcome of cognitive-behavioural guided self-care in bulimia nervosa? A preliminary randomized controlled trial. British Journal of Clinical Psychology, 45(Pt 1), 111–121. doi:10.1348/014466505X29143.CrossRefPubMed

Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., Hyer, K., & Berrett, M. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research, 23(3), 287–300. doi:10.1080/10503307.2013.787497.CrossRefPubMed

Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22(6), 638–647. doi:10.1080/10503307.2012.698918.CrossRefPubMed

Slade, K. (2008). Improving psychotherapy outcome: the use of immediate electronic feedback and revised clinical support tools. Unpublished doctoral dissertation, Brigham Young University, Provo.

Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy, 15(5), 287–303. doi:10.1002/cpp.594.CrossRef

Soeken, D. R., Manderscheid, R. W., Flatter, C. H., & Silbergeld, S. (1981). A controlled study of quantitative feedback in married-couples brief group psychotherapy. Psychotherapy Theory Research & Practice, 18(2), 204–216. doi:10.1037/h0086081.CrossRef

Thomson, R. G., Eccles, M. P., Steen, I. N., Greenaway, J., Stobbart, L., Murtagh, M. J., & May, C. R. (2007). A patient decision aid to support shared decision-making on anti-thrombotic treatment of patients with atrial fibrillation: Randomised controlled trial. Quality & Safety in Health Care, 16(3), 216–223. doi:10.1136/qshc.2006.018481.CrossRef

Trudeau, L. S. (2000). Effects of a clinical feedback system on client and therapist outcomes in a rural community mental health center. Unpublished doctoral dissertation, Iowa State University, Ames.

Truitt, K. G. (2011). Modeling treatment outcomes in eating disorders. Unpublished doctoral dissertation, Loma Linda University, Ann Arbor, MI.

Valderas, J. M., Kotzeva, A., Espallargues, M., Guyatt, G., Ferrans, C. E., Halyard, M. Y., & Alonso, J. (2008). The impact of measuring patient-reported outcomes in clinical practice: A systematic review of the literature. Quality of Life Research, 17(2), 179–193. doi:10.1007/s11136-007-9295-0.CrossRefPubMed

van Sonsbeek, M. A., Hutschemaekers, G. G., Veerman, J. W., & Tiemens, B. B. (2014). Effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care: Study protocol of a three-arm parallel-group randomized controlled trial. BMC Psychiatry, 14, 3. doi:10.1186/1471-244X-14-3.CrossRefPubMedPubMedCentral

Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50(1), 59–68. doi:10.1037/0022-0167.50.1.59.CrossRef

Wilson, S. R., Strub, P., Buist, A. S., Knowles, S. B., Lavori, P. W., Lapidus, J., & Vollmer, W. M. (2010). Shared treatment decision making improves adherence and outcomes in poorly controlled asthma. American Journal of Respiratory and Critical Care Medicine, 181(6), 566–577. doi:10.1164/rccm.200906-0907OC.CrossRefPubMedPubMedCentral

World Health Organization. (1992). The ICD-10 classification of mental and behavioural disorders: Clinical descriptions and diagnostic guidelines. Geneva: World Health Organization.

Title: Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review
Authors: Dawid Gondek
Julian Edbrooke-Childs
Elian Fink
Jessica Deighton
Miranda Wolpert
Publication date: 01-05-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-015-0710-5

ACC 2024 Congress

Springer Medicine

Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review

Abstract

ACC 2024 Congress

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2016

Learning from a Learning Collaboration: The CORC Approach to Combining Research, Evaluation and Practice in Child Mental Health

At the Intersection of Health Information Technology and Decision Support: Measurement Feedback Systems…and Beyond

Leading Horses to Water: Lessons from a Decade of Helping Psychological Therapy Services Use Routine Outcome Measurement to Improve Practice

Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination

A Qualitative Exploration of Patient and Clinician Views on Patient Reported Outcome Measures in Child Mental Health and Diabetes Services

Progress Monitoring in an Integrated Health Care System: Tracking Behavioral Health Vital Signs