Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 3/2016

Open Access 01-05-2016 | Commentary

Challenges in the Implementation of Measurement Feedback Systems

Author: Kim de Jong

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2016

Login to get access

Abstract

This commentary on the articles published in the special section on the development and implementation of measurement feedback systems (MFSs) discusses three challenging themes in the process of MFS implementation: design and planning, organizational context, and sustainability and unintended consequences. It is argued that the implementation of MFSs is complex, but is an important step in improving outcomes in routine care for children and young persons.
Literature
go back to reference Bickman, L., Douglas Kelley, S., Breda, C., De Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429. doi:10.1176/appi.ps.002052011.CrossRefPubMed Bickman, L., Douglas Kelley, S., Breda, C., De Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429. doi:10.​1176/​appi.​ps.​002052011.CrossRefPubMed
go back to reference Bickman, L., Douglas, S. R., De Andrade, A. R. V., Tomlinson, M., Gleacher, A., Olin, S., & Hoagwood, K. (2014). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0647-8. Bickman, L., Douglas, S. R., De Andrade, A. R. V., Tomlinson, M., Gleacher, A., Olin, S., & Hoagwood, K. (2014). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0647-8.
go back to reference Bruns, E. J., Hyde, K. L., Sather, A., Hook, A. N., & Lyon, A. R. (2015). Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0658-5. Bruns, E. J., Hyde, K. L., Sather, A., Hook, A. N., & Lyon, A. R. (2015). Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0658-5.
go back to reference Davidson, K., Perry, A., & Bell, L. (2014). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice, n/a-n/a. doi:10.1111/papt.12032. Davidson, K., Perry, A., & Bell, L. (2014). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice, n/a-n/a. doi:10.​1111/​papt.​12032.
go back to reference de Jong, K. (2014). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-014-0589-6. de Jong, K. (2014). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-014-0589-6.
go back to reference De Jong, K., & De Goede, M. (2015). Why do some therapists not deal with outcome monitoring feedback? A feasibility study on the effect of regulatory focus and person–organization fit on attitude and outcome. Psychotherapy Research, 25(6), 661–668. doi:10.1080/10503307.2015.1076198.CrossRef De Jong, K., & De Goede, M. (2015). Why do some therapists not deal with outcome monitoring feedback? A feasibility study on the effect of regulatory focus and person–organization fit on attitude and outcome. Psychotherapy Research, 25(6), 661–668. doi:10.​1080/​10503307.​2015.​1076198.CrossRef
go back to reference De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy research, 22(4), 464–474. doi:10.1080/10503307.2012.673023.CrossRefPubMed De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy research, 22(4), 464–474. doi:10.​1080/​10503307.​2012.​673023.CrossRefPubMed
go back to reference De Jong, K., Segaar, J., Van Ingenhoven, T., Busschbach, J. V., & Timman, R. Adverse effects of feedback in inpatients and day patients with personality disorders. Unpublished manuscript. De Jong, K., Segaar, J., Van Ingenhoven, T., Busschbach, J. V., & Timman, R. Adverse effects of feedback in inpatients and day patients with personality disorders. Unpublished manuscript.
go back to reference Dixon-Woods, M., McNicol, S., & Martin, G. (2012). Ten challenges in improving quality in healthcare: lessons from the Health Foundation’s programme evaluations and relevant literature. BMJ Quality & Safety. doi:10.1136/bmjqs-2011-000760. Dixon-Woods, M., McNicol, S., & Martin, G. (2012). Ten challenges in improving quality in healthcare: lessons from the Health Foundation’s programme evaluations and relevant literature. BMJ Quality & Safety. doi:10.​1136/​bmjqs-2011-000760.
go back to reference Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., et al. (2015). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0642-0. Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., et al. (2015). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0642-0.
go back to reference Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology and Psychotherapy: Science and Practice, 9(3), 329–343. doi:10.1093/clipsy.9.3.329. Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology and Psychotherapy: Science and Practice, 9(3), 329–343. doi:10.​1093/​clipsy.​9.​3.​329.
go back to reference Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241. doi:10.1176/appi.ps.201400141.CrossRefPubMed Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241. doi:10.​1176/​appi.​ps.​201400141.CrossRefPubMed
go back to reference Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61(3), 285–314. doi:10.1002/jclp.20084.CrossRefPubMed Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61(3), 285–314. doi:10.​1002/​jclp.​20084.CrossRefPubMed
go back to reference Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., & Shimokawa, K. (2004). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire) (3rd ed.). Wilmington, DE: American Professional Credentialling Services LLC. Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., & Shimokawa, K. (2004). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire) (3rd ed.). Wilmington, DE: American Professional Credentialling Services LLC.
go back to reference Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., et al. (2015). The contextualized technology adaptation process (CTAP): Optimizing health information technology to improve mental health systems. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0637-x.PubMedCentral Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., et al. (2015). The contextualized technology adaptation process (CTAP): Optimizing health information technology to improve mental health systems. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0637-x.PubMedCentral
go back to reference Nadeem, E., Cappella, E., Holland, S., Coccaro, C., & Crisonino, G. (2015). Development and piloting of a classroom-focused measurement feedback system. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0651-z. Nadeem, E., Cappella, E., Holland, S., Coccaro, C., & Crisonino, G. (2015). Development and piloting of a classroom-focused measurement feedback system. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0651-z.
go back to reference Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75(3), 255–261. doi:10.1016/j.jpsychores.2013.07.003.CrossRefPubMed Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75(3), 255–261. doi:10.​1016/​j.​jpsychores.​2013.​07.​003.CrossRefPubMed
go back to reference Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi:10.1037/a0019247.CrossRefPubMed Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi:10.​1037/​a0019247.CrossRefPubMed
go back to reference Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy research, 22(6), 638–647. doi:10.1080/10503307.2012.698918.CrossRefPubMed Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy research, 22(6), 638–647. doi:10.​1080/​10503307.​2012.​698918.CrossRefPubMed
go back to reference Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., & Hyer, K. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy research, 23(3), 287–300. doi:10.1080/10503307.2013.787497.CrossRefPubMed Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., & Hyer, K. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy research, 23(3), 287–300. doi:10.​1080/​10503307.​2013.​787497.CrossRefPubMed
go back to reference Steinfeld, B., Franklin, A., Mercer, B., Fraynt, R., & Simon, G. (2015). Progress monitoring in an integrated health care system: Tracking behavioral health vital signs. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0648-7.PubMed Steinfeld, B., Franklin, A., Mercer, B., Fraynt, R., & Simon, G. (2015). Progress monitoring in an integrated health care system: Tracking behavioral health vital signs. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-015-0648-7.PubMed
go back to reference Torrey, W., Bond, G., McHugo, G., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 353–364. doi:10.1007/s10488-011-0357-9.CrossRefPubMed Torrey, W., Bond, G., McHugo, G., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 353–364. doi:10.​1007/​s10488-011-0357-9.CrossRefPubMed
go back to reference Walter, G., Cleary, M., & Rey, J. M. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18(2), 109–115.PubMed Walter, G., Cleary, M., & Rey, J. M. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18(2), 109–115.PubMed
go back to reference Warren, J., Nelson, P., & Burlingame, G. (2009). Identifying youth at risk for treatment failure in outpatient community mental health services. Journal of Child and Family Studies, 18(6), 690–701. doi:10.1007/s10826-009-9275-9.CrossRef Warren, J., Nelson, P., & Burlingame, G. (2009). Identifying youth at risk for treatment failure in outpatient community mental health services. Journal of Child and Family Studies, 18(6), 690–701. doi:10.​1007/​s10826-009-9275-9.CrossRef
go back to reference Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Journal of Consulting and Clinical Psychology, 117(3), 450–469. doi:10.1037/0033-2909.117.3.450. Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Journal of Consulting and Clinical Psychology, 117(3), 450–469. doi:10.​1037/​0033-2909.​117.​3.​450.
Metadata
Title
Challenges in the Implementation of Measurement Feedback Systems
Author
Kim de Jong
Publication date
01-05-2016
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-015-0697-y

Other articles of this Issue 3/2016

Administration and Policy in Mental Health and Mental Health Services Research 3/2016 Go to the issue