Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 3/2016

01-05-2016 | Point of View

Leading Horses to Water: Lessons from a Decade of Helping Psychological Therapy Services Use Routine Outcome Measurement to Improve Practice

Authors: John Mellor-Clark, Simone Cross, James Macdonald, Tommy Skjulsvik

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2016

Login to get access

Abstract

We summarise the recent reflections of five thought leaders in the field of routine outcome measurement (ROM) for psychological therapy, and then add our own experience of introducing a national ROM system in the UK. We highlight, in particular, the post-implementation challenge of securing data of sufficient reliability to help inform service quality improvements. We ground our conclusions and recommendations in the rapidly evolving discipline of implementation science, and offer a best practice model for applying research recommendations in practice settings. In this context we portray ROM implementation as significant organizational change that benefits from rigorous process and clearly defined, well-communicated targets.
Literature
go back to reference Aarons, G. A., Hurlburt, M., & McCue Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy In Mental Health, 38, 4–23.CrossRefPubMedPubMedCentral Aarons, G. A., Hurlburt, M., & McCue Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy In Mental Health, 38, 4–23.CrossRefPubMedPubMedCentral
go back to reference Anker, M., Duncan, B., & Sparks, J. (2009). Using client feedback to improve couples therapy outcomes: A randomised clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704.CrossRefPubMed Anker, M., Duncan, B., & Sparks, J. (2009). Using client feedback to improve couples therapy outcomes: A randomised clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704.CrossRefPubMed
go back to reference Barkham, M., & Mellor-Clark, J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Journal of Clinical Psychology and Psychotherapy, 10, 319–327.CrossRef Barkham, M., & Mellor-Clark, J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Journal of Clinical Psychology and Psychotherapy, 10, 319–327.CrossRef
go back to reference Curtis-Tyler, K., Wolpert, M., & Edbrooke-Childs, J. (submitted). A qualitative exploration of clinicians and service user views on Patient Reported Outcome Measures in child mental health and diabetes services in the United Kingdom. Administration & Policy in Mental Health and Mental Health Services Research. Curtis-Tyler, K., Wolpert, M., & Edbrooke-Childs, J. (submitted). A qualitative exploration of clinicians and service user views on Patient Reported Outcome Measures in child mental health and diabetes services in the United Kingdom. Administration & Policy in Mental Health and Mental Health Services Research.
go back to reference Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health service research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.CrossRef Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health service research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.CrossRef
go back to reference de Jong, K. (submitted). Deriving effective implementation strategies for outcome monitoring from feedback theory. Administration and Policy in Mental Health. de Jong, K. (submitted). Deriving effective implementation strategies for outcome monitoring from feedback theory. Administration and Policy in Mental Health.
go back to reference de Jong, K., van Sluis, P., Nuger, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized controlled trial. Psychotherapy Research, 22, 464–474.CrossRefPubMed de Jong, K., van Sluis, P., Nuger, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized controlled trial. Psychotherapy Research, 22, 464–474.CrossRefPubMed
go back to reference Douglas, S., Button, S., & Casey, S. E. (submitted). Implementing for sustainability: Promoting use of a Measurement Feedback System for innovation and quality improvement. Administration and Policy in Mental Health. Douglas, S., Button, S., & Casey, S. E. (submitted). Implementing for sustainability: Promoting use of a Measurement Feedback System for innovation and quality improvement. Administration and Policy in Mental Health.
go back to reference Edbrooke-Childs, J., Wolpert, M., Deighton, J. (submitted). Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): A service evaluation of training for clinicians to use outcome measures in child mental health. Administration & Policy in Mental Health and Mental Health Services Research. Edbrooke-Childs, J., Wolpert, M., Deighton, J. (submitted). Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): A service evaluation of training for clinicians to use outcome measures in child mental health. Administration & Policy in Mental Health and Mental Health Services Research.
go back to reference Evans, C. (2012). Cautionary notes on power steering for psychotherapy. Canadian Psychology, 53(2), 131–139.CrossRef Evans, C. (2012). Cautionary notes on power steering for psychotherapy. Canadian Psychology, 53(2), 131–139.CrossRef
go back to reference Feldstein, A., & Glasgow, R. (2008). A practical robust implementation and sustainability model (PRISM). Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243.PubMed Feldstein, A., & Glasgow, R. (2008). A practical robust implementation and sustainability model (PRISM). Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243.PubMed
go back to reference Fleming, I., Jones, M., Bradley, J., & Wolpert, M. (submitted). Learning from a learning collaboration: the CORC approach to combining research, evaluation and practice in child mental health. Administration & Policy in Mental Health and Mental Health Services Research. Fleming, I., Jones, M., Bradley, J., & Wolpert, M. (submitted). Learning from a learning collaboration: the CORC approach to combining research, evaluation and practice in child mental health. Administration & Policy in Mental Health and Mental Health Services Research.
go back to reference Green, D., & Latchford, G. (2012). Maximising the Benefits of Psychotherapy: A Practice-Based Evidence Approach. Chichester: John Wiley & Sons.CrossRef Green, D., & Latchford, G. (2012). Maximising the Benefits of Psychotherapy: A Practice-Based Evidence Approach. Chichester: John Wiley & Sons.CrossRef
go back to reference Griffiths, S., Foster, J., Steen, S., & Pietroni, P. (2013). Mental health’s market experiment: Commissioning Psychological Therapies Through Any Qualified Provider. Chester: Centre for Psychological Therapies in Primary Care. Griffiths, S., Foster, J., Steen, S., & Pietroni, P. (2013). Mental health’s market experiment: Commissioning Psychological Therapies Through Any Qualified Provider. Chester: Centre for Psychological Therapies in Primary Care.
go back to reference Kraus, D. R., Seligman, D., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings. The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285–314. doi:10.1002/jclp.20084.CrossRefPubMed Kraus, D. R., Seligman, D., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings. The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285–314. doi:10.​1002/​jclp.​20084.CrossRefPubMed
go back to reference Lambert, M. (2010). Prevention of Treatment Failure: The Use of Measuring, Monitoring, and Feedback in Clinical Practice. Washington, DC: APA.CrossRef Lambert, M. (2010). Prevention of Treatment Failure: The Use of Measuring, Monitoring, and Feedback in Clinical Practice. Washington, DC: APA.CrossRef
go back to reference Lambert, M. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behaviour Change (6th ed., pp. 169–218). Hoboken, NJ: John Wiley & Sons. Lambert, M. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behaviour Change (6th ed., pp. 169–218). Hoboken, NJ: John Wiley & Sons.
go back to reference Lambert, M., & Shimokawa, K. (2011). Collecting Client Feedback. In J. Norcross (Ed.), Psychotherapy Relationships that Work: Evidence-based responsiveness (2nd ed., pp. 203–223). New York: Oxford University Press.CrossRef Lambert, M., & Shimokawa, K. (2011). Collecting Client Feedback. In J. Norcross (Ed.), Psychotherapy Relationships that Work: Evidence-based responsiveness (2nd ed., pp. 203–223). New York: Oxford University Press.CrossRef
go back to reference Mellor-Clark, J., & Barkham, M. (2006). The CORE System: Developing and delivering practice-based evidence through quality evaluation. In C. Feltham & I. Horton (Eds.), Handbook of Counselling and Psychotherapy (2nd ed.). London: Sage Publications. Mellor-Clark, J., & Barkham, M. (2006). The CORE System: Developing and delivering practice-based evidence through quality evaluation. In C. Feltham & I. Horton (Eds.), Handbook of Counselling and Psychotherapy (2nd ed.). London: Sage Publications.
go back to reference Mellor-Clark, J., Curtis Jenkins, A., Evans, R., Mothersole, G., & McIness, B. (2006). Resourcing a CORE Network to develop a National Research Database to help enhance psychological therapy and counselling service provision. Counselling & Psychotherapy Research, 6, 16–22.CrossRef Mellor-Clark, J., Curtis Jenkins, A., Evans, R., Mothersole, G., & McIness, B. (2006). Resourcing a CORE Network to develop a National Research Database to help enhance psychological therapy and counselling service provision. Counselling & Psychotherapy Research, 6, 16–22.CrossRef
go back to reference Meyers, D. C., Durlack, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480.CrossRefPubMed Meyers, D. C., Durlack, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480.CrossRefPubMed
go back to reference Shimokawa, K., Lambert, M., & Smart, D. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311.CrossRefPubMed Shimokawa, K., Lambert, M., & Smart, D. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311.CrossRefPubMed
go back to reference Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies as practiced in National Health Service settings. Psychological Medicine, 36, 555–566.CrossRefPubMed Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies as practiced in National Health Service settings. Psychological Medicine, 36, 555–566.CrossRefPubMed
go back to reference Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677–688.PubMed Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677–688.PubMed
go back to reference van Oenen, F. J., Schipper, S., Van, R., Schoevers, R., Visch, I., Peen, J., et al. (2013). Efficacy of immediate patient feedback in emergency psychiatry: A randomized controlled trail in a crisis intervention and brief therapy team. BMC Psychiatry, 13, 331–342.CrossRefPubMedPubMedCentral van Oenen, F. J., Schipper, S., Van, R., Schoevers, R., Visch, I., Peen, J., et al. (2013). Efficacy of immediate patient feedback in emergency psychiatry: A randomized controlled trail in a crisis intervention and brief therapy team. BMC Psychiatry, 13, 331–342.CrossRefPubMedPubMedCentral
go back to reference Wolpert, M. (2014). Uses and abuses of Patient Reported Outcome Measures (PROMs): Potential iatrogenic impact of PROMs implementation and how it can be mitigated. Administration and Policy in Mental Health and Mental Health Services Research, 41, 141–145. Wolpert, M. (2014). Uses and abuses of Patient Reported Outcome Measures (PROMs): Potential iatrogenic impact of PROMs implementation and how it can be mitigated. Administration and Policy in Mental Health and Mental Health Services Research, 41, 141–145.
go back to reference Wolpert, M., Fugard, A. J. B., Deighton, J., & Gorzig, A. (2012). Routine outcomes monitoring as part of children and young person’s Improving Access to Psychological Therapies (CYP IAPT)—improving care or unhelpful burden? Childs and Adolescent Mental Health, 17(3), 129–130.CrossRef Wolpert, M., Fugard, A. J. B., Deighton, J., & Gorzig, A. (2012). Routine outcomes monitoring as part of children and young person’s Improving Access to Psychological Therapies (CYP IAPT)—improving care or unhelpful burden? Childs and Adolescent Mental Health, 17(3), 129–130.CrossRef
Metadata
Title
Leading Horses to Water: Lessons from a Decade of Helping Psychological Therapy Services Use Routine Outcome Measurement to Improve Practice
Authors
John Mellor-Clark
Simone Cross
James Macdonald
Tommy Skjulsvik
Publication date
01-05-2016
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-014-0587-8

Other articles of this Issue 3/2016

Administration and Policy in Mental Health and Mental Health Services Research 3/2016 Go to the issue