Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-05-2016 | Original Paper

Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): Training clinicians to Use Outcome Measures in Child Mental Health

Authors: Julian Edbrooke-Childs, Miranda Wolpert, Jessica Deighton

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2016

Abstract

Patient reported outcome measures (PROMs) are prevalent in child mental health services. In this point of view, we discuss our experience of training clinicians to use PROMs and to interpret and discuss feedback from measures. Findings from pre–post observational data from clinicians who attended either a 1- or 3-day training course showed that clinicians in both courses had more positive attitudes and higher levels of self-efficacy regarding administering measures and using feedback after training. We hope that this special issue will lead the way for future research on training clinicians to use outcome measures so that PROMs may be a source of clinically useful practice based evidence.

As the measure was developed in Australia, the word “client” was changed to “patient” and “consumer” to “service user” to make the items more applicable to clinicians in mental health services in England, without changing the meaning of the items.

The effects of the covariates were not significant in any of the ANCOVAs.

Abrines-Jaume, N., Midgley, N., Hopkins, K., Hoffman, J., Martin, K., Law, D., et al. (2014). A qualitative analysis of implementing shared decision making in child and adolescent mental health services in the United Kingdom: Stages and facilitators. Clinical Child Psychology and Psychiatry. doi:10.1177/1359104514547596.

Batty, M. J., Moldavsky, M., Foroushani, P. S., Pass, S., Marriott, M., Sayal, K., et al. (2013). Implementing routine outcome measures in child and adolescent mental health services: From present to future practice. Child and Adolescent Mental Health, 18(2), 82–87. doi:10.1111/j.1475-3588.2012.00658.x.CrossRef

Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Reimer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429.CrossRefPubMed

Black, N. (2013). Patient reported outcome measures could help transform healthcare. BMJ, 346(1), d167–f167. doi:10.1136/bmj.f167.CrossRef

Booth, A., Sutton, A., & Falzon, L. (2003). Working together: Supporting projects through action learning. Health Information and Libraries Journal, 20, 225–231.CrossRefPubMed

Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research. doi:10.1080/10503307.2013.817696.PubMed

Carlier, I. V. E., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18(1), 104–110. doi:10.1111/j.1365-2753.2010.01543.x.CrossRefPubMed

Chen, J., Ou, L., & Hollis, S. (2013). A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Services Research, 13(1), 211.CrossRefPubMedPubMedCentral

Children and Young People’s Improving Access to Psychological Therapies Programme. (2013). National curriculum for core, cognitive behavioural therapy, parenting training (3–10 year olds), systemic family practice, interpersonal psychotherapy for adolescents, supervision, and transformational service leadership. London: IAPT.

Childs, J. (2013). Masterclasses: Promoting excellence in evidence-based, outcomes informed practice and user participation for child mental health professionals. London: CAMHS Press.

de Jong, K. (2014). Deriving implementation strategies for outcome monitoring from theory, research and practice. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-014-0589-6.

de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474. doi:10.1080/10503307.2012.673023.CrossRefPubMed

Deighton, J., Croudace, T., Fonagy, P., Brown, J., Patalay, P., & Wolpert, M. (2014). Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: A review of child self-report measures. Child and Adolescent Psychiatry and Mental Health, 8(1), 14. doi:10.1186/1753-2000-8-14.CrossRefPubMedPubMedCentral

Demming, W. (1986). Out of the crisis. Cambridge, MA: Massachusetts Institute of Technology.

Department of Health. (2010). Equity and excellence: Liberating the NHS. Norwich: The Stationery Office.

Department of Health. (2011). Talking therapies: A four-year plan of action. London: Author.

Department of Health. (2012). IAPT three-year report: The first million patients. London: Author.

Douglas, S., Button, S., & Casey, S. E. (2014). Implementing for sustainability: Promoting use of a measurement feedback system for innovation and quality improvement. Administration and Policy in Mental Health and Mental Health Services Research.

Fleming, I., Jones, M., Bradley, J., & Wolpert, M. (2014). Learning from a learning collaboration: The CORC approach to combining research, evaluation and practice in child mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-014-0592-y.

Hall, C. L., Taylor, J., Moldavsky, M., Marriott, M., Pass, S., & Newell, K. (2014). A qualitative process evaluation of electronic session-by-session outcome measurement in child and adolescent mental health services. BMC Psychiatry, 14, 113.

Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35(5), 485–491. doi:10.1037/0735-7028.35.5.485.CrossRef

Hoenders, R. H. J., Bos, E. H., Bartels-Velthuis, A. A., Vollbehr, N. K., Ploeg, K., Jonge, P., et al. (2013). Pitfalls in the assessment, analysis, and interpretation of routine outcome monitoring (ROM) data: Results from an outpatient clinic for integrative mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-013-0511-7.

Institue of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press.

Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896. doi:10.1080/15374416.2010.517169.CrossRef

Johnston, C., & Gowers, S. (2005). Routine outcome measurement: A survey of UK child and adolescent mental health services. Child and Adolescent Mental Health, 10(3), 133–139. doi:10.1111/j.1475-3588.2005.00357.x.CrossRef

Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368. doi:10.1097/YCO.0b013e32832c9162.CrossRefPubMedPubMedCentral

Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15–22.CrossRefPubMed

Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79. doi:10.1037/a0022238.CrossRefPubMed

Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2006). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. doi:10.1093/clipsy.bpg025.

Law, D. (2012). A practical guide to using service user feedback and outcome tools to inform clinical practice in child and adolescent mental health. London: IAPT National Team.

Locke, E. A., & Latham, G. P. (1990). A theory of goal setting and task performance. Englewood Cliff, NH: Prentice-Hall.

Locke, E. A., & Latham, G. P. (2002). Buiding a practically useful theory of goal setting and task motivation: A 35 year odyssey. American Psychologist, 57, 705–717.CrossRefPubMed

Lohr, K. N., & Zebrack, B. J. (2009). Using patient-reported outcomes in clinical practice: Challenges and opportunities. Quality of Life Research, 18(1), 99–107. doi:10.1007/sl1136-008-9413.CrossRefPubMed

Meehan, T., McCombes, S., Hatzipetrou, L., & Catchpoole, R. (2006). Introduction of routine outcome measures: Staff reactions and issues for consideration. Journal of Psychiatric and Mental Health Nursing, 13(5), 581–587.CrossRefPubMed

Mellor-Clark, J., Barkham, M., Connell, J., & Evans, C. (1999). Practice-based evidence and strandardised evaluation: informing the design of the CORE system. European Journal of Psychotherapy Counselling and Health, 2, 357–374.CrossRef

Mellor-Clark, J., Cross, S., Macdonald, J., & Skjulsvik, T. (2014). Leading horses to water: Lessons from a decade of helping psychological therapy services use routine outcome measurement to improve practice. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-014-0587-8.

Michelson, D., Rock, S., Holliday, S., Murphy, E., Myers, G., Tilki, S., et al. (2011). Improving psychiatric diagnosis in multidisciplinary child and adolescent mental health services. The Psychiatrist, 35(12), 454–459. doi:10.1192/pb.bp.111.034066.CrossRef

National Quality Forum. (2013). Patient Reported Outcomes (PROs) in performance measurement. Washington, DC: National Quality Forum.

Norman, S., Dean, S., Hansford, L., & Ford, T. (2013). Clinical practitioner’s attitudes towards the use of Routine Outcome Monitoring within Child and Adolescent Mental Health Services: A qualitative study of two Child and Adolescent Mental Health Services. Clinical Child Psychology and Psychiatry. doi:10.1177/1359104513492348.PubMed

Prochaska, J., & DiClemente, C. (1983). Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology, 51, 390–395.CrossRefPubMed

Prochaska, J., DiClemente, C., & Norcross, J. (1992). In search of how people change: Applications to addictive behaviors. American Psychologist, 47, 1002–1114.CrossRef

Smith, P. C., & Street, A. D. (2013). On the uses of routine patient-reported health outcome data. Health Economics, 22(2), 119–131. doi:10.1002/hec.2793.CrossRefPubMed

Smith, S. R., Wiggins, C. M., & Gorske, T. T. (2007). A survey of psychological assessment feedback practices. Assessment, 14(3), 310–319.CrossRefPubMed

The Health Foundation. (2012). Quality improvement training for healthcare professionals. London: The Health Foundation.

Trauer, T., Pedwell, G., & Lisa, G. (2009). The effect of guidance in the use of routine outcome measures in clinical meetings. Australian Health Review, 33, 144–151.CrossRefPubMed

Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research, 12(1), 71–80. doi:10.1080/14733145.2011.565125.CrossRef

Walter, G., Cleary, M., & Rey, J. M. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18(2), 109–115.PubMed

Whipple, J. L., & Lambert, M. J. (2011). Outcome Measures for Practice. Annual Review of Clinical Psychology, 7(1), 87–111. doi:10.1146/annurev-clinpsy-040510-143938.CrossRefPubMed

Willis, A., Deane, F. P., & Coombs, T. (2009). Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. International Journal of Mental Health Nursing, 18, 211–215. doi:10.1111/j.1447-0349.2009.00596.x.CrossRefPubMed

Wolpert, M. (2013). Do patient reported outcome measures do more harm than good? BMJ, 346(1), f2669–f2669. doi:10.1136/bmj.f2669.CrossRefPubMed

Wolpert, M., Curtis-Tyler, K., & Edbrooke-Childs, J. (2014). A qualitative exploration of clinician and service user views on Patient Reported Outcome Measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-014-0586-9.

Wolpert, M., Ford, T., Trustam, E., Law, D., Deighton, J., Flannery, H., et al. (2012). Patient-reported outcomes in child and adolescent mental health services (CAMHS): Use of idiographic and standardized measures. Journal of Mental Health, 21(2), 165–173. doi:10.3109/09638237.2012.664304.CrossRefPubMed

Title: Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): Training clinicians to Use Outcome Measures in Child Mental Health
Authors: Julian Edbrooke-Childs
Miranda Wolpert
Jessica Deighton
Publication date: 01-05-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-014-0600-2

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): Training clinicians to Use Outcome Measures in Child Mental Health

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2016

Deriving Implementation Strategies for Outcome Monitoring Feedback from Theory, Research and Practice

Achieving Precision Mental Health through Effective Assessment, Monitoring, and Feedback Processes

Implementing for Sustainability: Promoting Use of a Measurement Feedback System for Innovation and Quality Improvement

When is Sessional Monitoring More Likely in Child and Adolescent Mental Health Services?

Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination

Challenges in the Implementation of Measurement Feedback Systems