Skip to main content
Top
Published in: BMC Psychiatry 1/2013

Open Access 01-12-2013 | Research article

The use of routine outcome measures in two child and adolescent mental health services: a completed audit cycle

Authors: Charlotte L Hall, Maria Moldavsky, Laurence Baldwin, Michael Marriott, Karen Newell, John Taylor, Kapil Sayal, Chris Hollis

Published in: BMC Psychiatry | Issue 1/2013

Login to get access

Abstract

Background

Routine outcome measurement (ROM) is important for assessing the clinical effectiveness of health services and for monitoring patient outcomes. Within Child and Adolescent Mental Health Services (CAMHS) in the UK the adoption of ROM in CAMHS has been supported by both national and local initiatives (such as government strategies, local commissioning policy, and research).

Methods

With the aim of assessing how these policies and initiatives may have influenced the uptake of ROM within two different CAMHS we report the findings of two case-note audits: a baseline audit conducted in January 2011 and a re-audit conducted two years later in December 2012-February 2013.

Results

The findings show an increase in both the single and repeated use of outcome measures from the time of the original audit, with repeated use (baseline and follow-up) of the Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA) scale increasing from 10% to 50% of cases. Re-audited case-notes contained more combined use of different outcome measures, with greater consensus on which measures to use. Outcome measures that were applicable across a wide range of clinical conditions were more likely to be used than symptom-specific measures, and measures that were completed by the clinician were found more often than measures completed by the service user.

Conclusions

The findings show a substantial improvement in the use of outcome measures within CAMHS. These increases in use were found across different service organisations which were subject to different types of local service priorities and drivers.
Appendix
Available only for authorised users
Literature
1.
go back to reference Department of Health: The NHS Outcome Framework 2011/12. 2010, London: The NHS Outcome Framework 2011/12 Department of Health: The NHS Outcome Framework 2011/12. 2010, London: The NHS Outcome Framework 2011/12
2.
go back to reference Department of Health: National service framework for children, young people and maternity services: the mental health and psychological well-being of children and young people: standard - 9. Development of methods to capture users’ views of child and adolescent mental health services in clinical governance reviews (Project evaluation report). Edited by: DoH. 2007, http://www.corc.uk.net/wp…/CHI-evaluation-report-Attride-Stirling-J1.pdf. Accessed 26 July 2012 Department of Health: National service framework for children, young people and maternity services: the mental health and psychological well-being of children and young people: standard - 9. Development of methods to capture users’ views of child and adolescent mental health services in clinical governance reviews (Project evaluation report). Edited by: DoH. 2007, http://​www.​corc.​uk.​net/​wp…/​CHI-evaluation-report-Attride-Stirling-J1.​pdf. Accessed 26 July 2012
3.
go back to reference Goodman R: The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997, 38: 581-586. 10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed Goodman R: The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997, 38: 581-586. 10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed
4.
go back to reference Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S: A childrens global assessment scale (CGAS). Arch Gen Psychiatry. 1983, 40: 1228-1231. 10.1001/archpsyc.1983.01790100074010.CrossRefPubMed Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S: A childrens global assessment scale (CGAS). Arch Gen Psychiatry. 1983, 40: 1228-1231. 10.1001/archpsyc.1983.01790100074010.CrossRefPubMed
5.
go back to reference Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R: Brief scale for measuring the outcomes of emotional and behavioural disorders in children - health of the nation outcome scales for children and adolescents (HoNOSCA). Br J Psychiatry. 1999, 174: 413-416. 10.1192/bjp.174.5.413.CrossRefPubMed Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R: Brief scale for measuring the outcomes of emotional and behavioural disorders in children - health of the nation outcome scales for children and adolescents (HoNOSCA). Br J Psychiatry. 1999, 174: 413-416. 10.1192/bjp.174.5.413.CrossRefPubMed
6.
go back to reference Attride-Stirling J: Development of methods to capture users’ views of child and adolescent mental health services in clinical governance reviews (Project evaluation report). 2003 Attride-Stirling J: Development of methods to capture users’ views of child and adolescent mental health services in clinical governance reviews (Project evaluation report). 2003
8.
go back to reference Chorpita BF, Yim L, Moffitt C, Umemoto LA, Francis SE: Assessment of symptoms of DSM-IV anxiety and depression in children: a revised child anxiety and depression scale. Behav Res Ther. 2000, 38: 835-855. 10.1016/S0005-7967(99)00130-8.CrossRefPubMed Chorpita BF, Yim L, Moffitt C, Umemoto LA, Francis SE: Assessment of symptoms of DSM-IV anxiety and depression in children: a revised child anxiety and depression scale. Behav Res Ther. 2000, 38: 835-855. 10.1016/S0005-7967(99)00130-8.CrossRefPubMed
9.
go back to reference Miller SD, Duncan BL: The Outcome Rating Scale. 2000, Chicago, IL Miller SD, Duncan BL: The Outcome Rating Scale. 2000, Chicago, IL
10.
go back to reference Johnson LD, Miller SD, Duncan BL: The Session Rating Scale 30. 2000, Chicago Johnson LD, Miller SD, Duncan BL: The Session Rating Scale 30. 2000, Chicago
11.
go back to reference Johnston C, Gowers S: Routine outcome measurement: a survey of UK child and adolescent mental health services. Child Adolesc Mental Health. 2005, 10: 133-139. 10.1111/j.1475-3588.2005.00357.x.CrossRef Johnston C, Gowers S: Routine outcome measurement: a survey of UK child and adolescent mental health services. Child Adolesc Mental Health. 2005, 10: 133-139. 10.1111/j.1475-3588.2005.00357.x.CrossRef
12.
go back to reference Baruch G, Vrouva I: Collecting routine outcome data in a psychotherapy community clinic for young people: findings from an ongoing study. Child Adolesc Mental Health. 2010, 15: 30-36. 10.1111/j.1475-3588.2009.00531.x.CrossRef Baruch G, Vrouva I: Collecting routine outcome data in a psychotherapy community clinic for young people: findings from an ongoing study. Child Adolesc Mental Health. 2010, 15: 30-36. 10.1111/j.1475-3588.2009.00531.x.CrossRef
13.
go back to reference Batty M, Moldavsky M, Pass S, Foroushani PS, Marriot M, Sayal K, Hollis C: Implementing routine outcome measures in child and adolescent mental health services: from present to future practice. Child Adolesc Mental Health. doi:10.1111/j.1475-3588.2012.00658.x Batty M, Moldavsky M, Pass S, Foroushani PS, Marriot M, Sayal K, Hollis C: Implementing routine outcome measures in child and adolescent mental health services: from present to future practice. Child Adolesc Mental Health. doi:10.1111/j.1475-3588.2012.00658.x
14.
go back to reference Hatfield DR, Ogles BM: The use of outcome measures by psychologists in clinical practice. Prof Psychol Res Pract. 2004, 35: 485-491.CrossRef Hatfield DR, Ogles BM: The use of outcome measures by psychologists in clinical practice. Prof Psychol Res Pract. 2004, 35: 485-491.CrossRef
15.
go back to reference Hatfield DR, Ogles B: Why some clinicians use outcome measures and others do not. Administration and Policy in Mental Health and Mental Health Service Research. 2007, 34: 283-291. 10.1007/s10488-006-0110-y.CrossRef Hatfield DR, Ogles B: Why some clinicians use outcome measures and others do not. Administration and Policy in Mental Health and Mental Health Service Research. 2007, 34: 283-291. 10.1007/s10488-006-0110-y.CrossRef
16.
go back to reference Close-Goedjen JL, Saunders SM: The effect of technical support on clinician attitudes toward an outcome assessment instrument. J Behav Heal Serv Res. 2002, 29: 99-108. 10.1007/BF02287837.CrossRef Close-Goedjen JL, Saunders SM: The effect of technical support on clinician attitudes toward an outcome assessment instrument. J Behav Heal Serv Res. 2002, 29: 99-108. 10.1007/BF02287837.CrossRef
17.
go back to reference Willis A, Deane FP, Coombs T: Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. Int J Ment Health Nurs. 2009, 18: 211-215. 10.1111/j.1447-0349.2009.00596.x.CrossRefPubMed Willis A, Deane FP, Coombs T: Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. Int J Ment Health Nurs. 2009, 18: 211-215. 10.1111/j.1447-0349.2009.00596.x.CrossRefPubMed
18.
go back to reference Garralda E, Yates P: HoNOSCA: uses and limitations. Child Psychol Psychiatr Rev. 2000, 5: 131-132. 10.1017/S1360641700002306.CrossRef Garralda E, Yates P: HoNOSCA: uses and limitations. Child Psychol Psychiatr Rev. 2000, 5: 131-132. 10.1017/S1360641700002306.CrossRef
19.
go back to reference Bickman L: A measurement feedback system (MFS) is necessary to improve mental health outcomes. J Am Acad Child Adolesc Psychiatry. 2008, 47: 1114-1119. 10.1097/CHI.0b013e3181825af8.CrossRefPubMed Bickman L: A measurement feedback system (MFS) is necessary to improve mental health outcomes. J Am Acad Child Adolesc Psychiatry. 2008, 47: 1114-1119. 10.1097/CHI.0b013e3181825af8.CrossRefPubMed
20.
go back to reference Martin A-M, Fishman R, Baxter L, Ford T: Practitioners’ attitudes towards the use of standardized diagnostic assessment in routine practice: a qualitative study in two child and adolescent mental health services. Clin Child Psychol Psychiatry. 2011, 16: 407-420. 10.1177/1359104510366284.CrossRefPubMed Martin A-M, Fishman R, Baxter L, Ford T: Practitioners’ attitudes towards the use of standardized diagnostic assessment in routine practice: a qualitative study in two child and adolescent mental health services. Clin Child Psychol Psychiatry. 2011, 16: 407-420. 10.1177/1359104510366284.CrossRefPubMed
21.
go back to reference Conners C: Rating scales for use in drug studies with children. Psychopharmacology Bulletin [special issue on children]. 1973, 9: 24-42. Conners C: Rating scales for use in drug studies with children. Psychopharmacology Bulletin [special issue on children]. 1973, 9: 24-42.
22.
go back to reference Gowers S, Levine W, Bailey-Rogers S, Shore A, Burhouse E: Use of a rotuine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health servies. Br J Psychiatry. 2002, 180: 266-269. 10.1192/bjp.180.3.266.CrossRefPubMed Gowers S, Levine W, Bailey-Rogers S, Shore A, Burhouse E: Use of a rotuine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health servies. Br J Psychiatry. 2002, 180: 266-269. 10.1192/bjp.180.3.266.CrossRefPubMed
23.
go back to reference Garland AF, Kruse M, Aarons GA: Clinicians and outcome measurement: what’s the use?. J Behav Health Serv Res. 2003, 30: 393-405. 10.1007/BF02287427.CrossRefPubMed Garland AF, Kruse M, Aarons GA: Clinicians and outcome measurement: what’s the use?. J Behav Health Serv Res. 2003, 30: 393-405. 10.1007/BF02287427.CrossRefPubMed
24.
go back to reference Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.CrossRefPubMed Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.CrossRefPubMed
25.
go back to reference Goodman R, Scott S: Comparing the strengths and difficulties questionnaire and the child behavior checklist: is small beautiful?. J Abnorm Child Psychol. 1999, 27: 17-24. 10.1023/A:1022658222914.CrossRefPubMed Goodman R, Scott S: Comparing the strengths and difficulties questionnaire and the child behavior checklist: is small beautiful?. J Abnorm Child Psychol. 1999, 27: 17-24. 10.1023/A:1022658222914.CrossRefPubMed
26.
go back to reference Goodman R: The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry. 1999, 40: 791-799. 10.1111/1469-7610.00494.CrossRefPubMed Goodman R: The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry. 1999, 40: 791-799. 10.1111/1469-7610.00494.CrossRefPubMed
27.
go back to reference Barkham M, Margison F, Leach C, Lucock M, Mellor-Clark J, Evans C, Benson L, Connell J, Audin K, McGrath G: Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. J Consult Clin Psychol. 2001, 69: 184-196.CrossRefPubMed Barkham M, Margison F, Leach C, Lucock M, Mellor-Clark J, Evans C, Benson L, Connell J, Audin K, McGrath G: Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. J Consult Clin Psychol. 2001, 69: 184-196.CrossRefPubMed
28.
go back to reference Ford T, Tingay T, Wolpert M, Group CS: CORC’s Survey of routine outcome monitoring and national CAMHS dataset developments: a response to johnston and gower. Child Adolesc Mental Health. 2006, 11: 50-52. 10.1111/j.1475-3588.2005.00390.x.CrossRef Ford T, Tingay T, Wolpert M, Group CS: CORC’s Survey of routine outcome monitoring and national CAMHS dataset developments: a response to johnston and gower. Child Adolesc Mental Health. 2006, 11: 50-52. 10.1111/j.1475-3588.2005.00390.x.CrossRef
29.
go back to reference Oates J: Building regional health care networks in Europe. 2000, Amsterdam: Ios PressInc Oates J: Building regional health care networks in Europe. 2000, Amsterdam: Ios PressInc
30.
go back to reference Kiger LS, Kiger LS: Content and structure of health record. Health Information Management: Principles and organization for health information services. Edited by: Skurka M. 2003, Chicago: Jossey-Bass, 19-44. Kiger LS, Kiger LS: Content and structure of health record. Health Information Management: Principles and organization for health information services. Edited by: Skurka M. 2003, Chicago: Jossey-Bass, 19-44.
31.
go back to reference Garralda EM: Accountability of specialist child and adolescent mental health services. Br J Psychiatry. 2009, 194: 389-391. 10.1192/bjp.bp.108.059477.CrossRefPubMed Garralda EM: Accountability of specialist child and adolescent mental health services. Br J Psychiatry. 2009, 194: 389-391. 10.1192/bjp.bp.108.059477.CrossRefPubMed
32.
go back to reference Hanssen-Bauer K, Gowers S, Aalen OO, Bilenberg N, Brann P, Garralda E, Merry S, Heyerdahl S: Cross-national reliability of clinician-rated outcome measures in child and adolescent mental health services. Adm Policy Ment Health Ment Health Serv. 2007, 34: 513-518. 10.1007/s10488-007-0135-x.CrossRef Hanssen-Bauer K, Gowers S, Aalen OO, Bilenberg N, Brann P, Garralda E, Merry S, Heyerdahl S: Cross-national reliability of clinician-rated outcome measures in child and adolescent mental health services. Adm Policy Ment Health Ment Health Serv. 2007, 34: 513-518. 10.1007/s10488-007-0135-x.CrossRef
33.
go back to reference American Psychiatric Association: Diagnostic and statistical manual of mental disorders. 2013, Arlington, VA: American Psychiatric PublishingCrossRef American Psychiatric Association: Diagnostic and statistical manual of mental disorders. 2013, Arlington, VA: American Psychiatric PublishingCrossRef
34.
go back to reference Garralda EM, Yates P, Higginson I: Child and adolescent mental health service use – HoNOSCA as an outcome meaure. Br J Psychiatry. 2000, 177: 52-58. 10.1192/bjp.177.1.52.CrossRefPubMed Garralda EM, Yates P, Higginson I: Child and adolescent mental health service use – HoNOSCA as an outcome meaure. Br J Psychiatry. 2000, 177: 52-58. 10.1192/bjp.177.1.52.CrossRefPubMed
35.
go back to reference Truman J, Robinson K, Evans AL, Smith D, Cunningham L, Millward R, Minnis H: The strengths and difficulties questionnaire - a pilot study of a new computer version of the self-report scale. Eur Child Adolesc Psychiatry. 2003, 12: 9-14. 10.1007/s00787-003-0303-9.CrossRefPubMed Truman J, Robinson K, Evans AL, Smith D, Cunningham L, Millward R, Minnis H: The strengths and difficulties questionnaire - a pilot study of a new computer version of the self-report scale. Eur Child Adolesc Psychiatry. 2003, 12: 9-14. 10.1007/s00787-003-0303-9.CrossRefPubMed
36.
go back to reference Timimi S, Tetley D, Burgoine W, Walker G: Outcome orientated child and adolescent mental health services (OO-CAMHS): a whole service model. Clin Child Psychol Psychiatry. 2012, 17: 1-16. Timimi S, Tetley D, Burgoine W, Walker G: Outcome orientated child and adolescent mental health services (OO-CAMHS): a whole service model. Clin Child Psychol Psychiatry. 2012, 17: 1-16.
Metadata
Title
The use of routine outcome measures in two child and adolescent mental health services: a completed audit cycle
Authors
Charlotte L Hall
Maria Moldavsky
Laurence Baldwin
Michael Marriott
Karen Newell
John Taylor
Kapil Sayal
Chris Hollis
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2013
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-13-270

Other articles of this Issue 1/2013

BMC Psychiatry 1/2013 Go to the issue