Skip to main content
Top
Published in: European Child & Adolescent Psychiatry 8/2020

01-08-2020 | Original Contribution

The Child Outcome Rating Scale: validating a four-item measure of psychosocial functioning in community and clinic samples of children aged 10–15

Authors: Polly Casey, Praveetha Patalay, Jessica Deighton, Scott D. Miller, Miranda Wolpert

Published in: European Child & Adolescent Psychiatry | Issue 8/2020

Login to get access

Abstract

Psychosocial functioning is considered an important and valued outcome in relation to young people’s mental health as a construct distinct from psychiatric symptomology, especially in the light of an increasing focus on transdiagnostic approaches. Yet, the level of psychosocial functioning is rarely directly asked of young people themselves, despite the widespread recognition that the young person’s perspective is valuable and is often at odds with those of other reporters, such as parents or professionals. One possible reason for this is that the field lacks a clear agreed tool to capture this information in a non-burdensome way. To begin to address this gap, this paper describes psychometric analysis of the Child Outcome Rating Scale (CORS), a brief and highly accessible self-report measure of young people’s psychosocial functioning already used extensively by mental health professionals around the world but with only limited data on psychometric robustness. Using large community (n = 7822) and clinic (n = 2604) samples, we explore the factor structure, construct validity, internal consistency, differential item functioning, and sensitivity of the CORS. We found that the CORS stands up to psychometric scrutiny, having found satisfactory levels of reliability, validity, and sensitivity in this sample. We also found that the CORS is suitable for use with young people as old as 15 years old. That the CORS has been found to be psychometrically robust while being highly feasible (brief, simple, easy to administer) for use in busy clinical settings, combined with the fact that the CORS has already been widely adopted by clinicians and young people, suggests CORS may be an important tool for international use.
Footnotes
1
According to data from the January 2017 school census based on state funded primary and secondary schools (Department for Education).
 
2
The Children and Young People’s Improving Access to Psychological Therapies programme (CYP IAPT).
 
3
The most common the most common presenting problems across services were family relationship difficulties (52%), depression/low mood (50%), and/or generalised anxiety (49%) (not mutually exclusive issues). Percentages are based on the full CYP IAPT dataset, reported by Wolpert et al., (2016; https://​www.​corc.​uk.​net/​media/​1544/​0505207_​corc-report_​for-web.​pdf) and so provide a broad indication of presenting problems in the current sample.
 
Literature
1.
go back to reference Achenbach TM, McConaughy SH, Howell CT (1987) Child/adolescent behavioural and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 101:213–232PubMed Achenbach TM, McConaughy SH, Howell CT (1987) Child/adolescent behavioural and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 101:213–232PubMed
2.
go back to reference Batty MJ, Moldavsky M, Foroushani PS, Pass S, Marriott M, Sayal K, Hollis C (2013) Implementing routine outcome measures in child and adolescent mental health services: from present to future practice. Child Adolesc Mental Health 18(2):82–87 Batty MJ, Moldavsky M, Foroushani PS, Pass S, Marriott M, Sayal K, Hollis C (2013) Implementing routine outcome measures in child and adolescent mental health services: from present to future practice. Child Adolesc Mental Health 18(2):82–87
3.
go back to reference Bradley J, Murphy S, Fugard AJB, Nolas S-M, Law D (2013) What kinds of goals do children and young people set for themselves in therapy? Developing a goals framework using CORC data. Clin Child Fam Psychol Rev 1(1):8–18 Bradley J, Murphy S, Fugard AJB, Nolas S-M, Law D (2013) What kinds of goals do children and young people set for themselves in therapy? Developing a goals framework using CORC data. Clin Child Fam Psychol Rev 1(1):8–18
4.
go back to reference Cabrera-Nguyen P (2010) Author guidelines for reporting scale development and validation results. J Soc Soc Work Res 1(2):99–103 Cabrera-Nguyen P (2010) Author guidelines for reporting scale development and validation results. J Soc Soc Work Res 1(2):99–103
5.
go back to reference Chen FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model 14(3):464–504 Chen FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model 14(3):464–504
6.
go back to reference Cheung GW, Rensvold RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model 9(2):233–255 Cheung GW, Rensvold RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model 9(2):233–255
7.
go back to reference Children and Young People’s Improving Access to Psychological Therapies Programme (2013) National curriculum for core, cognitive behavioural therapy, parenting training (3–10-year olds), systemic family practice, interpersonal psychotherapy for adolescents, supervision, and transformational service leadership. IAPT, London Children and Young People’s Improving Access to Psychological Therapies Programme (2013) National curriculum for core, cognitive behavioural therapy, parenting training (3–10-year olds), systemic family practice, interpersonal psychotherapy for adolescents, supervision, and transformational service leadership. IAPT, London
9.
go back to reference Cleridou K, Patalay P, Martin P (2017) Does parent–child agreement vary based on presenting problems? Results from a UK clinical sample. Child Adolesc Psychiatry Mental Health 11:22 Cleridou K, Patalay P, Martin P (2017) Does parent–child agreement vary based on presenting problems? Results from a UK clinical sample. Child Adolesc Psychiatry Mental Health 11:22
10.
go back to reference Costello EJ, Foley DL, Angold A (2006) 10-year research update review: the epidemiology of child and adolescent psychiatric disorders: II. Developmental epidemiology. J Am Acad Child Adolesc Psychiatry 45(1):8–25PubMed Costello EJ, Foley DL, Angold A (2006) 10-year research update review: the epidemiology of child and adolescent psychiatric disorders: II. Developmental epidemiology. J Am Acad Child Adolesc Psychiatry 45(1):8–25PubMed
11.
go back to reference Deighton J, Croudace T, Fonagy P, Brown J, Patalya P, Wolpert M (2014) Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures. Child Adolesc Psychiatry Mental Health 8:14 Deighton J, Croudace T, Fonagy P, Brown J, Patalya P, Wolpert M (2014) Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures. Child Adolesc Psychiatry Mental Health 8:14
12.
go back to reference Deighton J, Lereya T, Patalay P, Casey P, Humphrey N, Wolpert W (2018) Mental health problems in young people, aged 11 to 14: Results from the first HeadStart annual survey of 30,000 children. CAMHS Press, London Deighton J, Lereya T, Patalay P, Casey P, Humphrey N, Wolpert W (2018) Mental health problems in young people, aged 11 to 14: Results from the first HeadStart annual survey of 30,000 children. CAMHS Press, London
13.
go back to reference Deighton J, Tymms P, Vostanis P, Belsky J, Fonagy P, Brown A, Martin A, Patalay P, Wolpert M (2013) The development of a school-based measure of child mental health. J Psychoeduc Assess 31:247–257PubMedPubMedCentral Deighton J, Tymms P, Vostanis P, Belsky J, Fonagy P, Brown A, Martin A, Patalay P, Wolpert M (2013) The development of a school-based measure of child mental health. J Psychoeduc Assess 31:247–257PubMedPubMedCentral
14.
go back to reference Duncan BL, Sparks JA, Miller SD, Bohanske RY, Claud DA (2006) Giving Youth a Voice: a preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. J Brief Therapy 5(2):71–88 Duncan BL, Sparks JA, Miller SD, Bohanske RY, Claud DA (2006) Giving Youth a Voice: a preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. J Brief Therapy 5(2):71–88
15.
go back to reference Hooper D, Coughlan J, Mullen MR (2008) Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods 6(1):53–60 Hooper D, Coughlan J, Mullen MR (2008) Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods 6(1):53–60
16.
go back to reference Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model A Multidisc J 6(1):1–55 Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model A Multidisc J 6(1):1–55
17.
go back to reference Husky MM, Boyd A, Bitfoi A, Carta MG, Chan-Chee C, Goelitz D, Koç C, Lesinskiene S, Mihova Z, Otten R, Pez O, Shojaei T, Kovess-Masfety V (2018) Self-reported mental health in children ages 6–12 years across eight European countries. Eur Child Adolesc Psychiatry 27(6):785–795PubMed Husky MM, Boyd A, Bitfoi A, Carta MG, Chan-Chee C, Goelitz D, Koç C, Lesinskiene S, Mihova Z, Otten R, Pez O, Shojaei T, Kovess-Masfety V (2018) Self-reported mental health in children ages 6–12 years across eight European countries. Eur Child Adolesc Psychiatry 27(6):785–795PubMed
18.
go back to reference Joseph S, Wood A (2010) Assessment of positive functioning in clinical psychology: theoretical and practical issues. Clin Psychol Rev 30:830–838PubMed Joseph S, Wood A (2010) Assessment of positive functioning in clinical psychology: theoretical and practical issues. Clin Psychol Rev 30:830–838PubMed
19.
go back to reference Kline RB (2005) Principles and Practice of Structural Equation Modeling, 2nd edn. Guilford Press, New York Kline RB (2005) Principles and Practice of Structural Equation Modeling, 2nd edn. Guilford Press, New York
20.
go back to reference Krause KR, Bear HA, Edbrooke-Childs J, Wolpert M (2018) What outcomes count? A review of outcomes measured for adolescent depression between 2007 and 2017. J Am Acad Child Adolesc Psychiatry 58(1):61–71PubMed Krause KR, Bear HA, Edbrooke-Childs J, Wolpert M (2018) What outcomes count? A review of outcomes measured for adolescent depression between 2007 and 2017. J Am Acad Child Adolesc Psychiatry 58(1):61–71PubMed
21.
go back to reference van Laerhoven H, van der Zaag-Loonen HJ, Derkx BHF (2004) A comparison of Likert scale and visual analogue scales as response options in children’s questionnaires. Acta Paediatr 93:830–835PubMed van Laerhoven H, van der Zaag-Loonen HJ, Derkx BHF (2004) A comparison of Likert scale and visual analogue scales as response options in children’s questionnaires. Acta Paediatr 93:830–835PubMed
22.
go back to reference Leamy M, Bird V, Le Boutillier C, Williams J, Slade M (2011) Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry 199(6):445–452PubMed Leamy M, Bird V, Le Boutillier C, Williams J, Slade M (2011) Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry 199(6):445–452PubMed
23.
go back to reference Lereya ST, Humphrey N, Patalay P, Wolpert M, Böhnke JR, Macdougall A, Deighton J (2016) The student resilience survey: psychometric validation and associations with mental health. Child Adolesc Psychiatry Mental Health 10:44 Lereya ST, Humphrey N, Patalay P, Wolpert M, Böhnke JR, Macdougall A, Deighton J (2016) The student resilience survey: psychometric validation and associations with mental health. Child Adolesc Psychiatry Mental Health 10:44
24.
go back to reference Meade AW, Johnson EC, Braddy PW (2008) Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol 93(3):568–592PubMed Meade AW, Johnson EC, Braddy PW (2008) Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol 93(3):568–592PubMed
25.
go back to reference Miller S, Duncan BL, Brown J, Sparks JA, Claud DA (2003) The Outcome Rating Scale: a preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. J Brief Therapy 2(2):91–100 Miller S, Duncan BL, Brown J, Sparks JA, Claud DA (2003) The Outcome Rating Scale: a preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. J Brief Therapy 2(2):91–100
26.
go back to reference Muthén LK, Muthén BO (1998–2015) Mplus user’s guide, 7th edn. Muthén & Muthén, Los Angeles Muthén LK, Muthén BO (1998–2015) Mplus user’s guide, 7th edn. Muthén & Muthén, Los Angeles
27.
go back to reference Nunnally JC (1978) Psychometric theory. McGrawHill, New York Nunnally JC (1978) Psychometric theory. McGrawHill, New York
28.
go back to reference Pantell RH, Lewis CC (1987) Measuring the impact of medical care on children. J Chronic Dis 40(1):99–108 Pantell RH, Lewis CC (1987) Measuring the impact of medical care on children. J Chronic Dis 40(1):99–108
29.
go back to reference Patalay P, Deighton J, Fonagy P, Vostanis P, Wolpert M (2014) Clinical validity of the Me and My School questionnaire: a self-report mental health measure for children and adolescents. Child Adolesc Psychiatry Mental Health 8:17 Patalay P, Deighton J, Fonagy P, Vostanis P, Wolpert M (2014) Clinical validity of the Me and My School questionnaire: a self-report mental health measure for children and adolescents. Child Adolesc Psychiatry Mental Health 8:17
30.
go back to reference Patalay P, Fitzsimons E (2018) Development and predictors of mental ill-health and wellbeing from childhood to adolescence. Soc Psychiatry Psychiatr Epidemiol 53(12):1311–1323PubMed Patalay P, Fitzsimons E (2018) Development and predictors of mental ill-health and wellbeing from childhood to adolescence. Soc Psychiatry Psychiatr Epidemiol 53(12):1311–1323PubMed
31.
go back to reference Patalay P, Fonagy P, Deighton J, Belsky J, Vostanis P, Wolpert M (2015) A general psychopathology factor in early adolescence. Br J Psychiatry 207:15–22PubMed Patalay P, Fonagy P, Deighton J, Belsky J, Vostanis P, Wolpert M (2015) A general psychopathology factor in early adolescence. Br J Psychiatry 207:15–22PubMed
32.
go back to reference Patel V, Flisher AJ, Hetrick S, McGorry P (2007) Mental health of young people: a global public-health challenge. Lancet 369:1302–1313PubMed Patel V, Flisher AJ, Hetrick S, McGorry P (2007) Mental health of young people: a global public-health challenge. Lancet 369:1302–1313PubMed
33.
go back to reference Putnick DL, Bornstein MH (2016) Measurement invariance conventions and reporting: the state of the art and future directions for psychological research. Dev Rev 41:71–90PubMedPubMedCentral Putnick DL, Bornstein MH (2016) Measurement invariance conventions and reporting: the state of the art and future directions for psychological research. Dev Rev 41:71–90PubMedPubMedCentral
34.
go back to reference Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, Egmar A-C, Gusi N, Herdman M et al (2010) Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res 19(6):887–897PubMedPubMedCentral Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, Egmar A-C, Gusi N, Herdman M et al (2010) Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res 19(6):887–897PubMedPubMedCentral
35.
go back to reference Satorra A, Bentler PM (2010) Ensuring positiveness of the scaled difference Chi square test statistic. Psychometrika 75:243–248PubMedPubMedCentral Satorra A, Bentler PM (2010) Ensuring positiveness of the scaled difference Chi square test statistic. Psychometrika 75:243–248PubMedPubMedCentral
36.
go back to reference Sharpe H, Patalay P, Fink E, Vostanis P, Deighton J, Wolpert M (2016) Exploring the relationship between quality of life and mental health problems in children: implications for measurement and practice. Eur Child Adolesc Psychiatry 25:659–667PubMed Sharpe H, Patalay P, Fink E, Vostanis P, Deighton J, Wolpert M (2016) Exploring the relationship between quality of life and mental health problems in children: implications for measurement and practice. Eur Child Adolesc Psychiatry 25:659–667PubMed
37.
go back to reference Slade M, Thornicroft G, Glover G (1999) The feasibility of routine outcome measures in mental health. Soc Psychiatry Psychiatr Epidemiol 34:243–249PubMed Slade M, Thornicroft G, Glover G (1999) The feasibility of routine outcome measures in mental health. Soc Psychiatry Psychiatr Epidemiol 34:243–249PubMed
38.
go back to reference Sourander A, Helstela L, Helenius H (1999) Parent-adolescent agreement on emotional and behavioral problems. Soc Psychiatry Psychiatr Epidemiol 34:657–663PubMed Sourander A, Helstela L, Helenius H (1999) Parent-adolescent agreement on emotional and behavioral problems. Soc Psychiatry Psychiatr Epidemiol 34:657–663PubMed
39.
go back to reference Sun J, Stewart D (2007) Development of population-based resilience measures in the primary school setting. Health Educ 7(6):575–599 Sun J, Stewart D (2007) Development of population-based resilience measures in the primary school setting. Health Educ 7(6):575–599
40.
go back to reference UK Government (2004) Children act, vol 31. The Stationery Office, London UK Government (2004) Children act, vol 31. The Stationery Office, London
Metadata
Title
The Child Outcome Rating Scale: validating a four-item measure of psychosocial functioning in community and clinic samples of children aged 10–15
Authors
Polly Casey
Praveetha Patalay
Jessica Deighton
Scott D. Miller
Miranda Wolpert
Publication date
01-08-2020
Publisher
Springer Berlin Heidelberg
Published in
European Child & Adolescent Psychiatry / Issue 8/2020
Print ISSN: 1018-8827
Electronic ISSN: 1435-165X
DOI
https://doi.org/10.1007/s00787-019-01423-4

Other articles of this Issue 8/2020

European Child & Adolescent Psychiatry 8/2020 Go to the issue