Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 6/2007

01-11-2007 | Original Paper

Cross-National Reliability of Clinician-Rated Outcome Measures in Child and Adolescent Mental Health Services

Authors: Ketil Hanssen-Bauer, Simon Gowers, Odd O. Aalen, Niels Bilenberg, Peter Brann, Elena Garralda, Sally Merry, Sonja Heyerdahl

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2007

Login to get access

Abstract

Clinician-rated measures are in extensive use as routine outcome measures in child and adolescent mental health services. We investigated cross-national differences and inter-rater reliability of the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA), the Children’s Global Assessment Scale (CGAS) and the Global Assessment of Psychosocial Disability (GAPD). Thirty clinicians from 5 nations independently rated 20 written vignettes. The national groups afterwards established national consensus ratings. There were no cross-national differences in independent scores, but there were differences in national consensus scores, which were also more severe than independent scores. The ICC for the HoNOSCA total score was 0.84, for the CGAS 0.61 and for the GAPD 0.54. These measures may usefully contribute to cross-national comparison studies.
Literature
go back to reference Becker, T., Knapp, M., Knudsen, H. C., Schene, A., Tansella, M., Thornicroft, G., et al. (1999). The EPSILON study of schizophrenia in five European countries. Design and methodology for standardising outcome measures and comparing patterns of care and service costs. British Journal of Psychiatry, 175, 514–521.PubMed Becker, T., Knapp, M., Knudsen, H. C., Schene, A., Tansella, M., Thornicroft, G., et al. (1999). The EPSILON study of schizophrenia in five European countries. Design and methodology for standardising outcome measures and comparing patterns of care and service costs. British Journal of Psychiatry, 175, 514–521.PubMed
go back to reference Bilenberg, N. (2003). Health of the nation outcome scales for children and adolescents (HoNOSCA). Results of a Danish field trial. European Child & Adolescent Psychiatry, 12(6), 298–302.CrossRef Bilenberg, N. (2003). Health of the nation outcome scales for children and adolescents (HoNOSCA). Results of a Danish field trial. European Child & Adolescent Psychiatry, 12(6), 298–302.CrossRef
go back to reference Brann, P., Coleman, G., & Luk, E. (2001). Routine outcome measurement in a child and adolescent mental health service: an evaluation of HoNOSCA. The Australian and New Zealand Journal of Psychiatry, 35(3), 370–376.CrossRefPubMed Brann, P., Coleman, G., & Luk, E. (2001). Routine outcome measurement in a child and adolescent mental health service: an evaluation of HoNOSCA. The Australian and New Zealand Journal of Psychiatry, 35(3), 370–376.CrossRefPubMed
go back to reference Canino, G., & Bravo, M. (1999). The translation and adaptation of diagnostic instruments for cross-cultural use. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 285–298). New York: The Guilford Press. Canino, G., & Bravo, M. (1999). The translation and adaptation of diagnostic instruments for cross-cultural use. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 285–298). New York: The Guilford Press.
go back to reference Department of Health and Ageing (2003). Mental health national outcomes and casemix collection: Technical specification of state and territory reporting requirements for the outcomes and casemix components of ‘agreed data’, Version 1.50. Canberra, Australia: Commonwealth Government. Department of Health and Ageing (2003). Mental health national outcomes and casemix collection: Technical specification of state and territory reporting requirements for the outcomes and casemix components of ‘agreed data’, Version 1.50. Canberra, Australia: Commonwealth Government.
go back to reference Dopfner, M., Steinhausen, H. C., Coghill, D., Dalsgaard, S., Poole, L., Ralston, S. J., et al. (2006). Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study. European Child & Adolescent Psychiatry, 15(Suppl 1), i46–i55.CrossRef Dopfner, M., Steinhausen, H. C., Coghill, D., Dalsgaard, S., Poole, L., Ralston, S. J., et al. (2006). Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study. European Child & Adolescent Psychiatry, 15(Suppl 1), i46–i55.CrossRef
go back to reference Dyrborg, J., Larsen, F. W., Nielsen, S., Byman, J., Nielsen, B. B., & Gautre-Delay, F. (2000). The Children’s Global Assessment Scale (CGAS) and Global Assessment of Psychosocial Disability (GAPD) in clinical practice - substance and reliability as judged by intraclass correlations. European Child & Adolescent Psychiatry, 9(3), 195–201.CrossRef Dyrborg, J., Larsen, F. W., Nielsen, S., Byman, J., Nielsen, B. B., & Gautre-Delay, F. (2000). The Children’s Global Assessment Scale (CGAS) and Global Assessment of Psychosocial Disability (GAPD) in clinical practice - substance and reliability as judged by intraclass correlations. European Child & Adolescent Psychiatry, 9(3), 195–201.CrossRef
go back to reference Efron, B., & Tibshirani, R. J. (1993). An introduction to the Bootstrap. Chapman & Hall. Efron, B., & Tibshirani, R. J. (1993). An introduction to the Bootstrap. Chapman & Hall.
go back to reference Garralda, M. E., Yates, P., & Higginson, I. (2000). Child and adolescent mental health service use. HoNOSCA as an outcome measure. British Journal of Psychiatry, 177, 52–58.CrossRefPubMed Garralda, M. E., Yates, P., & Higginson, I. (2000). Child and adolescent mental health service use. HoNOSCA as an outcome measure. British Journal of Psychiatry, 177, 52–58.CrossRefPubMed
go back to reference Gowers, S. G., Harrington, R. C., Whitton, A., Lelliott, P., Beevor, A., Wing, J., et al. (1999). Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA). British Journal of Psychiatry, 174, 413–416.PubMed Gowers, S. G., Harrington, R. C., Whitton, A., Lelliott, P., Beevor, A., Wing, J., et al. (1999). Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA). British Journal of Psychiatry, 174, 413–416.PubMed
go back to reference Johnston, C., & Gowers, S. (2005). Routine Outcome Measurement: A Survey of UK Child and Adolescent Mental Health Services. Child and Adolescent Mental Health, 10(3), 133–139.CrossRef Johnston, C., & Gowers, S. (2005). Routine Outcome Measurement: A Survey of UK Child and Adolescent Mental Health Services. Child and Adolescent Mental Health, 10(3), 133–139.CrossRef
go back to reference Peabody, J. W., Luck, J., Glassman, P., Jain, S., Hansen, J., Spell, M., et al. (2004). Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Annals of Internal Medicine, 141(10), 771–780.PubMed Peabody, J. W., Luck, J., Glassman, P., Jain, S., Hansen, J., Spell, M., et al. (2004). Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Annals of Internal Medicine, 141(10), 771–780.PubMed
go back to reference Rey, J. M., Starling, J., Wever, C., Dossetor, D. R., & Plapp, J. M. (1995). Inter-rater reliability of global assessment of functioning in a clinical setting. Journal of Child Psychology and Psychiatry, 36(5), 787–792.CrossRefPubMed Rey, J. M., Starling, J., Wever, C., Dossetor, D. R., & Plapp, J. M. (1995). Inter-rater reliability of global assessment of functioning in a clinical setting. Journal of Child Psychology and Psychiatry, 36(5), 787–792.CrossRefPubMed
go back to reference Schorre, B. E. & Vandvik, I. H. (2004). Global assessment of psychosocial functioning in child and adolescent psychiatry. A review of three unidimensional scales (CGAS, GAF, GAPD). European Child & Adolescent Psychiatry, 13(5), 273–286.CrossRef Schorre, B. E. & Vandvik, I. H. (2004). Global assessment of psychosocial functioning in child and adolescent psychiatry. A review of three unidimensional scales (CGAS, GAF, GAPD). European Child & Adolescent Psychiatry, 13(5), 273–286.CrossRef
go back to reference Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P., Fisher, P., Bird, H., et al. (1983). A children’s global assessment scale (CGAS). Archives of General Psychiatry, 40(11), 1228–1231.PubMed Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P., Fisher, P., Bird, H., et al. (1983). A children’s global assessment scale (CGAS). Archives of General Psychiatry, 40(11), 1228–1231.PubMed
go back to reference Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317.CrossRefPubMed Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317.CrossRefPubMed
go back to reference Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.CrossRef Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.CrossRef
go back to reference Weiss, B. (1998). Annotation: Routine monitoring of the effectiveness of child psychotherapy. Journal of Child Psychology and Psychiatry, 39(7), 943–950.CrossRefPubMed Weiss, B. (1998). Annotation: Routine monitoring of the effectiveness of child psychotherapy. Journal of Child Psychology and Psychiatry, 39(7), 943–950.CrossRefPubMed
go back to reference World Health Organization (1996). Multiaxial classification of child and adolescent psychiatric disorders. Cambridge University Press. World Health Organization (1996). Multiaxial classification of child and adolescent psychiatric disorders. Cambridge University Press.
go back to reference Yates, P., Garralda, M. E., & Higginson, I. (1999). Paddington complexity scale and health of the nation outcome scales for children and adolescents. British Journal of Psychiatry, 174, 417–423.PubMedCrossRef Yates, P., Garralda, M. E., & Higginson, I. (1999). Paddington complexity scale and health of the nation outcome scales for children and adolescents. British Journal of Psychiatry, 174, 417–423.PubMedCrossRef
Metadata
Title
Cross-National Reliability of Clinician-Rated Outcome Measures in Child and Adolescent Mental Health Services
Authors
Ketil Hanssen-Bauer
Simon Gowers
Odd O. Aalen
Niels Bilenberg
Peter Brann
Elena Garralda
Sally Merry
Sonja Heyerdahl
Publication date
01-11-2007
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2007
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-007-0135-x

Other articles of this Issue 6/2007

Administration and Policy in Mental Health and Mental Health Services Research 6/2007 Go to the issue