Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

The Child and Youth Mental Health Assessment (ChYMH): An examination of the psychometric properties of an integrated assessment developed for clinically referred children and youth

Authors: Shannon L. Stewart, Chloe A. Hamza

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

The Child and Youth Mental Health (ChYMH) assessment system was developed by interRAI (i.e., an international collective of researchers and clinicians from over thirty countries) in response to the unprecedented need for a coordinated approach to delivery of children’s mental health care. Many interRAI instruments are used across Canada and internationally, but the ChYMH represents the first assessment specifically for children and youth. In the present paper, a short overview of the development process of the ChYMH is provided, and then the psychometric properties of several embedded scales on the ChYMH are examined.

Methods

Participants included 1297 children and youth and their families who completed the ChYMH after being referred to mental health agencies within Ontario, Canada. In addition, smaller subsets of participants (N = 48–53) completed additional criterion measures, including the Social Skills Improvement System (SSIS), the Child and Adolescent Functional Assessment Scale (CAFAS), the Child Behavior Checklist (CBCL), and the Brief Child and Family Phone Interview (BCFPI).

Results

Results demonstrated that the ChYMH subscales had strong internal-consistency (Cronbach’s higher than .70), and correlated well with the criterion measures.

Conclusions

Findings support the clinical utility of the ChYMH for use among clinically referred children and youth. Implications for children’s mental health assessment and practice are discussed.
Literature
1.
go back to reference Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49:980–9.CrossRefPubMedPubMedCentral Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49:980–9.CrossRefPubMedPubMedCentral
3.
go back to reference McLeod GFH, Horwood LJ, Fergusson DM. Adolescent depression, adult mental health and psychosocial outcomes at 30 and 35 years. Psychol Med. 2016;46:1401–12.CrossRefPubMed McLeod GFH, Horwood LJ, Fergusson DM. Adolescent depression, adult mental health and psychosocial outcomes at 30 and 35 years. Psychol Med. 2016;46:1401–12.CrossRefPubMed
4.
go back to reference Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Arch Gen Psychiatry. 2012;69:372–80.CrossRefPubMed Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Arch Gen Psychiatry. 2012;69:372–80.CrossRefPubMed
5.
go back to reference Breslau J, Miller E, Breslau N, Bohnert K, Lucia V, Schweitzer J. The impact of early behavior disturbances on academic achievement in high school. Pediatrics. 2009;123:1472–6.CrossRefPubMedPubMedCentral Breslau J, Miller E, Breslau N, Bohnert K, Lucia V, Schweitzer J. The impact of early behavior disturbances on academic achievement in high school. Pediatrics. 2009;123:1472–6.CrossRefPubMedPubMedCentral
6.
go back to reference Porche MV, Fortuna LR, Lin J, Alegria M. Childhood trauma and psychiatric disorders as correlates of school dropout in a national sample of young adults. Child Dev. 2011;82:982–98.CrossRefPubMedPubMedCentral Porche MV, Fortuna LR, Lin J, Alegria M. Childhood trauma and psychiatric disorders as correlates of school dropout in a national sample of young adults. Child Dev. 2011;82:982–98.CrossRefPubMedPubMedCentral
7.
go back to reference Veldman K, Reijneveld SA, Ortiz JA, Verhulst FC, Bültmann U. Mental health trajectories from childhood to young adulthood affect the educational and employment status of young adults: results from the TRAILS study. J Epidemiol Commun H. 2015;69:588–93.CrossRef Veldman K, Reijneveld SA, Ortiz JA, Verhulst FC, Bültmann U. Mental health trajectories from childhood to young adulthood affect the educational and employment status of young adults: results from the TRAILS study. J Epidemiol Commun H. 2015;69:588–93.CrossRef
8.
go back to reference Hemphala M, Hodgins S. Do psychopathic traits assessed in mid-adolescence predict mental health, psychosocial, and antisocial, including criminal outcomes, over the subsequent 5 years? Can J Psychiatry. 2014;59:40–9.PubMedPubMedCentral Hemphala M, Hodgins S. Do psychopathic traits assessed in mid-adolescence predict mental health, psychosocial, and antisocial, including criminal outcomes, over the subsequent 5 years? Can J Psychiatry. 2014;59:40–9.PubMedPubMedCentral
9.
go back to reference Henry KL, Knight KE, Thornberry TP. School disengagement as a predictor of dropout, delinquency, and problem substance use during adolescence and early adulthood. J Youth Adolesc. 2012;41:156–66.CrossRefPubMed Henry KL, Knight KE, Thornberry TP. School disengagement as a predictor of dropout, delinquency, and problem substance use during adolescence and early adulthood. J Youth Adolesc. 2012;41:156–66.CrossRefPubMed
10.
go back to reference Chronis-Tuscano A, Molina BS, Pelham WE, Applegate B, Dahlke A, Overmyer M, Lahey BB. Very early predictors of adolescent depression and suicide attempts in children with attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 2010;67:1044–51.CrossRefPubMedPubMedCentral Chronis-Tuscano A, Molina BS, Pelham WE, Applegate B, Dahlke A, Overmyer M, Lahey BB. Very early predictors of adolescent depression and suicide attempts in children with attention-deficit/hyperactivity disorder. Arch Gen Psychiatry. 2010;67:1044–51.CrossRefPubMedPubMedCentral
12.
go back to reference Kirby K, Keon WJ. Out of the Shadows at last: Transforming mental health, mental illness and addiction service in Canada. Ottawa: Senate of Canada, Standing Committee on Social Affairs, Science and Technology; 2006. Kirby K, Keon WJ. Out of the Shadows at last: Transforming mental health, mental illness and addiction service in Canada. Ottawa: Senate of Canada, Standing Committee on Social Affairs, Science and Technology; 2006.
13.
go back to reference Waddell C, McEwan K, Shepherd CA, Offord DR, Hua JM. A public health strategy to improve the mental health of Canadian children. Can J Psychiatry. 2005;50:226–33.CrossRefPubMed Waddell C, McEwan K, Shepherd CA, Offord DR, Hua JM. A public health strategy to improve the mental health of Canadian children. Can J Psychiatry. 2005;50:226–33.CrossRefPubMed
15.
go back to reference Hirdes J, Smith T, Rabinowitz T, Yamauchi K, Pérez E, Telegdi N, et al. The resident assessment instrument-mental health (RAI-MH): Inter-rater reliability and convergent validity. J Behav Health Ser R. 2002;29:419–32.CrossRef Hirdes J, Smith T, Rabinowitz T, Yamauchi K, Pérez E, Telegdi N, et al. The resident assessment instrument-mental health (RAI-MH): Inter-rater reliability and convergent validity. J Behav Health Ser R. 2002;29:419–32.CrossRef
16.
go back to reference Kazdin AE. Evidence-based assessment for children and adolescents: issues in measurement development and clinical application. J Clin Child Adolesc. 2005;34:548–58.CrossRef Kazdin AE. Evidence-based assessment for children and adolescents: issues in measurement development and clinical application. J Clin Child Adolesc. 2005;34:548–58.CrossRef
17.
go back to reference Neisworth JT, Bagnato SJ. The mismeasure of young children: the authentic assessment alternative. Infants Young Child. 2004;17:198–212.CrossRef Neisworth JT, Bagnato SJ. The mismeasure of young children: the authentic assessment alternative. Infants Young Child. 2004;17:198–212.CrossRef
18.
go back to reference Burrows A, Morris J, Simon S, Hirdes J, Phillips C. Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing. 2000;29:165–72.CrossRefPubMed Burrows A, Morris J, Simon S, Hirdes J, Phillips C. Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing. 2000;29:165–72.CrossRefPubMed
19.
go back to reference Hirdes J, Ljunggren G, Morris J, Frijters D, Finne Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277–88.CrossRefPubMedPubMedCentral Hirdes J, Ljunggren G, Morris J, Frijters D, Finne Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277–88.CrossRefPubMedPubMedCentral
20.
go back to reference Morris JN, Carpenter I, Berg K, Jones RN. Outcome measures for use with home care clients. Can J Aging. 2000;19:87–105.CrossRef Morris JN, Carpenter I, Berg K, Jones RN. Outcome measures for use with home care clients. Can J Aging. 2000;19:87–105.CrossRef
21.
go back to reference Perlman CM, Hirdes JP, Barbaree H, Fries BE, McKillop I, Morris JN, Rabinowitz T. Development of mental health quality indicators (MHQIs) for inpatient psychiatry based on the interRAI mental health assessment. BMC Health Serv Res. 2013;13:15.CrossRefPubMedPubMedCentral Perlman CM, Hirdes JP, Barbaree H, Fries BE, McKillop I, Morris JN, Rabinowitz T. Development of mental health quality indicators (MHQIs) for inpatient psychiatry based on the interRAI mental health assessment. BMC Health Serv Res. 2013;13:15.CrossRefPubMedPubMedCentral
22.
go back to reference Stewart SL, Hirdes JP, Curtin-Telegdi N, Perlman C, MacLeod K, Ninan A, et al. interRAI Child and Youth Mental Health (ChYMH) Assessment Form and User’s Manual. Version 9.3. Washington: interRAI; 2015. Stewart SL, Hirdes JP, Curtin-Telegdi N, Perlman C, MacLeod K, Ninan A, et al. interRAI Child and Youth Mental Health (ChYMH) Assessment Form and User’s Manual. Version 9.3. Washington: interRAI; 2015.
23.
go back to reference Gresham F, Elliott SN. Social skills improvement system (SSIS) rating scales. Bloomington: Pearson Assessments; 2008. Gresham F, Elliott SN. Social skills improvement system (SSIS) rating scales. Bloomington: Pearson Assessments; 2008.
24.
go back to reference Flanagan DP, Alfonso VC, Primavera LH, Povall L, Higgins D. Convergent validity of the BASC and SSRS: Implications for social skills assessment. Psychol Schools. 1996;33:13–23.CrossRef Flanagan DP, Alfonso VC, Primavera LH, Povall L, Higgins D. Convergent validity of the BASC and SSRS: Implications for social skills assessment. Psychol Schools. 1996;33:13–23.CrossRef
25.
go back to reference Hodges K. CAFAS self-training manual and blank scoring forms. Functional Assessment Systems. 2003. Hodges K. CAFAS self-training manual and blank scoring forms. Functional Assessment Systems. 2003.
26.
go back to reference Hodges K, Wong MM. Psychometric characteristics of a multidimensional measure to assess impairment: the child and adolescent functional assessment scale. Journal of Child Fam Stud. 1996;5:445–67.CrossRef Hodges K, Wong MM. Psychometric characteristics of a multidimensional measure to assess impairment: the child and adolescent functional assessment scale. Journal of Child Fam Stud. 1996;5:445–67.CrossRef
27.
go back to reference Hodges K, Doucette-Gates A, Liao Q. The relationship between the Child and Adolescent Functional Assessment Scale (CAFAS) and indicators of functioning. Journal of Child Fam Stud. 1999;8:109–22.CrossRef Hodges K, Doucette-Gates A, Liao Q. The relationship between the Child and Adolescent Functional Assessment Scale (CAFAS) and indicators of functioning. Journal of Child Fam Stud. 1999;8:109–22.CrossRef
28.
go back to reference Achenbach TM. Manual for the CBCL/4-18 and 1991 Profile. Burlington: University of Vermont Department of Psychiatry; 1991. Achenbach TM. Manual for the CBCL/4-18 and 1991 Profile. Burlington: University of Vermont Department of Psychiatry; 1991.
29.
go back to reference Dutra L, Campbell L, Westen D. Quantifying clinical judgment in the assessment of adolescent psychopathology: reliability, validity, and factor structure of the child behavior checklist for clinician report. J Clin Psychol. 2004;60:65–85.CrossRefPubMed Dutra L, Campbell L, Westen D. Quantifying clinical judgment in the assessment of adolescent psychopathology: reliability, validity, and factor structure of the child behavior checklist for clinician report. J Clin Psychol. 2004;60:65–85.CrossRefPubMed
30.
go back to reference Cunningham CE, Pettingill P, Boyle M. The Brief Child and Family Phone Interview (BCFPI-3): a computerized intake and outcome assessment tool. Hamilton: McMaster University; 2002. Cunningham CE, Pettingill P, Boyle M. The Brief Child and Family Phone Interview (BCFPI-3): a computerized intake and outcome assessment tool. Hamilton: McMaster University; 2002.
31.
go back to reference Boyle MH, Cunningham CE, Georgiades K, Cullen J, Racine Y, Pettingill P. The Brief Child and Family Phone Interview (BCFPI): 2. Usefulness in screening for child and adolescent psychopathology. J Child Psychol Psychiatry. 2009;50:424–31.CrossRefPubMed Boyle MH, Cunningham CE, Georgiades K, Cullen J, Racine Y, Pettingill P. The Brief Child and Family Phone Interview (BCFPI): 2. Usefulness in screening for child and adolescent psychopathology. J Child Psychol Psychiatry. 2009;50:424–31.CrossRefPubMed
32.
go back to reference Cunningham CE, Boyle MH, Hong S, Pettingill P, Bohaychuk D. The Brief Child and Family Phone Interview (BCFPI): 1. Rationale, development, and description of a computerized children’s mental health intake and outcome assessment tool. J Child Psychol Psychiatry. 2009;50:416–23.CrossRefPubMed Cunningham CE, Boyle MH, Hong S, Pettingill P, Bohaychuk D. The Brief Child and Family Phone Interview (BCFPI): 1. Rationale, development, and description of a computerized children’s mental health intake and outcome assessment tool. J Child Psychol Psychiatry. 2009;50:416–23.CrossRefPubMed
33.
go back to reference Wellens NI, Milisen K, Flamaing J, Moons P. Methods to assess the validity of the interRAI Acute Care: a framework to guide clinimetric testing. J Eval Clin Pract. 2012;18:296–306.CrossRefPubMed Wellens NI, Milisen K, Flamaing J, Moons P. Methods to assess the validity of the interRAI Acute Care: a framework to guide clinimetric testing. J Eval Clin Pract. 2012;18:296–306.CrossRefPubMed
34.
go back to reference Jozefiak T, Kayed NS, Rimehaug T, Wormdal AK, Brubakk AM, Wichstrøm L. Prevalence and comorbidity of mental disorders among adolescents living in residential youth care. Eur Child Adoles Psychiatry. 2016;25:33–47.CrossRef Jozefiak T, Kayed NS, Rimehaug T, Wormdal AK, Brubakk AM, Wichstrøm L. Prevalence and comorbidity of mental disorders among adolescents living in residential youth care. Eur Child Adoles Psychiatry. 2016;25:33–47.CrossRef
35.
go back to reference Leadbeater BJ, Kuperminc GP, Blatt SJ, Hertzog C. A multivariate model of gender differences in adolescents' internalizing and externalizing problems. Dev Psychol. 1999;35:1268–82.CrossRefPubMed Leadbeater BJ, Kuperminc GP, Blatt SJ, Hertzog C. A multivariate model of gender differences in adolescents' internalizing and externalizing problems. Dev Psychol. 1999;35:1268–82.CrossRefPubMed
36.
go back to reference Martel MM. Sexual selection and sex differences in the prevalence of childhood externalizing and adolescent internalizing disorders. Psychol Bull. 2013;139:1221–59.CrossRefPubMed Martel MM. Sexual selection and sex differences in the prevalence of childhood externalizing and adolescent internalizing disorders. Psychol Bull. 2013;139:1221–59.CrossRefPubMed
37.
go back to reference Chaplin TM, Aldao A. Gender differences in emotion expression in children: a meta-analytic review. Psychol Bull. 2013;139:735–65.CrossRefPubMed Chaplin TM, Aldao A. Gender differences in emotion expression in children: a meta-analytic review. Psychol Bull. 2013;139:735–65.CrossRefPubMed
38.
go back to reference Sjöwall D, Roth L, Lindqvist S, Thorell LB. Multiple deficits in ADHD: executive dysfunction, delay aversion, reaction time variability, and emotional deficits. J Child Psychol Psychiatry. 2013;54:619–27.CrossRefPubMed Sjöwall D, Roth L, Lindqvist S, Thorell LB. Multiple deficits in ADHD: executive dysfunction, delay aversion, reaction time variability, and emotional deficits. J Child Psychol Psychiatry. 2013;54:619–27.CrossRefPubMed
39.
go back to reference Christakou A, Murphy CM, Chantiluke K, Cubillo AI, Smith AB, Giampietro V, Daly E, Ecker C, Robertson D, Murphy DG, Rubia K. Disorder-specific functional abnormalities during sustained attention in youth with attention deficit hyperactivity disorder (ADHD) and with autism. Mol Psychiatry. 2013;18:236–44.CrossRefPubMed Christakou A, Murphy CM, Chantiluke K, Cubillo AI, Smith AB, Giampietro V, Daly E, Ecker C, Robertson D, Murphy DG, Rubia K. Disorder-specific functional abnormalities during sustained attention in youth with attention deficit hyperactivity disorder (ADHD) and with autism. Mol Psychiatry. 2013;18:236–44.CrossRefPubMed
40.
go back to reference Smith JD, Dishion TJ, Shaw DS, Wilson MN, Winter CC, Patterson GR. Coercive family process and early-onset conduct problems from age 2 to school entry. Dev Psychopathology. 2014;26:917–32.CrossRef Smith JD, Dishion TJ, Shaw DS, Wilson MN, Winter CC, Patterson GR. Coercive family process and early-onset conduct problems from age 2 to school entry. Dev Psychopathology. 2014;26:917–32.CrossRef
41.
go back to reference Shaw P, Malek M, Watson B, Greenstein D, de Rossi P, Sharp W. Trajectories of cerebral cortical development in childhood and adolescence and adult attention-deficit/hyperactivity disorder. Biol Psychiatry. 2013;74:599–606.CrossRefPubMed Shaw P, Malek M, Watson B, Greenstein D, de Rossi P, Sharp W. Trajectories of cerebral cortical development in childhood and adolescence and adult attention-deficit/hyperactivity disorder. Biol Psychiatry. 2013;74:599–606.CrossRefPubMed
42.
go back to reference King KM, Lengua LJ, Monahan KC. Individual differences in the development of self-regulation during pre-adolescence: Connections to context and adjustment. J Abnorm Child Psych. 2013;41:57–69.CrossRef King KM, Lengua LJ, Monahan KC. Individual differences in the development of self-regulation during pre-adolescence: Connections to context and adjustment. J Abnorm Child Psych. 2013;41:57–69.CrossRef
43.
go back to reference Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives Gen Psychiatry. 2005;62:593–602.CrossRef Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives Gen Psychiatry. 2005;62:593–602.CrossRef
44.
go back to reference Chu PS, Saucier DA, Hafner E. Meta-analysis of the relationships between social support and well-being in children and adolescents. J Soc Clin Psychol. 2010;29:624–45.CrossRef Chu PS, Saucier DA, Hafner E. Meta-analysis of the relationships between social support and well-being in children and adolescents. J Soc Clin Psychol. 2010;29:624–45.CrossRef
45.
go back to reference Stewart SL, Currie M, Arbeau K, Leschied A, Kerry A. Assessment and planning for community and custodial services: The application of interRAI assessment in the youth justice system. In: Corrado RR, Leschied A, Lussier P, Whatley J, editors. Serious and Violent Young Offenders and Youth Criminal Justice: A Canadian Perspective. Canada: Simon Fraser University Publications; 2015. Stewart SL, Currie M, Arbeau K, Leschied A, Kerry A. Assessment and planning for community and custodial services: The application of interRAI assessment in the youth justice system. In: Corrado RR, Leschied A, Lussier P, Whatley J, editors. Serious and Violent Young Offenders and Youth Criminal Justice: A Canadian Perspective. Canada: Simon Fraser University Publications; 2015.
46.
go back to reference Phillips CD, Hawes C. The interRAI pediatric Home Care (PEDS HC) Assessment: Evaluating the long-term community-based service and support needs of children facing special health care challenges. Health Services Insight. 2015;8:17–24.CrossRef Phillips CD, Hawes C. The interRAI pediatric Home Care (PEDS HC) Assessment: Evaluating the long-term community-based service and support needs of children facing special health care challenges. Health Services Insight. 2015;8:17–24.CrossRef
47.
go back to reference Stewart SL, Hirdes JP. Identifying mental health symptoms in children and youth in residential and inpatient care settings. Healthc Manage Forum. 2015;28:150–6.CrossRefPubMed Stewart SL, Hirdes JP. Identifying mental health symptoms in children and youth in residential and inpatient care settings. Healthc Manage Forum. 2015;28:150–6.CrossRefPubMed
Metadata
Title
The Child and Youth Mental Health Assessment (ChYMH): An examination of the psychometric properties of an integrated assessment developed for clinically referred children and youth
Authors
Shannon L. Stewart
Chloe A. Hamza
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1970-9

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue