Skip to main content
Top
Published in: BMC Pediatrics 1/2019

Open Access 01-12-2019 | Research article

A screening tool for psychological difficulties in children aged 6 to 36 months: cross-cultural validation in Kenya, Cambodia and Uganda

Authors: Fabienne Nackers, Thomas Roederer, Caroline Marquer, Scholastic Ashaba, Samuel Maling, Juliet Mwanga-Amumpaire, Sothara Muny, Chea Sokeo, Vireak Shom, Maria Palha, Pauline Lefèbvre, Beatrice W. Kirubi, Grace Kamidigo, Bruno Falissard, Marie-Rose Moro, Rebecca F. Grais

Published in: BMC Pediatrics | Issue 1/2019

Login to get access

Abstract

Background

In low-resource settings, the lack of mental health professionals and cross-culturally validated screening instruments complicates mental health care delivery. This is especially the case for very young children. Here, we aimed to develop and cross-culturally validate a simple and rapid tool, the PSYCa 6–36, that can be administered by non-professionals to screen for psychological difficulties among children aged six to 36 months.

Methods

A primary validation of the PSYCa 6–36 was conducted in Kenya (n = 319 children aged 6 to 36 months; 2014), followed by additional validations in Kenya (n = 215; 2014) Cambodia (n = 189; 2015) and Uganda (n = 182; 2016). After informed consent, trained interviewers administered the PSYCa 6–36 to caregivers participating in the study. We assessed the psychometric properties of the PSYCa 6–36 and external validity was assessed by comparing the results of the PSYCa 6–36 against a clinical global impression severity [CGIS] score rated by an independent psychologist after a structured clinical interview with each participant.

Results

The PSYCa 6–36 showed satisfactory psychometric properties (Cronbach’s alpha > 0.60 in Uganda and > 0.70 in Kenya and Cambodia), temporal stability (intra-class correlation coefficient [ICC] > 0.8), and inter-rater reliability (ICC from 0.6 in Uganda to 0.8 in Kenya). Psychologists identified psychological difficulties (CGIS score > 1) in 11 children (5.1%) in Kenya, 13 children (8.7%) in Cambodia and 15 (10.5%) in Uganda, with an area under the receiver operating characteristic curve of 0.65 in Uganda and 0.80 in Kenya and Cambodia.

Conclusions

The PSYCa 6–36 allowed for rapid screening of psychological difficulties among children aged 6 to 36 months among the populations studied. Use of the tool also increased awareness of children’s psychological difficulties and the importance of early recognition to prevent long-term consequences. The PSYCa 6–36 would benefit from further use and validation studies in popula`tions with higher prevalence of psychological difficulties.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011;378:1515–25.CrossRef Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011;378:1515–25.CrossRef
2.
go back to reference Baubet T, Taïeb O, Pradère J, Moro MR. Traumatismes psychiques dans la première enfance. Sémiologie, diagnostic et traitement. EMC-Psychiatrie. 2004;1:15–22.CrossRef Baubet T, Taïeb O, Pradère J, Moro MR. Traumatismes psychiques dans la première enfance. Sémiologie, diagnostic et traitement. EMC-Psychiatrie. 2004;1:15–22.CrossRef
3.
go back to reference Skovgaard AM, Houmann T, Christiansen E, Landorph S, Jorgensen T, Olsen EM, et al. The prevalence of mental health problems in children 1(1/2) years of age - the Copenhagen child cohort 2000. J Child Psychol Psychiatry. 2007;48:62–70.CrossRef Skovgaard AM, Houmann T, Christiansen E, Landorph S, Jorgensen T, Olsen EM, et al. The prevalence of mental health problems in children 1(1/2) years of age - the Copenhagen child cohort 2000. J Child Psychol Psychiatry. 2007;48:62–70.CrossRef
4.
go back to reference Saxena S, Thornicroft G, Knapp M, Whiteford H. Resources for mental health: scarcity, inequity, and inefficiency. Lancet. 2007;370:878–89.CrossRef Saxena S, Thornicroft G, Knapp M, Whiteford H. Resources for mental health: scarcity, inequity, and inefficiency. Lancet. 2007;370:878–89.CrossRef
5.
go back to reference Crabb J, Stewart RC, Kokota D, Masson N, Chabunya S, Krishnadas R. Attitudes towards mental illness in Malawi: a cross-sectional survey. BMC Public Health. 2012;12:541.CrossRef Crabb J, Stewart RC, Kokota D, Masson N, Chabunya S, Krishnadas R. Attitudes towards mental illness in Malawi: a cross-sectional survey. BMC Public Health. 2012;12:541.CrossRef
6.
go back to reference Kapungwe A, Cooper S, Mwanza J, Mwape L, Sikwese A, Kakuma R, et al. Mental illness--stigma and discrimination in Zambia. Afr J Psychiatry (Johannesbg ). 2010;13:192–203. Kapungwe A, Cooper S, Mwanza J, Mwape L, Sikwese A, Kakuma R, et al. Mental illness--stigma and discrimination in Zambia. Afr J Psychiatry (Johannesbg ). 2010;13:192–203.
7.
go back to reference Atilola O. Cross-cultural child and adolescent psychiatry research in developing countries. Glob Ment Health (Camb ). 2015;2:e5.CrossRef Atilola O. Cross-cultural child and adolescent psychiatry research in developing countries. Glob Ment Health (Camb ). 2015;2:e5.CrossRef
8.
go back to reference Belfer ML. Child and adolescent mental disorders: the magnitude of the problem across the globe. J Child Psychol Psychiatry. 2008;49:226–36.CrossRef Belfer ML. Child and adolescent mental disorders: the magnitude of the problem across the globe. J Child Psychol Psychiatry. 2008;49:226–36.CrossRef
9.
go back to reference Canino G, Alegria M. Psychiatric diagnosis - is it universal or relative to culture? J Child Psychol Psychiatry. 2008;49:237–50.CrossRef Canino G, Alegria M. Psychiatric diagnosis - is it universal or relative to culture? J Child Psychol Psychiatry. 2008;49:237–50.CrossRef
10.
go back to reference Cortina MA, Sodha A, Fazel M, Ramchandani PG. Prevalence of child mental health problems in sub-Saharan Africa: a systematic review. Arch Pediatr Adolesc Med. 2012;166:276–81.CrossRef Cortina MA, Sodha A, Fazel M, Ramchandani PG. Prevalence of child mental health problems in sub-Saharan Africa: a systematic review. Arch Pediatr Adolesc Med. 2012;166:276–81.CrossRef
11.
go back to reference Burns GL, Patterson DR. Factor structure of the Eyberg child behavior inventory: a parent rating scale of oppositional defiant behavior toward adults, inattentive behavior, and conduct problem behavior. J Clin Child Psychol. 2000;29:569–77.CrossRef Burns GL, Patterson DR. Factor structure of the Eyberg child behavior inventory: a parent rating scale of oppositional defiant behavior toward adults, inattentive behavior, and conduct problem behavior. J Clin Child Psychol. 2000;29:569–77.CrossRef
12.
go back to reference Robins DL, Casagrande K, Barton M, Chen CM, Dumont-Mathieu T, Fein D. Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics. 2014;133:37–45.CrossRef Robins DL, Casagrande K, Barton M, Chen CM, Dumont-Mathieu T, Fein D. Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics. 2014;133:37–45.CrossRef
13.
go back to reference Achenbach TM, Rescorla L. Manual for the ASEBA preschool forms & profiles. Burlignton: University of Vermont, Research Center for Children, Youth, and Families; 2000. Achenbach TM, Rescorla L. Manual for the ASEBA preschool forms & profiles. Burlignton: University of Vermont, Research Center for Children, Youth, and Families; 2000.
14.
go back to reference Carter AS, Briggs-Gowan MJ, Jones SM, Little TD. The infant-toddler social and emotional assessment (ITSEA): factor structure, reliability, and validity. J Abnorm Child Psychol. 2003;31:495–514.CrossRef Carter AS, Briggs-Gowan MJ, Jones SM, Little TD. The infant-toddler social and emotional assessment (ITSEA): factor structure, reliability, and validity. J Abnorm Child Psychol. 2003;31:495–514.CrossRef
15.
go back to reference Fullard W, McDevitt SC, Carey WB. Assessing temperament in one- to three-year-old children. J Pediatr Psychol. 1984;9:205–17.CrossRef Fullard W, McDevitt SC, Carey WB. Assessing temperament in one- to three-year-old children. J Pediatr Psychol. 1984;9:205–17.CrossRef
16.
go back to reference Goldsmith HH. Studying temperament via construction of the toddler behavior assessment questionnaire. Child Dev. 1996;67:218–35.CrossRef Goldsmith HH. Studying temperament via construction of the toddler behavior assessment questionnaire. Child Dev. 1996;67:218–35.CrossRef
17.
go back to reference Putnam SP, Gartstein MA, Rothbart MK. Measurement of fine-grained aspects of toddler temperament: the early childhood behavior questionnaire. Infant Behav Dev. 2006;29:386–401.CrossRef Putnam SP, Gartstein MA, Rothbart MK. Measurement of fine-grained aspects of toddler temperament: the early childhood behavior questionnaire. Infant Behav Dev. 2006;29:386–401.CrossRef
18.
go back to reference Robinson EA, Eyberg SM, Ross W. Inventory of child problem behaviors: the standardization of an inventory of child conduct problem behaviors. J Clin Child Psychol. 1980;9:22–9.CrossRef Robinson EA, Eyberg SM, Ross W. Inventory of child problem behaviors: the standardization of an inventory of child conduct problem behaviors. J Clin Child Psychol. 1980;9:22–9.CrossRef
19.
go back to reference Mouton-Simien P, McCain AP, Kelley ML. The development of the toddler behavior screening inventory. J Abnorm Child Psychol. 1997;25:59–64.CrossRef Mouton-Simien P, McCain AP, Kelley ML. The development of the toddler behavior screening inventory. J Abnorm Child Psychol. 1997;25:59–64.CrossRef
20.
go back to reference Briggs-Gowan MJ, Carter AS, Irwin JR, Wachtel K, Cicchetti DV. The brief infant-toddler social and emotional assessment: screening for social-emotional problems and delays in competence. J Pediatr Psychol. 2004;29:143–55.CrossRef Briggs-Gowan MJ, Carter AS, Irwin JR, Wachtel K, Cicchetti DV. The brief infant-toddler social and emotional assessment: screening for social-emotional problems and delays in competence. J Pediatr Psychol. 2004;29:143–55.CrossRef
21.
go back to reference DeGangi GA, Poisson S, Sickel RZ, Wiener AS. The Infant-Toddler Symptom Checklist. Tucson: Therapy Skill Builders; 1995. DeGangi GA, Poisson S, Sickel RZ, Wiener AS. The Infant-Toddler Symptom Checklist. Tucson: Therapy Skill Builders; 1995.
22.
go back to reference Marquer C, Barry C, Mouchenik Y, Hustache S, Djibo DM, Manzo ML, et al. A rapid screening tool for psychological distress in children 3-6years old: results of a validation study. BMC Psychiatry. 2012;12:170.CrossRef Marquer C, Barry C, Mouchenik Y, Hustache S, Djibo DM, Manzo ML, et al. A rapid screening tool for psychological distress in children 3-6years old: results of a validation study. BMC Psychiatry. 2012;12:170.CrossRef
23.
go back to reference Marquer C, Barry C, Mouchenik Y, Djibo DM, Manzo ML, Trujillo Maza EM, et al. Screening for psychological difficulties in young children in crisis: complementary cross-cultural validation. Int Health. 2015;7:438–46.CrossRef Marquer C, Barry C, Mouchenik Y, Djibo DM, Manzo ML, Trujillo Maza EM, et al. Screening for psychological difficulties in young children in crisis: complementary cross-cultural validation. Int Health. 2015;7:438–46.CrossRef
24.
go back to reference Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8:94–104.CrossRef Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8:94–104.CrossRef
25.
go back to reference Zero To Three/National Center for Infants. Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC: 0–3R. Washington, DC: Zero To Three/National Center for Infants; 2005. Zero To Three/National Center for Infants. Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC: 0–3R. Washington, DC: Zero To Three/National Center for Infants; 2005.
26.
go back to reference Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef
27.
go back to reference Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.CrossRef
28.
go back to reference Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966;1:245–76.CrossRef Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966;1:245–76.CrossRef
29.
go back to reference Rouquette A, Falissard B. Sample size requirements for the internal validation of psychiatric scales. Int J Methods Psychiatr Res. 2011;20:235–49.CrossRef Rouquette A, Falissard B. Sample size requirements for the internal validation of psychiatric scales. Int J Methods Psychiatr Res. 2011;20:235–49.CrossRef
30.
go back to reference Lance C, Butts M, Michels L. The sources of four commonly reported cutoff criteria what did they really say? Organ Res Methods. 2006;9:202–20.CrossRef Lance C, Butts M, Michels L. The sources of four commonly reported cutoff criteria what did they really say? Organ Res Methods. 2006;9:202–20.CrossRef
31.
go back to reference Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New-York: McGraw-Hill; 1994. Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New-York: McGraw-Hill; 1994.
32.
go back to reference Skovgaard AM, Houmann T, Landorph SL, Christiansen E. Assessment and classification of psychopathology in epidemiological research of children 0-3 years of age: a review of the literature. Eur Child Adolesc Psychiatry. 2004;13:337–46.CrossRef Skovgaard AM, Houmann T, Landorph SL, Christiansen E. Assessment and classification of psychopathology in epidemiological research of children 0-3 years of age: a review of the literature. Eur Child Adolesc Psychiatry. 2004;13:337–46.CrossRef
33.
go back to reference Zeanah CH, Boris NW, Scheeringa MS. Psychopathology in infancy. J Child Psychol Psychiatry. 1997;38:81–99.CrossRef Zeanah CH, Boris NW, Scheeringa MS. Psychopathology in infancy. J Child Psychol Psychiatry. 1997;38:81–99.CrossRef
34.
go back to reference Cha ES, Kim KH, Erlen JA. Translation of scales in cross-cultural research: issues and techniques. J Adv Nurs. 2007;58:386–95.CrossRef Cha ES, Kim KH, Erlen JA. Translation of scales in cross-cultural research: issues and techniques. J Adv Nurs. 2007;58:386–95.CrossRef
35.
go back to reference Weeks A, Swerissen H, Belfrage J. Issues, challenges, and solutions in translating study instruments. Eval Rev. 2007;31:153–65.CrossRef Weeks A, Swerissen H, Belfrage J. Issues, challenges, and solutions in translating study instruments. Eval Rev. 2007;31:153–65.CrossRef
36.
go back to reference BICK E. Notes on infant observation in psycho-analytic training. Int J Psychoanal. 1964;45:558–66.PubMed BICK E. Notes on infant observation in psycho-analytic training. Int J Psychoanal. 1964;45:558–66.PubMed
37.
go back to reference Alegria M, McGuire T. Rethinking a universal framework in the psychiatric symptom-disorder relationship. J Health Soc Behav. 2003;44:257–74.CrossRef Alegria M, McGuire T. Rethinking a universal framework in the psychiatric symptom-disorder relationship. J Health Soc Behav. 2003;44:257–74.CrossRef
38.
go back to reference Angold A, Costello EJ. Nosology and measurement in child and adolescent psychiatry. J Child Psychol Psychiatry. 2009;50:9–15.CrossRef Angold A, Costello EJ. Nosology and measurement in child and adolescent psychiatry. J Child Psychol Psychiatry. 2009;50:9–15.CrossRef
39.
go back to reference Hackett R, Hackett L. Child psychiatry across cultures. Int Rev Psychiatry. 2009;11:225–35.CrossRef Hackett R, Hackett L. Child psychiatry across cultures. Int Rev Psychiatry. 2009;11:225–35.CrossRef
40.
go back to reference Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM. A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009;62:797–806.CrossRef Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM. A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009;62:797–806.CrossRef
41.
go back to reference Carter AS, Briggs-Gowan MJ, Davis NO. Assessment of young children's social-emotional development and psychopathology: recent advances and recommendations for practice. J Child Psychol Psychiatry. 2004;45:109–34.CrossRef Carter AS, Briggs-Gowan MJ, Davis NO. Assessment of young children's social-emotional development and psychopathology: recent advances and recommendations for practice. J Child Psychol Psychiatry. 2004;45:109–34.CrossRef
42.
go back to reference Egger HL, Angold A. Common emotional and behavioral disorders in preschool children: presentation, nosology, and epidemiology. J Child Psychol Psychiatry. 2006;47:313–37.CrossRef Egger HL, Angold A. Common emotional and behavioral disorders in preschool children: presentation, nosology, and epidemiology. J Child Psychol Psychiatry. 2006;47:313–37.CrossRef
43.
go back to reference Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry. 2000;177:396–401.CrossRef Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry. 2000;177:396–401.CrossRef
44.
go back to reference Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. J Child Psychol Psychiatry. 2008;49:313–34.CrossRef Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. J Child Psychol Psychiatry. 2008;49:313–34.CrossRef
45.
46.
go back to reference Volpe U, Mihai A, Jordanova V, Sartorius N. The pathways to mental healthcare worldwide: a systematic review. Curr Opin Psychiatry. 2015;28:299–306.CrossRef Volpe U, Mihai A, Jordanova V, Sartorius N. The pathways to mental healthcare worldwide: a systematic review. Curr Opin Psychiatry. 2015;28:299–306.CrossRef
Metadata
Title
A screening tool for psychological difficulties in children aged 6 to 36 months: cross-cultural validation in Kenya, Cambodia and Uganda
Authors
Fabienne Nackers
Thomas Roederer
Caroline Marquer
Scholastic Ashaba
Samuel Maling
Juliet Mwanga-Amumpaire
Sothara Muny
Chea Sokeo
Vireak Shom
Maria Palha
Pauline Lefèbvre
Beatrice W. Kirubi
Grace Kamidigo
Bruno Falissard
Marie-Rose Moro
Rebecca F. Grais
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2019
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-019-1461-3

Other articles of this Issue 1/2019

BMC Pediatrics 1/2019 Go to the issue