Top

BMC Psychiatry

Published in:

Open Access 01-12-2021 | Research article

Routine outcome measurement in adolescents seeking mental health services: standardization of HoNOSCA in Kenyan sample

Authors: Grace Nduku Wambua, Manasi Kumar, Fredrik Falkenström, Pim Cuijpers

Published in: BMC Psychiatry | Issue 1/2021

Abstract

Background

The evaluation of treatment outcomes is important for service providers to assess if there is improvement or not. The Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) was developed for this use in child and adolescent mental health services. Outcome measurement in routine mental health services is limited. This paper evaluates the psychometric properties of the self and clinician rated versions of the HoNOSCA for routine use in child and adolescent mental health services in Kenya.

Methods

Using a prospective design, the clinician- and self-rated versions of the HoNOSCA and the Paediatric Symptom Checklist (PSC) were administered at the Youth Centre at the Kenyatta National Hospital in Nairobi. Initial ratings were obtained from adolescents 12-17 years (n = 201). A sample of 98 paired ratings with 2 follow-ups were examined for measurement of change over time.

Results

Our findings showed good reliability with the self-rated version of the HoNOSCA score, correlating well with the self-reported version of the PSC (r = .74, p < .001). Both versions correlated well at follow-up and were sensitive to change. Using factor analysis, the maximum likelihood factoring and Promax rotation resulted in a four-factor structure, which with a Kaiser–Meyer–Olkin measure of sampling adequacy of 0.8 explained 54.74% of total variance.

Conclusion

The HoNOSCA appears to be of value, and easy to use in routine settings. Our findings suggest further investigation with a larger sample.

Klasen H, Claire CA. What works where? A systematic review of child and adolescent mental health interventions for low- and middle-income countries. Soc Psychiatry Psychiatr Epidemiol. 2013;48(4):595–1. https://doi.org/10.1007/s00127-012-0566-x.CrossRefPubMed

Waddell C, Shepherd CA, Schwartz C, Barican J. Child and youth mental disorders: prevalence and evidence-based interventions. Vancouver: Children’s Health Policy Centre, Simon Fraser University; 2014.

Das JK, Salam RA, Lassi ZS, Khan MN, Mahmood W, Patel V, et al. Interventions for adolescent mental health: an overview of systematic reviews. J Adolesc Health. 2016;59(4S):S49–60. https://doi.org/10.1016/j.jadohealth.2016.06.020.CrossRefPubMedPubMedCentral

Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, et al. What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. Am Psychol. 2017;72(2):79–117. https://doi.org/10.1037/a0040360.CrossRefPubMed

Uppendahl JR, Alozkan-Sever C, Cuijpers P, de Vries R, Sijbrandij M. Psychological and psychosocial interventions for PTSD, depression and anxiety among children and adolescents in low- and middle-income countries: A meta-analysis. Front Psychiatry. 10:933. https://doi.org/10.3389/fpsyt.2019.

Ridge NW, Warren JS, Burlingame GM, Wells MG, Tumblin KM. Reliability and validity of the youth outcome questionnaire self-report. J Clin Psychol. 2009;65(10):1115–26. https://doi.org/10.1002/jclp.20620.CrossRefPubMed

Thornicroft G, Slade M. New trends in assessing the outcomes of mental health interventions. World Psychiatry. 2014;13(2):118–24. https://doi.org/10.1002/wps.20114.CrossRefPubMedPubMedCentral

Kwan B, Rickwood DJ. A systematic review of mental health outcome measures for young people aged 12 to 25 years. BMC Psychiatry. 2015;15(1):279. https://doi.org/10.1186/s12888-015-0664-x.CrossRefPubMedPubMedCentral

Bentley N, Hartley S, Bucci S. Systematic review of self-report measures of general mental health and wellbeing in adolescent mental health. Clin Child Fam Psychol Rev. 2019;22(2):225–52. https://doi.org/10.1007/s10567-018-00273-x.CrossRefPubMed

10.

Hall CL, Moldavsky M, Taylor J, Sayal K, Marriott M, Batty MJ, et al. Implementation of routine outcome measurement in child and adolescent mental health services in the United Kingdom: a critical perspective. Eur Child Adolesc Psychiatry. 2014;23(4):239–42. https://doi.org/10.1007/s00787-013-0454.2.CrossRefPubMed

11.

Wing JK, Beevor AS, Curtis RH, Park SB, Hadden S, Burns A. Health of the nation outcome scales (HoNOS). Research and development. Br J Psychiatry. 1998;172(1):11–8. https://doi.org/10.1192/bjp.172.1.11.CrossRefPubMed

12.

Wing JK, Lelliott P, Beevor AS. Progress on HoNOS. Br J Psychiatry. 2000;176(4):392–3. https://doi.org/10.1192/bjp.176.4.392.CrossRef

13.

Pirkis JE, Burgess PM, Kirk PK, Dodson S, Combs TJ, Williamson MK. A review of the psychometric properties of the health of the nation outcome scales (HoNOS) family of measures. Health Qual Life Outcomes. 2005;3(1):76. https://doi.org/10.1186/1477-7525-3-76.CrossRefPubMedPubMedCentral

14.

Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, et al. Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the nation outcome scales for children and adolescents (HoNOSCA). Br J Psychiatry. 1999;174(5):413–6. https://doi.org/10.1192/bjp.174.5.413.CrossRefPubMed

15.

Gowers SG, Weetman J, Shore A, et al. Impact of hospitalisation on the outcome of adolescent anorexia nervosa. Br J Psychiatry. 2000;176(2):138–41. https://doi.org/10.1192/bjp.176.2.138.CrossRefPubMed

16.

Gowers S, Levine W, Bailey-Rogers S, Shore A, Burhouse E. Use of a routine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health services. Br J Psychiatry. 2002;180(3):266–9. https://doi.org/10.1192/bjp.180.3.266.CrossRefPubMed

17.

Ballesteros-Urpí A, Pardo-Hernández H, Ferrero-Gregori A, Torralbas-Ortega J, Puntí-Vidal J, Olivet PT, et al. Validation of the Spanish and Catalan versions of the Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA). Psychiatry Res. 2018;261:554–9.CrossRef

18.

Adamis D, Giannakopoulou DF, Konstantopoulou A, Michailedes M. Translation and standardization of the HoNOSCA (health of the nation outcome scales for children and adolescents) scale in a Greek sample. Clin Child Psychol Psychiatry. 2011;16(4):567–73. https://doi.org/10.1177/1359104510387881.CrossRefPubMed

19.

Achenbach TM, Rescorla LA. Manual for the ASEBA School-age Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth & Families; 2001.

20.

Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;38(5):581–6. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed

21.

Vreeman RC, Scanlon ML, Marete I, Mwangi A, Inui TS, McAteer CI, et al. Characteristics of HIV-infected adolescents enrolled in a disclosure intervention trial in western Kenya. AIDS Care. 2015;27(sup1):6–17.CrossRef

22.

Mathai J, Anderson P, Bourne A. The strengths and difficulties questionnaire (SDQ) as a screening measure prior to admission to a child and adolescent mental health service (CAMHS). Aust e-J Adv Mental Health. 2002;1:1–11.CrossRef

23.

Kariuki SM, Abubakar A, Kombe M, Kazungu M, Odhiambo R, Stein A, et al. Burden, risk factors, and comorbidities of behavioural and emotional problems in Kenyan children: a population-based study. Lancet Psychiatry. 2017;4(2):136–45. https://doi.org/10.1016/S2215-0366(16)30403-5.CrossRefPubMedPubMedCentral

24.

Magai DN, Malik JA, Koot HM. Emotional and behavioral problems in children and adolescents in Central Kenya. Child Psychiatry Hum Dev. 2018;49(4):659–71. https://doi.org/10.1007/s10578-018-0783-y.CrossRefPubMedPubMedCentral

25.

Magai DN, Koot HM. Quality of life in children and adolescents in Central Kenya: associations with emotional and behavioral problems. Qual Life Res. 2019;28(5):1271–9. https://doi.org/10.1007/s11136-019-02099-8.CrossRefPubMedPubMedCentral

26.

Wambua GN, Obondo A, Bifulco A, Kumar M. The role of attachment relationship in adolescents' problem behavior development: a cross-sectional study of Kenyan adolescents in Nairobi city. Child Adolesc Psychiatry Ment Health. 2018;12(1). https://doi.org/10.1186/s13034-018-0237-0.

27.

Garralda ME, Yates P, Higginson I. Child and adolescent mental health service use: HoNOSCA as an outcome measure. Br J Psychiatry. 2000;177(1):52–8. https://doi.org/10.1192/bjp.177.1.52.CrossRefPubMed

28.

Brann P, Coleman G, Luke E. Routine Outcome Measurement in a Child and Adolescent Mental Health Service: An Evaluation of HoNOSCA. Aust N Z J Psychiatry. 2001;35(3):370–6. https://doi.org/10.1046/j.1440-1614.2001.00890.x.CrossRefPubMed

29.

Hanssen-Bauer K, Langsrud O, Kvernmo S, Heyerdahl S. Clinician-rated mental health in outpatient child and adolescent mental health services: associations with parent, teacher, and adolescent ratings. Child Adolesc Psychiatry Ment Health. 2010;4(1):29. https://doi.org/10.1186/1753-2000-4-29.CrossRefPubMedPubMedCentral

30.

Manderson J, McCune N. The use of HoNOSCA in a child and adolescent mental health service. Ir J Psychol Med. 2003;20(2):52–5. https://doi.org/10.1017/S0790966700007618.CrossRefPubMed

31.

Jellinek MS, Murphy JM, Burns BJ. Brief psychosocial screening in outpatient paediatric practice. J Pediatr. 1986;109(2):371–8. https://doi.org/10.1016/S0022-3476(86)80408-5.CrossRefPubMed

32.

Murphy JM, Reede J, Jellinek MS, Bishop SJ. Screening for psychosocial dysfunction in inner-city children: further validation of the paediatric symptom checklist. J Am Acad Child Adolesc Psychiatry. 1992;31(6):1105–11. https://doi.org/10.1097/00004583-199211000-00019.CrossRefPubMed

33.

Lowenthal E, Lawler K, Harari N, Moamogwe L, Masunge J, Masedi M, et al. Validation of the pediatric symptom checklist in HIV-infected Batswana. J Child Adolesc Ment Health. 2011;23(1):17–28. https://doi.org/10.2989/17280583.2011.594245.CrossRefPubMedPubMedCentral

34.

Wambua GN, Kumar M, Falkenström F, Cuijpers P. Process and outcome of child psychotherapies offered in Kenya: a mixed methods study protocol on improving child mental health. BMC Psychiatry. 2020;20(1):263. https://doi.org/10.1186/s12888-020-02611-2.CrossRefPubMedPubMedCentral

35.

Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998;7:301–17.CrossRef

36.

Harnett PH, Loxton NJ, Sadler T, Hides L, Baldwin A. The Health of the Nation Outcome Scales for Children and Adolescents in an Adolescent In-Patient Sample. Aust N Z J Psychiatry. 2005;39(3):129–35. https://doi.org/10.1080/j.1440-1614.2005.01533.x.CrossRefPubMed

37.

D'Avanzo B, Lovaglio P, Parabiaghi A, Conti P, Frigerio A, Molteni M, et al. Health of the nation outcome scales for children and adolescents (HoNOSCA): psychometric properties of the Italian version. Child Youth Serv Rev. 2018;94:340–6. https://doi.org/10.1016/j.childyouth.2018.10.005.CrossRef

38.

Tiffin PA, Rolling K. Structure of the Health of the Nation Outcome Scales for Children and Adolescents: An ordinal factor analysis of clinician rating of a sample of young people referred to community mental health services. Psychiatry Res. 2012;212(197):154–62.CrossRef

Title: Routine outcome measurement in adolescents seeking mental health services: standardization of HoNOSCA in Kenyan sample
Authors: Grace Nduku Wambua
Manasi Kumar
Fredrik Falkenström
Pim Cuijpers
Publication date: 01-12-2021
Publisher: BioMed Central
Published in: BMC Psychiatry / Issue 1/2021
Electronic ISSN: 1471-244X
DOI: https://doi.org/10.1186/s12888-021-03438-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Routine outcome measurement in adolescents seeking mental health services: standardization of HoNOSCA in Kenyan sample

Abstract

Background

Methods

Results

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2021

Survival states as indicators of learning performance and biological stress in refugee children: a cross-sectional study with a comparison group

Role of SES on the association between childhood parental death and adulthood suicidal ideation: a mediation analysis using longitudinal dataset in South Korea

Magnitude and associated factors of substance use among pregnant women attending antenatal care in public hospitals of eastern Ethiopia

Efficient visual search for facial emotions in patients with major depression

Person-centered, non-pharmacological intervention in reducing psychotropic medications use among residents with dementia in Australian rural aged care homes

Aripiprazole in the real-world treatment for irritability associated with autism spectrum disorder in children and adolescents in Japan: 52-week post-marketing surveillance