Skip to main content
Top
Published in: Critical Care 1/2015

Open Access 01-12-2015 | Research

Prospective validation of pediatric disease severity scores to predict mortality in Ugandan children presenting with malaria and non-malaria febrile illness

Authors: Andrea L Conroy, Michael Hawkes, Kyla Hayford, Sophie Namasopo, Robert O Opoka, Chandy C John, W Conrad Liles, Kevin C Kain

Published in: Critical Care | Issue 1/2015

Login to get access

Abstract

Introduction

The development of simple clinical tools to identify children at risk of death would enable rapid and rational implementation of lifesaving measures to reduce childhood mortality globally.

Methods

We evaluated the ability of three clinical scoring systems to predict in-hospital mortality in a prospective observational study of Ugandan children with fever. We computed the Lambaréné Organ Dysfunction Score (LODS), Signs of Inflammation in Children that Kill (SICK), and the Pediatric Early Death Index for Africa (PEDIA). Model discrimination was evaluated by comparing areas under receiver operating characteristic curves (AUCs) and calibration was assessed using the Hosmer-Lemeshow goodness-of-fit test. Sub-analyses were performed in malaria versus non-malaria febrile illness (NMFI), and in early (≤48 hours) versus late (>48 hours) deaths.

Results

In total, 2089 children with known outcomes were included in the study (99 deaths, 4.7% mortality). All three scoring systems yielded good discrimination (AUCs, 95% confidence interval (CI): LODS, 0.90, 0.88 to 0.91; SICK, 0.85, 0.83 to 0.86; PEDIA, 0.90, 0.88 to 0.91). Using the Youden index to identify the best cut-offs, LODS had the highest positive likelihood ratio (+LR, 95% CI: LODS, 6.5, 5.6 to 7.6; SICK, 4.4, 3.9 to 5.0; PEDIA, 4.4, 3.9 to 5.0), whereas PEDIA had the lowest negative likelihood ratio (−LR, 95% CI: LODS, 0.21, 0.1 to 0.3; SICK, 0.22, 0.1 to 0.3; PEDIA, 0.16, 0.1 to 0.3), LODS and PEDIA were well calibrated (P = 0.79 and P = 0.21 respectively), and had higher AUCs than SICK in discriminating between survivors and non-survivors in malaria (AUCs, 95% CI: LODS, 0.92, 0.90 to 0.93; SICK, 0.86, 0.84 to 0.87; PEDIA, 0.92, 0.90 to 0.93), but comparable AUCs in NMFI (AUCs, 95% CI: LODS, 0.86, 0.83 to 0.89; SICK, 0.82, 0.79 to 0.86; PEDIA, 0.87, 0.83 to 0.893). The majority of deaths in the study occurred early (n = 85, 85.9%) where LODS and PEDIA had good discrimination.

Conclusions

All three scoring systems predicted outcome, but LODS holds the most promise as a clinical prognostic score based on its simplicity to compute, requirement for no equipment, and good discrimination.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rajaratnam JK, Marcus JR, Flaxman AD, Wang H, Levin-Rector A, Dwyer L, et al. Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970–2010: a systematic analysis of progress towards Millennium Development Goal 4. Lancet. 2010;375:1988–2008.CrossRef Rajaratnam JK, Marcus JR, Flaxman AD, Wang H, Levin-Rector A, Dwyer L, et al. Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970–2010: a systematic analysis of progress towards Millennium Development Goal 4. Lancet. 2010;375:1988–2008.CrossRef
2.
go back to reference Wang H, Liddell CA, Coates MM, Mooney MD, Levitz CE, Schumacher AE, et al. Global, regional, and national levels of neonatal, infant, and under-5 mortality during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:957–79.CrossRef Wang H, Liddell CA, Coates MM, Mooney MD, Levitz CE, Schumacher AE, et al. Global, regional, and national levels of neonatal, infant, and under-5 mortality during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:957–79.CrossRef
3.
go back to reference United Nations Children’s Fund. Levels & Trends in Child Mortality. Report 2013. Estimates Developed by the UN Inter-agency Group for Child Mortality Estimation. 3 UN Plaza, New York, New York, 10017 USA: United Nations Children’s Fund; 2013. United Nations Children’s Fund. Levels & Trends in Child Mortality. Report 2013. Estimates Developed by the UN Inter-agency Group for Child Mortality Estimation. 3 UN Plaza, New York, New York, 10017 USA: United Nations Children’s Fund; 2013.
4.
go back to reference World Health Organization. Emergency triage assessment and treatment course. 20, Avenue Appia, 1211 Geneva 27, Switzerland: World Health Organization; 2005. World Health Organization. Emergency triage assessment and treatment course. 20, Avenue Appia, 1211 Geneva 27, Switzerland: World Health Organization; 2005.
5.
go back to reference Pollack MM, Ruttimann UE, Getson PR. Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988;16:1110–6.CrossRef Pollack MM, Ruttimann UE, Getson PR. Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988;16:1110–6.CrossRef
6.
go back to reference Shann F, Pearson G, Slater A, Wilkinson K. Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care. Intensive Care Med. 1997;23:201–7.CrossRef Shann F, Pearson G, Slater A, Wilkinson K. Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care. Intensive Care Med. 1997;23:201–7.CrossRef
7.
go back to reference Helbok R, Issifou S, Matsiegui PB, Lackner P, Missinou MA, Kombila D, et al. Simplified multi-organ dysfunction score predicts disability in African children with Plasmodium falciparum malaria. Am J Trop Med Hyg. 2006;75:443–7.CrossRef Helbok R, Issifou S, Matsiegui PB, Lackner P, Missinou MA, Kombila D, et al. Simplified multi-organ dysfunction score predicts disability in African children with Plasmodium falciparum malaria. Am J Trop Med Hyg. 2006;75:443–7.CrossRef
8.
go back to reference Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, et al. Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003;362:192–7.CrossRef Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, et al. Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003;362:192–7.CrossRef
9.
go back to reference Duncan H, Hutchison J, Parshuram CS. The Pediatric Early Warning System score: a severity of illness score to predict urgent medical need in hospitalized children. J Crit Care. 2006;21:271–8.CrossRef Duncan H, Hutchison J, Parshuram CS. The Pediatric Early Warning System score: a severity of illness score to predict urgent medical need in hospitalized children. J Crit Care. 2006;21:271–8.CrossRef
10.
go back to reference Parshuram CS, Hutchison J, Middaugh K. Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care. 2009;13:R135.CrossRef Parshuram CS, Hutchison J, Middaugh K. Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care. 2009;13:R135.CrossRef
11.
go back to reference Egdell P, Finlay L, Pedley DK. The PAWS score: validation of an early warning scoring system for the initial assessment of children in the emergency department. Emerg Med J. 2008;25:745–9.CrossRef Egdell P, Finlay L, Pedley DK. The PAWS score: validation of an early warning scoring system for the initial assessment of children in the emergency department. Emerg Med J. 2008;25:745–9.CrossRef
12.
go back to reference Kumar N, Thomas N, Singhal D, Puliyel JM, Sreenivas V. Triage score for severity of illness. Indian Pediatr. 2003;40:204–10.PubMed Kumar N, Thomas N, Singhal D, Puliyel JM, Sreenivas V. Triage score for severity of illness. Indian Pediatr. 2003;40:204–10.PubMed
13.
go back to reference Gupta MA, Chakrabarty A, Halstead R, Sahni M, Rangasami J, Puliyel A, et al. Validation of “Signs of Inflammation in Children that Kill” (SICK) score for immediate non-invasive assessment of severity of illness. Ital J Pediatr. 2010;36:35.CrossRef Gupta MA, Chakrabarty A, Halstead R, Sahni M, Rangasami J, Puliyel A, et al. Validation of “Signs of Inflammation in Children that Kill” (SICK) score for immediate non-invasive assessment of severity of illness. Ital J Pediatr. 2010;36:35.CrossRef
14.
go back to reference Helbok R, Kendjo E, Issifou S, Lackner P, Newton Charles R, Kombila M, et al. The Lambaréné Organ Dysfunction Score (LODS) is a simple clinical predictor of fatal malaria in African children. J Infect Dis. 2009;200:1834–41.CrossRef Helbok R, Kendjo E, Issifou S, Lackner P, Newton Charles R, Kombila M, et al. The Lambaréné Organ Dysfunction Score (LODS) is a simple clinical predictor of fatal malaria in African children. J Infect Dis. 2009;200:1834–41.CrossRef
15.
go back to reference Berkley JA, Ross A, Mwangi I, Osier FH, Mohammed M, Shebbe M, et al. Prognostic indicators of early and late death in children admitted to district hospital in Kenya: cohort study. BMJ. 2003;326:361.CrossRef Berkley JA, Ross A, Mwangi I, Osier FH, Mohammed M, Shebbe M, et al. Prognostic indicators of early and late death in children admitted to district hospital in Kenya: cohort study. BMJ. 2003;326:361.CrossRef
16.
go back to reference Okello PE, Van Bortel W, Byaruhanga AM, Correwyn A, Roelants P, Talisuna A, et al. Variation in malaria transmission intensity in seven sites throughout Uganda. Am J Trop Med Hyg. 2006;75:219–25.CrossRef Okello PE, Van Bortel W, Byaruhanga AM, Correwyn A, Roelants P, Talisuna A, et al. Variation in malaria transmission intensity in seven sites throughout Uganda. Am J Trop Med Hyg. 2006;75:219–25.CrossRef
17.
go back to reference Hawkes M, Conroy AL, Opoka RO, Namasopo S, Liles WC, John CC, et al. Use of a three-band HRP2/pLDH combination rapid diagnostic test increases diagnostic specificity for falciparum malaria in Ugandan children. Malar J. 2014;13:43.CrossRef Hawkes M, Conroy AL, Opoka RO, Namasopo S, Liles WC, John CC, et al. Use of a three-band HRP2/pLDH combination rapid diagnostic test increases diagnostic specificity for falciparum malaria in Ugandan children. Malar J. 2014;13:43.CrossRef
18.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45.CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45.CrossRef
19.
go back to reference Taylor T, Olola C, Valim C, Agbenyega T, Kremsner P, Krishna S, et al. Standardized data collection for multi-center clinical studies of severe malaria in African children: establishing the SMAC network. Trans R Soc Trop Med Hyg. 2006;100:615–22.CrossRef Taylor T, Olola C, Valim C, Agbenyega T, Kremsner P, Krishna S, et al. Standardized data collection for multi-center clinical studies of severe malaria in African children: establishing the SMAC network. Trans R Soc Trop Med Hyg. 2006;100:615–22.CrossRef
20.
go back to reference Kendjo E, Agbenyega T, Bojang K, Newton CR, Bouyou-Akotet M, Pedross F, et al. Mortality patterns and site heterogeneity of severe malaria in African children. PLoS One. 2013;8:e58686.CrossRef Kendjo E, Agbenyega T, Bojang K, Newton CR, Bouyou-Akotet M, Pedross F, et al. Mortality patterns and site heterogeneity of severe malaria in African children. PLoS One. 2013;8:e58686.CrossRef
21.
go back to reference Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, et al. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: a systematic analysis of progress, projections, and priorities. PLoS Med. 2011;8:e1001080.CrossRef Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, et al. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: a systematic analysis of progress, projections, and priorities. PLoS Med. 2011;8:e1001080.CrossRef
Metadata
Title
Prospective validation of pediatric disease severity scores to predict mortality in Ugandan children presenting with malaria and non-malaria febrile illness
Authors
Andrea L Conroy
Michael Hawkes
Kyla Hayford
Sophie Namasopo
Robert O Opoka
Chandy C John
W Conrad Liles
Kevin C Kain
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2015
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-015-0773-4

Other articles of this Issue 1/2015

Critical Care 1/2015 Go to the issue