Skip to main content
Top
Published in: BMC Pediatrics 1/2018

Open Access 01-12-2018 | Research article

Development and validation of a diagnostic model for early differentiation of sepsis and non-infectious SIRS in critically ill children - a data-driven approach using machine-learning algorithms

Authors: Florian Lamping, Thomas Jack, Nicole Rübsamen, Michael Sasse, Philipp Beerbaum, Rafael T. Mikolajczyk, Martin Boehne, André Karch

Published in: BMC Pediatrics | Issue 1/2018

Login to get access

Abstract

Background

Since early antimicrobial therapy is mandatory in septic patients, immediate diagnosis and distinction from non-infectious SIRS is essential but hampered by the similarity of symptoms between both entities. We aimed to develop a diagnostic model for differentiation of sepsis and non-infectious SIRS in critically ill children based on routinely available parameters (baseline characteristics, clinical/laboratory parameters, technical/medical support).

Methods

This is a secondary analysis of a randomized controlled trial conducted at a German tertiary-care pediatric intensive care unit (PICU). Two hundred thirty-eight cases of non-infectious SIRS and 58 cases of sepsis (as defined by IPSCC criteria) were included. We applied a Random Forest approach to identify the best set of predictors out of 44 variables measured at the day of onset of the disease. The developed diagnostic model was validated in a temporal split-sample approach.

Results

A model including four clinical (length of PICU stay until onset of non-infectious SIRS/sepsis, central line, core temperature, number of non-infectious SIRS/sepsis episodes prior to diagnosis) and four laboratory parameters (interleukin-6, platelet count, procalcitonin, CRP) was identified in the training dataset. Validation in the test dataset revealed an AUC of 0.78 (95% CI: 0.70–0.87). Our model was superior to previously proposed biomarkers such as CRP, interleukin-6, procalcitonin or a combination of CRP and procalcitonin (maximum AUC = 0.63; 95% CI: 0.52–0.74). When aiming at a complete identification of sepsis cases (100%; 95% CI: 87–100%), 28% (95% CI: 20–38%) of non-infectious SIRS cases were assorted correctly.

Conclusions

Our approach allows early recognition of sepsis with an accuracy superior to previously described biomarkers, and could potentially reduce antibiotic use by 30% in non-infectious SIRS cases. External validation studies are necessary to confirm the generalizability of our approach across populations and treatment practices.

Trial registration

ClinicalTrials.​gov number: NCT00209768; registration date: September 21, 2005.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goldstein B, Giroir B, Randolph A. International consensus conference on pediatric S: international pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. 2005;6:2–8.CrossRefPubMed Goldstein B, Giroir B, Randolph A. International consensus conference on pediatric S: international pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. 2005;6:2–8.CrossRefPubMed
2.
go back to reference Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA et al. American-College of Chest Physicians Society of Critical Care Medicine Consensus Conference - Definitions for Sepsis and Organ Failure and Guidelines for the Use of Innovative Therapies in Sepsis. Crit Care Med. 1992;20:864–74. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA et al. American-College of Chest Physicians Society of Critical Care Medicine Consensus Conference - Definitions for Sepsis and Organ Failure and Guidelines for the Use of Innovative Therapies in Sepsis. Crit Care Med. 1992;20:864–74.
3.
go back to reference Gebara BM. Values for systolic blood pressure. Pediatr Crit Care Med. 2005;6:500. author reply 500-501CrossRefPubMed Gebara BM. Values for systolic blood pressure. Pediatr Crit Care Med. 2005;6:500. author reply 500-501CrossRefPubMed
4.
go back to reference Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315:801–10.CrossRefPubMedPubMedCentral Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315:801–10.CrossRefPubMedPubMedCentral
5.
go back to reference Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, Feinstein D, Zanotti S, Taiberg L, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med. 2006;34:1589–96.CrossRefPubMed Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, Feinstein D, Zanotti S, Taiberg L, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med. 2006;34:1589–96.CrossRefPubMed
6.
go back to reference Ratzinger F, Schuardt M, Eichbichler K, Tsirkinidou I, Bauer M, Haslacher H, Mitteregger D, Binder M, Burgmann H. Utility of sepsis biomarkers and the infection probability score to discriminate sepsis and systemic inflammatory response syndrome in standard care patients. PLoS One. 2013;8:e82946.CrossRefPubMedPubMedCentral Ratzinger F, Schuardt M, Eichbichler K, Tsirkinidou I, Bauer M, Haslacher H, Mitteregger D, Binder M, Burgmann H. Utility of sepsis biomarkers and the infection probability score to discriminate sepsis and systemic inflammatory response syndrome in standard care patients. PLoS One. 2013;8:e82946.CrossRefPubMedPubMedCentral
7.
go back to reference Hall TC, Bilku DK, Al-Leswas D, Horst C, Dennison AR. Biomarkers for the differentiation of sepsis and SIRS: the need for the standardisation of diagnostic studies. Ir J Med Sci. 2011;180:793–8.CrossRefPubMed Hall TC, Bilku DK, Al-Leswas D, Horst C, Dennison AR. Biomarkers for the differentiation of sepsis and SIRS: the need for the standardisation of diagnostic studies. Ir J Med Sci. 2011;180:793–8.CrossRefPubMed
9.
go back to reference Brunkhorst FM, Wegscheider K, Forycki ZF, Brunkhorst R. Procalcitonin for early diagnosis and differentiation of SIRS, sepsis, severe sepsis, and septic shock. Intensive Care Med. 2000;26(Suppl 2):S148–52.CrossRefPubMed Brunkhorst FM, Wegscheider K, Forycki ZF, Brunkhorst R. Procalcitonin for early diagnosis and differentiation of SIRS, sepsis, severe sepsis, and septic shock. Intensive Care Med. 2000;26(Suppl 2):S148–52.CrossRefPubMed
10.
go back to reference Selberg O, Hecker H, Martin M, Klos A, Bautsch W, Kohl J. Discrimination of sepsis and systemic inflammatory response syndrome by determination of circulating plasma concentrations of procalcitonin, protein complement 3a, and interleukin-6. Crit Care Med. 2000;28:2793–8.CrossRefPubMed Selberg O, Hecker H, Martin M, Klos A, Bautsch W, Kohl J. Discrimination of sepsis and systemic inflammatory response syndrome by determination of circulating plasma concentrations of procalcitonin, protein complement 3a, and interleukin-6. Crit Care Med. 2000;28:2793–8.CrossRefPubMed
11.
go back to reference Neunhoeffer F, Plinke S, Renk H, Hofbeck M, Fuchs J, Kumpf M, Zundel S, Seitz G. Serum concentrations of Interleukin-6, procalcitonin, and C-reactive protein: discrimination of septical complications and systemic inflammatory response syndrome after pediatric surgery. Eur J Pediatr Surg. 2016;26:180–5.PubMed Neunhoeffer F, Plinke S, Renk H, Hofbeck M, Fuchs J, Kumpf M, Zundel S, Seitz G. Serum concentrations of Interleukin-6, procalcitonin, and C-reactive protein: discrimination of septical complications and systemic inflammatory response syndrome after pediatric surgery. Eur J Pediatr Surg. 2016;26:180–5.PubMed
13.
go back to reference Neugebauer U, Trenkmann S, Bocklitz T, Schmerler D, Kiehntopf M, Popp J. Fast differentiation of SIRS and sepsis from blood plasma of ICU patients using Raman spectroscopy. J Biophotonics. 2014;7:232–40.CrossRefPubMed Neugebauer U, Trenkmann S, Bocklitz T, Schmerler D, Kiehntopf M, Popp J. Fast differentiation of SIRS and sepsis from blood plasma of ICU patients using Raman spectroscopy. J Biophotonics. 2014;7:232–40.CrossRefPubMed
14.
go back to reference Han JH, Nachamkin I, Coffin SE, Gerber JS, Fuchs B, Garrigan C, Han X, Bilker WB, Wise J, Tolomeo P, et al. Use of a combination biomarker algorithm to identify medical intensive care unit patients with suspected sepsis at very low likelihood of bacterial infection. Antimicrob Agents Chemother. 2015;59:6494–500.CrossRefPubMedPubMedCentral Han JH, Nachamkin I, Coffin SE, Gerber JS, Fuchs B, Garrigan C, Han X, Bilker WB, Wise J, Tolomeo P, et al. Use of a combination biomarker algorithm to identify medical intensive care unit patients with suspected sepsis at very low likelihood of bacterial infection. Antimicrob Agents Chemother. 2015;59:6494–500.CrossRefPubMedPubMedCentral
15.
go back to reference Kofoed K, Andersen O, Kronborg G, Tvede M, Petersen J, Eugen-Olsen J, Larsen K. Use of plasma C-reactive protein, procalcitonin, neutrophils, macrophage migration inhibitory factor, soluble urokinase-type plasminogen activator receptor, and soluble triggering receptor expressed on myeloid cells-1 in combination to diagnose infections: a prospective study. Crit Care. 2007;11:R38.CrossRefPubMedPubMedCentral Kofoed K, Andersen O, Kronborg G, Tvede M, Petersen J, Eugen-Olsen J, Larsen K. Use of plasma C-reactive protein, procalcitonin, neutrophils, macrophage migration inhibitory factor, soluble urokinase-type plasminogen activator receptor, and soluble triggering receptor expressed on myeloid cells-1 in combination to diagnose infections: a prospective study. Crit Care. 2007;11:R38.CrossRefPubMedPubMedCentral
16.
go back to reference Jack T, Boehne M, Brent BE, Hoy L, Koditz H, Wessel A, Sasse M. In-line filtration reduces severe complications and length of stay on pediatric intensive care unit: a prospective, randomized, controlled trial. Intensive Care Med. 2012;38:1008–16.CrossRefPubMedPubMedCentral Jack T, Boehne M, Brent BE, Hoy L, Koditz H, Wessel A, Sasse M. In-line filtration reduces severe complications and length of stay on pediatric intensive care unit: a prospective, randomized, controlled trial. Intensive Care Med. 2012;38:1008–16.CrossRefPubMedPubMedCentral
17.
go back to reference Calandra T, Cohen J, International Sepsis Forum Definition of Infection in the ICUCC. The international sepsis forum consensus conference on definitions of infection in the intensive care unit. Critical care medicine. 2005;33:1538–48.PubMed Calandra T, Cohen J, International Sepsis Forum Definition of Infection in the ICUCC. The international sepsis forum consensus conference on definitions of infection in the intensive care unit. Critical care medicine. 2005;33:1538–48.PubMed
18.
go back to reference Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008;36:309–32. Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008;36:309–32.
19.
go back to reference Stekhoven DJ, Buhlmann P. MissForest--non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8.CrossRefPubMed Stekhoven DJ, Buhlmann P. MissForest--non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8.CrossRefPubMed
20.
go back to reference Waljee AK, Mukherjee A, Singal AG, Zhang Y, Warren J, Balis U, Marrero J, Zhu J, Higgins PD. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open. 2013;3:e002847. Waljee AK, Mukherjee A, Singal AG, Zhang Y, Warren J, Balis U, Marrero J, Zhu J, Higgins PD. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open. 2013;3:e002847.
21.
go back to reference Boulesteix AL, Janitza S, Kruppa J, König IR. Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics. Wiley Interdiscip Rev Data Min Knowl Discov. 2012;2:493–507.CrossRef Boulesteix AL, Janitza S, Kruppa J, König IR. Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics. Wiley Interdiscip Rev Data Min Knowl Discov. 2012;2:493–507.CrossRef
23.
24.
go back to reference Hothorn T, Hornik K, Zeileis A. Unbiased recursive partitioning: a conditional inference framework. J Comput Graph Stat. 2006;15:651–74.CrossRef Hothorn T, Hornik K, Zeileis A. Unbiased recursive partitioning: a conditional inference framework. J Comput Graph Stat. 2006;15:651–74.CrossRef
25.
go back to reference Calle ML, Urrea V, Boulesteix AL, Malats N. AUC-RF: a new strategy for genomic profiling with random forest. Hum Hered. 2011;72:121–32.CrossRefPubMed Calle ML, Urrea V, Boulesteix AL, Malats N. AUC-RF: a new strategy for genomic profiling with random forest. Hum Hered. 2011;72:121–32.CrossRefPubMed
26.
27.
go back to reference Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, Vickers AJ, Ransohoff DF, Collins GS. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162:W1–73.CrossRefPubMed Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, Vickers AJ, Ransohoff DF, Collins GS. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162:W1–73.CrossRefPubMed
29.
go back to reference James G, Witten D, Hastie T, Tibshirani R: An introduction to statistical learning: with applications in R. New York: Springer Publishing Company, Incorporated; 2014. James G, Witten D, Hastie T, Tibshirani R: An introduction to statistical learning: with applications in R. New York: Springer Publishing Company, Incorporated; 2014.
30.
go back to reference da Souza DC, Costa GA. New clinical criteria for sepsis in children-finally, what is the most important thing: sensitivity or specificity? Pediatr Crit Care Med. 2017;18:1006–7.CrossRefPubMed da Souza DC, Costa GA. New clinical criteria for sepsis in children-finally, what is the most important thing: sensitivity or specificity? Pediatr Crit Care Med. 2017;18:1006–7.CrossRefPubMed
Metadata
Title
Development and validation of a diagnostic model for early differentiation of sepsis and non-infectious SIRS in critically ill children - a data-driven approach using machine-learning algorithms
Authors
Florian Lamping
Thomas Jack
Nicole Rübsamen
Michael Sasse
Philipp Beerbaum
Rafael T. Mikolajczyk
Martin Boehne
André Karch
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2018
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-018-1082-2

Other articles of this Issue 1/2018

BMC Pediatrics 1/2018 Go to the issue