Skip to main content
Top
Published in: BMC Infectious Diseases 1/2023

Open Access 01-12-2023 | Septicemia | Research

Predicting sepsis onset in ICU using machine learning models: a systematic review and meta-analysis

Authors: Zhenyu Yang, Xiaoju Cui, Zhe Song

Published in: BMC Infectious Diseases | Issue 1/2023

Login to get access

Abstract

Background

Sepsis is a life-threatening condition caused by an abnormal response of the body to infection and imposes a significant health and economic burden worldwide due to its high mortality rate. Early recognition of sepsis is crucial for effective treatment. This study aimed to systematically evaluate the performance of various machine learning models in predicting the onset of sepsis.

Methods

We conducted a comprehensive search of the Cochrane Library, PubMed, Embase, and Web of Science databases, covering studies from database inception to November 14, 2022. We used the PROBAST tool to assess the risk of bias. We calculated the predictive performance for sepsis onset using the C-index and accuracy. We followed the PRISMA guidelines for this study.

Results

We included 23 eligible studies with a total of 4,314,145 patients and 26 different machine learning models. The most frequently used models in the studies were random forest (n = 9), extreme gradient boost (n = 7), and logistic regression (n = 6) models. The random forest (test set n = 9, acc = 0.911) and extreme gradient boost (test set n = 7, acc = 0.957) models were the most accurate based on our analysis of the predictive performance. In terms of the C-index outcome, the random forest (n = 6, acc = 0.79) and extreme gradient boost (n = 7, acc = 0.83) models showed the highest performance.

Conclusion

Machine learning has proven to be an effective tool for predicting sepsis at an early stage. However, to obtain more accurate results, additional machine learning methods are needed. In our research, we discovered that the XGBoost and random forest models exhibited the best predictive performance and were most frequently utilized for predicting the onset of sepsis.

Trial registration

CRD42022384015
Appendix
Available only for authorised users
Literature
1.
go back to reference Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):801–10.CrossRefPubMedPubMedCentral Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):801–10.CrossRefPubMedPubMedCentral
2.
go back to reference Nemati S, Holder A, Razmi F, et al. An interpretable machine learning model for accurate prediction of sepsis in the ICU. Crit Care Med. 2018;46(4):547–53.CrossRefPubMedPubMedCentral Nemati S, Holder A, Razmi F, et al. An interpretable machine learning model for accurate prediction of sepsis in the ICU. Crit Care Med. 2018;46(4):547–53.CrossRefPubMedPubMedCentral
3.
go back to reference Greener JG, Kandathil SM, Moffat L, et al. A guide to machine learning for biologists. Nat Rev Mol Cell Biol. 2022;23(1):40–55.CrossRefPubMed Greener JG, Kandathil SM, Moffat L, et al. A guide to machine learning for biologists. Nat Rev Mol Cell Biol. 2022;23(1):40–55.CrossRefPubMed
4.
go back to reference Adams R, Henry KE, Sridharan A, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28(7):1455–60.CrossRefPubMed Adams R, Henry KE, Sridharan A, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28(7):1455–60.CrossRefPubMed
5.
go back to reference Wolff RF, Moons KGM, Riley RD, et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51–8.CrossRefPubMed Wolff RF, Moons KGM, Riley RD, et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51–8.CrossRefPubMed
6.
go back to reference Wang Z, Yao B. Multi-branching temporal convolutional network for sepsis prediction. IEEE J Biomed Health Inform. 2022;26(2):876–87.CrossRefPubMed Wang Z, Yao B. Multi-branching temporal convolutional network for sepsis prediction. IEEE J Biomed Health Inform. 2022;26(2):876–87.CrossRefPubMed
7.
go back to reference Srimedha BC, Raj RN, Mayya V. A Comprehensive machine learning based pipeline for an accurate early prediction of sepsis in ICU. Ieee Access. 2022;10:105120–32.CrossRef Srimedha BC, Raj RN, Mayya V. A Comprehensive machine learning based pipeline for an accurate early prediction of sepsis in ICU. Ieee Access. 2022;10:105120–32.CrossRef
8.
go back to reference Singh Y V, Singh P, Khan S, et al. A Machine Learning Model for Early Prediction and Detection of Sepsis in Intensive Care Unit Patients. J Healthc Eng. 2022;(2022):11. Singh Y V, Singh P, Khan S, et al. A Machine Learning Model for Early Prediction and Detection of Sepsis in Intensive Care Unit Patients. J Healthc Eng. 2022;(2022):11.
9.
go back to reference Shi S, Pan X, Zhang L, et al. An application based on bioinformatics and machine learning for risk prediction of sepsis at first clinical presentation using transcriptomic data. Front Genet. 2022;13:979529. Shi S, Pan X, Zhang L, et al. An application based on bioinformatics and machine learning for risk prediction of sepsis at first clinical presentation using transcriptomic data. Front Genet. 2022;13:979529.
10.
go back to reference Peng L, Peng C, Yang F, et al. Machine learning approach for the prediction of 30-day mortality in patients with sepsis-associated encephalopathy. BMC Med Res Methodol. 2022;22(1):183.CrossRefPubMedPubMedCentral Peng L, Peng C, Yang F, et al. Machine learning approach for the prediction of 30-day mortality in patients with sepsis-associated encephalopathy. BMC Med Res Methodol. 2022;22(1):183.CrossRefPubMedPubMedCentral
11.
go back to reference Zeng Z, Yao S, Zheng J, et al. Development and validation of a novel blending machine learning model for hospital mortality prediction in ICU patients with Sepsis. BioData Mining. 2021;14(1):1–15. Zeng Z, Yao S, Zheng J, et al. Development and validation of a novel blending machine learning model for hospital mortality prediction in ICU patients with Sepsis. BioData Mining. 2021;14(1):1–15.
12.
go back to reference Wernly B, Mamandipoor B, Baldia P, et al. Machine learning predicts mortality in septic patients using only routinely available ABG variables: a multi-centre evaluation. Int J Med Inform. 2021;145:104312.CrossRefPubMed Wernly B, Mamandipoor B, Baldia P, et al. Machine learning predicts mortality in septic patients using only routinely available ABG variables: a multi-centre evaluation. Int J Med Inform. 2021;145:104312.CrossRefPubMed
13.
14.
go back to reference Su L, Xu Z, Chang F, et al. Early Prediction of Mortality, Severity, and Length of Stay in the Intensive Care Unit of Sepsis Patients Based on Sepsis 3.0 by Machine Learning Models. Front Med. 2021;8:664966. Su L, Xu Z, Chang F, et al. Early Prediction of Mortality, Severity, and Length of Stay in the Intensive Care Unit of Sepsis Patients Based on Sepsis 3.0 by Machine Learning Models. Front Med. 2021;8:664966.
15.
go back to reference Shashikumar SP, Josef CS, Sharma A, et al. DeepAISE - An interpretable and recurrent neural survival model for early prediction of sepsis. Artif Intell Med. 2021;113:102036.CrossRefPubMedPubMedCentral Shashikumar SP, Josef CS, Sharma A, et al. DeepAISE - An interpretable and recurrent neural survival model for early prediction of sepsis. Artif Intell Med. 2021;113:102036.CrossRefPubMedPubMedCentral
16.
go back to reference Rodriguez A, Mendoza D, Ascuntar J, et al. Supervised classification techniques for prediction of mortality in adult patients with sepsis. Am J Emerg Med. 2021;45:392–7.CrossRefPubMed Rodriguez A, Mendoza D, Ascuntar J, et al. Supervised classification techniques for prediction of mortality in adult patients with sepsis. Am J Emerg Med. 2021;45:392–7.CrossRefPubMed
17.
go back to reference Rayan Z, Alfonse M, Salem ABM. Predicting Sepsis in the Intensive Care Unit (ICU) through Vital Signs using Support Vector Machine (SVM). Open Bioinformatics J. 2021;14(1):108–13.CrossRef Rayan Z, Alfonse M, Salem ABM. Predicting Sepsis in the Intensive Care Unit (ICU) through Vital Signs using Support Vector Machine (SVM). Open Bioinformatics J. 2021;14(1):108–13.CrossRef
18.
go back to reference Rafiei A, Rezaee A, Hajati F, et al. SSP: Early prediction of sepsis using fully connected LSTM-CNN model. Comput Biol Med. 2021;128:104110.CrossRefPubMed Rafiei A, Rezaee A, Hajati F, et al. SSP: Early prediction of sepsis using fully connected LSTM-CNN model. Comput Biol Med. 2021;128:104110.CrossRefPubMed
19.
go back to reference Persson I, Ostling A, Arlbrandt M, et al. A Machine Learning Sepsis Prediction Algorithm for Intended Intensive Care Unit Use (NAVOY Sepsis): Proof-of-Concept Study. JMIR formative research. 2021;5(9):e28000-e.CrossRef Persson I, Ostling A, Arlbrandt M, et al. A Machine Learning Sepsis Prediction Algorithm for Intended Intensive Care Unit Use (NAVOY Sepsis): Proof-of-Concept Study. JMIR formative research. 2021;5(9):e28000-e.CrossRef
20.
go back to reference Lu Z, Zhang J, Hong J, et al. Development of a Nomogram to Predict 28-Day Mortality of Patients With Sepsis-Induced Coagulopathy: an Analysis of the MIMIC-III Database. Front Med. 2021;8:661710. Lu Z, Zhang J, Hong J, et al. Development of a Nomogram to Predict 28-Day Mortality of Patients With Sepsis-Induced Coagulopathy: an Analysis of the MIMIC-III Database. Front Med. 2021;8:661710.
21.
go back to reference Liu W, Tao G, Zhang Y, et al. A Simple Weaning Model Based on Interpretable Machine Learning Algorithm for Patients With Sepsis: A Research of MIMIC-IV and eICU Databases. Front Med. 2022;8:814566. Liu W, Tao G, Zhang Y, et al. A Simple Weaning Model Based on Interpretable Machine Learning Algorithm for Patients With Sepsis: A Research of MIMIC-IV and eICU Databases. Front Med. 2022;8:814566.
22.
go back to reference Lin P-C, Chen K-T, Chen H-C, et al. Machine Learning Model to Identify Sepsis Patients in the Emergency Department: Algorithm Development and Validation. J Personal Med. 2021;11(11):1055. Lin P-C, Chen K-T, Chen H-C, et al. Machine Learning Model to Identify Sepsis Patients in the Emergency Department: Algorithm Development and Validation. J Personal Med. 2021;11(11):1055.
23.
go back to reference Yuan K C, Tsai L W, Lee K H, et al. The development an artificial intelligence algorithm for early sepsis diagnosis in the intensive care unit. Int J Med Informs. 2020;141:104176. Yuan K C, Tsai L W, Lee K H, et al. The development an artificial intelligence algorithm for early sepsis diagnosis in the intensive care unit. Int J Med Informs. 2020;141:104176.
24.
go back to reference Roimi M, Neuberger A, Shrot A, et al. Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms. Intensive Care Med. 2020;46(3):454–62.CrossRefPubMed Roimi M, Neuberger A, Shrot A, et al. Early diagnosis of bloodstream infections in the intensive care unit using machine-learning algorithms. Intensive Care Med. 2020;46(3):454–62.CrossRefPubMed
25.
go back to reference Parreco JP, Hidalgo AE, Badilla AD, et al. Predicting central line-associated bloodstream infections and mortality using supervised machine learning. J Crit Care. 2018;45:156–62.CrossRefPubMed Parreco JP, Hidalgo AE, Badilla AD, et al. Predicting central line-associated bloodstream infections and mortality using supervised machine learning. J Crit Care. 2018;45:156–62.CrossRefPubMed
26.
go back to reference Mao Q, Jay M, Hoffman JL, et al. Multicentre validation of a sepsis prediction algorithm using only vital sign data in the emergency department, general ward and ICU. BMJ Open. 2018;8(1):e017833. Mao Q, Jay M, Hoffman JL, et al. Multicentre validation of a sepsis prediction algorithm using only vital sign data in the emergency department, general ward and ICU. BMJ Open. 2018;8(1):e017833.
27.
go back to reference Lichter Y, Stavi D, Keler U, et al. A novel model for early detection of patient deterioration in ICU. Crit Care. 2018;(22):90. Lichter Y, Stavi D, Keler U, et al. A novel model for early detection of patient deterioration in ICU. Crit Care. 2018;(22):90.
28.
go back to reference Giannini HM, Ginestra JC, Chivers C, et al. A machine learning algorithm to predict severe sepsis and septic shock: development, implementation, and impact on clinical practice. Crit Care Med. 2019;47(11):1485–92.CrossRefPubMedPubMedCentral Giannini HM, Ginestra JC, Chivers C, et al. A machine learning algorithm to predict severe sepsis and septic shock: development, implementation, and impact on clinical practice. Crit Care Med. 2019;47(11):1485–92.CrossRefPubMedPubMedCentral
29.
go back to reference Hou N, Li M, He L, et al. Predicting 30-days mortality for MIMIC-III patients with sepsis-3: a machine learning approach using XGboost. J Transl Med. 2020;18(1):462.CrossRefPubMedPubMedCentral Hou N, Li M, He L, et al. Predicting 30-days mortality for MIMIC-III patients with sepsis-3: a machine learning approach using XGboost. J Transl Med. 2020;18(1):462.CrossRefPubMedPubMedCentral
30.
go back to reference Wang R, Zhang J, Shan B, et al. XGBoost machine learning algorithm for prediction of outcome in aneurysmal subarachnoid hemorrhage. Neuropsychiatr Dis Treat. 2022;18:659–67.CrossRefPubMedPubMedCentral Wang R, Zhang J, Shan B, et al. XGBoost machine learning algorithm for prediction of outcome in aneurysmal subarachnoid hemorrhage. Neuropsychiatr Dis Treat. 2022;18:659–67.CrossRefPubMedPubMedCentral
31.
go back to reference Bloch E, Rotem T, Cohen J, et al. Machine learning models for analysis of vital signs dynamics: a case for sepsis onset prediction. J Healthc Eng. 2019;(2019):11. Bloch E, Rotem T, Cohen J, et al. Machine learning models for analysis of vital signs dynamics: a case for sepsis onset prediction. J Healthc Eng. 2019;(2019):11.
Metadata
Title
Predicting sepsis onset in ICU using machine learning models: a systematic review and meta-analysis
Authors
Zhenyu Yang
Xiaoju Cui
Zhe Song
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Infectious Diseases / Issue 1/2023
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-023-08614-0

Other articles of this Issue 1/2023

BMC Infectious Diseases 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine