Skip to main content
Top
Published in: Critical Care 1/2021

Open Access 01-12-2021 | Dementia | Research

Machine-learning-based COVID-19 mortality prediction model and identification of patients at low and high risk of dying

Authors: Mohammad M. Banoei, Roshan Dinparastisaleh, Ali Vaeli Zadeh, Mehdi Mirsaeidi

Published in: Critical Care | Issue 1/2021

Login to get access

Abstract

Background

The coronavirus disease 2019 (COVID-19) pandemic caused by the SARS-Cov2 virus has become the greatest health and controversial issue for worldwide nations. It is associated with different clinical manifestations and a high mortality rate. Predicting mortality and identifying outcome predictors are crucial for COVID patients who are critically ill. Multivariate and machine learning methods may be used for developing prediction models and reduce the complexity of clinical phenotypes.

Methods

Multivariate predictive analysis was applied to 108 out of 250 clinical features, comorbidities, and blood markers captured at the admission time from a hospitalized cohort of patients (N = 250) with COVID-19. Inspired modification of partial least square (SIMPLS)-based model was developed to predict hospital mortality. Prediction accuracy was randomly assigned to training and validation sets. Predictive partition analysis was performed to obtain cutting value for either continuous or categorical variables. Latent class analysis (LCA) was carried to cluster the patients with COVID-19 to identify low- and high-risk patients. Principal component analysis and LCA were used to find a subgroup of survivors that tends to die.

Results

SIMPLS-based model was able to predict hospital mortality in patients with COVID-19 with moderate predictive power (Q2 = 0.24) and high accuracy (AUC > 0.85) through separating non-survivors from survivors developed using training and validation sets. This model was obtained by the 18 clinical and comorbidities predictors and 3 blood biochemical markers. Coronary artery disease, diabetes, Altered Mental Status, age > 65, and dementia were the topmost differentiating mortality predictors. CRP, prothrombin, and lactate were the most differentiating biochemical markers in the mortality prediction model. Clustering analysis identified high- and low-risk patients among COVID-19 survivors.

Conclusions

An accurate COVID-19 mortality prediction model among hospitalized patients based on the clinical features and comorbidities may play a beneficial role in the clinical setting to better management of patients with COVID-19. The current study revealed the application of machine-learning-based approaches to predict hospital mortality in patients with COVID-19 and identification of most important predictors from clinical, comorbidities and blood biochemical variables as well as recognizing high- and low-risk COVID-19 survivors.
Literature
1.
go back to reference Dhama K, Khan S, Tiwari R, Sircar S, Bhat S, Malik YS, Singh KP, Chaicumpa W, Bonilla-Aldana DK, Rodriguez-Morales AJ. Coronavirus disease 2019-COVID-19. Clin Microbiol Rev. 2020;33(4):e00028-e120.CrossRef Dhama K, Khan S, Tiwari R, Sircar S, Bhat S, Malik YS, Singh KP, Chaicumpa W, Bonilla-Aldana DK, Rodriguez-Morales AJ. Coronavirus disease 2019-COVID-19. Clin Microbiol Rev. 2020;33(4):e00028-e120.CrossRef
2.
go back to reference Hassan SA, Sheikh FN, Jamal S, Ezeh JK, Akhtar A. Coronavirus (COVID-19): a review of clinical features, diagnosis, and treatment. Cureus. 2020;12(3):e7355.PubMedPubMedCentral Hassan SA, Sheikh FN, Jamal S, Ezeh JK, Akhtar A. Coronavirus (COVID-19): a review of clinical features, diagnosis, and treatment. Cureus. 2020;12(3):e7355.PubMedPubMedCentral
3.
go back to reference Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, Liu L, Shan H, Lei CL, Hui DSC, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708–20.CrossRef Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, Liu L, Shan H, Lei CL, Hui DSC, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708–20.CrossRef
4.
go back to reference Chen Y, Ouyang L, Bao FS, Li Q, Han L, Zhang H, Zhu B, Ge Y, Robinson P, Xu M, et al. A multimodality machine learning approach to differentiate severe and nonsevere COVID-19: model development and validation. J Med Internet Res. 2021;23(4):e23948.CrossRef Chen Y, Ouyang L, Bao FS, Li Q, Han L, Zhang H, Zhu B, Ge Y, Robinson P, Xu M, et al. A multimodality machine learning approach to differentiate severe and nonsevere COVID-19: model development and validation. J Med Internet Res. 2021;23(4):e23948.CrossRef
5.
go back to reference Elwazir MY, Hosny S. Artificial intelligence in COVID-19 ultrastructure. J Microsc Ultrastruct. 2020;8(4):146–7.CrossRef Elwazir MY, Hosny S. Artificial intelligence in COVID-19 ultrastructure. J Microsc Ultrastruct. 2020;8(4):146–7.CrossRef
6.
go back to reference Chou EH, Wang CH, Hsieh YL, Namazi B, Wolfshohl J, Bhakta T, Tsai CL, Lien WC, Sankaranarayanan G, Lee CC, et al. Clinical features of emergency department patients from early COVID-19 pandemic that predict SARS-CoV-2 infection: machine-learning approach. West J Emerg Med. 2021;22(2):244–51.CrossRef Chou EH, Wang CH, Hsieh YL, Namazi B, Wolfshohl J, Bhakta T, Tsai CL, Lien WC, Sankaranarayanan G, Lee CC, et al. Clinical features of emergency department patients from early COVID-19 pandemic that predict SARS-CoV-2 infection: machine-learning approach. West J Emerg Med. 2021;22(2):244–51.CrossRef
7.
go back to reference Venturini S, Orso D, Cugini F, Crapis M, Fossati S, Callegari A, Pellis T, Tonizzo M, Grembiale A, Rosso A, et al. Classification and analysis of outcome predictors in non-critically ill COVID-19 patients. Intern Med J. 2021;51(4):506–14.CrossRef Venturini S, Orso D, Cugini F, Crapis M, Fossati S, Callegari A, Pellis T, Tonizzo M, Grembiale A, Rosso A, et al. Classification and analysis of outcome predictors in non-critically ill COVID-19 patients. Intern Med J. 2021;51(4):506–14.CrossRef
8.
go back to reference Boulesteix AL, Strimmer K. Partial least squares: a versatile tool for the analysis of high-dimensional genomic data. Brief Bioinform. 2007;8(1):32–44.CrossRef Boulesteix AL, Strimmer K. Partial least squares: a versatile tool for the analysis of high-dimensional genomic data. Brief Bioinform. 2007;8(1):32–44.CrossRef
9.
go back to reference de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemom Intell Lab Syst. 1993;18(3):251–63.CrossRef de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemom Intell Lab Syst. 1993;18(3):251–63.CrossRef
10.
go back to reference Wold S, Sjöström M, Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom Intell Lab Syst. 2001;58(2):109–30.CrossRef Wold S, Sjöström M, Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom Intell Lab Syst. 2001;58(2):109–30.CrossRef
11.
go back to reference Eriksson L, Johansson E, Kettaneh-Wold NTJ, Wikstrom C, Wold S. Multi- and megavariate data analysis basic principles and applications (part I), chapter 4. In: Umetrics; 2006. Eriksson L, Johansson E, Kettaneh-Wold NTJ, Wikstrom C, Wold S. Multi- and megavariate data analysis basic principles and applications (part I), chapter 4. In: Umetrics; 2006.
12.
go back to reference Peng DX, Lai F. Using partial least squares in operations management research: a practical guideline and summary of past research. J Oper Manag. 2012;30(6):467–80.CrossRef Peng DX, Lai F. Using partial least squares in operations management research: a practical guideline and summary of past research. J Oper Manag. 2012;30(6):467–80.CrossRef
13.
go back to reference Wu J-F, Wang Y. Multivariate analysis of metabolomics data. In: Qi X, Chen X, Wang Y, editors. Plant metabolomics: methods and applications. Dordrecht: Springer; 2015. p. 105–22. Wu J-F, Wang Y. Multivariate analysis of metabolomics data. In: Qi X, Chen X, Wang Y, editors. Plant metabolomics: methods and applications. Dordrecht: Springer; 2015. p. 105–22.
14.
go back to reference Yadaw AS, Li YC, Bose S, Iyengar R, Bunyavanich S, Pandey G. Clinical features of COVID-19 mortality: development and validation of a clinical prediction model. Lancet Digit Health. 2020;2(10):e516–25.CrossRef Yadaw AS, Li YC, Bose S, Iyengar R, Bunyavanich S, Pandey G. Clinical features of COVID-19 mortality: development and validation of a clinical prediction model. Lancet Digit Health. 2020;2(10):e516–25.CrossRef
15.
go back to reference Bhatraju PK, Ghassemieh BJ, Nichols M, Kim R, Jerome KR, Nalla AK, Greninger AL, Pipavath S, Wurfel MM, Evans L, et al. Covid-19 in critically ill patients in the Seattle region—case series. N Engl J Med. 2020;382(21):2012–22.CrossRef Bhatraju PK, Ghassemieh BJ, Nichols M, Kim R, Jerome KR, Nalla AK, Greninger AL, Pipavath S, Wurfel MM, Evans L, et al. Covid-19 in critically ill patients in the Seattle region—case series. N Engl J Med. 2020;382(21):2012–22.CrossRef
16.
go back to reference Duca A, Piva S, Focà E, Latronico N, Rizzi M. Calculated decisions: Brescia-COVID respiratory severity scale (BCRSS)/algorithm. Emerg Med Pract. 2020;22(5 Suppl):Cd1–2.PubMed Duca A, Piva S, Focà E, Latronico N, Rizzi M. Calculated decisions: Brescia-COVID respiratory severity scale (BCRSS)/algorithm. Emerg Med Pract. 2020;22(5 Suppl):Cd1–2.PubMed
17.
go back to reference Grasselli G, Zangrillo A, Zanella A, Antonelli M, Cabrini L, Castelli A, Cereda D, Coluccello A, Foti G, Fumagalli R, et al. Baseline characteristics and outcomes of 1591 patients infected with SARS-CoV-2 admitted to ICUs of the Lombardy Region, Italy. JAMA. 2020;323(16):1574–81.CrossRef Grasselli G, Zangrillo A, Zanella A, Antonelli M, Cabrini L, Castelli A, Cereda D, Coluccello A, Foti G, Fumagalli R, et al. Baseline characteristics and outcomes of 1591 patients infected with SARS-CoV-2 admitted to ICUs of the Lombardy Region, Italy. JAMA. 2020;323(16):1574–81.CrossRef
18.
go back to reference Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, Dunning J, Fairfield CJ, Gamble C, Green CA, et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score. BMJ. 2020;370:m3339.CrossRef Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, Dunning J, Fairfield CJ, Gamble C, Green CA, et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score. BMJ. 2020;370:m3339.CrossRef
19.
go back to reference Shang Y, Liu T, Wei Y, Li J, Shao L, Liu M, Zhang Y, Zhao Z, Xu H, Peng Z, et al. Scoring systems for predicting mortality for severe patients with COVID-19. EClinicalMedicine. 2020;24:100426.CrossRef Shang Y, Liu T, Wei Y, Li J, Shao L, Liu M, Zhang Y, Zhao Z, Xu H, Peng Z, et al. Scoring systems for predicting mortality for severe patients with COVID-19. EClinicalMedicine. 2020;24:100426.CrossRef
20.
go back to reference Zhao Z, Chen A, Hou W, Graham JM, Li H, Richman PS, Thode HC, Singer AJ, Duong TQ. Prediction model and risk scores of ICU admission and mortality in COVID-19. PLoS ONE. 2020;15(7):e0236618.CrossRef Zhao Z, Chen A, Hou W, Graham JM, Li H, Richman PS, Thode HC, Singer AJ, Duong TQ. Prediction model and risk scores of ICU admission and mortality in COVID-19. PLoS ONE. 2020;15(7):e0236618.CrossRef
21.
go back to reference Hajifathalian K, Sharaiha RZ, Kumar S, Krisko T, Skaf D, Ang B, Redd WD, Zhou JC, Hathorn KE, McCarty TR, et al. Development and external validation of a prediction risk model for short-term mortality among hospitalized U.S. COVID-19 patients: a proposal for the COVID-AID risk tool. PLoS ONE. 2020;15(9):e0239536.CrossRef Hajifathalian K, Sharaiha RZ, Kumar S, Krisko T, Skaf D, Ang B, Redd WD, Zhou JC, Hathorn KE, McCarty TR, et al. Development and external validation of a prediction risk model for short-term mortality among hospitalized U.S. COVID-19 patients: a proposal for the COVID-AID risk tool. PLoS ONE. 2020;15(9):e0239536.CrossRef
22.
go back to reference von Meijenfeldt FA, Havervall S, Adelmeijer J, Lundström A, Rudberg AS, Magnusson M, Mackman N, Thalin C, Lisman T. Prothrombotic changes in patients with COVID-19 are associated with disease severity and mortality. Res Pract Thromb Haemost. 2021;5(1):132–41.CrossRef von Meijenfeldt FA, Havervall S, Adelmeijer J, Lundström A, Rudberg AS, Magnusson M, Mackman N, Thalin C, Lisman T. Prothrombotic changes in patients with COVID-19 are associated with disease severity and mortality. Res Pract Thromb Haemost. 2021;5(1):132–41.CrossRef
23.
go back to reference Bannaga AS, Tabuso M, Farrugia A, Chandrapalan S, Somal K, Lim VK, Mohamed S, Nia GJ, Mannath J, Wong JL, et al. C-reactive protein and albumin association with mortality of hospitalised SARS-CoV-2 patients: a tertiary hospital experience. Clin Med (Lond). 2020;20(5):463–7.CrossRef Bannaga AS, Tabuso M, Farrugia A, Chandrapalan S, Somal K, Lim VK, Mohamed S, Nia GJ, Mannath J, Wong JL, et al. C-reactive protein and albumin association with mortality of hospitalised SARS-CoV-2 patients: a tertiary hospital experience. Clin Med (Lond). 2020;20(5):463–7.CrossRef
24.
go back to reference Li Z, Liu G, Wang L, Liang Y, Zhou Q, Wu F, Yao J, Chen B. From the insight of glucose metabolism disorder: oxygen therapy and blood glucose monitoring are crucial for quarantined COVID-19 patients. Ecotoxicol Environ Saf. 2020;197:110614–110614.CrossRef Li Z, Liu G, Wang L, Liang Y, Zhou Q, Wu F, Yao J, Chen B. From the insight of glucose metabolism disorder: oxygen therapy and blood glucose monitoring are crucial for quarantined COVID-19 patients. Ecotoxicol Environ Saf. 2020;197:110614–110614.CrossRef
25.
go back to reference Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, Li Q, Jiang C, Zhou Y, Liu S, et al. Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis. J Infect. 2020;81(2):e16–25.CrossRef Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, Li Q, Jiang C, Zhou Y, Liu S, et al. Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis. J Infect. 2020;81(2):e16–25.CrossRef
26.
go back to reference Yang L, Jin J, Luo W, Gan Y, Chen B, Li W. Risk factors for predicting mortality of COVID-19 patients: a systematic review and meta-analysis. PLoS ONE. 2020;15(11):e0243124.CrossRef Yang L, Jin J, Luo W, Gan Y, Chen B, Li W. Risk factors for predicting mortality of COVID-19 patients: a systematic review and meta-analysis. PLoS ONE. 2020;15(11):e0243124.CrossRef
27.
go back to reference Patel D, Kher V, Desai B, Lei X, Cen S, Nanda N, Gholamrezanezhad A, Duddalwar V, Varghese B, Oberai AA. Machine learning based predictors for COVID-19 disease severity. Sci Rep. 2021;11(1):4673.CrossRef Patel D, Kher V, Desai B, Lei X, Cen S, Nanda N, Gholamrezanezhad A, Duddalwar V, Varghese B, Oberai AA. Machine learning based predictors for COVID-19 disease severity. Sci Rep. 2021;11(1):4673.CrossRef
28.
go back to reference Marcos M, Belhassen-García M, Sánchez-Puente A, Sampedro-Gomez J, Azibeiro R, Dorado-Díaz PI, Marcano-Millán E, García-Vidal C, Moreiro-Barroso MT, Cubino-Bóveda N, et al. Development of a severity of disease score and classification model by machine learning for hospitalized COVID-19 patients. PLoS ONE. 2021;16(4):e0240200.CrossRef Marcos M, Belhassen-García M, Sánchez-Puente A, Sampedro-Gomez J, Azibeiro R, Dorado-Díaz PI, Marcano-Millán E, García-Vidal C, Moreiro-Barroso MT, Cubino-Bóveda N, et al. Development of a severity of disease score and classification model by machine learning for hospitalized COVID-19 patients. PLoS ONE. 2021;16(4):e0240200.CrossRef
29.
go back to reference Liu Q, Pang B, Li H, Zhang B, Liu Y, Lai L, Le W, Li J, Xia T, Zhang X, et al. Machine learning models for predicting critical illness risk in hospitalized patients with COVID-19 pneumonia. J Thorac Dis. 2021;13(2):1215–29.CrossRef Liu Q, Pang B, Li H, Zhang B, Liu Y, Lai L, Le W, Li J, Xia T, Zhang X, et al. Machine learning models for predicting critical illness risk in hospitalized patients with COVID-19 pneumonia. J Thorac Dis. 2021;13(2):1215–29.CrossRef
30.
go back to reference Hou W, Zhao Z, Chen A, Li H, Duong TQ. Machining learning predicts the need for escalated care and mortality in COVID-19 patients from clinical variables. Int J Med Sci. 2021;18(8):1739–45.CrossRef Hou W, Zhao Z, Chen A, Li H, Duong TQ. Machining learning predicts the need for escalated care and mortality in COVID-19 patients from clinical variables. Int J Med Sci. 2021;18(8):1739–45.CrossRef
31.
go back to reference Benito-León J, Del Castillo MD, Estirado A, Ghosh R, Dubey S, Serrano JI. Using unsupervised machine learning to identify age- and sex-independent severity subgroups among COVID-19 patients in the emergency department. J Med Internet Res. 2021;23:e25988.CrossRef Benito-León J, Del Castillo MD, Estirado A, Ghosh R, Dubey S, Serrano JI. Using unsupervised machine learning to identify age- and sex-independent severity subgroups among COVID-19 patients in the emergency department. J Med Internet Res. 2021;23:e25988.CrossRef
32.
go back to reference Eriksson L, Antti H, Gottfries J, Holmes E, Johansson E, Lindgren F, Long I, Lundstedt T, Trygg J, Wold S. Using chemometrics for navigating in the large data sets of genomics, proteomics, and metabonomics (gpm). Anal Bioanal Chem. 2004;380(3):419–29.CrossRef Eriksson L, Antti H, Gottfries J, Holmes E, Johansson E, Lindgren F, Long I, Lundstedt T, Trygg J, Wold S. Using chemometrics for navigating in the large data sets of genomics, proteomics, and metabonomics (gpm). Anal Bioanal Chem. 2004;380(3):419–29.CrossRef
Metadata
Title
Machine-learning-based COVID-19 mortality prediction model and identification of patients at low and high risk of dying
Authors
Mohammad M. Banoei
Roshan Dinparastisaleh
Ali Vaeli Zadeh
Mehdi Mirsaeidi
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2021
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-021-03749-5

Other articles of this Issue 1/2021

Critical Care 1/2021 Go to the issue