Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020

01-12-2020 | COVID-19 | Original research

Exploiting an early warning Nomogram for predicting the risk of ICU admission in patients with COVID-19: a multi-center study in China

Authors: Yiwu Zhou, Yanqi He, Huan Yang, He Yu, Ting Wang, Zhu Chen, Rong Yao, Zongan Liang

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2020

Login to get access

Abstract

Background

Novel coronavirus disease 2019 (COVID-19) is a global public health emergency. Here, we developed and validated a practical model based on the data from a multi-center cohort in China for early identification and prediction of which patients will be admitted to the intensive care unit (ICU).

Methods

Data of 1087 patients with laboratory-confirmed COVID-19 were collected from 49 sites between January 2 and February 28, 2020, in Sichuan and Wuhan. Patients were randomly categorized into the training and validation cohorts (7:3). The least absolute shrinkage and selection operator and logistic regression analyzes were used to develop the nomogram. The performance of the nomogram was evaluated for the C-index, calibration, discrimination, and clinical usefulness. Further, the nomogram was externally validated in a different cohort.

Results

The individualized prediction nomogram included 6 predictors: age, respiratory rate, systolic blood pressure, smoking status, fever, and chronic kidney disease. The model demonstrated a high discriminative ability in the training cohort (C-index = 0.829), which was confirmed in the external validation cohort (C-index = 0.776). In addition, the calibration plots confirmed good concordance for predicting the risk of ICU admission. Decision curve analysis revealed that the prediction nomogram was clinically useful.

Conclusion

We established an early prediction model incorporating clinical characteristics that could be quickly obtained on hospital admission, even in community health centers. This model can be conveniently used to predict the individual risk for ICU admission of patients with COVID-19 and optimize the use of limited resources.
Literature
1.
go back to reference Hui DS, Esam IA, Madani TA, Ntoumi F, Kock R, Dar O, Ippolito G, TD MH, Memish ZA, Drosten C, et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health - the latest 2019 novel coronavirus outbreak in Wuhan, China. Int J Infect Dis. 2020;91:264–6.CrossRefPubMedPubMedCentral Hui DS, Esam IA, Madani TA, Ntoumi F, Kock R, Dar O, Ippolito G, TD MH, Memish ZA, Drosten C, et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health - the latest 2019 novel coronavirus outbreak in Wuhan, China. Int J Infect Dis. 2020;91:264–6.CrossRefPubMedPubMedCentral
2.
go back to reference Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, Si HR, Zhu Y, Li B, Huang CL, et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020;579(7798):270–3.CrossRefPubMedPubMedCentral Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, Si HR, Zhu Y, Li B, Huang CL, et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020;579(7798):270–3.CrossRefPubMedPubMedCentral
3.
go back to reference World Health Organization. Coronavirus Disease 2019 (COVID-19) Situation Report-123. 23 May 2020 (2020). In.. World Health Organization. Coronavirus Disease 2019 (COVID-19) Situation Report-123. 23 May 2020 (2020). In..
4.
go back to reference Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, Azman AS, Reich NG, Lessler J. The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Ann Intern Med. 2020;172(9):577–82.CrossRefPubMed Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, Azman AS, Reich NG, Lessler J. The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Ann Intern Med. 2020;172(9):577–82.CrossRefPubMed
5.
go back to reference Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323(13):1239–42. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323(13):1239–42.
6.
go back to reference Dietz W, Santos-Burgoa C. Obesity and its Implications for COVID-19 Mortality. Obesity (Silver Spring). 2020;28(6):1005.CrossRef Dietz W, Santos-Burgoa C. Obesity and its Implications for COVID-19 Mortality. Obesity (Silver Spring). 2020;28(6):1005.CrossRef
7.
go back to reference Wynants L, Van Calster B, Bonten MMJ, Collins GS, Debray TPA, De Vos M, Haller MC, Heinze G, Moons KGM, Riley RD, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;369:m1328.CrossRefPubMedPubMedCentral Wynants L, Van Calster B, Bonten MMJ, Collins GS, Debray TPA, De Vos M, Haller MC, Heinze G, Moons KGM, Riley RD, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;369:m1328.CrossRefPubMedPubMedCentral
8.
go back to reference Satici C, Demirkol MA, Sargin Altunok E, Gursoy B, Alkan M, Kamat S, Demirok B, Surmeli CD, Calik M, Cavus Z, et al. Performance of pneumonia severity index and CURB-65 in predicting 30-day mortality in patients with COVID-19. Int J Infect Dis. 2020;98:84–9.CrossRefPubMedPubMedCentral Satici C, Demirkol MA, Sargin Altunok E, Gursoy B, Alkan M, Kamat S, Demirok B, Surmeli CD, Calik M, Cavus Z, et al. Performance of pneumonia severity index and CURB-65 in predicting 30-day mortality in patients with COVID-19. Int J Infect Dis. 2020;98:84–9.CrossRefPubMedPubMedCentral
9.
go back to reference Hu H, Yao N, Qiu Y. Comparing rapid scoring Systems in Mortality Prediction of critically ill patients with novel coronavirus disease. Acad Emerg Med. 2020;27(6):461–8.CrossRefPubMed Hu H, Yao N, Qiu Y. Comparing rapid scoring Systems in Mortality Prediction of critically ill patients with novel coronavirus disease. Acad Emerg Med. 2020;27(6):461–8.CrossRefPubMed
10.
go back to reference Fu L, Wang B, Yuan T, Chen X, Ao Y, Fitzpatrick T, Li P, Zhou Y, Lin YF, Duan Q, et al. Clinical characteristics of coronavirus disease 2019 (COVID-19) in China: a systematic review and meta-analysis. J Inf Secur. 2020;80(6):656–65. Fu L, Wang B, Yuan T, Chen X, Ao Y, Fitzpatrick T, Li P, Zhou Y, Lin YF, Duan Q, et al. Clinical characteristics of coronavirus disease 2019 (COVID-19) in China: a systematic review and meta-analysis. J Inf Secur. 2020;80(6):656–65.
11.
go back to reference Organization WH: Coronavirus disease (COVID-19) technical guidance: laboratory testing for 2019-nCoV in humans. In.; 2019. Organization WH: Coronavirus disease (COVID-19) technical guidance: laboratory testing for 2019-nCoV in humans. In.; 2019.
12.
go back to reference Organization. WH: Clinical management of severe acute respiratory infection when novel coronavirus (2019-nCoV) infection is suspected: interim guidance. In., January 28 edn; 2020. Organization. WH: Clinical management of severe acute respiratory infection when novel coronavirus (2019-nCoV) infection is suspected: interim guidance. In., January 28 edn; 2020.
13.
go back to reference Lei Z, Li J, Wu D, Xia Y, Wang Q, Si A, Wang K, Wan X, Lau WY, Wu M, et al. Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the Milan criteria. JAMA Surg. 2016;151(4):356–63.CrossRefPubMed Lei Z, Li J, Wu D, Xia Y, Wang Q, Si A, Wang K, Wan X, Lau WY, Wu M, et al. Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the Milan criteria. JAMA Surg. 2016;151(4):356–63.CrossRefPubMed
14.
go back to reference Attiyeh MA, Fernandez-Del Castillo C, Al Efishat M, Eaton AA, Gonen M, Batts R, Pergolini I, Rezaee N, Lillemoe KD, Ferrone CR, et al. Development and validation of a multi-institutional preoperative Nomogram for predicting grade of dysplasia in Intraductal papillary mucinous neoplasms (IPMNs) of the pancreas: a report from the pancreatic surgery consortium. Ann Surg. 2018;267(1):157–63.CrossRefPubMed Attiyeh MA, Fernandez-Del Castillo C, Al Efishat M, Eaton AA, Gonen M, Batts R, Pergolini I, Rezaee N, Lillemoe KD, Ferrone CR, et al. Development and validation of a multi-institutional preoperative Nomogram for predicting grade of dysplasia in Intraductal papillary mucinous neoplasms (IPMNs) of the pancreas: a report from the pancreatic surgery consortium. Ann Surg. 2018;267(1):157–63.CrossRefPubMed
15.
go back to reference Metlay JP, Waterer GW, Long AC, Anzueto A, Brozek J, Crothers K, Cooley LA, Dean NC, Fine MJ, Flanders SA, et al. Diagnosis and treatment of adults with community-acquired pneumonia an official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America. Am J Resp Crit Care. 2019;200(7):E45–67.CrossRef Metlay JP, Waterer GW, Long AC, Anzueto A, Brozek J, Crothers K, Cooley LA, Dean NC, Fine MJ, Flanders SA, et al. Diagnosis and treatment of adults with community-acquired pneumonia an official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America. Am J Resp Crit Care. 2019;200(7):E45–67.CrossRef
16.
go back to reference Gao HN, Lu HZ, Cao B, Du B, Shang H, Gan JH, Lu SH, Yang YD, Fang Q, Shen YZ, et al. Clinical findings in 111 cases of influenza a (H7N9) virus infection. N Engl J Med. 2013;368(24):2277–85.CrossRefPubMed Gao HN, Lu HZ, Cao B, Du B, Shang H, Gan JH, Lu SH, Yang YD, Fang Q, Shen YZ, et al. Clinical findings in 111 cases of influenza a (H7N9) virus infection. N Engl J Med. 2013;368(24):2277–85.CrossRefPubMed
17.
go back to reference Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat Med. 2007;26(30):5512–28.CrossRefPubMed Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat Med. 2007;26(30):5512–28.CrossRefPubMed
18.
19.
go back to reference Kidd AC, McGettrick M, Tsim S, Halligan DL, Bylesjo M, Blyth KG. Survival prediction in mesothelioma using a scalable Lasso regression model: instructions for use and initial performance using clinical predictors. BMJ Open Respir Res. 2018;5(1):e000240. Kidd AC, McGettrick M, Tsim S, Halligan DL, Bylesjo M, Blyth KG. Survival prediction in mesothelioma using a scalable Lasso regression model: instructions for use and initial performance using clinical predictors. BMJ Open Respir Res. 2018;5(1):e000240.
20.
go back to reference Alba AC, Agoritsas T, Walsh M, Hanna S, Iorio A, Devereaux PJ, McGinn T, Guyatt G. Discrimination and calibration of clinical prediction models Users' guides to the medical literature. Jama-J Am Med Assoc. 2017;318(14):1377–84.CrossRef Alba AC, Agoritsas T, Walsh M, Hanna S, Iorio A, Devereaux PJ, McGinn T, Guyatt G. Discrimination and calibration of clinical prediction models Users' guides to the medical literature. Jama-J Am Med Assoc. 2017;318(14):1377–84.CrossRef
21.
go back to reference Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, Zhang L, Fan G, Xu J, Gu X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506.CrossRefPubMedPubMedCentral Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, Zhang L, Fan G, Xu J, Gu X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506.CrossRefPubMedPubMedCentral
22.
go back to reference Wang K, Zuo P, Liu Y, Zhang M, Zhao X, Xie S, Zhang H, Chen X, Liu C. Clinical and laboratory predictors of in-hospital mortality in patients with COVID-19: a cohort study in Wuhan, China. Clin Infect Dis. 2020:ciaa538. Wang K, Zuo P, Liu Y, Zhang M, Zhao X, Xie S, Zhang H, Chen X, Liu C. Clinical and laboratory predictors of in-hospital mortality in patients with COVID-19: a cohort study in Wuhan, China. Clin Infect Dis. 2020:ciaa538.
23.
go back to reference Hong Y, Wu X, Qu J, Gao Y, Chen H, Zhang Z. Clinical characteristics of coronavirus disease 2019 and development of a prediction model for prolonged hospital length of stay. Ann Transl Med. 2020;8(7):443.CrossRefPubMedPubMedCentral Hong Y, Wu X, Qu J, Gao Y, Chen H, Zhang Z. Clinical characteristics of coronavirus disease 2019 and development of a prediction model for prolonged hospital length of stay. Ann Transl Med. 2020;8(7):443.CrossRefPubMedPubMedCentral
24.
go back to reference Chen X, Tang Y, Mo Y, Li S, Lin D, Yang Z, Yang Z, Sun H, Qiu J, Liao Y, et al. A diagnostic model for coronavirus disease 2019 (COVID-19) based on radiological semantic and clinical features: a multi-center study. Eur Radiol. 2020. Chen X, Tang Y, Mo Y, Li S, Lin D, Yang Z, Yang Z, Sun H, Qiu J, Liao Y, et al. A diagnostic model for coronavirus disease 2019 (COVID-19) based on radiological semantic and clinical features: a multi-center study. Eur Radiol. 2020.
25.
go back to reference Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, Chen G, Cheng G, Wang Y, Bi J, et al. Prediction for progression risk in patients with COVID-19 pneumonia: the CALL score. Clin Infect Dis. 2020. Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, Chen G, Cheng G, Wang Y, Bi J, et al. Prediction for progression risk in patients with COVID-19 pneumonia: the CALL score. Clin Infect Dis. 2020.
26.
go back to reference Liang W, Liang H, Ou L, Chen B, Chen A, Li C, Li Y, Guan W, Sang L, Lu J, et al. China Medical Treatment Expert Group for COVID-19. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med. 2020;180(8):1081–9. Liang W, Liang H, Ou L, Chen B, Chen A, Li C, Li Y, Guan W, Sang L, Lu J, et al. China Medical Treatment Expert Group for COVID-19. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med. 2020;180(8):1081–9.
27.
go back to reference Guzik TJ, Mohiddin SA, Dimarco A, Patel V, Savvatis K, Marelli-Berg FM, Madhur MS, Tomaszewski M, Maffia P, D'Acquisto F, et al. COVID-19 and the cardiovascular system: implications for risk assessment, diagnosis, and treatment options. Cardiovasc Res. 2020;116(10):1666–87. Guzik TJ, Mohiddin SA, Dimarco A, Patel V, Savvatis K, Marelli-Berg FM, Madhur MS, Tomaszewski M, Maffia P, D'Acquisto F, et al. COVID-19 and the cardiovascular system: implications for risk assessment, diagnosis, and treatment options. Cardiovasc Res. 2020;116(10):1666–87.
28.
go back to reference Cheng YC, Luo R, Wang K, Zhang M, Wang ZX, Dong L, Li JH, Yao Y, Ge SW, Xu G. Kidney disease is associated with in -hospital death of patients with COVID-19. Kidney Int. 2020;97(5):829–38.CrossRefPubMedPubMedCentral Cheng YC, Luo R, Wang K, Zhang M, Wang ZX, Dong L, Li JH, Yao Y, Ge SW, Xu G. Kidney disease is associated with in -hospital death of patients with COVID-19. Kidney Int. 2020;97(5):829–38.CrossRefPubMedPubMedCentral
29.
go back to reference Trujillo H, Caravaca-Fontán F, Sevillano Á, Gutiérrez E, Caro J, Gutiérrez E, Yuste C, Andrés A, Praga M. SARS-CoV-2 infection in hospitalized patients with kidney disease. Kidney Int Rep. 2020;5(6):905–9. Trujillo H, Caravaca-Fontán F, Sevillano Á, Gutiérrez E, Caro J, Gutiérrez E, Yuste C, Andrés A, Praga M. SARS-CoV-2 infection in hospitalized patients with kidney disease. Kidney Int Rep. 2020;5(6):905–9.
30.
go back to reference Chu KH, Tsang WK, Tang CS, Lam MF, Lai FM, To KF, Fung KS, Tang HL, Yan WW, Chan HW, et al. Acute renal impairment in coronavirus-associated severe acute respiratory syndrome. Kidney Int. 2005;67(2):698–705.CrossRefPubMedPubMedCentral Chu KH, Tsang WK, Tang CS, Lam MF, Lai FM, To KF, Fung KS, Tang HL, Yan WW, Chan HW, et al. Acute renal impairment in coronavirus-associated severe acute respiratory syndrome. Kidney Int. 2005;67(2):698–705.CrossRefPubMedPubMedCentral
31.
go back to reference Kumar A, Zarychanski R, Pinto R, Cook DJ, Marshall J, Lacroix J, Stelfox T, Bagshaw S, Choong K, Lamontagne F, et al. Critically ill patients with 2009 influenza a(H1N1) infection in Canada. JAMA. 2009;302(17):1872–9.CrossRefPubMed Kumar A, Zarychanski R, Pinto R, Cook DJ, Marshall J, Lacroix J, Stelfox T, Bagshaw S, Choong K, Lamontagne F, et al. Critically ill patients with 2009 influenza a(H1N1) infection in Canada. JAMA. 2009;302(17):1872–9.CrossRefPubMed
32.
go back to reference Jung JY, Park BH, Hong SB, Koh Y, Suh GY, Jeon K, Koh SO, Kim JY, Cho JH, Choi HS, et al. Acute kidney injury in critically ill patients with pandemic influenza a pneumonia 2009 in Korea: a multi-center study. J Crit Care. 2011;26(6):577–85.CrossRefPubMed Jung JY, Park BH, Hong SB, Koh Y, Suh GY, Jeon K, Koh SO, Kim JY, Cho JH, Choi HS, et al. Acute kidney injury in critically ill patients with pandemic influenza a pneumonia 2009 in Korea: a multi-center study. J Crit Care. 2011;26(6):577–85.CrossRefPubMed
33.
go back to reference Guan WJ, Liang WH, Zhao Y, Liang HR, Chen ZS, Li YM, Liu XQ, Chen RC, Tang CL, Wang T, et al. China Medical Treatment Expert Group for COVID-19. Comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis. Eur Respir J. 2020;55(5):2000547. Guan WJ, Liang WH, Zhao Y, Liang HR, Chen ZS, Li YM, Liu XQ, Chen RC, Tang CL, Wang T, et al. China Medical Treatment Expert Group for COVID-19. Comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis. Eur Respir J. 2020;55(5):2000547.
35.
go back to reference Bai Z, Gong Y, Tian X, Cao Y, Liu W, Li J. The rapid assessment and early warning models for COVID-19. Virol Sin. 2020;35(3):272–9. Bai Z, Gong Y, Tian X, Cao Y, Liu W, Li J. The rapid assessment and early warning models for COVID-19. Virol Sin. 2020;35(3):272–9.
36.
go back to reference Huang J, Cheng A, Kumar R, Fang Y, Chen G, Zhu Y, Lin S. Hypoalbuminemia predicts the outcome of COVID-19 independent of age and co-morbidity. J Med Virol. 2020:10.1002/jmv.26003. Huang J, Cheng A, Kumar R, Fang Y, Chen G, Zhu Y, Lin S. Hypoalbuminemia predicts the outcome of COVID-19 independent of age and co-morbidity. J Med Virol. 2020:10.1002/jmv.26003.
Metadata
Title
Exploiting an early warning Nomogram for predicting the risk of ICU admission in patients with COVID-19: a multi-center study in China
Authors
Yiwu Zhou
Yanqi He
Huan Yang
He Yu
Ting Wang
Zhu Chen
Rong Yao
Zongan Liang
Publication date
01-12-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-020-00795-w

Other articles of this Issue 1/2020

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020 Go to the issue