Skip to main content
Top
Published in: Infection 2/2022

Open Access 01-04-2022 | COVID-19 | Original Paper

Prediction of COVID-19 deterioration in high-risk patients at diagnosis: an early warning score for advanced COVID-19 developed by machine learning

Authors: Carolin E. M. Jakob, Ujjwal Mukund Mahajan, Marcus Oswald, Melanie Stecher, Maximilian Schons, Julia Mayerle, Siegbert Rieg, Mathias Pletz, Uta Merle, Kai Wille, Stefan Borgmann, Christoph D. Spinner, Sebastian Dolff, Clemens Scherer, Lisa Pilgram, Maria Rüthrich, Frank Hanses, Martin Hower, Richard Strauß, Steffen Massberg, Ahmet Görkem Er, Norma Jung, Jörg Janne Vehreschild, Hans Stubbe, Lukas Tometten, Rainer König, The LEOSS Study group

Published in: Infection | Issue 2/2022

Login to get access

Abstract

Purpose

While more advanced COVID-19 necessitates medical interventions and hospitalization, patients with mild COVID-19 do not require this. Identifying patients at risk of progressing to advanced COVID-19 might guide treatment decisions, particularly for better prioritizing patients in need for hospitalization.

Methods

We developed a machine learning-based predictor for deriving a clinical score identifying patients with asymptomatic/mild COVID-19 at risk of progressing to advanced COVID-19. Clinical data from SARS-CoV-2 positive patients from the multicenter Lean European Open Survey on SARS-CoV-2 Infected Patients (LEOSS) were used for discovery (2020-03-16 to 2020-07-14) and validation (data from 2020-07-15 to 2021-02-16).

Results

The LEOSS dataset contains 473 baseline patient parameters measured at the first patient contact. After training the predictor model on a training dataset comprising 1233 patients, 20 of the 473 parameters were selected for the predictor model. From the predictor model, we delineated a composite predictive score (SACOV-19, Score for the prediction of an Advanced stage of COVID-19) with eleven variables. In the validation cohort (n = 2264 patients), we observed good prediction performance with an area under the curve (AUC) of 0.73 ± 0.01. Besides temperature, age, body mass index and smoking habit, variables indicating pulmonary involvement (respiration rate, oxygen saturation, dyspnea), inflammation (CRP, LDH, lymphocyte counts), and acute kidney injury at diagnosis were identified. For better interpretability, the predictor was translated into a web interface.

Conclusion

We present a machine learning-based predictor model and a clinical score for identifying patients at risk of developing advanced COVID-19.
Appendix
Available only for authorised users
Literature
1.
go back to reference Okada P, Buathong R, Phuygun S, Thanadachakul T, Parnmen S, Wongboot W, et al. Early transmission patterns of coronavirus disease 2019 (COVID-19) in travellers from Wuhan to Thailand, January 2020. Eurosurveillance 2020;25:2000097. Okada P, Buathong R, Phuygun S, Thanadachakul T, Parnmen S, Wongboot W, et al. Early transmission patterns of coronavirus disease 2019 (COVID-19) in travellers from Wuhan to Thailand, January 2020. Eurosurveillance 2020;25:2000097.
2.
go back to reference Coronaviridae Study Group of the International Committee on Taxonomy of Viruses. The species severe acute respiratory syndrome-related coronavirus: classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol. 2020;5:536–44.CrossRef Coronaviridae Study Group of the International Committee on Taxonomy of Viruses. The species severe acute respiratory syndrome-related coronavirus: classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol. 2020;5:536–44.CrossRef
4.
go back to reference Guan W, Ni Z, Hu Y, Liang W, Ou C, He J, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382:1708–20.CrossRef Guan W, Ni Z, Hu Y, Liang W, Ou C, He J, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382:1708–20.CrossRef
5.
go back to reference Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395:1054–62.CrossRef Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395:1054–62.CrossRef
6.
go back to reference Liang W, Liang H, Ou L, Chen B, Chen A, Li C, et al. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med. 2020;180:1081.CrossRef Liang W, Liang H, Ou L, Chen B, Chen A, Li C, et al. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med. 2020;180:1081.CrossRef
7.
go back to reference Clift AK, Coupland CAC, Keogh RH, Diaz-Ordaz K, Williamson E, Harrison EM, et al. Living risk prediction algorithm (QCOVID) for risk of hospital admission and mortality from coronavirus 19 in adults: national derivation and validation cohort study. BMJ. 2020;371:m3731. Clift AK, Coupland CAC, Keogh RH, Diaz-Ordaz K, Williamson E, Harrison EM, et al. Living risk prediction algorithm (QCOVID) for risk of hospital admission and mortality from coronavirus 19 in adults: national derivation and validation cohort study. BMJ. 2020;371:m3731.
8.
go back to reference Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score. BMJ. 2020;370:m3339. Knight SR, Ho A, Pius R, Buchan I, Carson G, Drake TM, et al. Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score. BMJ. 2020;370:m3339.
9.
go back to reference Carr E, Bendayan R, Bean D, Stammers M, Wang W, Zhang H, et al. Evaluation and improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study. BMC Med. 2021;19:23.CrossRef Carr E, Bendayan R, Bean D, Stammers M, Wang W, Zhang H, et al. Evaluation and improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study. BMC Med. 2021;19:23.CrossRef
10.
go back to reference Liu S, Yao N, Qiu Y, He C. Predictive performance of SOFA and qSOFA for in-hospital mortality in severe novel coronavirus disease. Am J Emerg Med. 2020;38:2074–80.CrossRef Liu S, Yao N, Qiu Y, He C. Predictive performance of SOFA and qSOFA for in-hospital mortality in severe novel coronavirus disease. Am J Emerg Med. 2020;38:2074–80.CrossRef
11.
go back to reference Chang MC, Park Y-K, Kim B-O, Park D. Risk factors for disease progression in COVID-19 patients. BMC Infect Dis. 2020;20:445.CrossRef Chang MC, Park Y-K, Kim B-O, Park D. Risk factors for disease progression in COVID-19 patients. BMC Infect Dis. 2020;20:445.CrossRef
12.
go back to reference Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328. Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328.
13.
go back to reference Gupta RK, Marks M, Samuels THA, Luintel A, Rampling T, Chowdhury H, et al. Systematic evaluation and external validation of 22 prognostic models among hospitalised adults with COVID-19: an observational cohort study. Eur Respir J. 2020;56:2003498.CrossRef Gupta RK, Marks M, Samuels THA, Luintel A, Rampling T, Chowdhury H, et al. Systematic evaluation and external validation of 22 prognostic models among hospitalised adults with COVID-19: an observational cohort study. Eur Respir J. 2020;56:2003498.CrossRef
14.
go back to reference Gandhi RT, Lynch JB, Del Rio C. Mild or moderate Covid-19. N Engl J Med. 2020;383:1757–66.CrossRef Gandhi RT, Lynch JB, Del Rio C. Mild or moderate Covid-19. N Engl J Med. 2020;383:1757–66.CrossRef
15.
go back to reference Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323:1239.CrossRef Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323:1239.CrossRef
16.
go back to reference Attaway AH, Scheraga RG, Bhimraj A, Biehl M, Hatipoğlu U. Severe covid-19 pneumonia: pathogenesis and clinical management. BMJ. 2021;372:n436.CrossRef Attaway AH, Scheraga RG, Bhimraj A, Biehl M, Hatipoğlu U. Severe covid-19 pneumonia: pathogenesis and clinical management. BMJ. 2021;372:n436.CrossRef
17.
go back to reference Alhazzani W, Møller MH, Arabi YM, Loeb M, Gong MN, Fan E, et al. Surviving Sepsis Campaign: guidelines on the management of critically ill adults with coronavirus disease 2019 (COVID-19). Intensive Care Med. 2020;46:854–87.CrossRef Alhazzani W, Møller MH, Arabi YM, Loeb M, Gong MN, Fan E, et al. Surviving Sepsis Campaign: guidelines on the management of critically ill adults with coronavirus disease 2019 (COVID-19). Intensive Care Med. 2020;46:854–87.CrossRef
18.
go back to reference Darley DR, Dore GJ, Cysique L, Wilhelm KA, Andresen D, Tonga K, et al. Persistent symptoms up to four months after community and hospital-managed SARS-CoV-2 infection. Med J Aust. 2021;214:279–80.CrossRef Darley DR, Dore GJ, Cysique L, Wilhelm KA, Andresen D, Tonga K, et al. Persistent symptoms up to four months after community and hospital-managed SARS-CoV-2 infection. Med J Aust. 2021;214:279–80.CrossRef
19.
go back to reference Carfì A, Bernabei R, Landi F, Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent symptoms in patients after acute COVID-19. JAMA. 2020;324:603–5.CrossRef Carfì A, Bernabei R, Landi F, Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent symptoms in patients after acute COVID-19. JAMA. 2020;324:603–5.CrossRef
20.
go back to reference Weerahandi H, Hochman KA, Simon E, Blaum C, Chodosh J, Duan E, et al. Post-discharge health status and symptoms in patients with severe COVID-19. J Gen Intern Med. 2021;36:738–45.CrossRef Weerahandi H, Hochman KA, Simon E, Blaum C, Chodosh J, Duan E, et al. Post-discharge health status and symptoms in patients with severe COVID-19. J Gen Intern Med. 2021;36:738–45.CrossRef
21.
go back to reference Jakob CEM, Borgmann S, Duygu F, Behrends U, Hower M, Merle U, et al. First results of the “Lean European Open Survey on SARS-CoV-2-Infected Patients (LEOSS).” Infection. 2020;49:63–73.CrossRef Jakob CEM, Borgmann S, Duygu F, Behrends U, Hower M, Merle U, et al. First results of the “Lean European Open Survey on SARS-CoV-2-Infected Patients (LEOSS).” Infection. 2020;49:63–73.CrossRef
22.
go back to reference Jakob CEM, Kohlmayer F, Meurers T, Vehreschild JJ, Prasser F. Design and evaluation of a data anonymization pipeline to promote Open Science on COVID-19. Sci Data. 2020;7:435.CrossRef Jakob CEM, Kohlmayer F, Meurers T, Vehreschild JJ, Prasser F. Design and evaluation of a data anonymization pipeline to promote Open Science on COVID-19. Sci Data. 2020;7:435.CrossRef
23.
go back to reference Collins GS, Reitsma JB, Altman DG, Moons K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13:1.CrossRef Collins GS, Reitsma JB, Altman DG, Moons K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13:1.CrossRef
26.
go back to reference Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, et al. Risk factors of critical and mortal COVID-19 cases: a systematic literature review and meta-analysis. J Infect. 2020;81:e16-25.CrossRef Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, et al. Risk factors of critical and mortal COVID-19 cases: a systematic literature review and meta-analysis. J Infect. 2020;81:e16-25.CrossRef
27.
go back to reference Fan G, Tu C, Zhou F, Liu Z, Wang Y, Song B, et al. Comparison of severity scores for COVID-19 patients with pneumonia: a retrospective study. Eur Respir J. 2020;56:2002113.CrossRef Fan G, Tu C, Zhou F, Liu Z, Wang Y, Song B, et al. Comparison of severity scores for COVID-19 patients with pneumonia: a retrospective study. Eur Respir J. 2020;56:2002113.CrossRef
28.
go back to reference Gidari A, De Socio GV, Sabbatini S, Francisci D. Predictive value of National Early Warning Score 2 (NEWS2) for intensive care unit admission in patients with SARS-CoV-2 infection. Infect Dis. 2020;52:698–704.CrossRef Gidari A, De Socio GV, Sabbatini S, Francisci D. Predictive value of National Early Warning Score 2 (NEWS2) for intensive care unit admission in patients with SARS-CoV-2 infection. Infect Dis. 2020;52:698–704.CrossRef
29.
go back to reference Ihle-Hansen H, Berge T, Tveita A, Rønning EJ, Ernø PE, Andersen EL, Wang CH, Tveit A, Myrstad M. COVID-19: Symptoms, course of illness and use of clinical scoring systems for the first 42 patients admitted to a Norwegian local hospital. Tidsskr Nor Laegeforen. 2020;140(7). Ihle-Hansen H, Berge T, Tveita A, Rønning EJ, Ernø PE, Andersen EL, Wang CH, Tveit A, Myrstad M. COVID-19: Symptoms, course of illness and use of clinical scoring systems for the first 42 patients admitted to a Norwegian local hospital. Tidsskr Nor Laegeforen. 2020;140(7).
30.
go back to reference Smith GB, Redfern OC, Pimentel MA, Gerry S, Collins GS, Malycha J, et al. The National Early Warning Score 2 (NEWS2). Clin Med. 2019;19:260–260.CrossRef Smith GB, Redfern OC, Pimentel MA, Gerry S, Collins GS, Malycha J, et al. The National Early Warning Score 2 (NEWS2). Clin Med. 2019;19:260–260.CrossRef
31.
go back to reference Duca A, Piva S, Focà E, Latronico N, Rizzi M. Calculated decisions: Brescia-COVID Respiratory Severity Scale (BCRSS)/Algorithm. Emerg Med Pract. 2020;22:CD1–2.PubMed Duca A, Piva S, Focà E, Latronico N, Rizzi M. Calculated decisions: Brescia-COVID Respiratory Severity Scale (BCRSS)/Algorithm. Emerg Med Pract. 2020;22:CD1–2.PubMed
32.
go back to reference Huang H, Cai S, Li Y, Li Y, Fan Y, Li L, et al. Prognostic Factors for COVID-19 pneumonia progression to severe symptoms based on earlier clinical features: a retrospective analysis. Front Med (Lausanne). 2020;7:557453.CrossRef Huang H, Cai S, Li Y, Li Y, Fan Y, Li L, et al. Prognostic Factors for COVID-19 pneumonia progression to severe symptoms based on earlier clinical features: a retrospective analysis. Front Med (Lausanne). 2020;7:557453.CrossRef
34.
go back to reference Grifoni E, Valoriani A, Cei F, Vannucchi V, Moroni F, Pelagatti L, et al. The CALL score for predicting outcomes in patients with COVID-19. Clin Infect Dis. 2021;72:182–183. Grifoni E, Valoriani A, Cei F, Vannucchi V, Moroni F, Pelagatti L, et al. The CALL score for predicting outcomes in patients with COVID-19. Clin Infect Dis. 2021;72:182–183.
35.
go back to reference Lamontagne F, Agoritsas T, Siemieniuk R, Rochwerg B, Bartoszko J, Askie L, et al. A living WHO guideline on drugs to prevent covid-19. BMJ. 2021;372:n526. Lamontagne F, Agoritsas T, Siemieniuk R, Rochwerg B, Bartoszko J, Askie L, et al. A living WHO guideline on drugs to prevent covid-19. BMJ. 2021;372:n526.
36.
go back to reference Moons KGM, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. 2009;338:b606–b606.CrossRef Moons KGM, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. 2009;338:b606–b606.CrossRef
37.
go back to reference Herold T, Jurinovic V, Arnreich C, Lipworth BJ, Hellmuth JC, von Bergwelt-Baildon M, et al. Elevated levels of IL-6 and CRP predict the need for mechanical ventilation in COVID-19. J Allergy Clin Immunol. 2020;146:128.e4-136.e4.CrossRef Herold T, Jurinovic V, Arnreich C, Lipworth BJ, Hellmuth JC, von Bergwelt-Baildon M, et al. Elevated levels of IL-6 and CRP predict the need for mechanical ventilation in COVID-19. J Allergy Clin Immunol. 2020;146:128.e4-136.e4.CrossRef
Metadata
Title
Prediction of COVID-19 deterioration in high-risk patients at diagnosis: an early warning score for advanced COVID-19 developed by machine learning
Authors
Carolin E. M. Jakob
Ujjwal Mukund Mahajan
Marcus Oswald
Melanie Stecher
Maximilian Schons
Julia Mayerle
Siegbert Rieg
Mathias Pletz
Uta Merle
Kai Wille
Stefan Borgmann
Christoph D. Spinner
Sebastian Dolff
Clemens Scherer
Lisa Pilgram
Maria Rüthrich
Frank Hanses
Martin Hower
Richard Strauß
Steffen Massberg
Ahmet Görkem Er
Norma Jung
Jörg Janne Vehreschild
Hans Stubbe
Lukas Tometten
Rainer König
The LEOSS Study group
Publication date
01-04-2022
Publisher
Springer Berlin Heidelberg
Keyword
COVID-19
Published in
Infection / Issue 2/2022
Print ISSN: 0300-8126
Electronic ISSN: 1439-0973
DOI
https://doi.org/10.1007/s15010-021-01656-z

Other articles of this Issue 2/2022

Infection 2/2022 Go to the issue