Skip to main content
Top
Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 3/2022

01-03-2022 | COVID-19 | Reports of Original Investigations

Development of a repeated-measures predictive model and clinical risk score for mortality in ventilated COVID-19 patients

Authors: Justyna Bartoszko, MD, MSc, George Dranitsaris, MSc, PhD, M. Elizabeth Wilcox, MD, PhD, Lorenzo Del Sorbo, MD, Sangeeta Mehta, MD, Miki Peer, PhD, Matteo Parotto, MD, PhD, Isaac Bogoch, MD, MSc, Sheila Riazi, MD, MSc

Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Issue 3/2022

Login to get access

Abstract

Purpose

The COVID-19 pandemic has caused intensive care units (ICUs) to reach capacities requiring triage. A tool to predict mortality risk in ventilated patients with COVID-19 could inform decision-making and resource allocation, and allow population-level comparisons across institutions.

Methods

This retrospective cohort study included all mechanically ventilated adults with COVID-19 admitted to three tertiary care ICUs in Toronto, Ontario, between 1 March 2020 and 15 December 2020. Generalized estimating equations were used to identify variables predictive of mortality. The primary outcome was the probability of death at three-day intervals from the time of ICU admission (day 0), with risk re-calculation every three days to day 15; the final risk calculation estimated the probability of death at day 15 and beyond. A numerical algorithm was developed from the final model coefficients.

Results

One hundred twenty-seven patients were eligible for inclusion. Median ICU length of stay was 26.9 (interquartile range, 15.4–52.0) days. Overall mortality was 42%. From day 0 to 15, the variables age, temperature, lactate level, ventilation tidal volume, and vasopressor use significantly predicted mortality. Our final clinical risk score had an area under the receiver-operating characteristics curve of 0.9 (95% confidence interval [CI], 0.8 to 0.9). For every ten-point increase in risk score, the relative increase in the odds of death was approximately 4, with an odds ratio of 4.1 (95% CI, 2.9 to 5.9).

Conclusion

Our dynamic prediction tool for mortality in ventilated patients with COVID-19 has excellent diagnostic properties. Notwithstanding, external validation is required before widespread implementation.
Appendix
Available only for authorised users
Literature
7.
go back to reference Liang W, Liang H, Ou L, et al. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med 2020; 180: 1081-9.CrossRefPubMed Liang W, Liang H, Ou L, et al. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med 2020; 180: 1081-9.CrossRefPubMed
8.
go back to reference Chung H, Ko H, Kang WS, et al. Prediction and feature importance analysis for severity of COVID-19 in South Korea using artificial intelligence:model development and validation. J Med Internet Res 202; DOI: https://doi.org/10.2196/27060. Chung H, Ko H, Kang WS, et al. Prediction and feature importance analysis for severity of COVID-19 in South Korea using artificial intelligence:model development and validation. J Med Internet Res 202; DOI: https://​doi.​org/​10.​2196/​27060.
9.
go back to reference Gupta RK, Harrison EM, Ho A, et al. Development and validation of the ISARIC 4C deterioration model for adults hospitalised with COVID-19: a prospective cohort study. Lancet Respir Med 2021; 9: 349-59.CrossRefPubMedPubMedCentral Gupta RK, Harrison EM, Ho A, et al. Development and validation of the ISARIC 4C deterioration model for adults hospitalised with COVID-19: a prospective cohort study. Lancet Respir Med 2021; 9: 349-59.CrossRefPubMedPubMedCentral
10.
go back to reference Heldt FS, Vizcaychipi MP, Peacock S, et al. Early risk assessment for COVID-19 patients from emergency department data using machine learning. medRxiv 2020; DOI: 2020.05.19.20086488. Heldt FS, Vizcaychipi MP, Peacock S, et al. Early risk assessment for COVID-19 patients from emergency department data using machine learning. medRxiv 2020; DOI: 2020.05.19.20086488.
12.
go back to reference Chen R, Liang W, Jiang M, et al. Risk factors of fatal outcome in hospitalized subjects with coronavirus disease 2019 from a nationwide analysis in China. Chest 2020; 158: 97-105.CrossRefPubMed Chen R, Liang W, Jiang M, et al. Risk factors of fatal outcome in hospitalized subjects with coronavirus disease 2019 from a nationwide analysis in China. Chest 2020; 158: 97-105.CrossRefPubMed
17.
go back to reference Ryan L, Lam C, Mataraso S, et al. Mortality prediction model for the triage of COVID-19, pneumonia, and mechanically ventilated ICU patients: a retrospective study. Ann Med Surg (Lond) 2020; 59: 207-16.CrossRefPubMed Ryan L, Lam C, Mataraso S, et al. Mortality prediction model for the triage of COVID-19, pneumonia, and mechanically ventilated ICU patients: a retrospective study. Ann Med Surg (Lond) 2020; 59: 207-16.CrossRefPubMed
18.
go back to reference Raschke RA, Agarwal S, Rangan P, Heise CW, Curry SC. Discriminant accuracy of the SOFA score for determining the probable mortality of patients with COVID-19 pneumonia requiring mechanical ventilation. JAMA 2021; 325: 1469-70.CrossRefPubMedPubMedCentral Raschke RA, Agarwal S, Rangan P, Heise CW, Curry SC. Discriminant accuracy of the SOFA score for determining the probable mortality of patients with COVID-19 pneumonia requiring mechanical ventilation. JAMA 2021; 325: 1469-70.CrossRefPubMedPubMedCentral
20.
go back to reference Liu T, Liang W, Zhong H, et al. Risk factors associated with COVID-19 infection: a retrospective cohort study based on contacts tracing. Emerg Microbes Infect 2020; 9: 1546-53.CrossRefPubMedPubMedCentral Liu T, Liang W, Zhong H, et al. Risk factors associated with COVID-19 infection: a retrospective cohort study based on contacts tracing. Emerg Microbes Infect 2020; 9: 1546-53.CrossRefPubMedPubMedCentral
22.
go back to reference Sadaka F, EthmaneAbouElMaali C, Cytron MA, Fowler K, Javaux VM, O'Brien J. Predicting mortality of patients with sepsis: a comparison of APACHE II and APACHE III scoring systems. J Clin Med Res 2017; 9: 907-10.CrossRefPubMedPubMedCentral Sadaka F, EthmaneAbouElMaali C, Cytron MA, Fowler K, Javaux VM, O'Brien J. Predicting mortality of patients with sepsis: a comparison of APACHE II and APACHE III scoring systems. J Clin Med Res 2017; 9: 907-10.CrossRefPubMedPubMedCentral
24.
go back to reference Allison PD. Logistic Regression Using the SAS System: Theory and Application. SAS Publishing; 1999: 179-216. Allison PD. Logistic Regression Using the SAS System: Theory and Application. SAS Publishing; 1999: 179-216.
25.
go back to reference Grant SW, Collins GS, Nashef SA. Statistical Primer: developing and validating a risk prediction model. Eur J Cardiothorac Surg 2018; 54: 203-8.CrossRefPubMed Grant SW, Collins GS, Nashef SA. Statistical Primer: developing and validating a risk prediction model. Eur J Cardiothorac Surg 2018; 54: 203-8.CrossRefPubMed
26.
go back to reference Rabe-Hesketh S, Everitt B. Statistical Analysis Using Stata. Chapman & Hall/CRC; 2000: 119-36. Rabe-Hesketh S, Everitt B. Statistical Analysis Using Stata. Chapman & Hall/CRC; 2000: 119-36.
27.
go back to reference Lyman GH, Kuderer NM. A primer in prognostic and predictive models: development and validation of neutropenia risk models. Support Cancer Ther 2005; 2: 168-75.CrossRefPubMed Lyman GH, Kuderer NM. A primer in prognostic and predictive models: development and validation of neutropenia risk models. Support Cancer Ther 2005; 2: 168-75.CrossRefPubMed
28.
go back to reference Katz MH. Multivariable analysis: a primer for readers of medical research. Ann Intern Med 2003; 138: 644-50.CrossRefPubMed Katz MH. Multivariable analysis: a primer for readers of medical research. Ann Intern Med 2003; 138: 644-50.CrossRefPubMed
29.
go back to reference Steyerberg EW, Eijkemans MJ, Harrell FE Jr, Habbema JD. Prognostic modeling with logistic regression analysis: in search of a sensible strategy in small data sets. Med Decis Making 2001; 21: 45-56.CrossRefPubMed Steyerberg EW, Eijkemans MJ, Harrell FE Jr, Habbema JD. Prognostic modeling with logistic regression analysis: in search of a sensible strategy in small data sets. Med Decis Making 2001; 21: 45-56.CrossRefPubMed
30.
go back to reference Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001; 54: 774-81.CrossRefPubMed Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001; 54: 774-81.CrossRefPubMed
31.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36.CrossRefPubMed
32.
go back to reference McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making 1984; 4: 137-50.CrossRefPubMed McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making 1984; 4: 137-50.CrossRefPubMed
34.
go back to reference Shoukat A, Wells CR, Langley JM, Singer BH, Galvani AP, Moghadas SM. Projecting demand for critical care beds during COVID-19 outbreaks in Canada. CMAJ 2020; 192: E489-96.CrossRefPubMedPubMedCentral Shoukat A, Wells CR, Langley JM, Singer BH, Galvani AP, Moghadas SM. Projecting demand for critical care beds during COVID-19 outbreaks in Canada. CMAJ 2020; 192: E489-96.CrossRefPubMedPubMedCentral
35.
go back to reference Lim ZJ, Subramaniam A, Ponnapa Reddy M, et al. Case fatality rates for patients with COVID-19 requiring invasive mechanical ventilation. a meta-analysis. Am J Respir Crit Care Med 2021; 203: 54-66. Lim ZJ, Subramaniam A, Ponnapa Reddy M, et al. Case fatality rates for patients with COVID-19 requiring invasive mechanical ventilation. a meta-analysis. Am J Respir Crit Care Med 2021; 203: 54-66.
36.
go back to reference Botta M, Tsonas AM, Pillay J, et al. Ventilation management and clinical outcomes in invasively ventilated patients with COVID-19 (PRoVENT-COVID): a national, multicentre, observational cohort study. Lancet Respir Med 2021; 9: 139-48.CrossRefPubMed Botta M, Tsonas AM, Pillay J, et al. Ventilation management and clinical outcomes in invasively ventilated patients with COVID-19 (PRoVENT-COVID): a national, multicentre, observational cohort study. Lancet Respir Med 2021; 9: 139-48.CrossRefPubMed
37.
go back to reference Rhodes A, Evans LE, Alhazzani W, et al. Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock: 2016. Crit Care Med 2017; 45: 486-555.CrossRefPubMed Rhodes A, Evans LE, Alhazzani W, et al. Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock: 2016. Crit Care Med 2017; 45: 486-555.CrossRefPubMed
38.
go back to reference Shankar-Hari M, Phillips GS, Levy ML, et al. Developing a new definition and assessing new clinical criteria for septic shock: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 2016; 315: 775-87.CrossRefPubMedPubMedCentral Shankar-Hari M, Phillips GS, Levy ML, et al. Developing a new definition and assessing new clinical criteria for septic shock: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 2016; 315: 775-87.CrossRefPubMedPubMedCentral
39.
go back to reference Vincent JL, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med 1996; 22: 707-10.CrossRefPubMed Vincent JL, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med 1996; 22: 707-10.CrossRefPubMed
40.
go back to reference Wong DT, Crofts SL, Gomez M, McGuire GP, Byrick RJ. Evaluation of predictive ability of APACHE II system and hospital outcome in Canadian intensive care unit patients. Crit Care Med 1995; 23: 1177-83.CrossRefPubMed Wong DT, Crofts SL, Gomez M, McGuire GP, Byrick RJ. Evaluation of predictive ability of APACHE II system and hospital outcome in Canadian intensive care unit patients. Crit Care Med 1995; 23: 1177-83.CrossRefPubMed
41.
42.
go back to reference Auld SC, Caridi-Scheible M, Blum JM, et al. ICU and ventilator mortality among critically ill adults with coronavirus disease 2019. Crit Care Med 2020; 48: e799-804.CrossRefPubMed Auld SC, Caridi-Scheible M, Blum JM, et al. ICU and ventilator mortality among critically ill adults with coronavirus disease 2019. Crit Care Med 2020; 48: e799-804.CrossRefPubMed
44.
go back to reference Villar J, Ambrós A, Soler JA, et al. Age, PaO2/FIO2, and plateau pressure score: a proposal for a simple outcome score in patients with the acute respiratory distress syndrome. Crit Care Med 2016; 44: 1361-9.CrossRefPubMed Villar J, Ambrós A, Soler JA, et al. Age, PaO2/FIO2, and plateau pressure score: a proposal for a simple outcome score in patients with the acute respiratory distress syndrome. Crit Care Med 2016; 44: 1361-9.CrossRefPubMed
47.
go back to reference Fan E, Beitler JR, Brochard L, et al. COVID-19-associated acute respiratory distress syndrome: is a different approach to management warranted? Lancet Respir Med 2020; 8: 816-21.CrossRefPubMedPubMedCentral Fan E, Beitler JR, Brochard L, et al. COVID-19-associated acute respiratory distress syndrome: is a different approach to management warranted? Lancet Respir Med 2020; 8: 816-21.CrossRefPubMedPubMedCentral
48.
go back to reference Amato MB, Meade MO, Slutsky AS, et al. Driving pressure and survival in the acute respiratory distress syndrome. N Engl J Med 2015; 372: 747-55.CrossRefPubMed Amato MB, Meade MO, Slutsky AS, et al. Driving pressure and survival in the acute respiratory distress syndrome. N Engl J Med 2015; 372: 747-55.CrossRefPubMed
49.
go back to reference Urner M, Jüni P, Hansen B, Wettstein MS, Ferguson ND, Fan E. Time-varying intensity of mechanical ventilation and mortality in patients with acute respiratory failure: a registry-based, prospective cohort study. Lancet Respir Med 2020; 8: 905-13.CrossRefPubMedPubMedCentral Urner M, Jüni P, Hansen B, Wettstein MS, Ferguson ND, Fan E. Time-varying intensity of mechanical ventilation and mortality in patients with acute respiratory failure: a registry-based, prospective cohort study. Lancet Respir Med 2020; 8: 905-13.CrossRefPubMedPubMedCentral
51.
go back to reference REMAP-CAP Investigators; Gordon AC, Mouncey PR, Al-Beidh F, et al. Interleukin-6 receptor antagonists in critically ill patients with Covid-19. N Engl J Med 2021; 384: 1491-502. REMAP-CAP Investigators; Gordon AC, Mouncey PR, Al-Beidh F, et al. Interleukin-6 receptor antagonists in critically ill patients with Covid-19. N Engl J Med 2021; 384: 1491-502.
53.
go back to reference Prescott HC, Rice TW. Corticosteroids in COVID-19 ARDS: evidence and hope during the pandemic. JAMA 2020; 324: 1292-5.CrossRefPubMed Prescott HC, Rice TW. Corticosteroids in COVID-19 ARDS: evidence and hope during the pandemic. JAMA 2020; 324: 1292-5.CrossRefPubMed
54.
55.
go back to reference Gaudry S, Messika J, Ricard J-D, et al. Patient-important outcomes in randomized controlled trials in critically ill patients: a systematic review. Ann Intensive Care 2017; 7: 28-. Gaudry S, Messika J, Ricard J-D, et al. Patient-important outcomes in randomized controlled trials in critically ill patients: a systematic review. Ann Intensive Care 2017; 7: 28-.
Metadata
Title
Development of a repeated-measures predictive model and clinical risk score for mortality in ventilated COVID-19 patients
Authors
Justyna Bartoszko, MD, MSc
George Dranitsaris, MSc, PhD
M. Elizabeth Wilcox, MD, PhD
Lorenzo Del Sorbo, MD
Sangeeta Mehta, MD
Miki Peer, PhD
Matteo Parotto, MD, PhD
Isaac Bogoch, MD, MSc
Sheila Riazi, MD, MSc
Publication date
01-03-2022
Publisher
Springer International Publishing
Keyword
COVID-19
Published in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Issue 3/2022
Print ISSN: 0832-610X
Electronic ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-021-02163-3

Other articles of this Issue 3/2022

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 3/2022 Go to the issue