Deep Learning–Based Time-to-Death Prediction Model for COVID-19 Patients Using Clinical Data and Chest Radiographs

go back to reference Goyal DK, Mansab F, Iqbal A and Bhatti S. Early intervention likely improves mortality in COVID-19 infection. Clin Med (Lond). 2020;20(3):248-250.PubMedPubMedCentralCrossRef Goyal DK, Mansab F, Iqbal A and Bhatti S. Early intervention likely improves mortality in COVID-19 infection. Clin Med (Lond). 2020;20(3):248-250.PubMedPubMedCentralCrossRef

go back to reference Sun Q, Qiu H, Huang M and Yang Y. Lower mortality of COVID-19 by early recognition and intervention: experience from Jiangsu Province. Annals of Intensive Care. 2020;10(1):33.PubMedPubMedCentralCrossRef Sun Q, Qiu H, Huang M and Yang Y. Lower mortality of COVID-19 by early recognition and intervention: experience from Jiangsu Province. Annals of Intensive Care. 2020;10(1):33.PubMedPubMedCentralCrossRef

go back to reference Cox DR. Regression models and life-tables. Journal of the Royal Statistical Society. Series B (Methodological). 1972;34(2):187–220. Cox DR. Regression models and life-tables. Journal of the Royal Statistical Society. Series B (Methodological). 1972;34(2):187–220.

go back to reference Bello-Chavolla OY, Bahena-López JP, Antonio-Villa NE, Vargas-Vázquez A, González-Díaz A, Márquez-Salinas A, Fermín-Martínez CA, Naveja JJ and Aguilar-Salinas CA. Predicting mortality due to SARS-CoV-2: A mechanistic score relating obesity and diabetes to COVID-19 outcomes in Mexico. J Clin Endocrinol Metab. 2020;105(8). Bello-Chavolla OY, Bahena-López JP, Antonio-Villa NE, Vargas-Vázquez A, González-Díaz A, Márquez-Salinas A, Fermín-Martínez CA, Naveja JJ and Aguilar-Salinas CA. Predicting mortality due to SARS-CoV-2: A mechanistic score relating obesity and diabetes to COVID-19 outcomes in Mexico. J Clin Endocrinol Metab. 2020;105(8).

go back to reference Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, Chen G, Cheng G, Wang Y, Bi J, Tan L, Lau G and Qin E. Prediction for progression risk in patients with COVID-19 pneumonia: The CALL Score. Clin Infect Dis. 2020;71(6):1393-1399.PubMedCrossRef Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, Chen G, Cheng G, Wang Y, Bi J, Tan L, Lau G and Qin E. Prediction for progression risk in patients with COVID-19 pneumonia: The CALL Score. Clin Infect Dis. 2020;71(6):1393-1399.PubMedCrossRef

go back to reference Wang S, Zha Y, Li W, Wu Q, Li X, Niu M, Wang M, Qiu X, Li H, Yu H, Gong W, Bai Y, Li L, Zhu Y, Wang L and Tian J. A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis. European Respiratory Journal. 2020:2000775. Wang S, Zha Y, Li W, Wu Q, Li X, Niu M, Wang M, Qiu X, Li H, Yu H, Gong W, Bai Y, Li L, Zhu Y, Wang L and Tian J. A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis. European Respiratory Journal. 2020:2000775.

go back to reference Gao M, Piernas C, Astbury NM, Hippisley-Cox J, O'Rahilly S, Aveyard P and Jebb SA. Associations between body-mass index and COVID-19 severity in 6·9 million people in England: a prospective, community-based, cohort study. The Lancet Diabetes & Endocrinology. 2021;9(6):350-359.CrossRef Gao M, Piernas C, Astbury NM, Hippisley-Cox J, O'Rahilly S, Aveyard P and Jebb SA. Associations between body-mass index and COVID-19 severity in 6·9 million people in England: a prospective, community-based, cohort study. The Lancet Diabetes & Endocrinology. 2021;9(6):350-359.CrossRef

go back to reference Hinton G. Deep learning—a technology with the potential to transform health care. JAMA. 2018;320(11):1101-1102.PubMedCrossRef Hinton G. Deep learning—a technology with the potential to transform health care. JAMA. 2018;320(11):1101-1102.PubMedCrossRef

go back to reference LeCun Y, Bengio Y and Hinton G. Deep learning. Nature. 2015;521(7553):436-444.PubMedCrossRef LeCun Y, Bengio Y and Hinton G. Deep learning. Nature. 2015;521(7553):436-444.PubMedCrossRef

go back to reference Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T and Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Medical Research Methodology. 2018;18(1):24.PubMedPubMedCentralCrossRef Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T and Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Medical Research Methodology. 2018;18(1):24.PubMedPubMedCentralCrossRef

go back to reference Chau T-N, Lee P-O, Choi K-W, Lee C-M, Ma K-F, Tsang T-Y, Tso Y-K, Chiu M-C, Tong W-L, Yu W-C and Lai S-T. Value of initial chest radiographs for predicting clinical outcomes in patients with severe acute respiratory syndrome. Am J Med. 2004;117(4):249-254.PubMedPubMedCentralCrossRef Chau T-N, Lee P-O, Choi K-W, Lee C-M, Ma K-F, Tsang T-Y, Tso Y-K, Chiu M-C, Tong W-L, Yu W-C and Lai S-T. Value of initial chest radiographs for predicting clinical outcomes in patients with severe acute respiratory syndrome. Am J Med. 2004;117(4):249-254.PubMedPubMedCentralCrossRef

go back to reference Cozzi D, Albanesi M, Cavigli E, Moroni C, Bindi A, Luvarà S, Lucarini S, Busoni S, Mazzoni LN and Miele V. Chest X-ray in new Coronavirus Disease 2019 (COVID-19) infection: findings and correlation with clinical outcome. Radiol Med. 2020;125(8):730-737.PubMedPubMedCentralCrossRef Cozzi D, Albanesi M, Cavigli E, Moroni C, Bindi A, Luvarà S, Lucarini S, Busoni S, Mazzoni LN and Miele V. Chest X-ray in new Coronavirus Disease 2019 (COVID-19) infection: findings and correlation with clinical outcome. Radiol Med. 2020;125(8):730-737.PubMedPubMedCentralCrossRef

go back to reference Kim HW, Capaccione KM, Li G, Luk L, Widemon RS, Rahman O, Beylergil V, Mitchell R, D'Souza BM, Leb JS, Dumeer S, Bentley-Hibbert S, Liu M, Jambawalikar S, Austin JHM and Salvatore M. The role of initial chest X-ray in triaging patients with suspected COVID-19 during the pandemic. Emerg Radiol. 2020;27(6):617-621.PubMedPubMedCentralCrossRef Kim HW, Capaccione KM, Li G, Luk L, Widemon RS, Rahman O, Beylergil V, Mitchell R, D'Souza BM, Leb JS, Dumeer S, Bentley-Hibbert S, Liu M, Jambawalikar S, Austin JHM and Salvatore M. The role of initial chest X-ray in triaging patients with suspected COVID-19 during the pandemic. Emerg Radiol. 2020;27(6):617-621.PubMedPubMedCentralCrossRef

go back to reference Toussie D, Voutsinas N, Finkelstein M, Cedillo MA, Manna S, Maron SZ, Jacobi A, Chung M, Bernheim A, Eber C, Concepcion J, Fayad ZA and Gupta YS. Clinical and chest radiography features determine patient outcomes in young and middle-aged adults with COVID-19. Radiology. 2020;297(1):E197-E206.PubMedCrossRef Toussie D, Voutsinas N, Finkelstein M, Cedillo MA, Manna S, Maron SZ, Jacobi A, Chung M, Bernheim A, Eber C, Concepcion J, Fayad ZA and Gupta YS. Clinical and chest radiography features determine patient outcomes in young and middle-aged adults with COVID-19. Radiology. 2020;297(1):E197-E206.PubMedCrossRef

go back to reference Bai HX, Hsieh B, Xiong Z, Halsey K, Choi JW, Tran TML, Pan I, Shi L-B, Wang D-C, Mei J, Jiang X-L, Zeng Q-H, Egglin TK, Hu P-F, Agarwal S, Xie F-F, Li S, Healey T, Atalay MK and Liao W-H. Performance of radiologists in differentiating COVID-19 from Non-COVID-19 viral pneumonia at chest CT. Radiology. 2020;296(2):E46-E54.PubMedCrossRef Bai HX, Hsieh B, Xiong Z, Halsey K, Choi JW, Tran TML, Pan I, Shi L-B, Wang D-C, Mei J, Jiang X-L, Zeng Q-H, Egglin TK, Hu P-F, Agarwal S, Xie F-F, Li S, Healey T, Atalay MK and Liao W-H. Performance of radiologists in differentiating COVID-19 from Non-COVID-19 viral pneumonia at chest CT. Radiology. 2020;296(2):E46-E54.PubMedCrossRef

go back to reference Yang W, Sirajuddin A, Zhang X, Liu G, Teng Z, Zhao S and Lu M. The role of imaging in 2019 novel coronavirus pneumonia (COVID-19). Eur Radiol. 2020;30(9):4874-4882.PubMedPubMedCentralCrossRef Yang W, Sirajuddin A, Zhang X, Liu G, Teng Z, Zhao S and Lu M. The role of imaging in 2019 novel coronavirus pneumonia (COVID-19). Eur Radiol. 2020;30(9):4874-4882.PubMedPubMedCentralCrossRef

go back to reference Saltz J, Saltz M, Prasanna P, Moffitt R, Hajagos J, Bremer E, Balsamo J and Kurc T. (2021). Stony brook university COVID-19 positive cases. https://doi.org/10.7937/TCIA.BBAG-2923 Saltz J, Saltz M, Prasanna P, Moffitt R, Hajagos J, Bremer E, Balsamo J and Kurc T. (2021). Stony brook university COVID-19 positive cases. https://​doi.​org/​10.​7937/​TCIA.​BBAG-2923

go back to reference Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L and Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26(6):1045-1057.PubMedPubMedCentralCrossRef Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L and Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26(6):1045-1057.PubMedPubMedCentralCrossRef

go back to reference Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, Lijmer JG, Moher D, Rennie D, de Vet HCW, Kressel HY, Rifai N, Golub RM, Altman DG, Hooft L, Korevaar DA and Cohen JF. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ : British Medical Journal. 2015;351:h5527.PubMedPubMedCentralCrossRef Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, Lijmer JG, Moher D, Rennie D, de Vet HCW, Kressel HY, Rifai N, Golub RM, Altman DG, Hooft L, Korevaar DA and Cohen JF. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ : British Medical Journal. 2015;351:h5527.PubMedPubMedCentralCrossRef

go back to reference Sholzberg M, Tang GH, Rahhal H, AlHamzah M, Kreuziger LB, Áinle FN, Alomran F, Alayed K, Alsheef M, AlSumait F, Pompilio CE, Sperlich C, Tangri S, Tang T, Jaksa P, Suryanarayan D, Almarshoodi M, Castellucci LA, James PD, Lillicrap D, Carrier M, Beckett A, Colovos C, Jayakar J, Arsenault MP, Wu C, Doyon K, Andreou ER, Dounaevskaia V, Tseng EK, Lim G, Fralick M, Middeldorp S, Lee AYY, Zuo F, da Costa BR, Thorpe KE, Negri EM, Cushman M and Jüni P. Effectiveness of therapeutic heparin versus prophylactic heparin on death, mechanical ventilation, or intensive care unit admission in moderately ill patients with covid-19 admitted to hospital: RAPID randomised clinical trial. Bmj. 2021;375:n2400.PubMedCrossRef Sholzberg M, Tang GH, Rahhal H, AlHamzah M, Kreuziger LB, Áinle FN, Alomran F, Alayed K, Alsheef M, AlSumait F, Pompilio CE, Sperlich C, Tangri S, Tang T, Jaksa P, Suryanarayan D, Almarshoodi M, Castellucci LA, James PD, Lillicrap D, Carrier M, Beckett A, Colovos C, Jayakar J, Arsenault MP, Wu C, Doyon K, Andreou ER, Dounaevskaia V, Tseng EK, Lim G, Fralick M, Middeldorp S, Lee AYY, Zuo F, da Costa BR, Thorpe KE, Negri EM, Cushman M and Jüni P. Effectiveness of therapeutic heparin versus prophylactic heparin on death, mechanical ventilation, or intensive care unit admission in moderately ill patients with covid-19 admitted to hospital: RAPID randomised clinical trial. Bmj. 2021;375:n2400.PubMedCrossRef

go back to reference Spyropoulos AC, Goldin M, Giannis D, Diab W, Wang J, Khanijo S, Mignatti A, Gianos E, Cohen M, Sharifova G, Lund JM, Tafur A, Lewis PA, Cohoon KP, Rahman H, Sison CP, Lesser ML, Ochani K, Agrawal N, Hsia J, Anderson VE, Bonaca M, Halperin JL and Weitz JI. Efficacy and safety of therapeutic-dose heparin vs standard prophylactic or intermediate-dose heparins for thromboprophylaxis in high-risk hospitalized patients with COVID-19: The HEP-COVID randomized clinical trial. JAMA Intern Med. 2021;181(12):1612-1620.PubMedPubMedCentralCrossRef Spyropoulos AC, Goldin M, Giannis D, Diab W, Wang J, Khanijo S, Mignatti A, Gianos E, Cohen M, Sharifova G, Lund JM, Tafur A, Lewis PA, Cohoon KP, Rahman H, Sison CP, Lesser ML, Ochani K, Agrawal N, Hsia J, Anderson VE, Bonaca M, Halperin JL and Weitz JI. Efficacy and safety of therapeutic-dose heparin vs standard prophylactic or intermediate-dose heparins for thromboprophylaxis in high-risk hospitalized patients with COVID-19: The HEP-COVID randomized clinical trial. JAMA Intern Med. 2021;181(12):1612-1620.PubMedPubMedCentralCrossRef

go back to reference Goligher EC, Bradbury CA, McVerry BJ, Lawler PR, Berger JS, Gong MN, Carrier M, Reynolds HR, Kumar A, Turgeon AF, Kornblith LZ, Kahn SR, Marshall JC, Kim KS, Houston BL, Derde LPG, Cushman M, Tritschler T, Angus DC, Godoy LC, McQuilten Z, Kirwan BA, Farkouh ME, Brooks MM, Lewis RJ, Berry LR, Lorenzi E, Gordon AC, Ahuja T, Al-Beidh F, Annane D, Arabi YM, Aryal D, Baumann Kreuziger L, Beane A, Bhimani Z, Bihari S, Billett HH, Bond L, Bonten M, Brunkhorst F, Buxton M, Buzgau A, Castellucci LA, Chekuri S, Chen JT, Cheng AC, Chkhikvadze T, Coiffard B, Contreras A, Costantini TW, de Brouwer S, Detry MA, Duggal A, Džavík V, Effron MB, Eng HF, Escobedo J, Estcourt LJ, Everett BM, Fergusson DA, Fitzgerald M, Fowler RA, Froess JD, Fu Z, Galanaud JP, Galen BT, Gandotra S, Girard TD, Goodman AL, Goossens H, Green C, Greenstein YY, Gross PL, Haniffa R, Hegde SM, Hendrickson CM, Higgins AM, Hindenburg AA, Hope AA, Horowitz JM, Horvat CM, Huang DT, Hudock K, Hunt BJ, Husain M, Hyzy RC, Jacobson JR, Jayakumar D, Keller NM, Khan A, Kim Y, Kindzelski A, King AJ, Knudson MM, Kornblith AE, Kutcher ME, Laffan MA, Lamontagne F, Le Gal G, Leeper CM, Leifer ES, Lim G, Gallego Lima F, Linstrum K, Litton E, Lopez-Sendon J, Lother SA, Marten N, Saud Marinez A, Martinez M, Mateos Garcia E, Mavromichalis S, McAuley DF, McDonald EG, McGlothlin A, McGuinness SP, Middeldorp S, Montgomery SK, Mouncey PR, Murthy S, Nair GB, Nair R, Nichol AD, Nicolau JC, Nunez-Garcia B, Park JJ, Park PK, Parke RL, Parker JC, Parnia S, Paul JD, Pompilio M, Quigley JG, Rosenson RS, Rost NS, Rowan K, Santos FO, Santos M, Santos MO, Satterwhite L, Saunders CT, Schreiber J, Schutgens REG, Seymour CW, Siegal DM, Silva DG, Jr., Singhal AB, Slutsky AS, Solvason D, Stanworth SJ, Turner AM, van Bentum-Puijk W, van de Veerdonk FL, van Diepen S, Vazquez-Grande G, Wahid L, Wareham V, Widmer RJ, Wilson JG, Yuriditsky E, Zhong Y, Berry SM, McArthur CJ, Neal MD, Hochman JS, Webb SA and Zarychanski R. Therapeutic anticoagulation with heparin in critically Ill patients with Covid-19. N Engl J Med. 2021;385(9):777-789.PubMedCrossRef Goligher EC, Bradbury CA, McVerry BJ, Lawler PR, Berger JS, Gong MN, Carrier M, Reynolds HR, Kumar A, Turgeon AF, Kornblith LZ, Kahn SR, Marshall JC, Kim KS, Houston BL, Derde LPG, Cushman M, Tritschler T, Angus DC, Godoy LC, McQuilten Z, Kirwan BA, Farkouh ME, Brooks MM, Lewis RJ, Berry LR, Lorenzi E, Gordon AC, Ahuja T, Al-Beidh F, Annane D, Arabi YM, Aryal D, Baumann Kreuziger L, Beane A, Bhimani Z, Bihari S, Billett HH, Bond L, Bonten M, Brunkhorst F, Buxton M, Buzgau A, Castellucci LA, Chekuri S, Chen JT, Cheng AC, Chkhikvadze T, Coiffard B, Contreras A, Costantini TW, de Brouwer S, Detry MA, Duggal A, Džavík V, Effron MB, Eng HF, Escobedo J, Estcourt LJ, Everett BM, Fergusson DA, Fitzgerald M, Fowler RA, Froess JD, Fu Z, Galanaud JP, Galen BT, Gandotra S, Girard TD, Goodman AL, Goossens H, Green C, Greenstein YY, Gross PL, Haniffa R, Hegde SM, Hendrickson CM, Higgins AM, Hindenburg AA, Hope AA, Horowitz JM, Horvat CM, Huang DT, Hudock K, Hunt BJ, Husain M, Hyzy RC, Jacobson JR, Jayakumar D, Keller NM, Khan A, Kim Y, Kindzelski A, King AJ, Knudson MM, Kornblith AE, Kutcher ME, Laffan MA, Lamontagne F, Le Gal G, Leeper CM, Leifer ES, Lim G, Gallego Lima F, Linstrum K, Litton E, Lopez-Sendon J, Lother SA, Marten N, Saud Marinez A, Martinez M, Mateos Garcia E, Mavromichalis S, McAuley DF, McDonald EG, McGlothlin A, McGuinness SP, Middeldorp S, Montgomery SK, Mouncey PR, Murthy S, Nair GB, Nair R, Nichol AD, Nicolau JC, Nunez-Garcia B, Park JJ, Park PK, Parke RL, Parker JC, Parnia S, Paul JD, Pompilio M, Quigley JG, Rosenson RS, Rost NS, Rowan K, Santos FO, Santos M, Santos MO, Satterwhite L, Saunders CT, Schreiber J, Schutgens REG, Seymour CW, Siegal DM, Silva DG, Jr., Singhal AB, Slutsky AS, Solvason D, Stanworth SJ, Turner AM, van Bentum-Puijk W, van de Veerdonk FL, van Diepen S, Vazquez-Grande G, Wahid L, Wareham V, Widmer RJ, Wilson JG, Yuriditsky E, Zhong Y, Berry SM, McArthur CJ, Neal MD, Hochman JS, Webb SA and Zarychanski R. Therapeutic anticoagulation with heparin in critically Ill patients with Covid-19. N Engl J Med. 2021;385(9):777-789.PubMedCrossRef

go back to reference Barry M, Alotaibi M, Almohaya A, Aldrees A, AlHijji A, Althabit N, Alhasani S, Akkielah L, AlRajhi A, Nouh T, Temsah MH and Al-Tawfiq JA. Factors associated with poor outcomes among hospitalized patients with COVID-19: Experience from a MERS-CoV referral hospital. J Infect Public Health. 2021;14(11):1658-1665.PubMedPubMedCentralCrossRef Barry M, Alotaibi M, Almohaya A, Aldrees A, AlHijji A, Althabit N, Alhasani S, Akkielah L, AlRajhi A, Nouh T, Temsah MH and Al-Tawfiq JA. Factors associated with poor outcomes among hospitalized patients with COVID-19: Experience from a MERS-CoV referral hospital. J Infect Public Health. 2021;14(11):1658-1665.PubMedPubMedCentralCrossRef

go back to reference Izcovich A, Ragusa MA, Tortosa F, Lavena Marzio MA, Agnoletti C, Bengolea A, Ceirano A, Espinosa F, Saavedra E, Sanguine V, Tassara A, Cid C, Catalano HN, Agarwal A, Foroutan F and Rada G. Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review. PLoS One. 2020;15(11):e0241955.PubMedPubMedCentralCrossRef Izcovich A, Ragusa MA, Tortosa F, Lavena Marzio MA, Agnoletti C, Bengolea A, Ceirano A, Espinosa F, Saavedra E, Sanguine V, Tassara A, Cid C, Catalano HN, Agarwal A, Foroutan F and Rada G. Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review. PLoS One. 2020;15(11):e0241955.PubMedPubMedCentralCrossRef

go back to reference Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, Curtis HJ, Mehrkar A, Evans D, Inglesby P, Cockburn J, McDonald HI, MacKenna B, Tomlinson L, Douglas IJ, Rentsch CT, Mathur R, Wong AYS, Grieve R, Harrison D, Forbes H, Schultze A, Croker R, Parry J, Hester F, Harper S, Perera R, Evans SJW, Smeeth L and Goldacre B. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020;584(7821):430-436.PubMedPubMedCentralCrossRef Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, Curtis HJ, Mehrkar A, Evans D, Inglesby P, Cockburn J, McDonald HI, MacKenna B, Tomlinson L, Douglas IJ, Rentsch CT, Mathur R, Wong AYS, Grieve R, Harrison D, Forbes H, Schultze A, Croker R, Parry J, Hester F, Harper S, Perera R, Evans SJW, Smeeth L and Goldacre B. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020;584(7821):430-436.PubMedPubMedCentralCrossRef

go back to reference He K, Zhang X, Ren S and Sun J, editors. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. He K, Zhang X, Ren S and Sun J, editors. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016.

go back to reference Huang G, Liu Z, Van Der Maaten L and Weinberger KQ, editors. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition; 2017. Huang G, Liu Z, Van Der Maaten L and Weinberger KQ, editors. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition; 2017.

go back to reference Tan M and Le Q, editors. Efficientnet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning; 2019: PMLR. Tan M and Le Q, editors. Efficientnet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning; 2019: PMLR.

go back to reference Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N and Antiga L. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems. 2019;32:8026-8037. Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N and Antiga L. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems. 2019;32:8026-8037.

go back to reference Breiman L. Random Forests. Machine Learning. 2001;45(1):5-32.CrossRef Breiman L. Random Forests. Machine Learning. 2001;45(1):5-32.CrossRef

go back to reference Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D and Batra D, editors. Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision; 2017. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D and Batra D, editors. Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision; 2017.

go back to reference Harrell FE, Jr., Lee KL and Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361-387.PubMedCrossRef Harrell FE, Jr., Lee KL and Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361-387.PubMedCrossRef

go back to reference Brier GW. Verification of forecasts expressed in terms of probability. Monthly Weather Review. 1950;78(1):1-3.CrossRef Brier GW. Verification of forecasts expressed in terms of probability. Monthly Weather Review. 1950;78(1):1-3.CrossRef

go back to reference Heagerty PJ and Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics. 2005;61(1):92-105.PubMedCrossRef Heagerty PJ and Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics. 2005;61(1):92-105.PubMedCrossRef

go back to reference Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, Bonten MMJ, Dahly DL, Damen JA, Debray TPA, de Jong VMT, De Vos M, Dhiman P, Haller MC, Harhay MO, Henckaerts L, Heus P, Kammer M, Kreuzberger N, Lohmann A, Luijken K, Ma J, Martin GP, McLernon DJ, Andaur Navarro CL, Reitsma JB, Sergeant JC, Shi C, Skoetz N, Smits LJM, Snell KIE, Sperrin M, Spijker R, Steyerberg EW, Takada T, Tzoulaki I, van Kuijk SMJ, van Bussel BCT, van der Horst ICC, van Royen FS, Verbakel JY, Wallisch C, Wilkinson J, Wolff R, Hooft L, Moons KGM and van Smeden M. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328.PubMedPubMedCentralCrossRef Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, Bonten MMJ, Dahly DL, Damen JA, Debray TPA, de Jong VMT, De Vos M, Dhiman P, Haller MC, Harhay MO, Henckaerts L, Heus P, Kammer M, Kreuzberger N, Lohmann A, Luijken K, Ma J, Martin GP, McLernon DJ, Andaur Navarro CL, Reitsma JB, Sergeant JC, Shi C, Skoetz N, Smits LJM, Snell KIE, Sperrin M, Spijker R, Steyerberg EW, Takada T, Tzoulaki I, van Kuijk SMJ, van Bussel BCT, van der Horst ICC, van Royen FS, Verbakel JY, Wallisch C, Wilkinson J, Wolff R, Hooft L, Moons KGM and van Smeden M. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328.PubMedPubMedCentralCrossRef

go back to reference Xu M, Ouyang L, Han L, Sun K, Yu T, Li Q, Tian H, Safarnejad L, Zhang H, Gao Y, Bao FS, Chen Y, Robinson P, Ge Y, Zhu B, Liu J and Chen S. Accurately differentiating between patients with COVID-19, patients with other viral infections, and healthy individuals: Multimodal late fusion learning approach. J Med Internet Res. 2021;23(1):e25535.PubMedPubMedCentralCrossRef Xu M, Ouyang L, Han L, Sun K, Yu T, Li Q, Tian H, Safarnejad L, Zhang H, Gao Y, Bao FS, Chen Y, Robinson P, Ge Y, Zhu B, Liu J and Chen S. Accurately differentiating between patients with COVID-19, patients with other viral infections, and healthy individuals: Multimodal late fusion learning approach. J Med Internet Res. 2021;23(1):e25535.PubMedPubMedCentralCrossRef

go back to reference Ho TT, Park J, Kim T, Park B, Lee J, Kim JY, Kim KB, Choi S, Kim YH, Lim J-K and Choi S. Deep learning models for predicting severe progression in COVID-19-infected patients: Retrospective study. JMIR Med Inform. 2021;9(1):e24973.PubMedPubMedCentralCrossRef Ho TT, Park J, Kim T, Park B, Lee J, Kim JY, Kim KB, Choi S, Kim YH, Lim J-K and Choi S. Deep learning models for predicting severe progression in COVID-19-infected patients: Retrospective study. JMIR Med Inform. 2021;9(1):e24973.PubMedPubMedCentralCrossRef

go back to reference Fang C, Bai S, Chen Q, Zhou Y, Xia L, Qin L, Gong S, Xie X, Zhou C, Tu D, Zhang C, Liu X, Chen W, Bai X and Torr PHS. Deep learning for predicting COVID-19 malignant progression. Med Image Anal. 2021;72:102096.PubMedPubMedCentralCrossRef Fang C, Bai S, Chen Q, Zhou Y, Xia L, Qin L, Gong S, Xie X, Zhou C, Tu D, Zhang C, Liu X, Chen W, Bai X and Torr PHS. Deep learning for predicting COVID-19 malignant progression. Med Image Anal. 2021;72:102096.PubMedPubMedCentralCrossRef

go back to reference Soda P, D'Amico NC, Tessadori J, Valbusa G, Guarrasi V, Bortolotto C, Akbar MU, Sicilia R, Cordelli E, Fazzini D, Cellina M, Oliva G, Callea G, Panella S, Cariati M, Cozzi D, Miele V, Stellato E, Carrafiello G, Castorani G, Simeone A, Preda L, Iannello G, Del Bue A, Tedoldi F, Alí M, Sona D and Papa S. AIforCOVID: Predicting the clinical outcomes in patients with COVID-19 applying AI to chest-X-rays. An Italian multicentre study. Med Image Anal. 2021;74:102216. Soda P, D'Amico NC, Tessadori J, Valbusa G, Guarrasi V, Bortolotto C, Akbar MU, Sicilia R, Cordelli E, Fazzini D, Cellina M, Oliva G, Callea G, Panella S, Cariati M, Cozzi D, Miele V, Stellato E, Carrafiello G, Castorani G, Simeone A, Preda L, Iannello G, Del Bue A, Tedoldi F, Alí M, Sona D and Papa S. AIforCOVID: Predicting the clinical outcomes in patients with COVID-19 applying AI to chest-X-rays. An Italian multicentre study. Med Image Anal. 2021;74:102216.

go back to reference Kwon YJF, Toussie D, Finkelstein M, Cedillo MA, Maron SZ, Manna S, Voutsinas N, Eber C, Jacobi A, Bernheim A, Gupta YS, Chung MS, Fayad ZA, Glicksberg BS, Oermann EK and Costa AB. Combining initial radiographs and clinical variables improves deep learning prognostication in patients with COVID-19 from the emergency department. Radiology. Artificial intelligence. 2020;3(2):e200098-e200098.PubMedPubMedCentralCrossRef Kwon YJF, Toussie D, Finkelstein M, Cedillo MA, Maron SZ, Manna S, Voutsinas N, Eber C, Jacobi A, Bernheim A, Gupta YS, Chung MS, Fayad ZA, Glicksberg BS, Oermann EK and Costa AB. Combining initial radiographs and clinical variables improves deep learning prognostication in patients with COVID-19 from the emergency department. Radiology. Artificial intelligence. 2020;3(2):e200098-e200098.PubMedPubMedCentralCrossRef

go back to reference Chieregato M, Frangiamore F, Morassi M, Baresi C, Nici S, Bassetti C, Bnà C and Galelli M. A hybrid machine learning/deep learning COVID-19 severity predictive model from CT images and clinical data. Sci Rep. 2022;12(1):4329.PubMedPubMedCentralCrossRef Chieregato M, Frangiamore F, Morassi M, Baresi C, Nici S, Bassetti C, Bnà C and Galelli M. A hybrid machine learning/deep learning COVID-19 severity predictive model from CT images and clinical data. Sci Rep. 2022;12(1):4329.PubMedPubMedCentralCrossRef

go back to reference Khozeimeh F, Sharifrazi D, Izadi NH, Joloudari JH, Shoeibi A, Alizadehsani R, Gorriz JM, Hussain S, Sani ZA, Moosaei H, Khosravi A, Nahavandi S and Islam SMS. Combining a convolutional neural network with autoencoders to predict the survival chance of COVID-19 patients. Scientific Reports. 2021;11(1):15343.PubMedPubMedCentralCrossRef Khozeimeh F, Sharifrazi D, Izadi NH, Joloudari JH, Shoeibi A, Alizadehsani R, Gorriz JM, Hussain S, Sani ZA, Moosaei H, Khosravi A, Nahavandi S and Islam SMS. Combining a convolutional neural network with autoencoders to predict the survival chance of COVID-19 patients. Scientific Reports. 2021;11(1):15343.PubMedPubMedCentralCrossRef

go back to reference Kim DW, Lee S, Kwon S, Nam W, Cha I-H and Kim HJ. Deep learning-based survival prediction of oral cancer patients. Scientific Reports. 2019;9(1):6994.PubMedPubMedCentralCrossRef Kim DW, Lee S, Kwon S, Nam W, Cha I-H and Kim HJ. Deep learning-based survival prediction of oral cancer patients. Scientific Reports. 2019;9(1):6994.PubMedPubMedCentralCrossRef

go back to reference Jiao Z, Choi JW, Halsey K, Tran TML, Hsieh B, Wang D, Eweje F, Wang R, Chang K, Wu J, Collins SA, Yi TY, Delworth AT, Liu T, Healey TT, Lu S, Wang J, Feng X, Atalay MK, Yang L, Feldman M, Zhang PJL, Liao W-H, Fan Y and Bai HX. Prognostication of patients with COVID-19 using artificial intelligence based on chest x-rays and clinical data: a retrospective study. The Lancet Digital Health. 2021;3(5):e286-e294.PubMedPubMedCentralCrossRef Jiao Z, Choi JW, Halsey K, Tran TML, Hsieh B, Wang D, Eweje F, Wang R, Chang K, Wu J, Collins SA, Yi TY, Delworth AT, Liu T, Healey TT, Lu S, Wang J, Feng X, Atalay MK, Yang L, Feldman M, Zhang PJL, Liao W-H, Fan Y and Bai HX. Prognostication of patients with COVID-19 using artificial intelligence based on chest x-rays and clinical data: a retrospective study. The Lancet Digital Health. 2021;3(5):e286-e294.PubMedPubMedCentralCrossRef

go back to reference Lundberg SM and Lee S-I. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems; Long Beach, California, USA: Curran Associates Inc.; 2017. p. 4768–4777. Lundberg SM and Lee S-I. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems; Long Beach, California, USA: Curran Associates Inc.; 2017. p. 4768–4777.

go back to reference Kermali M, Khalsa RK, Pillai K, Ismail Z and Harky A. The role of biomarkers in diagnosis of COVID-19 - A systematic review. Life sciences. 2020;254:117788-117788.PubMedPubMedCentralCrossRef Kermali M, Khalsa RK, Pillai K, Ismail Z and Harky A. The role of biomarkers in diagnosis of COVID-19 - A systematic review. Life sciences. 2020;254:117788-117788.PubMedPubMedCentralCrossRef

go back to reference Lambden S, Laterre PF, Levy MM and Francois B. The SOFA score-development, utility and challenges of accurate assessment in clinical trials. Critical care (London, England). 2019;23(1):374-374.PubMedPubMedCentralCrossRef Lambden S, Laterre PF, Levy MM and Francois B. The SOFA score-development, utility and challenges of accurate assessment in clinical trials. Critical care (London, England). 2019;23(1):374-374.PubMedPubMedCentralCrossRef

go back to reference Howard FM, Kochanny S, Koshy M, Spiotto M and Pearson AT. Machine learning-guided adjuvant treatment of head and neck cancer. JAMA Netw Open. 2020;3(11):e2025881.PubMedPubMedCentralCrossRef Howard FM, Kochanny S, Koshy M, Spiotto M and Pearson AT. Machine learning-guided adjuvant treatment of head and neck cancer. JAMA Netw Open. 2020;3(11):e2025881.PubMedPubMedCentralCrossRef

go back to reference She Y, Jin Z, Wu J, Deng J, Zhang L, Su H, Jiang G, Liu H, Xie D, Cao N, Ren Y and Chen C. Development and validation of a deep learning model for non–small cell lung cancer survival. JAMA Network Open. 2020;3(6):e205842-e205842.PubMedPubMedCentralCrossRef She Y, Jin Z, Wu J, Deng J, Zhang L, Su H, Jiang G, Liu H, Xie D, Cao N, Ren Y and Chen C. Development and validation of a deep learning model for non–small cell lung cancer survival. JAMA Network Open. 2020;3(6):e205842-e205842.PubMedPubMedCentralCrossRef

go back to reference Bice N, Kirby N, Bahr T, Rasmussen K, Saenz D, Wagner T, Papanikolaou N and Fakhreddine M. Deep learning-based survival analysis for brain metastasis patients with the national cancer database. Journal of Applied Clinical Medical Physics. 2020;21(9):187-192.PubMedPubMedCentralCrossRef Bice N, Kirby N, Bahr T, Rasmussen K, Saenz D, Wagner T, Papanikolaou N and Fakhreddine M. Deep learning-based survival analysis for brain metastasis patients with the national cancer database. Journal of Applied Clinical Medical Physics. 2020;21(9):187-192.PubMedPubMedCentralCrossRef

go back to reference Fukushima K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics. 1980;36(4):193-202.PubMedCrossRef Fukushima K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics. 1980;36(4):193-202.PubMedCrossRef

go back to reference Brierley JD, Gospodarowicz MK and Wittekind C. TNM classification of malignant tumours: John Wiley & Sons; 2017. Brierley JD, Gospodarowicz MK and Wittekind C. TNM classification of malignant tumours: John Wiley & Sons; 2017.

go back to reference Dreyer KJ and Geis JR. When machines think: Radiology's next frontier. Radiology. 2017;285(3):713-718.PubMedCrossRef Dreyer KJ and Geis JR. When machines think: Radiology's next frontier. Radiology. 2017;285(3):713-718.PubMedCrossRef

go back to reference Finlayson SG, Subbaswamy A, Singh K, Bowers J, Kupke A, Zittrain J, Kohane IS and Saria S. The clinician and dataset shift in artificial intelligence. New England Journal of Medicine. 2021;385(3):283-286.PubMedCrossRef Finlayson SG, Subbaswamy A, Singh K, Bowers J, Kupke A, Zittrain J, Kohane IS and Saria S. The clinician and dataset shift in artificial intelligence. New England Journal of Medicine. 2021;385(3):283-286.PubMedCrossRef