Skip to main content
Top
Published in: BMC Geriatrics 1/2023

Open Access 01-12-2023 | Research

An ensemble machine learning approach to predict postoperative mortality in older patients undergoing emergency surgery

Authors: Sang-Wook Lee, Eun-Ho Lee, In-Cheol Choi

Published in: BMC Geriatrics | Issue 1/2023

Login to get access

Abstract

Background

Prediction of preoperative frailty risk in the emergency setting is a challenging issue because preoperative evaluation cannot be done sufficiently. In a previous study, the preoperative frailty risk prediction model used only diagnostic and operation codes for emergency surgery and found poor predictive performance. This study developed a preoperative frailty prediction model using machine learning techniques that can be used in various clinical settings with improved predictive performance.

Methods

This is a national cohort study including 22,448 patients who were older than 75 years and visited the hospital for emergency surgery from the cohort of older patients among the retrieved sample from the Korean National Health Insurance Service. The diagnostic and operation codes were one-hot encoded and entered into the predictive model using the extreme gradient boosting (XGBoost) as a machine learning technique. The predictive performance of the model for postoperative 90-day mortality was compared with those of previous frailty evaluation tools such as Operation Frailty Risk Score (OFRS) and Hospital Frailty Risk Score (HFRS) using the receiver operating characteristic curve analysis.

Results

The predictive performance of the XGBoost, OFRS, and HFRS for postoperative 90-day mortality was 0.840, 0.607, and 0.588 on a c-statistics basis, respectively.

Conclusions

Using machine learning techniques, XGBoost to predict postoperative 90-day mortality, using diagnostic and operation codes, the prediction performance was improved significantly over the previous risk assessment models such as OFRS and HFRS.
Appendix
Available only for authorised users
Literature
1.
go back to reference Chan SP, Ip KY, Irwin MG. Peri-operative optimisation of elderly and frail patients: a narrative review. Anaesthesia. 2019;74(Suppl 1):80–9.CrossRefPubMed Chan SP, Ip KY, Irwin MG. Peri-operative optimisation of elderly and frail patients: a narrative review. Anaesthesia. 2019;74(Suppl 1):80–9.CrossRefPubMed
2.
go back to reference Lim BG, Lee IO. Anesthetic management of geriatric patients. Korean J Anesthesiol. 2020;73(1):8–29.CrossRefPubMed Lim BG, Lee IO. Anesthetic management of geriatric patients. Korean J Anesthesiol. 2020;73(1):8–29.CrossRefPubMed
3.
go back to reference Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet. 2013;381(9868):752–62.CrossRefPubMed Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet. 2013;381(9868):752–62.CrossRefPubMed
4.
go back to reference Partridge JS, Harari D, Dhesi JK. Frailty in the older surgical patient: a review. Age Ageing. 2012;41(2):142–7.CrossRefPubMed Partridge JS, Harari D, Dhesi JK. Frailty in the older surgical patient: a review. Age Ageing. 2012;41(2):142–7.CrossRefPubMed
5.
go back to reference Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001;56(3):M146–156.CrossRefPubMed Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001;56(3):M146–156.CrossRefPubMed
6.
go back to reference Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I, Mitnitski A. A global clinical measure of fitness and frailty in elderly people. CMAJ. 2005;173(5):489–95.CrossRefPubMedPubMedCentral Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I, Mitnitski A. A global clinical measure of fitness and frailty in elderly people. CMAJ. 2005;173(5):489–95.CrossRefPubMedPubMedCentral
7.
go back to reference Arjunan A, Peel NM, Hubbard RE. Gait Speed and Frailty Status in relation to adverse outcomes in Geriatric Rehabilitation. Arch Phys Med Rehabil. 2019;100(5):859–64.CrossRefPubMed Arjunan A, Peel NM, Hubbard RE. Gait Speed and Frailty Status in relation to adverse outcomes in Geriatric Rehabilitation. Arch Phys Med Rehabil. 2019;100(5):859–64.CrossRefPubMed
8.
go back to reference Castell MV, Sanchez M, Julian R, Queipo R, Martin S, Otero A. Frailty prevalence and slow walking speed in persons age 65 and older: implications for primary care. BMC Fam Pract. 2013;14:86.CrossRefPubMedPubMedCentral Castell MV, Sanchez M, Julian R, Queipo R, Martin S, Otero A. Frailty prevalence and slow walking speed in persons age 65 and older: implications for primary care. BMC Fam Pract. 2013;14:86.CrossRefPubMedPubMedCentral
9.
go back to reference Choi JY, Kim KI, Choi Y, Ahn SH, Kang E, Oh HK, Kim DW, Kim EK, Yoon YS, Kang SB, et al. Comparison of multidimensional frailty score, grip strength, and gait speed in older surgical patients. J Cachexia Sarcopenia Muscle. 2020;11(2):432–40.CrossRefPubMedPubMedCentral Choi JY, Kim KI, Choi Y, Ahn SH, Kang E, Oh HK, Kim DW, Kim EK, Yoon YS, Kang SB, et al. Comparison of multidimensional frailty score, grip strength, and gait speed in older surgical patients. J Cachexia Sarcopenia Muscle. 2020;11(2):432–40.CrossRefPubMedPubMedCentral
10.
go back to reference Dudzinska-Griszek J, Szuster K, Szewieczek J. Grip strength as a frailty diagnostic component in geriatric inpatients. Clin Interv Aging. 2017;12:1151–7.CrossRefPubMedPubMedCentral Dudzinska-Griszek J, Szuster K, Szewieczek J. Grip strength as a frailty diagnostic component in geriatric inpatients. Clin Interv Aging. 2017;12:1151–7.CrossRefPubMedPubMedCentral
11.
go back to reference Jung HW, Jang IY, Lee CK, Yu SS, Hwang JK, Jeon C, Lee YS, Lee E. Usual gait speed is associated with frailty status, institutionalization, and mortality in community-dwelling rural older adults: a longitudinal analysis of the Aging Study of Pyeongchang Rural Area. Clin Interv Aging. 2018;13:1079–89.CrossRefPubMedPubMedCentral Jung HW, Jang IY, Lee CK, Yu SS, Hwang JK, Jeon C, Lee YS, Lee E. Usual gait speed is associated with frailty status, institutionalization, and mortality in community-dwelling rural older adults: a longitudinal analysis of the Aging Study of Pyeongchang Rural Area. Clin Interv Aging. 2018;13:1079–89.CrossRefPubMedPubMedCentral
12.
go back to reference Reeve TEt, Ur R, Craven TE, Kaan JH, Goldman MP, Edwards MS, Hurie JB, Velazquez-Ramirez G, Corriere MA. Grip strength measurement for frailty assessment in patients with vascular disease and associations with comorbidity, cardiac risk, and sarcopenia. J Vasc Surg. 2018;67(5):1512–20.CrossRef Reeve TEt, Ur R, Craven TE, Kaan JH, Goldman MP, Edwards MS, Hurie JB, Velazquez-Ramirez G, Corriere MA. Grip strength measurement for frailty assessment in patients with vascular disease and associations with comorbidity, cardiac risk, and sarcopenia. J Vasc Surg. 2018;67(5):1512–20.CrossRef
14.
go back to reference Rockwood K, Mitnitski A. Frailty defined by deficit accumulation and geriatric medicine defined by frailty. Clin Geriatr Med. 2011;27(1):17–26.CrossRefPubMed Rockwood K, Mitnitski A. Frailty defined by deficit accumulation and geriatric medicine defined by frailty. Clin Geriatr Med. 2011;27(1):17–26.CrossRefPubMed
15.
go back to reference Gilbert T, Neuburger J, Kraindler J, Keeble E, Smith P, Ariti C, Arora S, Street A, Parker S, Roberts HC, et al. Development and validation of a hospital frailty risk score focusing on older people in acute care settings using electronic hospital records: an observational study. Lancet. 2018;391(10132):1775–82.CrossRefPubMedPubMedCentral Gilbert T, Neuburger J, Kraindler J, Keeble E, Smith P, Ariti C, Arora S, Street A, Parker S, Roberts HC, et al. Development and validation of a hospital frailty risk score focusing on older people in acute care settings using electronic hospital records: an observational study. Lancet. 2018;391(10132):1775–82.CrossRefPubMedPubMedCentral
16.
go back to reference Lee SW, Nam JS, Kim YJ, Kim MJ, Choi JH, Lee EH, Joung KW, Choi IC. Predictive Model for the Assessment of Preoperative Frailty Risk in the Elderly.J Clin Med2021, 10(19). Lee SW, Nam JS, Kim YJ, Kim MJ, Choi JH, Lee EH, Joung KW, Choi IC. Predictive Model for the Assessment of Preoperative Frailty Risk in the Elderly.J Clin Med2021, 10(19).
17.
go back to reference Lee SW, Kim KS, Park SW, Kim J, Choi JH, Lee S, Joung KW, Choi IC. Application of the New Preoperative Frailty Risk Score in Elderly Patients Undergoing Emergency Surgery.Gerontology2022:1–9. Lee SW, Kim KS, Park SW, Kim J, Choi JH, Lee S, Joung KW, Choi IC. Application of the New Preoperative Frailty Risk Score in Elderly Patients Undergoing Emergency Surgery.Gerontology2022:1–9.
18.
go back to reference Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, Shilton A, Yearwood J, Dimitrova N, Ho TB, et al. Guidelines for developing and reporting machine learning predictive models in Biomedical Research: a multidisciplinary view. J Med Internet Res. 2016;18(12):e323.CrossRefPubMedPubMedCentral Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, Shilton A, Yearwood J, Dimitrova N, Ho TB, et al. Guidelines for developing and reporting machine learning predictive models in Biomedical Research: a multidisciplinary view. J Med Internet Res. 2016;18(12):e323.CrossRefPubMedPubMedCentral
19.
go back to reference Kim YI, Kim YY, Yoon JL, Won CW, Ha S, Cho KD, Park BR, Bae S, Lee EJ, Park SY, et al. Cohort Profile: National health insurance service-senior (NHIS-senior) cohort in Korea. BMJ Open. 2019;9(7):e024344.CrossRefPubMedPubMedCentral Kim YI, Kim YY, Yoon JL, Won CW, Ha S, Cho KD, Park BR, Bae S, Lee EJ, Park SY, et al. Cohort Profile: National health insurance service-senior (NHIS-senior) cohort in Korea. BMJ Open. 2019;9(7):e024344.CrossRefPubMedPubMedCentral
20.
go back to reference Chen TQ, Guestrin C. XGBoost: A Scalable Tree Boosting System. Kdd’16: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining. 2016:785–794. Chen TQ, Guestrin C. XGBoost: A Scalable Tree Boosting System. Kdd’16: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining. 2016:785–794.
21.
go back to reference Costa G, Bersigotti L, Massa G, Lepre L, Fransvea P, Lucarini A, Mercantini P, Balducci G, Sganga G, Crucitti A, et al. The emergency surgery Frailty Index (EmSFI): development and internal validation of a novel simple bedside risk score for elderly patients undergoing emergency surgery. Aging Clin Exp Res. 2021;33(8):2191–201.CrossRefPubMed Costa G, Bersigotti L, Massa G, Lepre L, Fransvea P, Lucarini A, Mercantini P, Balducci G, Sganga G, Crucitti A, et al. The emergency surgery Frailty Index (EmSFI): development and internal validation of a novel simple bedside risk score for elderly patients undergoing emergency surgery. Aging Clin Exp Res. 2021;33(8):2191–201.CrossRefPubMed
22.
go back to reference Joseph B, Zangbar B, Pandit V, Fain M, Mohler MJ, Kulvatunyou N, Jokar TO, O’Keeffe T, Friese RS, Rhee P. Emergency general surgery in the Elderly: Too Old or too frail? J Am Coll Surg. 2016;222(5):805–13.CrossRefPubMed Joseph B, Zangbar B, Pandit V, Fain M, Mohler MJ, Kulvatunyou N, Jokar TO, O’Keeffe T, Friese RS, Rhee P. Emergency general surgery in the Elderly: Too Old or too frail? J Am Coll Surg. 2016;222(5):805–13.CrossRefPubMed
23.
go back to reference Parikh RB, Manz C, Chivers C, Regli SH, Braun J, Draugelis ME, Schuchter LM, Shulman LN, Navathe AS, Patel MS et al. Machine Learning Approaches to Predict 6-Month Mortality Among Patients With Cancer.Jama Netw Open2019, 2(10). Parikh RB, Manz C, Chivers C, Regli SH, Braun J, Draugelis ME, Schuchter LM, Shulman LN, Navathe AS, Patel MS et al. Machine Learning Approaches to Predict 6-Month Mortality Among Patients With Cancer.Jama Netw Open2019, 2(10).
24.
go back to reference Wong A, Young AT, Liang AS, Gonzales R, Douglas VC, Hadley D. Development and validation of an Electronic Health Record-Based machine learning model to Estimate Delirium Risk in newly hospitalized patients without known cognitive impairment. Jama Netw Open. 2018;1(4):e181018.CrossRefPubMedPubMedCentral Wong A, Young AT, Liang AS, Gonzales R, Douglas VC, Hadley D. Development and validation of an Electronic Health Record-Based machine learning model to Estimate Delirium Risk in newly hospitalized patients without known cognitive impairment. Jama Netw Open. 2018;1(4):e181018.CrossRefPubMedPubMedCentral
25.
go back to reference Zhang ZH, Zhao YM, Canes A, Steinberg D, Lyashevska O. Collab AB-DCT: Predictive analytics with gradient boosting in clinical medicine.Ann Transl Med2019, 7(7). Zhang ZH, Zhao YM, Canes A, Steinberg D, Lyashevska O. Collab AB-DCT: Predictive analytics with gradient boosting in clinical medicine.Ann Transl Med2019, 7(7).
26.
go back to reference Watson DS, Krutzinna J, Bruce IN, Griffiths CEM, McInnes IB, Barnes MR, Floridi L. Clinical applications of machine learning algorithms: beyond the black box.Bmj-Brit Med J2019,364. Watson DS, Krutzinna J, Bruce IN, Griffiths CEM, McInnes IB, Barnes MR, Floridi L. Clinical applications of machine learning algorithms: beyond the black box.Bmj-Brit Med J2019,364.
27.
go back to reference Stojic A, Stanic N, Vukovic G, Stanisic S, Perisic M, Sostaric A, Lazic L. Explainable extreme gradient boosting tree-based prediction of toluene, ethylbenzene and xylene wet deposition. Sci Total Environ. 2019;653:140–7.CrossRefPubMed Stojic A, Stanic N, Vukovic G, Stanisic S, Perisic M, Sostaric A, Lazic L. Explainable extreme gradient boosting tree-based prediction of toluene, ethylbenzene and xylene wet deposition. Sci Total Environ. 2019;653:140–7.CrossRefPubMed
28.
go back to reference Lundberg SM, Lee SI. A Unified Approach to Interpreting Model Predictions.Adv Neur In2017,30. Lundberg SM, Lee SI. A Unified Approach to Interpreting Model Predictions.Adv Neur In2017,30.
Metadata
Title
An ensemble machine learning approach to predict postoperative mortality in older patients undergoing emergency surgery
Authors
Sang-Wook Lee
Eun-Ho Lee
In-Cheol Choi
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2023
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-023-03969-0

Other articles of this Issue 1/2023

BMC Geriatrics 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine