Skip to main content
Top
Published in:

18-12-2023 | Laparotomy | Review Article

Prognostic accuracy of emergency surgery score: a systematic review

Authors: Amirmohammad Toloui, Mohammad Kiah, Amir Ali Zarrin, Yaser Azizi, Mahmoud Yousefifard

Published in: European Journal of Trauma and Emergency Surgery | Issue 3/2024

Login to get access

Abstract

Purpose

This systematic review aimed to summarize the literature regarding the prognostic accuracy of the emergency surgery score (ESS).

Method

PubMed, Embase, Web of Science, and Scopus were comprehensively searched by May 30, 2023. Two independent researchers performed the initial screening by reviewing the titles and abstracts of the non-duplicate records and selecting the full text of articles meeting our inclusion criteria. Finally, original studies that reported the prognostic accuracy of ESS in any emergency surgeries were included. Data from the included studies were extracted into a checklist designed based on the PRISMA guidelines. The area under the curve (AUC) was used to compare the prognostic accuracy of ESS in different settings.

Results

Twenty-six studies met the inclusion criteria. ESS performed excellently in 30-day post-op mortality (AUC 0.84–0.89) and incidence of cardiac arrest (AUC 0.86–0.88) in emergency general surgeries. The AUC of ESS in overall 30-day morbidities varied from 0.72 to 0.82 in five cohort studies. In predicting the need for ICU admission, the study with the largest sample size reported the best sensitivity of ESS at 80% and the specificity at 85%. Moreover, an outstanding accuracy was observed for the prediction of 30-day sepsis/septic shock in emergency general surgeries (AUC 0.75–0.92).

Conclusion

Despite the acceptable prognostic accuracy of ESS in 30-day mortality, morbidities, and in-hospital ICU admission in different emergency surgeries, the high number of required variables and the high probability of missing data highlight the need for modifications to this scoring system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Committee to Develop the Reorganized Specialty of Trauma, Surgical Critical Care, and Emergency Surgery. Acute care surgery: trauma, critical care, and emergency surgery. J Trauma. 2005;58(3):614–6.CrossRef Committee to Develop the Reorganized Specialty of Trauma, Surgical Critical Care, and Emergency Surgery. Acute care surgery: trauma, critical care, and emergency surgery. J Trauma. 2005;58(3):614–6.CrossRef
2.
go back to reference Gale SC, Shafi S, Dombrovskiy VY, Arumugam D, Crystal JS. The public health burden of emergency general surgery in the United States: a 10-year analysis of the Nationwide Inpatient Sample–2001 to 2010. J Trauma Acute Care Surg. 2014;77(2):202–8.CrossRefPubMed Gale SC, Shafi S, Dombrovskiy VY, Arumugam D, Crystal JS. The public health burden of emergency general surgery in the United States: a 10-year analysis of the Nationwide Inpatient Sample–2001 to 2010. J Trauma Acute Care Surg. 2014;77(2):202–8.CrossRefPubMed
3.
go back to reference Havens JM, Peetz AB, Do WS, Cooper Z, Kelly E, Askari R, et al. The excess morbidity and mortality of emergency general surgery. J Trauma Acute Care Surg. 2015;78(2):306–11.CrossRefPubMed Havens JM, Peetz AB, Do WS, Cooper Z, Kelly E, Askari R, et al. The excess morbidity and mortality of emergency general surgery. J Trauma Acute Care Surg. 2015;78(2):306–11.CrossRefPubMed
4.
go back to reference Symons NR, Moorthy K, Almoudaris AM, Bottle A, Aylin P, Vincent CA, et al. Mortality in high-risk emergency general surgical admissions. Br J Surg. 2013;100(10):1318–25.CrossRefPubMed Symons NR, Moorthy K, Almoudaris AM, Bottle A, Aylin P, Vincent CA, et al. Mortality in high-risk emergency general surgical admissions. Br J Surg. 2013;100(10):1318–25.CrossRefPubMed
5.
go back to reference Han K, Lee JM, Achanta A, Kongkaewpaisan N, Kongwibulwut M, Eid AI, et al. Emergency surgery score accurately predicts the risk of post-operative infection in emergency general surgery. Surg Infect. 2019;20(1):4–9.CrossRef Han K, Lee JM, Achanta A, Kongkaewpaisan N, Kongwibulwut M, Eid AI, et al. Emergency surgery score accurately predicts the risk of post-operative infection in emergency general surgery. Surg Infect. 2019;20(1):4–9.CrossRef
6.
go back to reference Kongkaewpaisan N, Lee JM, Eid AI, Kongwibulwut M, Han K, King D, et al. Can the emergency surgery score (ESS) be used as a triage tool predicting the postoperative need for an ICU admission? Am J Surg. 2019;217(1):24–8.CrossRefPubMed Kongkaewpaisan N, Lee JM, Eid AI, Kongwibulwut M, Han K, King D, et al. Can the emergency surgery score (ESS) be used as a triage tool predicting the postoperative need for an ICU admission? Am J Surg. 2019;217(1):24–8.CrossRefPubMed
7.
go back to reference Sangji NF, Bohnen JD, Ramly EP, Yeh DD, King DR, DeMoya M, et al. Derivation and validation of a novel Emergency Surgery Acuity Score (ESAS). J Trauma Acute Care Surg. 2016;81(2):213–20.CrossRefPubMed Sangji NF, Bohnen JD, Ramly EP, Yeh DD, King DR, DeMoya M, et al. Derivation and validation of a novel Emergency Surgery Acuity Score (ESAS). J Trauma Acute Care Surg. 2016;81(2):213–20.CrossRefPubMed
8.
go back to reference Raffee L, Almasarweh SA, Mazahreh TS, Alawneh K, Alabdallah NB, Hamoud MAA, et al. Predicting mortality and morbidity in emergency general surgery patients in a Jordanian Tertiary Medical Center: a retrospective validation study of the Emergency Surgery Score (ESS). BMJ Open. 2022;12(11): e061781.CrossRefPubMedPubMedCentral Raffee L, Almasarweh SA, Mazahreh TS, Alawneh K, Alabdallah NB, Hamoud MAA, et al. Predicting mortality and morbidity in emergency general surgery patients in a Jordanian Tertiary Medical Center: a retrospective validation study of the Emergency Surgery Score (ESS). BMJ Open. 2022;12(11): e061781.CrossRefPubMedPubMedCentral
9.
go back to reference Naar L, El Hechi M, Kokoroskos N, Parks J, Fawley J, Mendoza AE, et al. Can the Emergency Surgery Score (ESS) predict outcomes in emergency general surgery patients with missing data elements? A nationwide analysis. Am J Surg. 2020;220(6):1613–22.CrossRefPubMed Naar L, El Hechi M, Kokoroskos N, Parks J, Fawley J, Mendoza AE, et al. Can the Emergency Surgery Score (ESS) predict outcomes in emergency general surgery patients with missing data elements? A nationwide analysis. Am J Surg. 2020;220(6):1613–22.CrossRefPubMed
11.
go back to reference Page M, Mckenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Moher D, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372(71):1–9. Page M, Mckenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Moher D, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372(71):1–9.
12.
go back to reference Austin PC, Steyerberg EW. Interpreting the concordance statistic of a logistic regression model: relation to the variance and odds ratio of a continuous explanatory variable. BMC Med Res Methodol. 2012;12:1–8.CrossRef Austin PC, Steyerberg EW. Interpreting the concordance statistic of a logistic regression model: relation to the variance and odds ratio of a continuous explanatory variable. BMC Med Res Methodol. 2012;12:1–8.CrossRef
13.
go back to reference Lee J, Mulder F, Leeflang M, Wolff R, Whiting P, Bossuyt PM. QUAPAS: an adaptation of the QUADAS-2 tool to assess prognostic accuracy studies. Ann Intern Med. 2022;175(7):1010–8.CrossRefPubMed Lee J, Mulder F, Leeflang M, Wolff R, Whiting P, Bossuyt PM. QUAPAS: an adaptation of the QUADAS-2 tool to assess prognostic accuracy studies. Ann Intern Med. 2022;175(7):1010–8.CrossRefPubMed
14.
go back to reference Alburakan A, Aloofy OA, Alasheikh MA, Bn Duraihem TA, Altoijry A, Altuwaijri TA, et al. The Emergency surgery score (ESS) accurately predicts outcomes of emergency surgical admissions at a Saudi academic health center. Am J Surg. 2021;222(3):631–7.CrossRefPubMed Alburakan A, Aloofy OA, Alasheikh MA, Bn Duraihem TA, Altoijry A, Altuwaijri TA, et al. The Emergency surgery score (ESS) accurately predicts outcomes of emergency surgical admissions at a Saudi academic health center. Am J Surg. 2021;222(3):631–7.CrossRefPubMed
15.
go back to reference Alburakan AA, Alshammari SA, AlOtaibi WS, Almalki JH, Shalhoub MM, Nouh TA, et al. Charlson Comorbidity Index as a predictor of difficult cholecystectomy in patients with acute cholecystitis. Cureus. 2022;14(11). Alburakan AA, Alshammari SA, AlOtaibi WS, Almalki JH, Shalhoub MM, Nouh TA, et al. Charlson Comorbidity Index as a predictor of difficult cholecystectomy in patients with acute cholecystitis. Cureus. 2022;14(11).
16.
go back to reference AlSowaiegh R, Naar L, El Moheb M, Parks JJ, Fawley J, Mendoza AE, et al. The Emergency Surgery Score is a powerful predictor of outcomes across multiple surgical specialties: results of a retrospective nationwide analysis. Surgery. 2021;170(5):1501–7.CrossRefPubMed AlSowaiegh R, Naar L, El Moheb M, Parks JJ, Fawley J, Mendoza AE, et al. The Emergency Surgery Score is a powerful predictor of outcomes across multiple surgical specialties: results of a retrospective nationwide analysis. Surgery. 2021;170(5):1501–7.CrossRefPubMed
17.
go back to reference AlSowaiegh R, Naar L, Mokhtari A, Parks JJ, Fawley J, Mendoza AE, et al. Does the Emergency Surgery Score predict failure to discharge the patient home? A nationwide analysis. J Trauma Acute Care Surg. 2021;90(3):471–6.CrossRefPubMed AlSowaiegh R, Naar L, Mokhtari A, Parks JJ, Fawley J, Mendoza AE, et al. Does the Emergency Surgery Score predict failure to discharge the patient home? A nationwide analysis. J Trauma Acute Care Surg. 2021;90(3):471–6.CrossRefPubMed
18.
go back to reference Balasundaram N, Burgon R, Nallani A, Tish S, Bath J, Vogel TR. Performance of the emergency surgery score for nonelective aortoiliac endovascular reconstructions. J Vasc Surg. 2022;75(6):e221–2.CrossRef Balasundaram N, Burgon R, Nallani A, Tish S, Bath J, Vogel TR. Performance of the emergency surgery score for nonelective aortoiliac endovascular reconstructions. J Vasc Surg. 2022;75(6):e221–2.CrossRef
19.
go back to reference Balasundaram N, Kumar VTS, Kanake S, Chandra I, Hamai C, Vogel TR. Performance of the Emergency Surgery Score (ESS) for nonelective infrainguinal open revascularization procedures (NEIOR). Surgery. 2023;173(3):830–6.CrossRefPubMed Balasundaram N, Kumar VTS, Kanake S, Chandra I, Hamai C, Vogel TR. Performance of the Emergency Surgery Score (ESS) for nonelective infrainguinal open revascularization procedures (NEIOR). Surgery. 2023;173(3):830–6.CrossRefPubMed
20.
go back to reference Balasundaram N, Peters A, Kumar VTS, Camazine M, Bath J, Vogel TR. Performance of emergency surgery score for urgent endovascular aneurysm repair. J Vasc Surg. 2021;74(4):e379–80.CrossRef Balasundaram N, Peters A, Kumar VTS, Camazine M, Bath J, Vogel TR. Performance of emergency surgery score for urgent endovascular aneurysm repair. J Vasc Surg. 2021;74(4):e379–80.CrossRef
21.
go back to reference Balasundaram N, Ramji S, Burgon RD, Assefa M, Chandra I, Vogel TR. Performance of the emergency surgery score in nonelective lower-extremity endovascular procedures. J Surg Res. 2023;283:619–25.CrossRefPubMed Balasundaram N, Ramji S, Burgon RD, Assefa M, Chandra I, Vogel TR. Performance of the emergency surgery score in nonelective lower-extremity endovascular procedures. J Surg Res. 2023;283:619–25.CrossRefPubMed
22.
go back to reference Bertsimas D, Dunn J, Velmahos GC, Kaafarani HM. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based predictive optimal trees in emergency surgery risk (POTTER) calculator. Ann Surg. 2018;268(4):574–83.CrossRefPubMed Bertsimas D, Dunn J, Velmahos GC, Kaafarani HM. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based predictive optimal trees in emergency surgery risk (POTTER) calculator. Ann Surg. 2018;268(4):574–83.CrossRefPubMed
23.
go back to reference Christou CD, Naar L, Kongkaewpaisan N, Tsolakidis A, Smyrnis P, Tooulias A, et al. Validation of the Emergency Surgery Score (ESS) in a Greek patient population: a prospective bi-institutional cohort study. Eur J Trauma Emerg Surg. 2022;48(2):1197–204. Christou CD, Naar L, Kongkaewpaisan N, Tsolakidis A, Smyrnis P, Tooulias A, et al. Validation of the Emergency Surgery Score (ESS) in a Greek patient population: a prospective bi-institutional cohort study. Eur J Trauma Emerg Surg. 2022;48(2):1197–204.
24.
go back to reference Clinch D, Wong M, Imbert E, Haddow L, Simpson K, Damaskos D. SP4. 1.3 Validation of the Emergency Surgery Score (ESS) in the UK patient population and comparison with NELA scoring: a retrospective multi-centre cohort study. Br J Surg. 2022;109(Supplement_5):znac247.043.CrossRef Clinch D, Wong M, Imbert E, Haddow L, Simpson K, Damaskos D. SP4. 1.3 Validation of the Emergency Surgery Score (ESS) in the UK patient population and comparison with NELA scoring: a retrospective multi-centre cohort study. Br J Surg. 2022;109(Supplement_5):znac247.043.CrossRef
25.
go back to reference El Hechi M, Kongkaewpaisan N, El Moheb M, Aicher B, Diaz Jr J, OʼMeara L, et al. The emergency surgery score (ESS) and outcomes in elderly patients undergoing emergency laparotomy: a post-hoc analysis of an EAST multicenter study. Am J Surg. 2021;221(5):1069–75. El Hechi M, Kongkaewpaisan N, El Moheb M, Aicher B, Diaz Jr J, OʼMeara L, et al. The emergency surgery score (ESS) and outcomes in elderly patients undergoing emergency laparotomy: a post-hoc analysis of an EAST multicenter study. Am J Surg. 2021;221(5):1069–75.
26.
go back to reference El Hechi M, Kongkaewpaisan N, Naar L, Aicher B, Diaz J Jr, O’Meara L, et al. The Emergency Surgery Score accurately predicts the need for postdischarge respiratory and renal support after emergent laparotomies: a prospective EAST multicenter study. J Trauma Acute Care Surg. 2021;90(3):557–64.CrossRefPubMed El Hechi M, Kongkaewpaisan N, Naar L, Aicher B, Diaz J Jr, O’Meara L, et al. The Emergency Surgery Score accurately predicts the need for postdischarge respiratory and renal support after emergent laparotomies: a prospective EAST multicenter study. J Trauma Acute Care Surg. 2021;90(3):557–64.CrossRefPubMed
27.
go back to reference Gaitanidis A, Breen K, Naar L, Mikdad S, El Moheb M, Kongkaewpaisan N, et al. Performance of the emergency surgery score (ESS) across different emergency general surgery procedures. J Surg Res. 2021;261:152–8.CrossRefPubMed Gaitanidis A, Breen K, Naar L, Mikdad S, El Moheb M, Kongkaewpaisan N, et al. Performance of the emergency surgery score (ESS) across different emergency general surgery procedures. J Surg Res. 2021;261:152–8.CrossRefPubMed
28.
go back to reference Gaitanidis A, Mikdad S, Breen K, Kongkaewpaisan N, Mendoza A, Saillant N, et al. The Emergency Surgery Score (ESS) accurately predicts outcomes in elderly patients undergoing emergency general surgery. Am J Surg. 2020;220(4):1052–7.CrossRefPubMed Gaitanidis A, Mikdad S, Breen K, Kongkaewpaisan N, Mendoza A, Saillant N, et al. The Emergency Surgery Score (ESS) accurately predicts outcomes in elderly patients undergoing emergency general surgery. Am J Surg. 2020;220(4):1052–7.CrossRefPubMed
29.
go back to reference Kaafarani HM, Kongkaewpaisan N, Aicher BO, Diaz JJ Jr, O’Meara LB, Decker C, et al. Prospective validation of the Emergency Surgery Score in emergency general surgery: an Eastern Association for the Surgery of Trauma multicenter study. J Trauma Acute Care Surg. 2020;89(1):118–24.CrossRefPubMed Kaafarani HM, Kongkaewpaisan N, Aicher BO, Diaz JJ Jr, O’Meara LB, Decker C, et al. Prospective validation of the Emergency Surgery Score in emergency general surgery: an Eastern Association for the Surgery of Trauma multicenter study. J Trauma Acute Care Surg. 2020;89(1):118–24.CrossRefPubMed
30.
go back to reference Nandan AR, Bohnen JD, Sangji NF, Kaafarani HMA. The Emergency Surgery Score (ESS) accurately predicts the occurrence of postoperative complications in emergency surgery patients: a reply. J Trauma Acute Care Surg. 2018;85(4):825.CrossRefPubMed Nandan AR, Bohnen JD, Sangji NF, Kaafarani HMA. The Emergency Surgery Score (ESS) accurately predicts the occurrence of postoperative complications in emergency surgery patients: a reply. J Trauma Acute Care Surg. 2018;85(4):825.CrossRefPubMed
31.
go back to reference Nouh T, Alkadi N, Alsuwailem L, Alshanaifi A, Alshunaiber R, Alburakan A. Comparison of different scoring systems in predicting mortality and postoperative complications in acute care surgery patients at a Saudi Academic Centre. Eur J Trauma Emerg Surg. 2023;49:1–7.CrossRef Nouh T, Alkadi N, Alsuwailem L, Alshanaifi A, Alshunaiber R, Alburakan A. Comparison of different scoring systems in predicting mortality and postoperative complications in acute care surgery patients at a Saudi Academic Centre. Eur J Trauma Emerg Surg. 2023;49:1–7.CrossRef
32.
go back to reference Peponis T, Bohnen JD, Sangji NF, Nandan AR, Han K, Lee J, et al. Does the emergency surgery score accurately predict outcomes in emergent laparotomies? Surgery. 2017;162(2):445–52.CrossRefPubMed Peponis T, Bohnen JD, Sangji NF, Nandan AR, Han K, Lee J, et al. Does the emergency surgery score accurately predict outcomes in emergent laparotomies? Surgery. 2017;162(2):445–52.CrossRefPubMed
33.
go back to reference Rozeboom PD, Bronsert MR, Henderson WG, Velopulos CG, Colborn KL, Lambert-Kerzner A, et al. The preoperative risk tool SURPAS accurately predicts outcomes in emergency surgery. Am J Surg. 2021;222(3):643–9.CrossRefPubMed Rozeboom PD, Bronsert MR, Henderson WG, Velopulos CG, Colborn KL, Lambert-Kerzner A, et al. The preoperative risk tool SURPAS accurately predicts outcomes in emergency surgery. Am J Surg. 2021;222(3):643–9.CrossRefPubMed
34.
go back to reference Bohara TP, Dangol E, Mukhia R, Joshi MR, Koirala K, Gelal D, et al. Emergency surgery score predicts morbidity and mortality in emergency general surgery. J KIST Med Coll. 2022;4(8):21–8. Bohara TP, Dangol E, Mukhia R, Joshi MR, Koirala K, Gelal D, et al. Emergency surgery score predicts morbidity and mortality in emergency general surgery. J KIST Med Coll. 2022;4(8):21–8.
35.
go back to reference Copeland G, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78(3):355–60.CrossRefPubMed Copeland G, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78(3):355–60.CrossRefPubMed
36.
go back to reference Sutton R, Bann S, Brooks M, Sarin S. The Surgical Risk Scale as an improved tool for risk-adjusted analysis in comparative surgical audit. Br J Surg. 2002;89(6):763–8.CrossRefPubMed Sutton R, Bann S, Brooks M, Sarin S. The Surgical Risk Scale as an improved tool for risk-adjusted analysis in comparative surgical audit. Br J Surg. 2002;89(6):763–8.CrossRefPubMed
Metadata
Title
Prognostic accuracy of emergency surgery score: a systematic review
Authors
Amirmohammad Toloui
Mohammad Kiah
Amir Ali Zarrin
Yaser Azizi
Mahmoud Yousefifard
Publication date
18-12-2023
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Trauma and Emergency Surgery / Issue 3/2024
Print ISSN: 1863-9933
Electronic ISSN: 1863-9941
DOI
https://doi.org/10.1007/s00068-023-02396-5

Other articles of this Issue 3/2024

European Journal of Trauma and Emergency Surgery 3/2024 Go to the issue