Skip to main content
Top
Published in: Journal of Gastrointestinal Surgery 8/2020

01-08-2020 | Original Article

Use of Machine Learning for Prediction of Patient Risk of Postoperative Complications After Liver, Pancreatic, and Colorectal Surgery

Authors: Katiuscha Merath, J. Madison Hyer, Rittal Mehta, Ayesha Farooq, Fabio Bagante, Kota Sahara, Diamantis I. Tsilimigras, Eliza Beal, Anghela Z. Paredes, Lu Wu, Aslam Ejaz, Timothy M. Pawlik

Published in: Journal of Gastrointestinal Surgery | Issue 8/2020

Login to get access

Abstract

Background

Surgical resection is the only potentially curative treatment for patients with colorectal, liver, and pancreatic cancers. Although these procedures are performed with low mortality, rates of complications remain relatively high following hepatopancreatic and colorectal surgery.

Methods

The American College of Surgeons (ACS) National Surgical Quality Improvement Program was utilized to identify patients undergoing liver, pancreatic and colorectal surgery from 2014 to 2016. Decision tree models were utilized to predict the occurrence of any complication, as well as specific complications. To assess the variability of the performance of the classification trees, bootstrapping was performed on 50% of the sample.

Results

Algorithms were derived from a total of 15,657 patients who met inclusion criteria. The algorithm had a good predictive ability for the occurrence of any complication, with a C-statistic of 0.74, outperforming the ASA (C-statistic 0.58) and ACS-Surgical Risk Calculator (C-statistic 0.71). The algorithm was able to predict with high accuracy thirteen out of the seventeen complications analyzed. The best performance was in the prediction of stroke (C-statistic 0.98), followed by wound dehiscence, cardiac arrest, and progressive renal failure (all C-statistic 0.96). The algorithm had a good predictive ability for superficial SSI (C-statistic 0.76), organ space SSI (C-statistic 0.76), sepsis (C-statistic 0.79), and bleeding requiring transfusion (C-statistic 0.79).

Conclusion

Machine learning was used to develop an algorithm that accurately predicted patient risk of developing complications following liver, pancreatic, or colorectal surgery. The algorithm had very good predictive ability to predict specific complications and demonstrated superiority over other established methods.
Literature
2.
go back to reference Ghaferi AA, Birkmeyer JD, Dimick JB. Complications, failure to rescue, and mortality with major inpatient surgery in medicare patients. Ann Surg. 2009;250(6):1029–34.PubMedCrossRef Ghaferi AA, Birkmeyer JD, Dimick JB. Complications, failure to rescue, and mortality with major inpatient surgery in medicare patients. Ann Surg. 2009;250(6):1029–34.PubMedCrossRef
3.
go back to reference Kohlnhofer BM, Tevis SE, Weber SM, Kennedy GD. Multiple complications and short length of stay are associated with postoperative readmissions. Am J Surg. 2014;207(4):449–56.PubMedPubMedCentralCrossRef Kohlnhofer BM, Tevis SE, Weber SM, Kennedy GD. Multiple complications and short length of stay are associated with postoperative readmissions. Am J Surg. 2014;207(4):449–56.PubMedPubMedCentralCrossRef
4.
go back to reference Mavros MN, de Jong M, Dogeas E, Hyder O, Pawlik TM. Impact of complications on long-term survival after resection of colorectal liver metastases. Br J Surg. 2013;100(5):711–8.PubMedCrossRef Mavros MN, de Jong M, Dogeas E, Hyder O, Pawlik TM. Impact of complications on long-term survival after resection of colorectal liver metastases. Br J Surg. 2013;100(5):711–8.PubMedCrossRef
5.
go back to reference Healy MA, Mullard AJ, Campbell DA, Dimick JB. Hospital and payer costs associated with surgical complications. JAMA Surg. 2016;151(9):823–30.PubMedCrossRef Healy MA, Mullard AJ, Campbell DA, Dimick JB. Hospital and payer costs associated with surgical complications. JAMA Surg. 2016;151(9):823–30.PubMedCrossRef
8.
go back to reference Silber JH, Rosenbaum PR, Trudeau ME, Chen W, Zhang X, Kelz RR, et al. Changes in prognosis after the first postoperative complication. Med Care. 2005;43(2):122–31.PubMedCrossRef Silber JH, Rosenbaum PR, Trudeau ME, Chen W, Zhang X, Kelz RR, et al. Changes in prognosis after the first postoperative complication. Med Care. 2005;43(2):122–31.PubMedCrossRef
9.
go back to reference Spolverato G, Yakoob MY, Kim Y, Alexandrescu S, Marques HP, Lamelas J, et al. Impact of complications on long-term survival after resection of intrahepatic cholangiocarcinoma. Cancer. 2015;121(16):2730–9.PubMedCrossRef Spolverato G, Yakoob MY, Kim Y, Alexandrescu S, Marques HP, Lamelas J, et al. Impact of complications on long-term survival after resection of intrahepatic cholangiocarcinoma. Cancer. 2015;121(16):2730–9.PubMedCrossRef
10.
go back to reference Dorcaratto D, Mazzinari G, Fernandez M, Muñoz E, Garcés-Albir M, Ortega J, et al. Impact of postoperative complications on survival and recurrence after resection of colorectal liver metastases: systematic review and meta-analysis. Ann Surg. 2019; Dorcaratto D, Mazzinari G, Fernandez M, Muñoz E, Garcés-Albir M, Ortega J, et al. Impact of postoperative complications on survival and recurrence after resection of colorectal liver metastases: systematic review and meta-analysis. Ann Surg. 2019;
11.
go back to reference Merath K, Chen Q, Bagante F, Akgul O, Idrees JJ, Dillhoff M, et al. Synergistic effects of perioperative complications on 30-day mortality following hepatopancreatic surgery. Journal of Gastrointestinal Surgery. 2018;22(10):1715–23.PubMedCrossRef Merath K, Chen Q, Bagante F, Akgul O, Idrees JJ, Dillhoff M, et al. Synergistic effects of perioperative complications on 30-day mortality following hepatopancreatic surgery. Journal of Gastrointestinal Surgery. 2018;22(10):1715–23.PubMedCrossRef
12.
go back to reference Ejaz A, Kim Y, Spolverato G, Taylor R, Hundt J, Pawlik TM. Understanding drivers of hospital charge variation for episodes of care among patients undergoing hepatopancreatobiliary surgery. HPB (Oxford). 2015;17(11):955–63.PubMedPubMedCentralCrossRef Ejaz A, Kim Y, Spolverato G, Taylor R, Hundt J, Pawlik TM. Understanding drivers of hospital charge variation for episodes of care among patients undergoing hepatopancreatobiliary surgery. HPB (Oxford). 2015;17(11):955–63.PubMedPubMedCentralCrossRef
14.
go back to reference Pradarelli JC, Healy MA, Osborne NH, Ghaferi AA, Dimick JB, Nathan H. Variation in Medicare expenditures for treating perioperative complications: the cost of rescue. JAMA Surg. 2016;151(12):e163340.PubMedCrossRef Pradarelli JC, Healy MA, Osborne NH, Ghaferi AA, Dimick JB, Nathan H. Variation in Medicare expenditures for treating perioperative complications: the cost of rescue. JAMA Surg. 2016;151(12):e163340.PubMedCrossRef
15.
go back to reference Copeland GP, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78(3):355–60.PubMedCrossRef Copeland GP, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78(3):355–60.PubMedCrossRef
16.
go back to reference Gawande AA, Kwaan MR, Regenbogen SE, Lipsitz SA, Zinner MJ. An Apgar score for surgery. J Am Coll Surg. 2007;204(2):201–8.PubMedCrossRef Gawande AA, Kwaan MR, Regenbogen SE, Lipsitz SA, Zinner MJ. An Apgar score for surgery. J Am Coll Surg. 2007;204(2):201–8.PubMedCrossRef
17.
go back to reference Bilimoria KY, Liu Y, Paruch JL, Zhou L, Kmiecik TE, Ko CY, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013;217(5):833–842.e1-3.PubMedPubMedCentralCrossRef Bilimoria KY, Liu Y, Paruch JL, Zhou L, Kmiecik TE, Ko CY, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013;217(5):833–842.e1-3.PubMedPubMedCentralCrossRef
18.
go back to reference Beal EW, Saunders ND, Kearney JF, Lyon E, Wei L, Squires MH, et al. Accuracy of the ACS NSQIP online risk calculator depends on how you look at it: results from the United States Gastric Cancer Collaborative. Am Surg. 2018;84(3):358–64.PubMed Beal EW, Saunders ND, Kearney JF, Lyon E, Wei L, Squires MH, et al. Accuracy of the ACS NSQIP online risk calculator depends on how you look at it: results from the United States Gastric Cancer Collaborative. Am Surg. 2018;84(3):358–64.PubMed
19.
go back to reference Gleeson EM, Shaikh MF, Shewokis PA, Clarke JR, Meyers WC, Pitt HA, et al. WHipple-ABACUS, a simple, validated risk score for 30-day mortality after pancreaticoduodenectomy developed using the ACS-NSQIP database. Surgery. 11;160(5):1279–87. Gleeson EM, Shaikh MF, Shewokis PA, Clarke JR, Meyers WC, Pitt HA, et al. WHipple-ABACUS, a simple, validated risk score for 30-day mortality after pancreaticoduodenectomy developed using the ACS-NSQIP database. Surgery. 11;160(5):1279–87.
20.
go back to reference Beal EW, Lyon E, Kearney J, Wei L, Ethun CG, Black SM, et al. Evaluating the American College of Surgeons National Surgical Quality Improvement project risk calculator: results from the U.S. Extrahepatic Biliary Malignancy Consortium. HPB (Oxford). 2017;19(12):1104–11.PubMedPubMedCentralCrossRef Beal EW, Lyon E, Kearney J, Wei L, Ethun CG, Black SM, et al. Evaluating the American College of Surgeons National Surgical Quality Improvement project risk calculator: results from the U.S. Extrahepatic Biliary Malignancy Consortium. HPB (Oxford). 2017;19(12):1104–11.PubMedPubMedCentralCrossRef
21.
go back to reference Bertsimas D, Dunn J, Velmahos GC, Kaafarani HMA. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based Predictive OpTimal Trees in Emergency Surgery Risk (POTTER) Calculator. Annals of Surgery. 2018;268(4):574–83.PubMedCrossRef Bertsimas D, Dunn J, Velmahos GC, Kaafarani HMA. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based Predictive OpTimal Trees in Emergency Surgery Risk (POTTER) Calculator. Annals of Surgery. 2018;268(4):574–83.PubMedCrossRef
22.
go back to reference Carlos RC, Kahn CE, Halabi S. Data science: big data, machine learning, and artificial intelligence. J Am Coll Radiol. 2018;15(3 Pt B):497–8.PubMedCrossRef Carlos RC, Kahn CE, Halabi S. Data science: big data, machine learning, and artificial intelligence. J Am Coll Radiol. 2018;15(3 Pt B):497–8.PubMedCrossRef
23.
go back to reference Linden A, Yarnold PR. Modeling time-to-event (survival) data using classification tree analysis. J Eval Clin Pract. 2017;23(6):1299–308.PubMedCrossRef Linden A, Yarnold PR. Modeling time-to-event (survival) data using classification tree analysis. J Eval Clin Pract. 2017;23(6):1299–308.PubMedCrossRef
24.
go back to reference Hu Y-J, Ku T-H, Jan R-H, Wang K, Tseng Y-C, Yang S-F. Decision tree-based learning to predict patient controlled analgesia consumption and readjustment. BMC Med Inform Decis Mak. 2012;12:131.PubMedPubMedCentralCrossRef Hu Y-J, Ku T-H, Jan R-H, Wang K, Tseng Y-C, Yang S-F. Decision tree-based learning to predict patient controlled analgesia consumption and readjustment. BMC Med Inform Decis Mak. 2012;12:131.PubMedPubMedCentralCrossRef
25.
go back to reference Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, et al. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998;228(4):491–507.PubMed Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, et al. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998;228(4):491–507.PubMed
26.
go back to reference Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg. 2009;250(3):363–76.PubMed Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg. 2009;250(3):363–76.PubMed
27.
go back to reference Fink AS, Campbell DA, Mentzer RM, Henderson WG, Daley J, Bannister J, et al. The National Surgical Quality Improvement Program in non-veterans administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53; discussion 353–354. Fink AS, Campbell DA, Mentzer RM, Henderson WG, Daley J, Bannister J, et al. The National Surgical Quality Improvement Program in non-veterans administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53; discussion 353–354.
28.
go back to reference Hastie T, Tibshirani R, Friedman JH. The elements of statistical learning: data mining, inference, and prediction. 2nd ed. New York, NY: Springer; 2009. 745 p. (Springer series in statistics).CrossRef Hastie T, Tibshirani R, Friedman JH. The elements of statistical learning: data mining, inference, and prediction. 2nd ed. New York, NY: Springer; 2009. 745 p. (Springer series in statistics).CrossRef
29.
go back to reference Pencina MJ, D’Agostino RB. Evaluating discrimination of risk prediction models: the C statistic. JAMA. 2015;314(10):1063–4.PubMedCrossRef Pencina MJ, D’Agostino RB. Evaluating discrimination of risk prediction models: the C statistic. JAMA. 2015;314(10):1063–4.PubMedCrossRef
30.
go back to reference Merath K, Bagante F, Beal EW, Lopez-Aguiar AG, Poultsides G, Makris E, et al. Nomogram predicting the risk of recurrence after curative-intent resection of primary non-metastatic gastrointestinal neuroendocrine tumors: an analysis of the U.S. Neuroendocrine Tumor Study Group. J Surg Oncol [Internet]. 2018; Available from: https://www.ncbi.nlm.nih.gov/pubmed/29448303 Merath K, Bagante F, Beal EW, Lopez-Aguiar AG, Poultsides G, Makris E, et al. Nomogram predicting the risk of recurrence after curative-intent resection of primary non-metastatic gastrointestinal neuroendocrine tumors: an analysis of the U.S. Neuroendocrine Tumor Study Group. J Surg Oncol [Internet]. 2018; Available from: https://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​29448303
31.
go back to reference Efron B, Tibshirani R. An introduction to the bootstrap. New York: Chapman & Hall; 1993. 436 p. (Monographs on statistics and applied probability).CrossRef Efron B, Tibshirani R. An introduction to the bootstrap. New York: Chapman & Hall; 1993. 436 p. (Monographs on statistics and applied probability).CrossRef
33.
go back to reference Zhao B, Waterman RS, Urman RD, Gabriel RA. A machine learning approach to predicting case duration for robot-assisted surgery. J Med Syst. 2019;43(2):32.PubMedCrossRef Zhao B, Waterman RS, Urman RD, Gabriel RA. A machine learning approach to predicting case duration for robot-assisted surgery. J Med Syst. 2019;43(2):32.PubMedCrossRef
34.
go back to reference Harvin JA, Green CE, Pedroza C, Tyson JE, Moore LJ, Wade CE, et al. Using machine learning to identify change in surgical decision making in current use of damage control laparotomy. J Am Coll Surg. 2019;228(3):255–64.PubMedPubMedCentralCrossRef Harvin JA, Green CE, Pedroza C, Tyson JE, Moore LJ, Wade CE, et al. Using machine learning to identify change in surgical decision making in current use of damage control laparotomy. J Am Coll Surg. 2019;228(3):255–64.PubMedPubMedCentralCrossRef
35.
go back to reference Canchi T, Kumar SD, Ng EYK, Narayanan S. A review of computational methods to predict the risk of rupture of abdominal aortic aneurysms. Biomed Res Int. 2015;2015:861627. Canchi T, Kumar SD, Ng EYK, Narayanan S. A review of computational methods to predict the risk of rupture of abdominal aortic aneurysms. Biomed Res Int. 2015;2015:861627.
36.
go back to reference Yeong E-K, Hsiao T-C, Chiang HK, Lin C-W. Prediction of burn healing time using artificial neural networks and reflectance spectrometer. Burns. 2005;31(4):415–20.PubMedCrossRef Yeong E-K, Hsiao T-C, Chiang HK, Lin C-W. Prediction of burn healing time using artificial neural networks and reflectance spectrometer. Burns. 2005;31(4):415–20.PubMedCrossRef
37.
38.
go back to reference James G, Witten D, Hastie T, Tibshirani R, editors. An introduction to statistical learning: with applications in R. New York: Springer; 2013. 426 p. (Springer texts in statistics). James G, Witten D, Hastie T, Tibshirani R, editors. An introduction to statistical learning: with applications in R. New York: Springer; 2013. 426 p. (Springer texts in statistics).
39.
go back to reference Parikh SA, Gomez R, Thirugnanasambandam M, Chauhan SS, De Oliveira V, Muluk SC, et al. Decision tree-based classification of abdominal aortic aneurysms using geometry quantification measures. Ann Biomed Eng. 2018;46(12):2135–47.PubMedPubMedCentralCrossRef Parikh SA, Gomez R, Thirugnanasambandam M, Chauhan SS, De Oliveira V, Muluk SC, et al. Decision tree-based classification of abdominal aortic aneurysms using geometry quantification measures. Ann Biomed Eng. 2018;46(12):2135–47.PubMedPubMedCentralCrossRef
40.
go back to reference Wynter-Blyth V, Moorthy K. Prehabilitation: preparing patients for surgery. BMJ. 8;358:j3702. Wynter-Blyth V, Moorthy K. Prehabilitation: preparing patients for surgery. BMJ. 8;358:j3702.
41.
go back to reference Minnella EM, Liberman AS, Charlebois P, Stein B, Scheede-Bergdahl C, Awasthi R, et al. The impact of improved functional capacity before surgery on postoperative complications: a study in colorectal cancer. Acta Oncol. 2019;1–6. Minnella EM, Liberman AS, Charlebois P, Stein B, Scheede-Bergdahl C, Awasthi R, et al. The impact of improved functional capacity before surgery on postoperative complications: a study in colorectal cancer. Acta Oncol. 2019;1–6.
Metadata
Title
Use of Machine Learning for Prediction of Patient Risk of Postoperative Complications After Liver, Pancreatic, and Colorectal Surgery
Authors
Katiuscha Merath
J. Madison Hyer
Rittal Mehta
Ayesha Farooq
Fabio Bagante
Kota Sahara
Diamantis I. Tsilimigras
Eliza Beal
Anghela Z. Paredes
Lu Wu
Aslam Ejaz
Timothy M. Pawlik
Publication date
01-08-2020
Publisher
Springer US
Published in
Journal of Gastrointestinal Surgery / Issue 8/2020
Print ISSN: 1091-255X
Electronic ISSN: 1873-4626
DOI
https://doi.org/10.1007/s11605-019-04338-2

Other articles of this Issue 8/2020

Journal of Gastrointestinal Surgery 8/2020 Go to the issue