Skip to main content
Top
Published in: European Journal of Trauma and Emergency Surgery 1/2015

Open Access 01-02-2015 | Original Article

Predicting outcomes in patients with perforated gastroduodenal ulcers: artificial neural network modelling indicates a highly complex disease

Authors: K. Søreide, K. Thorsen, J. A. Søreide

Published in: European Journal of Trauma and Emergency Surgery | Issue 1/2015

Login to get access

Abstract

Purpose

Mortality prediction models for patients with perforated peptic ulcer (PPU) have not yielded consistent or highly accurate results. Given the complex nature of this disease, which has many non-linear associations with outcomes, we explored artificial neural networks (ANNs) to predict the complex interactions between the risk factors of PPU and death among patients with this condition.

Methods

ANN modelling using a standard feed-forward, back-propagation neural network with three layers (i.e., an input layer, a hidden layer and an output layer) was used to predict the 30-day mortality of consecutive patients from a population-based cohort undergoing surgery for PPU. A receiver-operating characteristic (ROC) analysis was used to assess model accuracy.

Results

Of the 172 patients, 168 had their data included in the model; the data of 117 (70 %) were used for the training set, and the data of 51 (39 %) were used for the test set. The accuracy, as evaluated by area under the ROC curve (AUC), was best for an inclusive, multifactorial ANN model (AUC 0.90, 95 % CIs 0.85–0.95; p < 0.001). This model outperformed standard predictive scores, including Boey and PULP. The importance of each variable decreased as the number of factors included in the ANN model increased.

Conclusions

The prediction of death was most accurate when using an ANN model with several univariate influences on the outcome. This finding demonstrates that PPU is a highly complex disease for which clinical prognoses are likely difficult. The incorporation of computerised learning systems might enhance clinical judgments to improve decision making and outcome prediction.
Literature
1.
go back to reference Stewart B, Khanduri P, McCord C, Ohene-Yeboah M, Uranues S, Vega Rivera F, Mock C. Global disease burden of conditions requiring emergency surgery. Br J Surg. 2014;101:e9–22.PubMedCrossRef Stewart B, Khanduri P, McCord C, Ohene-Yeboah M, Uranues S, Vega Rivera F, Mock C. Global disease burden of conditions requiring emergency surgery. Br J Surg. 2014;101:e9–22.PubMedCrossRef
2.
go back to reference Lau JY, Barkun A, Fan DM, Kuipers EJ, Yang YS, Chan FK. Challenges in the management of acute peptic ulcer bleeding. Lancet. 2013;381:2033–43.PubMedCrossRef Lau JY, Barkun A, Fan DM, Kuipers EJ, Yang YS, Chan FK. Challenges in the management of acute peptic ulcer bleeding. Lancet. 2013;381:2033–43.PubMedCrossRef
3.
go back to reference Moller MH, Larsson HJ, Rosenstock S, Jorgensen H, Johnsen SP, Madsen AH, Adamsen S, Jensen AG, Zimmermann-Nielsen E, Thomsen RW. Quality-of-care initiative in patients treated surgically for perforated peptic ulcer. Br J Surg. 2013;100:543–52.PubMedCrossRef Moller MH, Larsson HJ, Rosenstock S, Jorgensen H, Johnsen SP, Madsen AH, Adamsen S, Jensen AG, Zimmermann-Nielsen E, Thomsen RW. Quality-of-care initiative in patients treated surgically for perforated peptic ulcer. Br J Surg. 2013;100:543–52.PubMedCrossRef
5.
go back to reference Thorsen K, Glomsaker TB, von Meer A, Søreide K, Søreide JA. Trends in diagnosis and surgical management of patients with perforated peptic ulcer. J Gastrointest Surg. 2011;15:1329–35.PubMedCentralPubMedCrossRef Thorsen K, Glomsaker TB, von Meer A, Søreide K, Søreide JA. Trends in diagnosis and surgical management of patients with perforated peptic ulcer. J Gastrointest Surg. 2011;15:1329–35.PubMedCentralPubMedCrossRef
6.
go back to reference Hemmer PH, de Schipper JS, van Etten B, Pierie JP, Bonenkamp JJ, de Graaf PW, Karsten TM. Results of surgery for perforated gastroduodenal ulcers in a dutch population. Dig Surg. 2011;28:360–6.PubMedCrossRef Hemmer PH, de Schipper JS, van Etten B, Pierie JP, Bonenkamp JJ, de Graaf PW, Karsten TM. Results of surgery for perforated gastroduodenal ulcers in a dutch population. Dig Surg. 2011;28:360–6.PubMedCrossRef
7.
go back to reference Byrge N, Barton RG, Enniss TM, Nirula R. Laparoscopic versus open repair of perforated gastroduodenal ulcer: A national surgical quality improvement program analysis. Am J Surg. 2013;206:957–62 (discussion 962–953).PubMedCrossRef Byrge N, Barton RG, Enniss TM, Nirula R. Laparoscopic versus open repair of perforated gastroduodenal ulcer: A national surgical quality improvement program analysis. Am J Surg. 2013;206:957–62 (discussion 962–953).PubMedCrossRef
8.
go back to reference Møller MH, Adamsen S, Thomsen RW, Møller AM. Preoperative prognostic factors for mortality in peptic ulcer perforation: a systematic review. Scand J Gastroenterol. 2010;45:785–805.PubMedCrossRef Møller MH, Adamsen S, Thomsen RW, Møller AM. Preoperative prognostic factors for mortality in peptic ulcer perforation: a systematic review. Scand J Gastroenterol. 2010;45:785–805.PubMedCrossRef
9.
go back to reference Thorsen K, Søreide JA, Søreide K. Scoring systems for outcome prediction in patients with perforated peptic ulcer. Scand J Trauma Resuscitation Emerg Med. 2013;21:25.CrossRef Thorsen K, Søreide JA, Søreide K. Scoring systems for outcome prediction in patients with perforated peptic ulcer. Scand J Trauma Resuscitation Emerg Med. 2013;21:25.CrossRef
10.
go back to reference Boey J, Choi SK, Poon A, Alagaratnam TT. Risk stratification in perforated duodenal ulcers. A prospective validation of predictive factors. Ann Surg. 1987;205:22–6.PubMedCentralPubMedCrossRef Boey J, Choi SK, Poon A, Alagaratnam TT. Risk stratification in perforated duodenal ulcers. A prospective validation of predictive factors. Ann Surg. 1987;205:22–6.PubMedCentralPubMedCrossRef
11.
go back to reference Thorsen K, Søreide JA, Søreide K. What is the best predictor of mortality in perforated peptic ulcer disease? A population-based, multivariable regression analysis including three clinical scoring systems. J Gastrointest Surg 2014. doi:10.1007/s11605-014-2485-5. Thorsen K, Søreide JA, Søreide K. What is the best predictor of mortality in perforated peptic ulcer disease? A population-based, multivariable regression analysis including three clinical scoring systems. J Gastrointest Surg 2014. doi:10.​1007/​s11605-014-2485-5.
12.
go back to reference Tepas JJ 3rd, Rimar JM, Hsiao AL, Nussbaum. Automated analysis of electronic medical record data reflects the pathophysiology of operative complications. Surgery. 2013;154:918–24 (discussion 924–916).PubMedCrossRef Tepas JJ 3rd, Rimar JM, Hsiao AL, Nussbaum. Automated analysis of electronic medical record data reflects the pathophysiology of operative complications. Surgery. 2013;154:918–24 (discussion 924–916).PubMedCrossRef
13.
go back to reference Stabile M, Cooper L. Review article: the evolving role of information technology in perioperative patient safety. Can J Anaesth. 2013;60:119–26.PubMedCrossRef Stabile M, Cooper L. Review article: the evolving role of information technology in perioperative patient safety. Can J Anaesth. 2013;60:119–26.PubMedCrossRef
14.
go back to reference Fogel SL, Baker CC. Effects of computerized decision support systems on blood glucose regulation in critically ill surgical patients. J Am Coll Surg. 2013;216:828–33 (discussion 833–825).PubMedCrossRef Fogel SL, Baker CC. Effects of computerized decision support systems on blood glucose regulation in critically ill surgical patients. J Am Coll Surg. 2013;216:828–33 (discussion 833–825).PubMedCrossRef
15.
go back to reference Cohen MJ. Use of models in identification and prediction of physiology in critically ill surgical patients. Br J Surg. 2012;99:487–93.PubMedCrossRef Cohen MJ. Use of models in identification and prediction of physiology in critically ill surgical patients. Br J Surg. 2012;99:487–93.PubMedCrossRef
16.
go back to reference Ansari D, Nilsson J, Andersson R, Regner S, Tingstedt B, Andersson B. Artificial neural networks predict survival from pancreatic cancer after radical surgery. Am J Surg. 2013;205:1–7.PubMedCrossRef Ansari D, Nilsson J, Andersson R, Regner S, Tingstedt B, Andersson B. Artificial neural networks predict survival from pancreatic cancer after radical surgery. Am J Surg. 2013;205:1–7.PubMedCrossRef
17.
go back to reference Prabhudesai SG, Gould S, Rekhraj S, Tekkis PP, Glazer G, Ziprin P. Artificial neural networks: Useful aid in diagnosing acute appendicitis. World J Surg. 2008;32:305–9 (discussion 310–301).PubMedCrossRef Prabhudesai SG, Gould S, Rekhraj S, Tekkis PP, Glazer G, Ziprin P. Artificial neural networks: Useful aid in diagnosing acute appendicitis. World J Surg. 2008;32:305–9 (discussion 310–301).PubMedCrossRef
18.
go back to reference Cucchetti A, Vivarelli M, Heaton ND, Phillips S, Piscaglia F, Bolondi L, La Barba G, Foxton MR, Rela M, O’Grady J, Pinna AD. Artificial neural network is superior to meld in predicting mortality of patients with end-stage liver disease. Gut. 2007;56:253–8.PubMedCentralPubMedCrossRef Cucchetti A, Vivarelli M, Heaton ND, Phillips S, Piscaglia F, Bolondi L, La Barba G, Foxton MR, Rela M, O’Grady J, Pinna AD. Artificial neural network is superior to meld in predicting mortality of patients with end-stage liver disease. Gut. 2007;56:253–8.PubMedCentralPubMedCrossRef
19.
go back to reference Selaru FM, Xu Y, Yin J, Zou T, Liu TC, Mori Y, Abraham JM, Sato F, Wang S, Twigg C, Olaru A, Shustova V, Leytin A, Hytiroglou P, Shibata D, Harpaz N, Meltzer SJ. Artificial neural networks distinguish among subtypes of neoplastic colorectal lesions. Gastroenterology. 2002;122:606–13.PubMedCrossRef Selaru FM, Xu Y, Yin J, Zou T, Liu TC, Mori Y, Abraham JM, Sato F, Wang S, Twigg C, Olaru A, Shustova V, Leytin A, Hytiroglou P, Shibata D, Harpaz N, Meltzer SJ. Artificial neural networks distinguish among subtypes of neoplastic colorectal lesions. Gastroenterology. 2002;122:606–13.PubMedCrossRef
20.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S. The strengthening the reporting of observational studies in epidemiology (strobe) statement: guidelines for reporting observational studies. Lancet. 2007;370:1453–7.CrossRef von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S. The strengthening the reporting of observational studies in epidemiology (strobe) statement: guidelines for reporting observational studies. Lancet. 2007;370:1453–7.CrossRef
21.
go back to reference Søreide K, Kørner H, Søreide JA. Diagnostic accuracy and receiver-operating characteristics curve analysis in surgical research and decision making. Ann Surg. 2011;253:27–34.PubMedCrossRef Søreide K, Kørner H, Søreide JA. Diagnostic accuracy and receiver-operating characteristics curve analysis in surgical research and decision making. Ann Surg. 2011;253:27–34.PubMedCrossRef
23.
go back to reference Møller MH, Engebjerg MC, Adamsen S, Bendix J, Thomsen RW. The peptic ulcer perforation (pulp) score: a predictor of mortality following peptic ulcer perforation. A cohort study. Acta Anaesthesiol Scand. 2012;56:655–62.PubMedCrossRef Møller MH, Engebjerg MC, Adamsen S, Bendix J, Thomsen RW. The peptic ulcer perforation (pulp) score: a predictor of mortality following peptic ulcer perforation. A cohort study. Acta Anaesthesiol Scand. 2012;56:655–62.PubMedCrossRef
24.
go back to reference Waljee AK, Higgins PD, Singal AG. A primer on predictive models. Clin Trans Gastroenterol. 2014;5:e44.CrossRef Waljee AK, Higgins PD, Singal AG. A primer on predictive models. Clin Trans Gastroenterol. 2014;5:e44.CrossRef
27.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA J Am Med Assoc. 2005;293:1223–38.CrossRef Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA J Am Med Assoc. 2005;293:1223–38.CrossRef
28.
go back to reference Glomsaker TB, Søreide K. Surgical training and working time restriction. Br J Surg. 2009;96:329–30.PubMedCrossRef Glomsaker TB, Søreide K. Surgical training and working time restriction. Br J Surg. 2009;96:329–30.PubMedCrossRef
29.
go back to reference Manning T, Sleator RD, Walsh P. Biologically inspired intelligent decision making: a commentary on the use of artificial neural networks in bioinformatics. Bioengineered. 2013;5(2):80–95.PubMedCrossRef Manning T, Sleator RD, Walsh P. Biologically inspired intelligent decision making: a commentary on the use of artificial neural networks in bioinformatics. Bioengineered. 2013;5(2):80–95.PubMedCrossRef
30.
go back to reference Cleophas TJ, Cleophas TF. Artificial intelligence for diagnostic purposes: principles, procedures and limitations. Clin Chem Lab Med CCLM/FESCC. 2010;48:159–65. Cleophas TJ, Cleophas TF. Artificial intelligence for diagnostic purposes: principles, procedures and limitations. Clin Chem Lab Med CCLM/FESCC. 2010;48:159–65.
31.
go back to reference Patel JL, Goyal RK. Applications of artificial neural networks in medical science. Curr Clin Pharmacol. 2007;2:217–26.PubMedCrossRef Patel JL, Goyal RK. Applications of artificial neural networks in medical science. Curr Clin Pharmacol. 2007;2:217–26.PubMedCrossRef
32.
go back to reference Grossi E, Mancini A, Buscema M. International experience on the use of artificial neural networks in gastroenterology. Dig Liver Dis. 2007;39:278–85.PubMedCrossRef Grossi E, Mancini A, Buscema M. International experience on the use of artificial neural networks in gastroenterology. Dig Liver Dis. 2007;39:278–85.PubMedCrossRef
33.
go back to reference Shi HY, Lee KT, Wang JJ, Sun DP, Lee HH, Chiu CC. Artificial neural network model for predicting 5-year mortality after surgery for hepatocellular carcinoma: a nationwide study. J Gastrointest Surg. 2012;16:2126–31.PubMedCrossRef Shi HY, Lee KT, Wang JJ, Sun DP, Lee HH, Chiu CC. Artificial neural network model for predicting 5-year mortality after surgery for hepatocellular carcinoma: a nationwide study. J Gastrointest Surg. 2012;16:2126–31.PubMedCrossRef
34.
go back to reference Shi HY, Lee KT, Lee HH, Ho WH, Sun DP, Wang JJ, Chiu CC. Comparison of artificial neural network and logistic regression models for predicting in-hospital mortality after primary liver cancer surgery. PLoS ONE. 2012;7:e35781.PubMedCentralPubMedCrossRef Shi HY, Lee KT, Lee HH, Ho WH, Sun DP, Wang JJ, Chiu CC. Comparison of artificial neural network and logistic regression models for predicting in-hospital mortality after primary liver cancer surgery. PLoS ONE. 2012;7:e35781.PubMedCentralPubMedCrossRef
35.
go back to reference Rotondano G, Cipolletta L, Grossi E, Koch M, Intraligi M, Buscema M, Marmo R. Artificial neural networks accurately predict mortality in patients with nonvariceal upper gi bleeding. Gastrointest Endosc. 2011;73:218–26 (226 e211–212).PubMedCrossRef Rotondano G, Cipolletta L, Grossi E, Koch M, Intraligi M, Buscema M, Marmo R. Artificial neural networks accurately predict mortality in patients with nonvariceal upper gi bleeding. Gastrointest Endosc. 2011;73:218–26 (226 e211–212).PubMedCrossRef
36.
go back to reference Andersson B, Andersson R, Ohlsson M, Nilsson J. Prediction of severe acute pancreatitis at admission to hospital using artificial neural networks. Pancreatology. 2011;11:328–35.PubMedCrossRef Andersson B, Andersson R, Ohlsson M, Nilsson J. Prediction of severe acute pancreatitis at admission to hospital using artificial neural networks. Pancreatology. 2011;11:328–35.PubMedCrossRef
37.
go back to reference Søreide K, Thorsen K, Søreide JA. Strategies to improve the outcome of emergency surgery for perforated peptic ulcer. Br J Surg. 2014;101:e51–64.PubMedCrossRef Søreide K, Thorsen K, Søreide JA. Strategies to improve the outcome of emergency surgery for perforated peptic ulcer. Br J Surg. 2014;101:e51–64.PubMedCrossRef
38.
go back to reference Søreide K, Alderson D, Bergenfelz A, Beynon J, Connor S, Deckelbaum DL, Dejong CH, Earnshaw JJ, Kyamanywa P, Perez RO, Sakai Y, Winter DC. Strategies to improve clinical research in surgery through international collaboration. Lancet. 2013;382:1140–51.PubMedCrossRef Søreide K, Alderson D, Bergenfelz A, Beynon J, Connor S, Deckelbaum DL, Dejong CH, Earnshaw JJ, Kyamanywa P, Perez RO, Sakai Y, Winter DC. Strategies to improve clinical research in surgery through international collaboration. Lancet. 2013;382:1140–51.PubMedCrossRef
Metadata
Title
Predicting outcomes in patients with perforated gastroduodenal ulcers: artificial neural network modelling indicates a highly complex disease
Authors
K. Søreide
K. Thorsen
J. A. Søreide
Publication date
01-02-2015
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Trauma and Emergency Surgery / Issue 1/2015
Print ISSN: 1863-9933
Electronic ISSN: 1863-9941
DOI
https://doi.org/10.1007/s00068-014-0417-4

Other articles of this Issue 1/2015

European Journal of Trauma and Emergency Surgery 1/2015 Go to the issue

ESTES News 1.2015

ESTES News 1.2015