Skip to main content
Top
Published in: Critical Care 2/2005

Open Access 01-04-2005 | Research

Comparison between logistic regression and neural networks to predict death in patients with suspected sepsis in the emergency room

Authors: Fabián Jaimes, Jorge Farbiarz, Diego Alvarez, Carlos Martínez

Published in: Critical Care | Issue 2/2005

Login to get access

Abstract

Introduction

Neural networks are new methodological tools based on nonlinear models. They appear to be better at prediction and classification in biological systems than do traditional strategies such as logistic regression. This paper provides a practical example that contrasts both approaches within the setting of suspected sepsis in the emergency room.

Methods

The study population comprised patients with suspected bacterial infection as their main diagnosis for admission to the emergency room at two University-based hospitals. Mortality within the first 28 days from admission was predicted using logistic regression with the following variables: age, immunosuppressive systemic disease, general systemic disease, Shock Index, temperature, respiratory rate, Glasgow Coma Scale score, leucocyte counts, platelet counts and creatinine. Also, with the same input and output variables, a probabilistic neural network was trained with an adaptive genetic algorithm. The network had three neurone layers: 10 neurones in the input layer, 368 in the hidden layer and two in the output layer. Calibration was measured using the Hosmer-Lemeshow goodness-of-fit test and discrimination was determined using receiver operating characteristic curves.

Results

A total of 533 patients were recruited and overall 28-day mortality was 19%. The factors chosen by logistic regression (with their score in parentheses) were as follows: immunosuppressive systemic disease or general systemic disease (2), respiratory rate 24–33 breaths/min (1), respiratory rate ≥ 34 breaths/min (3), Glasgow Come Scale score ≤12 (3), Shock Index ≥ 1.5 (2) and temperature <38°C (2). The network included all variables and there were no significant differences in predictive ability between the approaches. The areas under the receiver operating characteristic curves were 0.7517 and 0.8782 for the logistic model and the neural network, respectively (P = 0.037).

Conclusion

A predictive model would be an extremely useful tool in the setting of suspected sepsis in the emergency room. It could serve both as a guideline in medical decision-making and as a simple way to select or stratify patients in clinical research. Our proposed model and the specific development method – either logistic regression or neural networks – must be evaluated and validated in an independent population.
Appendix
Available only for authorised users
Literature
1.
go back to reference Martin GS, Mannino DM, Eaton S, Moss M: The epidemiology of sepsis in the United Sates from 1979 through 2000. N Engl J Med 2003, 348: 1546-1554. 10.1056/NEJMoa022139CrossRefPubMed Martin GS, Mannino DM, Eaton S, Moss M: The epidemiology of sepsis in the United Sates from 1979 through 2000. N Engl J Med 2003, 348: 1546-1554. 10.1056/NEJMoa022139CrossRefPubMed
2.
go back to reference Moss M, Martin GS: A global perspective on the epidemiology of sepsis. Intensive Care Med 2004, 30: 527-529. 10.1007/s00134-004-2182-zCrossRefPubMed Moss M, Martin GS: A global perspective on the epidemiology of sepsis. Intensive Care Med 2004, 30: 527-529. 10.1007/s00134-004-2182-zCrossRefPubMed
3.
go back to reference American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference: Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Crit Care Med 1992, 20: 864-874.CrossRef American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference: Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Crit Care Med 1992, 20: 864-874.CrossRef
4.
go back to reference Rangel-Frausto S, Pittet D, Costignan M, Hwang T, Davis CS, Wenzel RP: The natural history of the systemic inflammatory response syndrome. JAMA 1995, 273: 117-123. 10.1001/jama.273.2.117CrossRefPubMed Rangel-Frausto S, Pittet D, Costignan M, Hwang T, Davis CS, Wenzel RP: The natural history of the systemic inflammatory response syndrome. JAMA 1995, 273: 117-123. 10.1001/jama.273.2.117CrossRefPubMed
5.
go back to reference Gabutti L, Burnier M, Mombelli G, Male F, Pellegrini L, Marone C: Usefulness of artificial neural networks to predict follow-up dietary protein intake in hemodialysis patients. Kidney Int 2004, 66: 399-407. 10.1111/j.1523-1755.2004.00744.xCrossRefPubMed Gabutti L, Burnier M, Mombelli G, Male F, Pellegrini L, Marone C: Usefulness of artificial neural networks to predict follow-up dietary protein intake in hemodialysis patients. Kidney Int 2004, 66: 399-407. 10.1111/j.1523-1755.2004.00744.xCrossRefPubMed
6.
go back to reference Maiellaro PA, Cozzolongo R, Marino P: Artificial neural networks for the prediction of response to interferon plus ribavirin treatment in patients with chronic hepatitis C. Curr Pharm Des 2004, 10: 2101-2109.CrossRefPubMed Maiellaro PA, Cozzolongo R, Marino P: Artificial neural networks for the prediction of response to interferon plus ribavirin treatment in patients with chronic hepatitis C. Curr Pharm Des 2004, 10: 2101-2109.CrossRefPubMed
7.
go back to reference Lim WK, Er MJ: Classification of mammographic masses using generalized dynamic fuzzy neural networks. Med Phys 2004, 31: 1288-1295. 10.1118/1.1708643CrossRefPubMed Lim WK, Er MJ: Classification of mammographic masses using generalized dynamic fuzzy neural networks. Med Phys 2004, 31: 1288-1295. 10.1118/1.1708643CrossRefPubMed
8.
go back to reference Loukas C, Brown P: Online prediction of self-paced hand-movements from subthalamic activity using neural networks in Parkinson's disease. J Neurosci Methods 2004, 137: 193-205. 10.1016/j.jneumeth.2004.02.017CrossRefPubMed Loukas C, Brown P: Online prediction of self-paced hand-movements from subthalamic activity using neural networks in Parkinson's disease. J Neurosci Methods 2004, 137: 193-205. 10.1016/j.jneumeth.2004.02.017CrossRefPubMed
9.
go back to reference Jaimes F, Garcés J, Cuervo J, Ramírez F, Ramírez J, Quintero C, Vargas A, Zapata L, Ochoa J, Yepes M, et al.: Prognostic factors in systemic inflammatory response syndrome (SIRS). Development of a severity index [in Spanish]. Acta Medica Colombiana 2001, 26: 149-157. Jaimes F, Garcés J, Cuervo J, Ramírez F, Ramírez J, Quintero C, Vargas A, Zapata L, Ochoa J, Yepes M, et al.: Prognostic factors in systemic inflammatory response syndrome (SIRS). Development of a severity index [in Spanish]. Acta Medica Colombiana 2001, 26: 149-157.
10.
go back to reference Loader C: Local Regression and Likelihood. New York: Springer-Verlag; 1999. Loader C: Local Regression and Likelihood. New York: Springer-Verlag; 1999.
11.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating charasteristic (ROC) curve. Radiology 1982, 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating charasteristic (ROC) curve. Radiology 1982, 143: 29-36.CrossRefPubMed
12.
go back to reference Clermont G, Angus D, DiRusso S, Griffin M, Linde-Zwirble W: Predicting hospital mortality for patients in the intensive care unit: a comparison of artificial neural networks with logistic regression models. Crit Care Med 2001, 29: 291-296. 10.1097/00003246-200102000-00012CrossRefPubMed Clermont G, Angus D, DiRusso S, Griffin M, Linde-Zwirble W: Predicting hospital mortality for patients in the intensive care unit: a comparison of artificial neural networks with logistic regression models. Crit Care Med 2001, 29: 291-296. 10.1097/00003246-200102000-00012CrossRefPubMed
13.
go back to reference Nimgaonkar A, Karnad D, Sudarshan S, Ohno-Machado L, Kohane I: Prediction of mortality in an Indian intensive care unit. Comparison between APACHE II and artificial neural networks. Intensive Care Med 2004, 30: 248-253. 10.1007/s00134-003-2105-4CrossRefPubMed Nimgaonkar A, Karnad D, Sudarshan S, Ohno-Machado L, Kohane I: Prediction of mortality in an Indian intensive care unit. Comparison between APACHE II and artificial neural networks. Intensive Care Med 2004, 30: 248-253. 10.1007/s00134-003-2105-4CrossRefPubMed
14.
go back to reference Diamond G: What price perfection? Calibration and discrimination of clinical prediction models. J Clin Epidemiol 1992, 45: 85-89. 10.1016/0895-4356(92)90192-PCrossRefPubMed Diamond G: What price perfection? Calibration and discrimination of clinical prediction models. J Clin Epidemiol 1992, 45: 85-89. 10.1016/0895-4356(92)90192-PCrossRefPubMed
15.
go back to reference Tu J: Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol 1996, 49: 1225-1231. 10.1016/S0895-4356(96)00002-9CrossRefPubMed Tu J: Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol 1996, 49: 1225-1231. 10.1016/S0895-4356(96)00002-9CrossRefPubMed
16.
go back to reference Concato J, Feinstein AR, Holford TR: The risk of determining risk with multivariable models. Ann Intern Med 1993, 118: 201-210.CrossRefPubMed Concato J, Feinstein AR, Holford TR: The risk of determining risk with multivariable models. Ann Intern Med 1993, 118: 201-210.CrossRefPubMed
17.
go back to reference Justice AC, Covinsky KE, Berlin JA: Assessing the generalizability of prognostic information. Ann Intern Med 1999, 130: 515-524.CrossRefPubMed Justice AC, Covinsky KE, Berlin JA: Assessing the generalizability of prognostic information. Ann Intern Med 1999, 130: 515-524.CrossRefPubMed
Metadata
Title
Comparison between logistic regression and neural networks to predict death in patients with suspected sepsis in the emergency room
Authors
Fabián Jaimes
Jorge Farbiarz
Diego Alvarez
Carlos Martínez
Publication date
01-04-2005
Publisher
BioMed Central
Published in
Critical Care / Issue 2/2005
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc3054

Other articles of this Issue 2/2005

Critical Care 2/2005 Go to the issue