Skip to main content
Top
Published in: Intensive Care Medicine 6/2015

Open Access 01-06-2015 | Original

A clinical prediction model to identify patients at high risk of death in the emergency department

Authors: Michael Coslovsky, Jukka Takala, Aristomenis K. Exadaktylos, Luca Martinolli, Tobias M. Merz

Published in: Intensive Care Medicine | Issue 6/2015

Login to get access

Abstract

Purpose

Rapid assessment and intervention is important for the prognosis of acutely ill patients admitted to the emergency department (ED). The aim of this study was to prospectively develop and validate a model predicting the risk of in-hospital death based on all available information available at the time of ED admission and to compare its discriminative performance with a non-systematic risk estimate by the triaging first health-care provider.

Methods

Prospective cohort analysis based on a multivariable logistic regression for the probability of death.

Results

A total of 8,607 consecutive admissions of 7,680 patients admitted to the ED of a tertiary care hospital were analysed. Most frequent APACHE II diagnostic categories at the time of admission were neurological (2,052, 24 %), trauma (1,522, 18 %), infection categories [1,328, 15 %; including sepsis (357, 4.1 %), severe sepsis (249, 2.9 %), septic shock (27, 0.3 %)], cardiovascular (1,022, 12 %), gastrointestinal (848, 10 %) and respiratory (449, 5 %). The predictors of the final model were age, prolonged capillary refill time, blood pressure, mechanical ventilation, oxygen saturation index, Glasgow coma score and APACHE II diagnostic category. The model showed good discriminative ability, with an area under the receiver operating characteristic curve of 0.92 and good internal validity. The model performed significantly better than non-systematic triaging of the patient.

Conclusions

The use of the prediction model can facilitate the identification of ED patients with higher mortality risk. The model performs better than a non-systematic assessment and may facilitate more rapid identification and commencement of treatment of patients at risk of an unfavourable outcome.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nguyen HB, Banta JE, Cho TW, Van Ginkel C, Burroughs K, Wittlake WA, Corbett SW (2008) Mortality predictions using current physiologic scoring systems in patients meeting criteria for early goal-directed therapy and the severe sepsis resuscitation bundle. Shock 30:23–28PubMedCrossRef Nguyen HB, Banta JE, Cho TW, Van Ginkel C, Burroughs K, Wittlake WA, Corbett SW (2008) Mortality predictions using current physiologic scoring systems in patients meeting criteria for early goal-directed therapy and the severe sepsis resuscitation bundle. Shock 30:23–28PubMedCrossRef
2.
go back to reference Jones AE, Fitch MT, Kline JA (2005) Operational performance of validated physiologic scoring systems for predicting in-hospital mortality among critically ill emergency department patients. Crit Care Med 33:974–978PubMedCrossRef Jones AE, Fitch MT, Kline JA (2005) Operational performance of validated physiologic scoring systems for predicting in-hospital mortality among critically ill emergency department patients. Crit Care Med 33:974–978PubMedCrossRef
3.
go back to reference McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G, Nielsen M, Barrett D, Smith G, Collins CH (1998) Confidential inquiry into quality of care before admission to intensive care. BMJ 316:1853–1858PubMedCentralPubMedCrossRef McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G, Nielsen M, Barrett D, Smith G, Collins CH (1998) Confidential inquiry into quality of care before admission to intensive care. BMJ 316:1853–1858PubMedCentralPubMedCrossRef
4.
go back to reference Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K (2004) A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA study. Resuscitation 62:275–282PubMedCrossRef Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K (2004) A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA study. Resuscitation 62:275–282PubMedCrossRef
5.
go back to reference Buist M, Bernard S, Nguyen TV, Moore G, Anderson J (2004) Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation 62:137–141PubMedCrossRef Buist M, Bernard S, Nguyen TV, Moore G, Anderson J (2004) Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation 62:137–141PubMedCrossRef
6.
go back to reference De Luca G, Suryapranata H, Ottervanger JP, Antman EM (2004) Time delay to treatment and mortality in primary angioplasty for acute myocardial infarction: every minute of delay counts. Circulation 109:1223–1225PubMedCrossRef De Luca G, Suryapranata H, Ottervanger JP, Antman EM (2004) Time delay to treatment and mortality in primary angioplasty for acute myocardial infarction: every minute of delay counts. Circulation 109:1223–1225PubMedCrossRef
7.
go back to reference Duke G, Green J, Briedis J (2004) Survival of critically ill medical patients is time-critical. Crit Care Resusc 6:261–267PubMed Duke G, Green J, Briedis J (2004) Survival of critically ill medical patients is time-critical. Crit Care Resusc 6:261–267PubMed
8.
go back to reference Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G (2003) A prospective before-and-after trial of a medical emergency team. Med J Aust 179:283–287PubMed Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G (2003) A prospective before-and-after trial of a medical emergency team. Med J Aust 179:283–287PubMed
9.
go back to reference Goldhill DR, White SA, Sumner A (1999) Physiological values and procedures in the 24 h before ICU admission from the ward. Anaesthesia 54:529–534PubMedCrossRef Goldhill DR, White SA, Sumner A (1999) Physiological values and procedures in the 24 h before ICU admission from the ward. Anaesthesia 54:529–534PubMedCrossRef
10.
go back to reference Hillman KM, Bristow PJ, Chey T, Daffurn K, Jacques T, Norman SL, Bishop GF, Simmons G (2002) Duration of life-threatening antecedents prior to intensive care admission. Intensive Care Med 28:1629–1634PubMedCrossRef Hillman KM, Bristow PJ, Chey T, Daffurn K, Jacques T, Norman SL, Bishop GF, Simmons G (2002) Duration of life-threatening antecedents prior to intensive care admission. Intensive Care Med 28:1629–1634PubMedCrossRef
11.
go back to reference Derlet RW, Richards JR (2000) Overcrowding in the nation’s emergency departments: complex causes and disturbing effects. Ann Emerg Med 35:63–68PubMedCrossRef Derlet RW, Richards JR (2000) Overcrowding in the nation’s emergency departments: complex causes and disturbing effects. Ann Emerg Med 35:63–68PubMedCrossRef
12.
go back to reference Lynn SG, Kellermann AL (1991) Critical decision making: managing the emergency department in an overcrowded hospital. Ann Emerg Med 20:287–292PubMedCrossRef Lynn SG, Kellermann AL (1991) Critical decision making: managing the emergency department in an overcrowded hospital. Ann Emerg Med 20:287–292PubMedCrossRef
13.
go back to reference Gerdtz MF, Bucknall TK (2001) Triage nurses’ clinical decision making. An observational study of urgency assessment. J Adv Nurs 35:550–561PubMedCrossRef Gerdtz MF, Bucknall TK (2001) Triage nurses’ clinical decision making. An observational study of urgency assessment. J Adv Nurs 35:550–561PubMedCrossRef
14.
go back to reference Brillman JC, Doezema D, Tandberg D, Sklar DP, Davis KD, Simms S, Skipper BJ (1996) Triage: limitations in predicting need for emergent care and hospital admission. Ann Emerg Med 27:493–500PubMedCrossRef Brillman JC, Doezema D, Tandberg D, Sklar DP, Davis KD, Simms S, Skipper BJ (1996) Triage: limitations in predicting need for emergent care and hospital admission. Ann Emerg Med 27:493–500PubMedCrossRef
15.
go back to reference Durand AC, Gentile S, Gerbeaux P, Alazia M, Kiegel P, Luigi S, Lindenmeyer E, Olivier P, Hidoux MA, Sambuc R (2011) Be careful with triage in emergency departments: interobserver agreement on 1,578 patients in France. BMC Emerg Med 11:19PubMedCentralPubMedCrossRef Durand AC, Gentile S, Gerbeaux P, Alazia M, Kiegel P, Luigi S, Lindenmeyer E, Olivier P, Hidoux MA, Sambuc R (2011) Be careful with triage in emergency departments: interobserver agreement on 1,578 patients in France. BMC Emerg Med 11:19PubMedCentralPubMedCrossRef
16.
go back to reference Quitt J, Ryser D, Dieterle T, Luscher U, Martina B, Tschudi P (2009) Does nonmedical hospital admission staff accurately triage emergency department patients? Eur J Emerg Med 16:172–176PubMedCrossRef Quitt J, Ryser D, Dieterle T, Luscher U, Martina B, Tschudi P (2009) Does nonmedical hospital admission staff accurately triage emergency department patients? Eur J Emerg Med 16:172–176PubMedCrossRef
17.
go back to reference Subbe CP, Slater A, Menon D, Gemmell L (2006) Validation of physiological scoring systems in the accident and emergency department. Emerg Med J 23:841–845PubMedCentralPubMedCrossRef Subbe CP, Slater A, Menon D, Gemmell L (2006) Validation of physiological scoring systems in the accident and emergency department. Emerg Med J 23:841–845PubMedCentralPubMedCrossRef
19.
go back to reference Brabrand M, Folkestad L, Clausen NG, Knudsen T, Hallas J (2010) Risk scoring systems for adults admitted to the emergency department: a systematic review. Scand J Trauma Resusc Emerg Med 18:8PubMedCentralPubMedCrossRef Brabrand M, Folkestad L, Clausen NG, Knudsen T, Hallas J (2010) Risk scoring systems for adults admitted to the emergency department: a systematic review. Scand J Trauma Resusc Emerg Med 18:8PubMedCentralPubMedCrossRef
20.
go back to reference Prytherch DR, Smith GB, Schmidt PE, Featherstone PI (2010) ViEWS—towards a national early warning score for detecting adult inpatient deterioration. Resuscitation 81:932–937PubMedCrossRef Prytherch DR, Smith GB, Schmidt PE, Featherstone PI (2010) ViEWS—towards a national early warning score for detecting adult inpatient deterioration. Resuscitation 81:932–937PubMedCrossRef
21.
go back to reference Goodacre S, Wilson R, Shephard N, Nicholl J (2012) Derivation and validation of a risk adjustment model for predicting 7 day mortality in emergency medical admissions: mixed prospective and retrospective cohort study. BMJ 344:e2904PubMedCentralPubMedCrossRef Goodacre S, Wilson R, Shephard N, Nicholl J (2012) Derivation and validation of a risk adjustment model for predicting 7 day mortality in emergency medical admissions: mixed prospective and retrospective cohort study. BMJ 344:e2904PubMedCentralPubMedCrossRef
22.
go back to reference Challen K, Goodacre SW (2011) Predictive scoring in non-trauma emergency patients: a scoping review. Emerg Med J 28:827–837PubMedCrossRef Challen K, Goodacre SW (2011) Predictive scoring in non-trauma emergency patients: a scoping review. Emerg Med J 28:827–837PubMedCrossRef
23.
go back to reference Smith GB, Prytherch DR, Schmidt PE, Featherstone PI (2008) Review and performance evaluation of aggregate weighted ‘track and trigger’ systems. Resuscitation 77:170–179PubMedCrossRef Smith GB, Prytherch DR, Schmidt PE, Featherstone PI (2008) Review and performance evaluation of aggregate weighted ‘track and trigger’ systems. Resuscitation 77:170–179PubMedCrossRef
24.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMedCrossRef Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMedCrossRef
25.
go back to reference Khemani RG, Patel NR, Bart RD 3rd, Newth CJ (2009) Comparison of the pulse oximetric saturation/fraction of inspired oxygen ratio and the PaO2/fraction of inspired oxygen ratio in children. Chest 135:662–668PubMedCrossRef Khemani RG, Patel NR, Bart RD 3rd, Newth CJ (2009) Comparison of the pulse oximetric saturation/fraction of inspired oxygen ratio and the PaO2/fraction of inspired oxygen ratio in children. Chest 135:662–668PubMedCrossRef
26.
go back to reference Dumont CP, Tiep BL (2002) Using a reservoir nasal cannula in acute care. Crit Care Nurse 22:41–46PubMed Dumont CP, Tiep BL (2002) Using a reservoir nasal cannula in acute care. Crit Care Nurse 22:41–46PubMed
27.
go back to reference Burton GG, Hodgkin JE, Ward JJ (1991) Respiratory care: a guide to clinical practice. Lippincott Williams and Wilkins, Philadelphia Burton GG, Hodgkin JE, Ward JJ (1991) Respiratory care: a guide to clinical practice. Lippincott Williams and Wilkins, Philadelphia
28.
go back to reference Nagelkerke NJ (1991) A note on a general definition of the coefficient of determination. Biometrika 78:691–692CrossRef Nagelkerke NJ (1991) A note on a general definition of the coefficient of determination. Biometrika 78:691–692CrossRef
29.
go back to reference Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21:128–138PubMedCentralPubMedCrossRef Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21:128–138PubMedCentralPubMedCrossRef
30.
31.
go back to reference Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, New YorkCrossRef Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, New YorkCrossRef
32.
go back to reference Labarere J, Bertrand R, Fine MJ (2014) How to derive and validate clinical prediction models for use in intensive care medicine. Intensive Care Med 40:513–527PubMedCrossRef Labarere J, Bertrand R, Fine MJ (2014) How to derive and validate clinical prediction models for use in intensive care medicine. Intensive Care Med 40:513–527PubMedCrossRef
33.
go back to reference Olsson T, Terent A, Lind L (2004) Rapid emergency medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J Intern Med 255:579–587PubMedCrossRef Olsson T, Terent A, Lind L (2004) Rapid emergency medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J Intern Med 255:579–587PubMedCrossRef
34.
go back to reference Duckitt RW, Buxton-Thomas R, Walker J, Cheek E, Bewick V, Venn R, Forni LG (2007) Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth 98:769–774PubMedCrossRef Duckitt RW, Buxton-Thomas R, Walker J, Cheek E, Bewick V, Venn R, Forni LG (2007) Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth 98:769–774PubMedCrossRef
35.
go back to reference Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R, Courtney G (2008) Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J 25:803–806PubMedCrossRef Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R, Courtney G (2008) Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J 25:803–806PubMedCrossRef
36.
go back to reference van der Wulp I, Schrijvers AJ, van Stel HF (2009) Predicting admission and mortality with the emergency severity index and the Manchester triage system: a retrospective observational study. Emerg Med J 26:506–509PubMedCrossRef van der Wulp I, Schrijvers AJ, van Stel HF (2009) Predicting admission and mortality with the emergency severity index and the Manchester triage system: a retrospective observational study. Emerg Med J 26:506–509PubMedCrossRef
37.
go back to reference Froom P, Shimoni Z (2006) Prediction of hospital mortality rates by admission laboratory tests. Clin Chem 52:325–328PubMedCrossRef Froom P, Shimoni Z (2006) Prediction of hospital mortality rates by admission laboratory tests. Clin Chem 52:325–328PubMedCrossRef
38.
go back to reference Kellett J, Deane B, Gleeson M (2008) Derivation and validation of a score based on hypotension, oxygen saturation, low temperature, ECG changes and loss of independence (HOTEL) that predicts early mortality between 15 min and 24 h after admission to an acute medical unit. Resuscitation 78:52–58PubMedCrossRef Kellett J, Deane B, Gleeson M (2008) Derivation and validation of a score based on hypotension, oxygen saturation, low temperature, ECG changes and loss of independence (HOTEL) that predicts early mortality between 15 min and 24 h after admission to an acute medical unit. Resuscitation 78:52–58PubMedCrossRef
39.
go back to reference Seymour CW, Kahn JM, Cooke CR, Watkins TR, Heckbert SR, Rea TD (2010) Prediction of critical illness during out-of-hospital emergency care. JAMA 304:747–754PubMedCentralPubMedCrossRef Seymour CW, Kahn JM, Cooke CR, Watkins TR, Heckbert SR, Rea TD (2010) Prediction of critical illness during out-of-hospital emergency care. JAMA 304:747–754PubMedCentralPubMedCrossRef
Metadata
Title
A clinical prediction model to identify patients at high risk of death in the emergency department
Authors
Michael Coslovsky
Jukka Takala
Aristomenis K. Exadaktylos
Luca Martinolli
Tobias M. Merz
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
Intensive Care Medicine / Issue 6/2015
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-015-3737-x

Other articles of this Issue 6/2015

Intensive Care Medicine 6/2015 Go to the issue

What's New in Intensive Care

The ten diseases that look like ARDS