Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2010

Open Access 01-12-2010 | Review

Risk scoring systems for adults admitted to the emergency department: a systematic review

Authors: Mikkel Brabrand, Lars Folkestad, Nicola Groes Clausen, Torben Knudsen, Jesper Hallas

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2010

Login to get access

Abstract

Background

Patients referred to a medical admission unit (MAU) represent a broad spectrum of disease severity. In the interest of allocating resources to those who might potentially benefit most from clinical interventions, several scoring systems have been proposed as a triaging tool.
Even though most scoring systems are not meant to be used on an individual level, they can support the more inexperienced doctors and nurses in assessing the risk of deterioration of their patients.
We therefore performed a systematic review on the level of evidence of literature on scoring systems developed or validated in the MAU. We hypothesized that existing scoring systems would have a low level of evidence and only few systems would have been externally validated.

Methods

We conducted a systematic search using Medline, EMBASE and the Cochrane Library, according to the PRISMA guidelines, on scoring systems developed to assess medical patients at admission.
The primary endpoints were in-hospital mortality or transfer to the intensive care unit. Studies derived for only a single or few diagnoses were excluded.
The ability to identify patients at risk (discriminatory power) and agreement between observed and predicted outcome (calibration) along with the method of derivation and validation (application on a new cohort) were extracted.

Results

We identified 1,655 articles. Thirty were selected for further review and 10 were included in this review.
Eight systems used vital signs as variables and two relied mostly on blood tests.
Nine systems were derived using regression analysis and eight included patients admitted to a MAU. Six systems used in-hospital mortality as their primary endpoint.
Discriminatory power was specified for eight of the scoring systems and was acceptable or better in five of these. The calibration was only specified for four scoring systems. In none of the studies impact analysis or inter-observer reliability were analyzed.
None of the systems reached the highest level of evidence.

Conclusions

None of the 10 scoring systems presented in this article are perfect and all have their weaknesses. More research is needed before the use of scoring systems can be fully implemented to the risk assessment of acutely admitted medical patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference McClish DK, Powell SH: How well can physicians estimate mortality in a medical intensive care unit?. Med Decis Making. 1989, 9: 125-132. 10.1177/0272989X8900900207.CrossRefPubMed McClish DK, Powell SH: How well can physicians estimate mortality in a medical intensive care unit?. Med Decis Making. 1989, 9: 125-132. 10.1177/0272989X8900900207.CrossRefPubMed
2.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed
3.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed
4.
go back to reference Vincent JL, Moreno R, Takala J, Willatts S, de MA, Bruining H: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996, 22: 707-710. 10.1007/BF01709751.CrossRefPubMed Vincent JL, Moreno R, Takala J, Willatts S, de MA, Bruining H: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996, 22: 707-710. 10.1007/BF01709751.CrossRefPubMed
6.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed
7.
go back to reference Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, New York: Wiley, full_text. 2CrossRef Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, New York: Wiley, full_text. 2CrossRef
8.
go back to reference McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRefPubMed McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRefPubMed
9.
go back to reference Subbe CP, Kruger M, Rutherford P, Gemmel L: Validation of a modified Early Warning Score in medical admissions. QJM. 2001, 94: 521-526. 10.1093/qjmed/94.10.521.CrossRefPubMed Subbe CP, Kruger M, Rutherford P, Gemmel L: Validation of a modified Early Warning Score in medical admissions. QJM. 2001, 94: 521-526. 10.1093/qjmed/94.10.521.CrossRefPubMed
10.
go back to reference Subbe CP, Davies RG, Williams E, Rutherford P, Gemmell L: Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia. 2003, 58: 797-802. 10.1046/j.1365-2044.2003.03258.x.CrossRefPubMed Subbe CP, Davies RG, Williams E, Rutherford P, Gemmell L: Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia. 2003, 58: 797-802. 10.1046/j.1365-2044.2003.03258.x.CrossRefPubMed
11.
go back to reference Paterson R, MacLeod DC, Thetford D, Beattie A, Graham C, Lam S: Prediction of in-hospital mortality and length of stay using an early warning scoring system: clinical audit. Clin Med. 2006, 6: 281-284.CrossRefPubMed Paterson R, MacLeod DC, Thetford D, Beattie A, Graham C, Lam S: Prediction of in-hospital mortality and length of stay using an early warning scoring system: clinical audit. Clin Med. 2006, 6: 281-284.CrossRefPubMed
12.
go back to reference Froom P, Shimoni Z: Prediction of hospital mortality rates by admission laboratory tests. Clin Chem. 2006, 52: 325-328. 10.1373/clinchem.2005.059030.CrossRefPubMed Froom P, Shimoni Z: Prediction of hospital mortality rates by admission laboratory tests. Clin Chem. 2006, 52: 325-328. 10.1373/clinchem.2005.059030.CrossRefPubMed
13.
go back to reference Prytherch DR, Sirl JS, Schmidt P, Featherstone PI, Weaver PC, Smith GB: The use of routine laboratory data to predict in-hospital death in medical admissions. Resuscitation. 2005, 66: 203-207. 10.1016/j.resuscitation.2005.02.011.CrossRefPubMed Prytherch DR, Sirl JS, Schmidt P, Featherstone PI, Weaver PC, Smith GB: The use of routine laboratory data to predict in-hospital death in medical admissions. Resuscitation. 2005, 66: 203-207. 10.1016/j.resuscitation.2005.02.011.CrossRefPubMed
14.
go back to reference Kellett J, Deane B: The Simple Clinical Score predicts mortality for 30 days after admission to an acute medical unit. QJM. 2006, 99: 771-781. 10.1093/qjmed/hcl112.CrossRefPubMed Kellett J, Deane B: The Simple Clinical Score predicts mortality for 30 days after admission to an acute medical unit. QJM. 2006, 99: 771-781. 10.1093/qjmed/hcl112.CrossRefPubMed
15.
go back to reference Kellett J, Deane B, Gleeson M: Derivation and validation of a score based on Hypotension, Oxygen saturation, low Temperature, ECG changes and Loss of independence (HOTEL) that predicts early mortality between 15 min and 24 h after admission to an acute medical unit. Resuscitation. 2008 Kellett J, Deane B, Gleeson M: Derivation and validation of a score based on Hypotension, Oxygen saturation, low Temperature, ECG changes and Loss of independence (HOTEL) that predicts early mortality between 15 min and 24 h after admission to an acute medical unit. Resuscitation. 2008
16.
go back to reference Smith GB, Prytherch DR, Schmidt PE, Featherstone PI: Review and performance evaluation of aggregate weighted 'track and trigger' systems. Resuscitation. 2008, 77: 170-179. 10.1016/j.resuscitation.2007.12.004.CrossRefPubMed Smith GB, Prytherch DR, Schmidt PE, Featherstone PI: Review and performance evaluation of aggregate weighted 'track and trigger' systems. Resuscitation. 2008, 77: 170-179. 10.1016/j.resuscitation.2007.12.004.CrossRefPubMed
17.
go back to reference Rhee KJ, Fisher CJ, Willitis NH: The Rapid Acute Physiology Score. Am J Emerg Med. 1987, 5: 278-282. 10.1016/0735-6757(87)90350-0.CrossRefPubMed Rhee KJ, Fisher CJ, Willitis NH: The Rapid Acute Physiology Score. Am J Emerg Med. 1987, 5: 278-282. 10.1016/0735-6757(87)90350-0.CrossRefPubMed
18.
19.
go back to reference Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R: Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J. 2008, 25: 803-806. 10.1136/emj.2007.051425.CrossRefPubMed Groarke JD, Gallagher J, Stack J, Aftab A, Dwyer C, McGovern R: Use of an admission early warning score to predict patient morbidity and mortality and treatment success. Emerg Med J. 2008, 25: 803-806. 10.1136/emj.2007.051425.CrossRefPubMed
20.
go back to reference Duckitt RW, Buxton-Thomas R, Walker J, Cheek E, Bewick V, Venn R: Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth. 2007, 98: 769-774. 10.1093/bja/aem097.CrossRefPubMed Duckitt RW, Buxton-Thomas R, Walker J, Cheek E, Bewick V, Venn R: Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study. Br J Anaesth. 2007, 98: 769-774. 10.1093/bja/aem097.CrossRefPubMed
21.
go back to reference Olsson T, Terent A, Lind L: Rapid Emergency Medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J Intern Med. 2004, 255: 579-587. 10.1111/j.1365-2796.2004.01321.x.CrossRefPubMed Olsson T, Terent A, Lind L: Rapid Emergency Medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J Intern Med. 2004, 255: 579-587. 10.1111/j.1365-2796.2004.01321.x.CrossRefPubMed
22.
go back to reference A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT Principal Investigators. JAMA. 1995, 274: 1591-1598. 10.1001/jama.274.20.1591. A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT Principal Investigators. JAMA. 1995, 274: 1591-1598. 10.1001/jama.274.20.1591.
23.
go back to reference Knaus WA, Harrell FE, Lynn J, Goldman L, Phillips RS, Connors AF: The SUPPORT prognostic model. Objective estimates of survival for seriously ill hospitalized adults. Study to understand prognoses and preferences for outcomes and risks of treatments. Ann Intern Med. 1995, 122: 191-203.CrossRefPubMed Knaus WA, Harrell FE, Lynn J, Goldman L, Phillips RS, Connors AF: The SUPPORT prognostic model. Objective estimates of survival for seriously ill hospitalized adults. Study to understand prognoses and preferences for outcomes and risks of treatments. Ann Intern Med. 1995, 122: 191-203.CrossRefPubMed
24.
go back to reference Brannen AL, Godfrey LJ, Goetter WE: Prediction of outcome from critical illness. A comparison of clinical judgment with a prediction rule. Arch Intern Med. 1989, 149: 1083-1086. 10.1001/archinte.149.5.1083.CrossRefPubMed Brannen AL, Godfrey LJ, Goetter WE: Prediction of outcome from critical illness. A comparison of clinical judgment with a prediction rule. Arch Intern Med. 1989, 149: 1083-1086. 10.1001/archinte.149.5.1083.CrossRefPubMed
25.
go back to reference Sinuff T, Adhikari NK, Cook DJ, Schunemann HJ, Griffith LE, Rocker G: Mortality predictions in the intensive care unit: comparing physicians with scoring systems. Crit Care Med. 2006, 34: 878-885. 10.1097/01.CCM.0000201881.58644.41.CrossRefPubMed Sinuff T, Adhikari NK, Cook DJ, Schunemann HJ, Griffith LE, Rocker G: Mortality predictions in the intensive care unit: comparing physicians with scoring systems. Crit Care Med. 2006, 34: 878-885. 10.1097/01.CCM.0000201881.58644.41.CrossRefPubMed
26.
go back to reference Rocker G, Cook D, Sjokvist P, Weaver B, Finfer S, McDonald E: Clinician predictions of intensive care unit mortality. Crit Care Med. 2004, 32: 1149-1154. 10.1097/01.CCM.0000126402.51524.52.CrossRefPubMed Rocker G, Cook D, Sjokvist P, Weaver B, Finfer S, McDonald E: Clinician predictions of intensive care unit mortality. Crit Care Med. 2004, 32: 1149-1154. 10.1097/01.CCM.0000126402.51524.52.CrossRefPubMed
Metadata
Title
Risk scoring systems for adults admitted to the emergency department: a systematic review
Authors
Mikkel Brabrand
Lars Folkestad
Nicola Groes Clausen
Torben Knudsen
Jesper Hallas
Publication date
01-12-2010
Publisher
BioMed Central
DOI
https://doi.org/10.1186/1757-7241-18-8

Other articles of this Issue 1/2010

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2010 Go to the issue