Skip to main content
Top
Published in: Critical Care 1/2019

Open Access 01-12-2019 | Septicemia | Research

Prognostic accuracy of the Hamilton Early Warning Score (HEWS) and the National Early Warning Score 2 (NEWS2) among hospitalized patients assessed by a rapid response team

Authors: Shannon M. Fernando, Alison E. Fox-Robichaud, Bram Rochwerg, Pierre Cardinal, Andrew J. E. Seely, Jeffrey J. Perry, Daniel I. McIsaac, Alexandre Tran, Steven Skitch, Benjamin Tam, Michael Hickey, Peter M. Reardon, Peter Tanuseputro, Kwadwo Kyeremanteng

Published in: Critical Care | Issue 1/2019

Login to get access

Abstract

Background

Rapid response teams (RRTs) respond to hospitalized patients experiencing clinical deterioration and help determine subsequent management and disposition. We sought to evaluate and compare the prognostic accuracy of the Hamilton Early Warning Score (HEWS) and the National Early Warning Score 2 (NEWS2) for prediction of in-hospital mortality following RRT activation. We secondarily evaluated a subgroup of patients with suspected infection.

Methods

We retrospectively analyzed prospectively collected data (2012–2016) of consecutive RRT patients from two hospitals. The primary outcome was in-hospital mortality. We calculated the number needed to examine (NNE), which indicates the number of patients that need to be evaluated in order to detect one future death.

Results

Five thousand four hundred ninety-one patients were included, of whom 1837 (33.5%) died in-hospital. Mean age was 67.4 years, and 51.6% were male. A HEWS above the low-risk threshold (≥ 5) had a sensitivity of 75.9% (95% confidence interval (CI) 73.9–77.9) and specificity of 67.6% (95% CI 66.1–69.1) for mortality, with a NNE of 1.84. A NEWS2 above the low-risk threshold (≥ 5) had a sensitivity of 84.5% (95% CI 82.8–86.2), and specificity of 49.0% (95% CI: 47.4–50.7), with a NNE of 2.20. The area under the receiver operating characteristic curve (AUROC) was 0.76 (95% CI 0.75–0.77) for HEWS and 0.72 (95% CI: 0.71–0.74) for NEWS2. Among suspected infection patients (n = 1708), AUROC for HEWS was 0.79 (95% CI 0.76–0.81) and for NEWS2, 0.75 (95% CI 0.73–0.78).

Conclusions

The HEWS has comparable clinical accuracy to NEWS2 for prediction of in-hospital mortality among RRT patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jones D, Mitchell I, Hillman K, et al. Defining clinical deterioration. Resuscitation. 2013;84:1029–34.CrossRef Jones D, Mitchell I, Hillman K, et al. Defining clinical deterioration. Resuscitation. 2013;84:1029–34.CrossRef
2.
go back to reference Lyons PG, Edelson DP, Churpek MM. Rapid response systems. Resuscitation. 2018;128:191–7.CrossRef Lyons PG, Edelson DP, Churpek MM. Rapid response systems. Resuscitation. 2018;128:191–7.CrossRef
3.
go back to reference Winters BD, Weaver SJ, Pfoh ER, et al. Rapid-response systems as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158:417–25.CrossRef Winters BD, Weaver SJ, Pfoh ER, et al. Rapid-response systems as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158:417–25.CrossRef
4.
go back to reference Maharaj R, Raffaele I, Wendon J. Rapid response systems: a systematic review and meta-analysis. Crit Care. 2015;19:254.CrossRef Maharaj R, Raffaele I, Wendon J. Rapid response systems: a systematic review and meta-analysis. Crit Care. 2015;19:254.CrossRef
5.
go back to reference Jaderling G, Bell M, Martling CR, et al. ICU admittance by a rapid response team versus conventional admittance, characteristics, and outcome. Crit Care Med. 2013;41:725–31.CrossRef Jaderling G, Bell M, Martling CR, et al. ICU admittance by a rapid response team versus conventional admittance, characteristics, and outcome. Crit Care Med. 2013;41:725–31.CrossRef
6.
go back to reference De Jong A, Jung B, Daurat A, et al. Effect of rapid response systems on hospital mortality: a systematic review and meta-analysis. Intensive Care Med. 2016;42:615–7.CrossRef De Jong A, Jung B, Daurat A, et al. Effect of rapid response systems on hospital mortality: a systematic review and meta-analysis. Intensive Care Med. 2016;42:615–7.CrossRef
7.
go back to reference Jones D, Moran J, Winters B, et al. The rapid response system and end-of-life care. Curr Opin Crit Care. 2013;19:616–23.CrossRef Jones D, Moran J, Winters B, et al. The rapid response system and end-of-life care. Curr Opin Crit Care. 2013;19:616–23.CrossRef
8.
go back to reference Smith GB, Prytherch DR, Meredith P, et al. Early warning scores: unravelling detection and escalation. Int J Health Care Qual Assur. 2015;28:872–5.CrossRef Smith GB, Prytherch DR, Meredith P, et al. Early warning scores: unravelling detection and escalation. Int J Health Care Qual Assur. 2015;28:872–5.CrossRef
9.
go back to reference McNeill G, Bryden D. Do either early warning systems or emergency response teams improve hospital patient survival? A systematic review. Resuscitation. 2013;84:1652–67.CrossRef McNeill G, Bryden D. Do either early warning systems or emergency response teams improve hospital patient survival? A systematic review. Resuscitation. 2013;84:1652–67.CrossRef
10.
go back to reference Smith ME, Chiovaro JC, O'Neil M, et al. Early warning system scores for clinical deterioration in hospitalized patients: a systematic review. Ann Am Thorac Soc. 2014;11:1454–65.CrossRef Smith ME, Chiovaro JC, O'Neil M, et al. Early warning system scores for clinical deterioration in hospitalized patients: a systematic review. Ann Am Thorac Soc. 2014;11:1454–65.CrossRef
11.
go back to reference Smith GB, Prytherch DR, Meredith P, et al. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84:465–70.CrossRef Smith GB, Prytherch DR, Meredith P, et al. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84:465–70.CrossRef
12.
go back to reference Royal College of Physicians. National Early Warning Score (NEWS) 2: Standardizing the assessment of acute-illness severity in the NHS. Updated report of a working party. London: RCP; 2017. Royal College of Physicians. National Early Warning Score (NEWS) 2: Standardizing the assessment of acute-illness severity in the NHS. Updated report of a working party. London: RCP; 2017.
13.
go back to reference Skitch S, Tam B, Xu M, et al. Examining the utility of the Hamilton early warning scores (HEWS) at triage: retrospective pilot study in a Canadian emergency department. CJEM. 2018;20:266–74.CrossRef Skitch S, Tam B, Xu M, et al. Examining the utility of the Hamilton early warning scores (HEWS) at triage: retrospective pilot study in a Canadian emergency department. CJEM. 2018;20:266–74.CrossRef
14.
go back to reference Tam B, Xu M, Kwong M, et al. The admission Hamilton Early Warning Score (HEWS) predicts the risk of critical event during hospitalization. CJGIM. 2016;11:24–7. Tam B, Xu M, Kwong M, et al. The admission Hamilton Early Warning Score (HEWS) predicts the risk of critical event during hospitalization. CJGIM. 2016;11:24–7.
15.
go back to reference Bhattacharjee P, Edelson DP, Churpek MM. Identifying patients with sepsis on the hospital wards. Chest. 2017;151:898–907.CrossRef Bhattacharjee P, Edelson DP, Churpek MM. Identifying patients with sepsis on the hospital wards. Chest. 2017;151:898–907.CrossRef
16.
go back to reference Bone RC, Balk RA, Cerra FB, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101:1644–55.CrossRef Bone RC, Balk RA, Cerra FB, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101:1644–55.CrossRef
17.
go back to reference Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:801–10.CrossRef Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:801–10.CrossRef
18.
go back to reference Seymour CW, Liu VX, Iwashyna TJ, et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:762–74.CrossRef Seymour CW, Liu VX, Iwashyna TJ, et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:762–74.CrossRef
19.
go back to reference Fernando SM, Reardon PM, Rochwerg B, et al. Sepsis-3 septic shock criteria and associated mortality among infected hospitalized patients assessed by a rapid response team. Chest. 2018;154:309–16.CrossRef Fernando SM, Reardon PM, Rochwerg B, et al. Sepsis-3 septic shock criteria and associated mortality among infected hospitalized patients assessed by a rapid response team. Chest. 2018;154:309–16.CrossRef
20.
go back to reference Fernando SM, Reardon PM, Dowlatshahi D, et al. Outcomes and costs of patients admitted to the ICU due to spontaneous intracranial hemorrhage. Crit Care Med. 2018;46:e395–e403. Fernando SM, Reardon PM, Dowlatshahi D, et al. Outcomes and costs of patients admitted to the ICU due to spontaneous intracranial hemorrhage. Crit Care Med. 2018;46:e395–e403.
21.
go back to reference Fernando SM, Reardon PM, Bagshaw SM, et al. Impact of nighttime Rapid Response Team activation on outcomes of hospitalized patients with acute deterioration. Crit Care. 2018;22:67.CrossRef Fernando SM, Reardon PM, Bagshaw SM, et al. Impact of nighttime Rapid Response Team activation on outcomes of hospitalized patients with acute deterioration. Crit Care. 2018;22:67.CrossRef
22.
go back to reference Fernando SM, Rochwerg B, Reardon PM, et al. Emergency department disposition decisions and associated mortality and costs in ICU patients with suspected infection. Crit Care. 2018;22:172.CrossRef Fernando SM, Rochwerg B, Reardon PM, et al. Emergency department disposition decisions and associated mortality and costs in ICU patients with suspected infection. Crit Care. 2018;22:172.CrossRef
23.
go back to reference Baxter AD, Cardinal P, Hooper J, et al. Medical emergency teams at the Ottawa Hospital: the first two years. Can J Anaesth. 2008;55:223–31.CrossRef Baxter AD, Cardinal P, Hooper J, et al. Medical emergency teams at the Ottawa Hospital: the first two years. Can J Anaesth. 2008;55:223–31.CrossRef
24.
go back to reference Elixhauser A, Steiner C, Harris DR, et al. Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27.CrossRef Elixhauser A, Steiner C, Harris DR, et al. Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27.CrossRef
25.
go back to reference Alonzo TA, Pepe MS, Moskowitz CS. Sample size calculations for comparative studies of medical tests for detecting presence of disease. Stat Med. 2002;21:835–52.CrossRef Alonzo TA, Pepe MS, Moskowitz CS. Sample size calculations for comparative studies of medical tests for detecting presence of disease. Stat Med. 2002;21:835–52.CrossRef
26.
go back to reference Filleron T. Comparing sensitivity and specificity of medical imaging tests when verification bias is present: the concept of relative diagnostic accuracy. Eur J Radiol. 2018;98:32–5.CrossRef Filleron T. Comparing sensitivity and specificity of medical imaging tests when verification bias is present: the concept of relative diagnostic accuracy. Eur J Radiol. 2018;98:32–5.CrossRef
27.
go back to reference Romero-Brufau S, Huddleston JM, Escobar GJ, et al. Why the C-statistic is not informative to evaluate early warning scores and what metrics to use. Crit Care. 2015;19:285.CrossRef Romero-Brufau S, Huddleston JM, Escobar GJ, et al. Why the C-statistic is not informative to evaluate early warning scores and what metrics to use. Crit Care. 2015;19:285.CrossRef
28.
go back to reference DeVita MA, Smith GB, Adam SK, et al. “Identifying the hospitalised patient in crisis”--a consensus conference on the afferent limb of rapid response systems. Resuscitation. 2010;81:375–82.CrossRef DeVita MA, Smith GB, Adam SK, et al. “Identifying the hospitalised patient in crisis”--a consensus conference on the afferent limb of rapid response systems. Resuscitation. 2010;81:375–82.CrossRef
29.
go back to reference Churpek MM, Yuen TC, Winslow C, et al. Differences in vital signs between elderly and nonelderly patients prior to ward cardiac arrest. Crit Care Med. 2015;43:816–22.CrossRef Churpek MM, Yuen TC, Winslow C, et al. Differences in vital signs between elderly and nonelderly patients prior to ward cardiac arrest. Crit Care Med. 2015;43:816–22.CrossRef
30.
go back to reference Barwise A, Thongprayoon C, Gajic O, et al. Delayed rapid response team activation is associated with increased hospital mortality, morbidity, and length of stay in a tertiary care institution. Crit Care Med. 2016;44:54–63.CrossRef Barwise A, Thongprayoon C, Gajic O, et al. Delayed rapid response team activation is associated with increased hospital mortality, morbidity, and length of stay in a tertiary care institution. Crit Care Med. 2016;44:54–63.CrossRef
31.
go back to reference Reardon PM, Fernando SM, Murphy K, et al. Factors associated with delayed rapid response team activation. J Crit Care. 2018;46:73–8.CrossRef Reardon PM, Fernando SM, Murphy K, et al. Factors associated with delayed rapid response team activation. J Crit Care. 2018;46:73–8.CrossRef
32.
go back to reference Calzavacca P, Licari E, Tee A, et al. Features and outcome of patients receiving multiple medical emergency team reviews. Resuscitation. 2010;81:1509–15.CrossRef Calzavacca P, Licari E, Tee A, et al. Features and outcome of patients receiving multiple medical emergency team reviews. Resuscitation. 2010;81:1509–15.CrossRef
33.
go back to reference Subbe CP, Duller B, Bellomo R. Effect of an automated notification system for deteriorating ward patients on clinical outcomes. Crit Care. 2017;21:52.CrossRef Subbe CP, Duller B, Bellomo R. Effect of an automated notification system for deteriorating ward patients on clinical outcomes. Crit Care. 2017;21:52.CrossRef
34.
go back to reference Chan P, Peake S, Bellomo R, et al. Improving the recognition of, and response to in-hospital sepsis. Curr Infect Dis Rep. 2016;18:20.CrossRef Chan P, Peake S, Bellomo R, et al. Improving the recognition of, and response to in-hospital sepsis. Curr Infect Dis Rep. 2016;18:20.CrossRef
35.
go back to reference Cross G, Bilgrami I, Eastwood G, et al. The epidemiology of sepsis during rapid response team reviews in a teaching hospital. Anaesth Intensive Care. 2015;43:193–8.PubMed Cross G, Bilgrami I, Eastwood G, et al. The epidemiology of sepsis during rapid response team reviews in a teaching hospital. Anaesth Intensive Care. 2015;43:193–8.PubMed
36.
go back to reference Fernando SM, Tran A, Taljaard M, et al. Prognostic accuracy of the quick sequential organ failure assessment for mortality in patients with suspected infection: a systematic review and meta-analysis. Ann Intern Med. 2018;168:266–75.CrossRef Fernando SM, Tran A, Taljaard M, et al. Prognostic accuracy of the quick sequential organ failure assessment for mortality in patients with suspected infection: a systematic review and meta-analysis. Ann Intern Med. 2018;168:266–75.CrossRef
37.
go back to reference Churpek MM, Snyder A, Han X, et al. Quick Sepsis-related Organ Failure Assessment, Systemic Inflammatory Response Syndrome, and Early Warning Scores for detecting clinical deterioration in infected patients outside the intensive care unit. Am J Respir Crit Care Med. 2017;195:906–11.CrossRef Churpek MM, Snyder A, Han X, et al. Quick Sepsis-related Organ Failure Assessment, Systemic Inflammatory Response Syndrome, and Early Warning Scores for detecting clinical deterioration in infected patients outside the intensive care unit. Am J Respir Crit Care Med. 2017;195:906–11.CrossRef
Metadata
Title
Prognostic accuracy of the Hamilton Early Warning Score (HEWS) and the National Early Warning Score 2 (NEWS2) among hospitalized patients assessed by a rapid response team
Authors
Shannon M. Fernando
Alison E. Fox-Robichaud
Bram Rochwerg
Pierre Cardinal
Andrew J. E. Seely
Jeffrey J. Perry
Daniel I. McIsaac
Alexandre Tran
Steven Skitch
Benjamin Tam
Michael Hickey
Peter M. Reardon
Peter Tanuseputro
Kwadwo Kyeremanteng
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2019
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-019-2355-3

Other articles of this Issue 1/2019

Critical Care 1/2019 Go to the issue