Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2015

Open Access 01-12-2015 | Original research

Development and validation of a score to identify in the Emergency Department patients who may benefit from a time-critical intervention: a cohort study

Authors: Kirsty Challen, Mike Bradburn, Steve W. Goodacre

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2015

Login to get access

Abstract

Background

Risk stratification methods developed on the basis of predicting illness severity are often used to prioritise patients on the basis of urgency. Illness severity and urgency may not be interchangeable. Severe illness places patients at risk of adverse outcome, but treatment is only urgent if adverse outcome can be prevented by time-sensitive treatment. We aimed to develop a score to identify patients in need of urgent treatment, on the basis of potential to benefit from time-sensitive intervention, and to compare this with a severity score identifying patients at high risk of death.

Methods

A sequential cohort of adults presenting to one Emergency Department by ambulance and admitted to hospital was prospectively collected (2437 derivation, 2322 validation). Data on outcomes representing potential to benefit was collected retrospectively on a random subset (398 derivation, 227 validation). Logistic regression identified variables predictive of death and potential to benefit from urgent treatment.

Results

Death was predicted using age, respiratory rate, diastolic blood pressure, oxygen saturations, temperature, GCS and respiratory disease (AUROC 0.84 (95 % CI 0.8–0.89) derivation and 0.74 (0.69–0.81) validation), while potential to benefit was predicted by pulse, systolic blood pressure and GCS (AUROC 0.74 (0.67–0.80) derivation and 0.71 (0.59–0.82) validation).

Conclusions

A score developed to predict the need for urgent treatment has a different composition to a score developed to predict illness severity, suggesting that triage methods based on predicting severity could lead to inappropriate prioritisation on the intended basis of urgency.
Appendix
Available only for authorised users
Literature
1.
go back to reference Health and Social Care Information Centre. Provider level analysis for HES admitted patient care 2011–12 and 2012–13. Leeds: HSCIC; 2013. Health and Social Care Information Centre. Provider level analysis for HES admitted patient care 2011–12 and 2012–13. Leeds: HSCIC; 2013.
2.
go back to reference Hospital Episode Statistics. Adult Critical Care in England – April 2010 to March 2011: Experimental Statistics. London: Health and Social Care Information Centre; 2012. Hospital Episode Statistics. Adult Critical Care in England – April 2010 to March 2011: Experimental Statistics. London: Health and Social Care Information Centre; 2012.
3.
go back to reference Finlayson TL, Moyer CA, Sonnad SS. Assessing symptoms, disease severity, and quality of life in the clinical context: a theoretical framework. Am J Manage Care. 2004;10:336–44. Finlayson TL, Moyer CA, Sonnad SS. Assessing symptoms, disease severity, and quality of life in the clinical context: a theoretical framework. Am J Manage Care. 2004;10:336–44.
4.
go back to reference Challen K, Goodacre SW. Predictive scoring in non-trauma emergency patients: a scoping review. Emerg Med J. 2011;28:827–37.CrossRefPubMed Challen K, Goodacre SW. Predictive scoring in non-trauma emergency patients: a scoping review. Emerg Med J. 2011;28:827–37.CrossRefPubMed
5.
go back to reference Grady D, Berkowitz SA. Why is a good clinical prediction rule so hard to find? Arch Intern Med. 2011;171:1701–2.CrossRefPubMed Grady D, Berkowitz SA. Why is a good clinical prediction rule so hard to find? Arch Intern Med. 2011;171:1701–2.CrossRefPubMed
7.
go back to reference Gao H, McDonnell A, Harrison DA, Moore T, Adam S, Daly K, et al. Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med. 2007;33:667–9.CrossRefPubMed Gao H, McDonnell A, Harrison DA, Moore T, Adam S, Daly K, et al. Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med. 2007;33:667–9.CrossRefPubMed
8.
go back to reference Chan PS, Jain R, Nallmothu BK, Berg RA, Sasson C. Rapid response teams: a systematic review and meta-analysis. Arch Intern Med. 2010;170:18–26.CrossRefPubMed Chan PS, Jain R, Nallmothu BK, Berg RA, Sasson C. Rapid response teams: a systematic review and meta-analysis. Arch Intern Med. 2010;170:18–26.CrossRefPubMed
9.
go back to reference Goodacre S, Wilson R, Shephard N, Nicholl J. Derivation and validation of a risk adjustment model for predicting seven day mortality in emergency medical admissions: mixed prospective and retrospective cohort study. BMJ. 2012;344:e2904.PubMedCentralCrossRefPubMed Goodacre S, Wilson R, Shephard N, Nicholl J. Derivation and validation of a risk adjustment model for predicting seven day mortality in emergency medical admissions: mixed prospective and retrospective cohort study. BMJ. 2012;344:e2904.PubMedCentralCrossRefPubMed
10.
go back to reference Edbrooke DL, Minelli C, Mills GH, Iapichino G, Pezzi A, Corbella D, et al. Implications of ICU triage decisions on patient mortality: a cost-effectiveness analysis. Crit Care. 2011;15:R56.PubMedCentralCrossRefPubMed Edbrooke DL, Minelli C, Mills GH, Iapichino G, Pezzi A, Corbella D, et al. Implications of ICU triage decisions on patient mortality: a cost-effectiveness analysis. Crit Care. 2011;15:R56.PubMedCentralCrossRefPubMed
11.
go back to reference Cardoso LT, Grion CM, Matsuo T, Anami EH, Kauss IA, Seko L, et al. Impact of delayed admission to intensive care units on mortality of critically ill patients: a cohort study. Crit Care. 2011;15:R28.PubMedCentralCrossRefPubMed Cardoso LT, Grion CM, Matsuo T, Anami EH, Kauss IA, Seko L, et al. Impact of delayed admission to intensive care units on mortality of critically ill patients: a cohort study. Crit Care. 2011;15:R28.PubMedCentralCrossRefPubMed
12.
go back to reference Kaji AH, Schriger D, Green S. Looking through the retrospectoscope: reducing bias in Emergency Medicine chart review studies. Ann Emerg Med. 2014;64:292–8.CrossRefPubMed Kaji AH, Schriger D, Green S. Looking through the retrospectoscope: reducing bias in Emergency Medicine chart review studies. Ann Emerg Med. 2014;64:292–8.CrossRefPubMed
13.
go back to reference Platts-Mills TF, Travers D, Biese K, McCall B, Kizer S, LaMantia M, et al. Accuracy of the Emergency Severity Index triage instrument for identifying elder Emergency Department patients receiving an immediate life-saving intervention. Acad Emerg Med. 2010;17:238–43.CrossRefPubMed Platts-Mills TF, Travers D, Biese K, McCall B, Kizer S, LaMantia M, et al. Accuracy of the Emergency Severity Index triage instrument for identifying elder Emergency Department patients receiving an immediate life-saving intervention. Acad Emerg Med. 2010;17:238–43.CrossRefPubMed
14.
go back to reference Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–9.CrossRefPubMed Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–9.CrossRefPubMed
15.
go back to reference Berthelot S, Lang ES, Quan H, Stelfox HT. Identifying emergency-sensitive conditions for the calculation of an emergency care inhospital standardized mortality ratio. Ann Emerg Med. 2014;63:418–24.CrossRefPubMed Berthelot S, Lang ES, Quan H, Stelfox HT. Identifying emergency-sensitive conditions for the calculation of an emergency care inhospital standardized mortality ratio. Ann Emerg Med. 2014;63:418–24.CrossRefPubMed
16.
17.
go back to reference Sklar DP, Crandall CS, Loeliger E, Edmunds K, Paul I, Helitzer DL. Unanticipated death after discharge home from the Emergency Department. Ann Emerg Med. 2007;49(6):735–45.CrossRefPubMed Sklar DP, Crandall CS, Loeliger E, Edmunds K, Paul I, Helitzer DL. Unanticipated death after discharge home from the Emergency Department. Ann Emerg Med. 2007;49(6):735–45.CrossRefPubMed
18.
go back to reference Gabayan GZ, Derose SF, Asch SM, Yiu S, Lancaster EM, Poon KT, et al. Patterns and predictors of short-term death after Emergency Department discharge. Ann Emerg Med. 2011;58:551–8.PubMedCentralCrossRefPubMed Gabayan GZ, Derose SF, Asch SM, Yiu S, Lancaster EM, Poon KT, et al. Patterns and predictors of short-term death after Emergency Department discharge. Ann Emerg Med. 2011;58:551–8.PubMedCentralCrossRefPubMed
19.
go back to reference Jones D, Mitchell I, Hillman K, Story D. Defining clinical deterioration. Resuscitation. 2013;84:1029–34.CrossRefPubMed Jones D, Mitchell I, Hillman K, Story D. Defining clinical deterioration. Resuscitation. 2013;84:1029–34.CrossRefPubMed
20.
go back to reference Goodacre S, Cohen J, Bradburn M, Stevens J, Gray A, Benger J, et al. The 3Mg trial: a randomised controlled trial of intravenous or nebulised magnesium sulphate versus placebo in adults with acute severe asthma. Health Technol Assess. 2014;18(22):1–168.CrossRefPubMed Goodacre S, Cohen J, Bradburn M, Stevens J, Gray A, Benger J, et al. The 3Mg trial: a randomised controlled trial of intravenous or nebulised magnesium sulphate versus placebo in adults with acute severe asthma. Health Technol Assess. 2014;18(22):1–168.CrossRefPubMed
21.
go back to reference Cookson R, Claxton K, editors. The Humble Economist: Tony Culyer on Health, Health Care and Social Decision Making. York: University of York; 2012. Cookson R, Claxton K, editors. The Humble Economist: Tony Culyer on Health, Health Care and Social Decision Making. York: University of York; 2012.
22.
go back to reference Kellett J, Woodworth S, Wang F, Huang W. Changes and their prognostic implications in the abbreviated VitalpacTM early warning score (ViEWS) after admission to hospital of 18,853 acutely ill medical patients. Resuscitation. 2013;84:13–20.CrossRefPubMed Kellett J, Woodworth S, Wang F, Huang W. Changes and their prognostic implications in the abbreviated VitalpacTM early warning score (ViEWS) after admission to hospital of 18,853 acutely ill medical patients. Resuscitation. 2013;84:13–20.CrossRefPubMed
23.
go back to reference Croskerry P. From mindless to mindful practice — cognitive bias and clinical decision making. N Engl J Med. 2013;368:2445–8.CrossRefPubMed Croskerry P. From mindless to mindful practice — cognitive bias and clinical decision making. N Engl J Med. 2013;368:2445–8.CrossRefPubMed
24.
go back to reference Gaddis GM, Greenwald P, Huckson S. Toward improved implementation of evidence-based clinical algorithms: clinical practice guidelines, clinical decision rules, and clinical pathways. Acad Emerg Med. 2007;14:1015–22.CrossRefPubMed Gaddis GM, Greenwald P, Huckson S. Toward improved implementation of evidence-based clinical algorithms: clinical practice guidelines, clinical decision rules, and clinical pathways. Acad Emerg Med. 2007;14:1015–22.CrossRefPubMed
Metadata
Title
Development and validation of a score to identify in the Emergency Department patients who may benefit from a time-critical intervention: a cohort study
Authors
Kirsty Challen
Mike Bradburn
Steve W. Goodacre
Publication date
01-12-2015
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-015-0150-y

Other articles of this Issue 1/2015

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2015 Go to the issue

Reviewer acknowledgement

Reviewer acknowledgement