Skip to main content
Top
Published in: BMC Emergency Medicine 1/2016

Open Access 01-12-2016 | Research article

Prospective evaluation of an automated method to identify patients with severe sepsis or septic shock in the emergency department

Authors: Samuel M. Brown, Jason Jones, Kathryn Gibb Kuttler, Roger K. Keddington, Todd L. Allen, Peter Haug

Published in: BMC Emergency Medicine | Issue 1/2016

Login to get access

Abstract

Background

Sepsis is an often-fatal syndrome resulting from severe infection. Rapid identification and treatment are critical for septic patients. We therefore developed a probabilistic model to identify septic patients in the emergency department (ED). We aimed to produce a model that identifies 80 % of sepsis patients, with no more than 15 false positive alerts per day, within one hour of ED admission, using routine clinical data.

Methods

We developed the model using retrospective data for 132,748 ED encounters (549 septic), with manual chart review to confirm cases of severe sepsis or septic shock from January 2006 through December 2008. A naïve Bayes model was used to select model features, starting with clinician-proposed candidate variables, which were then used to calculate the probability of sepsis. We evaluated the accuracy of the resulting model in 93,733 ED encounters from April 2009 through June 2010.

Results

The final model included mean blood pressure, temperature, age, heart rate, and white blood cell count. The area under the receiver operating characteristic curve (AUC) for the continuous predictor model was 0.953. The binary alert achieved 76.4 % sensitivity with a false positive rate of 4.7 %.

Conclusions

We developed and validated a probabilistic model to identify sepsis early in an ED encounter. Despite changes in process, organizational focus, and the H1N1 influenza pandemic, our model performed adequately in our validation cohort, suggesting that it will be generalizable.
Literature
1.
go back to reference Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29:1303–10.CrossRefPubMed Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29:1303–10.CrossRefPubMed
2.
go back to reference Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348:1546–54.CrossRefPubMed Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348:1546–54.CrossRefPubMed
3.
go back to reference Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77.CrossRefPubMed Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77.CrossRefPubMed
4.
go back to reference ProCess Investigators, Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, Terndrup T, Wang HE, Hou PC, et al. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370:1683–93.CrossRef ProCess Investigators, Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, Terndrup T, Wang HE, Hou PC, et al. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370:1683–93.CrossRef
5.
6.
go back to reference Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;41:580–637.CrossRefPubMed Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;41:580–637.CrossRefPubMed
7.
go back to reference Miller RR, 3rd, Dong L, Nelson NC, Brown SM, Kuttler KG, Probst DR, Allen TL, Clemmer TP, for the Intermountain Healthcare Intensive Medicine Clinical P. Multicenter Implementation of a Severe Sepsis and Septic Shock Treatment Bundle. Am J Respir Crit Care Med. 2013;188(1):77–82. Miller RR, 3rd, Dong L, Nelson NC, Brown SM, Kuttler KG, Probst DR, Allen TL, Clemmer TP, for the Intermountain Healthcare Intensive Medicine Clinical P. Multicenter Implementation of a Severe Sepsis and Septic Shock Treatment Bundle. Am J Respir Crit Care Med. 2013;188(1):77–82.
8.
go back to reference Jones JP, Kuttler K, Keddington RK, Allen TL, Brown SM, Haug PJ. Derivation and validation of a probabilistic model deployed in the emergency department to identify patients with severe sepsis or septic shock. Am J Respir Crit Care Med. 2012;185:A1126. Jones JP, Kuttler K, Keddington RK, Allen TL, Brown SM, Haug PJ. Derivation and validation of a probabilistic model deployed in the emergency department to identify patients with severe sepsis or septic shock. Am J Respir Crit Care Med. 2012;185:A1126.
9.
go back to reference Miller 3rd RR, Dong L, Nelson NC, Brown SM, Kuttler KG, Probst DR, Allen TL, Clemmer TP, Intermountain Healthcare Intensive Medicine Clinical P. Multicenter implementation of a severe sepsis and septic shock treatment bundle. Am J Respir Crit Care Med. 2013;188:77–82.CrossRefPubMedPubMedCentral Miller 3rd RR, Dong L, Nelson NC, Brown SM, Kuttler KG, Probst DR, Allen TL, Clemmer TP, Intermountain Healthcare Intensive Medicine Clinical P. Multicenter implementation of a severe sepsis and septic shock treatment bundle. Am J Respir Crit Care Med. 2013;188:77–82.CrossRefPubMedPubMedCentral
10.
go back to reference Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM consensus conference committee. American college of chest physicians/society of critical care medicine. Chest. 1992;101:1644–55.CrossRefPubMed Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM consensus conference committee. American college of chest physicians/society of critical care medicine. Chest. 1992;101:1644–55.CrossRefPubMed
11.
go back to reference Miller 3rd RR, Markewitz BA, Rolfs RT, Brown SM, Dascomb KK, Grissom CK, Friedrichs MD, Mayer J, Hirshberg EL, Conklin J, et al. Clinical findings and demographic factors associated with ICU admission in Utah due to novel 2009 influenza A(H1N1) infection. Chest. 2010;137:752–8.CrossRefPubMedPubMedCentral Miller 3rd RR, Markewitz BA, Rolfs RT, Brown SM, Dascomb KK, Grissom CK, Friedrichs MD, Mayer J, Hirshberg EL, Conklin J, et al. Clinical findings and demographic factors associated with ICU admission in Utah due to novel 2009 influenza A(H1N1) infection. Chest. 2010;137:752–8.CrossRefPubMedPubMedCentral
12.
go back to reference Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001.CrossRef Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001.CrossRef
13.
go back to reference Efron B, Tibshirani R. Improvements on cross-validation: The.632+ bootstrap method. J Am Stat Assoc. 1997;92:548–60. Efron B, Tibshirani R. Improvements on cross-validation: The.632+ bootstrap method. J Am Stat Assoc. 1997;92:548–60.
14.
go back to reference R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna, Austria; 2009. R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna, Austria; 2009.
15.
go back to reference van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006;13:138–47.CrossRefPubMedPubMedCentral van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006;13:138–47.CrossRefPubMedPubMedCentral
Metadata
Title
Prospective evaluation of an automated method to identify patients with severe sepsis or septic shock in the emergency department
Authors
Samuel M. Brown
Jason Jones
Kathryn Gibb Kuttler
Roger K. Keddington
Todd L. Allen
Peter Haug
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2016
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-016-0095-0

Other articles of this Issue 1/2016

BMC Emergency Medicine 1/2016 Go to the issue