Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2014

Open Access 01-12-2014 | Research article

Diagnostic accuracy of a screening electronic alert tool for severe sepsis and septic shock in the emergency department

Authors: Sami Alsolamy, Majid Al Salamah, Majed Al Thagafi, Hasan M Al-Dorzi, Abdellatif M Marini, Nawfal Aljerian, Farhan Al-Enezi, Fatimah Al-Hunaidi, Ahmed M Mahmoud, Ahmed Alamry, Yaseen M Arabi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2014

Login to get access

Abstract

Background

Early recognition of severe sepsis and septic shock is challenging. The aim of this study was to determine the diagnostic accuracy of an electronic alert system in detecting severe sepsis or septic shock among emergency department (ED) patients.

Methods

An electronic sepsis alert system was developed as a part of a quality-improvement project for severe sepsis and septic shock. The system screened all adult ED patients for a combination of systemic inflammatory response syndrome and organ dysfunction criteria (hypotension, hypoxemia or lactic acidosis). This study included all patients older than 14 years who presented to the ED of a tertiary care academic medical center from Oct. 1, 2012 to Jan. 31, 2013. As a comparator, emergency medicine physicians or the critical care physician identified the patients with severe sepsis or septic shock.
In the ED, vital signs were manually entered into the hospital electronic heath record every hour in the critical care area and every two hours in other areas. We also calculated the time from the alert to the intensive care unit (ICU) referral.

Results

Of the 49,838 patients who presented to the ED, 222 (0.4%) were identified to have severe sepsis or septic shock. The electronic sepsis alert had a sensitivity of 93.18% (95% CI, 88.78% - 96.00%), specificity of 98.44 (95% CI, 98.33% – 98.55%), positive predictive value of 20.98% (95% CI, 18.50% – 23.70%) and negative predictive value of 99.97% (95% CI, 99.95% – 99.98%) for severe sepsis and septic shock. The alert preceded ICU referral by a median of 4.02 hours (Q1 - Q3: 1.25–8.55).

Conclusions

Our study shows that electronic sepsis alert tool has high sensitivity and specificity in recognizing severe sepsis and septic shock, which may improve early recognition and management.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wang HE, Devereaux RS, Yealy DM, Safford MM, Howard G: National variation in United States sepsis mortality: a descriptive study. Int J Health Geogr. 2010, 9: 9-10.1186/1476-072X-9-9.CrossRefPubMedPubMedCentral Wang HE, Devereaux RS, Yealy DM, Safford MM, Howard G: National variation in United States sepsis mortality: a descriptive study. Int J Health Geogr. 2010, 9: 9-10.1186/1476-072X-9-9.CrossRefPubMedPubMedCentral
2.
go back to reference Vincent JL, Sakr Y, Sprung CL, Ranieri VM, Reinhart K, Gerlach H, Moreno R, Carlet J, Le Gall JR, Payen D: Sepsis in European intensive care units: results of the SOAP study. Crit Care Med. 2006, 34 (2): 344-353. 10.1097/01.CCM.0000194725.48928.3A.CrossRefPubMed Vincent JL, Sakr Y, Sprung CL, Ranieri VM, Reinhart K, Gerlach H, Moreno R, Carlet J, Le Gall JR, Payen D: Sepsis in European intensive care units: results of the SOAP study. Crit Care Med. 2006, 34 (2): 344-353. 10.1097/01.CCM.0000194725.48928.3A.CrossRefPubMed
3.
go back to reference Hall MJ, Williams SN, DeFrances CJ, Golosinskiy A: Inpatient care for septicemia or sepsis: a challenge for patients and hospitals. NCHS Data Brief. 2011, 62: 1-8.PubMed Hall MJ, Williams SN, DeFrances CJ, Golosinskiy A: Inpatient care for septicemia or sepsis: a challenge for patients and hospitals. NCHS Data Brief. 2011, 62: 1-8.PubMed
4.
go back to reference Bullard MJ, Unger B, Spence J, Grafstein E: Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) adult guidelines. CJEM. 2008, 10 (2): 136-151.PubMed Bullard MJ, Unger B, Spence J, Grafstein E: Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) adult guidelines. CJEM. 2008, 10 (2): 136-151.PubMed
5.
go back to reference Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M: Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001, 345 (19): 1368-1377. 10.1056/NEJMoa010307.CrossRefPubMed Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M: Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001, 345 (19): 1368-1377. 10.1056/NEJMoa010307.CrossRefPubMed
6.
go back to reference Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, Osborn TM, Nunnally ME, Townsend SR, Reinhart K, Kleinpell RM, Angus DC, Deutschman CS, Machado FR, Rubenfeld GD, Webb SA, Beale RJ, Vincent JL, Moreno R: Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013, 41 (2): 580-637. 10.1097/CCM.0b013e31827e83af.CrossRefPubMed Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, Osborn TM, Nunnally ME, Townsend SR, Reinhart K, Kleinpell RM, Angus DC, Deutschman CS, Machado FR, Rubenfeld GD, Webb SA, Beale RJ, Vincent JL, Moreno R: Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013, 41 (2): 580-637. 10.1097/CCM.0b013e31827e83af.CrossRefPubMed
8.
go back to reference Fee C, Weber EJ, Maak CA, Bacchetti P: Effect of emergency department crowding on time to antibiotics in patients admitted with community-acquired pneumonia. Ann Emerg Med. 2007, 50 (5): 501-509. 10.1016/j.annemergmed.2007.08.003. 509 e501CrossRefPubMed Fee C, Weber EJ, Maak CA, Bacchetti P: Effect of emergency department crowding on time to antibiotics in patients admitted with community-acquired pneumonia. Ann Emerg Med. 2007, 50 (5): 501-509. 10.1016/j.annemergmed.2007.08.003. 509 e501CrossRefPubMed
9.
go back to reference Meurer WJ, Smith BL, Losman ED, Sherman D, Yaksich JD, Jared JD, Malani PN, Younger JG: Real-time identification of serious infection in geriatric patients using clinical information system surveillance. J Am Geriatr Soc. 2009, 57 (1): 40-45. 10.1111/j.1532-5415.2008.02094.x.CrossRefPubMed Meurer WJ, Smith BL, Losman ED, Sherman D, Yaksich JD, Jared JD, Malani PN, Younger JG: Real-time identification of serious infection in geriatric patients using clinical information system surveillance. J Am Geriatr Soc. 2009, 57 (1): 40-45. 10.1111/j.1532-5415.2008.02094.x.CrossRefPubMed
10.
go back to reference Nelson JL, Smith BL, Jared JD, Younger JG: Prospective trial of real-time electronic surveillance to expedite early care of severe sepsis. Ann Emerg Med. 2011, 57 (5): 500-504. 10.1016/j.annemergmed.2010.12.008.CrossRefPubMed Nelson JL, Smith BL, Jared JD, Younger JG: Prospective trial of real-time electronic surveillance to expedite early care of severe sepsis. Ann Emerg Med. 2011, 57 (5): 500-504. 10.1016/j.annemergmed.2010.12.008.CrossRefPubMed
11.
go back to reference Jaimes F, Garcés J, Cuervo J, Ramírez F, Ramírez J, Vargas A, Quintero C, Ochoa J, Tandioy F, Zapata L, Estrada J, Yepes M, Leal H: The systemic inflammatory response syndrome (SIRS) to identify infected patients in the emergency room. Intensive Care Med. 2003, 29 (8): 1368-1371. 10.1007/s00134-003-1874-0.CrossRefPubMed Jaimes F, Garcés J, Cuervo J, Ramírez F, Ramírez J, Vargas A, Quintero C, Ochoa J, Tandioy F, Zapata L, Estrada J, Yepes M, Leal H: The systemic inflammatory response syndrome (SIRS) to identify infected patients in the emergency room. Intensive Care Med. 2003, 29 (8): 1368-1371. 10.1007/s00134-003-1874-0.CrossRefPubMed
12.
go back to reference Grimes DA, Schulz KF: Uses and abuses of screening tests. Lancet. 2002, 359 (9309): 881-884. 10.1016/S0140-6736(02)07948-5.CrossRefPubMed Grimes DA, Schulz KF: Uses and abuses of screening tests. Lancet. 2002, 359 (9309): 881-884. 10.1016/S0140-6736(02)07948-5.CrossRefPubMed
13.
go back to reference Kocher KE, Shane SA, Venkatesh AK, Aronsky D, Asplin BR, Rathlev NK: Interventions to safeguard system effectiveness during periods of emergency department crowding. Acad Emerg Med. 2011, 18 (12): 1313-1317. 10.1111/j.1553-2712.2011.01219.x.CrossRefPubMed Kocher KE, Shane SA, Venkatesh AK, Aronsky D, Asplin BR, Rathlev NK: Interventions to safeguard system effectiveness during periods of emergency department crowding. Acad Emerg Med. 2011, 18 (12): 1313-1317. 10.1111/j.1553-2712.2011.01219.x.CrossRefPubMed
14.
go back to reference Langley GJ, Moen R, Nolan KM, Nolan TW, Norman CL, Provost LP: The Improvement Guide. 2009, John Wiley & Sons, San Franciso, California Langley GJ, Moen R, Nolan KM, Nolan TW, Norman CL, Provost LP: The Improvement Guide. 2009, John Wiley & Sons, San Franciso, California
15.
go back to reference Gerald J, Alsip J, Hicks J, Waldrum M, Dunlap N: Using the EMR to perform continuous, automated, real-time surveillance to identify hospitalized patients at risk of sepsis. Chest. 2011, 140 (4_MeetingAbstracts): 426A-10.1378/chest.1118563. doi:10.1378/chest.1118563CrossRef Gerald J, Alsip J, Hicks J, Waldrum M, Dunlap N: Using the EMR to perform continuous, automated, real-time surveillance to identify hospitalized patients at risk of sepsis. Chest. 2011, 140 (4_MeetingAbstracts): 426A-10.1378/chest.1118563. doi:10.1378/chest.1118563CrossRef
16.
go back to reference van der Sijs H, Aarts J, Vulto A, Berg M: Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006, 13 (2): 138-147. 10.1197/jamia.M1809.CrossRefPubMedPubMedCentral van der Sijs H, Aarts J, Vulto A, Berg M: Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006, 13 (2): 138-147. 10.1197/jamia.M1809.CrossRefPubMedPubMedCentral
Metadata
Title
Diagnostic accuracy of a screening electronic alert tool for severe sepsis and septic shock in the emergency department
Authors
Sami Alsolamy
Majid Al Salamah
Majed Al Thagafi
Hasan M Al-Dorzi
Abdellatif M Marini
Nawfal Aljerian
Farhan Al-Enezi
Fatimah Al-Hunaidi
Ahmed M Mahmoud
Ahmed Alamry
Yaseen M Arabi
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2014
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-014-0105-7

Other articles of this Issue 1/2014

BMC Medical Informatics and Decision Making 1/2014 Go to the issue