Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Research article

Predicting out of intensive care unit cardiopulmonary arrest or death using electronic medical record data

Authors: Carlos A Alvarez, Christopher A Clark, Song Zhang, Ethan A Halm, John J Shannon, Carlos E Girod, Lauren Cooper, Ruben Amarasingham

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

Accurate, timely and automated identification of patients at high risk for severe clinical deterioration using readily available clinical information in the electronic medical record (EMR) could inform health systems to target scarce resources and save lives.

Methods

We identified 7,466 patients admitted to a large, public, urban academic hospital between May 2009 and March 2010. An automated clinical prediction model for out of intensive care unit (ICU) cardiopulmonary arrest and unexpected death was created in the derivation sample (50% randomly selected from total cohort) using multivariable logistic regression. The automated model was then validated in the remaining 50% from the total cohort (validation sample). The primary outcome was a composite of resuscitation events, and death (RED). RED included cardiopulmonary arrest, acute respiratory compromise and unexpected death. Predictors were measured using data from the previous 24 hours. Candidate variables included vital signs, laboratory data, physician orders, medications, floor assignment, and the Modified Early Warning Score (MEWS), among other treatment variables.

Results

RED rates were 1.2% of patient-days for the total cohort. Fourteen variables were independent predictors of RED and included age, oxygenation, diastolic blood pressure, arterial blood gas and laboratory values, emergent orders, and assignment to a high risk floor. The automated model had excellent discrimination (c-statistic=0.85) and calibration and was more sensitive (51.6% and 42.2%) and specific (94.3% and 91.3%) than the MEWS alone. The automated model predicted RED 15.9 hours before they occurred and earlier than Rapid Response Team (RRT) activation (5.7 hours prior to an event, p=0.003)

Conclusion

An automated model harnessing EMR data offers great potential for identifying RED and was superior to both a prior risk model and the human judgment-driven RRT.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hillman KM, Bristow PJ, Chey T, Daffurn K, Jacques T, Norman SL, Bishop GF, Simmons G: Duration of life-threatening antecedents prior to intensive care admission. Intensive Care Med. 2002, 28 (11): 1629-1634. 10.1007/s00134-002-1496-y.CrossRefPubMed Hillman KM, Bristow PJ, Chey T, Daffurn K, Jacques T, Norman SL, Bishop GF, Simmons G: Duration of life-threatening antecedents prior to intensive care admission. Intensive Care Med. 2002, 28 (11): 1629-1634. 10.1007/s00134-002-1496-y.CrossRefPubMed
2.
go back to reference Buist MD, Jarmolowski E, Burton PR, Bernard SA, Waxman BP, Anderson J: Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a tertiary-care hospital. Med J Aust. 1999, 171 (1): 22-25.PubMed Buist MD, Jarmolowski E, Burton PR, Bernard SA, Waxman BP, Anderson J: Recognising clinical instability in hospital patients before cardiac arrest or unplanned admission to intensive care. A pilot study in a tertiary-care hospital. Med J Aust. 1999, 171 (1): 22-25.PubMed
3.
go back to reference Chan PS, Khalid A, Longmore LS, Berg RA, Kosiborod M, Spertus JA: Hospital-wide code rates and mortality before and after implementation of a rapid response team. JAMA. 2008, 300 (21): 2506-2513. 10.1001/jama.2008.715.CrossRefPubMed Chan PS, Khalid A, Longmore LS, Berg RA, Kosiborod M, Spertus JA: Hospital-wide code rates and mortality before and after implementation of a rapid response team. JAMA. 2008, 300 (21): 2506-2513. 10.1001/jama.2008.715.CrossRefPubMed
4.
go back to reference Sandroni C, Nolan J, Cavallaro F, Antonelli M: In-hospital cardiac arrest: incidence, prognosis and possible measures to improve survival. Intensive Care Med. 2007, 33 (2): 237-245. 10.1007/s00134-006-0326-z.CrossRefPubMed Sandroni C, Nolan J, Cavallaro F, Antonelli M: In-hospital cardiac arrest: incidence, prognosis and possible measures to improve survival. Intensive Care Med. 2007, 33 (2): 237-245. 10.1007/s00134-006-0326-z.CrossRefPubMed
5.
go back to reference Berwick DM, Calkins DR, McCannon CJ, Hackbarth AD: The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA. 2006, 295 (3): 324-327. 10.1001/jama.295.3.324.CrossRefPubMed Berwick DM, Calkins DR, McCannon CJ, Hackbarth AD: The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA. 2006, 295 (3): 324-327. 10.1001/jama.295.3.324.CrossRefPubMed
6.
go back to reference Chan PS, Jain R, Nallmothu BK, Berg RA, Sasson C: Rapid response teams: a systematic review and meta-analysis. Arch Intern Med. 2010, 170 (1): 18-26. 10.1001/archinternmed.2009.424.CrossRefPubMed Chan PS, Jain R, Nallmothu BK, Berg RA, Sasson C: Rapid response teams: a systematic review and meta-analysis. Arch Intern Med. 2010, 170 (1): 18-26. 10.1001/archinternmed.2009.424.CrossRefPubMed
7.
go back to reference Konrad D, Jäderling G, Bell M, Granath F, Ekbom A, Martling C-R: Reducing in-hospital cardiac arrests and hospital mortality by introducing a medical emergency team. Intensive Care Med. 2010, 36 (1): 100-106. 10.1007/s00134-009-1634-x.CrossRefPubMed Konrad D, Jäderling G, Bell M, Granath F, Ekbom A, Martling C-R: Reducing in-hospital cardiac arrests and hospital mortality by introducing a medical emergency team. Intensive Care Med. 2010, 36 (1): 100-106. 10.1007/s00134-009-1634-x.CrossRefPubMed
8.
go back to reference Winters BD, Pham JC, Hunt EA, Guallar E, Berenholtz S, Pronovost PJ: Rapid response systems: a systematic review. Crit Care Med. 2007, 35 (5): 1238-1243. 10.1097/01.CCM.0000262388.85669.68.CrossRefPubMed Winters BD, Pham JC, Hunt EA, Guallar E, Berenholtz S, Pronovost PJ: Rapid response systems: a systematic review. Crit Care Med. 2007, 35 (5): 1238-1243. 10.1097/01.CCM.0000262388.85669.68.CrossRefPubMed
9.
go back to reference Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005, 365 (9477): 2091-2097.CrossRefPubMed Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A: Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005, 365 (9477): 2091-2097.CrossRefPubMed
10.
go back to reference Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G: A prospective before-and-after trial of a medical emergency team. Med J Aust. 2003, 179 (6): 283-287.PubMed Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G: A prospective before-and-after trial of a medical emergency team. Med J Aust. 2003, 179 (6): 283-287.PubMed
11.
go back to reference Winters BD, Pham J, Pronovost PJ: Rapid response teams–walk, don't run. JAMA. 2006, 296 (13): 1645-1647. 10.1001/jama.296.13.1645.CrossRefPubMed Winters BD, Pham J, Pronovost PJ: Rapid response teams–walk, don't run. JAMA. 2006, 296 (13): 1645-1647. 10.1001/jama.296.13.1645.CrossRefPubMed
12.
go back to reference Subbe CP, Kruger M, Rutherford P, Gemmel L: Validation of a modified early warning score in medical admissions. QJM. 2001, 94 (10): 521-526. 10.1093/qjmed/94.10.521.CrossRefPubMed Subbe CP, Kruger M, Rutherford P, Gemmel L: Validation of a modified early warning score in medical admissions. QJM. 2001, 94 (10): 521-526. 10.1093/qjmed/94.10.521.CrossRefPubMed
13.
go back to reference Amarasingham R, Moore BJ, Tabak YP, Drazner MH, Clark CA, Zhang S, Reed WG, Swanson TS, Ma Y, Halm EA: An automated model to identify heart failure patients at risk for 30-day readmission or death using electronic medical record data. Med Care. 2010, 48 (11): 981-988. 10.1097/MLR.0b013e3181ef60d9.CrossRefPubMed Amarasingham R, Moore BJ, Tabak YP, Drazner MH, Clark CA, Zhang S, Reed WG, Swanson TS, Ma Y, Halm EA: An automated model to identify heart failure patients at risk for 30-day readmission or death using electronic medical record data. Med Care. 2010, 48 (11): 981-988. 10.1097/MLR.0b013e3181ef60d9.CrossRefPubMed
14.
go back to reference Tabak YP, Sun X, Derby KG, Kurtz SG, Johannes RS: Development and validation of a disease-specific risk adjustment system using automated clinical data. Health Serv Res. 2010, 45 (6 Pt 1): 1815-1835.CrossRefPubMedPubMedCentral Tabak YP, Sun X, Derby KG, Kurtz SG, Johannes RS: Development and validation of a disease-specific risk adjustment system using automated clinical data. Health Serv Res. 2010, 45 (6 Pt 1): 1815-1835.CrossRefPubMedPubMedCentral
15.
go back to reference Kho A, Rotz D, Alrahi K, Cardenas W, Ramsey K, Liebovitz D, Noskin G, Watts C: Utility of commonly captured data from an EHR to identify hospitalized patients at risk for clinical deterioration. AMIA. 2007, Chicago, Illinois: Annual Symposium Proceedings/AMIA Symposium, 404-408. Kho A, Rotz D, Alrahi K, Cardenas W, Ramsey K, Liebovitz D, Noskin G, Watts C: Utility of commonly captured data from an EHR to identify hospitalized patients at risk for clinical deterioration. AMIA. 2007, Chicago, Illinois: Annual Symposium Proceedings/AMIA Symposium, 404-408.
16.
go back to reference Whittington J, White R, Haig KM, Slock M: Using an automated risk assessment report to identify patients at risk for clinical deterioration. Jt Comm J Qual Patient Saf. 2007, 33 (9): 569-574.PubMed Whittington J, White R, Haig KM, Slock M: Using an automated risk assessment report to identify patients at risk for clinical deterioration. Jt Comm J Qual Patient Saf. 2007, 33 (9): 569-574.PubMed
18.
go back to reference Hajian-Tilaki KO, Hanley JA: Comparison of three methods for estimating the standard error of the area under the curve in ROC analysis of quantitative data. Acad Radiol. 2002, 9 (11): 1278-1285. 10.1016/S1076-6332(03)80561-5.CrossRefPubMed Hajian-Tilaki KO, Hanley JA: Comparison of three methods for estimating the standard error of the area under the curve in ROC analysis of quantitative data. Acad Radiol. 2002, 9 (11): 1278-1285. 10.1016/S1076-6332(03)80561-5.CrossRefPubMed
19.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
20.
go back to reference Elixhauser A, Steiner C, Harris DR, Coffey RM: Comorbidity measures for use with administrative data. Med Care. 1998, 36 (1): 8-27. 10.1097/00005650-199801000-00004.CrossRefPubMed Elixhauser A, Steiner C, Harris DR, Coffey RM: Comorbidity measures for use with administrative data. Med Care. 1998, 36 (1): 8-27. 10.1097/00005650-199801000-00004.CrossRefPubMed
21.
go back to reference Render ML, Kim HM, Welsh DE, Timmons S, Johnston J, Hui S, Connors AF, Wagner D, Daley J, Hofer TP: Automated intensive care unit risk adjustment: results from a national veterans affairs study. Crit Care Med. 2003, 31 (6): 1638-1646. 10.1097/01.CCM.0000055372.08235.09.CrossRefPubMed Render ML, Kim HM, Welsh DE, Timmons S, Johnston J, Hui S, Connors AF, Wagner D, Daley J, Hofer TP: Automated intensive care unit risk adjustment: results from a national veterans affairs study. Crit Care Med. 2003, 31 (6): 1638-1646. 10.1097/01.CCM.0000055372.08235.09.CrossRefPubMed
22.
go back to reference Knaus WA, Wagner DP, Zimmerman JE, Draper EA: Variations in mortality and length of stay in intensive care units. Ann Intern Med. 1993, 118 (10): 753-761.CrossRefPubMed Knaus WA, Wagner DP, Zimmerman JE, Draper EA: Variations in mortality and length of stay in intensive care units. Ann Intern Med. 1993, 118 (10): 753-761.CrossRefPubMed
23.
go back to reference Zhang HP, Singer B: Recursive Partitioning in the Health Sciences. 1999, New York, NY: SpringerCrossRef Zhang HP, Singer B: Recursive Partitioning in the Health Sciences. 1999, New York, NY: SpringerCrossRef
24.
25.
go back to reference Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, Shields A, Rosenbaum S, Blumenthal D: Use of electronic health records in U.S. hospitals. N Engl J Med. 2009, 360 (16): 1628-1638. 10.1056/NEJMsa0900592.CrossRefPubMed Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, Shields A, Rosenbaum S, Blumenthal D: Use of electronic health records in U.S. hospitals. N Engl J Med. 2009, 360 (16): 1628-1638. 10.1056/NEJMsa0900592.CrossRefPubMed
26.
go back to reference Blumenthal D: Stimulating the adoption of health information technology. N Engl J Med. 2009, 360 (15): 1477-1479. 10.1056/NEJMp0901592.CrossRefPubMed Blumenthal D: Stimulating the adoption of health information technology. N Engl J Med. 2009, 360 (15): 1477-1479. 10.1056/NEJMp0901592.CrossRefPubMed
Metadata
Title
Predicting out of intensive care unit cardiopulmonary arrest or death using electronic medical record data
Authors
Carlos A Alvarez
Christopher A Clark
Song Zhang
Ethan A Halm
John J Shannon
Carlos E Girod
Lauren Cooper
Ruben Amarasingham
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-28

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue