Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020

Open Access 01-12-2020 | Artificial Intelligence | Original research

Real-time AI prediction for major adverse cardiac events in emergency department patients with chest pain

Authors: Pei-I Zhang, Chien-Chin Hsu, Yuan Kao, Chia-Jung Chen, Ya-Wei Kuo, Shu-Lien Hsu, Tzu-Lan Liu, Hung-Jung Lin, Jhi-Joung Wang, Chung-Feng Liu, Chien-Cheng Huang

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2020

Login to get access

Abstract

Background

A big-data-driven and artificial intelligence (AI) with machine learning (ML) approach has never been integrated with the hospital information system (HIS) for predicting major adverse cardiac events (MACE) in patients with chest pain in the emergency department (ED). Therefore, we conducted the present study to clarify it.

Methods

In total, 85,254 ED patients with chest pain in three hospitals between 2009 and 2018 were identified. We randomized the patients into a 70%/30% split for ML model training and testing. We used 14 clinical variables from their electronic health records to construct a random forest model with the synthetic minority oversampling technique preprocessing algorithm to predict acute myocardial infarction (AMI) < 1 month and all-cause mortality < 1 month. Comparisons of the predictive accuracies among random forest, logistic regression, support-vector clustering (SVC), and K-nearest neighbor (KNN) models were also performed.

Results

Predicting MACE using the random forest model produced areas under the curves (AUC) of 0.915 for AMI < 1 month and 0.999 for all-cause mortality < 1 month. The random forest model had better predictive accuracy than logistic regression, SVC, and KNN. We further integrated the AI prediction model with the HIS to assist physicians with decision-making in real time. Validation of the AI prediction model by new patients showed AUCs of 0.907 for AMI < 1 month and 0.888 for all-cause mortality < 1 month.

Conclusions

An AI real-time prediction model is a promising method for assisting physicians in predicting MACE in ED patients with chest pain. Further studies to evaluate the impact on clinical practice are warranted.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bayon Fernandez J, Alegria Ezquerra E, Bosch Genover X, Cabades O'Callaghan A, Iglesias Garriz I, Jimenez Nacher JJ, Malpartida De Torres F, Sanz Romero G, Grupo de Trabajo ad hoc de la Seccion de Cardiopatia Isquemica y Unidades Coronarias de la Sociedad Espanola de C. Chest pain units. Organization and protocol for the diagnosis of acute coronary syndromes. Rev Esp Cardiol. 2002;55(2):143–54.PubMedCrossRef Bayon Fernandez J, Alegria Ezquerra E, Bosch Genover X, Cabades O'Callaghan A, Iglesias Garriz I, Jimenez Nacher JJ, Malpartida De Torres F, Sanz Romero G, Grupo de Trabajo ad hoc de la Seccion de Cardiopatia Isquemica y Unidades Coronarias de la Sociedad Espanola de C. Chest pain units. Organization and protocol for the diagnosis of acute coronary syndromes. Rev Esp Cardiol. 2002;55(2):143–54.PubMedCrossRef
2.
go back to reference Knockaert DC, Buntinx F, Stoens N, Bruyninckx R, Delooz H. Chest pain in the emergency department: the broad spectrum of causes. Eur J Emerg Med. 2002;9(1):25–30.PubMedCrossRef Knockaert DC, Buntinx F, Stoens N, Bruyninckx R, Delooz H. Chest pain in the emergency department: the broad spectrum of causes. Eur J Emerg Med. 2002;9(1):25–30.PubMedCrossRef
3.
go back to reference Pope JH, Aufderheide TP, Ruthazer R, Woolard RH, Feldman JA, Beshansky JR, Griffith JL, Selker HP. Missed diagnoses of acute cardiac ischemia in the emergency department. N Engl J Med. 2000;342(16):1163–70.PubMedCrossRef Pope JH, Aufderheide TP, Ruthazer R, Woolard RH, Feldman JA, Beshansky JR, Griffith JL, Selker HP. Missed diagnoses of acute cardiac ischemia in the emergency department. N Engl J Med. 2000;342(16):1163–70.PubMedCrossRef
5.
go back to reference Stopyra JP, Riley RF, Hiestand BC, Russell GB, Hoekstra JW, Lefebvre CW, Nicks BA, Cline DM, Askew KL, Elliott SB, et al. The HEART pathway randomized controlled trial one-year outcomes. Acad Emerg Med. 2019;26(1):41–50.PubMed Stopyra JP, Riley RF, Hiestand BC, Russell GB, Hoekstra JW, Lefebvre CW, Nicks BA, Cline DM, Askew KL, Elliott SB, et al. The HEART pathway randomized controlled trial one-year outcomes. Acad Emerg Med. 2019;26(1):41–50.PubMed
6.
go back to reference Mahler SA, Lenoir KM, Wells BJ, Burke GL, Duncan PW, Case LD, Herrington DM, Diaz-Garelli JF, Futrell WM, Hiestand BC, et al. Safely identifying emergency department patients with acute chest pain for early discharge. Circulation. 2018;138(22):2456–68.PubMedPubMedCentralCrossRef Mahler SA, Lenoir KM, Wells BJ, Burke GL, Duncan PW, Case LD, Herrington DM, Diaz-Garelli JF, Futrell WM, Hiestand BC, et al. Safely identifying emergency department patients with acute chest pain for early discharge. Circulation. 2018;138(22):2456–68.PubMedPubMedCentralCrossRef
7.
go back to reference Leite L, Baptista R, Leitao J, Cochicho J, Breda F, Elvas L, Fonseca I, Carvalho A, Costa JN. Chest pain in the emergency department: risk stratification with Manchester triage system and HEART score. BMC Cardiovasc Disord. 2015;15:48.PubMedPubMedCentralCrossRef Leite L, Baptista R, Leitao J, Cochicho J, Breda F, Elvas L, Fonseca I, Carvalho A, Costa JN. Chest pain in the emergency department: risk stratification with Manchester triage system and HEART score. BMC Cardiovasc Disord. 2015;15:48.PubMedPubMedCentralCrossRef
9.
go back to reference Than M, Flaws D, Sanders S, Doust J, Glasziou P, Kline J, Aldous S, Troughton R, Reid C, Parsonage WA, et al. Development and validation of the emergency department assessment of chest pain score and 2 h accelerated diagnostic protocol. Emerg Med Australas. 2014;26(1):34–44.PubMedCrossRef Than M, Flaws D, Sanders S, Doust J, Glasziou P, Kline J, Aldous S, Troughton R, Reid C, Parsonage WA, et al. Development and validation of the emergency department assessment of chest pain score and 2 h accelerated diagnostic protocol. Emerg Med Australas. 2014;26(1):34–44.PubMedCrossRef
10.
go back to reference Body R, Carley S, McDowell G, Pemberton P, Burrows G, Cook G, Lewis PS, Smith A, Mackway-Jones K. The Manchester acute coronary syndromes (MACS) decision rule for suspected cardiac chest pain: derivation and external validation. Heart. 2014;100(18):1462–8.PubMedPubMedCentralCrossRef Body R, Carley S, McDowell G, Pemberton P, Burrows G, Cook G, Lewis PS, Smith A, Mackway-Jones K. The Manchester acute coronary syndromes (MACS) decision rule for suspected cardiac chest pain: derivation and external validation. Heart. 2014;100(18):1462–8.PubMedPubMedCentralCrossRef
11.
go back to reference Jalili M, Hejripour Z, Honarmand AR, Pourtabatabaei N. Validation of the Vancouver chest pain rule: a prospective cohort study. Acad Emerg Med. 2012;19(7):837–42.PubMedCrossRef Jalili M, Hejripour Z, Honarmand AR, Pourtabatabaei N. Validation of the Vancouver chest pain rule: a prospective cohort study. Acad Emerg Med. 2012;19(7):837–42.PubMedCrossRef
12.
go back to reference Stewart J, Sprivulis P, Dwivedi G. Artificial intelligence and machine learning in emergency medicine. Emerg Med Australas. 2018;30(6):870–4.PubMedCrossRef Stewart J, Sprivulis P, Dwivedi G. Artificial intelligence and machine learning in emergency medicine. Emerg Med Australas. 2018;30(6):870–4.PubMedCrossRef
13.
go back to reference Liu N, Koh ZX, Goh J, Lin Z, Haaland B, Ting BP, Ong ME. Prediction of adverse cardiac events in emergency department patients with chest pain using machine learning for variable selection. BMC Med Inform Decis Mak. 2014;14:75.PubMedPubMedCentralCrossRef Liu N, Koh ZX, Goh J, Lin Z, Haaland B, Ting BP, Ong ME. Prediction of adverse cardiac events in emergency department patients with chest pain using machine learning for variable selection. BMC Med Inform Decis Mak. 2014;14:75.PubMedPubMedCentralCrossRef
14.
go back to reference Reaney PDW, Elliott HI, Noman A, Cooper JG. Risk stratifying chest pain patients in the emergency department using HEART, GRACE and TIMI scores, with a single contemporary troponin result, to predict major adverse cardiac events. Emerg Med J. 2018;35(7):420–7.PubMedCrossRef Reaney PDW, Elliott HI, Noman A, Cooper JG. Risk stratifying chest pain patients in the emergency department using HEART, GRACE and TIMI scores, with a single contemporary troponin result, to predict major adverse cardiac events. Emerg Med J. 2018;35(7):420–7.PubMedCrossRef
16.
go back to reference DeLaney MC, Neth M, Thomas JJ. Chest pain triage: current trends in the emergency departments in the United States. J Nucl Cardiol. 2017;24(6):2004–11.PubMedCrossRef DeLaney MC, Neth M, Thomas JJ. Chest pain triage: current trends in the emergency departments in the United States. J Nucl Cardiol. 2017;24(6):2004–11.PubMedCrossRef
17.
go back to reference Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making. JAMA. 2000;284(7):835–42.PubMedCrossRef Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making. JAMA. 2000;284(7):835–42.PubMedCrossRef
18.
go back to reference Pollack CV Jr, Sites FD, Shofer FS, Sease KL, Hollander JE. Application of the TIMI risk score for unstable angina and non-ST elevation acute coronary syndrome to an unselected emergency department chest pain population. Acad Emerg Med. 2006;13(1):13–8.PubMedCrossRef Pollack CV Jr, Sites FD, Shofer FS, Sease KL, Hollander JE. Application of the TIMI risk score for unstable angina and non-ST elevation acute coronary syndrome to an unselected emergency department chest pain population. Acad Emerg Med. 2006;13(1):13–8.PubMedCrossRef
19.
go back to reference Fox KA, Eagle KA, Gore JM, Steg PG, Anderson FA, Grace, Investigators G. The global registry of acute coronary events, 1999 to 2009--GRACE. Heart. 2010;96(14):1095–101.PubMedCrossRef Fox KA, Eagle KA, Gore JM, Steg PG, Anderson FA, Grace, Investigators G. The global registry of acute coronary events, 1999 to 2009--GRACE. Heart. 2010;96(14):1095–101.PubMedCrossRef
21.
go back to reference Poldervaart JM, Langedijk M, Backus BE, Dekker IMC, Six AJ, Doevendans PA, Hoes AW, Reitsma JB. Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department. Int J Cardiol. 2017;227:656–61.PubMedCrossRef Poldervaart JM, Langedijk M, Backus BE, Dekker IMC, Six AJ, Doevendans PA, Hoes AW, Reitsma JB. Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department. Int J Cardiol. 2017;227:656–61.PubMedCrossRef
22.
go back to reference Taylor RA, Pare JR, Venkatesh AK, Mowafi H, Melnick ER, Fleischman W, Hall MK. Prediction of in-hospital mortality in emergency department patients with Sepsis: a local big data-driven, machine learning approach. Acad Emerg Med. 2016;23(3):269–78.PubMedPubMedCentralCrossRef Taylor RA, Pare JR, Venkatesh AK, Mowafi H, Melnick ER, Fleischman W, Hall MK. Prediction of in-hospital mortality in emergency department patients with Sepsis: a local big data-driven, machine learning approach. Acad Emerg Med. 2016;23(3):269–78.PubMedPubMedCentralCrossRef
23.
go back to reference Karanasiou GS, Tripoliti EE, Papadopoulos TG, Kalatzis FG, Goletsis Y, Naka KK, Bechlioulis A, Errachid A, Fotiadis DI. Predicting adherence of patients with HF through machine learning techniques. Healthc Technol Lett. 2016;3(3):165–70.PubMedPubMedCentralCrossRef Karanasiou GS, Tripoliti EE, Papadopoulos TG, Kalatzis FG, Goletsis Y, Naka KK, Bechlioulis A, Errachid A, Fotiadis DI. Predicting adherence of patients with HF through machine learning techniques. Healthc Technol Lett. 2016;3(3):165–70.PubMedPubMedCentralCrossRef
24.
go back to reference Wang Y, Wu X, Chen Z, Ren F, Feng L, Du Q. Optimizing the predictive ability of machine learning methods for landslide susceptibility mapping using SMOTE for Lishui City in Zhejiang Province, China. Int J Environ Res Public Health. 2019;16(3):368. Wang Y, Wu X, Chen Z, Ren F, Feng L, Du Q. Optimizing the predictive ability of machine learning methods for landslide susceptibility mapping using SMOTE for Lishui City in Zhejiang Province, China. Int J Environ Res Public Health. 2019;16(3):368.
25.
go back to reference Chawla NVB, Hall KW, Kegelmeyer LO, P W. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.CrossRef Chawla NVB, Hall KW, Kegelmeyer LO, P W. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.CrossRef
26.
go back to reference Sullivan HR, Schweikart SJ. Are current tort liability doctrines adequate for addressing injury caused by AI? AMA J Ethics. 2019;21(2):E160–6.PubMedCrossRef Sullivan HR, Schweikart SJ. Are current tort liability doctrines adequate for addressing injury caused by AI? AMA J Ethics. 2019;21(2):E160–6.PubMedCrossRef
27.
go back to reference Ho CWL, Ali J, Caals K. Ensuring trustworthy use of artificial intelligence and big data analytics in health insurance. Bull World Health Organ. 2020;98(4):263–9.PubMedPubMedCentralCrossRef Ho CWL, Ali J, Caals K. Ensuring trustworthy use of artificial intelligence and big data analytics in health insurance. Bull World Health Organ. 2020;98(4):263–9.PubMedPubMedCentralCrossRef
28.
go back to reference Taft LM, Evans RS, Shyu CR, Egger MJ, Chawla N, Mitchell JA, Thornton SN, Bray B, Varner M. Countering imbalanced datasets to improve adverse drug event predictive models in labor and delivery. J Biomed Inform. 2009;42(2):356–64.PubMedCrossRef Taft LM, Evans RS, Shyu CR, Egger MJ, Chawla N, Mitchell JA, Thornton SN, Bray B, Varner M. Countering imbalanced datasets to improve adverse drug event predictive models in labor and delivery. J Biomed Inform. 2009;42(2):356–64.PubMedCrossRef
Metadata
Title
Real-time AI prediction for major adverse cardiac events in emergency department patients with chest pain
Authors
Pei-I Zhang
Chien-Chin Hsu
Yuan Kao
Chia-Jung Chen
Ya-Wei Kuo
Shu-Lien Hsu
Tzu-Lan Liu
Hung-Jung Lin
Jhi-Joung Wang
Chung-Feng Liu
Chien-Cheng Huang
Publication date
01-12-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s13049-020-00786-x

Other articles of this Issue 1/2020

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2020 Go to the issue