Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Heart Failure | Research

Development and comparison of machine learning-based models for predicting heart failure after acute myocardial infarction

Authors: Xuewen Li, Chengming Shang, Changyan Xu, Yiting Wang, Jiancheng Xu, Qi Zhou

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Aims

Heart failure (HF) is one of the common adverse cardiovascular events after acute myocardial infarction (AMI), but the predictive efficacy of numerous machine learning (ML) built models is unclear. This study aimed to build an optimal model to predict the occurrence of HF in AMI patients by comparing seven ML algorithms.

Methods

Cohort 1 included AMI patients from 2018 to 2019 divided into HF and control groups. All first routine test data of the study subjects were collected as the features to be selected for the model, and seven ML algorithms with screenable features were evaluated. Cohort 2 contains AMI patients from 2020 to 2021 to establish an early warning model with external validation. ROC curve and DCA curve to analyze the diagnostic efficacy and clinical benefit of the model respectively.

Results

The best performer among the seven ML algorithms was XgBoost, and the features of XgBoost algorithm for troponin I, triglycerides, urine red blood cell count, γ-glutamyl transpeptidase, glucose, urine specific gravity, prothrombin time, prealbumin, and urea were ranked high in importance. The AUC of the HF-Lab9 prediction model built by the XgBoost algorithm was 0.966 and had good clinical benefits.

Conclusions

This study screened the optimal ML algorithm as XgBoost and developed the model HF-Lab9 will improve the accuracy of clinicians in assessing the occurrence of HF after AMI and provide a reference for the selection of subsequent model-building algorithms.
Literature
1.
go back to reference Jenca D, Melenovsky V, Stehlik J, Stanek V, Kettner J, Kautzner J, Adamkova V, Wohlfahrt P. Heart failure after myocardial infarction: incidence and predictors. ESC Heart Fail. 2021;8(1):222–37.CrossRefPubMed Jenca D, Melenovsky V, Stehlik J, Stanek V, Kettner J, Kautzner J, Adamkova V, Wohlfahrt P. Heart failure after myocardial infarction: incidence and predictors. ESC Heart Fail. 2021;8(1):222–37.CrossRefPubMed
2.
go back to reference Hung J, Teng TH, Finn J, Knuiman M, Briffa T, Stewart S, Sanfilippo FM, Ridout S, Hobbs M. Trends from 1996 to 2007 in incidence and mortality outcomes of heart failure after acute myocardial infarction: a population-based study of 20,812 patients with first acute myocardial infarction in western Australia. J Am Heart Assoc. 2013;2(5):e000172.CrossRefPubMedPubMedCentral Hung J, Teng TH, Finn J, Knuiman M, Briffa T, Stewart S, Sanfilippo FM, Ridout S, Hobbs M. Trends from 1996 to 2007 in incidence and mortality outcomes of heart failure after acute myocardial infarction: a population-based study of 20,812 patients with first acute myocardial infarction in western Australia. J Am Heart Assoc. 2013;2(5):e000172.CrossRefPubMedPubMedCentral
3.
go back to reference Sulo G, Igland J, Vollset SE, Nygard O, Ebbing M, Sulo E, Egeland GM, Tell GS. Heart failure complicating Acute myocardial infarction; burden and timing of occurrence: a Nation-wide analysis including 86 771 patients from the Cardiovascular Disease in Norway (CVDNOR) Project. J Am Heart Assoc 2016, 5(1). Sulo G, Igland J, Vollset SE, Nygard O, Ebbing M, Sulo E, Egeland GM, Tell GS. Heart failure complicating Acute myocardial infarction; burden and timing of occurrence: a Nation-wide analysis including 86 771 patients from the Cardiovascular Disease in Norway (CVDNOR) Project. J Am Heart Assoc 2016, 5(1).
4.
go back to reference He J, Yi S, Zhou Y, Hu X, Lun Z, Dong H, Zhang Y. B-Lines by Lung Ultrasound can predict worsening Heart failure in Acute Myocardial Infarction during hospitalization and short-term Follow-Up. Front Cardiovasc Med. 2022;9:895133.CrossRefPubMedPubMedCentral He J, Yi S, Zhou Y, Hu X, Lun Z, Dong H, Zhang Y. B-Lines by Lung Ultrasound can predict worsening Heart failure in Acute Myocardial Infarction during hospitalization and short-term Follow-Up. Front Cardiovasc Med. 2022;9:895133.CrossRefPubMedPubMedCentral
5.
go back to reference Ponikowski P, Anker SD, AlHabib KF, Cowie MR, Force TL, Hu S, Jaarsma T, Krum H, Rastogi V, Rohde LE, et al. Heart failure: preventing disease and death worldwide. ESC Heart Fail. 2014;1(1):4–25.CrossRefPubMed Ponikowski P, Anker SD, AlHabib KF, Cowie MR, Force TL, Hu S, Jaarsma T, Krum H, Rastogi V, Rohde LE, et al. Heart failure: preventing disease and death worldwide. ESC Heart Fail. 2014;1(1):4–25.CrossRefPubMed
6.
go back to reference Schocken DD, Benjamin EJ, Fonarow GC, Krumholz HM, Levy D, Mensah GA, Narula J, Shor ES, Young JB, Hong Y, et al. Prevention of heart failure: a scientific statement from the American Heart Association Councils on Epidemiology and Prevention, Clinical Cardiology, Cardiovascular nursing, and high blood pressure research; quality of Care and Outcomes Research Interdisciplinary Working Group; and Functional Genomics and Translational Biology Interdisciplinary Working Group. Circulation. 2008;117(19):2544–65.CrossRefPubMed Schocken DD, Benjamin EJ, Fonarow GC, Krumholz HM, Levy D, Mensah GA, Narula J, Shor ES, Young JB, Hong Y, et al. Prevention of heart failure: a scientific statement from the American Heart Association Councils on Epidemiology and Prevention, Clinical Cardiology, Cardiovascular nursing, and high blood pressure research; quality of Care and Outcomes Research Interdisciplinary Working Group; and Functional Genomics and Translational Biology Interdisciplinary Working Group. Circulation. 2008;117(19):2544–65.CrossRefPubMed
7.
go back to reference Mohammad MA, Olesen KKW, Koul S, Gale CP, Rylance R, Jernberg T, Baron T, Spaak J, James S, Lindahl B, et al. Development and validation of an artificial neural network algorithm to predict mortality and admission to hospital for heart failure after myocardial infarction: a nationwide population-based study. Lancet Digit Health. 2022;4(1):e37–e45.CrossRefPubMed Mohammad MA, Olesen KKW, Koul S, Gale CP, Rylance R, Jernberg T, Baron T, Spaak J, James S, Lindahl B, et al. Development and validation of an artificial neural network algorithm to predict mortality and admission to hospital for heart failure after myocardial infarction: a nationwide population-based study. Lancet Digit Health. 2022;4(1):e37–e45.CrossRefPubMed
8.
go back to reference Tan J, He Y, Li Z, Xu X, Zhang Q, Xu Q, Zhang L, Xiang S, Tang X, Zhao W. Establishment and validation of a non-invasive diagnostic nomogram to identify heart failure in patients with Coronary Heart Disease. Front Cardiovasc Med. 2022;9:875702.CrossRefPubMedPubMedCentral Tan J, He Y, Li Z, Xu X, Zhang Q, Xu Q, Zhang L, Xiang S, Tang X, Zhao W. Establishment and validation of a non-invasive diagnostic nomogram to identify heart failure in patients with Coronary Heart Disease. Front Cardiovasc Med. 2022;9:875702.CrossRefPubMedPubMedCentral
9.
go back to reference Zhang J, Goode KM, Rigby A, Balk AH, Cleland JG. Identifying patients at risk of death or hospitalisation due to worsening heart failure using decision tree analysis: evidence from the Trans-European Network-Home-Care Management System (TEN-HMS) study. Int J Cardiol. 2013;163(2):149–56.CrossRefPubMed Zhang J, Goode KM, Rigby A, Balk AH, Cleland JG. Identifying patients at risk of death or hospitalisation due to worsening heart failure using decision tree analysis: evidence from the Trans-European Network-Home-Care Management System (TEN-HMS) study. Int J Cardiol. 2013;163(2):149–56.CrossRefPubMed
10.
go back to reference Masetic Z, Subasi A. Congestive heart failure detection using random forest classifier. Comput Methods Programs Biomed. 2016;130:54–64.CrossRefPubMed Masetic Z, Subasi A. Congestive heart failure detection using random forest classifier. Comput Methods Programs Biomed. 2016;130:54–64.CrossRefPubMed
11.
go back to reference Li X, Wang Y, Xu J. Development of a machine learning-based risk prediction model for cerebral infarction and comparison with nomogram model. J Affect Disord. 2022;314:341–8.CrossRefPubMed Li X, Wang Y, Xu J. Development of a machine learning-based risk prediction model for cerebral infarction and comparison with nomogram model. J Affect Disord. 2022;314:341–8.CrossRefPubMed
12.
go back to reference Stepinska J, Lettino M, Ahrens I, Bueno H, Garcia-Castrillo L, Khoury A, Lancellotti P, Mueller C, Muenzel T, Oleksiak A, et al. Diagnosis and risk stratification of chest pain patients in the emergency department: focus on acute coronary syndromes. A position paper of the Acute Cardiovascular Care Association. Eur Heart J Acute Cardiovasc Care. 2020;9(1):76–89.CrossRefPubMed Stepinska J, Lettino M, Ahrens I, Bueno H, Garcia-Castrillo L, Khoury A, Lancellotti P, Mueller C, Muenzel T, Oleksiak A, et al. Diagnosis and risk stratification of chest pain patients in the emergency department: focus on acute coronary syndromes. A position paper of the Acute Cardiovascular Care Association. Eur Heart J Acute Cardiovasc Care. 2020;9(1):76–89.CrossRefPubMed
13.
go back to reference Liang P, Xu W, Ma Y, Zhao X, Qin L. Increase of Elderly Population in the rainstorm hazard areas of China. Int J Environ Res Public Health 2017, 14(9). Liang P, Xu W, Ma Y, Zhao X, Qin L. Increase of Elderly Population in the rainstorm hazard areas of China. Int J Environ Res Public Health 2017, 14(9).
14.
go back to reference Hanya S, Yoshii K, Sugawara M. Study of the characteristics of pulmonary trunk in pulmonary hypertension secondary to Left Heart Disease using pressure-velocity loops (PU-Loops). Ann Vasc Dis 2017, 10(3). Hanya S, Yoshii K, Sugawara M. Study of the characteristics of pulmonary trunk in pulmonary hypertension secondary to Left Heart Disease using pressure-velocity loops (PU-Loops). Ann Vasc Dis 2017, 10(3).
15.
go back to reference Wang K, Zhu QZ, Ma XT, Cheng C. SUV39H2/KMT1B inhibits the cardiomyocyte senescence phenotype by down-regulating BTG2/PC3. Aging. 2021;13(18):22444–58.CrossRefPubMedPubMedCentral Wang K, Zhu QZ, Ma XT, Cheng C. SUV39H2/KMT1B inhibits the cardiomyocyte senescence phenotype by down-regulating BTG2/PC3. Aging. 2021;13(18):22444–58.CrossRefPubMedPubMedCentral
16.
go back to reference Geis NA, Pleger ST, Bekeredjian R, Chorianopoulos E, Kreusser MM, Frankenstein L, Ruhparwar A, Katus HA, Raake PWJ. Haemodynamic effects of percutaneous mitral valve edge-to-edge repair in patients with end-stage heart failure awaiting heart transplantation. ESC Heart Fail. 2018;5(5):892–901.CrossRefPubMedPubMedCentral Geis NA, Pleger ST, Bekeredjian R, Chorianopoulos E, Kreusser MM, Frankenstein L, Ruhparwar A, Katus HA, Raake PWJ. Haemodynamic effects of percutaneous mitral valve edge-to-edge repair in patients with end-stage heart failure awaiting heart transplantation. ESC Heart Fail. 2018;5(5):892–901.CrossRefPubMedPubMedCentral
17.
go back to reference Wang Q, Li B, Chen K, Yu F, Su H, Hu K, Liu Z, Wu G, Yan J, Su G. Machine learning-based risk prediction of malignant arrhythmia in hospitalized patients with heart failure. ESC Heart Fail. 2021;8(6):5363–71.CrossRefPubMedPubMedCentral Wang Q, Li B, Chen K, Yu F, Su H, Hu K, Liu Z, Wu G, Yan J, Su G. Machine learning-based risk prediction of malignant arrhythmia in hospitalized patients with heart failure. ESC Heart Fail. 2021;8(6):5363–71.CrossRefPubMedPubMedCentral
18.
go back to reference Tabassian M, Sunderji I, Erdei T, Sanchez-Martinez S, Degiovanni A, Marino P, Fraser AG, D’Hooge J. Diagnosis of heart failure with preserved ejection fraction: machine learning of Spatiotemporal Variations in Left Ventricular deformation. J Am Soc Echocardiogr. 2018;31(12):1272–1284e1279.CrossRefPubMed Tabassian M, Sunderji I, Erdei T, Sanchez-Martinez S, Degiovanni A, Marino P, Fraser AG, D’Hooge J. Diagnosis of heart failure with preserved ejection fraction: machine learning of Spatiotemporal Variations in Left Ventricular deformation. J Am Soc Echocardiogr. 2018;31(12):1272–1284e1279.CrossRefPubMed
19.
go back to reference Angraal S, Mortazavi BJ, Gupta A, Khera R, Ahmad T, Desai NR, Jacoby DL, Masoudi FA, Spertus JA, Krumholz HM. Machine learning prediction of mortality and hospitalization in heart failure with preserved ejection fraction. JACC Heart Fail. 2020;8(1):12–21.CrossRefPubMed Angraal S, Mortazavi BJ, Gupta A, Khera R, Ahmad T, Desai NR, Jacoby DL, Masoudi FA, Spertus JA, Krumholz HM. Machine learning prediction of mortality and hospitalization in heart failure with preserved ejection fraction. JACC Heart Fail. 2020;8(1):12–21.CrossRefPubMed
20.
go back to reference Chicco D, Jurman G. Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone. BMC Med Inform Decis Mak. 2020;20(1):16.CrossRefPubMedPubMedCentral Chicco D, Jurman G. Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone. BMC Med Inform Decis Mak. 2020;20(1):16.CrossRefPubMedPubMedCentral
21.
go back to reference Yuan H, Fan XS, Jin Y, He JX, Gui Y, Song LY, Song Y, Sun Q, Chen W. Development of heart failure risk prediction models based on a multi-marker approach using random forest algorithms. Chin Med J (Engl). 2019;132(7):819–26.CrossRefPubMed Yuan H, Fan XS, Jin Y, He JX, Gui Y, Song LY, Song Y, Sun Q, Chen W. Development of heart failure risk prediction models based on a multi-marker approach using random forest algorithms. Chin Med J (Engl). 2019;132(7):819–26.CrossRefPubMed
22.
go back to reference Chen J, Li Y, Liu P, Wu H, Su G. A nomogram to predict the in-hospital mortality of patients with congestive heart failure and chronic kidney disease. ESC Heart Fail 2022. Chen J, Li Y, Liu P, Wu H, Su G. A nomogram to predict the in-hospital mortality of patients with congestive heart failure and chronic kidney disease. ESC Heart Fail 2022.
23.
go back to reference Hu Y, Wang X, Xiao S, Huan C, Wu H, Xu T, Guo M, Zhu H, Pan D. Development and Validation of a Nomogram Model for Predicting the Risk of Readmission in Patients with Heart Failure with Reduced Ejection Fraction within 1 Year. Cardiovasc Ther 2022, 2022:4143173. Hu Y, Wang X, Xiao S, Huan C, Wu H, Xu T, Guo M, Zhu H, Pan D. Development and Validation of a Nomogram Model for Predicting the Risk of Readmission in Patients with Heart Failure with Reduced Ejection Fraction within 1 Year. Cardiovasc Ther 2022, 2022:4143173.
24.
go back to reference Guo CY, Wu MY, Cheng HM. The Comprehensive Machine Learning Analytics for Heart failure. Int J Environ Res Public Health 2021, 18(9). Guo CY, Wu MY, Cheng HM. The Comprehensive Machine Learning Analytics for Heart failure. Int J Environ Res Public Health 2021, 18(9).
25.
go back to reference Yu W, Lu Y, Shou H, Xu H, Shi L, Geng X, Song T. A 5-year survival status prognosis of nonmetastatic cervical cancer patients through machine learning algorithms. Cancer Med 2022. Yu W, Lu Y, Shou H, Xu H, Shi L, Geng X, Song T. A 5-year survival status prognosis of nonmetastatic cervical cancer patients through machine learning algorithms. Cancer Med 2022.
26.
go back to reference Feng M, Zhang J, Zhou X, Mo H, Jia L, Zhang C, Hu Y, Yuan W. Application of an interpretable machine learning model to Predict Lymph Node Metastasis in patients with laryngeal carcinoma. J Oncol. 2022;2022:6356399.CrossRefPubMedPubMedCentral Feng M, Zhang J, Zhou X, Mo H, Jia L, Zhang C, Hu Y, Yuan W. Application of an interpretable machine learning model to Predict Lymph Node Metastasis in patients with laryngeal carcinoma. J Oncol. 2022;2022:6356399.CrossRefPubMedPubMedCentral
27.
go back to reference Mao Y, Lan H, Lin W, Liang J, Huang H, Li L, Wen J, Chen G. Machine learning algorithms are comparable to conventional regression models in predicting distant metastasis of follicular thyroid carcinoma. Clin Endocrinol (Oxf). 2023;98(1):98–109.CrossRefPubMed Mao Y, Lan H, Lin W, Liang J, Huang H, Li L, Wen J, Chen G. Machine learning algorithms are comparable to conventional regression models in predicting distant metastasis of follicular thyroid carcinoma. Clin Endocrinol (Oxf). 2023;98(1):98–109.CrossRefPubMed
28.
go back to reference Ponikowski P, Voors AA, Anker SD, Bueno H, Cleland JG, Coats AJ, Falk V, Gonzalez-Juanatey JR, Harjola VP, Jankowska EA, et al. [2016 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure]. Kardiol Pol. 2016;74(10):1037–147.CrossRefPubMed Ponikowski P, Voors AA, Anker SD, Bueno H, Cleland JG, Coats AJ, Falk V, Gonzalez-Juanatey JR, Harjola VP, Jankowska EA, et al. [2016 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure]. Kardiol Pol. 2016;74(10):1037–147.CrossRefPubMed
29.
go back to reference Kim BS, Park JJ, Chang H, Kim SH, Kwon CH, Chung SM, Kim HY, Kim HJ. Association of High-Sensitivity troponin I with Cardiac and cerebrovascular events in patient after ischemic stroke. Cerebrovasc Dis 2022:1–7. Kim BS, Park JJ, Chang H, Kim SH, Kwon CH, Chung SM, Kim HY, Kim HJ. Association of High-Sensitivity troponin I with Cardiac and cerebrovascular events in patient after ischemic stroke. Cerebrovasc Dis 2022:1–7.
30.
go back to reference Tian P, Zhao X, Huang L, Feng J, Zhao L, Liang L, Huang B, Zhang Y, Zhang J. Prognostic value of high-sensitivity cardiac troponin I in patients with non-ischaemic heart failure: insights from China. ESC Heart Fail 2022. Tian P, Zhao X, Huang L, Feng J, Zhao L, Liang L, Huang B, Zhang Y, Zhang J. Prognostic value of high-sensitivity cardiac troponin I in patients with non-ischaemic heart failure: insights from China. ESC Heart Fail 2022.
31.
go back to reference Halldin AK, Lissner L, Lernfelt B, Bjorkelund C. Cholesterol and triglyceride levels in midlife and risk of heart failure in women, a longitudinal study: the prospective population study of women in Gothenburg. BMJ Open. 2020;10(6):e036709.CrossRefPubMedPubMedCentral Halldin AK, Lissner L, Lernfelt B, Bjorkelund C. Cholesterol and triglyceride levels in midlife and risk of heart failure in women, a longitudinal study: the prospective population study of women in Gothenburg. BMJ Open. 2020;10(6):e036709.CrossRefPubMedPubMedCentral
32.
go back to reference Ritsinger V, Hagstrom E, Lagerqvist B, Norhammar A. Admission glucose levels and Associated Risk for Heart failure after myocardial infarction in patients without diabetes. J Am Heart Assoc. 2021;10(22):e022667.CrossRefPubMedPubMedCentral Ritsinger V, Hagstrom E, Lagerqvist B, Norhammar A. Admission glucose levels and Associated Risk for Heart failure after myocardial infarction in patients without diabetes. J Am Heart Assoc. 2021;10(22):e022667.CrossRefPubMedPubMedCentral
33.
go back to reference Kazory A. Emergence of blood urea nitrogen as a biomarker of neurohormonal activation in heart failure. Am J Cardiol. 2010;106(5):694–700.CrossRefPubMed Kazory A. Emergence of blood urea nitrogen as a biomarker of neurohormonal activation in heart failure. Am J Cardiol. 2010;106(5):694–700.CrossRefPubMed
34.
go back to reference Li J, Liu S, Hu Y, Zhu L, Mao Y, Liu J. Predicting Mortality in Intensive Care Unit patients with heart failure using an interpretable machine learning model: Retrospective Cohort Study. J Med Internet Res. 2022;24(8):e38082.CrossRefPubMedPubMedCentral Li J, Liu S, Hu Y, Zhu L, Mao Y, Liu J. Predicting Mortality in Intensive Care Unit patients with heart failure using an interpretable machine learning model: Retrospective Cohort Study. J Med Internet Res. 2022;24(8):e38082.CrossRefPubMedPubMedCentral
36.
go back to reference Chen Q, Su L, Liu C, Gao F, Chen H, Yin Q, Li S. PRKAR1A and SDCBP serve as potential predictors of heart failure following Acute myocardial infarction. Front Immunol. 2022;13:878876.CrossRefPubMedPubMedCentral Chen Q, Su L, Liu C, Gao F, Chen H, Yin Q, Li S. PRKAR1A and SDCBP serve as potential predictors of heart failure following Acute myocardial infarction. Front Immunol. 2022;13:878876.CrossRefPubMedPubMedCentral
37.
go back to reference Li L, Wang W, Li T, Sun Y, Gao Y, Wang L, Yao HC. Gender-Related Difference in D-Dimer Level Predicts In-Hospital Heart Failure after Primary PCI for ST-Segment Elevation Myocardial Infarction. Dis Markers 2021, 2021:7641138. Li L, Wang W, Li T, Sun Y, Gao Y, Wang L, Yao HC. Gender-Related Difference in D-Dimer Level Predicts In-Hospital Heart Failure after Primary PCI for ST-Segment Elevation Myocardial Infarction. Dis Markers 2021, 2021:7641138.
38.
go back to reference Zhao BW, You ZH, Hu L, Guo ZH, Wang L, Chen ZH, Wong L. A Novel Method to Predict Drug-Target Interactions Based on Large-Scale Graph Representation Learning. Cancers (Basel) 2021, 13(9). Zhao BW, You ZH, Hu L, Guo ZH, Wang L, Chen ZH, Wong L. A Novel Method to Predict Drug-Target Interactions Based on Large-Scale Graph Representation Learning. Cancers (Basel) 2021, 13(9).
39.
go back to reference Zhao BW, Su XR, Hu PW, Ma YP, Zhou X, Hu L. A geometric deep learning framework for drug repositioning over heterogeneous information networks. Brief Bioinform 2022, 23(6). Zhao BW, Su XR, Hu PW, Ma YP, Zhou X, Hu L. A geometric deep learning framework for drug repositioning over heterogeneous information networks. Brief Bioinform 2022, 23(6).
Metadata
Title
Development and comparison of machine learning-based models for predicting heart failure after acute myocardial infarction
Authors
Xuewen Li
Chengming Shang
Changyan Xu
Yiting Wang
Jiancheng Xu
Qi Zhou
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02240-1

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue