Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Chronic Heart Failure | Research

Interpretable prediction of 3-year all-cause mortality in patients with chronic heart failure based on machine learning

Authors: Chenggong Xu, Hongxia Li, Jianping Yang, Yunzhu Peng, Hongyan Cai, Jing Zhou, Wenyi Gu, Lixing Chen

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

The goal of this study was to assess the effectiveness of machine learning models and create an interpretable machine learning model that adequately explained 3-year all-cause mortality in patients with chronic heart failure.

Methods

The data in this paper were selected from patients with chronic heart failure who were hospitalized at the First Affiliated Hospital of Kunming Medical University, from 2017 to 2019 with cardiac function class III-IV. The dataset was explored using six different machine learning models, including logistic regression, naive Bayes, random forest classifier, extreme gradient boost, K-nearest neighbor, and decision tree. Finally, interpretable methods based on machine learning, such as SHAP value, permutation importance, and partial dependence plots, were used to estimate the 3-year all-cause mortality risk and produce individual interpretations of the model's conclusions.

Result

In this paper, random forest was identified as the optimal aools lgorithm for this dataset. We also incorporated relevant machine learning interpretable tand techniques to improve disease prognosis, including permutation importance, PDP plots and SHAP values for analysis. From this study, we can see that the number of hospitalizations, age, glomerular filtration rate, BNP, NYHA cardiac function classification, lymphocyte absolute value, serum albumin, hemoglobin, total cholesterol, pulmonary artery systolic pressure and so on were important for providing an optimal risk assessment and were important predictive factors of chronic heart failure.

Conclusion

The machine learning-based cardiovascular risk models could be used to accurately assess and stratify the 3-year risk of all-cause mortality among CHF patients. Machine learning in combination with permutation importance, PDP plots, and the SHAP value could offer a clear explanation of individual risk prediction and give doctors an intuitive knowledge of the functions of important model components.
Literature
1.
go back to reference Yan L, Zirui H, Chun X, et al. Association of serum total cholesterol and left ventricular ejection fraction in patients with heart failure caused by coronary heart disease. Arch Med Sci. 2017;14(5):988–94. Yan L, Zirui H, Chun X, et al. Association of serum total cholesterol and left ventricular ejection fraction in patients with heart failure caused by coronary heart disease. Arch Med Sci. 2017;14(5):988–94.
2.
go back to reference Alba A, Agoritsas T, Jankowski M, et al. Risk prediction models for mortality in ambulatory patients with heart failure: a systematic review. Circ Heart Fail. 2013;6(5):881–9.CrossRefPubMed Alba A, Agoritsas T, Jankowski M, et al. Risk prediction models for mortality in ambulatory patients with heart failure: a systematic review. Circ Heart Fail. 2013;6(5):881–9.CrossRefPubMed
3.
go back to reference Lippi G. Sanchis-Gomar F (2020) Global epidemiology and future trends of heart failure. AME Med J. 2020;5:15.CrossRef Lippi G. Sanchis-Gomar F (2020) Global epidemiology and future trends of heart failure. AME Med J. 2020;5:15.CrossRef
4.
go back to reference Orso F, Fabbri G, Maggioni AP. Epidemiology of Heart Failure. Handb Exp Pharmacol. 2017;243:15–33.CrossRefPubMed Orso F, Fabbri G, Maggioni AP. Epidemiology of Heart Failure. Handb Exp Pharmacol. 2017;243:15–33.CrossRefPubMed
5.
go back to reference Jun H. Epidemiological characteristics and prevention strategies of heart failure in China. Chinese Heart and Heart Rhythm Elec J. 2015;3(02):2–3. Jun H. Epidemiological characteristics and prevention strategies of heart failure in China. Chinese Heart and Heart Rhythm Elec J. 2015;3(02):2–3.
6.
go back to reference Summary of China Cardiovascular Health and Disease Report 2021. Chinese Journal of Circulation,2022,37(06):553–578. Summary of China Cardiovascular Health and Disease Report 2021. Chinese Journal of Circulation,2022,37(06):553–578.
8.
go back to reference Pocock SJ, Ariti CA, McMurray JJV, Maggioni A, Køber L, Squire IB, Swedberg K, Dobson J, Poppe KK, Whalley GA, Doughty RN, Meta-Analysis Global Group in Chronic Heart Failure. Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies. Eur Heart J. 2013;34:1404–13.CrossRefPubMed Pocock SJ, Ariti CA, McMurray JJV, Maggioni A, Køber L, Squire IB, Swedberg K, Dobson J, Poppe KK, Whalley GA, Doughty RN, Meta-Analysis Global Group in Chronic Heart Failure. Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies. Eur Heart J. 2013;34:1404–13.CrossRefPubMed
9.
go back to reference Levy WC, Mozaffarian D, Linker DT, Sutradhar SC, Anker SD, Cropp AB, Anand I, Maggioni A, Burton P, Sullivan MD, Pitt B, Poole-Wilson PA, Mann DL, Packer M. The Seattle Heart Failure Model: Prediction of survival in heart failure. Circulation. 2006;113:1424–33.CrossRefPubMed Levy WC, Mozaffarian D, Linker DT, Sutradhar SC, Anker SD, Cropp AB, Anand I, Maggioni A, Burton P, Sullivan MD, Pitt B, Poole-Wilson PA, Mann DL, Packer M. The Seattle Heart Failure Model: Prediction of survival in heart failure. Circulation. 2006;113:1424–33.CrossRefPubMed
10.
go back to reference Collier TJ, Pocock SJ, McMurray JJV, Zannad F, Krum H, van Veldhuisen DJ, 4084 T. Tohyama et al. ESC Heart Failure 2021; 8: 4077–4085 Collier TJ, Pocock SJ, McMurray JJV, Zannad F, Krum H, van Veldhuisen DJ, 4084 T. Tohyama et al. ESC Heart Failure 2021; 8: 4077–4085
11.
go back to reference Swedberg K, Shi H, Vincent J, Pitt B. The impact of eplerenone at different levels of risk in patients with systolic heart failure and mild symptoms: Insight from a novel risk score for prognosis derived from the EMPHASIS-HF trial. Eur Heart J. 2013; 34: 2823–2829.[15] Mortazavi BJ, Downing NS, Swedberg K, Shi H, Vincent J, Pitt B. The impact of eplerenone at different levels of risk in patients with systolic heart failure and mild symptoms: Insight from a novel risk score for prognosis derived from the EMPHASIS-HF trial. Eur Heart J. 2013; 34: 2823–2829.[15] Mortazavi BJ, Downing NS,
12.
go back to reference Anderson JL, Heidenreich PA, Barnett PG, et al. ACC/AHA statement on cost/value methodology in clinical practice guidelines and performance measures: A report of the American college of cardiology/American heart association task force on performance measures and task force on practice guidelines[J]. J Am Coll Cardiol. 2014;(63-21). https://doi.org/10.1016/j.jacc.2014.03.016. Anderson JL, Heidenreich PA, Barnett PG, et al. ACC/AHA statement on cost/value methodology in clinical practice guidelines and performance measures: A report of the American college of cardiology/American heart association task force on performance measures and task force on practice guidelines[J]. J Am Coll Cardiol. 2014;(63-21). https://​doi.​org/​10.​1016/​j.​jacc.​2014.​03.​016.
14.
go back to reference Lyle M, Wan SH, Murphree D, Bennett C, Wiley BM, Barsness G, et al. Predictive value of the get with the guidelines heart failure risk score in unselected cardiac intensive care unit patients. J Am Heart Assoc. 2020;9:e012439.CrossRefPubMedPubMedCentral Lyle M, Wan SH, Murphree D, Bennett C, Wiley BM, Barsness G, et al. Predictive value of the get with the guidelines heart failure risk score in unselected cardiac intensive care unit patients. J Am Heart Assoc. 2020;9:e012439.CrossRefPubMedPubMedCentral
15.
go back to reference Lundberg SM, Nair B, Vavilala MS, et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat Biomed Engi. 2018;2(10):749–60.CrossRef Lundberg SM, Nair B, Vavilala MS, et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat Biomed Engi. 2018;2(10):749–60.CrossRef
16.
go back to reference Ahmad FS, Ning H, Rich JD, Yancy CW, Lloyd-Jones DM, Wilkins JT. Hypertension, obesity, diabetes, and heart failure-free survival: the cardiovascular disease lifetime risk pooling project. JACC Heart Fail. 2016;4(12):911–9.CrossRefPubMedPubMedCentral Ahmad FS, Ning H, Rich JD, Yancy CW, Lloyd-Jones DM, Wilkins JT. Hypertension, obesity, diabetes, and heart failure-free survival: the cardiovascular disease lifetime risk pooling project. JACC Heart Fail. 2016;4(12):911–9.CrossRefPubMedPubMedCentral
17.
go back to reference Allen LA, Matlock DD, Shetterly SM, Xu S, Levy WC, Portalupi LB, McIlvennan CK, Gurwitz JH, Johnson ES, Smith DH, Magid DJ. Use of risk models to predict death in the next year among individual ambulatory patients with heart failure. JAMA Cardiol. 2017;2:435–41.CrossRefPubMed Allen LA, Matlock DD, Shetterly SM, Xu S, Levy WC, Portalupi LB, McIlvennan CK, Gurwitz JH, Johnson ES, Smith DH, Magid DJ. Use of risk models to predict death in the next year among individual ambulatory patients with heart failure. JAMA Cardiol. 2017;2:435–41.CrossRefPubMed
20.
go back to reference Yancy CW, Jessup M, Bozkurt B, et al. ACC/AHA/HFSA focused update of the 2013 ACCF/AHA guideline for the management of heart failure: a report of the American college of cardiology/American heart association task force on clinical practice guidelines and the heart failure society of America. J Am Coll Cardiol. 2017;136:1476–88. Yancy CW, Jessup M, Bozkurt B, et al. ACC/AHA/HFSA focused update of the 2013 ACCF/AHA guideline for the management of heart failure: a report of the American college of cardiology/American heart association task force on clinical practice guidelines and the heart failure society of America. J Am Coll Cardiol. 2017;136:1476–88.
21.
go back to reference Vermond RA, Geelhoed B, Verweij N, Tieleman RG, Van der Harst P, Hillege HL, Van Gilst WH, Van Gelder IC, Rienstra M. Incidence of atrial fibrillation and relationship with cardiovascular events, heart failure, and mortality: a community-based study from the Netherlands. J Am Coll Cardiol. 2015;66(9):1000–7.CrossRefPubMed Vermond RA, Geelhoed B, Verweij N, Tieleman RG, Van der Harst P, Hillege HL, Van Gilst WH, Van Gelder IC, Rienstra M. Incidence of atrial fibrillation and relationship with cardiovascular events, heart failure, and mortality: a community-based study from the Netherlands. J Am Coll Cardiol. 2015;66(9):1000–7.CrossRefPubMed
23.
go back to reference Kawasoe S, Kubozono T, Ojima S, Miyata M, Ohishi M. Combined assessment of the red cell distribution width and b-type natriuretic peptide: a more useful prognostic marker of cardiovascular mortality in heart failure patients. Intern Med. 2018;57(12):1681–8.CrossRefPubMedPubMedCentral Kawasoe S, Kubozono T, Ojima S, Miyata M, Ohishi M. Combined assessment of the red cell distribution width and b-type natriuretic peptide: a more useful prognostic marker of cardiovascular mortality in heart failure patients. Intern Med. 2018;57(12):1681–8.CrossRefPubMedPubMedCentral
25.
go back to reference Alfraidi H, Seifer CM, Hiebert BM, Torbiak L, Zieroth S. McIntyre WF relation of increasing QRS duration over time and cardiovascular events in outpatients with heart failure. Am J Cardiol. 2019;124(12):1907–11.CrossRefPubMed Alfraidi H, Seifer CM, Hiebert BM, Torbiak L, Zieroth S. McIntyre WF relation of increasing QRS duration over time and cardiovascular events in outpatients with heart failure. Am J Cardiol. 2019;124(12):1907–11.CrossRefPubMed
26.
go back to reference Niedziela JT, Hudzik B, Szygula-Jurkiewicz B, Nowak JU, Polonski L, Gasior M, Rozentryt P. Albumin-to-globulin ratio as an independent predictor of mortality in chronic heart failure. Biomark Med. 2018;12(7):749–57.CrossRefPubMed Niedziela JT, Hudzik B, Szygula-Jurkiewicz B, Nowak JU, Polonski L, Gasior M, Rozentryt P. Albumin-to-globulin ratio as an independent predictor of mortality in chronic heart failure. Biomark Med. 2018;12(7):749–57.CrossRefPubMed
27.
go back to reference Pocock SJ, Wang D, Pfeffer MA, Yusuf S, McMurray JJ, Swedberg KB, Ostergren J, Michelson EL, Pieper KS, Granger CB. Predictors of mortality and morbidity in patients with chronic heart failure. Eur Heart J. 2006;27(1):65–75.CrossRefPubMed Pocock SJ, Wang D, Pfeffer MA, Yusuf S, McMurray JJ, Swedberg KB, Ostergren J, Michelson EL, Pieper KS, Granger CB. Predictors of mortality and morbidity in patients with chronic heart failure. Eur Heart J. 2006;27(1):65–75.CrossRefPubMed
28.
go back to reference Kwon HJ, Park JH, Park JJ, Lee JH, Seong IW. Improvement of left ventricular ejection fraction and pulmonary hypertension are significant prognostic factors in heart failure with reduced ejection fraction patients. J Cardiovasc Imaging. 2019;27(4):257–65.CrossRefPubMedPubMedCentral Kwon HJ, Park JH, Park JJ, Lee JH, Seong IW. Improvement of left ventricular ejection fraction and pulmonary hypertension are significant prognostic factors in heart failure with reduced ejection fraction patients. J Cardiovasc Imaging. 2019;27(4):257–65.CrossRefPubMedPubMedCentral
29.
go back to reference Núñez J, Bayés-Genís A, Zannad F, Rossignol P, Núñez E, Bodí V, Miñana G, Santas E, Chorro FJ, Mollar A, Carratalá A, Navarro J, Górriz JL, LupLupón J, Husser O, Metra M, Sanchis J. Long-term potassium monitoring and dynamics inheart failure and risk of mortality. Circulation. 2018;137(13):1320–30.CrossRefPubMed Núñez J, Bayés-Genís A, Zannad F, Rossignol P, Núñez E, Bodí V, Miñana G, Santas E, Chorro FJ, Mollar A, Carratalá A, Navarro J, Górriz JL, LupLupón J, Husser O, Metra M, Sanchis J. Long-term potassium monitoring and dynamics inheart failure and risk of mortality. Circulation. 2018;137(13):1320–30.CrossRefPubMed
30.
go back to reference Madan VD, Novak E, Rich MW. Impact of change in serum sodium concentration on mortality in patients hospitalized with heart failure and hyponatremia. Circ Heart Fail. 2011;4(5):637–43.CrossRefPubMed Madan VD, Novak E, Rich MW. Impact of change in serum sodium concentration on mortality in patients hospitalized with heart failure and hyponatremia. Circ Heart Fail. 2011;4(5):637–43.CrossRefPubMed
31.
go back to reference Zhao Juan Juan, Qiang Yan. Machine Learning in Python [M]. Mechanical Industry Press, 2019. 51–145 Zhao Juan Juan, Qiang Yan. Machine Learning in Python [M]. Mechanical Industry Press, 2019. 51–145
32.
go back to reference Mpanya D, Celik T, Klug E, Ntsinjana H. Machine learning and statistical methods for predicting mortality in heart failure. Heart Fail Rev. 2021;26(3):545–52.CrossRefPubMed Mpanya D, Celik T, Klug E, Ntsinjana H. Machine learning and statistical methods for predicting mortality in heart failure. Heart Fail Rev. 2021;26(3):545–52.CrossRefPubMed
33.
go back to reference Lundberg S, Lee SI. A unified approach to interpreting model predictions. Adv Neural Information Processing Syst. 2017;30:4765–74. Lundberg S, Lee SI. A unified approach to interpreting model predictions. Adv Neural Information Processing Syst. 2017;30:4765–74.
34.
go back to reference Yu Mei, Yu Jian, Wang Jianrong, etc. Data Analysis and Data Mining. Tsinghua University Press, 2018.114–189 Yu Mei, Yu Jian, Wang Jianrong, etc. Data Analysis and Data Mining. Tsinghua University Press, 2018.114–189
35.
36.
go back to reference Shiyou L. Introduction to Artificial Intelligence. Tsinghua University Press. 2020;570:205–12. Shiyou L. Introduction to Artificial Intelligence. Tsinghua University Press. 2020;570:205–12.
37.
go back to reference Liu L. Research and application of recommendation technology based on logistic regression. Univ Elect Sci Technol. 2013;18:30. Liu L. Research and application of recommendation technology based on logistic regression. Univ Elect Sci Technol. 2013;18:30.
38.
go back to reference Dong X. Research on logistic regression algorithm and its GPU parallel implementation. Harbin Institute Technol. 2016;12:11. Dong X. Research on logistic regression algorithm and its GPU parallel implementation. Harbin Institute Technol. 2016;12:11.
39.
go back to reference Zhanshan Li, Zhaogeng Li. Feature selection algorithm based on XGBoost. Journal of Communications. 2019;40(10):102. Zhanshan Li, Zhaogeng Li. Feature selection algorithm based on XGBoost. Journal of Communications. 2019;40(10):102.
40.
go back to reference Hastie T, Tibshirani R, Friedman J. The elements of statistical learning. Available from: https://statweb stanford.edu/~tibs/ElemStatLearn/. Hastie T, Tibshirani R, Friedman J. The elements of statistical learning. Available from: https://​statweb stanford.edu/~tibs/ElemStatLearn/.
41.
go back to reference Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, et al. From local explanations to global understanding with explainable AI for trees. Nat Mach Intell. 2020;2:56–67.CrossRefPubMedPubMedCentral Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, et al. From local explanations to global understanding with explainable AI for trees. Nat Mach Intell. 2020;2:56–67.CrossRefPubMedPubMedCentral
42.
go back to reference S.M. Lundberg, G.G. Erion, S-IJapa Lee, Consistent Individualized Feature Attribution for Tree Ensembles, 2018. S.M. Lundberg, G.G. Erion, S-IJapa Lee, Consistent Individualized Feature Attribution for Tree Ensembles, 2018.
43.
go back to reference Yang H, Tian J, Meng B, Wang K, Zheng C, Liu Y, Yan J, Han Q, Zhang Y. Application of extreme learning machine in the survival analysis of chronic heart failure patients with high percentage of censored survival time. Front Cardiovasc Med. 2021;29(8):726516.CrossRef Yang H, Tian J, Meng B, Wang K, Zheng C, Liu Y, Yan J, Han Q, Zhang Y. Application of extreme learning machine in the survival analysis of chronic heart failure patients with high percentage of censored survival time. Front Cardiovasc Med. 2021;29(8):726516.CrossRef
44.
go back to reference .M. Athanasiou, K. Sfrintzeri, K. Zarkogianni, et al., An Explainable XGBoost–Based Approach towards Assessing the Risk of Cardiovascular Disease in Patients with Type 2 Diabetes Mellitus[C]//2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE), IEEE, 2020. .M. Athanasiou, K. Sfrintzeri, K. Zarkogianni, et al., An Explainable XGBoost–Based Approach towards Assessing the Risk of Cardiovascular Disease in Patients with Type 2 Diabetes Mellitus[C]//2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE), IEEE, 2020.
45.
go back to reference Mathur P, Srivastava S, Xu X, Mehta JL. Artificial intelligence, machine learning, cardiovascular disease. Clin Med Insights Cardiol. 2020;14:1179546820927404.CrossRefPubMedPubMedCentral Mathur P, Srivastava S, Xu X, Mehta JL. Artificial intelligence, machine learning, cardiovascular disease. Clin Med Insights Cardiol. 2020;14:1179546820927404.CrossRefPubMedPubMedCentral
46.
go back to reference Wang Y, Zhu K, Li Y, Lv Q, Fu G, Zhang W. A machine learningbased approach for the prediction of periprocedural myocardial infarction by using routine data. Cardiovasc Diagn Ther. 2020;10:1313–24.CrossRefPubMedPubMedCentral Wang Y, Zhu K, Li Y, Lv Q, Fu G, Zhang W. A machine learningbased approach for the prediction of periprocedural myocardial infarction by using routine data. Cardiovasc Diagn Ther. 2020;10:1313–24.CrossRefPubMedPubMedCentral
47.
go back to reference Melchio R, Rinaldi G, Testa E, Giraudo A, Serraino C, Bracco C, Spadafora L, Falcetta A, Leccardi S, Silvestri A, Fenoglio L. Red cell distribution widthpredicts mid-term prognosis in patients hospitalized with acute heart failure:the RDW in Acute Heart Failure (RE-AHF) study. Intern Emerg Med. 2019;14(2):239–47.CrossRefPubMed Melchio R, Rinaldi G, Testa E, Giraudo A, Serraino C, Bracco C, Spadafora L, Falcetta A, Leccardi S, Silvestri A, Fenoglio L. Red cell distribution widthpredicts mid-term prognosis in patients hospitalized with acute heart failure:the RDW in Acute Heart Failure (RE-AHF) study. Intern Emerg Med. 2019;14(2):239–47.CrossRefPubMed
48.
go back to reference Strassheim D, Dempsey EC, Gerasimovskaya E, Stenmark K, Karoor V. Role of inflammatory cell subtypes in heart failure. J Immunol Res. 2019;2(2019):2164017. Strassheim D, Dempsey EC, Gerasimovskaya E, Stenmark K, Karoor V. Role of inflammatory cell subtypes in heart failure. J Immunol Res. 2019;2(2019):2164017.
Metadata
Title
Interpretable prediction of 3-year all-cause mortality in patients with chronic heart failure based on machine learning
Authors
Chenggong Xu
Hongxia Li
Jianping Yang
Yunzhu Peng
Hongyan Cai
Jing Zhou
Wenyi Gu
Lixing Chen
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02371-5

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue