Skip to main content
Top
Published in: BMC Cardiovascular Disorders 1/2023

Open Access 01-12-2023 | Heart Failure | Research

Development and validation of a prediction model for in-hospital death in patients with heart failure and atrial fibrillation

Authors: Meiyu Yan, Huizhu Liu, Qunfeng Xu, Shushu Yu, Ke Tang, Yun Xie

Published in: BMC Cardiovascular Disorders | Issue 1/2023

Login to get access

Abstract

Background

To develop a prediction model for in-hospital mortality of patients with heart failure (HF) and atrial fibrillation (AF).

Methods

This cohort study extracted the data of 10,236 patients with HF and AF upon intensive care unit (ICU) from the Medical Information Mart for Intensive Care (MIMIC). The subjects from MIMIC-IV were divided into the training set to construct the prediction model, and the testing set to verify the performance of the model. The samples from MIMIC-III database and eICU-CRD were included as the internal and external validation set to further validate the predictive value of the model, respectively. Univariate and multivariable Logistic regression analyses were used to explore predictors for in-hospital death in patients with HF and AF. The receiver operator characteristic (ROC), calibration curves and the decision curve analysis (DCA) curves were plotted to evaluate the predictive values of the model.

Results

The mean survival time of participants from MIMIC-III was 11.29 ± 10.05 days and the mean survival time of participants from MIMIC-IV was 10.56 ± 9.19 days. Simplified acute physiology score (SAPSII), red blood cell distribution width (RDW), beta-blocker, race, respiratory rate, urine output, coronary artery bypass grafting (CABG), Charlson comorbidity index, renal replacement therapies (RRT), antiarrhythmic, age, and anticoagulation were predictors finally included in the prediction model. The AUC of our prediction model was 0.810 (95%CI: 0.791–0.828) in the training set, 0.757 (95%CI: 0.729–0.786) in the testing set, 0.792 (95%CI: 0.774–0.810) in the internal validation set, and 0.724 (95%CI: 0.687–0.762) in the external validation set. The calibration curves of revealed that the predictive probabilities of our model for the in-hospital death in patients with HF and AF deviated slightly from the ideal model. The DCA curves revealed that the use of our prediction model increased the net benefit than use no model.

Conclusion

The prediction model had good discriminative ability, and might provide a tool to timely identify patients with HF complicated with AF who were at high risk of in-hospital mortality.
Appendix
Available only for authorised users
Literature
1.
go back to reference Parkash R, Wells GA, Rouleau J, Talajic M, Essebag V, Skanes A, et al. Randomized Ablation-Based Rhythm-Control Versus Rate-Control Trial in Patients With Heart Failure and Atrial Fibrillation: Results from the RAFT-AF trial. Circulation. 2022;145:1693–704.CrossRefPubMed Parkash R, Wells GA, Rouleau J, Talajic M, Essebag V, Skanes A, et al. Randomized Ablation-Based Rhythm-Control Versus Rate-Control Trial in Patients With Heart Failure and Atrial Fibrillation: Results from the RAFT-AF trial. Circulation. 2022;145:1693–704.CrossRefPubMed
2.
go back to reference Tsigkas G, Apostolos A, Despotopoulos S, Vasilagkos G, Kallergis E, Leventopoulos G, et al. Heart failure and atrial fibrillation: new concepts in pathophysiology, management, and future directions. Heart Fail Rev. 2022;27:1201–10.CrossRefPubMed Tsigkas G, Apostolos A, Despotopoulos S, Vasilagkos G, Kallergis E, Leventopoulos G, et al. Heart failure and atrial fibrillation: new concepts in pathophysiology, management, and future directions. Heart Fail Rev. 2022;27:1201–10.CrossRefPubMed
3.
go back to reference Mesubi OO, Anderson ME. Heart Failure and Atrial Fibrillation-Chicken or Egg? Circ Res. 2022;130:1011–3.CrossRefPubMed Mesubi OO, Anderson ME. Heart Failure and Atrial Fibrillation-Chicken or Egg? Circ Res. 2022;130:1011–3.CrossRefPubMed
4.
go back to reference Santhanakrishnan R, Wang N, Larson MG, Magnani JW, McManus DD, Lubitz SA, et al. Atrial fibrillation begets heart failure and vice versa: temporal associations and differences in preserved versus reduced ejection fraction. Circulation. 2016;133:484–92.CrossRefPubMedPubMedCentral Santhanakrishnan R, Wang N, Larson MG, Magnani JW, McManus DD, Lubitz SA, et al. Atrial fibrillation begets heart failure and vice versa: temporal associations and differences in preserved versus reduced ejection fraction. Circulation. 2016;133:484–92.CrossRefPubMedPubMedCentral
5.
go back to reference Mamas MA, Caldwell JC, Chacko S, Garratt CJ, Fath-Ordoubadi F, Neyses L. A meta-analysis of the prognostic significance of atrial fibrillation in chronic heart failure. Eur J Heart Fail. 2009;11:676–83.CrossRefPubMed Mamas MA, Caldwell JC, Chacko S, Garratt CJ, Fath-Ordoubadi F, Neyses L. A meta-analysis of the prognostic significance of atrial fibrillation in chronic heart failure. Eur J Heart Fail. 2009;11:676–83.CrossRefPubMed
6.
go back to reference Şaylık F, Çınar T, Akbulut T, Hayıroğlu M. Comparison of catheter ablation and medical therapy for atrial fibrillation in heart failure patients: A meta-analysis of randomized controlled trials. Heart Lung. 2023;57:69–74.CrossRefPubMed Şaylık F, Çınar T, Akbulut T, Hayıroğlu M. Comparison of catheter ablation and medical therapy for atrial fibrillation in heart failure patients: A meta-analysis of randomized controlled trials. Heart Lung. 2023;57:69–74.CrossRefPubMed
7.
go back to reference Perreault S, Schnitzer ME, Disso E, Qazi J, Boivin-Proulx LA, Dorais M. Polypharmacy and risk of mortality among patients with heart failure following hospitalization: a nested case-control study. Sci Rep. 2022;12(1):19963.CrossRefPubMedPubMedCentral Perreault S, Schnitzer ME, Disso E, Qazi J, Boivin-Proulx LA, Dorais M. Polypharmacy and risk of mortality among patients with heart failure following hospitalization: a nested case-control study. Sci Rep. 2022;12(1):19963.CrossRefPubMedPubMedCentral
8.
go back to reference Wang J, Chen Z, Yang H, Li H, Chen R, Yu J. Relationship between the Hemoglobin-to-Red Cell Distribution Width Ratio and All-Cause Mortality in Septic Patients with Atrial Fibrillation: Based on Propensity Score Matching Method. J Cardiovasc Dev Dis. 2022;9(11):400. Wang J, Chen Z, Yang H, Li H, Chen R, Yu J. Relationship between the Hemoglobin-to-Red Cell Distribution Width Ratio and All-Cause Mortality in Septic Patients with Atrial Fibrillation: Based on Propensity Score Matching Method. J Cardiovasc Dev Dis. 2022;9(11):400.
9.
go back to reference Ma K, Yang J, Shao Y, Li P, Guo H, Wu J, et al. Therapeutic and prognostic significance of arachidonic acid in heart failure. Circ Res. 2022;130:1056–71.CrossRefPubMed Ma K, Yang J, Shao Y, Li P, Guo H, Wu J, et al. Therapeutic and prognostic significance of arachidonic acid in heart failure. Circ Res. 2022;130:1056–71.CrossRefPubMed
10.
go back to reference Codina P, Zamora E, Levy WC, Revuelta-López E, Borrellas A, Spitaleri G, et al. Mortality risk prediction dynamics after heart failure treatment optimization: Repeat risk assessment using online risk calculators. Front Cardiovasc Med. 2022;9: 836451.CrossRefPubMedPubMedCentral Codina P, Zamora E, Levy WC, Revuelta-López E, Borrellas A, Spitaleri G, et al. Mortality risk prediction dynamics after heart failure treatment optimization: Repeat risk assessment using online risk calculators. Front Cardiovasc Med. 2022;9: 836451.CrossRefPubMedPubMedCentral
11.
go back to reference Negassa A, Ahmed S, Zolty R, Patel SR. Prediction model using machine learning for mortality in patients with heart failure. Am J Cardiol. 2021;153:86–93.CrossRefPubMed Negassa A, Ahmed S, Zolty R, Patel SR. Prediction model using machine learning for mortality in patients with heart failure. Am J Cardiol. 2021;153:86–93.CrossRefPubMed
12.
go back to reference Peterson PN, Rumsfeld JS, Liang L, Albert NM, Hernandez AF, Peterson ED, et al. A validated risk score for in-hospital mortality in patients with heart failure from the American Heart Association get with the guidelines program. Circ Cardiovasc Qual Outcomes. 2010;3:25–32.CrossRefPubMed Peterson PN, Rumsfeld JS, Liang L, Albert NM, Hernandez AF, Peterson ED, et al. A validated risk score for in-hospital mortality in patients with heart failure from the American Heart Association get with the guidelines program. Circ Cardiovasc Qual Outcomes. 2010;3:25–32.CrossRefPubMed
13.
go back to reference Ouwerkerk W, Voors AA, Zwinderman AH. Factors influencing the predictive power of models for predicting mortality and/or heart failure hospitalization in patients with heart failure. JACC Heart failure. 2014;2:429–36.CrossRefPubMed Ouwerkerk W, Voors AA, Zwinderman AH. Factors influencing the predictive power of models for predicting mortality and/or heart failure hospitalization in patients with heart failure. JACC Heart failure. 2014;2:429–36.CrossRefPubMed
14.
go back to reference Voors AA, Ouwerkerk W, Zannad F, van Veldhuisen DJ, Samani NJ, Ponikowski P, et al. Development and validation of multivariable models to predict mortality and hospitalization in patients with heart failure. Eur J Heart Fail. 2017;19:627–34.CrossRefPubMed Voors AA, Ouwerkerk W, Zannad F, van Veldhuisen DJ, Samani NJ, Ponikowski P, et al. Development and validation of multivariable models to predict mortality and hospitalization in patients with heart failure. Eur J Heart Fail. 2017;19:627–34.CrossRefPubMed
15.
go back to reference Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Scientific data. 2016;3: 160035.CrossRefPubMedPubMedCentral Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Scientific data. 2016;3: 160035.CrossRefPubMedPubMedCentral
16.
go back to reference Xu J, Cai H, Zheng X. Timing of vasopressin initiation and mortality in patients with septic shock: analysis of the MIMIC-III and MIMIC-IV databases. BMC Infect Dis. 2023;23:199.CrossRefPubMedPubMedCentral Xu J, Cai H, Zheng X. Timing of vasopressin initiation and mortality in patients with septic shock: analysis of the MIMIC-III and MIMIC-IV databases. BMC Infect Dis. 2023;23:199.CrossRefPubMedPubMedCentral
17.
go back to reference Peng S, Huang J, Liu X, Deng J, Sun C, Tang J, et al. Interpretable machine learning for 28-day all-cause in-hospital mortality prediction in critically ill patients with heart failure combined with hypertension: A retrospective cohort study based on medical information mart for intensive care database-IV and eICU databases. Frontiers in cardiovascular medicine. 2022;9: 994359.CrossRefPubMedPubMedCentral Peng S, Huang J, Liu X, Deng J, Sun C, Tang J, et al. Interpretable machine learning for 28-day all-cause in-hospital mortality prediction in critically ill patients with heart failure combined with hypertension: A retrospective cohort study based on medical information mart for intensive care database-IV and eICU databases. Frontiers in cardiovascular medicine. 2022;9: 994359.CrossRefPubMedPubMedCentral
18.
go back to reference Wang H, Zhao QY, Luo JC, Liu K, Yu SJ, Ma JF, et al. Early prediction of noninvasive ventilation failure after extubation: development and validation of a machine-learning model. BMC Pulm Med. 2022;22(1):304.CrossRefPubMedPubMedCentral Wang H, Zhao QY, Luo JC, Liu K, Yu SJ, Ma JF, et al. Early prediction of noninvasive ventilation failure after extubation: development and validation of a machine-learning model. BMC Pulm Med. 2022;22(1):304.CrossRefPubMedPubMedCentral
19.
go back to reference Li F, Xin H, Zhang J, Fu M, Zhou J, Lian Z. Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database. BMJ Open. 2021;11: e044779.CrossRefPubMedPubMedCentral Li F, Xin H, Zhang J, Fu M, Zhou J, Lian Z. Prediction model of in-hospital mortality in intensive care unit patients with heart failure: machine learning-based, retrospective analysis of the MIMIC-III database. BMJ Open. 2021;11: e044779.CrossRefPubMedPubMedCentral
20.
go back to reference Bowen GS, Diop MS, Jiang L, Wu WC, Rudolph JL. A multivariable prediction model for mortality in individuals admitted for heart failure. J Am Geriatr Soc. 2018;66:902–8.CrossRefPubMed Bowen GS, Diop MS, Jiang L, Wu WC, Rudolph JL. A multivariable prediction model for mortality in individuals admitted for heart failure. J Am Geriatr Soc. 2018;66:902–8.CrossRefPubMed
21.
go back to reference Han S, Wang C, Tong F, Li Y, Li Z, Sun Z, et al. Value of the Neutrophils/Prealbumin Ratio and Its Combination With the GWTG-HF Score in Predicting In-Hospital Mortality in Patients With Heart Failure. Am J Cardiol. 2022;172:62–7.CrossRefPubMed Han S, Wang C, Tong F, Li Y, Li Z, Sun Z, et al. Value of the Neutrophils/Prealbumin Ratio and Its Combination With the GWTG-HF Score in Predicting In-Hospital Mortality in Patients With Heart Failure. Am J Cardiol. 2022;172:62–7.CrossRefPubMed
22.
go back to reference Suzuki S, Yoshihisa A, Sato Y, Kanno Y, Watanabe S, Abe S, et al. Clinical significance of get with the guidelines-heart failure risk score in patients with chronic heart failure after hospitalization. J Am Heart Assoc. 2018;7: e008316.CrossRefPubMedPubMedCentral Suzuki S, Yoshihisa A, Sato Y, Kanno Y, Watanabe S, Abe S, et al. Clinical significance of get with the guidelines-heart failure risk score in patients with chronic heart failure after hospitalization. J Am Heart Assoc. 2018;7: e008316.CrossRefPubMedPubMedCentral
23.
go back to reference Misumi K, Matsue Y, Nogi K, Sunayama T, Dotare T, Maeda D, et al. Usefulness of incorporating hypochloremia into the get with the guidelines-heart failure risk model in patients with acute heart failure. Am J Cardiol. 2022;162:122–8.CrossRefPubMed Misumi K, Matsue Y, Nogi K, Sunayama T, Dotare T, Maeda D, et al. Usefulness of incorporating hypochloremia into the get with the guidelines-heart failure risk model in patients with acute heart failure. Am J Cardiol. 2022;162:122–8.CrossRefPubMed
24.
go back to reference Şaylık F, Çınar T, Selçuk M, Akbulut T, Hayıroğlu Mİ, Tanboğa İH. Evaluation of Naples Score for Long-Term Mortality in Patients With ST-Segment Elevation Myocardial Infarction Undergoing Primary Percutaneous Coronary Intervention. Angiology. 2023:33197231170982. Şaylık F, Çınar T, Selçuk M, Akbulut T, Hayıroğlu Mİ, Tanboğa İH. Evaluation of Naples Score for Long-Term Mortality in Patients With ST-Segment Elevation Myocardial Infarction Undergoing Primary Percutaneous Coronary Intervention. Angiology. 2023:33197231170982.
25.
go back to reference Mert İlker H, Faysal S, Ahmet Çağdaş Y, Murat S, Tufan Ç. Prognostic value of Intermountain Risk Score for short- and long-term mortality in patients with cardiogenic shock. Coron Artery Dis. 2023;34(2):154–9.CrossRefPubMed Mert İlker H, Faysal S, Ahmet Çağdaş Y, Murat S, Tufan Ç. Prognostic value of Intermountain Risk Score for short- and long-term mortality in patients with cardiogenic shock. Coron Artery Dis. 2023;34(2):154–9.CrossRefPubMed
26.
go back to reference Chen J, Li Y, Liu P, Wu H, Su G. A nomogram to predict the in-hospital mortality of patients with congestive heart failure and chronic kidney disease. ESC heart failure. 2022;9:3167–76.CrossRefPubMedPubMedCentral Chen J, Li Y, Liu P, Wu H, Su G. A nomogram to predict the in-hospital mortality of patients with congestive heart failure and chronic kidney disease. ESC heart failure. 2022;9:3167–76.CrossRefPubMedPubMedCentral
27.
go back to reference Wussler D, Michou E, Belkin M, Kozhuharov N, Diebold M, Gualandro DM, et al. Mortality prediction in acute heart failure: scores or biomarkers? Swiss Med Wkly. 2020;150: w20320.CrossRefPubMed Wussler D, Michou E, Belkin M, Kozhuharov N, Diebold M, Gualandro DM, et al. Mortality prediction in acute heart failure: scores or biomarkers? Swiss Med Wkly. 2020;150: w20320.CrossRefPubMed
28.
go back to reference Huang E, Bernard ML, Elise Hiltbold A, Khatib S, Polin GM, Rogers PA, et al. Sacubitril/valsartan: An antiarrhythmic drug? J Cardiovasc Electrophysiol. 2022;33:2375–81.CrossRefPubMed Huang E, Bernard ML, Elise Hiltbold A, Khatib S, Polin GM, Rogers PA, et al. Sacubitril/valsartan: An antiarrhythmic drug? J Cardiovasc Electrophysiol. 2022;33:2375–81.CrossRefPubMed
29.
go back to reference Parkash R, Wells G, Rouleau J, Talajic M, Essebag V, Skanes A, et al. A randomized ablation-based atrial fibrillation rhythm control versus rate control trial in patients with heart failure and high burden atrial fibrillation: The RAFT-AF trial rationale and design. Am Heart J. 2021;234:90–100.CrossRefPubMed Parkash R, Wells G, Rouleau J, Talajic M, Essebag V, Skanes A, et al. A randomized ablation-based atrial fibrillation rhythm control versus rate control trial in patients with heart failure and high burden atrial fibrillation: The RAFT-AF trial rationale and design. Am Heart J. 2021;234:90–100.CrossRefPubMed
30.
go back to reference Reed BN, Sueta CA. A practical guide for the treatment of symptomatic heart failure with reduced ejection fraction (HFrEF). Curr Cardiol Rev. 2015;11:23–32.CrossRefPubMedPubMedCentral Reed BN, Sueta CA. A practical guide for the treatment of symptomatic heart failure with reduced ejection fraction (HFrEF). Curr Cardiol Rev. 2015;11:23–32.CrossRefPubMedPubMedCentral
31.
go back to reference Hasbrouck M, Nguyen TT. Acute management of atrial fibrillation in congestive heart failure with reduced ejection fraction in the emergency department. Am J Emerg Med. 2022;58:39–42.CrossRefPubMed Hasbrouck M, Nguyen TT. Acute management of atrial fibrillation in congestive heart failure with reduced ejection fraction in the emergency department. Am J Emerg Med. 2022;58:39–42.CrossRefPubMed
32.
go back to reference Zhao L, Wang WYS, Yang X. Anticoagulation in atrial fibrillation with heart failure. Heart Fail Rev. 2018;23:563–71.CrossRefPubMed Zhao L, Wang WYS, Yang X. Anticoagulation in atrial fibrillation with heart failure. Heart Fail Rev. 2018;23:563–71.CrossRefPubMed
33.
go back to reference Shuvy M, Zwas DR, Keren A, Gotsman I. The age-adjusted Charlson comorbidity index: A significant predictor of clinical outcome in patients with heart failure. Eur J Intern Med. 2020;73:103–4.CrossRefPubMed Shuvy M, Zwas DR, Keren A, Gotsman I. The age-adjusted Charlson comorbidity index: A significant predictor of clinical outcome in patients with heart failure. Eur J Intern Med. 2020;73:103–4.CrossRefPubMed
34.
go back to reference Gangu K, Bobba A, Chela HK, Avula S, Basida S, Yadav N. In-hospital mortality rate and predictors of 30-day readmission in patients with heart failure exacerbation and atrial fibrillation: a cross-sectional study. Int J heart failure. 2022;4:145–53.CrossRef Gangu K, Bobba A, Chela HK, Avula S, Basida S, Yadav N. In-hospital mortality rate and predictors of 30-day readmission in patients with heart failure exacerbation and atrial fibrillation: a cross-sectional study. Int J heart failure. 2022;4:145–53.CrossRef
35.
go back to reference Hayıroğlu M, Çınar T, Çiçek V, Asal S, Kılıç Ş, Keser N, et al. A simple formula to predict echocardiographic diastolic dysfunction-electrocardiographic diastolic index. Herz. 2021;46(Suppl 2):159–65.CrossRefPubMed Hayıroğlu M, Çınar T, Çiçek V, Asal S, Kılıç Ş, Keser N, et al. A simple formula to predict echocardiographic diastolic dysfunction-electrocardiographic diastolic index. Herz. 2021;46(Suppl 2):159–65.CrossRefPubMed
36.
go back to reference Raghunath A, Nguyen DD, Schram M, Albert D, Gollakota S, Shapiro L, et al. Artificial intelligence-enabled mobile electrocardiograms for event prediction in paroxysmal atrial fibrillation. Cardiovasc Digital Health J. 2023;4(1):21–8.CrossRef Raghunath A, Nguyen DD, Schram M, Albert D, Gollakota S, Shapiro L, et al. Artificial intelligence-enabled mobile electrocardiograms for event prediction in paroxysmal atrial fibrillation. Cardiovasc Digital Health J. 2023;4(1):21–8.CrossRef
Metadata
Title
Development and validation of a prediction model for in-hospital death in patients with heart failure and atrial fibrillation
Authors
Meiyu Yan
Huizhu Liu
Qunfeng Xu
Shushu Yu
Ke Tang
Yun Xie
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Cardiovascular Disorders / Issue 1/2023
Electronic ISSN: 1471-2261
DOI
https://doi.org/10.1186/s12872-023-03521-3

Other articles of this Issue 1/2023

BMC Cardiovascular Disorders 1/2023 Go to the issue