Skip to main content
Top
Published in: BMC Nephrology 1/2023

Open Access 01-12-2023 | Hyperkalemia | Research

Predicting hyperkalemia in patients with advanced chronic kidney disease using the XGBoost model

Authors: Hsin-Hsiung Chang, Jung-Hsien Chiang, Chun-Chieh Tsai, Ping-Fang Chiu

Published in: BMC Nephrology | Issue 1/2023

Login to get access

Abstract

Background

Hyperkalemia is a common complication of chronic kidney disease (CKD). Hyperkalemia is associated with mortality, CKD progression, hospitalization, and high healthcare costs in patients with CKD. We developed a machine learning model to predict hyperkalemia in patients with advanced CKD at an outpatient clinic.

Methods

This retrospective study included 1,965 advanced CKD patients between January 1, 2010, and December 31, 2020 in Taiwan. We randomly divided all patients into the training (75%) and testing (25%) datasets. The primary outcome was to predict hyperkalemia (K+ > 5.5 mEq/L) in the next clinic vist. Two nephrologists were enrolled in a human-machine competition. The area under the receiver operating characteristic curves (AUCs), sensitivity, specificity, and accuracy were used to evaluate the performance of XGBoost and conventional logistic regression models with that of these physicians.

Results

In a human-machine competition of hyperkalemia prediction, the AUC, PPV, and accuracy of the XGBoost model were 0.867 (95% confidence interval: 0.840–0.894), 0.700, and 0.933, which was significantly better than that of our clinicians. There were four variables that were chosen as high-ranking variables in XGBoost and logistic regression models, including hemoglobin, the serum potassium level in the previous visit, angiotensin receptor blocker use, and calcium polystyrene sulfonate use.

Conclusions

The XGBoost model provided better predictive performance for hyperkalemia than physicians at the outpatient clinic.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mu F, Betts KA, Woolley JM, Dua A, Wang Y, Zhong J, Wu EQ. Prevalence and economic burden of hyperkalemia in the United States Medicare population. Curr Med Res Opin. 2020;36(8):1333–41.CrossRefPubMed Mu F, Betts KA, Woolley JM, Dua A, Wang Y, Zhong J, Wu EQ. Prevalence and economic burden of hyperkalemia in the United States Medicare population. Curr Med Res Opin. 2020;36(8):1333–41.CrossRefPubMed
2.
go back to reference Borrelli S, De Nicola L, Minutolo R, Conte G, Chiodini P, Cupisti A, Santoro D, Calabrese V, Giannese D, Garofalo C. Current management of hyperkalemia in non-dialysis CKD: longitudinal study of patients receiving stable nephrology care. Nutrients. 2021;13(3):942.CrossRefPubMedPubMedCentral Borrelli S, De Nicola L, Minutolo R, Conte G, Chiodini P, Cupisti A, Santoro D, Calabrese V, Giannese D, Garofalo C. Current management of hyperkalemia in non-dialysis CKD: longitudinal study of patients receiving stable nephrology care. Nutrients. 2021;13(3):942.CrossRefPubMedPubMedCentral
3.
go back to reference Palmer BF, Carrero JJ, Clegg DJ, Colbert GB, Emmett M, Fishbane S, Hain DJ, Lerma E, Onuigbo M, Rastogi A. Clinical management of hyperkalemia. In: Mayo Clinic Proceedings: 2021: Elsevier; 2021: 744–762. Palmer BF, Carrero JJ, Clegg DJ, Colbert GB, Emmett M, Fishbane S, Hain DJ, Lerma E, Onuigbo M, Rastogi A. Clinical management of hyperkalemia. In: Mayo Clinic Proceedings: 2021: Elsevier; 2021: 744–762.
4.
go back to reference Sarafidis PA, Blacklock R, Wood E, Rumjon A, Simmonds S, Fletcher-Rogers J, Ariyanayagam R, Al-Yassin A, Sharpe C, Vinen K. Prevalence and factors associated with hyperkalemia in predialysis patients followed in a low-clearance clinic. Clin J Am Soc Nephrol. 2012;7(8):1234–41.CrossRefPubMedPubMedCentral Sarafidis PA, Blacklock R, Wood E, Rumjon A, Simmonds S, Fletcher-Rogers J, Ariyanayagam R, Al-Yassin A, Sharpe C, Vinen K. Prevalence and factors associated with hyperkalemia in predialysis patients followed in a low-clearance clinic. Clin J Am Soc Nephrol. 2012;7(8):1234–41.CrossRefPubMedPubMedCentral
5.
go back to reference Clase CM, Carrero J-J, Ellison DH, Grams ME, Hemmelgarn BR, Jardine MJ, Kovesdy CP, Kline GA, Lindner G, Obrador GT. Potassium homeostasis and management of dyskalemia in kidney diseases: conclusions from a kidney disease: improving global outcomes (KDIGO) Controversies Conference. Kidney Int. 2020;97(1):42–61.CrossRefPubMed Clase CM, Carrero J-J, Ellison DH, Grams ME, Hemmelgarn BR, Jardine MJ, Kovesdy CP, Kline GA, Lindner G, Obrador GT. Potassium homeostasis and management of dyskalemia in kidney diseases: conclusions from a kidney disease: improving global outcomes (KDIGO) Controversies Conference. Kidney Int. 2020;97(1):42–61.CrossRefPubMed
6.
go back to reference Sharma A, Alvarez PJ, Woods SD, Dai D. A model to Predict Risk of Hyperkalemia in patients with chronic kidney Disease using a large administrative claims database. ClinicoEconomics and Outcomes Research: CEOR. 2020;12:657.CrossRefPubMed Sharma A, Alvarez PJ, Woods SD, Dai D. A model to Predict Risk of Hyperkalemia in patients with chronic kidney Disease using a large administrative claims database. ClinicoEconomics and Outcomes Research: CEOR. 2020;12:657.CrossRefPubMed
7.
go back to reference Lin CS, Lin C, Fang WH, Hsu CJ, Chen SJ, Huang KH, Lin WS, Tsai CS, Kuo CC, Chau T, et al. A deep-learning algorithm (ECG12Net) for detecting hypokalemia and hyperkalemia by Electrocardiography: Algorithm Development. JMIR Med Inform. 2020;8(3):e15931.CrossRefPubMedPubMedCentral Lin CS, Lin C, Fang WH, Hsu CJ, Chen SJ, Huang KH, Lin WS, Tsai CS, Kuo CC, Chau T, et al. A deep-learning algorithm (ECG12Net) for detecting hypokalemia and hyperkalemia by Electrocardiography: Algorithm Development. JMIR Med Inform. 2020;8(3):e15931.CrossRefPubMedPubMedCentral
8.
go back to reference Galloway CD, Valys AV, Shreibati JB, Treiman DL, Petterson FL, Gundotra VP, Albert DE, Attia ZI, Carter RE, Asirvatham SJ. Development and validation of a deep-learning model to screen for hyperkalemia from the electrocardiogram. JAMA Cardiol. 2019;4(5):428–36.CrossRefPubMedPubMedCentral Galloway CD, Valys AV, Shreibati JB, Treiman DL, Petterson FL, Gundotra VP, Albert DE, Attia ZI, Carter RE, Asirvatham SJ. Development and validation of a deep-learning model to screen for hyperkalemia from the electrocardiogram. JAMA Cardiol. 2019;4(5):428–36.CrossRefPubMedPubMedCentral
9.
go back to reference Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining: 2016; 2016: 785–794. Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining: 2016; 2016: 785–794.
10.
go back to reference Deng YH, Luo XQ, Yan P, Zhang NY, Liu Y, Duan SB. Outcome prediction for acute kidney injury among hospitalized children via eXtreme Gradient boosting algorithm. Sci Rep. 2022;12(1):1–11. Deng YH, Luo XQ, Yan P, Zhang NY, Liu Y, Duan SB. Outcome prediction for acute kidney injury among hospitalized children via eXtreme Gradient boosting algorithm. Sci Rep. 2022;12(1):1–11.
11.
go back to reference Chen T, Li X, Li Y, Xia E, Qin Y, Liang S, Xu F, Liang D, Zeng C, Liu Z. Prediction and risk stratification of kidney outcomes in IgA nephropathy. Am J Kidney Dis. 2019;74(3):300–9.CrossRefPubMed Chen T, Li X, Li Y, Xia E, Qin Y, Liang S, Xu F, Liang D, Zeng C, Liu Z. Prediction and risk stratification of kidney outcomes in IgA nephropathy. Am J Kidney Dis. 2019;74(3):300–9.CrossRefPubMed
12.
go back to reference Chang W, Liu Y, Xiao Y, Yuan X, Xu X, Zhang S, Zhou S. A machine-learning-based prediction method for hypertension outcomes based on medical data. Diagnostics. 2019;9(4):178.CrossRefPubMedPubMedCentral Chang W, Liu Y, Xiao Y, Yuan X, Xu X, Zhang S, Zhou S. A machine-learning-based prediction method for hypertension outcomes based on medical data. Diagnostics. 2019;9(4):178.CrossRefPubMedPubMedCentral
13.
go back to reference Hsieh HM, Lin MY, Chiu YW, Wu PH, Cheng LJ, Jian FS, Hsu CC, Hwang SJ. Economic evaluation of a pre-ESRD pay-for-performance programme in advanced chronic kidney disease patients. Nephrol Dial Transplant. 2017;32(7):1184–94.PubMed Hsieh HM, Lin MY, Chiu YW, Wu PH, Cheng LJ, Jian FS, Hsu CC, Hwang SJ. Economic evaluation of a pre-ESRD pay-for-performance programme in advanced chronic kidney disease patients. Nephrol Dial Transplant. 2017;32(7):1184–94.PubMed
14.
go back to reference Einhorn LM, Zhan M, Walker LD, Moen MF, Seliger SL, Weir MR, Fink JC. The frequency of hyperkalemia and its significance in chronic kidney disease. Arch Intern Med. 2009;169(12):1156–62.CrossRefPubMedPubMedCentral Einhorn LM, Zhan M, Walker LD, Moen MF, Seliger SL, Weir MR, Fink JC. The frequency of hyperkalemia and its significance in chronic kidney disease. Arch Intern Med. 2009;169(12):1156–62.CrossRefPubMedPubMedCentral
15.
go back to reference Kashihara N, Kohsaka S, Kanda E, Okami S, Yajima T. Hyperkalemia in real-world patients under continuous Medical Care in Japan. Kidney Int Rep. 2019;4(9):1248–60.CrossRefPubMedPubMedCentral Kashihara N, Kohsaka S, Kanda E, Okami S, Yajima T. Hyperkalemia in real-world patients under continuous Medical Care in Japan. Kidney Int Rep. 2019;4(9):1248–60.CrossRefPubMedPubMedCentral
17.
go back to reference Cha G-W, Moon H-J, Kim Y-C. Comparison of Random Forest and Gradient Boosting Machine Models for Predicting demolition Waste based on small datasets and categorical variables. Int J Environ Res Public Health. 2021;18(16):8530.CrossRefPubMedPubMedCentral Cha G-W, Moon H-J, Kim Y-C. Comparison of Random Forest and Gradient Boosting Machine Models for Predicting demolition Waste based on small datasets and categorical variables. Int J Environ Res Public Health. 2021;18(16):8530.CrossRefPubMedPubMedCentral
19.
go back to reference Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. 2016;34(21):2534.CrossRefPubMedPubMedCentral Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. 2016;34(21):2534.CrossRefPubMedPubMedCentral
20.
go back to reference Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30.
21.
go back to reference HWANG SJ, TSAI JC. Epidemiology, impact and preventive care of chronic kidney disease in Taiwan. Nephrology. 2010;15:3–9.CrossRefPubMed HWANG SJ, TSAI JC. Epidemiology, impact and preventive care of chronic kidney disease in Taiwan. Nephrology. 2010;15:3–9.CrossRefPubMed
22.
go back to reference Wang JS, Yen FS, Lin KD, Shin SJ, Hsu YH, Hsu CC. China DKDRCotDAotRo: epidemiological characteristics of diabetic kidney disease in Taiwan. J Diabetes Invest. 2021;12(12):2112–23.CrossRef Wang JS, Yen FS, Lin KD, Shin SJ, Hsu YH, Hsu CC. China DKDRCotDAotRo: epidemiological characteristics of diabetic kidney disease in Taiwan. J Diabetes Invest. 2021;12(12):2112–23.CrossRef
24.
go back to reference Luo J, Brunelli SM, Jensen DE, Yang A. Association between serum potassium and outcomes in patients with reduced kidney function. Clin J Am Soc Nephrol. 2016;11(1):90–100.CrossRefPubMed Luo J, Brunelli SM, Jensen DE, Yang A. Association between serum potassium and outcomes in patients with reduced kidney function. Clin J Am Soc Nephrol. 2016;11(1):90–100.CrossRefPubMed
26.
go back to reference James C, Ranson JM, Everson R, Llewellyn DJ. Performance of machine learning algorithms for predicting progression to dementia in memory clinic patients. JAMA Netw open. 2021;4(12):e2136553–3.CrossRefPubMedPubMedCentral James C, Ranson JM, Everson R, Llewellyn DJ. Performance of machine learning algorithms for predicting progression to dementia in memory clinic patients. JAMA Netw open. 2021;4(12):e2136553–3.CrossRefPubMedPubMedCentral
27.
go back to reference Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, Bradwell KR, Bremer C, Byrd JB, Denham A. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative. JAMA Netw open. 2021;4(7):e2116901–1.CrossRefPubMedPubMedCentral Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, Bradwell KR, Bremer C, Byrd JB, Denham A. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative. JAMA Netw open. 2021;4(7):e2116901–1.CrossRefPubMedPubMedCentral
28.
go back to reference Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12–22.CrossRefPubMed Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12–22.CrossRefPubMed
29.
30.
go back to reference London AJ. Artificial intelligence and black-box medical decisions: accuracy versus explainability. Hastings Cent Rep. 2019;49(1):15–21.CrossRefPubMed London AJ. Artificial intelligence and black-box medical decisions: accuracy versus explainability. Hastings Cent Rep. 2019;49(1):15–21.CrossRefPubMed
31.
go back to reference Weir MR, Rolfe M. Potassium homeostasis and renin-angiotensin-aldosterone system inhibitors. Clin J Am Soc Nephrol. 2010;5(3):531–48.CrossRefPubMed Weir MR, Rolfe M. Potassium homeostasis and renin-angiotensin-aldosterone system inhibitors. Clin J Am Soc Nephrol. 2010;5(3):531–48.CrossRefPubMed
32.
go back to reference Raebel MA. Hyperkalemia associated with use of angiotensin-converting enzyme inhibitors and angiotensin receptor blockers. Cardiovasc Ther. 2012;30(3):e156–66.CrossRefPubMed Raebel MA. Hyperkalemia associated with use of angiotensin-converting enzyme inhibitors and angiotensin receptor blockers. Cardiovasc Ther. 2012;30(3):e156–66.CrossRefPubMed
33.
go back to reference Mansoor F, Bai P, Kaur N, Sultan S, Sharma S, Dilip A, Kammawal Y, Shahid S, Rizwan A. Evaluation of serum electrolyte levels in patients with Anemia. Cureus 2021, 13(10). Mansoor F, Bai P, Kaur N, Sultan S, Sharma S, Dilip A, Kammawal Y, Shahid S, Rizwan A. Evaluation of serum electrolyte levels in patients with Anemia. Cureus 2021, 13(10).
34.
go back to reference Dewey J, Mastenbrook J, Bauler LD. Differentiating pseudohyperkalemia from true hyperkalemia in a patient with chronic lymphocytic leukemia and diverticulitis. Cureus 2020, 12(8). Dewey J, Mastenbrook J, Bauler LD. Differentiating pseudohyperkalemia from true hyperkalemia in a patient with chronic lymphocytic leukemia and diverticulitis. Cureus 2020, 12(8).
Metadata
Title
Predicting hyperkalemia in patients with advanced chronic kidney disease using the XGBoost model
Authors
Hsin-Hsiung Chang
Jung-Hsien Chiang
Chun-Chieh Tsai
Ping-Fang Chiu
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Nephrology / Issue 1/2023
Electronic ISSN: 1471-2369
DOI
https://doi.org/10.1186/s12882-023-03227-w

Other articles of this Issue 1/2023

BMC Nephrology 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.