Skip to main content
Top
Published in:

Open Access 01-12-2023 | Hyperkalemia | Research

Predicting hyperkalemia in patients with advanced chronic kidney disease using the XGBoost model

Authors: Hsin-Hsiung Chang, Jung-Hsien Chiang, Chun-Chieh Tsai, Ping-Fang Chiu

Published in: BMC Nephrology | Issue 1/2023

Login to get access

Abstract

Background

Hyperkalemia is a common complication of chronic kidney disease (CKD). Hyperkalemia is associated with mortality, CKD progression, hospitalization, and high healthcare costs in patients with CKD. We developed a machine learning model to predict hyperkalemia in patients with advanced CKD at an outpatient clinic.

Methods

This retrospective study included 1,965 advanced CKD patients between January 1, 2010, and December 31, 2020 in Taiwan. We randomly divided all patients into the training (75%) and testing (25%) datasets. The primary outcome was to predict hyperkalemia (K+ > 5.5 mEq/L) in the next clinic vist. Two nephrologists were enrolled in a human-machine competition. The area under the receiver operating characteristic curves (AUCs), sensitivity, specificity, and accuracy were used to evaluate the performance of XGBoost and conventional logistic regression models with that of these physicians.

Results

In a human-machine competition of hyperkalemia prediction, the AUC, PPV, and accuracy of the XGBoost model were 0.867 (95% confidence interval: 0.840–0.894), 0.700, and 0.933, which was significantly better than that of our clinicians. There were four variables that were chosen as high-ranking variables in XGBoost and logistic regression models, including hemoglobin, the serum potassium level in the previous visit, angiotensin receptor blocker use, and calcium polystyrene sulfonate use.

Conclusions

The XGBoost model provided better predictive performance for hyperkalemia than physicians at the outpatient clinic.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mu F, Betts KA, Woolley JM, Dua A, Wang Y, Zhong J, Wu EQ. Prevalence and economic burden of hyperkalemia in the United States Medicare population. Curr Med Res Opin. 2020;36(8):1333–41.CrossRefPubMed Mu F, Betts KA, Woolley JM, Dua A, Wang Y, Zhong J, Wu EQ. Prevalence and economic burden of hyperkalemia in the United States Medicare population. Curr Med Res Opin. 2020;36(8):1333–41.CrossRefPubMed
2.
go back to reference Borrelli S, De Nicola L, Minutolo R, Conte G, Chiodini P, Cupisti A, Santoro D, Calabrese V, Giannese D, Garofalo C. Current management of hyperkalemia in non-dialysis CKD: longitudinal study of patients receiving stable nephrology care. Nutrients. 2021;13(3):942.CrossRefPubMedPubMedCentral Borrelli S, De Nicola L, Minutolo R, Conte G, Chiodini P, Cupisti A, Santoro D, Calabrese V, Giannese D, Garofalo C. Current management of hyperkalemia in non-dialysis CKD: longitudinal study of patients receiving stable nephrology care. Nutrients. 2021;13(3):942.CrossRefPubMedPubMedCentral
3.
go back to reference Palmer BF, Carrero JJ, Clegg DJ, Colbert GB, Emmett M, Fishbane S, Hain DJ, Lerma E, Onuigbo M, Rastogi A. Clinical management of hyperkalemia. In: Mayo Clinic Proceedings: 2021: Elsevier; 2021: 744–762. Palmer BF, Carrero JJ, Clegg DJ, Colbert GB, Emmett M, Fishbane S, Hain DJ, Lerma E, Onuigbo M, Rastogi A. Clinical management of hyperkalemia. In: Mayo Clinic Proceedings: 2021: Elsevier; 2021: 744–762.
4.
go back to reference Sarafidis PA, Blacklock R, Wood E, Rumjon A, Simmonds S, Fletcher-Rogers J, Ariyanayagam R, Al-Yassin A, Sharpe C, Vinen K. Prevalence and factors associated with hyperkalemia in predialysis patients followed in a low-clearance clinic. Clin J Am Soc Nephrol. 2012;7(8):1234–41.CrossRefPubMedPubMedCentral Sarafidis PA, Blacklock R, Wood E, Rumjon A, Simmonds S, Fletcher-Rogers J, Ariyanayagam R, Al-Yassin A, Sharpe C, Vinen K. Prevalence and factors associated with hyperkalemia in predialysis patients followed in a low-clearance clinic. Clin J Am Soc Nephrol. 2012;7(8):1234–41.CrossRefPubMedPubMedCentral
5.
go back to reference Clase CM, Carrero J-J, Ellison DH, Grams ME, Hemmelgarn BR, Jardine MJ, Kovesdy CP, Kline GA, Lindner G, Obrador GT. Potassium homeostasis and management of dyskalemia in kidney diseases: conclusions from a kidney disease: improving global outcomes (KDIGO) Controversies Conference. Kidney Int. 2020;97(1):42–61.CrossRefPubMed Clase CM, Carrero J-J, Ellison DH, Grams ME, Hemmelgarn BR, Jardine MJ, Kovesdy CP, Kline GA, Lindner G, Obrador GT. Potassium homeostasis and management of dyskalemia in kidney diseases: conclusions from a kidney disease: improving global outcomes (KDIGO) Controversies Conference. Kidney Int. 2020;97(1):42–61.CrossRefPubMed
6.
go back to reference Sharma A, Alvarez PJ, Woods SD, Dai D. A model to Predict Risk of Hyperkalemia in patients with chronic kidney Disease using a large administrative claims database. ClinicoEconomics and Outcomes Research: CEOR. 2020;12:657.CrossRefPubMed Sharma A, Alvarez PJ, Woods SD, Dai D. A model to Predict Risk of Hyperkalemia in patients with chronic kidney Disease using a large administrative claims database. ClinicoEconomics and Outcomes Research: CEOR. 2020;12:657.CrossRefPubMed
7.
go back to reference Lin CS, Lin C, Fang WH, Hsu CJ, Chen SJ, Huang KH, Lin WS, Tsai CS, Kuo CC, Chau T, et al. A deep-learning algorithm (ECG12Net) for detecting hypokalemia and hyperkalemia by Electrocardiography: Algorithm Development. JMIR Med Inform. 2020;8(3):e15931.CrossRefPubMedPubMedCentral Lin CS, Lin C, Fang WH, Hsu CJ, Chen SJ, Huang KH, Lin WS, Tsai CS, Kuo CC, Chau T, et al. A deep-learning algorithm (ECG12Net) for detecting hypokalemia and hyperkalemia by Electrocardiography: Algorithm Development. JMIR Med Inform. 2020;8(3):e15931.CrossRefPubMedPubMedCentral
8.
go back to reference Galloway CD, Valys AV, Shreibati JB, Treiman DL, Petterson FL, Gundotra VP, Albert DE, Attia ZI, Carter RE, Asirvatham SJ. Development and validation of a deep-learning model to screen for hyperkalemia from the electrocardiogram. JAMA Cardiol. 2019;4(5):428–36.CrossRefPubMedPubMedCentral Galloway CD, Valys AV, Shreibati JB, Treiman DL, Petterson FL, Gundotra VP, Albert DE, Attia ZI, Carter RE, Asirvatham SJ. Development and validation of a deep-learning model to screen for hyperkalemia from the electrocardiogram. JAMA Cardiol. 2019;4(5):428–36.CrossRefPubMedPubMedCentral
9.
go back to reference Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining: 2016; 2016: 785–794. Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining: 2016; 2016: 785–794.
10.
go back to reference Deng YH, Luo XQ, Yan P, Zhang NY, Liu Y, Duan SB. Outcome prediction for acute kidney injury among hospitalized children via eXtreme Gradient boosting algorithm. Sci Rep. 2022;12(1):1–11. Deng YH, Luo XQ, Yan P, Zhang NY, Liu Y, Duan SB. Outcome prediction for acute kidney injury among hospitalized children via eXtreme Gradient boosting algorithm. Sci Rep. 2022;12(1):1–11.
11.
go back to reference Chen T, Li X, Li Y, Xia E, Qin Y, Liang S, Xu F, Liang D, Zeng C, Liu Z. Prediction and risk stratification of kidney outcomes in IgA nephropathy. Am J Kidney Dis. 2019;74(3):300–9.CrossRefPubMed Chen T, Li X, Li Y, Xia E, Qin Y, Liang S, Xu F, Liang D, Zeng C, Liu Z. Prediction and risk stratification of kidney outcomes in IgA nephropathy. Am J Kidney Dis. 2019;74(3):300–9.CrossRefPubMed
12.
go back to reference Chang W, Liu Y, Xiao Y, Yuan X, Xu X, Zhang S, Zhou S. A machine-learning-based prediction method for hypertension outcomes based on medical data. Diagnostics. 2019;9(4):178.CrossRefPubMedPubMedCentral Chang W, Liu Y, Xiao Y, Yuan X, Xu X, Zhang S, Zhou S. A machine-learning-based prediction method for hypertension outcomes based on medical data. Diagnostics. 2019;9(4):178.CrossRefPubMedPubMedCentral
13.
go back to reference Hsieh HM, Lin MY, Chiu YW, Wu PH, Cheng LJ, Jian FS, Hsu CC, Hwang SJ. Economic evaluation of a pre-ESRD pay-for-performance programme in advanced chronic kidney disease patients. Nephrol Dial Transplant. 2017;32(7):1184–94.PubMed Hsieh HM, Lin MY, Chiu YW, Wu PH, Cheng LJ, Jian FS, Hsu CC, Hwang SJ. Economic evaluation of a pre-ESRD pay-for-performance programme in advanced chronic kidney disease patients. Nephrol Dial Transplant. 2017;32(7):1184–94.PubMed
14.
go back to reference Einhorn LM, Zhan M, Walker LD, Moen MF, Seliger SL, Weir MR, Fink JC. The frequency of hyperkalemia and its significance in chronic kidney disease. Arch Intern Med. 2009;169(12):1156–62.CrossRefPubMedPubMedCentral Einhorn LM, Zhan M, Walker LD, Moen MF, Seliger SL, Weir MR, Fink JC. The frequency of hyperkalemia and its significance in chronic kidney disease. Arch Intern Med. 2009;169(12):1156–62.CrossRefPubMedPubMedCentral
15.
go back to reference Kashihara N, Kohsaka S, Kanda E, Okami S, Yajima T. Hyperkalemia in real-world patients under continuous Medical Care in Japan. Kidney Int Rep. 2019;4(9):1248–60.CrossRefPubMedPubMedCentral Kashihara N, Kohsaka S, Kanda E, Okami S, Yajima T. Hyperkalemia in real-world patients under continuous Medical Care in Japan. Kidney Int Rep. 2019;4(9):1248–60.CrossRefPubMedPubMedCentral
17.
go back to reference Cha G-W, Moon H-J, Kim Y-C. Comparison of Random Forest and Gradient Boosting Machine Models for Predicting demolition Waste based on small datasets and categorical variables. Int J Environ Res Public Health. 2021;18(16):8530.CrossRefPubMedPubMedCentral Cha G-W, Moon H-J, Kim Y-C. Comparison of Random Forest and Gradient Boosting Machine Models for Predicting demolition Waste based on small datasets and categorical variables. Int J Environ Res Public Health. 2021;18(16):8530.CrossRefPubMedPubMedCentral
19.
go back to reference Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. 2016;34(21):2534.CrossRefPubMedPubMedCentral Kerr KF, Brown MD, Zhu K, Janes H. Assessing the clinical impact of risk prediction models with decision curves: guidance for correct interpretation and appropriate use. J Clin Oncol. 2016;34(21):2534.CrossRefPubMedPubMedCentral
20.
go back to reference Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30.
21.
go back to reference HWANG SJ, TSAI JC. Epidemiology, impact and preventive care of chronic kidney disease in Taiwan. Nephrology. 2010;15:3–9.CrossRefPubMed HWANG SJ, TSAI JC. Epidemiology, impact and preventive care of chronic kidney disease in Taiwan. Nephrology. 2010;15:3–9.CrossRefPubMed
22.
go back to reference Wang JS, Yen FS, Lin KD, Shin SJ, Hsu YH, Hsu CC. China DKDRCotDAotRo: epidemiological characteristics of diabetic kidney disease in Taiwan. J Diabetes Invest. 2021;12(12):2112–23.CrossRef Wang JS, Yen FS, Lin KD, Shin SJ, Hsu YH, Hsu CC. China DKDRCotDAotRo: epidemiological characteristics of diabetic kidney disease in Taiwan. J Diabetes Invest. 2021;12(12):2112–23.CrossRef
24.
go back to reference Luo J, Brunelli SM, Jensen DE, Yang A. Association between serum potassium and outcomes in patients with reduced kidney function. Clin J Am Soc Nephrol. 2016;11(1):90–100.CrossRefPubMed Luo J, Brunelli SM, Jensen DE, Yang A. Association between serum potassium and outcomes in patients with reduced kidney function. Clin J Am Soc Nephrol. 2016;11(1):90–100.CrossRefPubMed
26.
go back to reference James C, Ranson JM, Everson R, Llewellyn DJ. Performance of machine learning algorithms for predicting progression to dementia in memory clinic patients. JAMA Netw open. 2021;4(12):e2136553–3.CrossRefPubMedPubMedCentral James C, Ranson JM, Everson R, Llewellyn DJ. Performance of machine learning algorithms for predicting progression to dementia in memory clinic patients. JAMA Netw open. 2021;4(12):e2136553–3.CrossRefPubMedPubMedCentral
27.
go back to reference Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, Bradwell KR, Bremer C, Byrd JB, Denham A. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative. JAMA Netw open. 2021;4(7):e2116901–1.CrossRefPubMedPubMedCentral Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, Bradwell KR, Bremer C, Byrd JB, Denham A. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative. JAMA Netw open. 2021;4(7):e2116901–1.CrossRefPubMedPubMedCentral
28.
go back to reference Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12–22.CrossRefPubMed Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12–22.CrossRefPubMed
29.
30.
go back to reference London AJ. Artificial intelligence and black-box medical decisions: accuracy versus explainability. Hastings Cent Rep. 2019;49(1):15–21.CrossRefPubMed London AJ. Artificial intelligence and black-box medical decisions: accuracy versus explainability. Hastings Cent Rep. 2019;49(1):15–21.CrossRefPubMed
31.
go back to reference Weir MR, Rolfe M. Potassium homeostasis and renin-angiotensin-aldosterone system inhibitors. Clin J Am Soc Nephrol. 2010;5(3):531–48.CrossRefPubMed Weir MR, Rolfe M. Potassium homeostasis and renin-angiotensin-aldosterone system inhibitors. Clin J Am Soc Nephrol. 2010;5(3):531–48.CrossRefPubMed
32.
go back to reference Raebel MA. Hyperkalemia associated with use of angiotensin-converting enzyme inhibitors and angiotensin receptor blockers. Cardiovasc Ther. 2012;30(3):e156–66.CrossRefPubMed Raebel MA. Hyperkalemia associated with use of angiotensin-converting enzyme inhibitors and angiotensin receptor blockers. Cardiovasc Ther. 2012;30(3):e156–66.CrossRefPubMed
33.
go back to reference Mansoor F, Bai P, Kaur N, Sultan S, Sharma S, Dilip A, Kammawal Y, Shahid S, Rizwan A. Evaluation of serum electrolyte levels in patients with Anemia. Cureus 2021, 13(10). Mansoor F, Bai P, Kaur N, Sultan S, Sharma S, Dilip A, Kammawal Y, Shahid S, Rizwan A. Evaluation of serum electrolyte levels in patients with Anemia. Cureus 2021, 13(10).
34.
go back to reference Dewey J, Mastenbrook J, Bauler LD. Differentiating pseudohyperkalemia from true hyperkalemia in a patient with chronic lymphocytic leukemia and diverticulitis. Cureus 2020, 12(8). Dewey J, Mastenbrook J, Bauler LD. Differentiating pseudohyperkalemia from true hyperkalemia in a patient with chronic lymphocytic leukemia and diverticulitis. Cureus 2020, 12(8).
Metadata
Title
Predicting hyperkalemia in patients with advanced chronic kidney disease using the XGBoost model
Authors
Hsin-Hsiung Chang
Jung-Hsien Chiang
Chun-Chieh Tsai
Ping-Fang Chiu
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Nephrology / Issue 1/2023
Electronic ISSN: 1471-2369
DOI
https://doi.org/10.1186/s12882-023-03227-w

Other articles of this Issue 1/2023

BMC Nephrology 1/2023 Go to the issue

A quick guide to ECGs

Electrocardiography Training Course

Improve your ECG interpretation skills with this comprehensive, rapid, interactive course. Expert advice provides detailed feedback as you work through 50 ECGs covering the most common cardiac presentations to ensure your practice stays up to date. 

PD Dr. Carsten W. Israel
Developed by: Springer Medizin
Start the cases

At a glance: The STEP trials

Obesity Clinical Trial Summary

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine
Read more