Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Insulins | Research Article

A machine-learning approach to predict postprandial hypoglycemia

Authors: Wonju Seo, You-Bin Lee, Seunghyun Lee, Sang-Man Jin, Sung-Min Park

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

For an effective artificial pancreas (AP) system and an improved therapeutic intervention with continuous glucose monitoring (CGM), predicting the occurrence of hypoglycemia accurately is very important. While there have been many studies reporting successful algorithms for predicting nocturnal hypoglycemia, predicting postprandial hypoglycemia still remains a challenge due to extreme glucose fluctuations that occur around mealtimes. The goal of this study is to evaluate the feasibility of easy-to-use, computationally efficient machine-learning algorithm to predict postprandial hypoglycemia with a unique feature set.

Methods

We use retrospective CGM datasets of 104 people who had experienced at least one hypoglycemia alert value during a three-day CGM session. The algorithms were developed based on four machine learning models with a unique data-driven feature set: a random forest (RF), a support vector machine using a linear function or a radial basis function, a K-nearest neighbor, and a logistic regression. With 5-fold cross-subject validation, the average performance of each model was calculated to compare and contrast their individual performance. The area under a receiver operating characteristic curve (AUC) and the F1 score were used as the main criterion for evaluating the performance.

Results

In predicting a hypoglycemia alert value with a 30-min prediction horizon, the RF model showed the best performance with the average AUC of 0.966, the average sensitivity of 89.6%, the average specificity of 91.3%, and the average F1 score of 0.543. In addition, the RF showed the better predictive performance for postprandial hypoglycemic events than other models.

Conclusion

In conclusion, we showed that machine-learning algorithms have potential in predicting postprandial hypoglycemia, and the RF model could be a better candidate for the further development of postprandial hypoglycemia prediction algorithm to advance the CGM technology and the AP technology further.
Literature
1.
go back to reference Nathan DM, DCCT/Edic Research Group. The diabetes control and complications trial/epidemiology of diabetes interventions and complications study at 30 years: overview. Diabetes Care. 2014; 37:9–16.CrossRef Nathan DM, DCCT/Edic Research Group. The diabetes control and complications trial/epidemiology of diabetes interventions and complications study at 30 years: overview. Diabetes Care. 2014; 37:9–16.CrossRef
2.
go back to reference Phillip M, Battelino T, Atlas E, Kordonouri O, Bratina N, Miller S, et al.Nocturnal glucose control with an artificial pancreas at a diabetes camp. N Engl J Med. 2013; 368:824–33.CrossRef Phillip M, Battelino T, Atlas E, Kordonouri O, Bratina N, Miller S, et al.Nocturnal glucose control with an artificial pancreas at a diabetes camp. N Engl J Med. 2013; 368:824–33.CrossRef
3.
go back to reference Thabit H, Tauschmann M, Allen J, Leelarathna L, Hartnell S, Wilinska M, et al.Home Use of an Artificial Beta Cell in Type 1 Diabetes. New Engl J Med. 2015; 373:2129–40.CrossRef Thabit H, Tauschmann M, Allen J, Leelarathna L, Hartnell S, Wilinska M, et al.Home Use of an Artificial Beta Cell in Type 1 Diabetes. New Engl J Med. 2015; 373:2129–40.CrossRef
4.
go back to reference Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications (DCCT/EDIC) Study Research Group. Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes. N Engl J Med. 2005; 353:2643–53.CrossRef Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications (DCCT/EDIC) Study Research Group. Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes. N Engl J Med. 2005; 353:2643–53.CrossRef
5.
go back to reference Cryer PE. The barrier of hypoglycemia in diabetes. Diabetes. 2008; 57:3169–76.CrossRef Cryer PE. The barrier of hypoglycemia in diabetes. Diabetes. 2008; 57:3169–76.CrossRef
6.
go back to reference Russell SJ, El-Khatib FH, Sinha M, Magyar KL, McKeon K, Goergen LG, et al.Outpatient Glycemic Control with a Bionic Pancreas in Type 1 Diabetes. N Engl J Med. 2014; 371:313–25.CrossRef Russell SJ, El-Khatib FH, Sinha M, Magyar KL, McKeon K, Goergen LG, et al.Outpatient Glycemic Control with a Bionic Pancreas in Type 1 Diabetes. N Engl J Med. 2014; 371:313–25.CrossRef
7.
go back to reference Kudva YC, Carter RE, Cobelli C, Basu R, Basu A. Closed-loop artificial pancreas systems: Physiological input to enhance next-generation devices. Diabetes Care. 2014; 37:1184–90.CrossRef Kudva YC, Carter RE, Cobelli C, Basu R, Basu A. Closed-loop artificial pancreas systems: Physiological input to enhance next-generation devices. Diabetes Care. 2014; 37:1184–90.CrossRef
9.
go back to reference Bergenstal RM, Garg S, Weinzimer SA, Buckingham BA, Bode BW, Tamborlane WV, et al.Safety of a Hybrid Closed-Loop Insulin Delivery System in Patients With Type 1 Diabetes. JAMA. 2016; 316:1407.CrossRef Bergenstal RM, Garg S, Weinzimer SA, Buckingham BA, Bode BW, Tamborlane WV, et al.Safety of a Hybrid Closed-Loop Insulin Delivery System in Patients With Type 1 Diabetes. JAMA. 2016; 316:1407.CrossRef
11.
go back to reference Pohl R, Li M, Krasner A, De Souza E. Development of stable liquid glucagon formulations for use in artificial pancreas. J Diabetes Sci Technol. 2015; 8(1):8–16.CrossRef Pohl R, Li M, Krasner A, De Souza E. Development of stable liquid glucagon formulations for use in artificial pancreas. J Diabetes Sci Technol. 2015; 8(1):8–16.CrossRef
12.
go back to reference Haidar A, Rabasa-Lhoret R, Legault L, Lovblom LE, Rakheja R, Messier V, D’Aoust É, Falappa CM, Justice T, Orszag A. Single- and dual-hormone artificial pancreas for overnight glucose control in type 1 diabetes. J Clin Endocrinol Metab. 2016; 101(1):214–23.CrossRef Haidar A, Rabasa-Lhoret R, Legault L, Lovblom LE, Rakheja R, Messier V, D’Aoust É, Falappa CM, Justice T, Orszag A. Single- and dual-hormone artificial pancreas for overnight glucose control in type 1 diabetes. J Clin Endocrinol Metab. 2016; 101(1):214–23.CrossRef
14.
go back to reference Unger RH, Orci L. Paracrinology of islets and the paracrinopathy of diabetes. Proc Natl Acad Sci. 2010; 107:16009–12.CrossRef Unger RH, Orci L. Paracrinology of islets and the paracrinopathy of diabetes. Proc Natl Acad Sci. 2010; 107:16009–12.CrossRef
15.
go back to reference Oviedo S, Vehi J, Calm R, Armengol J. A review of personalized blood glucose prediction strategies for T1DM patients. Int J Numer Method Biomed Eng. 2017; 33(6):1–21.CrossRef Oviedo S, Vehi J, Calm R, Armengol J. A review of personalized blood glucose prediction strategies for T1DM patients. Int J Numer Method Biomed Eng. 2017; 33(6):1–21.CrossRef
16.
go back to reference Woldaregay AZ, Årsand E, Botsis T, Albers D, Mamykina L, Hartvigsen G. Data-Driven Blood Glucose Pattern Classification and Anomalies Detection: Machine-Learning Applications in Type 1 Diabetes. J Med Internet Res; 21(5):e11030. Woldaregay AZ, Årsand E, Botsis T, Albers D, Mamykina L, Hartvigsen G. Data-Driven Blood Glucose Pattern Classification and Anomalies Detection: Machine-Learning Applications in Type 1 Diabetes. J Med Internet Res; 21(5):e11030.
17.
go back to reference Sparacino G, Zanderigo F, Corazza S, Maran A, Facchinetti A, Cobelli C. Glucose concentration can be predicted ahead in time from continuous glucose monitoring sensor time-series. IEEE Trans Biomed Eng. 2007; 54:931–7.CrossRef Sparacino G, Zanderigo F, Corazza S, Maran A, Facchinetti A, Cobelli C. Glucose concentration can be predicted ahead in time from continuous glucose monitoring sensor time-series. IEEE Trans Biomed Eng. 2007; 54:931–7.CrossRef
18.
go back to reference Yang J, Li L, Shi Y, Xie X. An ARIMA Model with Adaptive Orders for Predicting Blood Glucose Concentrations and Hypoglycemia. IEEE J Biomed Health Inform. 2018; 23(3):1251–60.CrossRef Yang J, Li L, Shi Y, Xie X. An ARIMA Model with Adaptive Orders for Predicting Blood Glucose Concentrations and Hypoglycemia. IEEE J Biomed Health Inform. 2018; 23(3):1251–60.CrossRef
19.
go back to reference Turksoy K, Bayrak ES, Quinn L, Littlejohn E, Rollins D, Cinar A. Hypoglycemia early alarm systems based on multivariable models. Ind Eng Chem Res. 2013; 52:12329–36.CrossRef Turksoy K, Bayrak ES, Quinn L, Littlejohn E, Rollins D, Cinar A. Hypoglycemia early alarm systems based on multivariable models. Ind Eng Chem Res. 2013; 52:12329–36.CrossRef
20.
go back to reference Pérez-Gandía C, Facchinetti A, Sparacino G, Cobelli C, Gómez EJ, Rigla M, et al.Artificial neural network algorithm for online glucose prediction from continuous glucose monitoring. Diabetes Technol Ther. 2010; 12:81–8.CrossRef Pérez-Gandía C, Facchinetti A, Sparacino G, Cobelli C, Gómez EJ, Rigla M, et al.Artificial neural network algorithm for online glucose prediction from continuous glucose monitoring. Diabetes Technol Ther. 2010; 12:81–8.CrossRef
21.
go back to reference Zecchin C, Facchinetti A, Sparacino G, De Nicolao G, Cobelli C. Neural network incorporating meal information improves accuracy of short-time prediction of glucose concentration. IEEE Trans Biomed Eng. 2012; 59:1550–60.CrossRef Zecchin C, Facchinetti A, Sparacino G, De Nicolao G, Cobelli C. Neural network incorporating meal information improves accuracy of short-time prediction of glucose concentration. IEEE Trans Biomed Eng. 2012; 59:1550–60.CrossRef
22.
go back to reference Zecchin C, Facchinetti A, Sparacino G, De Nicolao G, Cobelli C. A new neural network approach for short-term glucose prediction using continuous glucose monitoring time-series and meal information. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS: 2011. p. 5653–6. https://doi.org/10.1109/iembs.2011.6091368. Zecchin C, Facchinetti A, Sparacino G, De Nicolao G, Cobelli C. A new neural network approach for short-term glucose prediction using continuous glucose monitoring time-series and meal information. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS: 2011. p. 5653–6. https://​doi.​org/​10.​1109/​iembs.​2011.​6091368.
23.
go back to reference Zecchin C, Facchinetti A, Sparacino G, Cobelli C. How much is short-term glucose prediction in type 1 diabetes improved by adding insulin delivery and meal content information to CGM data? A proof-of-concept study. J Diabetes Sci Technol. 2016; 10:1149–60.CrossRef Zecchin C, Facchinetti A, Sparacino G, Cobelli C. How much is short-term glucose prediction in type 1 diabetes improved by adding insulin delivery and meal content information to CGM data? A proof-of-concept study. J Diabetes Sci Technol. 2016; 10:1149–60.CrossRef
24.
go back to reference Pappada SM, Cameron BD, Rosman PM, Bourey RE, Papadimos TJ, et al.Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. Diabetes Technol Ther. 2011; 13:135–41.CrossRef Pappada SM, Cameron BD, Rosman PM, Bourey RE, Papadimos TJ, et al.Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. Diabetes Technol Ther. 2011; 13:135–41.CrossRef
25.
go back to reference Dassau E, Cameron F, Lee H, Bequette BW, Zisser H, Jovanovič L, et al.Real-Time Hypoglycemia Prediction Suite Using Continuous Glucose Monitoring. Diabetes Care. 2010; 33:1249–54.CrossRef Dassau E, Cameron F, Lee H, Bequette BW, Zisser H, Jovanovič L, et al.Real-Time Hypoglycemia Prediction Suite Using Continuous Glucose Monitoring. Diabetes Care. 2010; 33:1249–54.CrossRef
29.
go back to reference Liebl A, Henrichs HR, Heinemann L, Freckmann G, Biermann E, Thomas A. Continuous glucose monitoring: Evidence and consensus statement for clinical use. J Diabetes Sci Technol. 2013; 7:500–19.CrossRef Liebl A, Henrichs HR, Heinemann L, Freckmann G, Biermann E, Thomas A. Continuous glucose monitoring: Evidence and consensus statement for clinical use. J Diabetes Sci Technol. 2013; 7:500–19.CrossRef
33.
go back to reference Palerm CC, Willis JP, Desemone J, Bequette BW. Hypoglycemia Prediction and Detection Using Optimal Estimation. Diabetes Technol Ther. 2005; 7:3–14.CrossRef Palerm CC, Willis JP, Desemone J, Bequette BW. Hypoglycemia Prediction and Detection Using Optimal Estimation. Diabetes Technol Ther. 2005; 7:3–14.CrossRef
35.
go back to reference International Hypoglycaemia Study Group. Glucose concentrations of less than 3.0 mmol/L (54 mg/dL) should be reported in clinical trials: a joint position statement of the American Diabetes Association and the European Association for the Study of Diabetes. Diabetes Care. 2017; 40:155–7.CrossRef International Hypoglycaemia Study Group. Glucose concentrations of less than 3.0 mmol/L (54 mg/dL) should be reported in clinical trials: a joint position statement of the American Diabetes Association and the European Association for the Study of Diabetes. Diabetes Care. 2017; 40:155–7.CrossRef
38.
go back to reference Ganganwar V. An overview of classification algorithms for imbalanced datasets. J Emerg Technol Adv Eng. 2012; 2:42–7. Ganganwar V. An overview of classification algorithms for imbalanced datasets. J Emerg Technol Adv Eng. 2012; 2:42–7.
40.
go back to reference Plis K, Bunescu R, Marling C, Shubrook J, Schwartz F. A Machine Learning Approach to Predicting Blood Glucose Levels for Diabetes Management. In: Workshops at the Twenty-Eighth AAAI Conference on Artific ial Intelligence: 2014: 2014. Plis K, Bunescu R, Marling C, Shubrook J, Schwartz F. A Machine Learning Approach to Predicting Blood Glucose Levels for Diabetes Management. In: Workshops at the Twenty-Eighth AAAI Conference on Artific ial Intelligence: 2014: 2014.
41.
go back to reference Longadge R, Dongre S, Malik L. Class imbalance problem in data mining review. 2013. arXiv preprint arXiv:13051707. Longadge R, Dongre S, Malik L. Class imbalance problem in data mining review. 2013. arXiv preprint arXiv:13051707.
44.
go back to reference Perlmuter LC, Flanagan BP, Shah PH, Singh SP. Glycemic Control and Hypoglycemia: Is the loser the winner?Diabetes Care. 2008; 31:2072–6.CrossRef Perlmuter LC, Flanagan BP, Shah PH, Singh SP. Glycemic Control and Hypoglycemia: Is the loser the winner?Diabetes Care. 2008; 31:2072–6.CrossRef
Metadata
Title
A machine-learning approach to predict postprandial hypoglycemia
Authors
Wonju Seo
You-Bin Lee
Seunghyun Lee
Sang-Man Jin
Sung-Min Park
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0943-4

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue