Skip to main content
Top
Published in: BMC Medicine 1/2022

Open Access 01-12-2022 | Insulins | Research article

Development and validation of prediction models for gestational diabetes treatment modality using supervised machine learning: a population-based cohort study

Authors: Lauren D. Liao, Assiamira Ferrara, Mara B. Greenberg, Amanda L. Ngo, Juanran Feng, Zhenhua Zhang, Patrick T. Bradshaw, Alan E. Hubbard, Yeyi Zhu

Published in: BMC Medicine | Issue 1/2022

Login to get access

Abstract

Background

Gestational diabetes (GDM) is prevalent and benefits from timely and effective treatment, given the short window to impact glycemic control. Clinicians face major barriers to choosing effectively among treatment modalities [medical nutrition therapy (MNT) with or without pharmacologic treatment (antidiabetic oral agents and/or insulin)]. We investigated whether clinical data at varied stages of pregnancy can predict GDM treatment modality.

Methods

Among a population-based cohort of 30,474 pregnancies with GDM delivered at Kaiser Permanente Northern California in 2007–2017, we selected those in 2007–2016 as the discovery set and 2017 as the temporal/future validation set. Potential predictors were extracted from electronic health records at different timepoints (levels 1–4): (1) 1-year preconception to the last menstrual period, (2) the last menstrual period to GDM diagnosis, (3) at GDM diagnosis, and (4) 1 week after GDM diagnosis. We compared transparent and ensemble machine learning prediction methods, including least absolute shrinkage and selection operator (LASSO) regression and super learner, containing classification and regression tree, LASSO regression, random forest, and extreme gradient boosting algorithms, to predict risks for pharmacologic treatment beyond MNT.

Results

The super learner using levels 1–4 predictors had higher predictability [tenfold cross-validated C-statistic in discovery/validation set: 0.934 (95% CI: 0.931–0.936)/0.815 (0.800–0.829)], compared to levels 1, 1–2, and 1–3 (discovery/validation set C-statistic: 0.683–0.869/0.634–0.754). A simpler, more interpretable model, including timing of GDM diagnosis, diagnostic fasting glucose value, and the status and frequency of glycemic control at fasting during one-week post diagnosis, was developed using tenfold cross-validated logistic regression based on super learner-selected predictors. This model compared to the super learner had only a modest reduction in predictability [discovery/validation set C-statistic: 0.825 (0.820–0.830)/0.798 (95% CI: 0.783–0.813)].

Conclusions

Clinical data demonstrated reasonably high predictability for GDM treatment modality at the time of GDM diagnosis and high predictability at 1-week post GDM diagnosis. These population-based, clinically oriented models may support algorithm-based risk-stratification for treatment modality, inform timely treatment, and catalyze more effective management of GDM.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ferrara A, Kahn HS, Quesenberry CP, Riley C, Hedderson MM. An increase in the incidence of gestational diabetes mellitus: Northern California, 1991–2000. Obstet Gynecol. 2004;103(3):526–33.CrossRef Ferrara A, Kahn HS, Quesenberry CP, Riley C, Hedderson MM. An increase in the incidence of gestational diabetes mellitus: Northern California, 1991–2000. Obstet Gynecol. 2004;103(3):526–33.CrossRef
2.
go back to reference Zhu Y, Zhang C. Prevalence of gestational diabetes and risk of progression to type 2 diabetes: a global perspective. Curr Diab Rep. 2016;16(1):7.CrossRef Zhu Y, Zhang C. Prevalence of gestational diabetes and risk of progression to type 2 diabetes: a global perspective. Curr Diab Rep. 2016;16(1):7.CrossRef
3.
go back to reference McIntyre HD, Catalano P, Zhang C, Desoye G, Mathiesen ER, Damm P. Gestational diabetes mellitus. Nat Rev Dis Primers. 2019;5(1):47.CrossRef McIntyre HD, Catalano P, Zhang C, Desoye G, Mathiesen ER, Damm P. Gestational diabetes mellitus. Nat Rev Dis Primers. 2019;5(1):47.CrossRef
4.
go back to reference Practice Bulletin No. 180: Gestational Diabetes Mellitus. Obstet Gynecol. 2017;130(1):e17–37.CrossRef Practice Bulletin No. 180: Gestational Diabetes Mellitus. Obstet Gynecol. 2017;130(1):e17–37.CrossRef
5.
go back to reference American Diabetes Association. 14. Management of diabetes in pregnancy: standards of medical care in diabetes-2021. Diabetes Care. 2021;44(Supplement 1):S200–10.CrossRef American Diabetes Association. 14. Management of diabetes in pregnancy: standards of medical care in diabetes-2021. Diabetes Care. 2021;44(Supplement 1):S200–10.CrossRef
6.
go back to reference Tisi DK, Burns DH, Luskey GW, Koski KG. Fetal exposure to altered amniotic fluid glucose, insulin, and insulin-like growth factor-binding protein 1 occurs before screening for gestational diabetes mellitus. Diabetes Care. 2011;34(1):139–44.CrossRef Tisi DK, Burns DH, Luskey GW, Koski KG. Fetal exposure to altered amniotic fluid glucose, insulin, and insulin-like growth factor-binding protein 1 occurs before screening for gestational diabetes mellitus. Diabetes Care. 2011;34(1):139–44.CrossRef
7.
go back to reference Flack JR, Ross GP, Ho S, McElduff A. Recommended changes to diagnostic criteria for gestational diabetes: impact on workload. Aust N Z J Obstet Gynaecol. 2010;50(5):439–43.CrossRef Flack JR, Ross GP, Ho S, McElduff A. Recommended changes to diagnostic criteria for gestational diabetes: impact on workload. Aust N Z J Obstet Gynaecol. 2010;50(5):439–43.CrossRef
8.
go back to reference Camelo Castillo W, Boggess K, Sturmer T, Brookhart MA, Benjamin DK Jr, Jonsson Funk M. Trends in glyburide compared with insulin use for gestational diabetes treatment in the United States, 2000–2011. Obstet Gynecol. 2014;123(6):1177–84.CrossRef Camelo Castillo W, Boggess K, Sturmer T, Brookhart MA, Benjamin DK Jr, Jonsson Funk M. Trends in glyburide compared with insulin use for gestational diabetes treatment in the United States, 2000–2011. Obstet Gynecol. 2014;123(6):1177–84.CrossRef
9.
go back to reference Coetzee EJ. Pregnancy and diabetes scenario around the world: Africa. Int J Gynaecol Obstet. 2009;104(Suppl 1):S39-41.CrossRef Coetzee EJ. Pregnancy and diabetes scenario around the world: Africa. Int J Gynaecol Obstet. 2009;104(Suppl 1):S39-41.CrossRef
10.
go back to reference Goetzl L, Wilkins I. Glyburide compared to insulin for the treatment of gestational diabetes mellitus: a cost analysis. J Perinatol. 2002;22(5):403–6.CrossRef Goetzl L, Wilkins I. Glyburide compared to insulin for the treatment of gestational diabetes mellitus: a cost analysis. J Perinatol. 2002;22(5):403–6.CrossRef
11.
go back to reference Gordon N, Lin T. The Kaiser Permanente Northern California adult member health survey. Perm J. 2016;20(4):15–225.CrossRef Gordon N, Lin T. The Kaiser Permanente Northern California adult member health survey. Perm J. 2016;20(4):15–225.CrossRef
12.
go back to reference Go AS, Lee WY, Yang J, Lo JC, Gurwitz JH. Statin therapy and risks for death and hospitalization in chronic heart failure. JAMA. 2006;296(17):2105–11.CrossRef Go AS, Lee WY, Yang J, Lo JC, Gurwitz JH. Statin therapy and risks for death and hospitalization in chronic heart failure. JAMA. 2006;296(17):2105–11.CrossRef
13.
go back to reference Carpenter MW, Coustan DR. Criteria for screening tests for gestational diabetes. Am J Obstet Gynecol. 1982;144(7):768–73.CrossRef Carpenter MW, Coustan DR. Criteria for screening tests for gestational diabetes. Am J Obstet Gynecol. 1982;144(7):768–73.CrossRef
14.
go back to reference Zhu Y, Hedderson MM, Feng J, Mevi AA, Ferrara A. The Pregnancy Environment and Lifestyle Study (PETALS): a population-based longitudinal multi-racial birth cohort. BMC Pregnancy Childbirth. 2017;17(1):122.CrossRef Zhu Y, Hedderson MM, Feng J, Mevi AA, Ferrara A. The Pregnancy Environment and Lifestyle Study (PETALS): a population-based longitudinal multi-racial birth cohort. BMC Pregnancy Childbirth. 2017;17(1):122.CrossRef
15.
go back to reference Ferrara A. Increasing prevalence of gestational diabetes mellitus: a public health perspective. Diabetes Care. 2007;30(Suppl 2):S141-146.CrossRef Ferrara A. Increasing prevalence of gestational diabetes mellitus: a public health perspective. Diabetes Care. 2007;30(Suppl 2):S141-146.CrossRef
16.
go back to reference Ferrara A, Hedderson MM, Ching J, Kim C, Peng T, Crites YM. Referral to telephonic nurse management improves outcomes in women with gestational diabetes. Am J Obstet Gynecol. 2012;206(6):491 e491-495.CrossRef Ferrara A, Hedderson MM, Ching J, Kim C, Peng T, Crites YM. Referral to telephonic nurse management improves outcomes in women with gestational diabetes. Am J Obstet Gynecol. 2012;206(6):491 e491-495.CrossRef
18.
go back to reference Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33(1):1–22.CrossRef Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33(1):1–22.CrossRef
19.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.CrossRef
21.
go back to reference Ares J, Martin-Nieto A, Diaz-Naya L, Tarton T, Menendez-Prada T, Ragnarsson CS, Delgado-Alvarez E, Menendez-Torre E. Gestational diabetes mellitus (GDM): relationship between higher cutoff values for 100 g Oral Glucose Tolerance Test (OGTT) and insulin requirement during pregnancy. Matern Child Health J. 2017;21(7):1488–92.CrossRef Ares J, Martin-Nieto A, Diaz-Naya L, Tarton T, Menendez-Prada T, Ragnarsson CS, Delgado-Alvarez E, Menendez-Torre E. Gestational diabetes mellitus (GDM): relationship between higher cutoff values for 100 g Oral Glucose Tolerance Test (OGTT) and insulin requirement during pregnancy. Matern Child Health J. 2017;21(7):1488–92.CrossRef
22.
go back to reference Bakiner O, Bozkirli E, Ozsahin K, Sariturk C, Ertorer E. Risk factors that can predict antenatal insulin need in gestational diabetes. J Clin Med Res. 2013;5(5):381–8.PubMedPubMedCentral Bakiner O, Bozkirli E, Ozsahin K, Sariturk C, Ertorer E. Risk factors that can predict antenatal insulin need in gestational diabetes. J Clin Med Res. 2013;5(5):381–8.PubMedPubMedCentral
23.
go back to reference Gonzalez-Quintero VH, Istwan NB, Rhea DJ, Tudela CM, Flick AA, de la Torre L, Stanziano GJ. Antenatal factors predicting subsequent need for insulin treatment in women with gestational diabetes. J Womens Health (Larchmt). 2008;17(7):1183–7.CrossRef Gonzalez-Quintero VH, Istwan NB, Rhea DJ, Tudela CM, Flick AA, de la Torre L, Stanziano GJ. Antenatal factors predicting subsequent need for insulin treatment in women with gestational diabetes. J Womens Health (Larchmt). 2008;17(7):1183–7.CrossRef
24.
go back to reference Koning SH, Scheuneman KA, Lutgers HL, Korteweg FJ, van den Berg G, Sollie KM, Roos A, van Loon AJ, Links TP, van Tol KM, et al. Risk stratification for healthcare planning in women with gestational diabetes mellitus. Neth J Med. 2016;74(6):262–9.PubMed Koning SH, Scheuneman KA, Lutgers HL, Korteweg FJ, van den Berg G, Sollie KM, Roos A, van Loon AJ, Links TP, van Tol KM, et al. Risk stratification for healthcare planning in women with gestational diabetes mellitus. Neth J Med. 2016;74(6):262–9.PubMed
25.
go back to reference Mitra S, Nayak PK, Sahoo J, Mathew A, Padma A, Kamalanathan S, Agrawal S. Predictors for antenatal insulin requirement in gestational diabetes. Gynecol Endocrinol. 2014;30(8):565–8.CrossRef Mitra S, Nayak PK, Sahoo J, Mathew A, Padma A, Kamalanathan S, Agrawal S. Predictors for antenatal insulin requirement in gestational diabetes. Gynecol Endocrinol. 2014;30(8):565–8.CrossRef
26.
go back to reference Tan YY, Liauw PC, Yeo GS. Using glucose tolerance test results to predict insulin requirement in women with gestational diabetes. Aust N Z J Obstet Gynaecol. 1995;35(3):262–6.CrossRef Tan YY, Liauw PC, Yeo GS. Using glucose tolerance test results to predict insulin requirement in women with gestational diabetes. Aust N Z J Obstet Gynaecol. 1995;35(3):262–6.CrossRef
27.
go back to reference Wong VW, Jalaludin B. Gestational diabetes mellitus: who requires insulin therapy? Aust N Z J Obstet Gynaecol. 2011;51(5):432–6.CrossRef Wong VW, Jalaludin B. Gestational diabetes mellitus: who requires insulin therapy? Aust N Z J Obstet Gynaecol. 2011;51(5):432–6.CrossRef
28.
go back to reference Souza A, Costa RA, Paganoti CF, Rodrigues AS, Zugaib M, Hadar E, Hod M, Francisco RPV. Can we stratify the risk for insulin need in women diagnosed early with gestational diabetes by fasting blood glucose? J Matern Fetal Neonatal Med. 2019;32(12):2036–41.CrossRef Souza A, Costa RA, Paganoti CF, Rodrigues AS, Zugaib M, Hadar E, Hod M, Francisco RPV. Can we stratify the risk for insulin need in women diagnosed early with gestational diabetes by fasting blood glucose? J Matern Fetal Neonatal Med. 2019;32(12):2036–41.CrossRef
29.
go back to reference Barnes RA, Wong T, Ross GP, Jalaludin BB, Wong VW, Smart CE, Collins CE, MacDonald-Wicks L, Flack JR. A novel validated model for the prediction of insulin therapy initiation and adverse perinatal outcomes in women with gestational diabetes mellitus. Diabetologia. 2016;59(11):2331–8.CrossRef Barnes RA, Wong T, Ross GP, Jalaludin BB, Wong VW, Smart CE, Collins CE, MacDonald-Wicks L, Flack JR. A novel validated model for the prediction of insulin therapy initiation and adverse perinatal outcomes in women with gestational diabetes mellitus. Diabetologia. 2016;59(11):2331–8.CrossRef
30.
go back to reference Mendez-Figueroa H, Daley J, Lopes VV, Coustan DR. Predicting the need for medical therapy in patients with mild gestational diabetes. Am J Perinatol. 2014;31(2):105–12.PubMed Mendez-Figueroa H, Daley J, Lopes VV, Coustan DR. Predicting the need for medical therapy in patients with mild gestational diabetes. Am J Perinatol. 2014;31(2):105–12.PubMed
31.
go back to reference Pertot T, Molyneaux L, Tan K, Ross GP, Yue DK, Wong J. Can common clinical parameters be used to identify patients who will need insulin treatment in gestational diabetes mellitus? Diabetes Care. 2011;34(10):2214–6.CrossRef Pertot T, Molyneaux L, Tan K, Ross GP, Yue DK, Wong J. Can common clinical parameters be used to identify patients who will need insulin treatment in gestational diabetes mellitus? Diabetes Care. 2011;34(10):2214–6.CrossRef
32.
go back to reference Sapienza AD, Francisco RP, Trindade TC, Zugaib M. Factors predicting the need for insulin therapy in patients with gestational diabetes mellitus. Diabetes Res Clin Pract. 2010;88(1):81–6.CrossRef Sapienza AD, Francisco RP, Trindade TC, Zugaib M. Factors predicting the need for insulin therapy in patients with gestational diabetes mellitus. Diabetes Res Clin Pract. 2010;88(1):81–6.CrossRef
Metadata
Title
Development and validation of prediction models for gestational diabetes treatment modality using supervised machine learning: a population-based cohort study
Authors
Lauren D. Liao
Assiamira Ferrara
Mara B. Greenberg
Amanda L. Ngo
Juanran Feng
Zhenhua Zhang
Patrick T. Bradshaw
Alan E. Hubbard
Yeyi Zhu
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2022
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-022-02499-7

Other articles of this Issue 1/2022

BMC Medicine 1/2022 Go to the issue