Skip to main content
Top
Published in: Digestive Diseases and Sciences 7/2022

24-06-2021 | Colonoscopy | Original Article

Regression and Random Forest Machine Learning Have Limited Performance in Predicting Bowel Preparation in Veteran Population

Authors: Jacob E. Kurlander, Akbar K. Waljee, Stacy B. Menees, Rachel Lipson, Alex N. Kokaly, Andrew J. Read, Karmel S. Shehadeh, Amy Cohn, Sameer D. Saini

Published in: Digestive Diseases and Sciences | Issue 7/2022

Login to get access

Abstract

Background

Inadequate bowel preparation undermines the quality of colonoscopy, but patients likely to be affected are difficult to identify beforehand.

Aims

This study aimed to develop, validate, and compare prediction models for bowel preparation inadequacy using conventional logistic regression (LR) and random forest machine learning (RFML).

Methods

We created a retrospective cohort of patients who underwent outpatient colonoscopy at a single VA medical center between January 2012 and October 2015. Candidate predictor variables were chosen after a literature review. We extracted all available predictor variables from the electronic medical record, and bowel preparation from the endoscopy database. The data were split into 70% training and 30% validation sets. Multivariable LR and RFML were used to predict preparation inadequacy as a dichotomous outcome.

Results

The cohort included 6,885 Veterans, of whom 964 (14%) had inadequate preparation. Using LR, the area under the receiver operating characteristic curve (AUC) for the validation cohort was 0.66 (95% CI 0.62, 0.69) and the Brier score, in which a lower score indicates better performance, was 0.11. Using RFML, the AUC for the validation cohort was 0.61 (95% CI 0.58, 0.65) and the Brier score was 0.12.

Conclusions

LR and RFML had similar performance in predicting bowel preparation, which was modest and likely insufficient for use in practice. Future research is needed to identify additional predictor variables and to test other machine learning algorithms. At present, endoscopy units should focus on universal strategies to enhance preparation adequacy.
Appendix
Available only for authorised users
Literature
1.
go back to reference US Preventive Services Task Force, Davidson KW, Barry MJ, Mangione CM et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2021;325:1965.CrossRef US Preventive Services Task Force, Davidson KW, Barry MJ, Mangione CM et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2021;325:1965.CrossRef
3.
go back to reference Johnson DA, Barkun AN, Cohen LB et al. Optimizing adequacy of bowel cleansing for colonoscopy: recommendations from the US Multi-Society Task Force on Colorectal Cancer. Gastrointest Endosc. 2014;80:543–562.CrossRef Johnson DA, Barkun AN, Cohen LB et al. Optimizing adequacy of bowel cleansing for colonoscopy: recommendations from the US Multi-Society Task Force on Colorectal Cancer. Gastrointest Endosc. 2014;80:543–562.CrossRef
4.
go back to reference Kilgore TW, Abdinoor AA, Szary NM et al. Bowel preparation with split-dose polyethylene glycol before colonoscopy: a meta-analysis of randomized controlled trials. Gastrointest Endosc. 2011;73:1240–1245.CrossRef Kilgore TW, Abdinoor AA, Szary NM et al. Bowel preparation with split-dose polyethylene glycol before colonoscopy: a meta-analysis of randomized controlled trials. Gastrointest Endosc. 2011;73:1240–1245.CrossRef
5.
go back to reference Sim JS, Koo JS. Predictors of inadequate bowel preparation and salvage options on colonoscopy. Clin Endosc. 2016;49:346–349.CrossRef Sim JS, Koo JS. Predictors of inadequate bowel preparation and salvage options on colonoscopy. Clin Endosc. 2016;49:346–349.CrossRef
6.
go back to reference Woo DH, Kim KO, Jeong DE et al. Prospective analysis of factors associated with inadequate bowel preparation for colonoscopy in actual clinical practice. Intest Res. 2018;16:293.CrossRef Woo DH, Kim KO, Jeong DE et al. Prospective analysis of factors associated with inadequate bowel preparation for colonoscopy in actual clinical practice. Intest Res. 2018;16:293.CrossRef
7.
go back to reference Rutherford CC, Calderwood AH. Update on bowel preparation for colonoscopy. Curr Treat Options Gastroenterol. 2018;16:165–181.CrossRef Rutherford CC, Calderwood AH. Update on bowel preparation for colonoscopy. Curr Treat Options Gastroenterol. 2018;16:165–181.CrossRef
8.
go back to reference Lebwohl B, Kastrinos F, Glick M, et al. The impact of suboptimal bowel preparation on adenoma miss rates and the factors associated with early repeat colonoscopy. Gastrointest Endosc. 2011;73:1207–1214.CrossRef Lebwohl B, Kastrinos F, Glick M, et al. The impact of suboptimal bowel preparation on adenoma miss rates and the factors associated with early repeat colonoscopy. Gastrointest Endosc. 2011;73:1207–1214.CrossRef
9.
go back to reference Froehlich F, Wietlisbach V, Gonvers J-J, Burnand B, Vader J-P. Impact of colonic cleansing on quality and diagnostic yield of colonoscopy: The European Panel of Appropriateness of Gastrointestinal Endoscopy European multicenter study. Gastrointest Endosc. 2005;61:378–384.CrossRef Froehlich F, Wietlisbach V, Gonvers J-J, Burnand B, Vader J-P. Impact of colonic cleansing on quality and diagnostic yield of colonoscopy: The European Panel of Appropriateness of Gastrointestinal Endoscopy European multicenter study. Gastrointest Endosc. 2005;61:378–384.CrossRef
10.
go back to reference Rex DK, Imperiale TF, Latinovich DR, Bratcher LL. Impact of bowel preparation on efficiency and cost of colonoscopy. Am J Gastroenterol. 2002;97:1696–1700.CrossRef Rex DK, Imperiale TF, Latinovich DR, Bratcher LL. Impact of bowel preparation on efficiency and cost of colonoscopy. Am J Gastroenterol. 2002;97:1696–1700.CrossRef
11.
go back to reference ASGE Standards of Practice Committee. Saltzman JR, Cash BD, Pasha SF, Early DS, Muthusamy VR, et al. Bowel preparation before colonoscopy. Gastrointest Endosc. 2015;81:781–794. ASGE Standards of Practice Committee. Saltzman JR, Cash BD, Pasha SF, Early DS, Muthusamy VR, et al. Bowel preparation before colonoscopy. Gastrointest Endosc. 2015;81:781–794.
12.
go back to reference Chung YW, Han DS, Park KH et al. Patient factors predictive of inadequate bowel preparation using polyethylene glycol: a prospective study in Korea. J Clin Gastroenterol. 2009;43:448–452.CrossRef Chung YW, Han DS, Park KH et al. Patient factors predictive of inadequate bowel preparation using polyethylene glycol: a prospective study in Korea. J Clin Gastroenterol. 2009;43:448–452.CrossRef
13.
go back to reference Ness RM, Manam R, Hoen H, Chalasani N. Predictors of inadequate bowel preparation for colonoscopy. Am J Gastroenterol. 2001;96:1797–1802.CrossRef Ness RM, Manam R, Hoen H, Chalasani N. Predictors of inadequate bowel preparation for colonoscopy. Am J Gastroenterol. 2001;96:1797–1802.CrossRef
14.
go back to reference Nguyen DL, Wieland M. Risk factors predictive of poor quality preparation during average risk colonoscopy screening: the importance of health literacy. J Gastrointestin Liver Dis. 2010;19:369–372.PubMed Nguyen DL, Wieland M. Risk factors predictive of poor quality preparation during average risk colonoscopy screening: the importance of health literacy. J Gastrointestin Liver Dis. 2010;19:369–372.PubMed
15.
go back to reference Dik VK, Moons LMG, Hüyük M et al. Predicting inadequate bowel preparation for colonoscopy in participants receiving split-dose bowel preparation: development and validation of a prediction score. Gastrointest Endosc 2015;81:665–672.CrossRef Dik VK, Moons LMG, Hüyük M et al. Predicting inadequate bowel preparation for colonoscopy in participants receiving split-dose bowel preparation: development and validation of a prediction score. Gastrointest Endosc 2015;81:665–672.CrossRef
16.
go back to reference Hassan C, Fuccio L, Bruno M et al. A predictive model identifies patients most likely to have inadequate bowel preparation for colonoscopy. Clin Gastroenterol Hepatol. 2012;10:501–506.CrossRef Hassan C, Fuccio L, Bruno M et al. A predictive model identifies patients most likely to have inadequate bowel preparation for colonoscopy. Clin Gastroenterol Hepatol. 2012;10:501–506.CrossRef
17.
go back to reference Modi R, Wang HS, Sharma GN et al. 911 Development of an online calculator to predict sub-optimal bowel preparation among patients scheduled for colonoscopy. Gastrointest Endosc. 2012;75:AB170.CrossRef Modi R, Wang HS, Sharma GN et al. 911 Development of an online calculator to predict sub-optimal bowel preparation among patients scheduled for colonoscopy. Gastrointest Endosc. 2012;75:AB170.CrossRef
19.
go back to reference Waljee AK, Mukherjee A, Singal AG et al. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open 2013;3:002847.CrossRef Waljee AK, Mukherjee A, Singal AG et al. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open 2013;3:002847.CrossRef
20.
go back to reference Gaduputi V, Chandrala C, Tariq H, Sakam S, Dev A, Chilimuri S. Influence of perception of colorectal cancer risk and patient bowel preparation behaviors: a study in minority populations. Clin Exp Gastroenterol. 2015;8:69–75.PubMedPubMedCentral Gaduputi V, Chandrala C, Tariq H, Sakam S, Dev A, Chilimuri S. Influence of perception of colorectal cancer risk and patient bowel preparation behaviors: a study in minority populations. Clin Exp Gastroenterol. 2015;8:69–75.PubMedPubMedCentral
21.
go back to reference Cheng R-W, Chiu Y-C, Wu K-L et al. Predictive factors for inadequate colon preparation before colonoscopy. Tech Coloproctology. 2015;19:111–115.CrossRef Cheng R-W, Chiu Y-C, Wu K-L et al. Predictive factors for inadequate colon preparation before colonoscopy. Tech Coloproctology. 2015;19:111–115.CrossRef
22.
go back to reference Quan H, Li B, Couris CM et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–682.CrossRef Quan H, Li B, Couris CM et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–682.CrossRef
23.
go back to reference Waljee AK, Higgins PDR, Singal AG. A primer on predictive models. Clin Transl Gastroenterol 2014;5:e44.CrossRef Waljee AK, Higgins PDR, Singal AG. A primer on predictive models. Clin Transl Gastroenterol 2014;5:e44.CrossRef
24.
go back to reference Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement.
25.
go back to reference Singal AG, Mukherjee A, Joseph Elmunzer B et al. Machine learning algorithms outperform conventional regression models in predicting development of hepatocellular carcinoma. Am J Gastroenterol. 2013;108:1723–1730.CrossRef Singal AG, Mukherjee A, Joseph Elmunzer B et al. Machine learning algorithms outperform conventional regression models in predicting development of hepatocellular carcinoma. Am J Gastroenterol. 2013;108:1723–1730.CrossRef
26.
go back to reference Gulshan V, Peng L, Coram M et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402–2410.CrossRef Gulshan V, Peng L, Coram M et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402–2410.CrossRef
27.
go back to reference Frizzell JD, Liang L, Schulte PJ et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol. 2017;2:204–209.CrossRef Frizzell JD, Liang L, Schulte PJ et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol. 2017;2:204–209.CrossRef
28.
go back to reference Beam AL, Kohane IS. Big data and machine learning in health care. JAMA. 2018;319:1317–1318.CrossRef Beam AL, Kohane IS. Big data and machine learning in health care. JAMA. 2018;319:1317–1318.CrossRef
29.
go back to reference van der Ploeg T, Austin PC, Steyerberg EW. Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints. BMC Med Res Methodol. 2014;14:137.CrossRef van der Ploeg T, Austin PC, Steyerberg EW. Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints. BMC Med Res Methodol. 2014;14:137.CrossRef
30.
go back to reference Parmar R, Martel M, Rostom A, Barkun AN. Validated scales for colon cleansing: a systematic review. Am J Gastroenterol. 2016;111:197–204.CrossRef Parmar R, Martel M, Rostom A, Barkun AN. Validated scales for colon cleansing: a systematic review. Am J Gastroenterol. 2016;111:197–204.CrossRef
Metadata
Title
Regression and Random Forest Machine Learning Have Limited Performance in Predicting Bowel Preparation in Veteran Population
Authors
Jacob E. Kurlander
Akbar K. Waljee
Stacy B. Menees
Rachel Lipson
Alex N. Kokaly
Andrew J. Read
Karmel S. Shehadeh
Amy Cohn
Sameer D. Saini
Publication date
24-06-2021
Publisher
Springer US
Keyword
Colonoscopy
Published in
Digestive Diseases and Sciences / Issue 7/2022
Print ISSN: 0163-2116
Electronic ISSN: 1573-2568
DOI
https://doi.org/10.1007/s10620-021-07113-z

Other articles of this Issue 7/2022

Digestive Diseases and Sciences 7/2022 Go to the issue