Skip to main content
Top
Published in: Journal of General Internal Medicine 6/2015

01-06-2015 | Original Research

Predicting Non-Adherence with Outpatient Colonoscopy Using a Novel Electronic Tool that Measures Prior Non-Adherence

Authors: Daniel M. Blumenthal, MD, MBA, Gaurav Singal, MD, Shikha S. Mangla, MD, Eric A. Macklin, Ph.D., Daniel C. Chung, MD

Published in: Journal of General Internal Medicine | Issue 6/2015

Login to get access

ABSTRACT

BACKGROUND

Accurately predicting the risk of no-show for a scheduled colonoscopy can help target interventions to improve compliance with colonoscopy, and thereby reduce the disease burden of colorectal cancer and enhance the utilization of resources within endoscopy units.

OBJECTIVES

We aimed to utilize information available in an electronic medical record (EMR) and endoscopy scheduling system to create a predictive model for no-show risk, and to simultaneously evaluate the role for natural language processing (NLP) in developing such a model.

DESIGN

This was a retrospective observational study using discovery and validation phases to design a colonoscopy non-adherence prediction model. An NLP-derived variable called the Non-Adherence Ratio (“NAR”) was developed, validated, and included in the model.

PARTICIPANTS

Patients scheduled for outpatient colonoscopy at an Academic Medical Center (AMC) that is part of a multi-hospital health system, 2009 to 2011, were included in the study.

MAIN MEASURES

Odds ratios for non-adherence were calculated for all variables in the discovery cohort, and an Area Under the Receiver Operating Curve (AUC) was calculated for the final non-adherence prediction model.

KEY RESULTS

The non-adherence model included six variables: 1) gender; 2) history of psychiatric illness, 3) NAR; 4) wait time in months; 5) number of prior missed endoscopies; and 6) education level. The model achieved discrimination in the validation cohort (AUC= =70.2 %). At a threshold non-adherence score of 0.46, the model’s sensitivity and specificity were 33 % and 92 %, respectively. Removing the NAR from the model significantly reduced its predictive power (AUC = 64.3 %, difference = 5.9 %, p < 0.001).

CONCLUSIONS

A six-variable model using readily available clinical and demographic information demonstrated accuracy for predicting colonoscopy non-adherence. The NAR, a novel variable developed using NLP technology, significantly strengthened this model’s predictive power.
Appendix
Available only for authorised users
Literature
1.
go back to reference Walsh JM, Terdiman JP. Colorectal cancer screening: scientific review. JAMA. 2003;289(10):1288–1296.CrossRefPubMed Walsh JM, Terdiman JP. Colorectal cancer screening: scientific review. JAMA. 2003;289(10):1288–1296.CrossRefPubMed
2.
go back to reference Cesare H, Di Emilio G, Perry JP, et al. Cost effectiveness of colonoscopy, based on the appropriateness of an indication. Clin Gastroenterol Hepatol. 2008;6(11):1231–1236.CrossRef Cesare H, Di Emilio G, Perry JP, et al. Cost effectiveness of colonoscopy, based on the appropriateness of an indication. Clin Gastroenterol Hepatol. 2008;6(11):1231–1236.CrossRef
3.
go back to reference Pignone M, Saha S, Hoerger T, Mandelblatt J. Cost-effectiveness analyses of colorectal cancer screening. Ann Intern Med. 2002;137(2):96–104.CrossRefPubMed Pignone M, Saha S, Hoerger T, Mandelblatt J. Cost-effectiveness analyses of colorectal cancer screening. Ann Intern Med. 2002;137(2):96–104.CrossRefPubMed
4.
go back to reference Doubeni CA, Weinmann S, Adams K, et al. Screening colonoscopy and risk for incident late-stage colorectal cancer diagnosis in average-risk adults. Ann Intern Med. 2013;158(5):312–320.CrossRefPubMedCentralPubMed Doubeni CA, Weinmann S, Adams K, et al. Screening colonoscopy and risk for incident late-stage colorectal cancer diagnosis in average-risk adults. Ann Intern Med. 2013;158(5):312–320.CrossRefPubMedCentralPubMed
5.
go back to reference Winawer SJ, Zauber AG, Ho MN, et al. Prevention of colorectal cancer by colonoscopic polypectomy. N Engl J Med. 1993;329(27):1977–1981.CrossRefPubMed Winawer SJ, Zauber AG, Ho MN, et al. Prevention of colorectal cancer by colonoscopic polypectomy. N Engl J Med. 1993;329(27):1977–1981.CrossRefPubMed
6.
go back to reference Zauber AG, Winawer SJ, O’Brien MJ, et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med. 2012;366(8):687–696.CrossRefPubMedCentralPubMed Zauber AG, Winawer SJ, O’Brien MJ, et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med. 2012;366(8):687–696.CrossRefPubMedCentralPubMed
7.
go back to reference Kazarian ES, Carreira FS, Toribara NW, Denberg TD. Colonoscopy completion in a large safety net health care system. Clin Gastroenterol Hepatol. 2008;6(4):438–442.CrossRefPubMed Kazarian ES, Carreira FS, Toribara NW, Denberg TD. Colonoscopy completion in a large safety net health care system. Clin Gastroenterol Hepatol. 2008;6(4):438–442.CrossRefPubMed
8.
go back to reference Kelly RB, Shank C. Adherence to screening flexible sigmoidoscopy in asymptomatic patients. Med Care. 1992;30(11):1029–1042.CrossRefPubMed Kelly RB, Shank C. Adherence to screening flexible sigmoidoscopy in asymptomatic patients. Med Care. 1992;30(11):1029–1042.CrossRefPubMed
9.
go back to reference Turner BJ, Weiner M, Yang C, TenHave T. Predicting adherence to colonoscopy or flexible sigmoidoscopy on the basis of physician appointment–keeping behavior. Ann Intern Med. 2004;140(7):528–532.CrossRefPubMed Turner BJ, Weiner M, Yang C, TenHave T. Predicting adherence to colonoscopy or flexible sigmoidoscopy on the basis of physician appointment–keeping behavior. Ann Intern Med. 2004;140(7):528–532.CrossRefPubMed
11.
go back to reference Turner B, Weiner M, Berry S, Lillie K, Fosnocht K, Hollenbeak C. Overcoming poor attendance to first scheduled colonoscopy: a randomized trial of peer coach or brochure support. J Gen Intern Med. 2008;23(1):58–63.CrossRefPubMedCentralPubMed Turner B, Weiner M, Berry S, Lillie K, Fosnocht K, Hollenbeak C. Overcoming poor attendance to first scheduled colonoscopy: a randomized trial of peer coach or brochure support. J Gen Intern Med. 2008;23(1):58–63.CrossRefPubMedCentralPubMed
12.
go back to reference Goodwin JS, Singh A, Reddy N, Riall TS, Kuo Y-F. Overuse of screening colonoscopy in the medicare population. Arch Intern Med. 2011;171(15):1335–1343.CrossRefPubMed Goodwin JS, Singh A, Reddy N, Riall TS, Kuo Y-F. Overuse of screening colonoscopy in the medicare population. Arch Intern Med. 2011;171(15):1335–1343.CrossRefPubMed
13.
go back to reference Adams LA, Pawlik J, Forbes GM. Nonattendance at outpatient endoscopy. Endoscopy. 2004;36(5):402–404.CrossRefPubMed Adams LA, Pawlik J, Forbes GM. Nonattendance at outpatient endoscopy. Endoscopy. 2004;36(5):402–404.CrossRefPubMed
14.
go back to reference Green AR, Peters-Lewis A, Percac-Lima S, et al. Barriers to screening colonoscopy for low-income latino and white patients in an urban community health center. J Gen Intern Med. 2008;23(6):834–840.CrossRefPubMedCentralPubMed Green AR, Peters-Lewis A, Percac-Lima S, et al. Barriers to screening colonoscopy for low-income latino and white patients in an urban community health center. J Gen Intern Med. 2008;23(6):834–840.CrossRefPubMedCentralPubMed
15.
go back to reference Sola-vera J, Sáez J, Laveda R, et al. Factors associated with non-attendance at outpatient endoscopy. Scand J Gastroenterol. 2008;43(2):202–206.CrossRefPubMed Sola-vera J, Sáez J, Laveda R, et al. Factors associated with non-attendance at outpatient endoscopy. Scand J Gastroenterol. 2008;43(2):202–206.CrossRefPubMed
16.
go back to reference Gupta M, Holub JL, Eisen G. Do indication and demographics for colonoscopy affect completion? A large national database evaluation. Eur J Gastroenterol Hepatol. 2010;22(5):620–627.CrossRefPubMed Gupta M, Holub JL, Eisen G. Do indication and demographics for colonoscopy affect completion? A large national database evaluation. Eur J Gastroenterol Hepatol. 2010;22(5):620–627.CrossRefPubMed
17.
go back to reference Beydoun H, Beydoun M. Predictors of colorectal cancer screening behaviors among average-risk older adults in the United States. Cancer Causes Control. 2008;19(4):339–359.CrossRefPubMed Beydoun H, Beydoun M. Predictors of colorectal cancer screening behaviors among average-risk older adults in the United States. Cancer Causes Control. 2008;19(4):339–359.CrossRefPubMed
18.
go back to reference Watson AJ, O’Rourke J, Jethwani K, et al. Linking electronic health record-extracted psychosocial data in real-time to risk of readmission for heart failure. Psychosomatics. 2011;52(4):319–327.CrossRefPubMed Watson AJ, O’Rourke J, Jethwani K, et al. Linking electronic health record-extracted psychosocial data in real-time to risk of readmission for heart failure. Psychosomatics. 2011;52(4):319–327.CrossRefPubMed
19.
go back to reference Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc. 2005;12(4):448–457.CrossRefPubMedCentralPubMed Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc. 2005;12(4):448–457.CrossRefPubMedCentralPubMed
20.
go back to reference Denny JC, Peterson JF, Choma NN, et al. Extracting timing and status descriptors for colonoscopy testing from electronic medical records. J Am Med Inform Assoc. 2010;17(4):383–388.CrossRefPubMedCentralPubMed Denny JC, Peterson JF, Choma NN, et al. Extracting timing and status descriptors for colonoscopy testing from electronic medical records. J Am Med Inform Assoc. 2010;17(4):383–388.CrossRefPubMedCentralPubMed
21.
go back to reference Harkema H, Chapman WW, Saul M, Dellon ES, Schoen RE, Mehrotra A. Developing a natural language processing application for measuring the quality of colonoscopy procedures. J Am Med Inform Assoc. 2011;18(Suppl 1):i150–i156.CrossRefPubMedCentralPubMed Harkema H, Chapman WW, Saul M, Dellon ES, Schoen RE, Mehrotra A. Developing a natural language processing application for measuring the quality of colonoscopy procedures. J Am Med Inform Assoc. 2011;18(Suppl 1):i150–i156.CrossRefPubMedCentralPubMed
22.
go back to reference Murff HJ, FitzHenry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306(8):848–855.CrossRefPubMed Murff HJ, FitzHenry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306(8):848–855.CrossRefPubMed
23.
go back to reference Zalis M, Harris M. Advanced search of the electronic medical record: augmenting safety and efficiency in radiology. J Am Coll Radiol. 2011;7(8):625–634.CrossRef Zalis M, Harris M. Advanced search of the electronic medical record: augmenting safety and efficiency in radiology. J Am Coll Radiol. 2011;7(8):625–634.CrossRef
24.
go back to reference Blumenthal DM, Singal G, Mangla S, Macklin EA, Chung DC. 983 predicting noncompliance with scheduled outpatient elective colonoscopy. Gastroenterology. 2012;142(5, Supplement 1):S-173. Blumenthal DM, Singal G, Mangla S, Macklin EA, Chung DC. 983 predicting noncompliance with scheduled outpatient elective colonoscopy. Gastroenterology. 2012;142(5, Supplement 1):S-173.
25.
go back to reference Inadomi JM. Taishotoyama symposium barriers to colorectal cancer screening: economics, capacity and adherence. J Gastroenterol Hepatol. 2008;23:S198–S204.CrossRefPubMed Inadomi JM. Taishotoyama symposium barriers to colorectal cancer screening: economics, capacity and adherence. J Gastroenterol Hepatol. 2008;23:S198–S204.CrossRefPubMed
26.
go back to reference Holden DJ, Jonas DE, Porterfield DS, Reuland D, Harris R. Systematic review: enhancing the use and quality of colorectal cancer screening. Ann Intern Med. 2010;152(10):668–676.CrossRefPubMed Holden DJ, Jonas DE, Porterfield DS, Reuland D, Harris R. Systematic review: enhancing the use and quality of colorectal cancer screening. Ann Intern Med. 2010;152(10):668–676.CrossRefPubMed
27.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.CrossRefPubMedCentralPubMed Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.CrossRefPubMedCentralPubMed
28.
go back to reference Frederiksen BL, Jorgensen T, Brasso K, Holten I, Osler M. Socioeconomic position and participation in colorectal cancer screening. Br J Cancer. 2010;103(10):1496–1501.CrossRefPubMedCentralPubMed Frederiksen BL, Jorgensen T, Brasso K, Holten I, Osler M. Socioeconomic position and participation in colorectal cancer screening. Br J Cancer. 2010;103(10):1496–1501.CrossRefPubMedCentralPubMed
29.
go back to reference Guessous I, Dash C, Lapin P, Doroshenk M, Smith RA, Klabunde CN. Colorectal cancer screening barriers and facilitators in older persons. Prev Med. 2010;50(1–2):3–10.CrossRefPubMed Guessous I, Dash C, Lapin P, Doroshenk M, Smith RA, Klabunde CN. Colorectal cancer screening barriers and facilitators in older persons. Prev Med. 2010;50(1–2):3–10.CrossRefPubMed
30.
go back to reference Anderson J, Fortinsky R, Kleppinger A, Merz-Beyus A, Huntington C III, Lagarde S. Predictors of compliance with free endoscopic colorectal cancer screening in uninsured adults. J Gen Intern Med. 2011;26(8):875–880.CrossRefPubMedCentralPubMed Anderson J, Fortinsky R, Kleppinger A, Merz-Beyus A, Huntington C III, Lagarde S. Predictors of compliance with free endoscopic colorectal cancer screening in uninsured adults. J Gen Intern Med. 2011;26(8):875–880.CrossRefPubMedCentralPubMed
31.
go back to reference Lucas GM, Chaisson RE, Moore RD. Highly active antiretroviral therapy in a large urban clinic: risk factors for virologic failure and adverse drug reactions. Ann Intern Med. 1999;131(2):81–87.CrossRefPubMed Lucas GM, Chaisson RE, Moore RD. Highly active antiretroviral therapy in a large urban clinic: risk factors for virologic failure and adverse drug reactions. Ann Intern Med. 1999;131(2):81–87.CrossRefPubMed
32.
go back to reference Goldman L, Freidin R, Cook E, Eigner J, Grich P. A multivariate approach to the prediction of no-show behavior in a primary care center. Arch Intern Med. 1982;142(3):563–567.CrossRefPubMed Goldman L, Freidin R, Cook E, Eigner J, Grich P. A multivariate approach to the prediction of no-show behavior in a primary care center. Arch Intern Med. 1982;142(3):563–567.CrossRefPubMed
33.
go back to reference Barron WM. Failed appointments: who misses them, why they are missed, and what can be done. Prim Care. 1980;7(4):563–574.PubMed Barron WM. Failed appointments: who misses them, why they are missed, and what can be done. Prim Care. 1980;7(4):563–574.PubMed
34.
go back to reference Alaeddini A, Yang K, Reddy C, Yu S. A probabilistic model for predicting the probability of no-show in hospital appointments. Health Care Manag Sci. 2011;14(2):146–157.CrossRefPubMed Alaeddini A, Yang K, Reddy C, Yu S. A probabilistic model for predicting the probability of no-show in hospital appointments. Health Care Manag Sci. 2011;14(2):146–157.CrossRefPubMed
35.
go back to reference Chariatte V, Berchtold A, Akré C, Michaud P-A, Suris J-C. Missed appointments in an outpatient clinic for adolescents, an approach to predict the risk of missing. J Adolesc Health. 2008;43(1):38–45.CrossRefPubMed Chariatte V, Berchtold A, Akré C, Michaud P-A, Suris J-C. Missed appointments in an outpatient clinic for adolescents, an approach to predict the risk of missing. J Adolesc Health. 2008;43(1):38–45.CrossRefPubMed
36.
go back to reference Daggy J, Lawley M, Willis D, et al. Using no-show modeling to improve clinic performance. Health Inform J. 2010;16(4):246–259.CrossRef Daggy J, Lawley M, Willis D, et al. Using no-show modeling to improve clinic performance. Health Inform J. 2010;16(4):246–259.CrossRef
37.
go back to reference Henderson R. Encouraging attendance at outpatient appointments: can we do more? Scott Med J. 2008;53(1):9–12.CrossRefPubMed Henderson R. Encouraging attendance at outpatient appointments: can we do more? Scott Med J. 2008;53(1):9–12.CrossRefPubMed
38.
go back to reference Neal RD, Lawlor DA, Allgar V, et al. Missed appointments in general practice: retrospective data analysis from four practices. Br J Gen Pract. 2001;51:830–832.PubMedCentralPubMed Neal RD, Lawlor DA, Allgar V, et al. Missed appointments in general practice: retrospective data analysis from four practices. Br J Gen Pract. 2001;51:830–832.PubMedCentralPubMed
39.
go back to reference Dove HG, Schneider KC. The usefulness of patients’ individual characteristics in predicting no-shows in outpatient clinics. Med Care. 1981;19(7):734–740.CrossRefPubMed Dove HG, Schneider KC. The usefulness of patients’ individual characteristics in predicting no-shows in outpatient clinics. Med Care. 1981;19(7):734–740.CrossRefPubMed
40.
go back to reference Lee V, Earnest A, Chen M, Krishnan B. Predictors of failed attendances in a multi-specialty outpatient centre using electronic databases. BMC Health Serv Res. 2005;5(51):1–8. Lee V, Earnest A, Chen M, Krishnan B. Predictors of failed attendances in a multi-specialty outpatient centre using electronic databases. BMC Health Serv Res. 2005;5(51):1–8.
41.
go back to reference Thompson K. Programming techniques: regular expression search algorithm. Commun ACM. 1968;11(6):419–422.CrossRef Thompson K. Programming techniques: regular expression search algorithm. Commun ACM. 1968;11(6):419–422.CrossRef
42.
go back to reference Friedman C, Johnson SB, Forman B, Starren J. Architectural requirements for a multipurpose natural language processor in the clinical environment. Proc Annu Symp Comput Appl Med Care. 1995;347–351. Friedman C, Johnson SB, Forman B, Starren J. Architectural requirements for a multipurpose natural language processor in the clinical environment. Proc Annu Symp Comput Appl Med Care. 1995;347–351.
44.
go back to reference Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff. 2011;30(3):464–471.CrossRef Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff. 2011;30(3):464–471.CrossRef
45.
go back to reference DeVore S, Champion RW. Driving population health through accountable care organizations. Health Aff. 2011;30(1):41–50.CrossRef DeVore S, Champion RW. Driving population health through accountable care organizations. Health Aff. 2011;30(1):41–50.CrossRef
46.
go back to reference Elkin EB, Shapiro E, Snow JG, Zauber AG, Krauskopf MS. The economic impact of a patient navigator program to increase screening colonoscopy. Cancer. 2012;118(23):5982–5988.CrossRefPubMed Elkin EB, Shapiro E, Snow JG, Zauber AG, Krauskopf MS. The economic impact of a patient navigator program to increase screening colonoscopy. Cancer. 2012;118(23):5982–5988.CrossRefPubMed
47.
go back to reference Jandorf L, Gutierrez Y, Lopez J, Christie J, Itzkowitz S. Use of a patient navigator to increase colorectal cancer screening in an urban neighborhood health clinic. J Urban Health. 2005;82(2):216–224.CrossRefPubMedCentralPubMed Jandorf L, Gutierrez Y, Lopez J, Christie J, Itzkowitz S. Use of a patient navigator to increase colorectal cancer screening in an urban neighborhood health clinic. J Urban Health. 2005;82(2):216–224.CrossRefPubMedCentralPubMed
48.
go back to reference Lebwohl B, Neugut A, Stavsky E, et al. Effect of a patient navigator program on the volume and quality of colonoscopy. J Clin Gastroenterol. 2011;45(5):e47–e53.CrossRefPubMedCentralPubMed Lebwohl B, Neugut A, Stavsky E, et al. Effect of a patient navigator program on the volume and quality of colonoscopy. J Clin Gastroenterol. 2011;45(5):e47–e53.CrossRefPubMedCentralPubMed
50.
go back to reference Liang SY, Phillips KA, Nagamine M, Ladabaum U, Haas JS. Rates and predictors of colorectal cancer screening. Prev Chron Dis. 2006;3(4):A117–A129. Liang SY, Phillips KA, Nagamine M, Ladabaum U, Haas JS. Rates and predictors of colorectal cancer screening. Prev Chron Dis. 2006;3(4):A117–A129.
Metadata
Title
Predicting Non-Adherence with Outpatient Colonoscopy Using a Novel Electronic Tool that Measures Prior Non-Adherence
Authors
Daniel M. Blumenthal, MD, MBA
Gaurav Singal, MD
Shikha S. Mangla, MD
Eric A. Macklin, Ph.D.
Daniel C. Chung, MD
Publication date
01-06-2015
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 6/2015
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-014-3165-6

Other articles of this Issue 6/2015

Journal of General Internal Medicine 6/2015 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.