Skip to main content
Top
Published in: BMC Health Services Research 1/2022

Open Access 01-12-2022 | Research

Reducing non-attendance in outpatient appointments: predictive model development, validation, and clinical assessment

Authors: Damià Valero-Bover, Pedro González, Gerard Carot-Sans, Isaac Cano, Pilar Saura, Pilar Otermin, Celia Garcia, Maria Gálvez, Francisco Lupiáñez-Villanueva, Jordi Piera-Jiménez

Published in: BMC Health Services Research | Issue 1/2022

Login to get access

Abstract

Background

Non-attendance to scheduled hospital outpatient appointments may compromise healthcare resource planning, which ultimately reduces the quality of healthcare provision by delaying assessments and increasing waiting lists. We developed a model for predicting non-attendance and assessed the effectiveness of an intervention for reducing non-attendance based on the model.

Methods

The study was conducted in three stages: (1) model development, (2) prospective validation of the model with new data, and (3) a clinical assessment with a pilot study that included the model as a stratification tool to select the patients in the intervention. Candidate models were built using retrospective data from appointments scheduled between January 1, 2015, and November 30, 2018, in the dermatology and pneumology outpatient services of the Hospital Municipal de Badalona (Spain). The predictive capacity of the selected model was then validated prospectively with appointments scheduled between January 7 and February 8, 2019. The effectiveness of selective phone call reminders to patients at high risk of non-attendance according to the model was assessed on all consecutive patients with at least one appointment scheduled between February 25 and April 19, 2019. We finally conducted a pilot study in which all patients identified by the model as high risk of non-attendance were randomly assigned to either a control (no intervention) or intervention group, the last receiving phone call reminders one week before the appointment.

Results

Decision trees were selected for model development. Models were trained and selected using 33,329 appointments in the dermatology service and 21,050 in the pneumology service. Specificity, sensitivity, and accuracy for the prediction of non-attendance were 79.90%, 67.09%, and 73.49% for dermatology, and 71.38%, 57.84%, and 64.61% for pneumology outpatient services. The prospective validation showed a specificity of 78.34% (95%CI 71.07, 84.51) and balanced accuracy of 70.45% for dermatology; and 69.83% (95%CI 60.61, 78.00) for pneumology, respectively. The effectiveness of the intervention was assessed on 1,311 individuals identified as high risk of non-attendance according to the selected model. Overall, the intervention resulted in a significant reduction in the non-attendance rate to both the dermatology and pneumology services, with a decrease of 50.61% (p<0.001) and 39.33% (p=0.048), respectively.

Conclusions

The risk of non-attendance can be adequately estimated using patient information stored in medical records. The patient stratification according to the non-attendance risk allows prioritizing interventions, such as phone call reminders, to effectively reduce non-attendance rates.
Appendix
Available only for authorised users
Literature
1.
go back to reference LaGanga LR. Clinic Overbooking to Improve Patient Access and Increase Provider Productivity*. Decis Sci. 2007;38(2):251–76.CrossRef LaGanga LR. Clinic Overbooking to Improve Patient Access and Increase Provider Productivity*. Decis Sci. 2007;38(2):251–76.CrossRef
2.
go back to reference Bech M. The economics of non-attendance and the expected effect of charging a fine on non-attendees. Health Policy (New York). 2005;74(2):181–91.CrossRef Bech M. The economics of non-attendance and the expected effect of charging a fine on non-attendees. Health Policy (New York). 2005;74(2):181–91.CrossRef
3.
go back to reference Dantas LF. No-shows in appointment scheduling – a systematic literature review. Health Policy (New York). 2018;122(4):412–21.CrossRef Dantas LF. No-shows in appointment scheduling – a systematic literature review. Health Policy (New York). 2018;122(4):412–21.CrossRef
4.
go back to reference Samorani M. Outpatient appointment scheduling given individual day-dependent no-show predictions. Eur J Oper Res. 2015;240(1):245–57.CrossRef Samorani M. Outpatient appointment scheduling given individual day-dependent no-show predictions. Eur J Oper Res. 2015;240(1):245–57.CrossRef
5.
go back to reference Kopach R. Effects of clinical characteristics on successful open access scheduling. Health Care Manag Sci. 2007;10(2):111–24.CrossRef Kopach R. Effects of clinical characteristics on successful open access scheduling. Health Care Manag Sci. 2007;10(2):111–24.CrossRef
6.
go back to reference Hardy KJ. Quality improvement report: Information given to patients before appointments and its effect on non-attendance rate. BMJ. 2001;323(7324):1298–300.CrossRef Hardy KJ. Quality improvement report: Information given to patients before appointments and its effect on non-attendance rate. BMJ. 2001;323(7324):1298–300.CrossRef
7.
go back to reference Guy R. How effective are short message service reminders at increasing clinic attendance? A meta-analysis and systematic review. Health Serv Res. 2012;47(2):614–32.CrossRef Guy R. How effective are short message service reminders at increasing clinic attendance? A meta-analysis and systematic review. Health Serv Res. 2012;47(2):614–32.CrossRef
8.
go back to reference Pollastri AR. Incentive program decreases no-shows in nontreatment substance abuse research. Exp Clin Psychopharmacol. 2005;13(4):376–80.CrossRef Pollastri AR. Incentive program decreases no-shows in nontreatment substance abuse research. Exp Clin Psychopharmacol. 2005;13(4):376–80.CrossRef
9.
go back to reference Chen Z. Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: A randomized controlled trial. J Zhejiang Univ Sci B. 2008;9(1):34–8.CrossRef Chen Z. Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: A randomized controlled trial. J Zhejiang Univ Sci B. 2008;9(1):34–8.CrossRef
10.
go back to reference Gurol-Urganci I. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev. 2013;2017(12) Gurol-Urganci I. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev. 2013;2017(12)
11.
go back to reference Parikh A. The Effectiveness of Outpatient Appointment Reminder Systems in Reducing No-Show Rates. Am J Med. 2010;123(6):542–8.CrossRef Parikh A. The Effectiveness of Outpatient Appointment Reminder Systems in Reducing No-Show Rates. Am J Med. 2010;123(6):542–8.CrossRef
12.
go back to reference Norris JB. An empirical investigation into factors affecting patient cancellations and no-shows at outpatient clinics. Decis Support Syst. 2014;57:428–43.CrossRef Norris JB. An empirical investigation into factors affecting patient cancellations and no-shows at outpatient clinics. Decis Support Syst. 2014;57:428–43.CrossRef
13.
go back to reference Torres O. Risk factor model to predict a missed clinic appointment in an urban, academic, and underserved setting. Popul Health Manag. 2015;18(2):131–6.CrossRef Torres O. Risk factor model to predict a missed clinic appointment in an urban, academic, and underserved setting. Popul Health Manag. 2015;18(2):131–6.CrossRef
14.
go back to reference Carreras-García D. Patient no-show prediction: A systematic literature review. Entropy. 2020;22(6) Carreras-García D. Patient no-show prediction: A systematic literature review. Entropy. 2020;22(6)
15.
go back to reference McMahan HB. Ad click prediction: a view from the trenches. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining; 2013. p. 1222–30.CrossRef McMahan HB. Ad click prediction: a view from the trenches. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining; 2013. p. 1222–30.CrossRef
17.
go back to reference Rudolph JW. There’s no such thing as “nonjudgmental” debriefing: a theory and method for debriefing with good judgment. Simul Healthc. 2006;1(1):49–55.CrossRef Rudolph JW. There’s no such thing as “nonjudgmental” debriefing: a theory and method for debriefing with good judgment. Simul Healthc. 2006;1(1):49–55.CrossRef
18.
go back to reference Ahmad MU. A predictive model for decreasing clinical no-show rates in a primary care setting. Int. J Healthc Manag. 2019; Ahmad MU. A predictive model for decreasing clinical no-show rates in a primary care setting. Int. J Healthc Manag. 2019;
19.
go back to reference Gromisch ES. Who is not coming to clinic? A predictive model of excessive missed appointments in persons with multiple sclerosis. Mult Scler Relat Disord. 2020;38 Gromisch ES. Who is not coming to clinic? A predictive model of excessive missed appointments in persons with multiple sclerosis. Mult Scler Relat Disord. 2020;38
20.
go back to reference Daggy J. Using no-show modeling to improve clinic performance. Health Inform J. 2010;16(4):246–59.CrossRef Daggy J. Using no-show modeling to improve clinic performance. Health Inform J. 2010;16(4):246–59.CrossRef
21.
go back to reference Ding X. Designing risk prediction models for ambulatory no-shows across different specialties and clinics. J Am Med Informatics Assoc. 2018;25(8):924–30.CrossRef Ding X. Designing risk prediction models for ambulatory no-shows across different specialties and clinics. J Am Med Informatics Assoc. 2018;25(8):924–30.CrossRef
22.
go back to reference Elvira C. Machine-Learning-Based No Show Prediction in Outpatient Visits. Int J Interact Multimed Artif Intell. 2018;4(7):29. Elvira C. Machine-Learning-Based No Show Prediction in Outpatient Visits. Int J Interact Multimed Artif Intell. 2018;4(7):29.
23.
go back to reference Chua SL. Development of predictive scoring model for risk stratification of no-show at a public hospital specialist outpatient clinic. Proc Singapore Healthc. 2019;28(2):96–104.CrossRef Chua SL. Development of predictive scoring model for risk stratification of no-show at a public hospital specialist outpatient clinic. Proc Singapore Healthc. 2019;28(2):96–104.CrossRef
24.
go back to reference Suk M-Y. Evaluation of Patient No-Shows in a Tertiary Hospital: Focusing on Modes of Appointment-Making and Type of Appointment. Int J Environ Res Public Health. 2021;18(6):3288.CrossRef Suk M-Y. Evaluation of Patient No-Shows in a Tertiary Hospital: Focusing on Modes of Appointment-Making and Type of Appointment. Int J Environ Res Public Health. 2021;18(6):3288.CrossRef
25.
go back to reference Chong LR. Artificial Intelligence Predictive Analytics in the Management of Outpatient MRI Appointment No-Shows. Am J Roentgenol. 2020:1–8. Chong LR. Artificial Intelligence Predictive Analytics in the Management of Outpatient MRI Appointment No-Shows. Am J Roentgenol. 2020:1–8.
26.
go back to reference Lagman RL. “If You Call Them, They Will Come”: A Telephone Call Reminder to Decrease the No-Show Rate in an Outpatient Palliative Medicine Clinic. Am J Hosp Palliat Med. 2020; Lagman RL. “If You Call Them, They Will Come”: A Telephone Call Reminder to Decrease the No-Show Rate in an Outpatient Palliative Medicine Clinic. Am J Hosp Palliat Med. 2020;
27.
go back to reference Leong KC. The use of text messaging to improve attendance in primary care: A randomized controlled trial. Fam Pract. 2006;23(6):699–705.CrossRef Leong KC. The use of text messaging to improve attendance in primary care: A randomized controlled trial. Fam Pract. 2006;23(6):699–705.CrossRef
28.
go back to reference Prytherch DR. ViEWS—towards a national early warning score for detecting adult inpatient deterioration. Resuscitation. 2010;81(8):932–7.CrossRef Prytherch DR. ViEWS—towards a national early warning score for detecting adult inpatient deterioration. Resuscitation. 2010;81(8):932–7.CrossRef
29.
go back to reference Gomes MAG. No-shows at public secondary dental care for pediatric patients: a cross-sectional study in a large Brazilian city. Cien Saude Colet. 2019;24(5):1915–23.CrossRef Gomes MAG. No-shows at public secondary dental care for pediatric patients: a cross-sectional study in a large Brazilian city. Cien Saude Colet. 2019;24(5):1915–23.CrossRef
30.
go back to reference Miller AJ. Predictors of repeated “no-showing” to clinic appointments. Am J Otolaryngol - Head Neck Med Surg. 2015;36(3):411–4. Miller AJ. Predictors of repeated “no-showing” to clinic appointments. Am J Otolaryngol - Head Neck Med Surg. 2015;36(3):411–4.
31.
go back to reference Jensen H. Characteristics of customary non-attenders in general practice who are diagnosed with cancer: A cross-sectional study in Denmark. Eur J Cancer Care (Engl). 2019;28(6) Jensen H. Characteristics of customary non-attenders in general practice who are diagnosed with cancer: A cross-sectional study in Denmark. Eur J Cancer Care (Engl). 2019;28(6)
32.
go back to reference Wolff DL. Rate and predictors for non-attendance of patients undergoing hospital outpatient treatment for chronic diseases: A register-based cohort study. BMC Health Serv Res. 2019;19(1):386.CrossRef Wolff DL. Rate and predictors for non-attendance of patients undergoing hospital outpatient treatment for chronic diseases: A register-based cohort study. BMC Health Serv Res. 2019;19(1):386.CrossRef
33.
go back to reference Coleman MM. Injury type and emergency department management of orthopaedic patients influences follow-up rates. J Bone Jt Surg Am. 2014;96(19):1650–8.CrossRef Coleman MM. Injury type and emergency department management of orthopaedic patients influences follow-up rates. J Bone Jt Surg Am. 2014;96(19):1650–8.CrossRef
Metadata
Title
Reducing non-attendance in outpatient appointments: predictive model development, validation, and clinical assessment
Authors
Damià Valero-Bover
Pedro González
Gerard Carot-Sans
Isaac Cano
Pilar Saura
Pilar Otermin
Celia Garcia
Maria Gálvez
Francisco Lupiáñez-Villanueva
Jordi Piera-Jiménez
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2022
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-022-07865-y

Other articles of this Issue 1/2022

BMC Health Services Research 1/2022 Go to the issue