Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Research

A multi-granular stacked regression for forecasting long-term demand in Emergency Departments

Authors: Charlotte James, Richard Wood, Rachel Denholm

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

In the United Kingdom, Emergency Departments (EDs) are under significant pressure due to an ever-increasing number of attendances. Understanding how the capacity of other urgent care services and the health of a population may influence ED attendances is imperative for commissioners and policy makers to develop long-term strategies for reducing this pressure and improving quality and safety.

Methods

We developed a novel multi-granular stacked regression (MGSR) model using publicly available data to predict future mean monthly ED attendances within Clinical Commissioning Group regions in England. The MGSR combines measures of population health and health service capacity in other related settings. We assessed model performance using the R-squared statistic, measuring variance explained, and the Mean Absolute Percentage Error (MAPE), measuring forecasting accuracy. We used the MGSR to forecast ED demand over a 4-year period under hypothetical scenarios where service capacity is increased, or population health is improved.

Results

Measures of service capacity explain 41 ± 4% of the variance in monthly ED attendances and measures of population health explain 62 ± 22%. The MGSR leads to an overall improvement in performance, with an R-squared of 0.79 ± 0.02 and MAPE of 3% when forecasting mean monthly ED attendances per CCG. Using the MGSR to forecast long-term demand under different scenarios, we found improving population health would reduce peak ED attendances per CCG by approximately 1000 per month after 2 years.

Conclusion

Combining models of population health and wider urgent care service capacity for predicting monthly ED attendances leads to an improved performance compared to each model individually. Policies designed to improve population health will reduce ED attendances and enhance quality and safety in the long-term.
Literature
3.
go back to reference Turner J, Knowles E, Simpson R, Sampson F, Dixon S, Long J, Bell-Gorrod H, Jacques R, Coster J, Yang H, Nicholl J. Impact of NHS 111 online on the NHS 111 telephone service and urgent care system: a mixed-methods study. Health Serv Deliv Res. 2021;9(21):1–48.CrossRef Turner J, Knowles E, Simpson R, Sampson F, Dixon S, Long J, Bell-Gorrod H, Jacques R, Coster J, Yang H, Nicholl J. Impact of NHS 111 online on the NHS 111 telephone service and urgent care system: a mixed-methods study. Health Serv Deliv Res. 2021;9(21):1–48.CrossRef
4.
go back to reference Cheng Q, Argon NT, Evans CS, Liu Y, Platts-Mills TF, Ziya S. Forecasting emergency department hourly occupancy using time series analysis. Am J Emerg Med. 2021;48:177–82.CrossRef Cheng Q, Argon NT, Evans CS, Liu Y, Platts-Mills TF, Ziya S. Forecasting emergency department hourly occupancy using time series analysis. Am J Emerg Med. 2021;48:177–82.CrossRef
6.
go back to reference Boyle J, Jessup M, Crilly J, Green D, Lind J, Wallis M, et al. Predicting emergency department admissions. Emerg Med J. 2012;29(5):358–65.CrossRef Boyle J, Jessup M, Crilly J, Green D, Lind J, Wallis M, et al. Predicting emergency department admissions. Emerg Med J. 2012;29(5):358–65.CrossRef
8.
go back to reference Jones SS, Thomas A, Evans RS, Welch SJ, Haug PJ, Snow GL. Forecasting daily patient volumes in the emergency department. Acad Emerg Med. 2008;15(2):159–70.CrossRef Jones SS, Thomas A, Evans RS, Welch SJ, Haug PJ, Snow GL. Forecasting daily patient volumes in the emergency department. Acad Emerg Med. 2008;15(2):159–70.CrossRef
9.
go back to reference Tideman S, Santillana M, Bickel J, Reis B. Internet search query data improve forecasts of daily emergency department volume. J Am Med Inform Assoc. 2019;26(12):1574–83.CrossRef Tideman S, Santillana M, Bickel J, Reis B. Internet search query data improve forecasts of daily emergency department volume. J Am Med Inform Assoc. 2019;26(12):1574–83.CrossRef
10.
go back to reference Vollmer MAC, Glampson B, Mellan T, Mishra S, Mercuri L, Costello C, et al. A unified machine learning approach to time series forecasting applied to demand at emergency departments. BMC Emerg Med. 2021;21(1):9.CrossRef Vollmer MAC, Glampson B, Mellan T, Mishra S, Mercuri L, Costello C, et al. A unified machine learning approach to time series forecasting applied to demand at emergency departments. BMC Emerg Med. 2021;21(1):9.CrossRef
11.
go back to reference Champion R, Kinsman LD, Lee GA, Masman KA, May EA, Mills TM, et al. Forecasting emergency department presentations. Aust Health Rev. 2007;31(1):83–90.CrossRef Champion R, Kinsman LD, Lee GA, Masman KA, May EA, Mills TM, et al. Forecasting emergency department presentations. Aust Health Rev. 2007;31(1):83–90.CrossRef
12.
go back to reference Jilani T, Housley G, Figueredo G, Tang PS, Hatton J, Shaw D. Short and long term predictions of Hospital emergency department attendances. Int J Med Inform. 2019;129:167–74.CrossRef Jilani T, Housley G, Figueredo G, Tang PS, Hatton J, Shaw D. Short and long term predictions of Hospital emergency department attendances. Int J Med Inform. 2019;129:167–74.CrossRef
13.
go back to reference Zhou L, Zhao P, Wu D, Cheng C, Huang H. Time series model for forecasting the number of new admission inpatients. BMC Med Inform Decis Mak. 2018;15(1):39.CrossRef Zhou L, Zhao P, Wu D, Cheng C, Huang H. Time series model for forecasting the number of new admission inpatients. BMC Med Inform Decis Mak. 2018;15(1):39.CrossRef
14.
go back to reference Sudarshan VK, Brabrand M, Range TM, Wiil UK. Performance evaluation of Emergency Department patient arrivals forecasting models by including meteorological and calendar information: a comparative study. Comput Biol Med. 2021;135:104541.CrossRef Sudarshan VK, Brabrand M, Range TM, Wiil UK. Performance evaluation of Emergency Department patient arrivals forecasting models by including meteorological and calendar information: a comparative study. Comput Biol Med. 2021;135:104541.CrossRef
15.
go back to reference Scantlebury R, Rowlands G, Durbaba S, Schofield P, Sidhu K, Ashworth M. Socioeconomic deprivation and accident and emergency attendances: cross-sectional analysis of general practices in England. Br J Gen Pract. 2015;65(639):e649–54.CrossRef Scantlebury R, Rowlands G, Durbaba S, Schofield P, Sidhu K, Ashworth M. Socioeconomic deprivation and accident and emergency attendances: cross-sectional analysis of general practices in England. Br J Gen Pract. 2015;65(639):e649–54.CrossRef
16.
go back to reference Tuominen J, Lomio F, Oksala N, Palomäki A, Peltonen J, Huttunen H, Roine A. Forecasting daily emergency department arrivals using high-dimensional multivariate data: a feature selection approach. BMC Med Inform Decis Mak. 2022;22(1):1–2.CrossRef Tuominen J, Lomio F, Oksala N, Palomäki A, Peltonen J, Huttunen H, Roine A. Forecasting daily emergency department arrivals using high-dimensional multivariate data: a feature selection approach. BMC Med Inform Decis Mak. 2022;22(1):1–2.CrossRef
17.
go back to reference Giebel C, McIntyre JC, Daras K, Gabbay M, Downing J, Pirmohamed M, et al. What are the social predictors of accident and emergency attendance in disadvantaged neighbourhoods? Results from a cross-sectional household health survey in the north west of England. BMJ Open. 2019;9(1):e022820.CrossRef Giebel C, McIntyre JC, Daras K, Gabbay M, Downing J, Pirmohamed M, et al. What are the social predictors of accident and emergency attendance in disadvantaged neighbourhoods? Results from a cross-sectional household health survey in the north west of England. BMJ Open. 2019;9(1):e022820.CrossRef
18.
go back to reference Hull SA, Homer K, Boomla K, Robson J, Ashworth M. Population and patient factors affecting emergency department attendance in London: retrospective cohort analysis of linked primary and secondary care records. Br J Gen Pract. 2018;68(668):e157-67.CrossRef Hull SA, Homer K, Boomla K, Robson J, Ashworth M. Population and patient factors affecting emergency department attendance in London: retrospective cohort analysis of linked primary and secondary care records. Br J Gen Pract. 2018;68(668):e157-67.CrossRef
19.
go back to reference Pedrycz W. Granular computing: an introduction. In: Proceedings joint 9th IFSA world congress and 20th NAFIPS international conference (Cat. No. 01TH8569) 25 Jul 2001 (Vol. 3, pp. 1349–1354). IEEE. Pedrycz W. Granular computing: an introduction. In: Proceedings joint 9th IFSA world congress and 20th NAFIPS international conference (Cat. No. 01TH8569) 25 Jul 2001 (Vol. 3, pp. 1349–1354). IEEE.
20.
go back to reference Kumar N, Baghel BK. Smart stacking of deep learning models for granular joint intent-slot extraction for multi-intent SLU. IEEE Access. 2021;9:97582–90.CrossRef Kumar N, Baghel BK. Smart stacking of deep learning models for granular joint intent-slot extraction for multi-intent SLU. IEEE Access. 2021;9:97582–90.CrossRef
21.
go back to reference Jin J, Zhao Y, Cui R. Research on multi-granularity ensemble learning based on Korean. In: The 2nd international conference on computing and data science, 28 Jan 2021 (pp. 1–6). Jin J, Zhao Y, Cui R. Research on multi-granularity ensemble learning based on Korean. In: The 2nd international conference on computing and data science, 28 Jan 2021 (pp. 1–6).
23.
go back to reference Deng W, Wang G, Zhang X, Xu J, Li G. A multi-granularity combined prediction model based on fuzzy trend forecasting and particle swarm techniques. Neurocomputing. 2016;173:1671–82.CrossRef Deng W, Wang G, Zhang X, Xu J, Li G. A multi-granularity combined prediction model based on fuzzy trend forecasting and particle swarm techniques. Neurocomputing. 2016;173:1671–82.CrossRef
24.
go back to reference Wang J, Zhou H, Hong T, Li X, Wang S. A multi-granularity heterogeneous combination approach to crude oil price forecasting. Energy Econom. 2020;91:104790.CrossRef Wang J, Zhou H, Hong T, Li X, Wang S. A multi-granularity heterogeneous combination approach to crude oil price forecasting. Energy Econom. 2020;91:104790.CrossRef
33.
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825–30. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825–30.
35.
go back to reference Hastie T, Tibshirani R, Friedman JH, Friedman JH. The elements of statistical learning: data mining, inference, and prediction. New York: Springer; 2009.CrossRef Hastie T, Tibshirani R, Friedman JH, Friedman JH. The elements of statistical learning: data mining, inference, and prediction. New York: Springer; 2009.CrossRef
Metadata
Title
A multi-granular stacked regression for forecasting long-term demand in Emergency Departments
Authors
Charlotte James
Richard Wood
Rachel Denholm
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02109-3

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue