Skip to main content
Top
Published in: BMC Infectious Diseases 1/2022

Open Access 01-12-2022 | COVID-19 | Research article

On the accuracy of short-term COVID-19 fatality forecasts

Authors: Nino Antulov-Fantulin, Lucas Böttcher

Published in: BMC Infectious Diseases | Issue 1/2022

Login to get access

Abstract

Background

Forecasting new cases, hospitalizations, and disease-induced deaths is an important part of infectious disease surveillance and helps guide health officials in implementing effective countermeasures. For disease surveillance in the US, the Centers for Disease Control and Prevention (CDC) combine more than 65 individual forecasts of these numbers in an ensemble forecast at national and state levels. A similar initiative has been launched by the European CDC (ECDC) in the second half of 2021.

Methods

We collected data on CDC and ECDC ensemble forecasts of COVID-19 fatalities, and we compare them with easily interpretable “Euler” forecasts serving as a model-free benchmark that is only based on the local rate of change of the incidence curve. The term “Euler method” is motivated by the eponymous numerical integration scheme that calculates the value of a function at a future time step based on the current rate of change.

Results

Our results show that simple and easily interpretable “Euler” forecasts can compete favorably with both CDC and ECDC ensemble forecasts on short-term forecasting horizons of 1 week. However, ensemble forecasts better perform on longer forecasting horizons.

Conclusions

Using the current rate of change in incidences as estimates of future incidence changes is useful for epidemic forecasting on short time horizons. An advantage of the proposed method over other forecasting approaches is that it can be implemented with a very limited amount of work and without relying on additional data (e.g., data on human mobility and contact patterns) and high-performance computing systems.
Appendix
Available only for authorised users
Footnotes
1
Additional results for CDC and ECDC forecasts that are based on data that was last updated in January 2022 are provided in the Results section.
 
2
All optimization procedures in this work were robust to regularization parameter selection and were applied in a causal manner. That is, at the prediction time T only historical data \(y(t\le T)\) is being used in the minimization (5).
 
Literature
2.
go back to reference Ray et. al. Ensemble Forecasts of Coronavirus Disease 2019 (COVID-19) in the U.S. medRxiv, 2020. Ray et. al. Ensemble Forecasts of Coronavirus Disease 2019 (COVID-19) in the U.S. medRxiv, 2020.
4.
go back to reference Perc M, Gorišek Miksić N, Slavinec M, Stožer A. Forecasting Covid-19. Front Phys. 2020;8:127.CrossRef Perc M, Gorišek Miksić N, Slavinec M, Stožer A. Forecasting Covid-19. Front Phys. 2020;8:127.CrossRef
5.
go back to reference Appadu AR, Kelil AS, Tijani YO. Comparison of some forecasting methods for covid-19. Alexandria Eng J. 2021;60(1):1565–89.CrossRef Appadu AR, Kelil AS, Tijani YO. Comparison of some forecasting methods for covid-19. Alexandria Eng J. 2021;60(1):1565–89.CrossRef
6.
go back to reference Keeling MJ, Rohani P. Modeling infectious diseases in humans and animals. Princeton University Press, Princeton; 2011.CrossRef Keeling MJ, Rohani P. Modeling infectious diseases in humans and animals. Princeton University Press, Princeton; 2011.CrossRef
7.
go back to reference Böttcher Lucas, Antulov-Fantulin Nino. Unifying continuous, discrete, and hybrid susceptible-infected-recovered processes on networks. Phys Rev Res. 2020;2(3): 033121.CrossRef Böttcher Lucas, Antulov-Fantulin Nino. Unifying continuous, discrete, and hybrid susceptible-infected-recovered processes on networks. Phys Rev Res. 2020;2(3): 033121.CrossRef
8.
go back to reference Mills Terence C. Applied time series analysis: a practical guide to modeling and forecasting. Academic Press, Boca Raton; 2019. Mills Terence C. Applied time series analysis: a practical guide to modeling and forecasting. Academic Press, Boca Raton; 2019.
9.
go back to reference Euler Leonhard. Institutiones calculi integralis, volume 4. Academia Imperialis Scientiarum, 1794. Euler Leonhard. Institutiones calculi integralis, volume 4. Academia Imperialis Scientiarum, 1794.
10.
go back to reference Quarteroni A, Sacco R, Saleri F. Numerical Mathematics, vol. 37. Springer, New York; 2010. Quarteroni A, Sacco R, Saleri F. Numerical Mathematics, vol. 37. Springer, New York; 2010.
11.
go back to reference Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis, 2020. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis, 2020.
12.
go back to reference Anderson Roy M, May Robert M. Infectious diseases of humans: dynamics and control. Oxford University Press, Oxford; 1992. Anderson Roy M, May Robert M. Infectious diseases of humans: dynamics and control. Oxford University Press, Oxford; 1992.
14.
go back to reference Böttcher Lucas, D’Orsogna MariaR, Chou Tom. Using excess deaths and testing statistics to determine COVID-19 mortalities. Eur J Epidemiol. 2021;36(5):545–58.CrossRef Böttcher Lucas, D’Orsogna MariaR, Chou Tom. Using excess deaths and testing statistics to determine COVID-19 mortalities. Eur J Epidemiol. 2021;36(5):545–58.CrossRef
15.
go back to reference Cullum Jane. Numerical differentiation and regularization. SIAM J Num Anal. 1971;8(2):254–65.CrossRef Cullum Jane. Numerical differentiation and regularization. SIAM J Num Anal. 1971;8(2):254–65.CrossRef
16.
go back to reference Chartrand Rick . Numerical differentiation of noisy, nonsmooth data. International Scholarly Research Notices, 2011, 2011. Chartrand Rick . Numerical differentiation of noisy, nonsmooth data. International Scholarly Research Notices, 2011, 2011.
19.
go back to reference Katsikopoulos Konstantinos V, Şimşek Özgür, Buckmann Marcus , Gigerenzer Gerd. Transparent modeling of influenza incidence: Big data or a single data point from psychological theory? Int J Forecast. 2021. Katsikopoulos Konstantinos V, Şimşek Özgür, Buckmann Marcus , Gigerenzer Gerd. Transparent modeling of influenza incidence: Big data or a single data point from psychological theory? Int J Forecast. 2021.
20.
go back to reference Dietvorst BerkeleyJ, Bharti Soaham. People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychol Sci. 2020;31(10):1302–14.CrossRef Dietvorst BerkeleyJ, Bharti Soaham. People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychol Sci. 2020;31(10):1302–14.CrossRef
21.
go back to reference Friedman Jerome, Hastie Trevor, Tibshirani Robert, et al. The elements of statistical learning, vol. 1. Springer, New York; 2001. Friedman Jerome, Hastie Trevor, Tibshirani Robert, et al. The elements of statistical learning, vol. 1. Springer, New York; 2001.
Metadata
Title
On the accuracy of short-term COVID-19 fatality forecasts
Authors
Nino Antulov-Fantulin
Lucas Böttcher
Publication date
01-12-2022
Publisher
BioMed Central
Keyword
COVID-19
Published in
BMC Infectious Diseases / Issue 1/2022
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-022-07205-9

Other articles of this Issue 1/2022

BMC Infectious Diseases 1/2022 Go to the issue