Skip to main content
Top
Published in: BMC Infectious Diseases 1/2017

Open Access 01-12-2017 | Research article

Influenza epidemic surveillance and prediction based on electronic health record data from an out-of-hours general practitioner cooperative: model development and validation on 2003–2015 data

Authors: Barbara Michiels, Van Kinh Nguyen, Samuel Coenen, Philippe Ryckebosch, Nathalie Bossuyt, Niel Hens

Published in: BMC Infectious Diseases | Issue 1/2017

Login to get access

Abstract

Background

Annual influenza epidemics significantly burden health care. Anticipating them allows for timely preparation. The Scientific Institute of Public Health in Belgium (WIV-ISP) monitors the incidence of influenza and influenza-like illnesses (ILIs) and reports on a weekly basis. General practitioners working in out-of-hour cooperatives (OOH GPCs) register diagnoses of ILIs in an instantly accessible electronic health record (EHR) system.
This article has two objectives: to explore the possibility of modelling seasonal influenza epidemics using EHR ILI data from the OOH GPC Deurne-Borgerhout, Belgium, and to attempt to develop a model accurately predicting new epidemics to complement the national influenza surveillance by WIV-ISP.

Method

Validity of the OOH GPC data was assessed by comparing OOH GPC ILI data with WIV-ISP ILI data for the period 2003–2012 and using Pearson’s correlation. The best fitting prediction model based on OOH GPC data was developed on 2003–2012 data and validated on 2012–2015 data. A comparison of this model with other well-established surveillance methods was performed. A 1-week and one-season ahead prediction was formulated.

Results

In the OOH GPC, 72,792 contacts were recorded from 2003 to 2012 and 31,844 from 2012 to 2015. The mean ILI diagnosis/week was 4.77 (IQR 3.00) and 3.44 (IQR 3.00) for the two periods respectively. Correlation between OOHs and WIV-ISP ILI incidence is high ranging from 0.83 up to 0.97. Adding a secular trend (5 year cycle) and using a first-order autoregressive modelling for the epidemic component together with the use of Poisson likelihood produced the best prediction results. The selected model had the best 1-week ahead prediction performance compared to existing surveillance methods. The prediction of the starting week was less accurate (±3 weeks) than the predicted duration of the next season.

Conclusion

OOH GPC data can be used to predict influenza epidemics both accurately and fast 1-week and one-season ahead. It can also be used to complement the national influenza surveillance to anticipate optimal preparation.
Literature
3.
go back to reference Brabazon ED, Carton MW, Murray C, Hederman L, Bedford D. General practice out-of-hours service in Ireland provides a new source of syndromic surveillance data on influenza. Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2010;15(31). Epub 2010/08/27. Brabazon ED, Carton MW, Murray C, Hederman L, Bedford D. General practice out-of-hours service in Ireland provides a new source of syndromic surveillance data on influenza. Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2010;15(31). Epub 2010/08/27.
4.
go back to reference Harder KM, Andersen PH, Baehr I, Nielsen LP, Ethelberg S, Glismann S, et al. Electronic real-time surveillance for influenza-like illness: experience from the 2009 influenza A(H1N1) pandemic in Denmark. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2011;16(3). Epub 2011/01/26. Harder KM, Andersen PH, Baehr I, Nielsen LP, Ethelberg S, Glismann S, et al. Electronic real-time surveillance for influenza-like illness: experience from the 2009 influenza A(H1N1) pandemic in Denmark. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2011;16(3). Epub 2011/01/26.
5.
go back to reference Adriaenssens N, Bartholomeeusen S, Ryckebosch P, Coenen S. Quality of antibiotic prescription during office hours and out-of-hours in Flemish primary care, using European quality indicators. Eur J Gen Pract. 2014;20(2):114–20. doi:10.3109/13814788.2013.828200. Epub 2013/09/04.CrossRefPubMed Adriaenssens N, Bartholomeeusen S, Ryckebosch P, Coenen S. Quality of antibiotic prescription during office hours and out-of-hours in Flemish primary care, using European quality indicators. Eur J Gen Pract. 2014;20(2):114–20. doi:10.​3109/​13814788.​2013.​828200. Epub 2013/09/04.CrossRefPubMed
7.
go back to reference International Classification of Primary Care ICPC-2-R, Revised second edition, WONCA International Classification Committee, Oxford University Press; 2005. ISBN 978-019-856857-5. International Classification of Primary Care ICPC-2-R, Revised second edition, WONCA International Classification Committee, Oxford University Press; 2005. ISBN 978-019-856857-5.
8.
go back to reference Michiels B, Thomas I, Van Royen P, Coenen S. Clinical prediction rules combining signs, symptoms and epidemiological context to distinguish influenza from influenza-like illnesses in primary care: a cross sectional study. BMC Fam Pract. 2011;12:4. doi:10.1186/1471-2296-12-4. Epub 2011/02/11. PubMed PMID: 21306610; PubMed Central PMCID: PMCPmc3045895.CrossRefPubMedPubMedCentral Michiels B, Thomas I, Van Royen P, Coenen S. Clinical prediction rules combining signs, symptoms and epidemiological context to distinguish influenza from influenza-like illnesses in primary care: a cross sectional study. BMC Fam Pract. 2011;12:4. doi:10.​1186/​1471-2296-12-4. Epub 2011/02/11. PubMed PMID: 21306610; PubMed Central PMCID: PMCPmc3045895.CrossRefPubMedPubMedCentral
10.
go back to reference Thomas I, Hombrouck A, Van Gucht S, Weyckmans J, El Kadaani K, Abady M, et al. Virological Surveillance of Influenza in Belgium Season 2014-2015. Brussels: Scientific Institute of Public Health; 2015. Contract No.: D/2015/2505/60. Thomas I, Hombrouck A, Van Gucht S, Weyckmans J, El Kadaani K, Abady M, et al. Virological Surveillance of Influenza in Belgium Season 2014-2015. Brussels: Scientific Institute of Public Health; 2015. Contract No.: D/2015/2505/60.
13.
go back to reference Gelman A, Hwang J, Vehtari A. Understanding predictive information criteria for Bayesian models. Stat Comput. 2013;24(6):997–1016.CrossRef Gelman A, Hwang J, Vehtari A. Understanding predictive information criteria for Bayesian models. Stat Comput. 2013;24(6):997–1016.CrossRef
14.
16.
go back to reference Stroup DF, Williamson GD, Herndon JL, Karon JM. Detection of aberrations in the occurrence of notifiable diseases surveillance data. Stat Med. 1989;8(3):323–9. discussion 31-2. Epub 1989/03/01.CrossRefPubMed Stroup DF, Williamson GD, Herndon JL, Karon JM. Detection of aberrations in the occurrence of notifiable diseases surveillance data. Stat Med. 1989;8(3):323–9. discussion 31-2. Epub 1989/03/01.CrossRefPubMed
17.
go back to reference Farrington P, Andrews N. In: Brookmeyer R, Stroup DF, editors. Monitoring the Health of Populations: Statistical Principles and Methods for Public Health Surveillance. Outbreak detection: application to infectious disease surveillance. New York: OUP USA; 2003. p. 203–31.CrossRef Farrington P, Andrews N. In: Brookmeyer R, Stroup DF, editors. Monitoring the Health of Populations: Statistical Principles and Methods for Public Health Surveillance. Outbreak detection: application to infectious disease surveillance. New York: OUP USA; 2003. p. 203–31.CrossRef
18.
go back to reference Salmon M, Schumacher D, Höhle M. Monitoring Count Time Series in R: Aberration Detection in Public Health Surveillance. J Stat Softw. 2016;arXiv:1411.292 [stat.CO]. Salmon M, Schumacher D, Höhle M. Monitoring Count Time Series in R: Aberration Detection in Public Health Surveillance. J Stat Softw. 2016;arXiv:1411.292 [stat.CO].
21.
go back to reference Azambuja MIR. Influenza recycling and secular trends in mortality and natality. Br Actuar J. 2009;15(Supplement S1):123–50.CrossRef Azambuja MIR. Influenza recycling and secular trends in mortality and natality. Br Actuar J. 2009;15(Supplement S1):123–50.CrossRef
22.
go back to reference Hyndman RJ, Khandakar Y. Automatic time series forecasting: the forecast package for R. J Stat Soft. 2008;27(3):1–22.CrossRef Hyndman RJ, Khandakar Y. Automatic time series forecasting: the forecast package for R. J Stat Soft. 2008;27(3):1–22.CrossRef
23.
go back to reference Held L, Höhle M, Hofmann M. A statistical framework for the analysis of multivariate infectious disease surveillance counts. Stat Model. 2005;5(3):187–99.CrossRef Held L, Höhle M, Hofmann M. A statistical framework for the analysis of multivariate infectious disease surveillance counts. Stat Model. 2005;5(3):187–99.CrossRef
24.
go back to reference Paul M, Held L. Predictive assessment of a non-linear random effects model for multivariate time series of infectious disease counts. Stat Med. 2011;30(10):1118–36. doi:10.1002/sim.4177.PubMed Paul M, Held L. Predictive assessment of a non-linear random effects model for multivariate time series of infectious disease counts. Stat Med. 2011;30(10):1118–36. doi:10.​1002/​sim.​4177.PubMed
25.
Metadata
Title
Influenza epidemic surveillance and prediction based on electronic health record data from an out-of-hours general practitioner cooperative: model development and validation on 2003–2015 data
Authors
Barbara Michiels
Van Kinh Nguyen
Samuel Coenen
Philippe Ryckebosch
Nathalie Bossuyt
Niel Hens
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Infectious Diseases / Issue 1/2017
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-016-2175-x

Other articles of this Issue 1/2017

BMC Infectious Diseases 1/2017 Go to the issue