Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2012

Open Access 01-12-2012 | Technical advance

Sequential detection of influenza epidemics by the Kolmogorov-Smirnov test

Authors: Pau Closas, Ermengol Coma, Leonardo Méndez

Published in: BMC Medical Informatics and Decision Making | Issue 1/2012

Login to get access

Abstract

Background

Influenza is a well known and common human respiratory infection, causing significant morbidity and mortality every year. Despite Influenza variability, fast and reliable outbreak detection is required for health resource planning. Clinical health records, as published by the Diagnosticat database in Catalonia, host useful data for probabilistic detection of influenza outbreaks.

Methods

This paper proposes a statistical method to detect influenza epidemic activity. Non-epidemic incidence rates are modeled against the exponential distribution, and the maximum likelihood estimate for the decaying factor λ is calculated. The sequential detection algorithm updates the parameter as new data becomes available. Binary epidemic detection of weekly incidence rates is assessed by Kolmogorov-Smirnov test on the absolute difference between the empirical and the cumulative density function of the estimated exponential distribution with significance level 0 ≤ α ≤ 1.

Results

The main advantage with respect to other approaches is the adoption of a statistically meaningful test, which provides an indicator of epidemic activity with an associated probability. The detection algorithm was initiated with parameter λ 0 = 3.8617 estimated from the training sequence (corresponding to non-epidemic incidence rates of the 2008-2009 influenza season) and sequentially updated. Kolmogorov-Smirnov test detected the following weeks as epidemic for each influenza season: 50−10 (2008-2009 season), 38−50 (2009-2010 season), weeks 50−9 (2010-2011 season) and weeks 3 to 12 for the current 2011-2012 season.

Conclusions

Real medical data was used to assess the validity of the approach, as well as to construct a realistic statistical model of weekly influenza incidence rates in non-epidemic periods. For the tested data, the results confirmed the ability of the algorithm to detect the start and the end of epidemic periods. In general, the proposed test could be applied to other data sets to quickly detect influenza outbreaks. The sequential structure of the test makes it suitable for implementation in many platforms at a low computational cost without requiring to store large data sets.
Appendix
Available only for authorised users
Literature
2.
go back to reference Coma E, Méndez L: SISAP: 4 años buceando en mares de datos. AMF. 2010, 6 (8): 473-476. Coma E, Méndez L: SISAP: 4 años buceando en mares de datos. AMF. 2010, 6 (8): 473-476.
4.
go back to reference Sonesson C, Bock D: A review and discussion of prospective statistical surveillance in public health. J R Stat Soc A. 2003, 166 (1): 5-21. 10.1111/1467-985X.00256.CrossRef Sonesson C, Bock D: A review and discussion of prospective statistical surveillance in public health. J R Stat Soc A. 2003, 166 (1): 5-21. 10.1111/1467-985X.00256.CrossRef
6.
go back to reference Serfling RE: Methods for current statistical analysis of excess pneumonia-influenza deaths. Public Health Rep. 1963, 6 (78): 494-506.CrossRef Serfling RE: Methods for current statistical analysis of excess pneumonia-influenza deaths. Public Health Rep. 1963, 6 (78): 494-506.CrossRef
7.
go back to reference Crighton EJ, Moineddin R, Mamdani M, Upshur REG: Influenza and pneumonia hospitalizations in Ontario: a time-series analysis. Epidemiol Infect. 2004, 132 (6): 1167-1174. 10.1017/S0950268804002924.CrossRefPubMedPubMedCentral Crighton EJ, Moineddin R, Mamdani M, Upshur REG: Influenza and pneumonia hospitalizations in Ontario: a time-series analysis. Epidemiol Infect. 2004, 132 (6): 1167-1174. 10.1017/S0950268804002924.CrossRefPubMedPubMedCentral
9.
go back to reference Bock D, Andersson E, Frisén M: Statistical surveillance of epidemics: peak detection of influenza in Sweden. Biometrical J. 2008, 50 (1): 71-85. 10.1002/bimj.200610362.CrossRef Bock D, Andersson E, Frisén M: Statistical surveillance of epidemics: peak detection of influenza in Sweden. Biometrical J. 2008, 50 (1): 71-85. 10.1002/bimj.200610362.CrossRef
10.
go back to reference Martínez-Beneito MA, Conesa D, López-Quílez A, López-Maside A: Bayesian Markov switching models for the early detection of influenza epidemics. Stat Med. 2008, 27: 4455-4468. 10.1002/sim.3320.CrossRefPubMed Martínez-Beneito MA, Conesa D, López-Quílez A, López-Maside A: Bayesian Markov switching models for the early detection of influenza epidemics. Stat Med. 2008, 27: 4455-4468. 10.1002/sim.3320.CrossRefPubMed
13.
go back to reference Aramaki E, Maskawa S, Morita M: Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter. Proc. of the 2011 Conference on Empirical Methods in Natural Language Processing. 2011, Edinburgh, Scotland, UK: Association for Computational Linguistics, 1568-1576. Aramaki E, Maskawa S, Morita M: Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter. Proc. of the 2011 Conference on Empirical Methods in Natural Language Processing. 2011, Edinburgh, Scotland, UK: Association for Computational Linguistics, 1568-1576.
14.
go back to reference Rath TM, Carreras M, Sebastiani P: Automated detection of influenza epidemics with Hidden Markov Models. Advances in Intelligent Data Analysis V. 2003, Berlin, Heidelberg: Springer, 521-532.CrossRef Rath TM, Carreras M, Sebastiani P: Automated detection of influenza epidemics with Hidden Markov Models. Advances in Intelligent Data Analysis V. 2003, Berlin, Heidelberg: Springer, 521-532.CrossRef
15.
go back to reference Papoulis A, Pillai SU: Probability, Random Variables and Stochastic Processes. 2001, New Delhi, India: McGraw–Hill Papoulis A, Pillai SU: Probability, Random Variables and Stochastic Processes. 2001, New Delhi, India: McGraw–Hill
18.
go back to reference Stephens MA: EDF statistics for goodness of fit and some comparisons. J Am Stat Assoc. 1974, 69 (347): 730-737. 10.1080/01621459.1974.10480196.CrossRef Stephens MA: EDF statistics for goodness of fit and some comparisons. J Am Stat Assoc. 1974, 69 (347): 730-737. 10.1080/01621459.1974.10480196.CrossRef
19.
go back to reference Bickel P, Doksum K: Mathematical Statistics: Basic Ideas and Selected Topics, Volume 1. 2001, Upper Saddle River, New Jersey: Prentice Hall Bickel P, Doksum K: Mathematical Statistics: Basic Ideas and Selected Topics, Volume 1. 2001, Upper Saddle River, New Jersey: Prentice Hall
20.
go back to reference Massey FJ: The Kolmogorov-Smirnov test for goodness of fit. J Am Stat Assoc. 1951, 46 (253): 68-78. 10.1080/01621459.1951.10500769.CrossRef Massey FJ: The Kolmogorov-Smirnov test for goodness of fit. J Am Stat Assoc. 1951, 46 (253): 68-78. 10.1080/01621459.1951.10500769.CrossRef
21.
go back to reference Miller LH: Table of percentage points of Kolmogorov statistics. J Am Stat Assoc. 1956, 51 (273): 111-121. 10.1080/01621459.1956.10501314.CrossRef Miller LH: Table of percentage points of Kolmogorov statistics. J Am Stat Assoc. 1956, 51 (273): 111-121. 10.1080/01621459.1956.10501314.CrossRef
22.
go back to reference Pearson E, Hartley H: Biometrika Tables for Statisticians, Volume 2. 1972, England: Cambridge University Press Pearson E, Hartley H: Biometrika Tables for Statisticians, Volume 2. 1972, England: Cambridge University Press
26.
go back to reference Godoy P, Pumarola T, Martínez A, Torner N, Rodés A, Carmona G, Ciruela P, Caylà J, Tortajada C, Domínguez A, Plasència A: Surveillance of the pandemic influenza (H1N1) 2009 in Catalonia: results and implications. Rev Esp Salud Publica. 2011, 1 (85): 37-45. Godoy P, Pumarola T, Martínez A, Torner N, Rodés A, Carmona G, Ciruela P, Caylà J, Tortajada C, Domínguez A, Plasència A: Surveillance of the pandemic influenza (H1N1) 2009 in Catalonia: results and implications. Rev Esp Salud Publica. 2011, 1 (85): 37-45.
28.
go back to reference Cook S, Conrad C, Fowlkes AL, Mohebbi MH: Assessing Google Flu trends performance in the United States during the 2009 influenza virus A(H1N1) pandemic. PLoS ONE. 2011, 6 (8): e23610-10.1371/journal.pone.0023610.CrossRefPubMedPubMedCentral Cook S, Conrad C, Fowlkes AL, Mohebbi MH: Assessing Google Flu trends performance in the United States during the 2009 influenza virus A(H1N1) pandemic. PLoS ONE. 2011, 6 (8): e23610-10.1371/journal.pone.0023610.CrossRefPubMedPubMedCentral
Metadata
Title
Sequential detection of influenza epidemics by the Kolmogorov-Smirnov test
Authors
Pau Closas
Ermengol Coma
Leonardo Méndez
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2012
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-12-112

Other articles of this Issue 1/2012

BMC Medical Informatics and Decision Making 1/2012 Go to the issue