Skip to main content
Top
Published in: BMC Public Health 1/2012

Open Access 01-12-2012 | Research article

Epidemic features affecting the performance of outbreak detection algorithms

Authors: Jie Kuang, Wei Zhong Yang, Ding Lun Zhou, Zhong Jie Li, Ya Jia Lan

Published in: BMC Public Health | Issue 1/2012

Login to get access

Abstract

Background

Outbreak detection algorithms play an important role in effective automated surveillance. Although many algorithms have been designed to improve the performance of outbreak detection, few published studies have examined how epidemic features of infectious disease impact on the detection performance of algorithms. This study compared the performance of three outbreak detection algorithms stratified by epidemic features of infectious disease and examined the relationship between epidemic features and performance of outbreak detection algorithms.

Methods

Exponentially weighted moving average (EWMA), cumulative sum (CUSUM) and moving percentile method (MPM) algorithms were applied. We inserted simulated outbreaks into notifiable infectious disease data in China Infectious Disease Automated-alert and Response System (CIDARS), and compared the performance of the three algorithms with optimized parameters at a fixed false alarm rate of 5% classified by epidemic features of infectious disease. Multiple linear regression was adopted to analyse the relationship of the algorithms’ sensitivity and timeliness with the epidemic features of infectious diseases.

Results

The MPM had better detection performance than EWMA and CUSUM through all simulated outbreaks, with or without stratification by epidemic features (incubation period, baseline counts and outbreak magnitude). The epidemic features were associated with both sensitivity and timeliness. Compared with long incubation, short incubation had lower probability (β* = −0.13, P < 0.001) but needed shorter time to detect outbreaks (β* = −0.57, P < 0.001). Lower baseline counts were associated with higher probability (β* = −0.20, P < 0.001) and longer time (β* = 0.14, P < 0.001). The larger outbreak magnitude was correlated with higher probability (β* = 0.55, P < 0.001) and shorter time (β* = −0.23, P < 0.001).

Conclusions

The results of this study suggest that the MPM is a prior algorithm for outbreak detection and differences of epidemic features in detection performance should be considered in automatic surveillance practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wang LD, Wang Y, Jin SG, Wu ZY, Chin DP, Koplan JP, Wilson ME: Emergence and control of infectious diseases in China. Lancet. 2008, 372 (9649): 1598-1605. 10.1016/S0140-6736(08)61365-3.CrossRefPubMed Wang LD, Wang Y, Jin SG, Wu ZY, Chin DP, Koplan JP, Wilson ME: Emergence and control of infectious diseases in China. Lancet. 2008, 372 (9649): 1598-1605. 10.1016/S0140-6736(08)61365-3.CrossRefPubMed
2.
go back to reference Ministry of Health of the People’s Republic of China: Emergency infectious disease prevention and control strategies. 2007, Ministry of Health of the People’s Republic of China, Beijing Ministry of Health of the People’s Republic of China: Emergency infectious disease prevention and control strategies. 2007, Ministry of Health of the People’s Republic of China, Beijing
3.
go back to reference Yang WZ, Li ZJ, Lan YJ, Wang JF, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ, Liao YL, Hu WB: A nationwide web-based automated system for outbreak early detection and rapid response in China. Western Pacific Surveillance and Response Journal. 2011, 2 (1): 1-6. Yang WZ, Li ZJ, Lan YJ, Wang JF, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ, Liao YL, Hu WB: A nationwide web-based automated system for outbreak early detection and rapid response in China. Western Pacific Surveillance and Response Journal. 2011, 2 (1): 1-6.
4.
go back to reference Yang WZ, Lan YJ, Li ZJ, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ: The application of national outbreak automatic detection and response system, China. Chin J Epidemiol. 2010, 31 (11): 1240-1244. Yang WZ, Lan YJ, Li ZJ, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ: The application of national outbreak automatic detection and response system, China. Chin J Epidemiol. 2010, 31 (11): 1240-1244.
5.
go back to reference Wang L, Ramoni MF, Mandl KD, Sebastiani P: Factors affecting automated syndromic surveillance. Artificial Intelligence in Medicine. 2005, 34 (3): 269-278. 10.1016/j.artmed.2004.11.002.CrossRefPubMed Wang L, Ramoni MF, Mandl KD, Sebastiani P: Factors affecting automated syndromic surveillance. Artificial Intelligence in Medicine. 2005, 34 (3): 269-278. 10.1016/j.artmed.2004.11.002.CrossRefPubMed
6.
go back to reference Buckeridge DL: Outbreak detection through automated surveillance: A review of the determinants of detection. Journal of Biomedical Informatics. 2007, 40 (4): 370-379. 10.1016/j.jbi.2006.09.003.CrossRefPubMed Buckeridge DL: Outbreak detection through automated surveillance: A review of the determinants of detection. Journal of Biomedical Informatics. 2007, 40 (4): 370-379. 10.1016/j.jbi.2006.09.003.CrossRefPubMed
7.
go back to reference Wang XL, Zeng D, Seale H, Cheng H, Luan RS, He X, Pang XH, Dou XF, Wang QY: Comparing early outbreak detection algorithms based on their optimized parameter values. Journal of Biomedical Informatics. 2010, 43 (1): 97-103. 10.1016/j.jbi.2009.08.003.CrossRefPubMed Wang XL, Zeng D, Seale H, Cheng H, Luan RS, He X, Pang XH, Dou XF, Wang QY: Comparing early outbreak detection algorithms based on their optimized parameter values. Journal of Biomedical Informatics. 2010, 43 (1): 97-103. 10.1016/j.jbi.2009.08.003.CrossRefPubMed
8.
go back to reference Pelecanos AM, Ryan PA, Gatton ML: Outbreak detection algorithms for seasonal disease data: a case study using ross river virus disease. BMC Med Inform Decis Mak. 2010, 10: 74-10.1186/1472-6947-10-74.CrossRefPubMedPubMedCentral Pelecanos AM, Ryan PA, Gatton ML: Outbreak detection algorithms for seasonal disease data: a case study using ross river virus disease. BMC Med Inform Decis Mak. 2010, 10: 74-10.1186/1472-6947-10-74.CrossRefPubMedPubMedCentral
9.
go back to reference Watkins RE, Eagleson S, Veenendaal B, Wright G, Plant AJ: Disease surveillance using a hidden Markov model. BMC Med Inform Decis Mak. 2009, 9: 39-10.1186/1472-6947-9-39.CrossRefPubMedPubMedCentral Watkins RE, Eagleson S, Veenendaal B, Wright G, Plant AJ: Disease surveillance using a hidden Markov model. BMC Med Inform Decis Mak. 2009, 9: 39-10.1186/1472-6947-9-39.CrossRefPubMedPubMedCentral
10.
go back to reference Jiang X, Cooper GF: A real-time temporal Bayesian architecture for event surveillance and its application to patient-specific multiple disease outbreak detection. Data Mining and Knowledge Discovery. 2010, 20 (3): 328-360. 10.1007/s10618-009-0151-4.CrossRef Jiang X, Cooper GF: A real-time temporal Bayesian architecture for event surveillance and its application to patient-specific multiple disease outbreak detection. Data Mining and Knowledge Discovery. 2010, 20 (3): 328-360. 10.1007/s10618-009-0151-4.CrossRef
11.
go back to reference Lu HM, Zeng D, Chen HC: Prospective Infectious Disease Outbreak Detection Using Markov Switching Models. Ieee Transactions on Knowledge and Data Engineering. 2010, 22 (4): 565-577.CrossRef Lu HM, Zeng D, Chen HC: Prospective Infectious Disease Outbreak Detection Using Markov Switching Models. Ieee Transactions on Knowledge and Data Engineering. 2010, 22 (4): 565-577.CrossRef
12.
go back to reference Shen Y, Cooper GF: A New Prior for Bayesian Anomaly Detection Application to Biosurveillance. Methods of Information in Medicine. 2010, 49 (1): 44-53.PubMed Shen Y, Cooper GF: A New Prior for Bayesian Anomaly Detection Application to Biosurveillance. Methods of Information in Medicine. 2010, 49 (1): 44-53.PubMed
13.
go back to reference Alimadad A, Salibian-Barrera M: An Outlier-Robust Fit for Generalized Additive Models With Applications to Disease Outbreak Detection. Journal of the American Statistical Association. 2011, 106 (494): 719-731. 10.1198/jasa.2011.tm09654.CrossRef Alimadad A, Salibian-Barrera M: An Outlier-Robust Fit for Generalized Additive Models With Applications to Disease Outbreak Detection. Journal of the American Statistical Association. 2011, 106 (494): 719-731. 10.1198/jasa.2011.tm09654.CrossRef
14.
go back to reference Jiang FJ: Evaluation research on the quality of reporting in Emergency Public Reporting System. Master thesis. Chinese Center for Disease Control and Prevention. 2006 Jiang FJ: Evaluation research on the quality of reporting in Emergency Public Reporting System. Master thesis. Chinese Center for Disease Control and Prevention. 2006
15.
go back to reference Stroup DF, Williamson GD, Herndon JL, Karon JM: Detection of aberrations in the occurrence of notifiable diseases surveillance data. Statistics in Medicine. 1989, 8: 323-329. 10.1002/sim.4780080312.CrossRefPubMed Stroup DF, Williamson GD, Herndon JL, Karon JM: Detection of aberrations in the occurrence of notifiable diseases surveillance data. Statistics in Medicine. 1989, 8: 323-329. 10.1002/sim.4780080312.CrossRefPubMed
16.
go back to reference Farrington CP, Andrews NJ, Beale AD, Catchpole MA: A statistical algorithm for the early detection of outbreaks of infectious disease. Journal of the Royal Statistical Society, Series A. 1996, 159: 547-563.CrossRef Farrington CP, Andrews NJ, Beale AD, Catchpole MA: A statistical algorithm for the early detection of outbreaks of infectious disease. Journal of the Royal Statistical Society, Series A. 1996, 159: 547-563.CrossRef
17.
go back to reference Williamson GD, Hudson GW: A monitoring system for detecting aberrations in public health surveillance reports. Statistics in Medicine. 1999, 18: 3283-3298. 10.1002/(SICI)1097-0258(19991215)18:23<3283::AID-SIM316>3.0.CO;2-Z.CrossRefPubMed Williamson GD, Hudson GW: A monitoring system for detecting aberrations in public health surveillance reports. Statistics in Medicine. 1999, 18: 3283-3298. 10.1002/(SICI)1097-0258(19991215)18:23<3283::AID-SIM316>3.0.CO;2-Z.CrossRefPubMed
19.
go back to reference Zhang J, Tsui FC, Wagner MM, Hogan WR: Detection of Outbreaks from Time Series Data Using Wavelet Transform. AMIA Annu Symp Proc. 2003, 748-752. Zhang J, Tsui FC, Wagner MM, Hogan WR: Detection of Outbreaks from Time Series Data Using Wavelet Transform. AMIA Annu Symp Proc. 2003, 748-752.
20.
go back to reference Montgomery DC: Introduction to Statistical Quality Control. 2001, John Wiley and Sons, New York Montgomery DC: Introduction to Statistical Quality Control. 2001, John Wiley and Sons, New York
21.
go back to reference Hutwagner LC, Maloney EK, Bean NH, Slutsker L, Martin SM: Using laboratory-based surveillance data for prevention: an algorithm for detecting salmonella outbreaks. Emerg Infect Dis. 1997, 3: 395-400. 10.3201/eid0303.970322.CrossRefPubMedPubMedCentral Hutwagner LC, Maloney EK, Bean NH, Slutsker L, Martin SM: Using laboratory-based surveillance data for prevention: an algorithm for detecting salmonella outbreaks. Emerg Infect Dis. 1997, 3: 395-400. 10.3201/eid0303.970322.CrossRefPubMedPubMedCentral
22.
go back to reference Yang WZ, Xing HX, Wang HZ, Lan YJ, Sun Q, Hu SX, Lv W, Yuan ZA, Chen YX, Dong BQ: A study on early detection for seven infectious diseases. Chin J Epidemiol. 2004, 25 (12): 1039-1041. Yang WZ, Xing HX, Wang HZ, Lan YJ, Sun Q, Hu SX, Lv W, Yuan ZA, Chen YX, Dong BQ: A study on early detection for seven infectious diseases. Chin J Epidemiol. 2004, 25 (12): 1039-1041.
24.
go back to reference Zhang RJ, Ji GH, Wang Y, Zai B: Investigation of a Shigella bacteria cause bacillary dysentery outbreak. Chin J Pest Control. 2009, 25 (6): 437-438. Zhang RJ, Ji GH, Wang Y, Zai B: Investigation of a Shigella bacteria cause bacillary dysentery outbreak. Chin J Pest Control. 2009, 25 (6): 437-438.
25.
go back to reference Li SX, Li LJ, Yu QF, Yu FB, Yu HX, Wu BW: Investigation of a scarlet fever outbreak in a school, Yuxi City. Chin J Sch Health. 2005, 26 (6): 510-511. Li SX, Li LJ, Yu QF, Yu FB, Yu HX, Wu BW: Investigation of a scarlet fever outbreak in a school, Yuxi City. Chin J Sch Health. 2005, 26 (6): 510-511.
26.
go back to reference Zhang TT, Chen HX: Analysis of a mumps outbreak in a junior middle school of Huaxi town, Huayin City. Henan Journal of Preventive Medicine. 2009, 20 (6): 449-450. Zhang TT, Chen HX: Analysis of a mumps outbreak in a junior middle school of Huaxi town, Huayin City. Henan Journal of Preventive Medicine. 2009, 20 (6): 449-450.
27.
go back to reference Huo HC: Report on a measles outbreak investigation. Disease surveillance. 1997, 11: 430- Huo HC: Report on a measles outbreak investigation. Disease surveillance. 1997, 11: 430-
28.
go back to reference Yao LJ, Chen HH: Analysis of a malaria outbreak investigation. Guangdong health and epidemic prevention. 1998, 24 (1): 43-44. Yao LJ, Chen HH: Analysis of a malaria outbreak investigation. Guangdong health and epidemic prevention. 1998, 24 (1): 43-44.
29.
go back to reference Yin K, Li MQ, Liu JJ: Analysis of typhoid outbreak investigation in a school, Liuzhou. Modern preventive medicine. 2007, 34 (13): 2559-2560. Yin K, Li MQ, Liu JJ: Analysis of typhoid outbreak investigation in a school, Liuzhou. Modern preventive medicine. 2007, 34 (13): 2559-2560.
30.
go back to reference Chen ZZ: A outbreak investigation of encephalitis B in 2000 year, Anxi County. Journal of Preventive Medicine Information. 2001, 17 (4): 278-279. Chen ZZ: A outbreak investigation of encephalitis B in 2000 year, Anxi County. Journal of Preventive Medicine Information. 2001, 17 (4): 278-279.
31.
go back to reference Nong ZM, Meng LJ, Liu ZH, Jiang CH: Investigation of a hepatitis A outbreak in a school. Chin J Sch Health. 2009, 30 (3): 274-275. Nong ZM, Meng LJ, Liu ZH, Jiang CH: Investigation of a hepatitis A outbreak in a school. Chin J Sch Health. 2009, 30 (3): 274-275.
32.
go back to reference Ma YL: Infectious diseases. 2004, Shanghai scientific & Technical Publishers, Shanghai Ma YL: Infectious diseases. 2004, Shanghai scientific & Technical Publishers, Shanghai
33.
go back to reference Wagner MM, Wallstrom G: Methods For Algorithm Evaluation. Handbook of Biosurveillance. Edited by: Wagner MM, Moore AW, Aryel RM. 2006, Elsevier Press, Burlington, 301-310.CrossRef Wagner MM, Wallstrom G: Methods For Algorithm Evaluation. Handbook of Biosurveillance. Edited by: Wagner MM, Moore AW, Aryel RM. 2006, Elsevier Press, Burlington, 301-310.CrossRef
34.
go back to reference Nordin JD, Goodman MJ, Kulldorff M, Ritzwoller DP, Abrams AM, Kleinman K, Levitt MJ, Donahue J, Platt R: Simulated anthrax attacks and syndromic surveillance. Emerg Infect Dis. 2005, 11 (9): 1396-1400.CrossRef Nordin JD, Goodman MJ, Kulldorff M, Ritzwoller DP, Abrams AM, Kleinman K, Levitt MJ, Donahue J, Platt R: Simulated anthrax attacks and syndromic surveillance. Emerg Infect Dis. 2005, 11 (9): 1396-1400.CrossRef
35.
go back to reference Ozonoff A, Forsberg L, Bonetti M, Pagano M: Bivariate method for spatio-temporal syndromic surveillance. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 59-66. Ozonoff A, Forsberg L, Bonetti M, Pagano M: Bivariate method for spatio-temporal syndromic surveillance. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 59-66.
36.
go back to reference Jackson ML, Baer A, Painter I, Duchin J: A simulation study comparing aberration detection algorithms for syndromic surveillance. BMC Med Inform Decis Mak. 2000, 7: 6-CrossRef Jackson ML, Baer A, Painter I, Duchin J: A simulation study comparing aberration detection algorithms for syndromic surveillance. BMC Med Inform Decis Mak. 2000, 7: 6-CrossRef
37.
go back to reference Hutwagner L, Browne T, Seeman GM, Fleischauer AT: Comparing aberration detection methods with simulated data. Emerg Infect Dis. 2005, 11: 314-316. 10.3201/eid1102.040587.CrossRefPubMedPubMedCentral Hutwagner L, Browne T, Seeman GM, Fleischauer AT: Comparing aberration detection methods with simulated data. Emerg Infect Dis. 2005, 11: 314-316. 10.3201/eid1102.040587.CrossRefPubMedPubMedCentral
38.
go back to reference Goldenberg A, Shmueli G, Caruana RA, Fienberg SE: Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales. Proc Natl Acad Sci USA. 2002, 99 (8): 5237-5240. 10.1073/pnas.042117499.CrossRefPubMedPubMedCentral Goldenberg A, Shmueli G, Caruana RA, Fienberg SE: Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales. Proc Natl Acad Sci USA. 2002, 99 (8): 5237-5240. 10.1073/pnas.042117499.CrossRefPubMedPubMedCentral
39.
go back to reference Reis BY, Pagano M, Mandl KD: Using temporal context to improve biosurveillance. Proc Natl Acad Sci USA. 2003, 100 (4): 1961-1965. 10.1073/pnas.0335026100.CrossRefPubMedPubMedCentral Reis BY, Pagano M, Mandl KD: Using temporal context to improve biosurveillance. Proc Natl Acad Sci USA. 2003, 100 (4): 1961-1965. 10.1073/pnas.0335026100.CrossRefPubMedPubMedCentral
Metadata
Title
Epidemic features affecting the performance of outbreak detection algorithms
Authors
Jie Kuang
Wei Zhong Yang
Ding Lun Zhou
Zhong Jie Li
Ya Jia Lan
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2012
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-12-418

Other articles of this Issue 1/2012

BMC Public Health 1/2012 Go to the issue