Skip to main content
Top
Published in: BMC Public Health 1/2009

Open Access 01-12-2009 | Research article

Early detection of influenza outbreaks using the DC Department of Health's syndromic surveillance system

Authors: Beth Ann Griffin, Arvind K Jain, John Davies-Cole, Chevelle Glymph, Garret Lum, Samuel C Washington, Michael A Stoto

Published in: BMC Public Health | Issue 1/2009

Login to get access

Abstract

Background

Since 2001, the District of Columbia Department of Health has been using an emergency room syndromic surveillance system to identify possible disease outbreaks. Data are received from a number of local hospital emergency rooms and analyzed daily using a variety of statistical detection algorithms. The aims of this paper are to characterize the performance of these statistical detection algorithms in rigorous yet practical terms in order to identify the optimal parameters for each and to compare the ability of two syndrome definition criteria and data from a children's hospital versus vs. other hospitals to determine the onset of seasonal influenza.

Methods

We first used a fine-tuning approach to improve the sensitivity of each algorithm to detecting simulated outbreaks and to identifying previously known outbreaks. Subsequently, using the fine-tuned algorithms, we examined (i) the ability of unspecified infection and respiratory syndrome categories to detect the start of the flu season and (ii) how well data from Children's National Medical Center (CNMC) did versus all the other hospitals when using unspecified infection, respiratory, and both categories together.

Results

Simulation studies using the data showed that over a range of situations, the multivariate CUSUM algorithm performed more effectively than the other algorithms tested. In addition, the parameters that yielded optimal performance varied for each algorithm, especially with the number of cases in the data stream. In terms of detecting the onset of seasonal influenza, only "unspecified infection," especially the counts from CNMC, clearly delineated influenza outbreaks out of the eight available syndromic classifications. In three of five years, CNMC consistently flags earlier (from 2 days up to 2 weeks earlier) than a multivariate analysis of all other DC hospitals.

Conclusions

When practitioners apply statistical detection algorithms to their own data, fine tuning of parameters is necessary to improve overall sensitivity. With fined tuned algorithms, our results suggest that emergency room based syndromic surveillance focusing on unspecified infection cases in children is an effective way to determine the beginning of the influenza outbreak and could serve as a trigger for more intensive surveillance efforts and initiate infection control measures in the community.
Appendix
Available only for authorised users
Literature
2.
go back to reference Buehler JW, Sonricker A, Paladini M: Syndromic Surveillance Practice in the United States: Findings from a survey of state, territorial, and selected local health departments. Advances in Disease Surveillance. 2008, 6: 3-[Note: this is a web publication and each paper is given a number (3) rather than page numbers] Buehler JW, Sonricker A, Paladini M: Syndromic Surveillance Practice in the United States: Findings from a survey of state, territorial, and selected local health departments. Advances in Disease Surveillance. 2008, 6: 3-[Note: this is a web publication and each paper is given a number (3) rather than page numbers]
3.
go back to reference Brownstein JS, Kleinman KP, Mandl KP: Identifying pediatric age groups for influenza vaccination using a real-time regional surveillance system. American Journal of Epidemiology. 2005, 162: 686-693. 10.1093/aje/kwi257.CrossRefPubMedPubMedCentral Brownstein JS, Kleinman KP, Mandl KP: Identifying pediatric age groups for influenza vaccination using a real-time regional surveillance system. American Journal of Epidemiology. 2005, 162: 686-693. 10.1093/aje/kwi257.CrossRefPubMedPubMedCentral
4.
go back to reference Lemay R, Mawudeku A, Shi Y, Ruben M, Achonu C: Syndromic surveillance for influenzalike illness. Biosecurity and Bioterrorism: Biodefense Strategy, Practice, and Science. 2008, 6: 161-170. 10.1089/bsp.2007.0056.CrossRef Lemay R, Mawudeku A, Shi Y, Ruben M, Achonu C: Syndromic surveillance for influenzalike illness. Biosecurity and Bioterrorism: Biodefense Strategy, Practice, and Science. 2008, 6: 161-170. 10.1089/bsp.2007.0056.CrossRef
5.
go back to reference Lu J, et al: Could outpatient visits enhance our ability of early detecting influenza-like illness outbreaks?. Advances in Disease Surveillance. 2006, 1: 44- Lu J, et al: Could outpatient visits enhance our ability of early detecting influenza-like illness outbreaks?. Advances in Disease Surveillance. 2006, 1: 44-
6.
go back to reference Lau EHY, Cowling BJ, Ho LM, Leung GM: Optimizing use of multistream influenza sentinel surveillance data. Emerging Infectious Diseases. 2008, 14: 1154-1157. 10.3201/eid1407.080060.CrossRefPubMedPubMedCentral Lau EHY, Cowling BJ, Ho LM, Leung GM: Optimizing use of multistream influenza sentinel surveillance data. Emerging Infectious Diseases. 2008, 14: 1154-1157. 10.3201/eid1407.080060.CrossRefPubMedPubMedCentral
7.
go back to reference Zheng W, Aitken R, Muscatello DJ, Churches T: Potential for early warning of viral influenza activity in the community by monitoring clinical diagnosis of influenza in hospital emergency departments. BMC Public Health. 2007, 7: 250-260. 10.1186/1471-2458-7-250.CrossRefPubMedPubMedCentral Zheng W, Aitken R, Muscatello DJ, Churches T: Potential for early warning of viral influenza activity in the community by monitoring clinical diagnosis of influenza in hospital emergency departments. BMC Public Health. 2007, 7: 250-260. 10.1186/1471-2458-7-250.CrossRefPubMedPubMedCentral
8.
go back to reference Cooper DL, Smith GE, Regan M, Large S, Groenewegen P: Tracking the spatial diffusion of influenza and norovirus using telehealth data: a spatio-temporal analysis of syndromic data. BMC Medicine. 2008, 6: 16-10.1186/1741-7015-6-16.CrossRefPubMedPubMedCentral Cooper DL, Smith GE, Regan M, Large S, Groenewegen P: Tracking the spatial diffusion of influenza and norovirus using telehealth data: a spatio-temporal analysis of syndromic data. BMC Medicine. 2008, 6: 16-10.1186/1741-7015-6-16.CrossRefPubMedPubMedCentral
9.
go back to reference Olson DR, Heffernan RT, Paladini M, Konty K, Weiss D, Mostashari F: Monitoring the impact of influenza by age: emergency department fever and respiratory complaint surveillance in New York City. PLoS Medicine. 2007, 4 (8): e247-10.1371/journal.pmed.0040247.CrossRefPubMedPubMedCentral Olson DR, Heffernan RT, Paladini M, Konty K, Weiss D, Mostashari F: Monitoring the impact of influenza by age: emergency department fever and respiratory complaint surveillance in New York City. PLoS Medicine. 2007, 4 (8): e247-10.1371/journal.pmed.0040247.CrossRefPubMedPubMedCentral
10.
go back to reference Polgreen PM, Chen Y, Pennock DM, Nelson FD: Using internet searches for influenza sureillance. Clinical Infectious Diseases. 2008, 47: 1443-8. 10.1086/593098.CrossRefPubMed Polgreen PM, Chen Y, Pennock DM, Nelson FD: Using internet searches for influenza sureillance. Clinical Infectious Diseases. 2008, 47: 1443-8. 10.1086/593098.CrossRefPubMed
11.
go back to reference Ginsberg J, Mohebbi MH, Patel RS, et al: Detecting influenza epidemics using search engine query data (letter). Nature. 2009, 457: 1012-14. 10.1038/nature07634.CrossRefPubMed Ginsberg J, Mohebbi MH, Patel RS, et al: Detecting influenza epidemics using search engine query data (letter). Nature. 2009, 457: 1012-14. 10.1038/nature07634.CrossRefPubMed
13.
go back to reference Stoto MA, Jain AJ, Diamond A, et al: Time series analysis of the District of Columbia's syndromic surveillance data. MMWR. 2005, 54: 202- Stoto MA, Jain AJ, Diamond A, et al: Time series analysis of the District of Columbia's syndromic surveillance data. MMWR. 2005, 54: 202-
14.
go back to reference Sebastiani P, Mandl KD, Szolovits P, Kohane IS, Ramoni MF: A Bayesian dynamic model for influenza surveillance. Statistics in Medicine. 2006, 25: 1803-1816. 10.1002/sim.2566.CrossRefPubMedPubMedCentral Sebastiani P, Mandl KD, Szolovits P, Kohane IS, Ramoni MF: A Bayesian dynamic model for influenza surveillance. Statistics in Medicine. 2006, 25: 1803-1816. 10.1002/sim.2566.CrossRefPubMedPubMedCentral
15.
go back to reference Begier EM, Sockwell D, Branch LM, et al: The National Capitol Region's emergency department syndromic surveillance system. Emerg Inf Dis. 2003, 9: 393-396.CrossRef Begier EM, Sockwell D, Branch LM, et al: The National Capitol Region's emergency department syndromic surveillance system. Emerg Inf Dis. 2003, 9: 393-396.CrossRef
16.
go back to reference Lasko TA, Bhagwat JG, Zou KH, et al: The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inf. 2005, 38: 404-15. 10.1016/j.jbi.2005.02.008.CrossRef Lasko TA, Bhagwat JG, Zou KH, et al: The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inf. 2005, 38: 404-15. 10.1016/j.jbi.2005.02.008.CrossRef
17.
go back to reference Woodall WH: The use of control charts in health-care and public-health surveillance. J Qual Tech. 2006, 38: 1-16. Woodall WH: The use of control charts in health-care and public-health surveillance. J Qual Tech. 2006, 38: 1-16.
18.
go back to reference Montgomery DC: Introduction to Statistical Quality Control. 2001, New York: New York: John Wiley & Sons, 4 Montgomery DC: Introduction to Statistical Quality Control. 2001, New York: New York: John Wiley & Sons, 4
19.
go back to reference Stoto MA, Fricker RD, Jain AJ, Olwell D, Wilson AG, Wilson G, et al: Evaluating statistical methods for syndromic surveillance. Statistical Methods in Counter-Terrorism. Edited by: Olwell D, Wilson AG, Wilson G. 2006, New York, New York: Springer, 141-72. full_text.CrossRef Stoto MA, Fricker RD, Jain AJ, Olwell D, Wilson AG, Wilson G, et al: Evaluating statistical methods for syndromic surveillance. Statistical Methods in Counter-Terrorism. Edited by: Olwell D, Wilson AG, Wilson G. 2006, New York, New York: Springer, 141-72. full_text.CrossRef
21.
go back to reference Tokars JI, Burkom H, Xing J, et al: Enhancing time-series detection algorithms for automated biosurveillance. Emerg Inf Dis. 2009, 15: 533-9. 10.3201/eid1504.080616.CrossRef Tokars JI, Burkom H, Xing J, et al: Enhancing time-series detection algorithms for automated biosurveillance. Emerg Inf Dis. 2009, 15: 533-9. 10.3201/eid1504.080616.CrossRef
22.
go back to reference Stoto MA, Schonlau M, Mariano LT: Syndromic surveillance: Is it worth the effort?. Chance. 2004, 17: 19-24.CrossRef Stoto MA, Schonlau M, Mariano LT: Syndromic surveillance: Is it worth the effort?. Chance. 2004, 17: 19-24.CrossRef
23.
go back to reference Stoto M: Syndromic surveillance in public health practice. Institute of Medicine, ed. Infectious Disease Surveillance and Detection (Workshop Report). 2007, Washington: National Academy Press, 63-72. Stoto M: Syndromic surveillance in public health practice. Institute of Medicine, ed. Infectious Disease Surveillance and Detection (Workshop Report). 2007, Washington: National Academy Press, 63-72.
Metadata
Title
Early detection of influenza outbreaks using the DC Department of Health's syndromic surveillance system
Authors
Beth Ann Griffin
Arvind K Jain
John Davies-Cole
Chevelle Glymph
Garret Lum
Samuel C Washington
Michael A Stoto
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2009
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-9-483

Other articles of this Issue 1/2009

BMC Public Health 1/2009 Go to the issue