Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2005

Open Access 01-12-2005 | Research article

Modeling emergency department visit patterns for infectious disease complaints: results and application to disease surveillance

Authors: Judith C Brillman, Tom Burr, David Forslund, Edward Joyce, Rick Picard, Edith Umland

Published in: BMC Medical Informatics and Decision Making | Issue 1/2005

Login to get access

Abstract

Background

Concern over bio-terrorism has led to recognition that traditional public health surveillance for specific conditions is unlikely to provide timely indication of some disease outbreaks, either naturally occurring or induced by a bioweapon. In non-traditional surveillance, the use of health care resources are monitored in "near real" time for the first signs of an outbreak, such as increases in emergency department (ED) visits for respiratory, gastrointestinal or neurological chief complaints (CC).

Methods

We collected ED CCs from 2/1/94 – 5/31/02 as a training set. A first-order model was developed for each of seven CC categories by accounting for long-term, day-of-week, and seasonal effects. We assessed predictive performance on subsequent data from 6/1/02 – 5/31/03, compared CC counts to predictions and confidence limits, and identified anomalies (simulated and real).

Results

Each CC category exhibited significant day-of-week differences. For most categories, counts peaked on Monday. There were seasonal cycles in both respiratory and undifferentiated infection complaints and the season-to-season variability in peak date was summarized using a hierarchical model. For example, the average peak date for respiratory complaints was January 22, with a season-to-season standard deviation of 12 days. This season-to-season variation makes it challenging to predict respiratory CCs so we focused our effort and discussion on prediction performance for this difficult category. Total ED visits increased over the study period by 4%, but respiratory complaints decreased by roughly 20%, illustrating that long-term averages in the data set need not reflect future behavior in data subsets.

Conclusion

We found that ED CCs provided timely indicators for outbreaks. Our approach led to successful identification of a respiratory outbreak one-to-two weeks in advance of reports from the state-wide sentinel flu surveillance and of a reported increase in positive laboratory test results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moran GJ, Kyriacou DN, Newdow MA, Talan DA: Emergency Department Sentinel Surveillance for Emerging Infectious Diseases. Editorial. Annals Emerg Med. 1995, 26 (3): 351-354. Moran GJ, Kyriacou DN, Newdow MA, Talan DA: Emergency Department Sentinel Surveillance for Emerging Infectious Diseases. Editorial. Annals Emerg Med. 1995, 26 (3): 351-354.
2.
go back to reference Hirshon JM: The Rationale for Developing Public Health Surveillance Systems Based on Emergency Department Data. Acad Emerg Med. 2000, 7 (12): 1428-1432.CrossRefPubMed Hirshon JM: The Rationale for Developing Public Health Surveillance Systems Based on Emergency Department Data. Acad Emerg Med. 2000, 7 (12): 1428-1432.CrossRefPubMed
4.
go back to reference Suyama J, Sztajnkycer M, Lindsell D, Otten EJ, Daniels JM, Kressel AB: Surveillance of Infectious Disease Occurrences in the Community: An Analysis of Symptom Presentation in the Emergency Department. Acad Emerg Med. 2003, 10 (7): 753-763. 10.1197/aemj.10.7.753.CrossRefPubMed Suyama J, Sztajnkycer M, Lindsell D, Otten EJ, Daniels JM, Kressel AB: Surveillance of Infectious Disease Occurrences in the Community: An Analysis of Symptom Presentation in the Emergency Department. Acad Emerg Med. 2003, 10 (7): 753-763. 10.1197/aemj.10.7.753.CrossRefPubMed
5.
go back to reference Teich JM: Information Systems Support for Emergency Medicine. Ann Emerg Med. 1998, 31 (3): 304-307.CrossRefPubMed Teich JM: Information Systems Support for Emergency Medicine. Ann Emerg Med. 1998, 31 (3): 304-307.CrossRefPubMed
6.
go back to reference Garrison HG, Runyan CW, Tintinalli JE, Barber CW, Bordley WC, Hargarten SW, Pollock DA, Weiss HB: Emergency Department Surveillance: An Examination of Issues and a Proposal for a National Strategy. Ann Emerg Med. 1994, 24 (5): 849-856.CrossRefPubMed Garrison HG, Runyan CW, Tintinalli JE, Barber CW, Bordley WC, Hargarten SW, Pollock DA, Weiss HB: Emergency Department Surveillance: An Examination of Issues and a Proposal for a National Strategy. Ann Emerg Med. 1994, 24 (5): 849-856.CrossRefPubMed
7.
go back to reference Jorm LR, Thackway SV, Churches TR, Hills MW: Watching the Games: Public Health Surveillance for the Sydney 2000 Olympic Games. J Epidemiol Community Health. 2003, 57: 102-108. 10.1136/jech.57.2.102.CrossRefPubMedPubMedCentral Jorm LR, Thackway SV, Churches TR, Hills MW: Watching the Games: Public Health Surveillance for the Sydney 2000 Olympic Games. J Epidemiol Community Health. 2003, 57: 102-108. 10.1136/jech.57.2.102.CrossRefPubMedPubMedCentral
8.
go back to reference Tsui FC, Espino JU, Wagner MM, Gesteland P, Ivanov O, Olszewski RT, Liu Z, Zeng X, Chapman W, Wong WK, Moore A: Data, Network, and Application: Technical Description of the Utah RODS Winder Olympic Biosurveillance System. Proceedings/AMIA Annual Symposium. 2002, 815-819. Tsui FC, Espino JU, Wagner MM, Gesteland P, Ivanov O, Olszewski RT, Liu Z, Zeng X, Chapman W, Wong WK, Moore A: Data, Network, and Application: Technical Description of the Utah RODS Winder Olympic Biosurveillance System. Proceedings/AMIA Annual Symposium. 2002, 815-819.
9.
go back to reference Talan DA, Moran GJ, Mower WR, Newdow M, Ong S, Slutsker L, Jarvis WR, Conn LA, Pinner RW: EMERGEncy ID NET: an emergency department-based emerging infections sentinel network. Clin Infect Dis. 1999, 28 (2): 401-402.CrossRefPubMed Talan DA, Moran GJ, Mower WR, Newdow M, Ong S, Slutsker L, Jarvis WR, Conn LA, Pinner RW: EMERGEncy ID NET: an emergency department-based emerging infections sentinel network. Clin Infect Dis. 1999, 28 (2): 401-402.CrossRefPubMed
10.
go back to reference Zelicoff AP, Brillman JC, Forslund DW, George JE, Zink S, Koenig S, Staab T, Simpson G, Umland E, Bersell K: The Rapid Syndrome Validation Project (RSVP). Proceedings/AMIA Fall Symposium, Journal of the American Medical Informatics Association. 2001 Zelicoff AP, Brillman JC, Forslund DW, George JE, Zink S, Koenig S, Staab T, Simpson G, Umland E, Bersell K: The Rapid Syndrome Validation Project (RSVP). Proceedings/AMIA Fall Symposium, Journal of the American Medical Informatics Association. 2001
11.
go back to reference Tsui FC, Espino JU, Dato VM, Gesteland PH, Hutman J, Wagner MM: Technical Description of RODS: A Real-time Public Health Surveillance System. J Am Med Inform Assoc. 2003, 10: 399-408. 10.1197/jamia.M1345.CrossRefPubMedPubMedCentral Tsui FC, Espino JU, Dato VM, Gesteland PH, Hutman J, Wagner MM: Technical Description of RODS: A Real-time Public Health Surveillance System. J Am Med Inform Assoc. 2003, 10: 399-408. 10.1197/jamia.M1345.CrossRefPubMedPubMedCentral
12.
go back to reference Forslund DW, George JE: A Service-based Approach to Integrating Epidemiological Information in Public Health Departments. Proceedings/AMIA Annual Symposium. 2002, 1020- Forslund DW, George JE: A Service-based Approach to Integrating Epidemiological Information in Public Health Departments. Proceedings/AMIA Annual Symposium. 2002, 1020-
13.
go back to reference Lewis MD, Pavlin JA, Mansfield JL, O'Brien S, Boomsma LG, Elbert Y, Kelley PW: Disease Outbreak Detection System Using Syndromic Data in the Greater Washington DC Area. Am J Prev Med. 2002, 23 (3): 180-186. 10.1016/S0749-3797(02)00490-7.CrossRefPubMed Lewis MD, Pavlin JA, Mansfield JL, O'Brien S, Boomsma LG, Elbert Y, Kelley PW: Disease Outbreak Detection System Using Syndromic Data in the Greater Washington DC Area. Am J Prev Med. 2002, 23 (3): 180-186. 10.1016/S0749-3797(02)00490-7.CrossRefPubMed
14.
go back to reference Barthell EN, Cordell WH, Moorhead JC, Handler J, Feied O, Smith MS, Cochrane DG, Felton CW, Collins MA: The Frontlines of Medicine Project: A Proposal for the Standardized Communication of Emergency Department Data for Public Health Uses Including Syndromic Surveillance for Biological and Chemical Terrorism. Ann Emerg Med. 2002, 39 (4): 422-429. 10.1067/mem.2002.123127.CrossRefPubMed Barthell EN, Cordell WH, Moorhead JC, Handler J, Feied O, Smith MS, Cochrane DG, Felton CW, Collins MA: The Frontlines of Medicine Project: A Proposal for the Standardized Communication of Emergency Department Data for Public Health Uses Including Syndromic Surveillance for Biological and Chemical Terrorism. Ann Emerg Med. 2002, 39 (4): 422-429. 10.1067/mem.2002.123127.CrossRefPubMed
15.
go back to reference Begier E, Sockwell D, Branch L, Davies-Cole J, Jones L, Edwards L, Casani J, Blythe D: The National Capitol Region's Emergency Department Syndromic Surveillance System: Do Chief Complaint and Discharge Diagnosis Yield Different Results?. Emerging Infectious Diseases. 2003, 9 (3): 393-396.CrossRefPubMedPubMedCentral Begier E, Sockwell D, Branch L, Davies-Cole J, Jones L, Edwards L, Casani J, Blythe D: The National Capitol Region's Emergency Department Syndromic Surveillance System: Do Chief Complaint and Discharge Diagnosis Yield Different Results?. Emerging Infectious Diseases. 2003, 9 (3): 393-396.CrossRefPubMedPubMedCentral
17.
go back to reference Simonsen L, Clarke MJ, Stroup DF, Williamson GD, Arden NH, Cox NJ: A Method for Timely Assessment of Influenza-Related Mortality in the United States. Epidemiology. 1997, 8: 390-395. 10.1097/00001648-199707000-00007.CrossRefPubMed Simonsen L, Clarke MJ, Stroup DF, Williamson GD, Arden NH, Cox NJ: A Method for Timely Assessment of Influenza-Related Mortality in the United States. Epidemiology. 1997, 8: 390-395. 10.1097/00001648-199707000-00007.CrossRefPubMed
18.
go back to reference Ryan TP: Statistical Methods for Quality Improvement. 1989, New York: Wiley Ryan TP: Statistical Methods for Quality Improvement. 1989, New York: Wiley
19.
20.
go back to reference Speed T, Culpin D: The Role of Statistics in Nuclear Materials Accounting: Issues and Problems. J R Stat Soc [ser] A. 1986, 149 (4): 281-313.CrossRef Speed T, Culpin D: The Role of Statistics in Nuclear Materials Accounting: Issues and Problems. J R Stat Soc [ser] A. 1986, 149 (4): 281-313.CrossRef
23.
go back to reference Graves T, Picard R: Predicting the Evolution of P&I Mortality During a Flu Season, Los Alamos National Laboratory Report, LA-UR-02-4717. 2002 Graves T, Picard R: Predicting the Evolution of P&I Mortality During a Flu Season, Los Alamos National Laboratory Report, LA-UR-02-4717. 2002
25.
go back to reference Irvin CB, Nouhan PP, Rice K: Syndromic Analysis of Computerized Emergency Department Patient's Chief Complaints: An Opportunity for Bioterrorism and Influenza Surveillance. Ann Emerg Med. 2003, 41: 447-452. 10.1067/mem.2003.104.CrossRefPubMed Irvin CB, Nouhan PP, Rice K: Syndromic Analysis of Computerized Emergency Department Patient's Chief Complaints: An Opportunity for Bioterrorism and Influenza Surveillance. Ann Emerg Med. 2003, 41: 447-452. 10.1067/mem.2003.104.CrossRefPubMed
28.
go back to reference Reis BY, Pagano M, Mandl KD: Using temporal context to improve biosurveillance. Proc Natl Acad Sci USA. 2003, 100 (4): 1961-1965. 10.1073/pnas.0335026100.CrossRefPubMedPubMedCentral Reis BY, Pagano M, Mandl KD: Using temporal context to improve biosurveillance. Proc Natl Acad Sci USA. 2003, 100 (4): 1961-1965. 10.1073/pnas.0335026100.CrossRefPubMedPubMedCentral
29.
go back to reference Ismail NA, Pettitt AN, Webster RA: 'Online' monitoring and retrospective analysis of hospital outcomes based on a scan statistic. Statistics in Medicine. 2003, 22: 2861-2876. 10.1002/sim.1532.CrossRefPubMed Ismail NA, Pettitt AN, Webster RA: 'Online' monitoring and retrospective analysis of hospital outcomes based on a scan statistic. Statistics in Medicine. 2003, 22: 2861-2876. 10.1002/sim.1532.CrossRefPubMed
30.
go back to reference Duncan A: Quality Control and Industrial Statistics. 1974, Illinois: Richard Irwin, Inc Duncan A: Quality Control and Industrial Statistics. 1974, Illinois: Richard Irwin, Inc
31.
go back to reference Forslund D, Umland E, Brillman JC, Joyce E, Froman P, Burr T, Judd SL, Picard R, Wokoun D, Joner M, Sewell CM: Results from Fielding of the Bio-Surveillance Analysis, Feedback, Evaluation and Response (B-SAFER) System in Albuquerque, New Mexico. JAMIA. 2003, 842- Forslund D, Umland E, Brillman JC, Joyce E, Froman P, Burr T, Judd SL, Picard R, Wokoun D, Joner M, Sewell CM: Results from Fielding of the Bio-Surveillance Analysis, Feedback, Evaluation and Response (B-SAFER) System in Albuquerque, New Mexico. JAMIA. 2003, 842-
32.
go back to reference Umland ET, Brillman JC, Koster F, Froman P, Joyce EL, Forslund DW, Picard RR, Burr T, Sewell CM, Castle S, Bersell K: Fielding the Bio-Surveillance Analysis, Feedback, Evaluation and Response (B-SAFER) System. Proceedings of BTR. 2003, 185-190. Umland ET, Brillman JC, Koster F, Froman P, Joyce EL, Forslund DW, Picard RR, Burr T, Sewell CM, Castle S, Bersell K: Fielding the Bio-Surveillance Analysis, Feedback, Evaluation and Response (B-SAFER) System. Proceedings of BTR. 2003, 185-190.
33.
go back to reference Olszewski R: Bayesian Classification of Triage Diagnoses for the Early Detection of Epidemics. 2002, Pittsburgh: University of Pittsburgh Olszewski R: Bayesian Classification of Triage Diagnoses for the Early Detection of Epidemics. 2002, Pittsburgh: University of Pittsburgh
34.
go back to reference Sniegoski CA: Automated Syndromic Classification of Chief Complaint Records: JHAPL Technical Digest. 2004, 25 (1): 68-75. Sniegoski CA: Automated Syndromic Classification of Chief Complaint Records: JHAPL Technical Digest. 2004, 25 (1): 68-75.
35.
go back to reference Das D, Weiss D, Mostashari F, Treadwell T, McQuiston J, Hutwagner L, Karpati A, Bornschlegel K, Seeman M, Turcios R, Terebuh P, Curtis R, Heffernan R, Balter S: Enhanced Drop-in Syndromic Surveillance in New York City Following September 11 2001. J Urban Health. 2003, 80 (2): 76-88. Das D, Weiss D, Mostashari F, Treadwell T, McQuiston J, Hutwagner L, Karpati A, Bornschlegel K, Seeman M, Turcios R, Terebuh P, Curtis R, Heffernan R, Balter S: Enhanced Drop-in Syndromic Surveillance in New York City Following September 11 2001. J Urban Health. 2003, 80 (2): 76-88.
36.
go back to reference Forslund D, Joyce E, Burr T, Picard R, Wokoun D, Umland E, Brillman J, Froman P, Koster F: Setting Standards for Improved Syndromic Surveillance. IEEE Engineering in Medicine and Biology Magazine. 2004, 65-70. 10.1109/MEMB.2004.1297176. Forslund D, Joyce E, Burr T, Picard R, Wokoun D, Umland E, Brillman J, Froman P, Koster F: Setting Standards for Improved Syndromic Surveillance. IEEE Engineering in Medicine and Biology Magazine. 2004, 65-70. 10.1109/MEMB.2004.1297176.
37.
go back to reference Mostashari F, Fine A, Das D, Adams J, Layton M: Use of Ambulance Dispatch Data as an Early Warning System for Community wide Influenza like Illness, New York City. J Urban Health. 2003, 80 (2): i43-49.PubMedPubMedCentral Mostashari F, Fine A, Das D, Adams J, Layton M: Use of Ambulance Dispatch Data as an Early Warning System for Community wide Influenza like Illness, New York City. J Urban Health. 2003, 80 (2): i43-49.PubMedPubMedCentral
38.
go back to reference Rotstein Z, Wilf-Miron R, Lavi B, Shahar A, Gabbay U, Noy S: The Dynamics of Patient Visits to a Public Hospital ED: A Statistical Model. AJEM. 1997, 15 (6): 596-598. 10.1016/S0735-6757(97)90166-2.CrossRef Rotstein Z, Wilf-Miron R, Lavi B, Shahar A, Gabbay U, Noy S: The Dynamics of Patient Visits to a Public Hospital ED: A Statistical Model. AJEM. 1997, 15 (6): 596-598. 10.1016/S0735-6757(97)90166-2.CrossRef
39.
go back to reference Reis BY, Mandl KD: Syndromic Surveillance: the effects of syndrome grouping on model accuracy and outbreak detection. Ann Emerg Med. 2004, 44 (3): 235-241. 10.1016/j.annemergmed.2004.03.030.CrossRefPubMed Reis BY, Mandl KD: Syndromic Surveillance: the effects of syndrome grouping on model accuracy and outbreak detection. Ann Emerg Med. 2004, 44 (3): 235-241. 10.1016/j.annemergmed.2004.03.030.CrossRefPubMed
Metadata
Title
Modeling emergency department visit patterns for infectious disease complaints: results and application to disease surveillance
Authors
Judith C Brillman
Tom Burr
David Forslund
Edward Joyce
Rick Picard
Edith Umland
Publication date
01-12-2005
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2005
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-5-4

Other articles of this Issue 1/2005

BMC Medical Informatics and Decision Making 1/2005 Go to the issue