Skip to main content
Top
Published in: BMC Public Health 1/2008

Open Access 01-12-2008 | Technical advance

Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas

Authors: Jean-Baptiste Meynard, Herve Chaudet, Andrew D Green, Henry L Jefferson, Gaetan Texier, Daniel Webber, Bruce Dupuy, Jean-Paul Boutin

Published in: BMC Public Health | Issue 1/2008

Login to get access

Abstract

Background

In recent years a wide variety of epidemiological surveillance systems have been developed to provide early identification of outbreaks of infectious disease. Each system has had its own strengths and weaknesses. In 2002 a Working Group of the Centers for Disease Control and Prevention (CDC) produced a framework for evaluation, which proved suitable for many public health surveillance systems. However this did not easily adapt to the military setting, where by necessity a variety of different parameters are assessed, different constraints placed on the systems, and different objectives required. This paper describes a proposed framework for evaluation of military syndromic surveillance systems designed to detect outbreaks of disease on operational deployments.

Methods

The new framework described in this paper was developed from the cumulative experience of British and French military syndromic surveillance systems. The methods included a general assessment framework (CDC), followed by more specific methods of conducting evaluation. These included Knowledge/Attitude/Practice surveys (KAP surveys), technical audits, ergonomic studies, simulations and multi-national exercises. A variety of military constraints required integration into the evaluation. Examples of these include the variability of geographical conditions in the field, deployment to areas without prior knowledge of naturally-occurring disease patterns, the differences in field sanitation between locations and over the length of deployment, the mobility of military forces, turnover of personnel, continuity of surveillance across different locations, integration with surveillance systems from other nations working alongside each other, compatibility with non-medical information systems, and security.

Results

A framework for evaluation has been developed that can be used for military surveillance systems in a staged manner consisting of initial, intermediate and final evaluations. For each stage of the process parameters for assessment have been defined and methods identified.

Conclusion

The combined experiences of French and British syndromic surveillance systems developed for use in deployed military forces has allowed the development of a specific evaluation framework. The tool is suitable for use by all nations who wish to evaluate syndromic surveillance in their own military forces. It could also be useful for civilian mobile systems or for national security surveillance systems.
Appendix
Available only for authorised users
Literature
1.
go back to reference Contandriopoulos AP, Champagne F, Denis JL, Avargues MC: [Evaluation in the health sector: concepts and methods]. Rev Epidemiol Sante Publique. 2000, 48 (6): 517-539.PubMed Contandriopoulos AP, Champagne F, Denis JL, Avargues MC: [Evaluation in the health sector: concepts and methods]. Rev Epidemiol Sante Publique. 2000, 48 (6): 517-539.PubMed
2.
go back to reference Sosin DM, DeThomasis J: Evaluation challenges for syndromic surveillance--making incremental progress. MMWR Morb Mortal Wkly Rep. 2004, 53 Suppl: 125-129. Sosin DM, DeThomasis J: Evaluation challenges for syndromic surveillance--making incremental progress. MMWR Morb Mortal Wkly Rep. 2004, 53 Suppl: 125-129.
3.
4.
go back to reference Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V: Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR. 2004, 53(RR-5): 1-11. Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V: Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR. 2004, 53(RR-5): 1-11.
6.
go back to reference Chaudet H, Meynard JB, Texier G, Tournebize O, Pellegrin L, Queyriaux B, Boutin JP: Distributed and Mobile Collaboration for Real Time Epidemiological Surveillance during Forces Deployments. Stud Health Technol Inform. 2005, 116: 983-988.PubMed Chaudet H, Meynard JB, Texier G, Tournebize O, Pellegrin L, Queyriaux B, Boutin JP: Distributed and Mobile Collaboration for Real Time Epidemiological Surveillance during Forces Deployments. Stud Health Technol Inform. 2005, 116: 983-988.PubMed
7.
go back to reference Jefferson H, Dupuy B, Chaudet H, Texier G, Green A, Barnish G, Boutin JP, Meynard JB: Evaluation of syndromic surveillance for the early detection of outbreaks among military personnel in a tropical country. J Public Health. 2008 Jefferson H, Dupuy B, Chaudet H, Texier G, Green A, Barnish G, Boutin JP, Meynard JB: Evaluation of syndromic surveillance for the early detection of outbreaks among military personnel in a tropical country. J Public Health. 2008
8.
go back to reference Pineault R, Daveluy C: La planification de la santé : concepts, méthodes, stratégies. 1986, Montréal , Les éditions Agence d'Arc Pineault R, Daveluy C: La planification de la santé : concepts, méthodes, stratégies. 1986, Montréal , Les éditions Agence d'Arc
9.
go back to reference Pyzdek T, Keller P: Quality Engineering Handbook. 2003, New York , Marcel Dekker Pyzdek T, Keller P: Quality Engineering Handbook. 2003, New York , Marcel Dekker
10.
go back to reference Nielsen J: Usability engineering. 1993, Academic Press Nielsen J: Usability engineering. 1993, Academic Press
11.
go back to reference Nielsen J, Mack RL: Usability inspection methods. 1994, John Wiley and Sons, Inc.CrossRef Nielsen J, Mack RL: Usability inspection methods. 1994, John Wiley and Sons, Inc.CrossRef
12.
go back to reference Scapin DL, Bastien JMC: Ergonomic criteria for evaluating the ergonomic quality of interactive systems. Behaviour and Information Technology. 1997, 16: 220-231. 10.1080/014492997119806.CrossRef Scapin DL, Bastien JMC: Ergonomic criteria for evaluating the ergonomic quality of interactive systems. Behaviour and Information Technology. 1997, 16: 220-231. 10.1080/014492997119806.CrossRef
14.
go back to reference Daudens E, Lamy M, Dupuy B, Texier G, Chaudet H, Pellegrin L, Tournebize O, Moine G, Deparis X, Migliani R, Spiegel A, Boutin JP, Morvan J, Meynard JB: Evaluation within the stakeholders of a syndromic surveillance system in French Guiana. Advances in Disease Surveillance. 2007, 2: 197- Daudens E, Lamy M, Dupuy B, Texier G, Chaudet H, Pellegrin L, Tournebize O, Moine G, Deparis X, Migliani R, Spiegel A, Boutin JP, Morvan J, Meynard JB: Evaluation within the stakeholders of a syndromic surveillance system in French Guiana. Advances in Disease Surveillance. 2007, 2: 197-
15.
go back to reference Daudens E, Langevin S, Pellegrin L, Texier G, Dupuy B, Chaudet H, Boutin JP, Meynard JB: Assessment of a military real-time epidemiological surveillance system by its users in French Guiana. Public Health. Soumis- Daudens E, Langevin S, Pellegrin L, Texier G, Dupuy B, Chaudet H, Boutin JP, Meynard JB: Assessment of a military real-time epidemiological surveillance system by its users in French Guiana. Public Health. Soumis-
16.
go back to reference Chaudet H, Meynard JB, Texier G, Pellegrin L, Queyriaux B, Hupin C, Boutin JP: Lessons from the Participation of the French Real-Time Surveillance System ASTER/2SEFAG in an International Disease Surveillance Exercise. Tropical Medicine and International Health. 2007, 12: 227- Chaudet H, Meynard JB, Texier G, Pellegrin L, Queyriaux B, Hupin C, Boutin JP: Lessons from the Participation of the French Real-Time Surveillance System ASTER/2SEFAG in an International Disease Surveillance Exercise. Tropical Medicine and International Health. 2007, 12: 227-
17.
go back to reference Meynard JB, Dussart P, Lamy M, Matheus S, Dupuy B, Daudens E, Texier G, Chaudet H, Pellegrin L, Tournebize O, Moine G, Deparis X, Migliani R, Spiegel A, Morvan J, Boutin JP: Interest of syndromic surveillance within the Armed Forces in French Guiana for early warning. Advances in Disease Surveillance. 2007, 2: 111- Meynard JB, Dussart P, Lamy M, Matheus S, Dupuy B, Daudens E, Texier G, Chaudet H, Pellegrin L, Tournebize O, Moine G, Deparis X, Migliani R, Spiegel A, Morvan J, Boutin JP: Interest of syndromic surveillance within the Armed Forces in French Guiana for early warning. Advances in Disease Surveillance. 2007, 2: 111-
18.
go back to reference Meynard JB, Chaudet H, Texier G, Ardillon V, Ravachol F, Deparis X, Jefferson H, Dussart P, Morvan J, Boutin JP: Value of syndromic surveillance within the Armed Forces for early warning during a dengue fever outbreak in French Guiana in 2006. BMC Medical Informatics and Decision Making. 2008 Meynard JB, Chaudet H, Texier G, Ardillon V, Ravachol F, Deparis X, Jefferson H, Dussart P, Morvan J, Boutin JP: Value of syndromic surveillance within the Armed Forces for early warning during a dengue fever outbreak in French Guiana in 2006. BMC Medical Informatics and Decision Making. 2008
19.
go back to reference Lombardo JS, Burkom H, Pavlin J, Centers for Disease Control and Prevention (CDC): ESSENCE II and the framework for evaluating syndromic surveillance systems. MMWR Morb Mortal Wkly Rep. 2004, 53 Suppl: 159-165. Lombardo JS, Burkom H, Pavlin J, Centers for Disease Control and Prevention (CDC): ESSENCE II and the framework for evaluating syndromic surveillance systems. MMWR Morb Mortal Wkly Rep. 2004, 53 Suppl: 159-165.
20.
go back to reference Doroshenko A, Cooper D, Smith G, Gerard E, Chinemana F, Verlander N, Nicoll A: Evaluation of syndromic surveillance based on National Health Service Direct derived data--England and Wales. MMWR Morb Mortal Wkly Rep. 2005, 54 Suppl: 117-122. Doroshenko A, Cooper D, Smith G, Gerard E, Chinemana F, Verlander N, Nicoll A: Evaluation of syndromic surveillance based on National Health Service Direct derived data--England and Wales. MMWR Morb Mortal Wkly Rep. 2005, 54 Suppl: 117-122.
21.
go back to reference Jefferson H, Chaudet H, Dupuy B, Faragher B, Green A, Texier G, de Lesquen M, Barnish G, Boutin JP, Meynard JB: Evaluation of the system 2SE FAG using the framework for evaluating syndromic surveillance systems. Public Health. 2007, Soumis- Jefferson H, Chaudet H, Dupuy B, Faragher B, Green A, Texier G, de Lesquen M, Barnish G, Boutin JP, Meynard JB: Evaluation of the system 2SE FAG using the framework for evaluating syndromic surveillance systems. Public Health. 2007, Soumis-
22.
go back to reference Clothier HJ, Fielding JE, Kelly HA: An evaluation of the Australian Sentinel Practice Research Network (ASPREN) surveillance for influenza-like illness. Commun Dis Intell. 2005, 29 (3): 231-247. Clothier HJ, Fielding JE, Kelly HA: An evaluation of the Australian Sentinel Practice Research Network (ASPREN) surveillance for influenza-like illness. Commun Dis Intell. 2005, 29 (3): 231-247.
23.
go back to reference Kaufman Z, Wong WK, Peled-Leviatan T, Cohen E, Lavy C, Aharonowitz G, Dichtiar R, Bromberg M, Havkin O, Kokia E, Green MS: Evaluation of a syndromic surveillance system using the WSARE algorithm for early detection of an unusual, localized summer outbreak of influenza B: implications for bioterrorism surveillance. Isr Med Assoc J. 2007, 9 (1): 3-7.PubMed Kaufman Z, Wong WK, Peled-Leviatan T, Cohen E, Lavy C, Aharonowitz G, Dichtiar R, Bromberg M, Havkin O, Kokia E, Green MS: Evaluation of a syndromic surveillance system using the WSARE algorithm for early detection of an unusual, localized summer outbreak of influenza B: implications for bioterrorism surveillance. Isr Med Assoc J. 2007, 9 (1): 3-7.PubMed
24.
go back to reference Buckeridge DL, Burkom H, Moore A, Pavlin J, Cutchis P, Hogan W: Evaluation of syndromic surveillance systems--design of an epidemic simulation model. MMWR Morb Mortal Wkly Rep. 2004, 53 : 137-143. Buckeridge DL, Burkom H, Moore A, Pavlin J, Cutchis P, Hogan W: Evaluation of syndromic surveillance systems--design of an epidemic simulation model. MMWR Morb Mortal Wkly Rep. 2004, 53 : 137-143.
25.
go back to reference Buckeridge DL, Switzer P, Owens D, Siegrist D, Pavlin J, Musen M: An evaluation model for syndromic surveillance: assessing the performance of a temporal algorithm. MMWR Morb Mortal Wkly Rep. 2005, 54 : 109-115. Buckeridge DL, Switzer P, Owens D, Siegrist D, Pavlin J, Musen M: An evaluation model for syndromic surveillance: assessing the performance of a temporal algorithm. MMWR Morb Mortal Wkly Rep. 2005, 54 : 109-115.
26.
go back to reference Kleinman KP, Abrams A, Mandl K, Platt R: Simulation for assessing statistical methods of biologic terrorism surveillance. MMWR Morb Mortal Wkly Rep. 2005, 54 : 101-108. Kleinman KP, Abrams A, Mandl K, Platt R: Simulation for assessing statistical methods of biologic terrorism surveillance. MMWR Morb Mortal Wkly Rep. 2005, 54 : 101-108.
27.
go back to reference Betancourt JA, Hakre S, Polyak CS, Pavlin JA: Evaluation of ICD-9 codes for syndromic surveillance in the electronic surveillance system for the early notification of community-based epidemics. Mil Med. 2007, 172 (4): 346-352.CrossRefPubMed Betancourt JA, Hakre S, Polyak CS, Pavlin JA: Evaluation of ICD-9 codes for syndromic surveillance in the electronic surveillance system for the early notification of community-based epidemics. Mil Med. 2007, 172 (4): 346-352.CrossRefPubMed
Metadata
Title
Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas
Authors
Jean-Baptiste Meynard
Herve Chaudet
Andrew D Green
Henry L Jefferson
Gaetan Texier
Daniel Webber
Bruce Dupuy
Jean-Paul Boutin
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2008
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-8-146

Other articles of this Issue 1/2008

BMC Public Health 1/2008 Go to the issue