Skip to main content
Top
Published in: BMC Public Health 1/2017

Open Access 01-12-2017 | Research article

Evaluation of the ability of standardized supports to improve public health response to syndromic surveillance for respiratory diseases in Canada

Authors: Laura A. Rivera, Ye Li, Rachel D. Savage, Natasha S. Crowcroft, Shelly Bolotin, Laura C. Rosella, Wendy Lou, Jessica Hopkins, Ian Gemmill, Ian Johnson

Published in: BMC Public Health | Issue 1/2017

Login to get access

Abstract

Background

Despite widespread implementation of syndromic surveillance systems within public health agencies, previous studies of the implementation and use of these systems have indicated that the functions and responses taken in response to syndromic surveillance data vary widely according to local context and preferences. The objective of the Syndromic Surveillance Evaluation Study was to develop and implement standardized supports in local public health agencies in Ontario, Canada, and evaluate the ability of these supports to affect actions taken as part of public health communicable disease control programs.

Methods

Local public health agencies (LPHA) in Ontario, which used syndromic surveillance based on emergency department visits for respiratory disease, were recruited and randomly allocated to the study intervention or control group. The intervention group health agencies received standardized supports in terms of a standardized aberrant event detection algorithm and a response protocol dictating steps to investigate and assess the public health significance of syndromic surveillance alerts. The control group continued with their pre-existing syndromic surveillance infrastructure and processes. Outcomes were assessed using logbooks, which collected quantitative and qualitative information about alerts received, investigation steps taken, and public health responses. The study was conducted prospectively for 15 months (October 2013 to February 2015).

Results

Fifteen LPHAs participated in the study (n = 9 intervention group, n = 6 control group). A total of 1,969 syndromic surveillance alerts were received by all LPHAs. Variations in the types and amount of responses varied by LPHA, in particularly differences were noted by the size of the health unit. Smaller health units had more challenges to both detect and mount a response to any alerts. LPHAs in the control group were more likely to declare alerts to have public health significance and to initiate any action. Regression models using repeated measures showed an interaction between the year (Year 1 versus Year 2) and the intervention as well as an interaction between year and sustained nature of the alert. Both of these were linked to the control health units reporting more “watchful waiting”.

Conclusions

This study raises questions about the effectiveness of using standardized protocols to improve the performance of syndromic surveillance in a decentralized public health system. Despite efforts to create standardized protocols and engage public health agencies in the process, no significant differences in the effective use of syndromic alerts were observed beyond year 1. It also raises questions about the minimum capacity of the agency and minimum population size that are required for an effective response.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Henning KJ. What is Syndromic Surveillance? MMWR Suppl. 2004;53:7–11. Henning KJ. What is Syndromic Surveillance? MMWR Suppl. 2004;53:7–11.
3.
go back to reference Reingold A. If Syndromic Surveillance is the Answer, What is the Question? Biosecur Bioterror. 2003;1(2):77–81.CrossRefPubMed Reingold A. If Syndromic Surveillance is the Answer, What is the Question? Biosecur Bioterror. 2003;1(2):77–81.CrossRefPubMed
4.
go back to reference Stoto MA, Schonlau M, Mariano LT. Syndromic surveillance: Is it worth the effort? Chance. 2004;17:19–24.CrossRef Stoto MA, Schonlau M, Mariano LT. Syndromic surveillance: Is it worth the effort? Chance. 2004;17:19–24.CrossRef
5.
go back to reference Bravata DM, McDonald KM, Smith WM, Rydzak C, Szeto H, Buckeridge DL, et al. Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Ann InternMed. 2004;140(11):910–22.CrossRef Bravata DM, McDonald KM, Smith WM, Rydzak C, Szeto H, Buckeridge DL, et al. Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Ann InternMed. 2004;140(11):910–22.CrossRef
6.
go back to reference Buckeridge DL. Outbreak detection through automated surveillance: a review of the determinants of detection. J Biomed Inform. 2007;40(4):370–9.CrossRefPubMed Buckeridge DL. Outbreak detection through automated surveillance: a review of the determinants of detection. J Biomed Inform. 2007;40(4):370–9.CrossRefPubMed
7.
go back to reference Buehler JW, Whitney EA, Smith D, Prietula MJ, Stanton SH, Isakov AP. Situational uses of syndromic surveillance. Biosecur Bioterror. 2009;7(2):165–77.CrossRefPubMed Buehler JW, Whitney EA, Smith D, Prietula MJ, Stanton SH, Isakov AP. Situational uses of syndromic surveillance. Biosecur Bioterror. 2009;7(2):165–77.CrossRefPubMed
8.
go back to reference Katz R, May L, Baker J, Test E. Redefining syndromic surveillance. J Epidemiol Glob Health. 2011;1(1):21–9.CrossRefPubMed Katz R, May L, Baker J, Test E. Redefining syndromic surveillance. J Epidemiol Glob Health. 2011;1(1):21–9.CrossRefPubMed
9.
go back to reference Elliot AJ, Morbey RA, Hughes HE, Harcourt SE, Smith S, Loveridge P, et al. Syndromic surveillance - a public health legacy of the London 2012 Olympic and Paralympic Games. Public Health. 2013;127(8):777–81.CrossRefPubMed Elliot AJ, Morbey RA, Hughes HE, Harcourt SE, Smith S, Loveridge P, et al. Syndromic surveillance - a public health legacy of the London 2012 Olympic and Paralympic Games. Public Health. 2013;127(8):777–81.CrossRefPubMed
10.
go back to reference Doroshenko A, Cooper D, Smith G, Gerard E, Chinemana F, Verlander N, et al. Evaluation of syndromic surveillance based on National Health Service Direct derived data - England and Wales. MMWR Suppl. 2005;54:117–22.PubMed Doroshenko A, Cooper D, Smith G, Gerard E, Chinemana F, Verlander N, et al. Evaluation of syndromic surveillance based on National Health Service Direct derived data - England and Wales. MMWR Suppl. 2005;54:117–22.PubMed
11.
go back to reference Sosin DM, DeThomasis J. Evaluation challenges for syndromic surveillance--making incremental progress. MMWR Suppl. 2004;53:125–9.PubMed Sosin DM, DeThomasis J. Evaluation challenges for syndromic surveillance--making incremental progress. MMWR Suppl. 2004;53:125–9.PubMed
12.
go back to reference Van den Wijngaard CC, van Pelt W, Nagelkerke NJ, Kretzschmar M, Koopmans MP. Evaluation of syndromic surveillance in the Netherlands: its added value and recommendations for implementation. Eurosurveillance. 2011;16(9):1–8. Van den Wijngaard CC, van Pelt W, Nagelkerke NJ, Kretzschmar M, Koopmans MP. Evaluation of syndromic surveillance in the Netherlands: its added value and recommendations for implementation. Eurosurveillance. 2011;16(9):1–8.
13.
go back to reference Terry W, Ostrowsky B, Huang A. Should we be worried? 443 Investigation of signals generated by an electronic syndromic surveillance system--Westchester County, New York. MMWR. 2004;53(Suppl):190–5. Terry W, Ostrowsky B, Huang A. Should we be worried? 443 Investigation of signals generated by an electronic syndromic surveillance system--Westchester County, New York. MMWR. 2004;53(Suppl):190–5.
14.
go back to reference Uscher-Pines L, Farrell CL, Cattani J, Hsieh YH, Moskal MD, Babin SM, et al. A survey of usage protocols of syndromic surveillance systems by state public health departments in the United States. J Public Health Manag Pract. 2009;15(5):432–8.CrossRefPubMed Uscher-Pines L, Farrell CL, Cattani J, Hsieh YH, Moskal MD, Babin SM, et al. A survey of usage protocols of syndromic surveillance systems by state public health departments in the United States. J Public Health Manag Pract. 2009;15(5):432–8.CrossRefPubMed
15.
go back to reference Buehler JW, Sonricker A, Paladini M, Soper P, Mostashari F. Syndromic surveillance practice in the United States: findings from a survey of state, territorial, and selected local health departments. Adv Dis Surveill. 2008;6(3):1–20. Buehler JW, Sonricker A, Paladini M, Soper P, Mostashari F. Syndromic surveillance practice in the United States: findings from a survey of state, territorial, and selected local health departments. Adv Dis Surveill. 2008;6(3):1–20.
16.
go back to reference Savage R, Chu A, Rosella LC, Crowcroft NS, Varia M, Policarpio ME, et al. Perceived usefulness of syndromic surveillance in Ontario during the H1N1 pandemic. J Public Health. 2012;34(2):195–202.CrossRef Savage R, Chu A, Rosella LC, Crowcroft NS, Varia M, Policarpio ME, et al. Perceived usefulness of syndromic surveillance in Ontario during the H1N1 pandemic. J Public Health. 2012;34(2):195–202.CrossRef
17.
go back to reference Chu A, Savage R, Whelan M, Rosella LC, Crowcroft NS, Willison D, et al. Assessing the relativ timeliness of Ontario's syndromic surveillance systems for early detection of the 2009 influenza H1N1 pandemic waves. Can J Public Health. 2013;104(4):340–7.CrossRefPubMed Chu A, Savage R, Whelan M, Rosella LC, Crowcroft NS, Willison D, et al. Assessing the relativ timeliness of Ontario's syndromic surveillance systems for early detection of the 2009 influenza H1N1 pandemic waves. Can J Public Health. 2013;104(4):340–7.CrossRefPubMed
18.
go back to reference Chu A, Savage R, Willison D, Crowcroft NS, Rosella LC, Sider D, et al. The use of syndromic surveillance for decision-making during the H1N1 pandemic: a qualitative study. BMC Public Health. 2012;12:929.CrossRefPubMedPubMedCentral Chu A, Savage R, Willison D, Crowcroft NS, Rosella LC, Sider D, et al. The use of syndromic surveillance for decision-making during the H1N1 pandemic: a qualitative study. BMC Public Health. 2012;12:929.CrossRefPubMedPubMedCentral
20.
go back to reference Van Dijk A, Aramini J, Edge G, Moore KM. Real-time surveillance for respiratory disease outbreaks, Ontario, Canada. Emerging Infect Dis. 2009;15(5):799–801.CrossRefPubMedCentral Van Dijk A, Aramini J, Edge G, Moore KM. Real-time surveillance for respiratory disease outbreaks, Ontario, Canada. Emerging Infect Dis. 2009;15(5):799–801.CrossRefPubMedCentral
21.
go back to reference Van V, Dijk A, McGuinness D, Rolland E, Moore K. Can Telehealth Ontario respiratory call volume be used as a proxy for emergency department respiratory visit surveillance by public health? CJEM. 2008;10(1):18–24.CrossRef Van V, Dijk A, McGuinness D, Rolland E, Moore K. Can Telehealth Ontario respiratory call volume be used as a proxy for emergency department respiratory visit surveillance by public health? CJEM. 2008;10(1):18–24.CrossRef
23.
go back to reference Gagliardi AR, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2016;11:38.CrossRefPubMedPubMedCentral Gagliardi AR, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2016;11:38.CrossRefPubMedPubMedCentral
24.
go back to reference Edwards RW. Internal analytical quality control using the cusum chart and truncated V-mask procedure. Ann Clin Biochem. 1980;17:205–11.CrossRefPubMed Edwards RW. Internal analytical quality control using the cusum chart and truncated V-mask procedure. Ann Clin Biochem. 1980;17:205–11.CrossRefPubMed
25.
go back to reference Rossi G, Lampugnani L, Marchi M. An approximate CUSUM procedure for surveillance of health events. Stat Med. 1999;18:2111–22.CrossRefPubMed Rossi G, Lampugnani L, Marchi M. An approximate CUSUM procedure for surveillance of health events. Stat Med. 1999;18:2111–22.CrossRefPubMed
26.
go back to reference Uscher-Pines L, Farrell CL, Babin SM, Cattani J, Gaydos CA, Hsieh YH, et al. Framework for the development of response protocols for public health syndromic surveillance systems: case studies of 8 US states. Disaster Med Public Health Prep. 2009;3(2):S29–36.CrossRefPubMed Uscher-Pines L, Farrell CL, Babin SM, Cattani J, Gaydos CA, Hsieh YH, et al. Framework for the development of response protocols for public health syndromic surveillance systems: case studies of 8 US states. Disaster Med Public Health Prep. 2009;3(2):S29–36.CrossRefPubMed
28.
go back to reference Thomas DR. A General Inductive Approach for Analyzing Qualitative Evaluation Data. Am J Eval. 2006;27:237–46.CrossRef Thomas DR. A General Inductive Approach for Analyzing Qualitative Evaluation Data. Am J Eval. 2006;27:237–46.CrossRef
29.
go back to reference Hsieh H-F, Shannon SE. Three Approaches to Qualitative Content Analysis. Qual Health Res. 2005;15:1277–88.CrossRefPubMed Hsieh H-F, Shannon SE. Three Approaches to Qualitative Content Analysis. Qual Health Res. 2005;15:1277–88.CrossRefPubMed
31.
go back to reference Gilca R, Skowronski DM, Douville-Fradet M, Amini R, Boulianne N, Rouleau I, et al. Mid-Season Estimates of Influenza Vaccine Effectiveness against Influenza A (H3N2) Hospitalization in the Elderly in Quebec, Canada, January 2015. Plos One. 2015;10(7):e0132195.CrossRefPubMedPubMedCentral Gilca R, Skowronski DM, Douville-Fradet M, Amini R, Boulianne N, Rouleau I, et al. Mid-Season Estimates of Influenza Vaccine Effectiveness against Influenza A (H3N2) Hospitalization in the Elderly in Quebec, Canada, January 2015. Plos One. 2015;10(7):e0132195.CrossRefPubMedPubMedCentral
32.
go back to reference Smith GE, Cooper DL, Loveridge P, Chinemana F, Gerard E, Verlander N. A national syndromic surveillance system for England and Wales using calls to a telephone helpline. Eurosurveillance. 2006;11(12):220–4.PubMed Smith GE, Cooper DL, Loveridge P, Chinemana F, Gerard E, Verlander N. A national syndromic surveillance system for England and Wales using calls to a telephone helpline. Eurosurveillance. 2006;11(12):220–4.PubMed
Metadata
Title
Evaluation of the ability of standardized supports to improve public health response to syndromic surveillance for respiratory diseases in Canada
Authors
Laura A. Rivera
Ye Li
Rachel D. Savage
Natasha S. Crowcroft
Shelly Bolotin
Laura C. Rosella
Wendy Lou
Jessica Hopkins
Ian Gemmill
Ian Johnson
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2017
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-017-4073-6

Other articles of this Issue 1/2017

BMC Public Health 1/2017 Go to the issue