Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2014

Open Access 01-12-2014 | Research article

Electronic immunization data collection systems: application of an evaluation framework

Authors: Christine L Heidebrecht, Jeffrey C Kwong, Michael Finkelstein, Sherman D Quan, Jennifer A Pereira, Susan Quach, Shelley L Deeks

Published in: BMC Medical Informatics and Decision Making | Issue 1/2014

Login to get access

Abstract

Background

Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units.

Methods

The Centers for Disease Control and Prevention’s Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations.

Results

Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers’ immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform.

Conclusions

Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage.
Appendix
Available only for authorised users
Literature
2.
go back to reference Laroche JA, Diniz AJ: Immunisation registers in Canada: progress made, current situation, and challenges for the future. Euro Surveill. 2012, 17: 20158-PubMed Laroche JA, Diniz AJ: Immunisation registers in Canada: progress made, current situation, and challenges for the future. Euro Surveill. 2012, 17: 20158-PubMed
3.
go back to reference Heidebrecht CL, Pereira JA, Quach S, Foisy J, Quan SD, Finkelstein M, Deeks SL, Guay M, Bettinger JA, Kolbe F, Crowcroft NS, Sikora CA, Buckeridge DL, Kwong JC: Approaches to immunization data collection employed across Canada during the pandemic (H1N1) 2009 influenza vaccination campaign. Can J Public Health. 2011, 102: 349-54.PubMed Heidebrecht CL, Pereira JA, Quach S, Foisy J, Quan SD, Finkelstein M, Deeks SL, Guay M, Bettinger JA, Kolbe F, Crowcroft NS, Sikora CA, Buckeridge DL, Kwong JC: Approaches to immunization data collection employed across Canada during the pandemic (H1N1) 2009 influenza vaccination campaign. Can J Public Health. 2011, 102: 349-54.PubMed
4.
go back to reference Centers for Disease Control and Prevention: Updated guidelines for evaluating public health surveillance systems. MMWR Recomm Rep. 2001, 50 (RR-13): 1-35. Centers for Disease Control and Prevention: Updated guidelines for evaluating public health surveillance systems. MMWR Recomm Rep. 2001, 50 (RR-13): 1-35.
5.
go back to reference Centers for Disease Control and Prevention: Progress in immunization information systems - United States, 2009. MMWR Morb Mortal Wkly Rep. 2011, 60 (1): 10-12. Centers for Disease Control and Prevention: Progress in immunization information systems - United States, 2009. MMWR Morb Mortal Wkly Rep. 2011, 60 (1): 10-12.
6.
go back to reference Canada H: Functional standards and minimum (core) data sets for a national immunization registry network and vaccine associated adverse events surveillance system. Can Commun Dis Rep. 2002, 28 (Suppl 6): 1-32. Canada H: Functional standards and minimum (core) data sets for a national immunization registry network and vaccine associated adverse events surveillance system. Can Commun Dis Rep. 2002, 28 (Suppl 6): 1-32.
8.
go back to reference Pereira JA, Quach S, Heidebrecht CL, Foisy J, Quan S, Finkelstein M, Sikora CA, Bettinger JA, Buckeridge DL, McCarthy A, Deeks SL, Kwong JC: Pan-Canadian assessment of pandemic immunization data collection: study methodology. BMC Med Res Methodol. 2010, 10: 51-10.1186/1471-2288-10-51.CrossRefPubMedPubMedCentral Pereira JA, Quach S, Heidebrecht CL, Foisy J, Quan S, Finkelstein M, Sikora CA, Bettinger JA, Buckeridge DL, McCarthy A, Deeks SL, Kwong JC: Pan-Canadian assessment of pandemic immunization data collection: study methodology. BMC Med Res Methodol. 2010, 10: 51-10.1186/1471-2288-10-51.CrossRefPubMedPubMedCentral
9.
go back to reference Szklo M, Nieto FJ: Epidemiology: Beyond the Basics. 2007, Burlington: Jones and Bartlett, 2 Szklo M, Nieto FJ: Epidemiology: Beyond the Basics. 2007, Burlington: Jones and Bartlett, 2
10.
go back to reference Powerpoint Presentation. Ontario Ministry of Health and Long-Term Care: Overview of the Panorama Project in Ontario. 2012, Ontario Public Health Integrated Solutions Branch Powerpoint Presentation. Ontario Ministry of Health and Long-Term Care: Overview of the Panorama Project in Ontario. 2012, Ontario Public Health Integrated Solutions Branch
11.
go back to reference Jha AK, Doolan D, Grandt D, Scott T, Bates DW: The use of health information technology in seven nations. Int J Med Inform. 2008, 77 (12): 848-54. 10.1016/j.ijmedinf.2008.06.007.CrossRefPubMed Jha AK, Doolan D, Grandt D, Scott T, Bates DW: The use of health information technology in seven nations. Int J Med Inform. 2008, 77 (12): 848-54. 10.1016/j.ijmedinf.2008.06.007.CrossRefPubMed
12.
go back to reference Salzberg CA, Jang Y, Rozenblum R, Zimlichman E, Tambllyn R, Bates DW: Policy initiatives for health information technology: a qualitative study of U.S. Expectations and Canada’s experience. Int J Med Inform. 2012, 81 (10): 713-22. 10.1016/j.ijmedinf.2012.07.007.CrossRefPubMed Salzberg CA, Jang Y, Rozenblum R, Zimlichman E, Tambllyn R, Bates DW: Policy initiatives for health information technology: a qualitative study of U.S. Expectations and Canada’s experience. Int J Med Inform. 2012, 81 (10): 713-22. 10.1016/j.ijmedinf.2012.07.007.CrossRefPubMed
15.
go back to reference Hull BP, Deeks SL, McIntyre PB: The Australian Childhood Immunisation Register - A model for universal immunisation registers?. Vaccine. 2009, 27: 5054-5060. 10.1016/j.vaccine.2009.06.056.CrossRefPubMed Hull BP, Deeks SL, McIntyre PB: The Australian Childhood Immunisation Register - A model for universal immunisation registers?. Vaccine. 2009, 27: 5054-5060. 10.1016/j.vaccine.2009.06.056.CrossRefPubMed
16.
go back to reference Chin LK, Crawford NW, Rowles G, Butterly JP: Australian immunisation registers: established foundations and opportunities for improvement. Euro Surveill. 2012, 17: 20148-PubMed Chin LK, Crawford NW, Rowles G, Butterly JP: Australian immunisation registers: established foundations and opportunities for improvement. Euro Surveill. 2012, 17: 20148-PubMed
18.
go back to reference Grove Krause T, Jakobsen S, Haarh M, Mølbak K: The Danish vaccination register. Euro Surveill. 2012, 17: 20155-PubMed Grove Krause T, Jakobsen S, Haarh M, Mølbak K: The Danish vaccination register. Euro Surveill. 2012, 17: 20155-PubMed
19.
go back to reference Trogstad L, Ung G, Hagerup-Jenssen M, Cappelen I, Haugen IL, Feiring B: The Norwegian immunisation register – SYSVAK. Euro Surveill. 2012, 17: 20147-PubMed Trogstad L, Ung G, Hagerup-Jenssen M, Cappelen I, Haugen IL, Feiring B: The Norwegian immunisation register – SYSVAK. Euro Surveill. 2012, 17: 20147-PubMed
Metadata
Title
Electronic immunization data collection systems: application of an evaluation framework
Authors
Christine L Heidebrecht
Jeffrey C Kwong
Michael Finkelstein
Sherman D Quan
Jennifer A Pereira
Susan Quach
Shelley L Deeks
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2014
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-14-5

Other articles of this Issue 1/2014

BMC Medical Informatics and Decision Making 1/2014 Go to the issue