Skip to main content
Top
Published in: BMC Pediatrics 1/2014

Open Access 01-12-2014 | Research article

The pot calling the kettle black: the extent and type of errors in a computerized immunization registry and by parent report

Authors: Shannon E MacDonald, Donald P Schopflocher, Richard P Golonka

Published in: BMC Pediatrics | Issue 1/2014

Login to get access

Abstract

Background

Accurate classification of children’s immunization status is essential for clinical care, administration and evaluation of immunization programs, and vaccine program research. Computerized immunization registries have been proposed as a valuable alternative to provider paper records or parent report, but there is a need to better understand the challenges associated with their use. This study assessed the accuracy of immunization status classification in an immunization registry as compared to parent report and determined the number and type of errors occurring in both sources.

Methods

This study was a sub-analysis of a larger study which compared the characteristics of children whose immunizations were up to date (UTD) at two years as compared to those not UTD. Children’s immunization status was initially determined from a population-based immunization registry, and then compared to parent report of immunization status, as reported in a postal survey. Discrepancies between the two sources were adjudicated by review of immunization providers’ hard-copy clinic records. Descriptive analyses included calculating proportions and confidence intervals for errors in classification and reporting of the type and frequency of errors.

Results

Among the 461 survey respondents, there were 60 discrepancies in immunization status. The majority of errors were due to parent report (n = 44), but the registry was not without fault (n = 16). Parents tended to erroneously report their child as UTD, whereas the registry was more likely to wrongly classify children as not UTD. Reasons for registry errors included failure to account for varicella disease history, variable number of doses required due to age at series initiation, and doses administered out of the region.

Conclusions

These results confirm that parent report is often flawed, but also identify that registries are prone to misclassification of immunization status. Immunization program administrators and researchers need to institute measures to identify and reduce misclassification, in order for registries to play an effective role in the control of vaccine-preventable disease.
Literature
1.
go back to reference Placzek H, Madoff LC: The use of immunization registry-based data in vaccine effectiveness studies. Vaccine. 2011, 29: 399-411. 10.1016/j.vaccine.2010.11.007.CrossRefPubMed Placzek H, Madoff LC: The use of immunization registry-based data in vaccine effectiveness studies. Vaccine. 2011, 29: 399-411. 10.1016/j.vaccine.2010.11.007.CrossRefPubMed
2.
go back to reference Greene SK, Shi P, Dutta-Linn MM, Shoup JA, Hinrichsen VL, Ray P, et al: Accuracy of data on influenza vaccination status at four vaccine safety datalink sites. Am J Prev Med. 2009, 37: 552-555. 10.1016/j.amepre.2009.08.022.CrossRefPubMed Greene SK, Shi P, Dutta-Linn MM, Shoup JA, Hinrichsen VL, Ray P, et al: Accuracy of data on influenza vaccination status at four vaccine safety datalink sites. Am J Prev Med. 2009, 37: 552-555. 10.1016/j.amepre.2009.08.022.CrossRefPubMed
3.
go back to reference Laroche JA, Diniz AJ: Immunisation registers in Canada: progress made, current situation, and challenges for the future. Euro Surveill. 2012, 17: 17- Laroche JA, Diniz AJ: Immunisation registers in Canada: progress made, current situation, and challenges for the future. Euro Surveill. 2012, 17: 17-
4.
go back to reference Linkins RW, Feikema SM: Immunization registries: the cornerstone of childhood immunization in the 21st century. Pediatr Ann. 1998, 27: 349-354.CrossRefPubMed Linkins RW, Feikema SM: Immunization registries: the cornerstone of childhood immunization in the 21st century. Pediatr Ann. 1998, 27: 349-354.CrossRefPubMed
5.
go back to reference Wood D, Saarlas KN, Inkelas M, Matyas BT: Immunization registries in the United States: Implications for the practice of public health in a changing health care system. Annu Rev Public Health. 1999, 20: 231-255. 10.1146/annurev.publhealth.20.1.231.CrossRefPubMed Wood D, Saarlas KN, Inkelas M, Matyas BT: Immunization registries in the United States: Implications for the practice of public health in a changing health care system. Annu Rev Public Health. 1999, 20: 231-255. 10.1146/annurev.publhealth.20.1.231.CrossRefPubMed
6.
go back to reference Salmon DA, Smith PJ, Navar AM, Pan WK, Omer SB, Singleton JA, et al: Measuring immunization coverage among preschool children: past, present, and future opportunities. Epidemiol Rev. 2006, 28: 27-40. 10.1093/epirev/mxj001.CrossRefPubMed Salmon DA, Smith PJ, Navar AM, Pan WK, Omer SB, Singleton JA, et al: Measuring immunization coverage among preschool children: past, present, and future opportunities. Epidemiol Rev. 2006, 28: 27-40. 10.1093/epirev/mxj001.CrossRefPubMed
7.
go back to reference Freeman VA, DeFriese GH: The challenge and potential of childhood immunization registries. Annu Rev Public Health. 2003, 24: 227-246. 10.1146/annurev.publhealth.24.100901.140831.CrossRefPubMed Freeman VA, DeFriese GH: The challenge and potential of childhood immunization registries. Annu Rev Public Health. 2003, 24: 227-246. 10.1146/annurev.publhealth.24.100901.140831.CrossRefPubMed
8.
go back to reference Bentsi-Enchill A, Duclos P, Scott J, MacIsaac K, Halperin S: Childhood pertussis immunization status as reported by parents and the completeness of public-health and physician records in Nova Scotia. Can Commun Dis Rep. 1996, 22: 201-204.PubMed Bentsi-Enchill A, Duclos P, Scott J, MacIsaac K, Halperin S: Childhood pertussis immunization status as reported by parents and the completeness of public-health and physician records in Nova Scotia. Can Commun Dis Rep. 1996, 22: 201-204.PubMed
9.
go back to reference Dorell CG, Jain N, Yankey D: Validity of parent-reported vaccination status for adolescents aged 13–17 years: national immunization survey-teen, 2008. Public Health Rep. 2011, 126 (2): 60-69.PubMedPubMedCentral Dorell CG, Jain N, Yankey D: Validity of parent-reported vaccination status for adolescents aged 13–17 years: national immunization survey-teen, 2008. Public Health Rep. 2011, 126 (2): 60-69.PubMedPubMedCentral
10.
go back to reference Stecher DS, Adelman R, Brinkman T, Bulloch B: Accuracy of a state immunization registry in the pediatric emergency department. Pediatr Emerg Care. 2008, 24: 71-74. 10.1097/PEC.0b013e318163db4d.CrossRefPubMed Stecher DS, Adelman R, Brinkman T, Bulloch B: Accuracy of a state immunization registry in the pediatric emergency department. Pediatr Emerg Care. 2008, 24: 71-74. 10.1097/PEC.0b013e318163db4d.CrossRefPubMed
11.
go back to reference Suarez L, Simpson DM, Smith DR: Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics. 1997, 99: e3-CrossRefPubMed Suarez L, Simpson DM, Smith DR: Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics. 1997, 99: e3-CrossRefPubMed
12.
go back to reference Miles M, Ryman TK, Dietz V, Zell E, Luman ET: Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. Vaccine. 2013, 31: 1560-1568. 10.1016/j.vaccine.2012.10.089.CrossRefPubMed Miles M, Ryman TK, Dietz V, Zell E, Luman ET: Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. Vaccine. 2013, 31: 1560-1568. 10.1016/j.vaccine.2012.10.089.CrossRefPubMed
13.
go back to reference Lister S, McIntyre PB, Burgess MA, O’Brien ED: Immunisation coverage in Australian children: a systematic review 1990–1998. Commun Dis Intell. 1999, 23: 145-170.PubMed Lister S, McIntyre PB, Burgess MA, O’Brien ED: Immunisation coverage in Australian children: a systematic review 1990–1998. Commun Dis Intell. 1999, 23: 145-170.PubMed
14.
go back to reference Bolton P, Holt E, Ross A, Hughart N, Guyer B: Estimating vaccination coverage using parental recall, vaccination cards, and medical records. Public Health Rep. 1998, 113: 521-PubMedPubMedCentral Bolton P, Holt E, Ross A, Hughart N, Guyer B: Estimating vaccination coverage using parental recall, vaccination cards, and medical records. Public Health Rep. 1998, 113: 521-PubMedPubMedCentral
15.
go back to reference Goldstein KP, Kviz FJ, Daum RS: Accuracy of immunization histories provided by adults accompanying preschool children to a pediatric emergency department. JAMA. 1993, 270: 2190-2194. 10.1001/jama.1993.03510180060034.CrossRefPubMed Goldstein KP, Kviz FJ, Daum RS: Accuracy of immunization histories provided by adults accompanying preschool children to a pediatric emergency department. JAMA. 1993, 270: 2190-2194. 10.1001/jama.1993.03510180060034.CrossRefPubMed
16.
go back to reference Davidson AJ, Melinkovich P, Beaty BL, Chandramouli V, Hambidge SJ, Phibbs SL, et al: Immunization registry accuracy: improvement with progressive clinical application. Am J Prev Med. 2003, 24: 276-280. 10.1016/S0749-3797(02)00638-4.CrossRefPubMed Davidson AJ, Melinkovich P, Beaty BL, Chandramouli V, Hambidge SJ, Phibbs SL, et al: Immunization registry accuracy: improvement with progressive clinical application. Am J Prev Med. 2003, 24: 276-280. 10.1016/S0749-3797(02)00638-4.CrossRefPubMed
21.
go back to reference Khare M, Piccinino L, Barker LE, Linkins RW: Assessment of immunization registry databases as supplemental sources of data to improve ascertainment of vaccination coverage estimates in the national immunization survey. Arch Pediatr Adolesc Med. 2006, 160: 838-842. 10.1001/archpedi.160.8.838.CrossRefPubMed Khare M, Piccinino L, Barker LE, Linkins RW: Assessment of immunization registry databases as supplemental sources of data to improve ascertainment of vaccination coverage estimates in the national immunization survey. Arch Pediatr Adolesc Med. 2006, 160: 838-842. 10.1001/archpedi.160.8.838.CrossRefPubMed
22.
go back to reference Kelly JS, Zimmerman LA, Reed K, Enger KS: Immunization information systems national research and evaluation agenda. J Public Health Manag Pract. 2007, 13: 35-38. 10.1097/00124784-200701000-00007.CrossRefPubMed Kelly JS, Zimmerman LA, Reed K, Enger KS: Immunization information systems national research and evaluation agenda. J Public Health Manag Pract. 2007, 13: 35-38. 10.1097/00124784-200701000-00007.CrossRefPubMed
23.
go back to reference Boulianne N, Deceuninck G, Duval B, et al: Why are some children incompletely vaccinated at the age of 2?. Can J Public Health. 2003, 94: 218-223.PubMed Boulianne N, Deceuninck G, Duval B, et al: Why are some children incompletely vaccinated at the age of 2?. Can J Public Health. 2003, 94: 218-223.PubMed
24.
go back to reference Ortega AN, Andrews SF, Katz SH, Dowshen SA, Curtice WS, Cannon ME, et al: Comparing a computer-based childhood vaccination registry with parental vaccination cards: a population-based study of Delaware children. Clin Pediatr. 1997, 36: 217-221. 10.1177/000992289703600406.CrossRef Ortega AN, Andrews SF, Katz SH, Dowshen SA, Curtice WS, Cannon ME, et al: Comparing a computer-based childhood vaccination registry with parental vaccination cards: a population-based study of Delaware children. Clin Pediatr. 1997, 36: 217-221. 10.1177/000992289703600406.CrossRef
25.
go back to reference Mahon BE, Shea KM, Dougherty NN, Loughlin AM: Implications for registry-based vaccine effectiveness studies from an evaluation of an immunization registry: a cross-sectional study. BMC Public Health. 2008, 8: 160-10.1186/1471-2458-8-160.CrossRefPubMedPubMedCentral Mahon BE, Shea KM, Dougherty NN, Loughlin AM: Implications for registry-based vaccine effectiveness studies from an evaluation of an immunization registry: a cross-sectional study. BMC Public Health. 2008, 8: 160-10.1186/1471-2458-8-160.CrossRefPubMedPubMedCentral
26.
go back to reference Samuels RC, Appel L, Reddy SI, Tilson RS: Improving accuracy in a computerized immunization registry. Ambul Pediatr. 2002, 2: 187-192. 10.1367/1539-4409(2002)002<0187:IAIACI>2.0.CO;2.CrossRefPubMed Samuels RC, Appel L, Reddy SI, Tilson RS: Improving accuracy in a computerized immunization registry. Ambul Pediatr. 2002, 2: 187-192. 10.1367/1539-4409(2002)002<0187:IAIACI>2.0.CO;2.CrossRefPubMed
27.
go back to reference Yusuf H, Adams M, Rodewald L, Lu P, Rosenthal J, Legum SE, et al: Fragmentation of immunization history among providers and parents of children in selected underserved areas. Am J Prev Med. 2002, 23: 106-112. 10.1016/S0749-3797(02)00463-4.CrossRefPubMed Yusuf H, Adams M, Rodewald L, Lu P, Rosenthal J, Legum SE, et al: Fragmentation of immunization history among providers and parents of children in selected underserved areas. Am J Prev Med. 2002, 23: 106-112. 10.1016/S0749-3797(02)00463-4.CrossRefPubMed
28.
go back to reference Stokley S, Rodewald LE, Maes EF: The impact of record scattering on the measurement of immunization coverage. Pediatrics. 2001, 107: 91-86. 10.1542/peds.107.1.91.CrossRefPubMed Stokley S, Rodewald LE, Maes EF: The impact of record scattering on the measurement of immunization coverage. Pediatrics. 2001, 107: 91-86. 10.1542/peds.107.1.91.CrossRefPubMed
29.
go back to reference Wilton R, Pennisi AJ: Evaluating the accuracy of transcribed computer-stored immunization data. Pediatrics. 1994, 94 (6 Pt 1): 902-906.PubMed Wilton R, Pennisi AJ: Evaluating the accuracy of transcribed computer-stored immunization data. Pediatrics. 1994, 94 (6 Pt 1): 902-906.PubMed
30.
go back to reference Kolasa MS, Chilkatowsky AP, Clarke KR, Lutz JP: How complete are immunization registries? the Philadelphia story. Ambul Pediatr. 2006, 6: 21-24. 10.1016/j.ambp.2005.08.006.CrossRefPubMed Kolasa MS, Chilkatowsky AP, Clarke KR, Lutz JP: How complete are immunization registries? the Philadelphia story. Ambul Pediatr. 2006, 6: 21-24. 10.1016/j.ambp.2005.08.006.CrossRefPubMed
31.
go back to reference Adams WG, Conners WP, Mann AM, Palfrey S: Immunization entry at the point of service improves quality, saves time, and is well-accepted. Pediatrics. 2000, 106: 489-492. 10.1542/peds.106.3.489.CrossRefPubMed Adams WG, Conners WP, Mann AM, Palfrey S: Immunization entry at the point of service improves quality, saves time, and is well-accepted. Pediatrics. 2000, 106: 489-492. 10.1542/peds.106.3.489.CrossRefPubMed
32.
go back to reference Lawrence GL, MacIntyre CR, Hull BP, McIntyre PB: Effectiveness of the linkage of child care and maternity payments to childhood immunisation. Vaccine. 2004, 22: 2345-2350. 10.1016/j.vaccine.2003.10.038.CrossRefPubMed Lawrence GL, MacIntyre CR, Hull BP, McIntyre PB: Effectiveness of the linkage of child care and maternity payments to childhood immunisation. Vaccine. 2004, 22: 2345-2350. 10.1016/j.vaccine.2003.10.038.CrossRefPubMed
33.
go back to reference Irving SA, Donahue JG, Shay DK, Ellis-Coyle TL, Belongia EA: Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. Vaccine. 2009, 27: 6546-6549. 10.1016/j.vaccine.2009.08.050.CrossRefPubMed Irving SA, Donahue JG, Shay DK, Ellis-Coyle TL, Belongia EA: Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. Vaccine. 2009, 27: 6546-6549. 10.1016/j.vaccine.2009.08.050.CrossRefPubMed
34.
go back to reference Boyd TD, Linkins RW, Mason K, Bulim I, Lemke B: Assessing immunization registry data completeness in Bexar county, Texas. Am J Prev Med. 2002, 22: 184-187. 10.1016/S0749-3797(01)00427-5.CrossRefPubMed Boyd TD, Linkins RW, Mason K, Bulim I, Lemke B: Assessing immunization registry data completeness in Bexar county, Texas. Am J Prev Med. 2002, 22: 184-187. 10.1016/S0749-3797(01)00427-5.CrossRefPubMed
Metadata
Title
The pot calling the kettle black: the extent and type of errors in a computerized immunization registry and by parent report
Authors
Shannon E MacDonald
Donald P Schopflocher
Richard P Golonka
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2014
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/1471-2431-14-1

Other articles of this Issue 1/2014

BMC Pediatrics 1/2014 Go to the issue