Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

Validity of parental recalls to estimate vaccination coverage: evidence from Tanzania

Authors: Peter Binyaruka, Josephine Borghi

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

The estimates of vaccination coverage are measured from administrative data and from population based survey. While both card-based and recall data are collected through population survey, and the recall is when the card is missing, the preferred estimates remain of the card-based due to limited validity of parental recalls. As there is a concern of missing cards in poor settings, the evidence on validity of parental recalls is limited and varied across vaccine types, and therefore timely and needed. We validated the recalls against card-based data based on population survey in Tanzania.

Methods

We used a cross-sectional survey of about 3000 households with women who delivered in the last 12 months prior to the interview in 2012 from three regions in Tanzania. Data on the vaccination status on four vaccine types were collected using two data sources, card and recall-based. We compared the level of agreement and identified the recall bias between the two data sources. We further computed the sensitivity and specificity of parental recalls, and used a multivariate logit model to identify the determinants of parental recall bias.

Results

Most parents (85.4%) were able to present the vaccination cards during the survey, and these were used for analysis. Although the coverage levels were generally similar across data sources, the recall-based data slightly overestimated the coverage estimates. The level of agreement between the two data sources was high above 94%, with minimal recall bias of less than 6%. The recall bias due to over-reporting were slightly higher than that due to under-reporting. The sensitivity of parental recalls was generally high for all vaccine types, while the specificity was generally low across vaccine types except for measles. The minimal recall bias for DPT and measles were associated with the mother’s age, education level, health insurance status, region location and child age.

Conclusion

Parental recalls when compared to card-based data are hugely accurate with minimal recall bias in Tanzania. Our findings support the use of parental recall collected through surveys to identify the child vaccination status in the absence of vaccination cards. The use of recall data alongside card-based estimates also ensures more representative coverage estimates.
Literature
1.
go back to reference United Nations. The Sustain Dev Goals Report 2016. New York: United Nations; 2016. United Nations. The Sustain Dev Goals Report 2016. New York: United Nations; 2016.
2.
go back to reference Lim SS, Stein DB, Charrow A, Murray CJ. Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008;372(9655):2031–46.CrossRefPubMed Lim SS, Stein DB, Charrow A, Murray CJ. Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008;372(9655):2031–46.CrossRefPubMed
3.
go back to reference WHO. Monitoring the building blocks of health systems: A handbook of indicators and their measurement startegies. Geneva, Switzerland: World Health Organization; 2010. WHO. Monitoring the building blocks of health systems: A handbook of indicators and their measurement startegies. Geneva, Switzerland: World Health Organization; 2010.
4.
go back to reference Miles M, Ryman TK, Dietz V, Zell E, Luman ET. Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. Vaccine. 2013;31(12):1560–8.CrossRefPubMed Miles M, Ryman TK, Dietz V, Zell E, Luman ET. Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. Vaccine. 2013;31(12):1560–8.CrossRefPubMed
5.
go back to reference Bos E, Batson A. Using immunization coverage rates for monitoring health sector performance. Washington, DC: The World Bank; 2000. Bos E, Batson A. Using immunization coverage rates for monitoring health sector performance. Washington, DC: The World Bank; 2000.
6.
go back to reference Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, Wolfson L, Jones G, Birmingham M. WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ. 2009;87(7):535–41.CrossRefPubMedPubMedCentral Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, Wolfson L, Jones G, Birmingham M. WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ. 2009;87(7):535–41.CrossRefPubMedPubMedCentral
7.
go back to reference Luman ET, Ryman TK, Sablan M. Estimating vaccination coverage: validity of household-retained vaccination cards and parental recall. Vaccine. 2009;27(19):2534–9.CrossRefPubMed Luman ET, Ryman TK, Sablan M. Estimating vaccination coverage: validity of household-retained vaccination cards and parental recall. Vaccine. 2009;27(19):2534–9.CrossRefPubMed
8.
9.
go back to reference Murray CJ, Shengelia B, Gupta N, Moussavi S, Tandon A, Thieren M. Validity of reported vaccination coverage in 45 countries. Lancet. 2003;362(9389):1022–7.CrossRefPubMed Murray CJ, Shengelia B, Gupta N, Moussavi S, Tandon A, Thieren M. Validity of reported vaccination coverage in 45 countries. Lancet. 2003;362(9389):1022–7.CrossRefPubMed
12.
go back to reference Borgdorff MW, Walker GJ. Estimating vaccination coverage: routine information or sample survey? J Trop Med Hyg. 1988;91(1):35–42.PubMed Borgdorff MW, Walker GJ. Estimating vaccination coverage: routine information or sample survey? J Trop Med Hyg. 1988;91(1):35–42.PubMed
13.
go back to reference Cutts FT, Waldman RJ, Zoffman HM. Surveillance for the expanded Programme on immunization. Bull World Health Organ. 1993;71(5):633–9.PubMedPubMedCentral Cutts FT, Waldman RJ, Zoffman HM. Surveillance for the expanded Programme on immunization. Bull World Health Organ. 1993;71(5):633–9.PubMedPubMedCentral
14.
go back to reference Haddad S, Bicaba A, Feletto M, Fournier P, Zunzunegui MV. Heterogeneity in the validity of administrative-based estimates of immunization coverage across health districts in Burkina Faso: implications for measurement, monitoring and planning. Health Policy Plan. 2010;25(5):393–405.CrossRefPubMedPubMedCentral Haddad S, Bicaba A, Feletto M, Fournier P, Zunzunegui MV. Heterogeneity in the validity of administrative-based estimates of immunization coverage across health districts in Burkina Faso: implications for measurement, monitoring and planning. Health Policy Plan. 2010;25(5):393–405.CrossRefPubMedPubMedCentral
15.
go back to reference Cutts FT, Izurieta HS, Rhoda DA. Measuring coverage in MNCH: design, implementation, and interpretation challenges associated with tracking vaccination coverage using household surveys. PLoS Med. 2013;10(5):e1001404.CrossRefPubMedPubMedCentral Cutts FT, Izurieta HS, Rhoda DA. Measuring coverage in MNCH: design, implementation, and interpretation challenges associated with tracking vaccination coverage using household surveys. PLoS Med. 2013;10(5):e1001404.CrossRefPubMedPubMedCentral
16.
go back to reference WHO. Immunization coverage cluster survey—reference manual. Geneva, Switzerland: World Health Organization; 2005. WHO. Immunization coverage cluster survey—reference manual. Geneva, Switzerland: World Health Organization; 2005.
17.
go back to reference Eisele TP, Rhoda DA, Cutts FT, Keating J, Ren R, Barros AJ, Arnold F. Measuring coverage in MNCH: total survey error and the interpretation of intervention coverage estimates from household surveys. PLoS Med. 2013;10(5):e1001386.CrossRefPubMedPubMedCentral Eisele TP, Rhoda DA, Cutts FT, Keating J, Ren R, Barros AJ, Arnold F. Measuring coverage in MNCH: total survey error and the interpretation of intervention coverage estimates from household surveys. PLoS Med. 2013;10(5):e1001386.CrossRefPubMedPubMedCentral
18.
go back to reference Ramakrishnan R, Venkata Rao T, Sundaramoorthy L, Joshua V. Magnitude of recall bias in the estimation of immunization coverage and its determinants. Indian Pediatr. 1999;36:881–6.PubMed Ramakrishnan R, Venkata Rao T, Sundaramoorthy L, Joshua V. Magnitude of recall bias in the estimation of immunization coverage and its determinants. Indian Pediatr. 1999;36:881–6.PubMed
19.
go back to reference Gareaballah ET, Loevinsohn BP. The accuracy of mother's reports about their children's vaccination status. Bull World Health Organ. 1989;67(6):669–74.PubMedPubMedCentral Gareaballah ET, Loevinsohn BP. The accuracy of mother's reports about their children's vaccination status. Bull World Health Organ. 1989;67(6):669–74.PubMedPubMedCentral
20.
go back to reference Selimuzzaman A, Ullah M, Haque M. Accuracy of mothers’ reports regarding vaccination status of their children in urban Bangladesh. TAJ: Journal of Teachers Association. 2009;21(1):4. Selimuzzaman A, Ullah M, Haque M. Accuracy of mothers’ reports regarding vaccination status of their children in urban Bangladesh. TAJ: Journal of Teachers Association. 2009;21(1):4.
21.
go back to reference Brown J, Monasch R, Bicego G, Burton A, Boerma JT. An assessment of the quality of national child immunization coverage estimates in population-based surveys, vol. 700. Chapel Hill (North Carolina): MEASURE Evaluation; 2002. Brown J, Monasch R, Bicego G, Burton A, Boerma JT. An assessment of the quality of national child immunization coverage estimates in population-based surveys, vol. 700. Chapel Hill (North Carolina): MEASURE Evaluation; 2002.
22.
go back to reference Bolton P, Holt E, Ross A, Hughart N, Guyer B. Estimating vaccination coverage using parental recall, vaccination cards, and medical records. Public Health Rep. 1998;113(6):521–6.PubMedPubMedCentral Bolton P, Holt E, Ross A, Hughart N, Guyer B. Estimating vaccination coverage using parental recall, vaccination cards, and medical records. Public Health Rep. 1998;113(6):521–6.PubMedPubMedCentral
23.
go back to reference Suarez L, Simpson DM, Smith DR. Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics. 1997;99(5):E3.CrossRefPubMed Suarez L, Simpson DM, Smith DR. Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics. 1997;99(5):E3.CrossRefPubMed
24.
go back to reference Langsten R, Hill K. The accuracy of mothers' reports of child vaccination: evidence from rural Egypt. Soc Sci Med. 1998;46(9):1205–12.CrossRefPubMed Langsten R, Hill K. The accuracy of mothers' reports of child vaccination: evidence from rural Egypt. Soc Sci Med. 1998;46(9):1205–12.CrossRefPubMed
25.
go back to reference George K, Victor S, Abel R. Reliability of mother as an informant with regard to immunisation. Indian J Pediatr. 1990;57(4):588–90.CrossRefPubMed George K, Victor S, Abel R. Reliability of mother as an informant with regard to immunisation. Indian J Pediatr. 1990;57(4):588–90.CrossRefPubMed
27.
go back to reference NBS. Tanzania Population and Housing Census: Population Distribution by Administrative Areas 2012. Dar es Salaam: National Bureau of Statistics (NBS); 2013. NBS. Tanzania Population and Housing Census: Population Distribution by Administrative Areas 2012. Dar es Salaam: National Bureau of Statistics (NBS); 2013.
28.
go back to reference Binyaruka P, Patouillard E, Powell-Jackson T, Greco G, Maestad O, Borghi J. Effect of paying for performance on utilisation, quality, and user costs of health Services in Tanzania: a controlled before and after study. PLoS One. 2015;10(8):e0135013.CrossRefPubMedPubMedCentral Binyaruka P, Patouillard E, Powell-Jackson T, Greco G, Maestad O, Borghi J. Effect of paying for performance on utilisation, quality, and user costs of health Services in Tanzania: a controlled before and after study. PLoS One. 2015;10(8):e0135013.CrossRefPubMedPubMedCentral
29.
go back to reference Borghi J, Mayumana I, Mashasi I, Binyaruka P, Patouillard E, Njau I, Maestad O, Abdulla S, Mamdani M. Protocol for the evaluation of a pay for performance programme in Pwani region in Tanzania: a controlled before and after study. Implement Sci. 2013;8:80.CrossRefPubMedPubMedCentral Borghi J, Mayumana I, Mashasi I, Binyaruka P, Patouillard E, Njau I, Maestad O, Abdulla S, Mamdani M. Protocol for the evaluation of a pay for performance programme in Pwani region in Tanzania: a controlled before and after study. Implement Sci. 2013;8:80.CrossRefPubMedPubMedCentral
31.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
32.
go back to reference Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Physical therapy. 2005;85(3):257–68.PubMed Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Physical therapy. 2005;85(3):257–68.PubMed
33.
go back to reference Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990;43(6):551–8.CrossRefPubMed Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990;43(6):551–8.CrossRefPubMed
34.
go back to reference Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–9.CrossRefPubMed Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–9.CrossRefPubMed
35.
36.
go back to reference Filmer D, Pritchett LH. Estimating wealth effects without expenditure data--or tears: an application to educational enrollments in states of India. Demography. 2001;38(1):115–32.PubMed Filmer D, Pritchett LH. Estimating wealth effects without expenditure data--or tears: an application to educational enrollments in states of India. Demography. 2001;38(1):115–32.PubMed
37.
go back to reference Vyas S, Kumaranayake L. Constructing socio-economic status indices: how to use principal components analysis. Health Policy Plan. 2006;21(6):459–68.CrossRefPubMed Vyas S, Kumaranayake L. Constructing socio-economic status indices: how to use principal components analysis. Health Policy Plan. 2006;21(6):459–68.CrossRefPubMed
38.
Metadata
Title
Validity of parental recalls to estimate vaccination coverage: evidence from Tanzania
Authors
Peter Binyaruka
Josephine Borghi
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3270-z

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue