Skip to main content
Top
Published in: BMC Public Health 1/2011

Open Access 01-12-2011 | Research article

Validating child vaccination status in a demographic surveillance system using data from a clinical cohort study: evidence from rural South Africa

Authors: James Ndirangu, Ruth Bland, Till Bärnighausen, Marie-Louise Newell

Published in: BMC Public Health | Issue 1/2011

Login to get access

Abstract

Background

Childhood vaccination coverage can be estimated from a range of sources. This study aims to validate vaccination data from a longitudinal population-based demographic surveillance system (DSS) against data from a clinical cohort study.

Methods

The sample includes 821 children in the Vertical Transmission cohort Study (VTS), who were born between December 2001 and April 2005, and were matched to the Africa Centre DSS, in northern KwaZulu-Natal. Vaccination information in the surveillance was collected retrospectively, using standardized questionnaires during bi-annual household visits, when the child was 12 to 23 months of age. DSS vaccination information was based on extraction from a vaccination card or, if the card was not available, on maternal recall. In the VTS, vaccination data was collected at scheduled maternal and child clinic visits when a study nurse administered child vaccinations. We estimated the sensitivity of the surveillance in detecting vaccinations conducted as part of the VTS during these clinic visits.

Results

Vaccination data in matched children in the DSS was based on the vaccination card in about two-thirds of the cases and on maternal recall in about one-third. The sensitivity of the vaccination variables in the surveillance was high for all vaccines based on either information from a South African Road-to-Health (RTH) card (0.94-0.97) or maternal recall (0.94-0.98). Addition of maternal recall to the RTH card information had little effect on the sensitivity of the surveillance variable (0.95-0.97). The estimates of sensitivity did not vary significantly, when we stratified the analyses by maternal antenatal HIV status. Addition of maternal recall of vaccination status of the child to the RTH card information significantly increased the proportion of children known to be vaccinated across all vaccines in the DSS.

Conclusion

Maternal recall performs well in identifying vaccinated children aged 12-23 months (both in HIV-infected and HIV-uninfected mothers), with sensitivity similar to information extracted from vaccination cards. Information based on both maternal recall and vaccination cards should be used if the aim is to use surveillance data to identify children who received a vaccination.
Appendix
Available only for authorised users
Literature
1.
go back to reference Armstrong EP: Economic benefits and costs associated with target vaccinations. Journal of Managed Care Pharmacy. 2007, 13 (7 Suppl B): S12-15.CrossRefPubMed Armstrong EP: Economic benefits and costs associated with target vaccinations. Journal of Managed Care Pharmacy. 2007, 13 (7 Suppl B): S12-15.CrossRefPubMed
2.
go back to reference Otten M, Kezaala R, Fall A, Masresha B, Martin R, Cairns L, Eggers R, Biellik R, Grabowsky M, Strebel P, Okwo-Bele JM, Nshimirimana D: Public-health impact of accelerated measles control in the WHO African Region 2000-03. Lancet. 2005, 366 (9488): 832-839. 10.1016/S0140-6736(05)67216-9.CrossRefPubMed Otten M, Kezaala R, Fall A, Masresha B, Martin R, Cairns L, Eggers R, Biellik R, Grabowsky M, Strebel P, Okwo-Bele JM, Nshimirimana D: Public-health impact of accelerated measles control in the WHO African Region 2000-03. Lancet. 2005, 366 (9488): 832-839. 10.1016/S0140-6736(05)67216-9.CrossRefPubMed
3.
go back to reference Breiman RF, Streatfield PK, Phelan M, Shifa N, Rashid M, Yunus M: Effect of infant immunisation on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data. Lancet. 2004, 364 (9452): 2204-2211. 10.1016/S0140-6736(04)17593-4.CrossRefPubMed Breiman RF, Streatfield PK, Phelan M, Shifa N, Rashid M, Yunus M: Effect of infant immunisation on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data. Lancet. 2004, 364 (9452): 2204-2211. 10.1016/S0140-6736(04)17593-4.CrossRefPubMed
7.
go back to reference Parker AA, Staggs W, Dayan GH, Ortega-Sanchez IR, Rota PA, Lowe L, Boardman P, Teclaw R, Graves C, LeBaron CW: Implications of a 2005 measles outbreak in Indiana for sustained elimination of measles in the United States. N Engl J Med. 2006, 355 (5): 447-455. 10.1056/NEJMoa060775.CrossRefPubMed Parker AA, Staggs W, Dayan GH, Ortega-Sanchez IR, Rota PA, Lowe L, Boardman P, Teclaw R, Graves C, LeBaron CW: Implications of a 2005 measles outbreak in Indiana for sustained elimination of measles in the United States. N Engl J Med. 2006, 355 (5): 447-455. 10.1056/NEJMoa060775.CrossRefPubMed
8.
go back to reference Lee BR, Feaver SL, Miller CA, Hedberg CW, Ehresmann KR: An elementary school outbreak of varicella attributed to vaccine failure: policy implications. J Infect Dis. 2004, 190 (3): 477-483. 10.1086/422041.CrossRefPubMed Lee BR, Feaver SL, Miller CA, Hedberg CW, Ehresmann KR: An elementary school outbreak of varicella attributed to vaccine failure: policy implications. J Infect Dis. 2004, 190 (3): 477-483. 10.1086/422041.CrossRefPubMed
10.
11.
go back to reference Mast TC, Kigozi G, Wabwire-Mangen F, Sewankambo N, Serwadda D, Gray R, Wawer M, Black R: Immunisation coverage among children born to HIV-infected women in Rakai district, Uganda: Effect of voluntary testing and counselling (VCT). AIDS Care. 2006, 18 (7): 755-763. 10.1080/09540120500521053.CrossRefPubMed Mast TC, Kigozi G, Wabwire-Mangen F, Sewankambo N, Serwadda D, Gray R, Wawer M, Black R: Immunisation coverage among children born to HIV-infected women in Rakai district, Uganda: Effect of voluntary testing and counselling (VCT). AIDS Care. 2006, 18 (7): 755-763. 10.1080/09540120500521053.CrossRefPubMed
12.
go back to reference Dunn DT, Newell ML, Peckham CS, Vanden Eijden S: Routine vaccination and vaccine-preventable infections in children born to human immunodeficiency virus-infected mothers. European Collaborative Study. Acta Paediatr. 1998, 87 (4): 458-459. 10.1080/08035259850157101.CrossRefPubMed Dunn DT, Newell ML, Peckham CS, Vanden Eijden S: Routine vaccination and vaccine-preventable infections in children born to human immunodeficiency virus-infected mothers. European Collaborative Study. Acta Paediatr. 1998, 87 (4): 458-459. 10.1080/08035259850157101.CrossRefPubMed
13.
go back to reference Muhwava W, Nyirenda M: Demographic and Socio-Economic Trends in the ACDIS, Monograph No 2. Africa Centre for Health and Population Studies, Mtubatuba, South Africa. 2007 Muhwava W, Nyirenda M: Demographic and Socio-Economic Trends in the ACDIS, Monograph No 2. Africa Centre for Health and Population Studies, Mtubatuba, South Africa. 2007
14.
go back to reference Tanser F, Hosegood V, Bärnighausen T, Herbst K, Nyirenda M, Muhwava W, Newell C, Viljoen J, Mutevedzi T, Newell ML: Cohort Profile: Africa Centre Demographic Information System (ACDIS) and population-based HIV survey. International Journal of Epidemiology. 2008, 37 (5): 956-962. 10.1093/ije/dym211.CrossRefPubMed Tanser F, Hosegood V, Bärnighausen T, Herbst K, Nyirenda M, Muhwava W, Newell C, Viljoen J, Mutevedzi T, Newell ML: Cohort Profile: Africa Centre Demographic Information System (ACDIS) and population-based HIV survey. International Journal of Epidemiology. 2008, 37 (5): 956-962. 10.1093/ije/dym211.CrossRefPubMed
15.
go back to reference Tanser F, Bärnighausen T, Cooke GS, Newell ML: Localized spatial clustering of HIV infections in a widely disseminated rural South African epidemic. Int J Epidemiol. 2009, 38 (4): 1008-1016. 10.1093/ije/dyp148.CrossRefPubMedPubMedCentral Tanser F, Bärnighausen T, Cooke GS, Newell ML: Localized spatial clustering of HIV infections in a widely disseminated rural South African epidemic. Int J Epidemiol. 2009, 38 (4): 1008-1016. 10.1093/ije/dyp148.CrossRefPubMedPubMedCentral
16.
go back to reference Bärnighausen T, Tanser F, Newell ML: Lack of a decline in HIV incidence in a rural community with high HIV prevalence in South Africa, 2003-2007. AIDS Res Hum Retroviruses. 2009, 25 (4): 405-409. 10.1089/aid.2008.0211.CrossRefPubMedPubMedCentral Bärnighausen T, Tanser F, Newell ML: Lack of a decline in HIV incidence in a rural community with high HIV prevalence in South Africa, 2003-2007. AIDS Res Hum Retroviruses. 2009, 25 (4): 405-409. 10.1089/aid.2008.0211.CrossRefPubMedPubMedCentral
17.
go back to reference Zaba B, Marston M, Crampin AC, Isingo R, Biraro S, Bärnighausen T, Lopman B, Lutalo T, Glynn JR, Todd J: Age-specific mortality patterns in HIV-infected individuals: a comparative analysis of African community study data. AIDS. 2007, 21 (Suppl 6): S87-96. 10.1097/01.aids.0000299415.67646.26.CrossRefPubMed Zaba B, Marston M, Crampin AC, Isingo R, Biraro S, Bärnighausen T, Lopman B, Lutalo T, Glynn JR, Todd J: Age-specific mortality patterns in HIV-infected individuals: a comparative analysis of African community study data. AIDS. 2007, 21 (Suppl 6): S87-96. 10.1097/01.aids.0000299415.67646.26.CrossRefPubMed
18.
go back to reference Herbst AJ, Cooke GS, Bärnighausen T, KanyKany A, Tanser F, Newell ML: Adult mortality and antiretroviral treatment roll-out in rural KwaZulu-Natal, South Africa. Bull World Health Organ. 2009, 87 (10): 754-762. 10.2471/BLT.08.058982.CrossRefPubMedPubMedCentral Herbst AJ, Cooke GS, Bärnighausen T, KanyKany A, Tanser F, Newell ML: Adult mortality and antiretroviral treatment roll-out in rural KwaZulu-Natal, South Africa. Bull World Health Organ. 2009, 87 (10): 754-762. 10.2471/BLT.08.058982.CrossRefPubMedPubMedCentral
19.
go back to reference Rice BD, Batzing-Feigenbaum J, Hosegood V, Tanser F, Hill C, Bärnighausen T, Herbst K, Welz T, Newell ML: Population and antenatal-based HIV prevalence estimates in a high contracepting female population in rural South Africa. BMC Public Health. 2007, 7: 160-10.1186/1471-2458-7-160.CrossRefPubMedPubMedCentral Rice BD, Batzing-Feigenbaum J, Hosegood V, Tanser F, Hill C, Bärnighausen T, Herbst K, Welz T, Newell ML: Population and antenatal-based HIV prevalence estimates in a high contracepting female population in rural South Africa. BMC Public Health. 2007, 7: 160-10.1186/1471-2458-7-160.CrossRefPubMedPubMedCentral
20.
go back to reference Tanser F, Hosegood V, Benzler J, Solarsh G: New approaches to spatially analyse primary health care usage patterns in rural South Africa. Tropical Medicine and International Health. 2001, 6 (10): 826-838. 10.1046/j.1365-3156.2001.00794.x.CrossRefPubMed Tanser F, Hosegood V, Benzler J, Solarsh G: New approaches to spatially analyse primary health care usage patterns in rural South Africa. Tropical Medicine and International Health. 2001, 6 (10): 826-838. 10.1046/j.1365-3156.2001.00794.x.CrossRefPubMed
21.
go back to reference Ndirangu J, Bärnighausen T, Tanser F, Tint K, Newell ML: Levels of childhood vaccination coverage and the impact of maternal HIV status on child vaccination status in rural KwaZulu-Natal, South Africa. Trop Med Int Health. 2009, 14 (11): 1383-1393. 10.1111/j.1365-3156.2009.02382.x.CrossRefPubMedPubMedCentral Ndirangu J, Bärnighausen T, Tanser F, Tint K, Newell ML: Levels of childhood vaccination coverage and the impact of maternal HIV status on child vaccination status in rural KwaZulu-Natal, South Africa. Trop Med Int Health. 2009, 14 (11): 1383-1393. 10.1111/j.1365-3156.2009.02382.x.CrossRefPubMedPubMedCentral
22.
go back to reference Tarwa C, De Villiers F: The use of the Road to Health Card in monitoring child health. South Africal Family Practice. 2007, 49 (1): 15-CrossRef Tarwa C, De Villiers F: The use of the Road to Health Card in monitoring child health. South Africal Family Practice. 2007, 49 (1): 15-CrossRef
24.
go back to reference Coovadia HM, Rollins NC, Bland RM, Little K, Coutsoudis A, Bennish ML, Newell ML: Mother-to-child transmission of HIV-1 infection during exclusive breastfeeding in the first 6 months of life: an intervention cohort study. Lancet. 2007, 369 (9567): 1107-1116. 10.1016/S0140-6736(07)60283-9.CrossRefPubMed Coovadia HM, Rollins NC, Bland RM, Little K, Coutsoudis A, Bennish ML, Newell ML: Mother-to-child transmission of HIV-1 infection during exclusive breastfeeding in the first 6 months of life: an intervention cohort study. Lancet. 2007, 369 (9567): 1107-1116. 10.1016/S0140-6736(07)60283-9.CrossRefPubMed
25.
go back to reference Bland R, Coovadia H, Coutsoudis A, Rollins N, Newell M: Cohort profile: mamanengane or the Africa centre vertical transmission study. Int J Epidemiol. 2010, 39 (2): 351-360. 10.1093/ije/dyp165.CrossRefPubMedPubMedCentral Bland R, Coovadia H, Coutsoudis A, Rollins N, Newell M: Cohort profile: mamanengane or the Africa centre vertical transmission study. Int J Epidemiol. 2010, 39 (2): 351-360. 10.1093/ije/dyp165.CrossRefPubMedPubMedCentral
26.
go back to reference Cui FQ, Gofin R: Immunization coverage and its determinants in children aged 12-23 months in Gansu, China. Vaccine. 2007, 25 (4): 664-671. 10.1016/j.vaccine.2006.08.027.CrossRefPubMed Cui FQ, Gofin R: Immunization coverage and its determinants in children aged 12-23 months in Gansu, China. Vaccine. 2007, 25 (4): 664-671. 10.1016/j.vaccine.2006.08.027.CrossRefPubMed
27.
go back to reference Koumare AK, Traore D, Haidara F, Sissoko F, Traore I, Drame S, Sangare K, Diakite K, Coulibaly B, Togola B, Maiga A: Evaluation of immunization coverage within the Expanded Program on Immunization in Kita Circle, Mali: a cross-sectional survey. BMC Int Health Hum Rights. 2009, 9 (Suppl 1): S13-10.1186/1472-698X-9-S1-S13.CrossRefPubMedPubMedCentral Koumare AK, Traore D, Haidara F, Sissoko F, Traore I, Drame S, Sangare K, Diakite K, Coulibaly B, Togola B, Maiga A: Evaluation of immunization coverage within the Expanded Program on Immunization in Kita Circle, Mali: a cross-sectional survey. BMC Int Health Hum Rights. 2009, 9 (Suppl 1): S13-10.1186/1472-698X-9-S1-S13.CrossRefPubMedPubMedCentral
29.
go back to reference Biellik R, Madema S, Taole A, Kutsulukuta A, Allies E, Eggers R, Ngcobo N, Nxumalo M, Shearley A, Mabuzane E, Kufa E, Okwo-Bele JM: First 5 years of measles elimination in southern Africa: 1996-2000. Lancet. 2002, 359 (9317): 1564-1568. 10.1016/S0140-6736(02)08517-3.CrossRefPubMed Biellik R, Madema S, Taole A, Kutsulukuta A, Allies E, Eggers R, Ngcobo N, Nxumalo M, Shearley A, Mabuzane E, Kufa E, Okwo-Bele JM: First 5 years of measles elimination in southern Africa: 1996-2000. Lancet. 2002, 359 (9317): 1564-1568. 10.1016/S0140-6736(02)08517-3.CrossRefPubMed
30.
go back to reference Siegfried N, Wiysonge CS, Pienaar D: Too little, too late: measles epidemic in South Africa. Lancet. 2010, 376 (9736): 160-CrossRefPubMed Siegfried N, Wiysonge CS, Pienaar D: Too little, too late: measles epidemic in South Africa. Lancet. 2010, 376 (9736): 160-CrossRefPubMed
31.
go back to reference Hoque M, Hoque E, Kader SB: Audit of antenatal care in a rural district of KZN, South Africa. South African Family Practice. 2008, 50 (3): 66-CrossRef Hoque M, Hoque E, Kader SB: Audit of antenatal care in a rural district of KZN, South Africa. South African Family Practice. 2008, 50 (3): 66-CrossRef
33.
go back to reference Bos E, Batson A: Using immunization coverage rates for monitoring health sector performance. 2000, Washington, DC: The World Bank; Bos E, Batson A: Using immunization coverage rates for monitoring health sector performance. 2000, Washington, DC: The World Bank;
35.
go back to reference Anand S, Bärnighausen T: Health workers and vaccination coverage in developing countries: an econometric analysis. Lancet. 2007, 369 (9569): 1277-1285. 10.1016/S0140-6736(07)60599-6.CrossRefPubMed Anand S, Bärnighausen T: Health workers and vaccination coverage in developing countries: an econometric analysis. Lancet. 2007, 369 (9569): 1277-1285. 10.1016/S0140-6736(07)60599-6.CrossRefPubMed
36.
go back to reference Bärnighausen T, Bloom DE, Canning D, Friedman A, Levine OS, O'Brien J, Privor-Dumm L, Walker D: Rethinking the benefits and costs of childhood vaccination: the example of the Haemophilus influenzae type b vaccine. Vaccine. 2011, 29 (13): 2371-2380. 10.1016/j.vaccine.2010.11.090.CrossRefPubMed Bärnighausen T, Bloom DE, Canning D, Friedman A, Levine OS, O'Brien J, Privor-Dumm L, Walker D: Rethinking the benefits and costs of childhood vaccination: the example of the Haemophilus influenzae type b vaccine. Vaccine. 2011, 29 (13): 2371-2380. 10.1016/j.vaccine.2010.11.090.CrossRefPubMed
37.
go back to reference Bärnighausen T, Bloom DE, Canning D, O'Brien J: Accounting for the full benefits of childhood vaccination in South Africa. S Afr Med J. 2008, 98 (11): 844-846. 842 Bärnighausen T, Bloom DE, Canning D, O'Brien J: Accounting for the full benefits of childhood vaccination in South Africa. S Afr Med J. 2008, 98 (11): 844-846. 842
Metadata
Title
Validating child vaccination status in a demographic surveillance system using data from a clinical cohort study: evidence from rural South Africa
Authors
James Ndirangu
Ruth Bland
Till Bärnighausen
Marie-Louise Newell
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2011
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-11-372

Other articles of this Issue 1/2011

BMC Public Health 1/2011 Go to the issue