Skip to main content
Top
Published in: BMC Public Health 1/2008

Open Access 01-12-2008 | Research article

Impact of methodological "shortcuts" in conducting public health surveys: Results from a vaccination coverage survey

Authors: Elizabeth T Luman, Mariana Sablan, Shannon Stokley, Mary M McCauley, Kate M Shaw

Published in: BMC Public Health | Issue 1/2008

Login to get access

Abstract

Background

Lack of methodological rigor can cause survey error, leading to biased results and suboptimal public health response. This study focused on the potential impact of 3 methodological "shortcuts" pertaining to field surveys: relying on a single source for critical data, failing to repeatedly visit households to improve response rates, and excluding remote areas.

Methods

In a vaccination coverage survey of young children conducted in the Commonwealth of the Northern Mariana Islands in July 2005, 3 sources of vaccination information were used, multiple follow-up visits were made, and all inhabited areas were included in the sampling frame. Results are calculated with and without these strategies.

Results

Most children had at least 2 sources of data; vaccination coverage estimated from any single source was substantially lower than from all sources combined. Eligibility was ascertained for 79% of households after the initial visit and for 94% of households after follow-up visits; vaccination coverage rates were similar with and without follow-up. Coverage among children on remote islands differed substantially from that of their counterparts on the main island indicating a programmatic need for locality-specific information; excluding remote islands from the survey would have had little effect on overall estimates due to small populations and divergent results.

Conclusion

Strategies to reduce sources of survey error should be maximized in public health surveys. The impact of the 3 strategies illustrated here will vary depending on the primary outcomes of interest and local situations. Survey limitations such as potential for error should be well-documented, and the likely direction and magnitude of bias should be considered.
Appendix
Available only for authorised users
Literature
1.
go back to reference Evaluation of Multiple Indicator Cluster Surveys. 1999, New York: United Nations Children's Fund Evaluation of Multiple Indicator Cluster Surveys. 1999, New York: United Nations Children's Fund
2.
go back to reference US Agency for International Development, : Demographic and Health Survey Supervisor's and Editor's Manual. MEASURES DHS Basic Documentation No. 5. 2005, Calverton, Maryland, USA: ORC Macro US Agency for International Development, : Demographic and Health Survey Supervisor's and Editor's Manual. MEASURES DHS Basic Documentation No. 5. 2005, Calverton, Maryland, USA: ORC Macro
3.
go back to reference Smith PJ, Battaglia MP, Huggins VJ, et al: Overview of the sampling design and statistical methods used in the National Immunization Survey. Am J Prev Med. 2001, 20 (suppl 4): 17-24. 10.1016/S0749-3797(01)00285-9.CrossRefPubMed Smith PJ, Battaglia MP, Huggins VJ, et al: Overview of the sampling design and statistical methods used in the National Immunization Survey. Am J Prev Med. 2001, 20 (suppl 4): 17-24. 10.1016/S0749-3797(01)00285-9.CrossRefPubMed
4.
go back to reference Botman SL, Moore TF, Moriarty CL, Parsons VL: Design and estimation for the National Health Interview Survey, 1995–2004. National Center for Health Statistics, Centers for Disease Control and Prevention. Vital Health Stat. 2000, 2 (130): Botman SL, Moore TF, Moriarty CL, Parsons VL: Design and estimation for the National Health Interview Survey, 1995–2004. National Center for Health Statistics, Centers for Disease Control and Prevention. Vital Health Stat. 2000, 2 (130):
5.
go back to reference Lemeshow S, Tserkovnyi AG, Tulloch JL, Dowd JE, Lwanga SK, Keja J: A computer simulation of the EPI survey strategy. Int J Epidemiol. 1985, 14: 473-481. 10.1093/ije/14.3.473.CrossRefPubMed Lemeshow S, Tserkovnyi AG, Tulloch JL, Dowd JE, Lwanga SK, Keja J: A computer simulation of the EPI survey strategy. Int J Epidemiol. 1985, 14: 473-481. 10.1093/ije/14.3.473.CrossRefPubMed
6.
go back to reference Katz J, Yoon SS, Brendel K, West KP: Sampling designs for xerophthalmia prevalence surveys. Int J Epidemiol. 1997, 26: 1041-1048. 10.1093/ije/26.5.1041.CrossRefPubMed Katz J, Yoon SS, Brendel K, West KP: Sampling designs for xerophthalmia prevalence surveys. Int J Epidemiol. 1997, 26: 1041-1048. 10.1093/ije/26.5.1041.CrossRefPubMed
7.
go back to reference Brogan D, Flagg EW, Deming M, Waldman R: Increasing the Accuracy of the Expanded Programme on Immunization's Cluster Survey Design. Ann Epidemiol. 1994, 4: 302-311.CrossRefPubMed Brogan D, Flagg EW, Deming M, Waldman R: Increasing the Accuracy of the Expanded Programme on Immunization's Cluster Survey Design. Ann Epidemiol. 1994, 4: 302-311.CrossRefPubMed
8.
go back to reference Turner AG, Magnani RJ, Shuaib M: A Not Quite as Quick but Much Cleaner Alternative to the Expanded Programme on Immunization (EPI) Cluster Survey Design. Int J Epidemiol. 1996, 25: 198-203. 10.1093/ije/25.1.198.CrossRefPubMed Turner AG, Magnani RJ, Shuaib M: A Not Quite as Quick but Much Cleaner Alternative to the Expanded Programme on Immunization (EPI) Cluster Survey Design. Int J Epidemiol. 1996, 25: 198-203. 10.1093/ije/25.1.198.CrossRefPubMed
9.
go back to reference Milligan P, Njie A, Bennett S: Comparison of two cluster sampling methods for health surveys in developing countries. Int J Epidemiol. 2004, 33: 1-8. 10.1093/ije/dyh096.CrossRef Milligan P, Njie A, Bennett S: Comparison of two cluster sampling methods for health surveys in developing countries. Int J Epidemiol. 2004, 33: 1-8. 10.1093/ije/dyh096.CrossRef
10.
go back to reference Lanata CF, Black RE: Lot quality assurance sampling techniques in health surveys in developing countries: advantages and current constraints. Wld Hlth Statist Quart. 1991, 44: 133-139. Lanata CF, Black RE: Lot quality assurance sampling techniques in health surveys in developing countries: advantages and current constraints. Wld Hlth Statist Quart. 1991, 44: 133-139.
11.
go back to reference Lemeshow S, Taber S: Lot quality assurance sampling: single- and double-sampling plans. Wld Hlth Statist Quart. 1991, 44: 115-132. Lemeshow S, Taber S: Lot quality assurance sampling: single- and double-sampling plans. Wld Hlth Statist Quart. 1991, 44: 115-132.
12.
go back to reference Robertson SE, Valadez JJ: Global review of health care surveys using lot quality assurance sampling (LQAS), 1984–2004. Soc Sci Med. 2006, 63: 1648-1660. 10.1016/j.socscimed.2006.04.011.CrossRefPubMed Robertson SE, Valadez JJ: Global review of health care surveys using lot quality assurance sampling (LQAS), 1984–2004. Soc Sci Med. 2006, 63: 1648-1660. 10.1016/j.socscimed.2006.04.011.CrossRefPubMed
13.
go back to reference Groves RM: Survey errors and survey costs. 1989, New York: John Wiley & Sons, IncCrossRef Groves RM: Survey errors and survey costs. 1989, New York: John Wiley & Sons, IncCrossRef
14.
go back to reference U.S. Census Bureau: 2000 Census of Population and Housing, Commonwealth of the Northern Mariana Islands Summary File: Technical Documentation. 2003 U.S. Census Bureau: 2000 Census of Population and Housing, Commonwealth of the Northern Mariana Islands Summary File: Technical Documentation. 2003
15.
go back to reference Luman ET, Sablan M, Anaya G, et al: Vaccination coverage in the US Commonwealth of the Northern Mariana Islands, 2005. J Public Health Manag Pract. 2007, , 13: 605-614. Luman ET, Sablan M, Anaya G, et al: Vaccination coverage in the US Commonwealth of the Northern Mariana Islands, 2005. J Public Health Manag Pract. 2007, , 13: 605-614.
17.
go back to reference World Health Organization: Immunization Coverage Cluster Survey – Reference Manual. 2005, Geneva: WHO Vaccine Assessment and Monitoring Team, Department of Immunization, Vaccines and Biologicals, WHO/IVB/04.23. World Health Organization: Immunization Coverage Cluster Survey – Reference Manual. 2005, Geneva: WHO Vaccine Assessment and Monitoring Team, Department of Immunization, Vaccines and Biologicals, WHO/IVB/04.23.
Metadata
Title
Impact of methodological "shortcuts" in conducting public health surveys: Results from a vaccination coverage survey
Authors
Elizabeth T Luman
Mariana Sablan
Shannon Stokley
Mary M McCauley
Kate M Shaw
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2008
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-8-99

Other articles of this Issue 1/2008

BMC Public Health 1/2008 Go to the issue