Skip to main content
Top
Published in: Emerging Themes in Epidemiology 1/2018

Open Access 01-12-2018 | Research article

Role of survey response rates on valid inference: an application to HIV prevalence estimates

Authors: Miguel Marino, Marcello Pagano

Published in: Emerging Themes in Epidemiology | Issue 1/2018

Login to get access

Abstract

Background

Nationally-representative surveys suggest that females have a higher prevalence of HIV than males in most African countries. Unfortunately, these results are made on the basis of surveys with non-ignorable missing data. This study evaluates the impact that differential survey nonresponse rates between males and females can have on the point estimate of the HIV prevalence ratio of these two classifiers.

Methods

We study 29 Demographic and Health Surveys (DHS) from 2001 to 2010. Instead of employing often used multiple imputation models with a Missing at Random assumption that may not hold in this setting, we assess the effect of ignoring the information contained in the missing HIV information for males and females through three proposed statistical measures. These measures can be used in settings where the interest is comparing the prevalence of a disease between two groups. The proposed measures do not utilize parametric models and can be implemented by researchers of any level. They are: (1) an upper bound on the potential bias of the usual practise of using reported HIV prevalence estimates that ignore subjects who have missing HIV outcomes. (2) Plausible range intervals to account for nonresponses, without any additional parametric modeling assumptions. (3) Prevalence ratio inflation factors to correct the point estimate of the HIV prevalence ratio, if estimates of nonresponders’ HIV prevalences were known.

Results

In 86% of countries, males have higher upper bounds of HIV prevalence than females, this is consonant with males possibly having higher infection rates than females. Additionally, 74% of surveys have a plausible range that crosses 1.0, suggesting a plausible equivalence between male and female HIV prevalences.

Conclusions

It is quite reasonable to conclude that there is so much DHS nonresponse in evaluating the HIV status question, that existing data is plausibly generated by the situation where the virus is equally distributed between the sexes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Berkley S, Naamara W, Okware S, Downing R, Konde-Lule J, Wawer M, Musagaara M, Musgrave S. AIDS and HIV infection in Uganda-are more women infected than men? Aids. 1990;4(12):1237–42.CrossRefPubMed Berkley S, Naamara W, Okware S, Downing R, Konde-Lule J, Wawer M, Musagaara M, Musgrave S. AIDS and HIV infection in Uganda-are more women infected than men? Aids. 1990;4(12):1237–42.CrossRefPubMed
2.
go back to reference Boerma JT, Ghys PD, Walker N. Estimates of HIV-1 prevalence from national population-based surveys as a new gold standard. Lancet. 2003;362:1929–31.CrossRefPubMed Boerma JT, Ghys PD, Walker N. Estimates of HIV-1 prevalence from national population-based surveys as a new gold standard. Lancet. 2003;362:1929–31.CrossRefPubMed
3.
go back to reference Bouvet E, De Vincenzi I, Ancelle R, Vachon F. Defloration as risk factor for heterosexual HIV transmission. The Lancet. 1989;333(8638):615.CrossRef Bouvet E, De Vincenzi I, Ancelle R, Vachon F. Defloration as risk factor for heterosexual HIV transmission. The Lancet. 1989;333(8638):615.CrossRef
4.
go back to reference Brick JM, Kalton G. Handling missing data in survey research. Stat Methods Med Res. 1996;5(3):215–38.CrossRefPubMed Brick JM, Kalton G. Handling missing data in survey research. Stat Methods Med Res. 1996;5(3):215–38.CrossRefPubMed
5.
go back to reference Brookmeyer R. Measuring the HIV/AIDS epidemic: approaches and challenges. Epidemiol Rev. 2010;32:26–37.CrossRefPubMed Brookmeyer R. Measuring the HIV/AIDS epidemic: approaches and challenges. Epidemiol Rev. 2010;32:26–37.CrossRefPubMed
6.
go back to reference Clark SJ, Houle B. Validation, replication, and sensitivity testing of Heckman-type selection models to adjust estimates of HIV prevalence. PLoS ONE. 2014;9(11):e112563.CrossRefPubMedPubMedCentral Clark SJ, Houle B. Validation, replication, and sensitivity testing of Heckman-type selection models to adjust estimates of HIV prevalence. PLoS ONE. 2014;9(11):e112563.CrossRefPubMedPubMedCentral
7.
go back to reference Cochran WG. Sampling techniques. 3rd ed. New York: Wiley; 1977. Cochran WG. Sampling techniques. 3rd ed. New York: Wiley; 1977.
8.
go back to reference Cochran WG, Mosteller F, Tukey JW. Statistical problems of the Kinsey report. J Am Stat Assoc. 1953;48:673–716.CrossRef Cochran WG, Mosteller F, Tukey JW. Statistical problems of the Kinsey report. J Am Stat Assoc. 1953;48:673–716.CrossRef
9.
go back to reference Corsi DJ, Neuman M, Finlay JE, Subramanian SV. Demographic and health surveys: a profile. Int J Epidemiol. 2012;41(6):1602–13.CrossRefPubMed Corsi DJ, Neuman M, Finlay JE, Subramanian SV. Demographic and health surveys: a profile. Int J Epidemiol. 2012;41(6):1602–13.CrossRefPubMed
10.
go back to reference Fideli ÜS, Allen SA, Musonda R, Trask S, Hahn BH, Weiss H, Mulenga J, Kasolo F, Vermund SH, Aldrovandi GM. Virologic and immunologic determinants of heterosexual transmission of human immunodeficiency virus type 1 in Africa. AIDS Res Hum Retrovir. 2001;17(10):901–10.CrossRefPubMedPubMedCentral Fideli ÜS, Allen SA, Musonda R, Trask S, Hahn BH, Weiss H, Mulenga J, Kasolo F, Vermund SH, Aldrovandi GM. Virologic and immunologic determinants of heterosexual transmission of human immunodeficiency virus type 1 in Africa. AIDS Res Hum Retrovir. 2001;17(10):901–10.CrossRefPubMedPubMedCentral
11.
go back to reference Garcia-Calleja JM, Gouws E, Ghys PD. National population based HIV prevalence surveys in sub-Saharan Africa: results and implications for HIV and AIDS estimates. Sex Transm Infect. 2006;82:iii64–70.CrossRefPubMedPubMedCentral Garcia-Calleja JM, Gouws E, Ghys PD. National population based HIV prevalence surveys in sub-Saharan Africa: results and implications for HIV and AIDS estimates. Sex Transm Infect. 2006;82:iii64–70.CrossRefPubMedPubMedCentral
12.
go back to reference Giordano K, Bärnighausen T, McGrath N, Snow R, Harlow S, Newell ML. Factors associated with repeated refusal to participate in longitudinal population-based HIV surveillance in rural South Africa: an observational study, regression analyses. J HIV AIDS Surveill Epidemiol. 2012;4(1):1–15. Giordano K, Bärnighausen T, McGrath N, Snow R, Harlow S, Newell ML. Factors associated with repeated refusal to participate in longitudinal population-based HIV surveillance in rural South Africa: an observational study, regression analyses. J HIV AIDS Surveill Epidemiol. 2012;4(1):1–15.
13.
go back to reference Glynn JR, Buvé A, Caraël M, Musonda RM, Kahindo M, Macauley I, Tembo F, Study Group on Heterogeneity of HIV Epidemics in African Cities. Factors influencing the difference in HIV prevalence between antenatal clinic and general population in sub-Saharan Africa. Aids. 2001;15(13):1717–25.CrossRefPubMed Glynn JR, Buvé A, Caraël M, Musonda RM, Kahindo M, Macauley I, Tembo F, Study Group on Heterogeneity of HIV Epidemics in African Cities. Factors influencing the difference in HIV prevalence between antenatal clinic and general population in sub-Saharan Africa. Aids. 2001;15(13):1717–25.CrossRefPubMed
14.
go back to reference Grassly NC, Morgan M, Walker N, Garnett G, Stanecki KA, Stover J, Brown T, Ghys PD. Uncertainty in estimates of HIV/AIDS: the estimation and application of plausibility bounds. Sex Transm Infect. 2004;80:i31–8.CrossRefPubMedPubMedCentral Grassly NC, Morgan M, Walker N, Garnett G, Stanecki KA, Stover J, Brown T, Ghys PD. Uncertainty in estimates of HIV/AIDS: the estimation and application of plausibility bounds. Sex Transm Infect. 2004;80:i31–8.CrossRefPubMedPubMedCentral
15.
go back to reference Gregson S, Garnett GP. Contrasting gender differentials in HIV-1 prevalence and associated mortality increase in eastern and southern Africa: artefact of data or natural course of epidemics? Aids. 2000;14:S85–99.CrossRefPubMed Gregson S, Garnett GP. Contrasting gender differentials in HIV-1 prevalence and associated mortality increase in eastern and southern Africa: artefact of data or natural course of epidemics? Aids. 2000;14:S85–99.CrossRefPubMed
16.
go back to reference Gregson S, Mason PR, Garnett GP, Zhuwau T, Nyamukapa CA, Anderson RM, Chandiwana SK. A rural HIV epidemic in Zimbabwe? Findings from a population-based survey. Int J STD AIDS. 2001;12(3):189–96.CrossRefPubMed Gregson S, Mason PR, Garnett GP, Zhuwau T, Nyamukapa CA, Anderson RM, Chandiwana SK. A rural HIV epidemic in Zimbabwe? Findings from a population-based survey. Int J STD AIDS. 2001;12(3):189–96.CrossRefPubMed
17.
go back to reference Gregson S, Nyamukapa CA, Garnett GP, Mason PR, Zhuwau T, Caraël M, Chandiwana SK, Anderson RM. Sexual mixing patterns and sex-differentials in teenage exposure to HIV infection in rural Zimbabwe. The Lancet. 2002;359(9321):1896–903.CrossRef Gregson S, Nyamukapa CA, Garnett GP, Mason PR, Zhuwau T, Caraël M, Chandiwana SK, Anderson RM. Sexual mixing patterns and sex-differentials in teenage exposure to HIV infection in rural Zimbabwe. The Lancet. 2002;359(9321):1896–903.CrossRef
18.
go back to reference Hedt BL, Pagano M. Health indicators: eliminating bias from convenience sampling estimators. Stat Med. 2011;30:560–8.PubMedPubMedCentral Hedt BL, Pagano M. Health indicators: eliminating bias from convenience sampling estimators. Stat Med. 2011;30:560–8.PubMedPubMedCentral
19.
go back to reference Hogan DR, Salomon JA, Canning D, Hammitt JK, Zaslavsky AM, Bärnighausen T. National HIV prevalence estimates for sub-Saharan Africa: controlling selection bias with Heckman-type selection models. Sex Transm Infect. 2012;88(Suppl 2):i17–23.CrossRefPubMedPubMedCentral Hogan DR, Salomon JA, Canning D, Hammitt JK, Zaslavsky AM, Bärnighausen T. National HIV prevalence estimates for sub-Saharan Africa: controlling selection bias with Heckman-type selection models. Sex Transm Infect. 2012;88(Suppl 2):i17–23.CrossRefPubMedPubMedCentral
20.
go back to reference Hund L, Pagano M. Estimating HIV prevalence from surveys with low individual consent rates: annealing individual and pooled samples. Emerg Themes Epidemiol. 2013;10:2–11.CrossRefPubMedPubMedCentral Hund L, Pagano M. Estimating HIV prevalence from surveys with low individual consent rates: annealing individual and pooled samples. Emerg Themes Epidemiol. 2013;10:2–11.CrossRefPubMedPubMedCentral
21.
go back to reference Joesoef MR, Cheluget B, Marum LH, Wandera C, Ryan CA, DeCock KM, Chebet K. Differential of HIV prevalence in women and men who attended sexually transmitted disease clinics at HIV sentinel surveillance sites in Kenya, 1990–2001. Int J STD AIDS. 2003;14(3):193–6.CrossRefPubMed Joesoef MR, Cheluget B, Marum LH, Wandera C, Ryan CA, DeCock KM, Chebet K. Differential of HIV prevalence in women and men who attended sexually transmitted disease clinics at HIV sentinel surveillance sites in Kenya, 1990–2001. Int J STD AIDS. 2003;14(3):193–6.CrossRefPubMed
22.
go back to reference Little RJA. Pattern-mixture models for multivariate incomplete data. J Am Stat Assoc. 1993;88(421):125–34. Little RJA. Pattern-mixture models for multivariate incomplete data. J Am Stat Assoc. 1993;88(421):125–34.
23.
go back to reference Little RJA, Rubin DB. Statistical analysis with missing data. New Jersey: Wiley; 2002.CrossRef Little RJA, Rubin DB. Statistical analysis with missing data. New Jersey: Wiley; 2002.CrossRef
24.
go back to reference Lydié N, Robinson NJ, Ferry B, Akam E, De Loenzien M, Abega S, Study Group on Heterogeneity of HIV Epidemics in African Cities. Mobility, sexual behavior, and HIV infection in an urban population in Cameroon. J Acquir Immune Defic Syndr. 2004;35(1):67–74.CrossRefPubMed Lydié N, Robinson NJ, Ferry B, Akam E, De Loenzien M, Abega S, Study Group on Heterogeneity of HIV Epidemics in African Cities. Mobility, sexual behavior, and HIV infection in an urban population in Cameroon. J Acquir Immune Defic Syndr. 2004;35(1):67–74.CrossRefPubMed
25.
go back to reference Magadi MA. Understanding the gender disparity in HIV infection across countries in sub-Saharan Africa: evidence from the demographic and health surveys. Sociol Health Illn. 2011;33:522–39.CrossRefPubMedPubMedCentral Magadi MA. Understanding the gender disparity in HIV infection across countries in sub-Saharan Africa: evidence from the demographic and health surveys. Sociol Health Illn. 2011;33:522–39.CrossRefPubMedPubMedCentral
26.
go back to reference Manda S, Masenyetse L, Cai B, Meyer R. Mapping HIV prevalence using population and antenatal sentinel-based HIV surveys: a multi-stage approach. Popul Health Metr. 2015;13(1):22–37.CrossRefPubMedPubMedCentral Manda S, Masenyetse L, Cai B, Meyer R. Mapping HIV prevalence using population and antenatal sentinel-based HIV surveys: a multi-stage approach. Popul Health Metr. 2015;13(1):22–37.CrossRefPubMedPubMedCentral
27.
go back to reference Marston M, Harriss K, Slaymaker E. Non-response bias in estimates of HIV prevalence due to the mobility of absentees in national population-based surveys: a study of nine national surveys. Sex Transm Infect. 2008;84:i71–7.CrossRefPubMedPubMedCentral Marston M, Harriss K, Slaymaker E. Non-response bias in estimates of HIV prevalence due to the mobility of absentees in national population-based surveys: a study of nine national surveys. Sex Transm Infect. 2008;84:i71–7.CrossRefPubMedPubMedCentral
28.
29.
go back to reference Mishra V, Vaessen M, Boerma J, Arnold F, Way A, Barrere B, Cross A, Hong R, Sangha J. HIV testing in national population-based surveys: experience from the Demographic and Health Surveys. Bull World Health Organ. 2006;84(7):537–45.CrossRefPubMedPubMedCentral Mishra V, Vaessen M, Boerma J, Arnold F, Way A, Barrere B, Cross A, Hong R, Sangha J. HIV testing in national population-based surveys: experience from the Demographic and Health Surveys. Bull World Health Organ. 2006;84(7):537–45.CrossRefPubMedPubMedCentral
30.
go back to reference Mishra V, Barrere B, Hong R, Khan S. Evaluation of bias in HIV seroprevalence estimates from national household surveys. Sex Transm Infect. 2008;84(Suppl 1):i63–70.CrossRefPubMedPubMedCentral Mishra V, Barrere B, Hong R, Khan S. Evaluation of bias in HIV seroprevalence estimates from national household surveys. Sex Transm Infect. 2008;84(Suppl 1):i63–70.CrossRefPubMedPubMedCentral
31.
go back to reference Moss GB, Clemetson D, D’Costa L, Plummer FA, Ndinya-Achola JO, Reilly M, Holmes KK, Piot P, Maitha GM, Hillier SL, Kiviat NC, Cameron CW, Wamola IA, Kreiss JK. Association of cervical ectopy with heterosexual transmission of human immunodeficiency virus: results of a study of couples in Nairobi, Kenya. J Infect Dis. 1991;164(3):588–91.CrossRefPubMed Moss GB, Clemetson D, D’Costa L, Plummer FA, Ndinya-Achola JO, Reilly M, Holmes KK, Piot P, Maitha GM, Hillier SL, Kiviat NC, Cameron CW, Wamola IA, Kreiss JK. Association of cervical ectopy with heterosexual transmission of human immunodeficiency virus: results of a study of couples in Nairobi, Kenya. J Infect Dis. 1991;164(3):588–91.CrossRefPubMed
32.
go back to reference Nicolosi A, Leite MLC, Musicco M, Arid C, Gavazzeni G, Lazzarin A. The efficiency of male-to female and female-to-male sexual transmission of the human immunodeficiency virus: a study of 730 stable couples. Epidemiology. 1994;5(6):570–5.CrossRefPubMed Nicolosi A, Leite MLC, Musicco M, Arid C, Gavazzeni G, Lazzarin A. The efficiency of male-to female and female-to-male sexual transmission of the human immunodeficiency virus: a study of 730 stable couples. Epidemiology. 1994;5(6):570–5.CrossRefPubMed
33.
go back to reference Nyirenda M, Zaba B, Barnighausen T, Hosegood V, Newell M. Adjusting HIV prevalence for survey non-response using mortality rates: an application of the method using surveillance data from rural South Africa. PLoS ONE. 2010;5(8):e12370.CrossRefPubMedPubMedCentral Nyirenda M, Zaba B, Barnighausen T, Hosegood V, Newell M. Adjusting HIV prevalence for survey non-response using mortality rates: an application of the method using surveillance data from rural South Africa. PLoS ONE. 2010;5(8):e12370.CrossRefPubMedPubMedCentral
34.
go back to reference Ramirez-Avila L, Nixon K, Noubary F, Giddy J, Losina E, Walensky RP, Bassett IV. Routing HIV testing in adolescents and young adults presenting to an outpatient clinic in Durban, South Africa. PLoS ONE. 2012;7(9):e45507.CrossRefPubMedPubMedCentral Ramirez-Avila L, Nixon K, Noubary F, Giddy J, Losina E, Walensky RP, Bassett IV. Routing HIV testing in adolescents and young adults presenting to an outpatient clinic in Durban, South Africa. PLoS ONE. 2012;7(9):e45507.CrossRefPubMedPubMedCentral
35.
go back to reference Redondo-Sendino Á, Guallar-Castillón P, Banegas JR, Rodríguez-Artalejo F. Gender differences in the utilization of health-care services among the older adult population of Spain. BMC Public Health. 2006;6(1):155.CrossRefPubMedPubMedCentral Redondo-Sendino Á, Guallar-Castillón P, Banegas JR, Rodríguez-Artalejo F. Gender differences in the utilization of health-care services among the older adult population of Spain. BMC Public Health. 2006;6(1):155.CrossRefPubMedPubMedCentral
36.
go back to reference Royce RA, Sena A, Cates W Jr, Cohen MS. Sexual transmission of HIV. N Engl J Med. 1997;336(15):1072–8.CrossRefPubMed Royce RA, Sena A, Cates W Jr, Cohen MS. Sexual transmission of HIV. N Engl J Med. 1997;336(15):1072–8.CrossRefPubMed
37.
go back to reference Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.CrossRef Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.CrossRef
38.
go back to reference Rutstein SO, Rojas G. Guide to DHS statistics. Calverton: ORC Macro; 2006. Rutstein SO, Rojas G. Guide to DHS statistics. Calverton: ORC Macro; 2006.
39.
go back to reference Sindelar JL. Differential use of medical care by sex. J Polit Econ. 1982;190:1003–19.CrossRef Sindelar JL. Differential use of medical care by sex. J Polit Econ. 1982;190:1003–19.CrossRef
41.
go back to reference Vanable PA, Carey MP, Blair DC, Littlewood RA. Impact of HIV-related stigma on health behaviors and psychological adjustment among HIV-positive men and women. AIDS Behav. 2006;10(5):473–82.CrossRefPubMedPubMedCentral Vanable PA, Carey MP, Blair DC, Littlewood RA. Impact of HIV-related stigma on health behaviors and psychological adjustment among HIV-positive men and women. AIDS Behav. 2006;10(5):473–82.CrossRefPubMedPubMedCentral
42.
go back to reference Ziraba AK, Madise NJ, Matilu M, Zulu E, Kebaso J, Khamadi S, Okoth V, Ezeh AC. The effect of participant nonresponse on HIV prevalence estimates in a population-based survey in two informal settlements in Nairobi city. Popul Health Metr. 2010;8:22–32.CrossRefPubMedPubMedCentral Ziraba AK, Madise NJ, Matilu M, Zulu E, Kebaso J, Khamadi S, Okoth V, Ezeh AC. The effect of participant nonresponse on HIV prevalence estimates in a population-based survey in two informal settlements in Nairobi city. Popul Health Metr. 2010;8:22–32.CrossRefPubMedPubMedCentral
Metadata
Title
Role of survey response rates on valid inference: an application to HIV prevalence estimates
Authors
Miguel Marino
Marcello Pagano
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Emerging Themes in Epidemiology / Issue 1/2018
Electronic ISSN: 1742-7622
DOI
https://doi.org/10.1186/s12982-018-0074-x

Other articles of this Issue 1/2018

Emerging Themes in Epidemiology 1/2018 Go to the issue