Skip to main content
Top
Published in: AIDS and Behavior 4/2012

Open Access 01-05-2012 | Original Paper

Estimating Design Effect and Calculating Sample Size for Respondent-Driven Sampling Studies of Injection Drug Users in the United States

Authors: Cyprian Wejnert, Huong Pham, Nevin Krishna, Binh Le, Elizabeth DiNenno

Published in: AIDS and Behavior | Issue 4/2012

Login to get access

Abstract

Respondent-driven sampling (RDS) has become increasingly popular for sampling hidden populations, including injecting drug users (IDU). However, RDS data are unique and require specialized analysis techniques, many of which remain underdeveloped. RDS sample size estimation requires knowing design effect (DE), which can only be calculated post hoc. Few studies have analyzed RDS DE using real world empirical data. We analyze estimated DE from 43 samples of IDU collected using a standardized protocol. We find the previous recommendation that sample size be at least doubled, consistent with DE = 2, underestimates true DE and recommend researchers use DE = 4 as an alternate estimate when calculating sample size. A formula for calculating sample size for RDS studies among IDU is presented. Researchers faced with limited resources may wish to accept slightly higher standard errors to keep sample size requirements low. Our results highlight dangers of ignoring sampling design in analysis.
Literature
2.
go back to reference CDC. HIV-associated behaviors among injecting-drug users—23 Cities, United States, May 2005–February 2006. Morb Mortal Wkly Rep. 2009;58(13):329–32. CDC. HIV-associated behaviors among injecting-drug users—23 Cities, United States, May 2005–February 2006. Morb Mortal Wkly Rep. 2009;58(13):329–32.
3.
go back to reference White House Office of National AIDS Policy. National HIV/AIDS Strategy for the United States. Washington: The White House Office of National AIDS Policy; 2010. White House Office of National AIDS Policy. National HIV/AIDS Strategy for the United States. Washington: The White House Office of National AIDS Policy; 2010.
4.
go back to reference Heckathorn DD. Respondent-driven sampling. II. Deriving valid population estimates from chain-referral samples of hidden populations. Soc Probl. 2002;49(1):11–34.CrossRef Heckathorn DD. Respondent-driven sampling. II. Deriving valid population estimates from chain-referral samples of hidden populations. Soc Probl. 2002;49(1):11–34.CrossRef
5.
go back to reference Volz E, Heckathorn DD. Probability based estimation theory for respondent driven sampling. J Off Stat. 2008;24(1):79–97. Volz E, Heckathorn DD. Probability based estimation theory for respondent driven sampling. J Off Stat. 2008;24(1):79–97.
6.
go back to reference Salganik MJ, Heckathorn DD. Sampling and estimation in hidden populations using respondent-driven sampling. Sociol Methodol. 2004;34:193–239.CrossRef Salganik MJ, Heckathorn DD. Sampling and estimation in hidden populations using respondent-driven sampling. Sociol Methodol. 2004;34:193–239.CrossRef
7.
go back to reference Malekinejad M, Johnston LG, Kendall C, Kerr LR, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav. 2008;12(4 Suppl):S105–30.PubMedCrossRef Malekinejad M, Johnston LG, Kendall C, Kerr LR, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav. 2008;12(4 Suppl):S105–30.PubMedCrossRef
8.
go back to reference Broadhead RS, Heckathorn DD. Aids-prevention outreach among injection-drug users—agency problems and new approaches. Soc Probl. 1994;41(3):473–95.CrossRef Broadhead RS, Heckathorn DD. Aids-prevention outreach among injection-drug users—agency problems and new approaches. Soc Probl. 1994;41(3):473–95.CrossRef
9.
go back to reference Platt L, Wall M, Rhodes T, Judd A, Hickman M, Johnston LG, et al. Methods to recruit hard-to-reach groups: comparing two chain referral sampling methods of recruiting injecting drug users across nine studies in Russia and Estonia. J Urban Health. 2006;83(6 Suppl):i39–53.PubMedCrossRef Platt L, Wall M, Rhodes T, Judd A, Hickman M, Johnston LG, et al. Methods to recruit hard-to-reach groups: comparing two chain referral sampling methods of recruiting injecting drug users across nine studies in Russia and Estonia. J Urban Health. 2006;83(6 Suppl):i39–53.PubMedCrossRef
10.
go back to reference Lansky A, Abdul-Quader AS, Cribbin M, Hall T, Finlayson TJ, Garfein RS, et al. Developing an HIV behavioral surveillance system for injecting drug users: the National HIV Behavioral Surveillance System. Public Health Rep. 2007;122(Suppl 1):48–55.PubMed Lansky A, Abdul-Quader AS, Cribbin M, Hall T, Finlayson TJ, Garfein RS, et al. Developing an HIV behavioral surveillance system for injecting drug users: the National HIV Behavioral Surveillance System. Public Health Rep. 2007;122(Suppl 1):48–55.PubMed
11.
go back to reference Des Jarlais DC, Arasteh K, Perlis T, Hagan H, Abdul-Quader A, Heckathorn DD, et al. Convergence of HIV seroprevalence among injecting and non-injecting drug users in New York City. AIDS. 2007;21(2):231–5.PubMedCrossRef Des Jarlais DC, Arasteh K, Perlis T, Hagan H, Abdul-Quader A, Heckathorn DD, et al. Convergence of HIV seroprevalence among injecting and non-injecting drug users in New York City. AIDS. 2007;21(2):231–5.PubMedCrossRef
12.
go back to reference Heckathorn DD. Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl. 1997;44(2):174–99.CrossRef Heckathorn DD. Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl. 1997;44(2):174–99.CrossRef
13.
go back to reference Wejnert C, Heckathorn DD. Web-based network sampling—efficiency and efficacy of respondent-driven sampling for online research. Sociol Method Res. 2008;37(1):105–34.CrossRef Wejnert C, Heckathorn DD. Web-based network sampling—efficiency and efficacy of respondent-driven sampling for online research. Sociol Method Res. 2008;37(1):105–34.CrossRef
14.
go back to reference Cornfield J. The determination of sample size. Am J Public Health Nations Health. 1951;41(6):654–61.PubMedCrossRef Cornfield J. The determination of sample size. Am J Public Health Nations Health. 1951;41(6):654–61.PubMedCrossRef
15.
go back to reference Kish L. Survey sampling. New York: Wiley; 1965. Kish L. Survey sampling. New York: Wiley; 1965.
16.
go back to reference Lohr S. Sampling: design and analysis. Pacific Grove: Brooks/Cole Publishing Company; 1999. Lohr S. Sampling: design and analysis. Pacific Grove: Brooks/Cole Publishing Company; 1999.
17.
go back to reference Karon JM. The analysis of time-location sampling study data. In: Proceeding of the joint statistical meeting, section on survey research methods. Minneapolis, MN: American Statistical Association; 2005. p. 3180–6. Karon JM. The analysis of time-location sampling study data. In: Proceeding of the joint statistical meeting, section on survey research methods. Minneapolis, MN: American Statistical Association; 2005. p. 3180–6.
18.
go back to reference Salganik MJ. Variance estimation, design effects, and sample size calculations for respondent-driven sampling. J Urban Health. 2006;83(6 Suppl):i98–112.PubMedCrossRef Salganik MJ. Variance estimation, design effects, and sample size calculations for respondent-driven sampling. J Urban Health. 2006;83(6 Suppl):i98–112.PubMedCrossRef
19.
go back to reference Szwarcwald CL, de Souza Junior PR, Damacena GN, Junior AB, Kendall C. Analysis of data collected by RDS among sex workers in 10 Brazilian cities, 2009: estimation of the prevalence of HIV, variance, and design effect. J Acquir Immune Defic Syndr. 2011;57(Suppl 3):S129–35.PubMed Szwarcwald CL, de Souza Junior PR, Damacena GN, Junior AB, Kendall C. Analysis of data collected by RDS among sex workers in 10 Brazilian cities, 2009: estimation of the prevalence of HIV, variance, and design effect. J Acquir Immune Defic Syndr. 2011;57(Suppl 3):S129–35.PubMed
20.
go back to reference Goel S, Salganik MJ. Assessing respondent-driven sampling. Proc Natl Acad Sci USA. 2010;107(15):6743–7.PubMedCrossRef Goel S, Salganik MJ. Assessing respondent-driven sampling. Proc Natl Acad Sci USA. 2010;107(15):6743–7.PubMedCrossRef
21.
go back to reference Wejnert C. An empirical test of respondent-driven sampling: point estimates, variance, degree measures, and out-of-equilibrium data. Sociol Methodol. 2009;39(1):73–116.PubMedCrossRef Wejnert C. An empirical test of respondent-driven sampling: point estimates, variance, degree measures, and out-of-equilibrium data. Sociol Methodol. 2009;39(1):73–116.PubMedCrossRef
22.
go back to reference Lansky A, Brooks JT, Dinenno E, Heffelfinger J, Hall HI, Mermin J. Epidemiology of HIV in the United States. J Acquir Immune Defic Syndr. 2010;55(Suppl 2):S64–8.PubMed Lansky A, Brooks JT, Dinenno E, Heffelfinger J, Hall HI, Mermin J. Epidemiology of HIV in the United States. J Acquir Immune Defic Syndr. 2010;55(Suppl 2):S64–8.PubMed
23.
go back to reference Gallagher KM, Sullivan PS, Lansky A, Onorato IM. Behavioral surveillance among people at risk for HIV infection in the U.S.: the National HIV Behavioral Surveillance System. Public Health Rep. 2007;122(Suppl 1):32–8.PubMed Gallagher KM, Sullivan PS, Lansky A, Onorato IM. Behavioral surveillance among people at risk for HIV infection in the U.S.: the National HIV Behavioral Surveillance System. Public Health Rep. 2007;122(Suppl 1):32–8.PubMed
24.
go back to reference Wejnert C, Heckathorn D. Respondent-driven sampling: operational procedures, evolution of estimators, and topics for future research. In: Williams M, Vogt P, editors. The SAGE handbook of innovation in social research methods. London: SAGE Publications, Ltd.; 2011. p. 473–97. Wejnert C, Heckathorn D. Respondent-driven sampling: operational procedures, evolution of estimators, and topics for future research. In: Williams M, Vogt P, editors. The SAGE handbook of innovation in social research methods. London: SAGE Publications, Ltd.; 2011. p. 473–97.
25.
go back to reference McPherson M, Smith-Lovin L, Cook JM. Birds of a feather: homophily in social networks. Annu Rev Sociol. 2001;27:415–44.CrossRef McPherson M, Smith-Lovin L, Cook JM. Birds of a feather: homophily in social networks. Annu Rev Sociol. 2001;27:415–44.CrossRef
26.
go back to reference Gile KJ. Improved inference for respondent-driven sampling data with application to HIV prevalence estimation. J Am Stat Assoc. 2011;106(493):135–46.CrossRef Gile KJ. Improved inference for respondent-driven sampling data with application to HIV prevalence estimation. J Am Stat Assoc. 2011;106(493):135–46.CrossRef
27.
go back to reference Volz E, Wejnert C, Degani I, Heckathorn D. Respondent-driven sampling analysis tool (RDSAT). 8th ed. Ithaca: Cornell University; 2010. Volz E, Wejnert C, Degani I, Heckathorn D. Respondent-driven sampling analysis tool (RDSAT). 8th ed. Ithaca: Cornell University; 2010.
Metadata
Title
Estimating Design Effect and Calculating Sample Size for Respondent-Driven Sampling Studies of Injection Drug Users in the United States
Authors
Cyprian Wejnert
Huong Pham
Nevin Krishna
Binh Le
Elizabeth DiNenno
Publication date
01-05-2012
Publisher
Springer US
Published in
AIDS and Behavior / Issue 4/2012
Print ISSN: 1090-7165
Electronic ISSN: 1573-3254
DOI
https://doi.org/10.1007/s10461-012-0147-8

Other articles of this Issue 4/2012

AIDS and Behavior 4/2012 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine