Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Does size really matter? A sensitivity analysis of number of seeds in a respondent-driven sampling study of gay, bisexual and other men who have sex with men in Vancouver, Canada

Authors: Nathan John Lachowsky, Justin Tyler Sorge, Henry Fisher Raymond, Zishan Cui, Paul Sereda, Ashleigh Rich, Eric A. Roth, Robert S. Hogg, David M. Moore

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Respondent-driven sampling (RDS) is an increasingly used peer chain-recruitment method to sample “hard-to-reach” populations for whom there are no reliable sampling frames. Implementation success of RDS varies; one potential negative factor being the number of seeds used.

Methods

We conducted a sensitivity analysis on estimates produced using data from an RDS study of gay, bisexual and other men who have sex with men (GBMSM) aged ≥16 years living in Vancouver, Canada. Participants completed a questionnaire on demographics, sexual behavior and substance use. For analysis, we used increasing seed exclusion criteria, starting with all participants and subsequently removing unproductive seeds, chains of ≤1 recruitment waves, and chains of ≤2 recruitment waves. We calculated estimates for three different outcomes (HIV serostatus, condomless anal intercourse with HIV discordant/unknown status partner, and injecting drugs) using three different RDS weighting procedures: RDS-I, RDS-II, and RDS-SS. We also assessed seed dependence with bottleneck analyses and convergence plots. Statistical differences between RDS estimators were assessed through simulation analysis.

Results

Overall, 719 participants were recruited, which included 119 seeds and a maximum of 16 recruitment waves (mean chain length = 1.7). The sample of >0 recruitment waves removed unproductive seeds (n = 50/119, 42.0%), resulting in 69 chains (mean length = 3.0). The sample of >1 recruitment waves removed 125 seeds or recruits (17.4% of overall sample), resulting in 37 chains (mean length = 4.8). The final sample of >2 recruitment waves removed a further 182 seeds or recruits (25.3% of overall sample), resulting in 25 chains (mean length = 6.1). Convergence plots and bottleneck analyses of condomless anal intercourse with HIV discordant/unknown status partner and injecting drugs outcomes were satisfactory. For these two outcomes, regardless of seed exclusion criteria used, the crude proportions fell within 95% confidence intervals of all RDS-weighted estimates. Significant differences between the three RDS estimators were not observed.

Conclusions

Within a sample of GBMSM in Vancouver, Canada, this RDS study suggests that when equilibrium and homophily are met, although potentially costly and time consuming, analysis is not negatively affected by large numbers of unproductive or lowly productive seeds.
Appendix
Available only for authorised users
Literature
1.
go back to reference Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS. 2005;19 Suppl 2:S67–72.CrossRefPubMed Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS. 2005;19 Suppl 2:S67–72.CrossRefPubMed
3.
go back to reference Centre for Communicable Disease and Infection Control, Public Health Agency of Canada. HIV/AIDS Epi Updates Chapter 1: National HIV Prevalence and Incidence Estimates for 2011. Canada: Centre for Communicable Disease and Infection Control, Public Health Agency of Canada; 2014. Centre for Communicable Disease and Infection Control, Public Health Agency of Canada. HIV/AIDS Epi Updates Chapter 1: National HIV Prevalence and Incidence Estimates for 2011. Canada: Centre for Communicable Disease and Infection Control, Public Health Agency of Canada; 2014.
4.
go back to reference Trussler T, Banks P, Marchand R, Robert W, Gustafson R, Hogg R, et al. ManCount Sizes-up the Gaps: a sexual health survey of gay men in Vancouver. Vancouver: Vancouver Coastal Health; 2010. Trussler T, Banks P, Marchand R, Robert W, Gustafson R, Hogg R, et al. ManCount Sizes-up the Gaps: a sexual health survey of gay men in Vancouver. Vancouver: Vancouver Coastal Health; 2010.
7.
8.
go back to reference Heckathorn DD. Respondent-driven sampling: A new approach to the study of hidden populations. Soc Probl. 1997;44(2):174–99.CrossRef Heckathorn DD. Respondent-driven sampling: A new approach to the study of hidden populations. Soc Probl. 1997;44(2):174–99.CrossRef
9.
go back to reference Respondent-Driven HDD, Sampling II. Deriving Valid Population Estimates from Chain-Referral Samples of Hidden Populations. Soc Probl. 2002;49(1):11–34.CrossRef Respondent-Driven HDD, Sampling II. Deriving Valid Population Estimates from Chain-Referral Samples of Hidden Populations. Soc Probl. 2002;49(1):11–34.CrossRef
10.
go back to reference Malekinejad M, Johnston LG, Kendall C, Kerr LRFS, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: A systematic review. AIDS Behav. 2008;12 SUPPL 1:105–30.CrossRef Malekinejad M, Johnston LG, Kendall C, Kerr LRFS, Rifkin MR, Rutherford GW. Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: A systematic review. AIDS Behav. 2008;12 SUPPL 1:105–30.CrossRef
11.
go back to reference Johnston L, Whitehead S, Simic-Lawson M, Kendall C. Formative research to optimize respondentdriven sampling surveys among hard-to-reach populations in HIV behavioral and biological surveillance: lessons learned from four case studies. AIDS Care. 2010;22(6):784–92.CrossRefPubMed Johnston L, Whitehead S, Simic-Lawson M, Kendall C. Formative research to optimize respondentdriven sampling surveys among hard-to-reach populations in HIV behavioral and biological surveillance: lessons learned from four case studies. AIDS Care. 2010;22(6):784–92.CrossRefPubMed
15.
go back to reference Salganik MJ, Heckathorn DD. Sampling and estimation in hidden populations using respondent-driven sampling. Sociol Methodol. 2004;34(1):193–240.CrossRef Salganik MJ, Heckathorn DD. Sampling and estimation in hidden populations using respondent-driven sampling. Sociol Methodol. 2004;34(1):193–240.CrossRef
16.
go back to reference Heckathorn D, Semaan S. Extensions of respondent-driven sampling: a new approach to the study of injection drug users aged 18–25. AIDS Behav. 2002;6(1):55–67. Available from: http://link.springer.com/article/10.1023/A:1014528612685.CrossRef Heckathorn D, Semaan S. Extensions of respondent-driven sampling: a new approach to the study of injection drug users aged 18–25. AIDS Behav. 2002;6(1):55–67. Available from: http://​link.​springer.​com/​article/​10.​1023/​A:​1014528612685.CrossRef
17.
go back to reference Wejnert C. An empirical test of respondent-driven sampling: Point estimates, variance, degree measures, and out-of-equilibrium data. Sociol Methodol. 2009;39(1):73–116.CrossRefPubMedPubMedCentral Wejnert C. An empirical test of respondent-driven sampling: Point estimates, variance, degree measures, and out-of-equilibrium data. Sociol Methodol. 2009;39(1):73–116.CrossRefPubMedPubMedCentral
18.
go back to reference Volz E, Heckathorn DD. Probability based estimation theory for respondent driven sampling. J Off Stat. 2008;24(1):79–97. Volz E, Heckathorn DD. Probability based estimation theory for respondent driven sampling. J Off Stat. 2008;24(1):79–97.
19.
go back to reference Wirtz AL, Mehta SH, Latkin C, Zelaya CE, Galai N, Peryshkina A, et al. Comparison of respondent driven sampling estimators to determine HIV prevalence and population characteristics among men who have sex with men in Moscow, Russia. PLoS One. 2016;11(6):e0155519.CrossRefPubMedPubMedCentral Wirtz AL, Mehta SH, Latkin C, Zelaya CE, Galai N, Peryshkina A, et al. Comparison of respondent driven sampling estimators to determine HIV prevalence and population characteristics among men who have sex with men in Moscow, Russia. PLoS One. 2016;11(6):e0155519.CrossRefPubMedPubMedCentral
22.
go back to reference Gile K, Johnston LG, Salganik MJ. Diagnostics for respondent‐driven sampling. J R … [Internet]. 2014;241–69. Available from: http://onlinelibrary.wiley.com/doi/10.1111/rssa.12059/full. Gile K, Johnston LG, Salganik MJ. Diagnostics for respondent‐driven sampling. J R … [Internet]. 2014;241–69. Available from: http://​onlinelibrary.​wiley.​com/​doi/​10.​1111/​rssa.​12059/​full.
24.
go back to reference Fox J. Diagnosing Non-Normality, Nonconstant Error Variance, and Nonlinearity. In: Applied Regression Analysis and Generalized Linear Models. 3rd ed. Thousand Oaks: SAGE Publishing; 2016. Fox J. Diagnosing Non-Normality, Nonconstant Error Variance, and Nonlinearity. In: Applied Regression Analysis and Generalized Linear Models. 3rd ed. Thousand Oaks: SAGE Publishing; 2016.
26.
go back to reference Ramadanovic B, Vasarhelyi K, Nadaf A, Wittenberg RW, Montaner JSG, Wood E, et al. Changing Risk Behaviours and the HIV Epidemic: A Mathematical Analysis in the Context of Treatment as Prevention. PLoS One. 2013;8(5):e62321.CrossRefPubMedPubMedCentral Ramadanovic B, Vasarhelyi K, Nadaf A, Wittenberg RW, Montaner JSG, Wood E, et al. Changing Risk Behaviours and the HIV Epidemic: A Mathematical Analysis in the Context of Treatment as Prevention. PLoS One. 2013;8(5):e62321.CrossRefPubMedPubMedCentral
27.
go back to reference Handcock MS, Fellows IE, Gile KJ. RDS Analyst: Software for the Analysis of Respondent-Driven Sampling Data, Version 0.52 [Internet]. 2015. Available from: http://hpmrg.org. Handcock MS, Fellows IE, Gile KJ. RDS Analyst: Software for the Analysis of Respondent-Driven Sampling Data, Version 0.52 [Internet]. 2015. Available from: http://​hpmrg.​org.
29.
go back to reference Henrich J, Heine SJ, Norenzayan A. The weirdest people in the world? Behav Brain Sci. 2010;33(2–3):61-83-135. Henrich J, Heine SJ, Norenzayan A. The weirdest people in the world? Behav Brain Sci. 2010;33(2–3):61-83-135.
30.
go back to reference Moore DM, Cui Z, Lachowsky N, Raymond HF, Roth E, Rich A, Sereda P, Howard T, McFarland W, Lal A, Montaner J. HIV Community Viral Load and Factors Associated With Elevated Viremia Among a Community-Based Sample of Men Who Have Sex With Men in Vancouver, Canada. J Acquir Immune Defic Syndr. 2016;72(1):87–95. Moore DM, Cui Z, Lachowsky N, Raymond HF, Roth E, Rich A, Sereda P, Howard T, McFarland W, Lal A, Montaner J. HIV Community Viral Load and Factors Associated With Elevated Viremia Among a Community-Based Sample of Men Who Have Sex With Men in Vancouver, Canada. J Acquir Immune Defic Syndr. 2016;72(1):87–95.
Metadata
Title
Does size really matter? A sensitivity analysis of number of seeds in a respondent-driven sampling study of gay, bisexual and other men who have sex with men in Vancouver, Canada
Authors
Nathan John Lachowsky
Justin Tyler Sorge
Henry Fisher Raymond
Zishan Cui
Paul Sereda
Ashleigh Rich
Eric A. Roth
Robert S. Hogg
David M. Moore
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0258-4

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue