Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Understanding recruitment: outcomes associated with alternate methods for seed selection in respondent driven sampling

Authors: John L Wylie, Ann M Jolly

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Respondent driven sampling (RDS) was designed for sampling “hidden” populations and intended as a means of generating unbiased population estimates. Its widespread use has been accompanied by increasing scrutiny as researchers attempt to understand the extent to which the population estimates produced by RDS are, in fact, generalizable to the actual population of interest. In this study we compare two different methods of seed selection to determine whether this may influence recruitment and RDS measures.

Methods

Two seed groups were established. One group was selected as per a standard RDS approach of study staff purposefully selecting a small number of individuals to initiate recruitment chains. The second group consisted of individuals self-presenting to study staff during the time of data collection. Recruitment was allowed to unfold from each group and RDS estimates were compared between the groups. A comparison of variables associated with HIV was also completed.

Results

Three analytic groups were used for the majority of the analyses–RDS recruits originating from study staff-selected seeds (n = 196); self-presenting seeds (n = 118); and recruits of self-presenting seeds (n = 264). Multinomial logistic regression demonstrated significant differences between the three groups across six of ten sociodemographic and risk behaviours examined. Examination of homophily values also revealed differences in recruitment from the two seed groups (e.g. in one arm of the study sex workers and solvent users tended not to recruit others like themselves, while the opposite was true in the second arm of the study). RDS estimates of population proportions were also different between the two recruitment arms; in some cases corresponding confidence intervals between the two recruitment arms did not overlap. Further differences were revealed when comparisons of HIV prevalence were carried out.

Conclusions

RDS is a cost-effective tool for data collection, however, seed selection has the potential to influence which subgroups within a population are accessed. Our findings indicate that using multiple methods for seed selection may improve access to hidden populations. Our results further highlight the need for a greater understanding of RDS to ensure appropriate, accurate and representative estimates of a population can be obtained from an RDS sample.
Literature
1.
go back to reference Heckathorn D: Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl. 1997, 44: 174-199. 10.2307/3096941.CrossRef Heckathorn D: Respondent-driven sampling: a new approach to the study of hidden populations. Soc Probl. 1997, 44: 174-199. 10.2307/3096941.CrossRef
2.
go back to reference Heckathorn D: Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Soc Problems. 2002, 49: 11-32. 10.1525/sp.2002.49.1.11.CrossRef Heckathorn D: Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Soc Problems. 2002, 49: 11-32. 10.1525/sp.2002.49.1.11.CrossRef
3.
go back to reference Malekinejad M, Johnston L, Kendall C, Kerr L, Rifkin M, Rutherford G: Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav. 2008, 12: 105-130. 10.1007/s10461-008-9421-1.CrossRef Malekinejad M, Johnston L, Kendall C, Kerr L, Rifkin M, Rutherford G: Using respondent-driven sampling methodology for HIV biological and behavioral surveillance in international settings: a systematic review. AIDS Behav. 2008, 12: 105-130. 10.1007/s10461-008-9421-1.CrossRef
4.
go back to reference Salganik MJ: Respondent-driven sampling in the real world. Epidemiology. 2012, 23 (1): 148-150. 10.1097/EDE.0b013e31823b6979.CrossRefPubMed Salganik MJ: Respondent-driven sampling in the real world. Epidemiology. 2012, 23 (1): 148-150. 10.1097/EDE.0b013e31823b6979.CrossRefPubMed
6.
go back to reference McCreesh N, Frost SDW, Seeley J, Katongole J, Tarsh MN, Ndunguse R, Jichi F, Lunel NL, Maher D, Johnston LG, et al: Evaluation of respondent-driven sampling. Epidemiology. 2012, 23 (1): 138-147. 10.1097/EDE.0b013e31823ac17c.CrossRefPubMedPubMedCentral McCreesh N, Frost SDW, Seeley J, Katongole J, Tarsh MN, Ndunguse R, Jichi F, Lunel NL, Maher D, Johnston LG, et al: Evaluation of respondent-driven sampling. Epidemiology. 2012, 23 (1): 138-147. 10.1097/EDE.0b013e31823ac17c.CrossRefPubMedPubMedCentral
7.
go back to reference Burt RD, Thiede H: Evaluating consistency in repeat surveys of injection drug users recruited by respondent-driven sampling in the Seattle area: results from the NHBS-IDU1 and NHBS-IDU2 surveys. Ann Epidemiol. 2012, 22 (5): 354-363. 10.1016/j.annepidem.2012.02.012.CrossRefPubMedPubMedCentral Burt RD, Thiede H: Evaluating consistency in repeat surveys of injection drug users recruited by respondent-driven sampling in the Seattle area: results from the NHBS-IDU1 and NHBS-IDU2 surveys. Ann Epidemiol. 2012, 22 (5): 354-363. 10.1016/j.annepidem.2012.02.012.CrossRefPubMedPubMedCentral
8.
go back to reference Ma X, Zhang Q, He X, Sun W, Yue H, Chen S, Raymond HF, Li Y, Xu M, Du H, et al: Trends in prevalence of HIV, syphilis, hepatitis C, hepatitis B, and sexual risk behavior among men who have sex with men. Results of 3 consecutive respondent-driven sampling surveys in Beijing, 2004 through 2006. J Acq lmmun Def Synd. 2007, 45: 581-587. 10.1097/QAI.0b013e31811eadbc.CrossRef Ma X, Zhang Q, He X, Sun W, Yue H, Chen S, Raymond HF, Li Y, Xu M, Du H, et al: Trends in prevalence of HIV, syphilis, hepatitis C, hepatitis B, and sexual risk behavior among men who have sex with men. Results of 3 consecutive respondent-driven sampling surveys in Beijing, 2004 through 2006. J Acq lmmun Def Synd. 2007, 45: 581-587. 10.1097/QAI.0b013e31811eadbc.CrossRef
9.
go back to reference Townsend L, Johnston LG, Flisher AJ, Mathews C, Zembe Y: Effectiveness of respondent-driven sampling to recruit high risk heterosexual men who have multiple female sexual partners: differences in HIV prevalence and sexual risk behaviours measured at two time points. AIDS Behav. 2010, 14: 1330-1339. 10.1007/s10461-010-9753-5.CrossRefPubMed Townsend L, Johnston LG, Flisher AJ, Mathews C, Zembe Y: Effectiveness of respondent-driven sampling to recruit high risk heterosexual men who have multiple female sexual partners: differences in HIV prevalence and sexual risk behaviours measured at two time points. AIDS Behav. 2010, 14: 1330-1339. 10.1007/s10461-010-9753-5.CrossRefPubMed
10.
go back to reference Halkitis PN, Kupprat SA, Hubbard D, Simons SM, Jabouin R, Hampton MC, Gillen S: Evaluation of the relative effectiveness of three HIV testing strategies targeting African American men who have sex with men (MSM) in New York City. Ann Behav Med. 2011, 42 (3): 361-369. 10.1007/s12160-011-9299-4.CrossRefPubMed Halkitis PN, Kupprat SA, Hubbard D, Simons SM, Jabouin R, Hampton MC, Gillen S: Evaluation of the relative effectiveness of three HIV testing strategies targeting African American men who have sex with men (MSM) in New York City. Ann Behav Med. 2011, 42 (3): 361-369. 10.1007/s12160-011-9299-4.CrossRefPubMed
11.
go back to reference Rudolph AE, Crawford ND, Latkin CA, Heimer R, Benjamin EO, Jones KC, Fuller CM: Subpopulations of illicit drug users reached by targeted street outreach and respondent-driven sampling strategies: implications for research and public health practice. Ann Epidemiol. 2011, 21: 280-289. 10.1016/j.annepidem.2010.11.007.CrossRefPubMedPubMedCentral Rudolph AE, Crawford ND, Latkin CA, Heimer R, Benjamin EO, Jones KC, Fuller CM: Subpopulations of illicit drug users reached by targeted street outreach and respondent-driven sampling strategies: implications for research and public health practice. Ann Epidemiol. 2011, 21: 280-289. 10.1016/j.annepidem.2010.11.007.CrossRefPubMedPubMedCentral
12.
go back to reference Robinson WT, Risser JM, McGoy S, Becker AB, Rehman H, Jefferson M, Griffin V, Wolverton M, Tortu S: Recruiting injection drug users: a three-site comparison of results and experiences with respondent-driven and targeted sampling procedures. J Urban Health. 2006, 83 (7): i29-i38.CrossRefPubMed Robinson WT, Risser JM, McGoy S, Becker AB, Rehman H, Jefferson M, Griffin V, Wolverton M, Tortu S: Recruiting injection drug users: a three-site comparison of results and experiences with respondent-driven and targeted sampling procedures. J Urban Health. 2006, 83 (7): i29-i38.CrossRefPubMed
13.
go back to reference Lansky A, Abdul-Quader AS, Cribbin M, Hall T, Finlayson TJ, Garfein RS, Lin LS, Sullivan PS: Developing an HIV Behavioral Surveillance System for injecting drug users: the National HIV behavioral surveillance system. Publ Health Rep. 2007, 122 (Suppl 1): 48-55. Lansky A, Abdul-Quader AS, Cribbin M, Hall T, Finlayson TJ, Garfein RS, Lin LS, Sullivan PS: Developing an HIV Behavioral Surveillance System for injecting drug users: the National HIV behavioral surveillance system. Publ Health Rep. 2007, 122 (Suppl 1): 48-55.
14.
go back to reference Platt L, Wall M, Rhodes T, Judd A, Hickman M, Johnston LG, Renton A, Bobrova N, Sarang A: Methods to recruit hard-to-reach groups: comparing two chain referral sampling methods of recruiting injecting drug users across nine studies in Russia and Estonia. J Urban Health. 2006, 83 (Suppl 1): 39-53.CrossRefPubMedCentral Platt L, Wall M, Rhodes T, Judd A, Hickman M, Johnston LG, Renton A, Bobrova N, Sarang A: Methods to recruit hard-to-reach groups: comparing two chain referral sampling methods of recruiting injecting drug users across nine studies in Russia and Estonia. J Urban Health. 2006, 83 (Suppl 1): 39-53.CrossRefPubMedCentral
15.
go back to reference Kendall C, Kerr L, Gondim R, Werneck G, Macena R, Pontes M, Johnston L, Sabin K, McFarland W: An empirical comparison of respondent-driven sampling, time location sampling, and snowball sampling for behavioral surveillance in men who have sex with men, Fortaleza, Brazil. AIDS Behav. 2008, 12: 97-104. 10.1007/s10461-008-9390-4.CrossRef Kendall C, Kerr L, Gondim R, Werneck G, Macena R, Pontes M, Johnston L, Sabin K, McFarland W: An empirical comparison of respondent-driven sampling, time location sampling, and snowball sampling for behavioral surveillance in men who have sex with men, Fortaleza, Brazil. AIDS Behav. 2008, 12: 97-104. 10.1007/s10461-008-9390-4.CrossRef
16.
go back to reference Daniulaityte R, Falck R, Li L, Nahhas RW, Carlson RG: Respondent-driven sampling to recruit young adult non-medical users of pharmaceutical opioids: problems and solutions. Drug Alcohol Depend. 2012, 121: 23-29. 10.1016/j.drugalcdep.2011.08.005.CrossRefPubMed Daniulaityte R, Falck R, Li L, Nahhas RW, Carlson RG: Respondent-driven sampling to recruit young adult non-medical users of pharmaceutical opioids: problems and solutions. Drug Alcohol Depend. 2012, 121: 23-29. 10.1016/j.drugalcdep.2011.08.005.CrossRefPubMed
17.
go back to reference Paquette DM, Bryant J, Crawford S, de Wit JBF: Conducting a respondent-driven sampling survey with the use of existing resources in Sydney, Australia. Drug Alchohol Depen. 2011, 116: 125-131. 10.1016/j.drugalcdep.2010.12.002.CrossRef Paquette DM, Bryant J, Crawford S, de Wit JBF: Conducting a respondent-driven sampling survey with the use of existing resources in Sydney, Australia. Drug Alchohol Depen. 2011, 116: 125-131. 10.1016/j.drugalcdep.2010.12.002.CrossRef
18.
go back to reference Johnston LG, Malekinejad M, Kendall C, Iuppa IM, Rutherford GW: Implementation challenges to using respondent-driven sampling methodology for HIV biological and behavioral surveillance: field experiences in international settings. AIDS Behav. 2008, 12 (4 Suppl): S131-S141.CrossRefPubMed Johnston LG, Malekinejad M, Kendall C, Iuppa IM, Rutherford GW: Implementation challenges to using respondent-driven sampling methodology for HIV biological and behavioral surveillance: field experiences in international settings. AIDS Behav. 2008, 12 (4 Suppl): S131-S141.CrossRefPubMed
19.
go back to reference Thompson LH, Schellenberg M, Ormond M, Wylie JL: Social structural analysis of street-involved youth in Winnipeg, Canada. JoSS. 2011, 12 (Article 6): Thompson LH, Schellenberg M, Ormond M, Wylie JL: Social structural analysis of street-involved youth in Winnipeg, Canada. JoSS. 2011, 12 (Article 6):
21.
go back to reference Volz E, Wejnert C, Degani I, Heckathorn DD: Respondent-driven sampling analysis tool (RDSAT) version 5.6. 2007, Ithaca, NY: Cornell University Volz E, Wejnert C, Degani I, Heckathorn DD: Respondent-driven sampling analysis tool (RDSAT) version 5.6. 2007, Ithaca, NY: Cornell University
22.
go back to reference Ammann RA: Defibrotide for hepatic VOD in children: exact statistics can help!. Bone Marrow Transpl. 2004, 34: 277-278. 10.1038/sj.bmt.1704571.CrossRef Ammann RA: Defibrotide for hepatic VOD in children: exact statistics can help!. Bone Marrow Transpl. 2004, 34: 277-278. 10.1038/sj.bmt.1704571.CrossRef
Metadata
Title
Understanding recruitment: outcomes associated with alternate methods for seed selection in respondent driven sampling
Authors
John L Wylie
Ann M Jolly
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-93

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue