Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Retaining young people in a longitudinal sexual health survey: a trial of strategies to maintain participation

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

There is an increasing trend towards lower participation in questionnaire surveys. This reduces representativeness, increases costs and introduces particular challenges to longitudinal surveys, as researchers have to use complex statistical techniques which attempt to address attrition. This paper describes a trial of incentives to retain longitudinal survey cohorts from ages 16 to 20, to question them on the sensitive topic of sexual health.

Methods

A longitudinal survey was conducted with 8,430 eligible pupils from two sequential year groups from 25 Scottish schools. Wave 1 (14 years) and Wave 2 (16 years) were conducted largely within schools. For Wave 3 (18 years), when everyone had left school, the sample was split into 4 groups that were balanced across predictors of survey participation: 1) no incentive; 2) chance of winning one of twenty-five vouchers worth £20; 3) chance of winning one £500 voucher; 4) a definite reward of a £10 voucher sent on receipt of their completed questionnaire. Outcomes were participation at Wave 3 and two years later at Wave 4. Analysis used logistic regression and adjusted for clustering at school level.

Results

The only condition that had a significant and beneficial impact for pupils was to offer a definite reward for participation (Group 4). Forty-one percent of Group 4 participated in Wave 3 versus 27% or less for Groups 1 to 3. At Wave 4, 35% of Group 4 took part versus 25% or less for the other groups. Similarly, 22% of Group 4 participated in all four Waves of the longitudinal study, whereas for the other three groups it was 16% or less that participated in full.

Conclusions

The best strategy for retaining all groups of pupils and one that improved retention at both age 18 and age 20 was to offer a definite reward for participation. This is expensive, however, given the many benefits of retaining a longitudinal sample, we recommend inclusion of this as a research cost for cohort and other repeat-contact studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Galea S, Tracy M: Participation Rates in Epidemiologic Studies. Annals of Epidemiology. 2007, 17 (9): 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed Galea S, Tracy M: Participation Rates in Epidemiologic Studies. Annals of Epidemiology. 2007, 17 (9): 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed
3.
go back to reference Collins RL, Ellickson PK, Hays RD, McCaffrey DF: Effects of Incentive Size and Timing on Response Rates to a Follow-up Wave of a Longitudinal Mailed Survey. Evaluation Review. 2000, 24 (4): 347-363. 10.1177/0193841X0002400401.CrossRefPubMed Collins RL, Ellickson PK, Hays RD, McCaffrey DF: Effects of Incentive Size and Timing on Response Rates to a Follow-up Wave of a Longitudinal Mailed Survey. Evaluation Review. 2000, 24 (4): 347-363. 10.1177/0193841X0002400401.CrossRefPubMed
4.
go back to reference Wight D, Raab GM, Henderson M, Abraham C, Buston K, Hart G, Scott S: Limits of teacher delivered sex education: interim behavioural outcomes from randomised trial. BMJ. 2002, 324 (7351): 1430-10.1136/bmj.324.7351.1430.CrossRefPubMedPubMedCentral Wight D, Raab GM, Henderson M, Abraham C, Buston K, Hart G, Scott S: Limits of teacher delivered sex education: interim behavioural outcomes from randomised trial. BMJ. 2002, 324 (7351): 1430-10.1136/bmj.324.7351.1430.CrossRefPubMedPubMedCentral
5.
go back to reference Dunn KM, Jordan K, Lacey RJ, Shapley M, Jinks C: Patterns of Consent in Epidemiologic Research: Evidence from Over 25,000 Responders. Am J Epidemiol. 2004, 159 (11): 1087-1094. 10.1093/aje/kwh141.CrossRefPubMed Dunn KM, Jordan K, Lacey RJ, Shapley M, Jinks C: Patterns of Consent in Epidemiologic Research: Evidence from Over 25,000 Responders. Am J Epidemiol. 2004, 159 (11): 1087-1094. 10.1093/aje/kwh141.CrossRefPubMed
6.
go back to reference Eagan TML, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: Predictors and consequences for exposure-disease associations. Journal of Clinical Epidemiology. 2002, 55: 775-781. 10.1016/S0895-4356(02)00431-6.CrossRefPubMed Eagan TML, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: Predictors and consequences for exposure-disease associations. Journal of Clinical Epidemiology. 2002, 55: 775-781. 10.1016/S0895-4356(02)00431-6.CrossRefPubMed
7.
go back to reference Cunradi CB, Moore R, Killoran M, Ames G: Survey Nonresponse Bias Among Young Adults: The Role of Alcohol, Tobacco, and Drugs. Substance Use & Misuse. 2005, 40 (2): 171-185.CrossRef Cunradi CB, Moore R, Killoran M, Ames G: Survey Nonresponse Bias Among Young Adults: The Role of Alcohol, Tobacco, and Drugs. Substance Use & Misuse. 2005, 40 (2): 171-185.CrossRef
8.
go back to reference Hille ETM, Elbertse L, Gravenhorst JB, Brand R, Verloove-Vanhorick SP, on behalf of the Dutch P-CSG: Nonresponse Bias in a Follow-up Study of 19-Year-Old Adolescents Born as Preterm Infants. Pediatrics. 2005, 116 (5): e662-666. 10.1542/peds.2005-0682.CrossRefPubMed Hille ETM, Elbertse L, Gravenhorst JB, Brand R, Verloove-Vanhorick SP, on behalf of the Dutch P-CSG: Nonresponse Bias in a Follow-up Study of 19-Year-Old Adolescents Born as Preterm Infants. Pediatrics. 2005, 116 (5): e662-666. 10.1542/peds.2005-0682.CrossRefPubMed
9.
go back to reference Partin MR, Malone M, Winnett M, Slater J, Bar-Cohen A, Caplan L: The impact of survey nonresponse bias on conclusions drawn from a mammography intervention trial. Journal of Clinical Epidemiology. 2003, 56: 867-873. 10.1016/S0895-4356(03)00061-1.CrossRefPubMed Partin MR, Malone M, Winnett M, Slater J, Bar-Cohen A, Caplan L: The impact of survey nonresponse bias on conclusions drawn from a mammography intervention trial. Journal of Clinical Epidemiology. 2003, 56: 867-873. 10.1016/S0895-4356(03)00061-1.CrossRefPubMed
10.
go back to reference Dillman DA, Sinclair MD, Clark JR: Effects of questionnaire length, respondent-friendly design, and a difficult question on response rates for occupant-addressed census mail surveys. Public Opin Q. 1993, 57: 289-304. 10.1086/269376.CrossRef Dillman DA, Sinclair MD, Clark JR: Effects of questionnaire length, respondent-friendly design, and a difficult question on response rates for occupant-addressed census mail surveys. Public Opin Q. 1993, 57: 289-304. 10.1086/269376.CrossRef
11.
go back to reference Junghans C, Feder G, Hemingway H, Timmis A, Jones M: Recruiting patients to medical research: double blind randomised trial of "opt-in" versus "opt-out" strategies. BMJ. 2005, 331 (7522): 940-10.1136/bmj.38583.625613.AE.CrossRefPubMedPubMedCentral Junghans C, Feder G, Hemingway H, Timmis A, Jones M: Recruiting patients to medical research: double blind randomised trial of "opt-in" versus "opt-out" strategies. BMJ. 2005, 331 (7522): 940-10.1136/bmj.38583.625613.AE.CrossRefPubMedPubMedCentral
12.
go back to reference Etter J-F, Cucherat M, Perneger TV: Questionnaire Color and Response Rates to Mailed Surveys: A Randomizedtrial Anda Meta-Analysis. Eval Health Prof. 2002, 25 (2): 185-199. 10.1177/01678702025002004.CrossRefPubMed Etter J-F, Cucherat M, Perneger TV: Questionnaire Color and Response Rates to Mailed Surveys: A Randomizedtrial Anda Meta-Analysis. Eval Health Prof. 2002, 25 (2): 185-199. 10.1177/01678702025002004.CrossRefPubMed
13.
go back to reference Moss VDaW BR: Do personalization and postage make a difference on response rates to surveys of professional populations. Psychol Rep. 1991, 68: 692-694. 10.2466/PR0.68.2.692-694.CrossRef Moss VDaW BR: Do personalization and postage make a difference on response rates to surveys of professional populations. Psychol Rep. 1991, 68: 692-694. 10.2466/PR0.68.2.692-694.CrossRef
14.
go back to reference Senn CY, Desmarais S, Verberg N, Wood E: Sampling the Reluctant Participant: A Random-Sample Response-Rate Study of Men and Sexual Coercion. Journal of Applied Social Psychology. 2006, 30 (1): 96-105. 10.1111/j.1559-1816.2000.tb02307.x.CrossRef Senn CY, Desmarais S, Verberg N, Wood E: Sampling the Reluctant Participant: A Random-Sample Response-Rate Study of Men and Sexual Coercion. Journal of Applied Social Psychology. 2006, 30 (1): 96-105. 10.1111/j.1559-1816.2000.tb02307.x.CrossRef
15.
go back to reference Bruce T, Salkeld G, Short L, Solomon M, Ward J: A randomised trial of telephone versus postcard prompts to enhance response rate in a phased population-based study about community preferences. Australian and New Zealand Journal of Public Health. 2000, 24 (4): 456-457. 10.1111/j.1467-842X.2000.tb01615.x.CrossRefPubMed Bruce T, Salkeld G, Short L, Solomon M, Ward J: A randomised trial of telephone versus postcard prompts to enhance response rate in a phased population-based study about community preferences. Australian and New Zealand Journal of Public Health. 2000, 24 (4): 456-457. 10.1111/j.1467-842X.2000.tb01615.x.CrossRefPubMed
16.
go back to reference Aadahl M, Jorgensen M: The Effect of Conducting a Lottery on Questionnaire Response Rates: A Randomised Controlled Trial. European Journal of Epidemiology. 2003, 18 (10): 941-944. 10.1023/A:1025826921030.CrossRefPubMed Aadahl M, Jorgensen M: The Effect of Conducting a Lottery on Questionnaire Response Rates: A Randomised Controlled Trial. European Journal of Epidemiology. 2003, 18 (10): 941-944. 10.1023/A:1025826921030.CrossRefPubMed
17.
go back to reference Datta AR, Horrigan MW, Walker JR: Evaluation of a Monetary Incentive Payment Experiment in the National Longitudinal Survey of Youth, 1997 Cohort. Presented at the. 2001, Federal Committee on Statistical Methodology Conference Datta AR, Horrigan MW, Walker JR: Evaluation of a Monetary Incentive Payment Experiment in the National Longitudinal Survey of Youth, 1997 Cohort. Presented at the. 2001, Federal Committee on Statistical Methodology Conference
18.
go back to reference Kalantar JS, Talley NJ: The effects of lottery incentive and length of questionnaire on health survey response rates: a randomised study. Journal of Clinical Epidemiology. 1999, 52 (11): 1117-1122. 10.1016/S0895-4356(99)00051-7.CrossRefPubMed Kalantar JS, Talley NJ: The effects of lottery incentive and length of questionnaire on health survey response rates: a randomised study. Journal of Clinical Epidemiology. 1999, 52 (11): 1117-1122. 10.1016/S0895-4356(99)00051-7.CrossRefPubMed
19.
go back to reference Martinson BC, Lazovitch D, Lando HA, Perry CL, McGovern PG, Boyle RG: Effectiveness of Monetary Incentives for Recruiting Adolescents to an Intervention Trial to Reduce Smoking. Preventative Medicine. 2000, 31: 706-713. 10.1006/pmed.2000.0762.CrossRef Martinson BC, Lazovitch D, Lando HA, Perry CL, McGovern PG, Boyle RG: Effectiveness of Monetary Incentives for Recruiting Adolescents to an Intervention Trial to Reduce Smoking. Preventative Medicine. 2000, 31: 706-713. 10.1006/pmed.2000.0762.CrossRef
20.
go back to reference Roberts PJ, Roberts C, Sibbald B, Torgerson DJ: The effect of a direct payment or lottery on questionnaire response rates: a randomised control trial. Journal of Epidemiology and Community Health. 2000, 54: 71-72. 10.1136/jech.54.1.71.CrossRefPubMedPubMedCentral Roberts PJ, Roberts C, Sibbald B, Torgerson DJ: The effect of a direct payment or lottery on questionnaire response rates: a randomised control trial. Journal of Epidemiology and Community Health. 2000, 54: 71-72. 10.1136/jech.54.1.71.CrossRefPubMedPubMedCentral
21.
go back to reference Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap RW, Kwan I: Increasing response rates to postal questionnaires: systematic review. BMJ. 2002, 324: 1183-1191. 10.1136/bmj.324.7347.1183.CrossRefPubMedPubMedCentral Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap RW, Kwan I: Increasing response rates to postal questionnaires: systematic review. BMJ. 2002, 324: 1183-1191. 10.1136/bmj.324.7347.1183.CrossRefPubMedPubMedCentral
22.
go back to reference Edwards P, Cooper R, Roberts I, Frost C: Meta-analysis of randomised trials of monetary incentives and response to mailed questionnaires. Journal of Epidemiology and Community Health. 2005, 59 (11): 987-999. 10.1136/jech.2005.034397.CrossRefPubMedPubMedCentral Edwards P, Cooper R, Roberts I, Frost C: Meta-analysis of randomised trials of monetary incentives and response to mailed questionnaires. Journal of Epidemiology and Community Health. 2005, 59 (11): 987-999. 10.1136/jech.2005.034397.CrossRefPubMedPubMedCentral
23.
go back to reference Roberts LM, Wilson S, Roalfe A, Bridge P: A Randomised Control Trial to Determine the Effect on Response of Including a Lottery Incentive in Health Surveys. BMC Health Services Research. 2004, 4 (30): Roberts LM, Wilson S, Roalfe A, Bridge P: A Randomised Control Trial to Determine the Effect on Response of Including a Lottery Incentive in Health Surveys. BMC Health Services Research. 2004, 4 (30):
24.
go back to reference Johansson L, Solvoll K, Opdahl SA, Bjorneboe G-E Aa, Drevon CA: Response rates with different distribution methods and reward and reproducibility of a quantitative food frequency questionnaire. European Journal of Clinical Nutrition. 1997, 51 (6): 343-353. 10.1038/sj.ejcn.1600410.CrossRef Johansson L, Solvoll K, Opdahl SA, Bjorneboe G-E Aa, Drevon CA: Response rates with different distribution methods and reward and reproducibility of a quantitative food frequency questionnaire. European Journal of Clinical Nutrition. 1997, 51 (6): 343-353. 10.1038/sj.ejcn.1600410.CrossRef
25.
go back to reference Henderson M, Wight D, Raab G, Abraham C, Buston K, Hart G, Scott S: Heterosexual risk behaviour among young teenagers in Scotland. Journal of Adolescence. 2002, 25: 483-494. 10.1006/jado.2002.0493.CrossRefPubMed Henderson M, Wight D, Raab G, Abraham C, Buston K, Hart G, Scott S: Heterosexual risk behaviour among young teenagers in Scotland. Journal of Adolescence. 2002, 25: 483-494. 10.1006/jado.2002.0493.CrossRefPubMed
26.
go back to reference Henderson M, Ecob R DW, Abraham C: What explains between-school differences in rates of smoking?. BMC Public Health. 2008, 8: 218-10.1186/1471-2458-8-218.CrossRefPubMedPubMedCentral Henderson M, Ecob R DW, Abraham C: What explains between-school differences in rates of smoking?. BMC Public Health. 2008, 8: 218-10.1186/1471-2458-8-218.CrossRefPubMedPubMedCentral
27.
go back to reference Parkes A, Henderson M, Wight D: Do sexual health services encourage teenagers to use condoms? A longitudinal study. Journal of Family Planning and Reproductive Health Care. 2005, 31 (4): 271-280.CrossRefPubMed Parkes A, Henderson M, Wight D: Do sexual health services encourage teenagers to use condoms? A longitudinal study. Journal of Family Planning and Reproductive Health Care. 2005, 31 (4): 271-280.CrossRefPubMed
Metadata
Title
Retaining young people in a longitudinal sexual health survey: a trial of strategies to maintain participation
Publication date
01-12-2010
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-9

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue