Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

The effect of two lottery-style incentives on response rates to postal questionnaires in a prospective cohort study in preschool children at high risk of asthma: a randomized trial

Authors: Lonneke B van der Mark, Karina E van Wonderen, Jacob Mohrs, Patrick JE Bindels, Milo A Puhan, Gerben ter Riet

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

In research with long-term follow-up and repeated measurements, quick and complete response to questionnaires helps ensure a study’s validity, precision and efficiency. Evidence on the effect of non-monetary incentives on response rates in observational longitudinal research is scarce.

Objectives

To study the impact of two strategies to enhance completeness and efficiency in observational cohort studies with follow-up durations of around 2 years.

Method and intervention

In a factorial design, 771 children between 2 and 5 years old and their parents participating in a prospective cohort study were randomized to three intervention groups and a control group. Three types of lotteries were run: (i) daytrip tickets for the whole family to a popular amusement park if they returned all postal questionnaires, (ii) €12.50-worth gift vouchers for sending back the questionnaire on time after each questionnaire round and (iii) a combination of (i) and (ii).

Main outcome measures

Primary outcome was the proportion of participants who returned all questionnaires without any reminder. Secondary outcomes were ‘100% returned with or without reminder’, ‘probability of 100% non-response’, ‘probability of withdrawal’, ‘proportion of returned questionnaires’ and ‘overall number of reminders sent’.

Statistical analysis

After testing for interaction between the two lottery interventions, the two trials were analysed separately. We calculated risk differences (RD) and numbers needed to “treat” and their 95% confidence intervals.

Results

Daytrip nor voucher intervention had an effect on the proportion of participants who returned all questionnaires (RD −0.01; 95% CI-0.07 – 0.06) and (RD 0.02; 95% CI-0.50 – 0.08), respectively. No effects were found on the secondary outcomes.

Conclusion

Our findings do not support the idea that lottery-style incentives lead to more complete response to postal questionnaires in observational cohort studies with repeated data collection and follow-up durations of around 2 years.
Appendix
Available only for authorised users
Literature
1.
go back to reference Booker CL, Harding S, Benzeval M: A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011, 11: 249-10.1186/1471-2458-11-249.CrossRefPubMedPubMedCentral Booker CL, Harding S, Benzeval M: A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011, 11: 249-10.1186/1471-2458-11-249.CrossRefPubMedPubMedCentral
2.
go back to reference Doody MM, Sigurdson AS, Kampa D, Chimes K, Alexander BH, Ron E, et al: Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire. Am J Epidemiol. 2003, 157 (7): 643-651. 10.1093/aje/kwg033.CrossRefPubMed Doody MM, Sigurdson AS, Kampa D, Chimes K, Alexander BH, Ron E, et al: Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire. Am J Epidemiol. 2003, 157 (7): 643-651. 10.1093/aje/kwg033.CrossRefPubMed
3.
go back to reference White E, Carney PA, Kolar AS: Increasing response to mailed questionnaires by including a pencil/pen. Am J Epidemiol. 2005, 162 (3): 261-266. 10.1093/aje/kwi194.CrossRefPubMed White E, Carney PA, Kolar AS: Increasing response to mailed questionnaires by including a pencil/pen. Am J Epidemiol. 2005, 162 (3): 261-266. 10.1093/aje/kwi194.CrossRefPubMed
4.
go back to reference van Wonderen KE, van der Mark LB, Mohrs J, Geskus RB, van der Wal WM, van Aalderen WM, et al: Prediction and treatment of asthma in preschool children at risk: study design and baseline data of a prospective cohort study in general practice (ARCADE). BMC Pulm Med. 2009, 9: 13-10.1186/1471-2466-9-13.CrossRefPubMedPubMedCentral van Wonderen KE, van der Mark LB, Mohrs J, Geskus RB, van der Wal WM, van Aalderen WM, et al: Prediction and treatment of asthma in preschool children at risk: study design and baseline data of a prospective cohort study in general practice (ARCADE). BMC Pulm Med. 2009, 9: 13-10.1186/1471-2466-9-13.CrossRefPubMedPubMedCentral
5.
go back to reference White IR, Royston P, Wood AM: Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011, 30 (4): 377-399. 10.1002/sim.4067.CrossRefPubMed White IR, Royston P, Wood AM: Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011, 30 (4): 377-399. 10.1002/sim.4067.CrossRefPubMed
7.
go back to reference Montgomery AA, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Methodol. 2003, 3: 26-10.1186/1471-2288-3-26.CrossRefPubMedPubMedCentral Montgomery AA, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Methodol. 2003, 3: 26-10.1186/1471-2288-3-26.CrossRefPubMedPubMedCentral
8.
go back to reference Goodman SN: p values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. Am J Epidemiol. 1993, 137 (5): 485-496.PubMed Goodman SN: p values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. Am J Epidemiol. 1993, 137 (5): 485-496.PubMed
9.
go back to reference Goodman SN: Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med. 1999, 130 (12): 995-1004.CrossRefPubMed Goodman SN: Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med. 1999, 130 (12): 995-1004.CrossRefPubMed
10.
go back to reference Mcgrayne S: The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy. 2011, Yale University Press,   Mcgrayne S: The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy. 2011, Yale University Press,  
13.
go back to reference Halpern SD, Kohn R, Dornbrand-Lo A, Metkus T, Asch DA, Volpp KG: Lottery-based versus fixed incentives to increase clinicians' response to surveys. Health Serv Res. 2011, 46 (5): 1663-1674. 10.1111/j.1475-6773.2011.01264.x.CrossRefPubMedPubMedCentral Halpern SD, Kohn R, Dornbrand-Lo A, Metkus T, Asch DA, Volpp KG: Lottery-based versus fixed incentives to increase clinicians' response to surveys. Health Serv Res. 2011, 46 (5): 1663-1674. 10.1111/j.1475-6773.2011.01264.x.CrossRefPubMedPubMedCentral
Metadata
Title
The effect of two lottery-style incentives on response rates to postal questionnaires in a prospective cohort study in preschool children at high risk of asthma: a randomized trial
Authors
Lonneke B van der Mark
Karina E van Wonderen
Jacob Mohrs
Patrick JE Bindels
Milo A Puhan
Gerben ter Riet
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-186

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue