Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

Improving response rate and quality of survey data with a scratch lottery ticket incentive

Authors: Frank Olsen, Birgit Abelsen, Jan Abel Olsen

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

The quality of data collected in survey research is usually indicated by the response rate; the representativeness of the sample, and; the rate of completed questions (item-response). In attempting to improve a generally declining response rate in surveys considerable efforts are being made through follow-up mailings and various types of incentives. This study examines effects of including a scratch lottery ticket in the invitation letter to a survey.

Method

Questionnaires concerning oral health were mailed to a random sample of 2,400 adults. A systematically selected half of the sample (1,200 adults) received a questionnaire including a scratch lottery ticket. One reminder without the incentive was sent.

Results

The incentive increased the response rate and improved representativeness by reaching more respondents with lower education. Furthermore, it reduced item nonresponse. The initial incentive had no effect on the propensity to respond after the reminder.

Conclusion

When attempting to improve survey data, three issues become important: response rate, representativeness, and item-response. This study shows that including a scratch lottery ticket in the invitation letter performs well on all the three.
Literature
1.
Groves M: Nonresponse rates and nonresponse bias in household surveys. Int J of Public Opin R. 2006, 70: 646-675.CrossRef
2.
Arzheimer K, Klein M: The effect of material incentives on the return rate, the panel attrition and the sample composition of a mail panel survey – results of an empirical experiment. Int J of Public Opin R. 1999, 11: 366-375.
3.
Larson P, Chow G: Total cost/response rate trade-offs in mail survey research: impact of follow-up mailings and monetary incentives. Ind Market Manag. 2001, 32: 533-537.CrossRef
4.
Singer E: Nonresponse bias in houshold surveys. Public Opin Quart. 2006, 70: 637-654. 10.1093/poq/nfl034.CrossRef
5.
Curtin R, Presser S, Singer E: Changes in telephone survey nonresponse over the past quarter century. Public Opin Quart. 2005, 69: 87-98. 10.1093/poq/nfi002.CrossRef
6.
de Leeuw E, de Heer W: Trends in household survey nonresponse: A longitudinal and international comparition. In Survey Nonresponse. Edited by: Groves R, Dillman D, Eltinge J, Little R. 2002, Wiley, New York
7.
Ryu E, Couper M, Marans R: Survey incentives: Cash vs in-kind; face-to-face vs mail; response rate vs nonresponse error. Int J of Public Opin R. 2005, 18: 89-106.CrossRef
8.
Shettle C, Mooney G: Monetary incentives in U.S. government surveys. J Off Stat. 1999, 15: 231-250.
9.
Singer E, van Hoewyk J, Gebler N, Raughunathan T, McGonagle K: The effect of incentives on response rates in interviewer-mediated surveys. J Off Stat. 1999, 15: 217-230.
10.
Teisl M, Roe B, Vayda M: Incentive effects on response rates, data quality, and survey administration costs. Int J of Public Opin R. 2005, 18: 364-373.CrossRef
11.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Wentz R, Kwan I, Cooper R, Felix L, Pratap M: Methods to increase response to postal and electronic questionnaires (Review). 2009, Cohrane Database of systematic Reviews
12.
Singer E, van Hoewyk J, Maher M: Experiments with incentives in telephone survey. Public Opin Quart. 2000, 64: 171-188. 10.1086/317761.CrossRef
13.
Singer E: In Survey Nonresponse. Edited by: Groves R, Dillman D, Eltinge J, Little R. 2002, John Wiley & Sons, New York, The use of incentives to reduce nonresponse in household surveys
14.
Church A: Estimating the Effect of Incentives on Mail Survey Response Rates: A Meta-Analysis. Public Opin Quart. 1993, 57: 62-79. 10.1086/269355.CrossRef
15.
Jobber D, Saunders J, Mitchell V: Prepaid monetary incentive effects on mail survey response. J B Res. 2004, 57: 21-25. 10.1016/S0148-2963(02)00280-1.CrossRef
16.
James J, Bolstein R: The effect of monetary incentives and follow-up mailings on the response rate and response quality in mail surveys. Public Opin Quart. 1990, 56: 346-361.CrossRef
17.
Harris I, Khoo O, Young J, Solomon M, Rae H: Lottery incentives did not improve response rate to a mailed survey: a randomized controlled trial. Journal of Clinical Epidemiology. 2008, 61: 609-610. 10.1016/j.jclinepi.2007.07.012.CrossRefPubMed
18.
Finsen V, Storeheier A: Scratch lottery tickets are a poor incentive to respond to mail questionnaires. BMC Med Res Methodol. 2006, 6: 1-5. 10.1186/1471-2288-6-1.CrossRef
19.
Kalantar J, Talley N: The effects of lottery incentive and length of questionnaire on health survey response rates: a randomized study. Journal of Clinical Epidemiology. 1999, 52: 1117-1122. 10.1016/S0895-4356(99)00051-7.CrossRefPubMed
20.
Robertson J, Walkom E, McGettigan P: Response rates and representativeness: a lottery incentive improves physician survey return rates. Pharmacoepidemiology and Drug Safety. 2005, 14: 571-577. 10.1002/pds.1126.CrossRefPubMed
21.
Leung G, Ho L, Chan M, Johnston J, Wong F: The effects of cash and lottery incentives on mailed surveys to physicians A randomized trial. Journal of Clinical Epidemiology. 2002, 55: 801-807. 10.1016/S0895-4356(02)00442-0.CrossRefPubMed
22.
Roberts L, Wilson S, Roalfe A, Bridge P: A randomised controlled trial to determine the effect on response of including a lottery incentive in health surveys. BMC Health Services Research. 2004, 4: 30-10.1186/1472-6963-4-30.CrossRefPubMedPubMedCentral
23.
Halpern S, Kohn R, Dornbrand-Lo A, Asch D, Volpp K: Lottery-Based versus Fixed Incentives to Increase Clinicians' Response to Surveys. Health Services Research. 2011, doi:10.1111/j.1475-6773.2011.01264.x.
24.
Moses S, Clark T: Effect of prize draw incentive on the response rate to a postal survey of obstetricians and gynaecologists: a randomised controlled trial. BMC Health Services Research. 2004, 4: 14-10.1186/1472-6963-4-14.CrossRefPubMedPubMedCentral
25.
Aadahl M, Jørgensen T: The effect on conducting a lottery on questionnaire response rates: a randomised controlled trial. European Journal of epidemiology. 2003, 18: 941-944.CrossRefPubMed
26.
Deutskens E, de Ruyters K, Wetzels M, Oosterveld P: Response rate and response quality of internet-based surveys: An experimental study . Marketing Letters. 2004, 15: 21-36.CrossRef
27.
Göritz A: The impact of material incentives on response quantity, response quality, sample composition, survey outcome, and cost in online access panels. International Journal of Market Research. 2004, 46: 327-345.
28.
Bonke J, Fallesen P: The impact of incentives and interview methods on response quantity and quality in diary- and booklet-based surveys. Survey Research Methods. 2010, 4: 91-101.
29.
Johansson L, Solvoll K, Opdahl S, Bjorneboe G-E, Drevon C: Response rates with different distribution methods and reward, and reproducibility of a quantitative food frequency questionnaire. European. European Journal of Clinical Nutrition. 1997, 51: 346-353. 10.1038/sj.ejcn.1600410.CrossRef
30.
Martinson B, Lazovich D, Lando H, Perry C, McGovern P, Boyle R: Effectiveness of monetary incentives for recruiting adolescents to an intervention trial to reduce smoking. Preventive Medicine. 2000, 31: 706-713. 10.1006/pmed.2000.0762.CrossRefPubMed
31.
McLaren B, Shelley J: Response rates of Victorian general practitioners to a mailed survey on miscarriage: randomised trial of a prize and two forms of introduction to the research. Australian and New Zealand Journal of Public Health. 2000, 24: 360-364. 10.1111/j.1467-842X.2000.tb01593.x.CrossRefPubMed
32.
Blythe B: Increasing mailed survey responses with a lottery. Social Work Research Abstracts. 1986, 22: 18-19.CrossRef
33.
Tjerbo T, Kværner K, Botten G, Aasland O: Use of incentives to enhance response rates in questionnaire surveys. Tidsskr Norske Laege. 2005, 125: 2496-2497.
34.
Whiteman M, Langenberg P, Kjerulff K, McCarter R, Flaws J: A randomized trial of incentives to improve response rates to a mailed women's health questionnaire. Journal of Women's Health. 2003, 12: 821-828. 10.1089/154099903322447783.CrossRefPubMed
35.
Øren A, Bakken I: Gambling and gambling problems i Norway. 2007, SINTEF, Trondheim
36.
Martin E, Abreu D, Winters F: Money and motive: effects of incentives on panel attrition in the survey of income and program participation. J Off Stat. 2001, 17: 276-284.
37.
Willimack D, Schuman H, Pennel B, Lepkowski J: Effects of a Prepaid Non-Monetary Incentive on Response Rates and Response Quality in a Face-to-Face Survey. Public Opin Quart. 1995, 96: 1541-1545.
38.
Gouldner A: The norm of reciprocity: a preliminary statement. Am Soc Rev. 1960, 25: 161-178. 10.2307/2092623.CrossRef
Metadata
Title
Improving response rate and quality of survey data with a scratch lottery ticket incentive
Authors
Frank Olsen
Birgit Abelsen
Jan Abel Olsen
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-52

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue

Research article

The use of continuous data versus binary data in MTC models: A case study in rheumatoid arthritis

Research article

Internet trials: participant experiences and perspectives

Correspondence

Intervention dose estimation in health promotion programmes: a framework and a tool. Application to the diet and physical activity promotion PRALIMAP trial

Technical advance

Statistical adjustment of genotyping error in a case–control study of childhood leukaemia

Correspondence

Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ

Research article

Method for appraising model validity of randomised controlled trials of homeopathic treatment: multi-rater concordance study