Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study

Authors: Shengchao Yu, Howard E. Alper, Angela-Maithy Nguyen, Robert M. Brackbill, Lennon Turner, Deborah J. Walker, Carey B. Maslow, Kimberly C. Zweig

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Achieving adequate response rates is an ongoing challenge for longitudinal studies. The World Trade Center Health Registry is a longitudinal health study that periodically surveys a cohort of ~71,000 people exposed to the 9/11 terrorist attacks in New York City. Since Wave 1, the Registry has conducted three follow-up surveys (Waves 2–4) every 3–4 years and utilized various strategies to increase survey participation. A promised monetary incentive was offered for the first time to survey non-respondents in the recent Wave 4 survey, conducted 13–14 years after 9/11.

Methods

We evaluated the effectiveness of a monetary incentive in improving the response rate five months after survey launch, and assessed whether or not response completeness was compromised due to incentive use. The study compared the likelihood of returning a survey for those who received an incentive offer to those who did not, using logistic regression models. Among those who returned surveys, we also examined whether those receiving an incentive notification had higher rate of response completeness than those who did not, using negative binomial regression models and logistic regression models.

Results

We found that a $10 monetary incentive offer was effective in increasing Wave 4 response rates. Specifically, the $10 incentive offer was useful in encouraging initially reluctant participants to respond to the survey. The likelihood of returning a survey increased by 30% for those who received an incentive offer (AOR = 1.3, 95% CI: 1.1, 1.4), and the incentive increased the number of returned surveys by 18%. Moreover, our results did not reveal any significant differences on response completeness between those who received an incentive offer and those who did not.

Conclusions

In the face of the growing challenge of maintaining a high response rate for the World Trade Center Health Registry follow-up surveys, this study showed the value of offering a monetary incentive as an additional refusal conversion strategy. Our findings also suggest that an incentive offer could be particularly useful near the end of data collection period when an immediate boost in response rate is needed.
Literature
1.
go back to reference Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRefPubMed Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRefPubMed
2.
go back to reference Singer E, Groves RM, Corning AD. Differential incentives: beliefs about practices, perceptions of equity, and effects on survey participation. Public Opin Q. 1999;63(2):251–60.CrossRef Singer E, Groves RM, Corning AD. Differential incentives: beliefs about practices, perceptions of equity, and effects on survey participation. Public Opin Q. 1999;63(2):251–60.CrossRef
3.
go back to reference Singer E, Couper MP. Do incentives exert undue influence on survey participation? Experimental evidence. J Empir Res Hum Res Ethics. 2008;3(3):49–56.CrossRefPubMedPubMedCentral Singer E, Couper MP. Do incentives exert undue influence on survey participation? Experimental evidence. J Empir Res Hum Res Ethics. 2008;3(3):49–56.CrossRefPubMedPubMedCentral
4.
go back to reference Beebe TJ, Jenkins SM, Anderson KJ, Davern ME. Survey-related experiential and attitudinal correlates of future health survey participation: results of a statewide survey. Mayo Clin Proc. 2008;83(12):1358–63.CrossRefPubMed Beebe TJ, Jenkins SM, Anderson KJ, Davern ME. Survey-related experiential and attitudinal correlates of future health survey participation: results of a statewide survey. Mayo Clin Proc. 2008;83(12):1358–63.CrossRefPubMed
5.
go back to reference Kanuk L, Berenson C. Mail surveys and response rates: a literature review. J Mark Res. 1975;12(4):440–53.CrossRef Kanuk L, Berenson C. Mail surveys and response rates: a literature review. J Mark Res. 1975;12(4):440–53.CrossRef
6.
go back to reference Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183.CrossRefPubMedPubMedCentral Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183.CrossRefPubMedPubMedCentral
7.
go back to reference Hardy P, Bell JL, Brocklehurst P. Evaluation of the effects of an offer of a monetary incentive on the rate of questionnaire return during follow-up of a clinical trial: a randomised study within a trial. BMC Med Res Methodol. 2016;16(1):82.CrossRefPubMedPubMedCentral Hardy P, Bell JL, Brocklehurst P. Evaluation of the effects of an offer of a monetary incentive on the rate of questionnaire return during follow-up of a clinical trial: a randomised study within a trial. BMC Med Res Methodol. 2016;16(1):82.CrossRefPubMedPubMedCentral
8.
go back to reference Church AH. Estimating the effect of incentives on mail survey response rates: a meta-analysis. Public Opin Q. 1993;57(1):62–79.CrossRef Church AH. Estimating the effect of incentives on mail survey response rates: a meta-analysis. Public Opin Q. 1993;57(1):62–79.CrossRef
9.
go back to reference Armstrong JS. Monetary incentives in mail surveys. Public Opin Q. 1975;39(1):111–6.CrossRef Armstrong JS. Monetary incentives in mail surveys. Public Opin Q. 1975;39(1):111–6.CrossRef
10.
go back to reference Göritz AS. Incentive effects. In: Improving survey methods: lessons from recent research. London: Taylor & Francis; 2014. p. 339–50. Göritz AS. Incentive effects. In: Improving survey methods: lessons from recent research. London: Taylor & Francis; 2014. p. 339–50.
11.
go back to reference Knoll M, Soller L, Ben-Shoshan M, Harrington D, Fragapane J, Joseph L, et al. The use of incentives in vulnerable populations for a telephone survey: a randomized controlled trial. BMC Res Notes. 2012;5:572.CrossRefPubMedPubMedCentral Knoll M, Soller L, Ben-Shoshan M, Harrington D, Fragapane J, Joseph L, et al. The use of incentives in vulnerable populations for a telephone survey: a randomized controlled trial. BMC Res Notes. 2012;5:572.CrossRefPubMedPubMedCentral
12.
go back to reference Shaw MJ, Beebe TJ, Jensen HL, Adlis SA. The use of monetary incentives in a community survey: impact on response rates, data quality, and cost. Health Serv Res. 2001;35(6):1339.PubMedPubMedCentral Shaw MJ, Beebe TJ, Jensen HL, Adlis SA. The use of monetary incentives in a community survey: impact on response rates, data quality, and cost. Health Serv Res. 2001;35(6):1339.PubMedPubMedCentral
13.
go back to reference Singer E, Ye C. The use and effects of incentives in surveys. Ann Am Acad Pol Soc Sci. 2013;645(1):112–41.CrossRef Singer E, Ye C. The use and effects of incentives in surveys. Ann Am Acad Pol Soc Sci. 2013;645(1):112–41.CrossRef
14.
go back to reference Göritz AS. Incentives in web studies: methodological issues and a review. Int J Internet Sci. 2006;1(1):58–70. Göritz AS. Incentives in web studies: methodological issues and a review. Int J Internet Sci. 2006;1(1):58–70.
15.
go back to reference Coughlin SS, Aliaga P, Barth S, Eber S, Maillard J, Mahan C, Williams M. The effectiveness of a monetary incentive on response rates in a survey of recent US veterans. Survey Pract. 2011;4(1). Coughlin SS, Aliaga P, Barth S, Eber S, Maillard J, Mahan C, Williams M. The effectiveness of a monetary incentive on response rates in a survey of recent US veterans. Survey Pract. 2011;4(1).
Metadata
Title
The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study
Authors
Shengchao Yu
Howard E. Alper
Angela-Maithy Nguyen
Robert M. Brackbill
Lennon Turner
Deborah J. Walker
Carey B. Maslow
Kimberly C. Zweig
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0353-1

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue