Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Effect of prepaid and promised financial incentive on follow-up survey response in cigarette smokers: a randomized controlled trial

Authors: Yee Tak Derek Cheung, Xue Weng, Man Ping Wang, Sai Yin Ho, Antonio Cho Shing Kwong, Vienna Wai Yin Lai, Tai Hing Lam

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Monetary incentive is often used to increase response rate in smokers’ survey, but such effect of prepaid and promised incentives in a follow-up survey is unknown. We compared the effect of different incentive schemes on the consent and retention rates in a follow-up survey of adult cigarette smokers.

Methods

This was a randomized controlled trial (RCT) in Hong Kong, China. Smokers who completed a non-incentivized baseline telephone smoking survey were invited to a 3-month follow-up, with randomization into (1) the control group (no incentive), (2) a promised HK$100 (US$12.8) incentive upon completion, (3) a promised HK$200 (US$25.6) incentive upon completion, or (4) a prepaid HK$100 incentive plus another promised HK$100 incentive (“mixed incentive”). Crude risk ratios from log-binomial regression models were used to assess if the 3 incentive schemes predicted higher rates of consent at baseline or retention at 3-month than no incentive.

Results

In total, 1246 smokers were enrolled. The overall consent and retention rates were 37.1 and 23.0%, respectively. Both rates generally increased with the incentive amount and offer of prepaid incentive. The mixed incentive scheme marginally increased the retention rate versus no incentive (26.8% vs 20.3%; risk ratio (RR) = 1.32; 95% CI: 1.00–1.76; P = 0.053), but not the consent rate (RR = 1.13; 95% CI: 0.93–1.38; P = 0.22). Among the consented participants, approximately 50% in the mixed incentive group received the mailed prepaid incentive, who achieved a higher retention rate than the group without incentives (82.8% vs 56.1%; RR = 1.48; 95% CI: 1.21–1.80; P < 0.01).

Conclusion

The mixed incentive scheme combining the prepaid and promised incentive was effective to increase the follow-up retention rate by 48%. We recommend this mixed incentive scheme to increase the follow-up retention rate. More efficient methods of delivering the incentive are needed to maximize its effects.

Trial registration

U.S. Clinical Trials registry (clinicaltrials.gov, retrospectively registered, reference number: NCT03297866).
Literature
1.
go back to reference Kempf AM, Remington PL. New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health. 2007;28(1):113–26.CrossRef Kempf AM, Remington PL. New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health. 2007;28(1):113–26.CrossRef
2.
go back to reference Tuckel P, O'Neill H. The vanishing respondent in telephone surveys. J Advert Res. 2002;42(5):26–48.CrossRef Tuckel P, O'Neill H. The vanishing respondent in telephone surveys. J Advert Res. 2002;42(5):26–48.CrossRef
3.
go back to reference Peytchev A, Carley-Baxter LR, Black MC. Multiple sources of nonobservation error in telephone surveys: coverage and nonresponse. Sociol Methods Res. 2011;40(1):138–68.CrossRef Peytchev A, Carley-Baxter LR, Black MC. Multiple sources of nonobservation error in telephone surveys: coverage and nonresponse. Sociol Methods Res. 2011;40(1):138–68.CrossRef
4.
go back to reference Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRef Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRef
5.
go back to reference Groves RM. Survey errors and survey costs. Hoboken, NJ, US: John Wiley & Sons Inc 2004. Groves RM. Survey errors and survey costs. Hoboken, NJ, US: John Wiley & Sons Inc 2004.
6.
go back to reference Centers for Disease Control and Prevention. 2012–2013 National Adult Tobacco Survey: sample design and methodology summary. 2015. Centers for Disease Control and Prevention. 2012–2013 National Adult Tobacco Survey: sample design and methodology summary. 2015.
7.
go back to reference Centers for Disease Control and Prevention. 2013-2014 National Adult Tobacco Survey: Sample Design and Methodology Report. 2016. Centers for Disease Control and Prevention. 2013-2014 National Adult Tobacco Survey: Sample Design and Methodology Report. 2016.
8.
go back to reference Thompson ME, Fong GT, Hammond D, et al. Methods of the international tobacco control (ITC) four country survey. Tob Control 2006;15 Suppl 3(Suppl 3):iii12-iii18.CrossRef Thompson ME, Fong GT, Hammond D, et al. Methods of the international tobacco control (ITC) four country survey. Tob Control 2006;15 Suppl 3(Suppl 3):iii12-iii18.CrossRef
9.
go back to reference Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–75.CrossRef Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–75.CrossRef
10.
go back to reference Studer J, Baggio S, Mohler-Kuo M, et al. Examining non-response bias in substance use research—are late respondents proxies for non-respondents? Drug Alcohol Depend. 2013;132(1):316–23.CrossRef Studer J, Baggio S, Mohler-Kuo M, et al. Examining non-response bias in substance use research—are late respondents proxies for non-respondents? Drug Alcohol Depend. 2013;132(1):316–23.CrossRef
11.
go back to reference Zhao J, Stockwell T, Macdonald S. Non–response bias in alcohol and drug population surveys. Drug and Alcohol Review. 2009;28(6):648–57.CrossRef Zhao J, Stockwell T, Macdonald S. Non–response bias in alcohol and drug population surveys. Drug and Alcohol Review. 2009;28(6):648–57.CrossRef
12.
go back to reference Woodruff SI, Conway TL, Edwards CC. Increasing response rates to a smoking survey for US navy enlisted women. Evaluation & the Health Professions. 2000;23(2):172–81.CrossRef Woodruff SI, Conway TL, Edwards CC. Increasing response rates to a smoking survey for US navy enlisted women. Evaluation & the Health Professions. 2000;23(2):172–81.CrossRef
13.
go back to reference Keating NL, Zaslavsky AM, Goldstein J, et al. Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Med Care. 2008;46(8):878–81.CrossRef Keating NL, Zaslavsky AM, Goldstein J, et al. Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Med Care. 2008;46(8):878–81.CrossRef
14.
go back to reference Halpern SD, Ubel PA, Berlin JA, et al. Randomized trial of 5 dollars versus 10 dollars monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Med Care. 2002;40(9):834–9.CrossRef Halpern SD, Ubel PA, Berlin JA, et al. Randomized trial of 5 dollars versus 10 dollars monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Med Care. 2002;40(9):834–9.CrossRef
15.
go back to reference Leung GM, Johnston JM, Saing H, et al. Prepayment was superior to postpayment cash incentives in a randomized postal survey among physicians. J Clin Epidemiol. 2004;57(8):777–84.CrossRef Leung GM, Johnston JM, Saing H, et al. Prepayment was superior to postpayment cash incentives in a randomized postal survey among physicians. J Clin Epidemiol. 2004;57(8):777–84.CrossRef
16.
go back to reference Church AH. Estimating the effects of incentives on mail response rates: a meta-analysis. Public Opin Q. 1993;57(1):62–79.CrossRef Church AH. Estimating the effects of incentives on mail response rates: a meta-analysis. Public Opin Q. 1993;57(1):62–79.CrossRef
17.
go back to reference Pforr K, Blohm M, Blom AG, et al. Are incentive effects on response rates and nonresponse bias in large-scale, face-to-face surveys generalizable to Germany? Evidence from ten experiments. Public Opin Q. 2015;79(3):740–68.CrossRef Pforr K, Blohm M, Blom AG, et al. Are incentive effects on response rates and nonresponse bias in large-scale, face-to-face surveys generalizable to Germany? Evidence from ten experiments. Public Opin Q. 2015;79(3):740–68.CrossRef
18.
go back to reference Singer E, Van Hoewyk J, Maher MP. Experiments with incentives in telephone surveys. Public Opin Q. 2000;64(2):171–88.CrossRef Singer E, Van Hoewyk J, Maher MP. Experiments with incentives in telephone surveys. Public Opin Q. 2000;64(2):171–88.CrossRef
19.
go back to reference Groves RM, Cialdini RB, Couper MP. Understanding the decision to participate in a survey. Public Opin Q. 1992;56(4):475–95.CrossRef Groves RM, Cialdini RB, Couper MP. Understanding the decision to participate in a survey. Public Opin Q. 1992;56(4):475–95.CrossRef
20.
go back to reference Dillman DA, Smyth JD, Christian LM. Internet, mail, and mixed-mode surveys: the tailored design method, 3rd ed. Hoboken, NJ, US: John Wiley & Sons Inc 2009. Dillman DA, Smyth JD, Christian LM. Internet, mail, and mixed-mode surveys: the tailored design method, 3rd ed. Hoboken, NJ, US: John Wiley & Sons Inc 2009.
21.
go back to reference O'Donoghue T, Rabin M. Doing it now or later. Am Econ Rev. 1999;89(1):103–24.CrossRef O'Donoghue T, Rabin M. Doing it now or later. Am Econ Rev. 1999;89(1):103–24.CrossRef
22.
go back to reference Berns GS, Laibson D, Loewenstein G. Intertemporal choice – toward an integrative framework. Trends Cogn Sci. 2007;11(11):482–8.CrossRef Berns GS, Laibson D, Loewenstein G. Intertemporal choice – toward an integrative framework. Trends Cogn Sci. 2007;11(11):482–8.CrossRef
23.
go back to reference Hand DJ, Heil SH, Sigmon SC, et al. Improving medicaid health incentives programs: lessons from substance abuse treatment research. Prev Med. 2014;63:87–9.CrossRef Hand DJ, Heil SH, Sigmon SC, et al. Improving medicaid health incentives programs: lessons from substance abuse treatment research. Prev Med. 2014;63:87–9.CrossRef
24.
go back to reference Cheung DYT, Wang MP, Ho SY, et al. Report on tobacco control policy-related survey 2017. Hong Kong SAR: Hong Kong Council on Smoking and Health; 2018. Cheung DYT, Wang MP, Ho SY, et al. Report on tobacco control policy-related survey 2017. Hong Kong SAR: Hong Kong Council on Smoking and Health; 2018.
25.
go back to reference Census and Statistics Department. Thematic household survey, Report No.64: Pattern of Smoking. Hong Kong SAR: Hong Kong SAR Government 2018. Census and Statistics Department. Thematic household survey, Report No.64: Pattern of Smoking. Hong Kong SAR: Hong Kong SAR Government 2018.
26.
go back to reference Leung D, Chan S, Lam T. Prevalence and characteristics of hardcore smokers in Hong Kong. Hong Kong Med J. 2017;23(3 Supplement 2):4–9.PubMed Leung D, Chan S, Lam T. Prevalence and characteristics of hardcore smokers in Hong Kong. Hong Kong Med J. 2017;23(3 Supplement 2):4–9.PubMed
27.
go back to reference Leung DYP, Chan SSC, Chan V, et al. Hardcore smoking after comprehensive smoke-free legislation and health warnings on cigarette packets in Hong Kong. Public Health. 2016;132:50–6.CrossRef Leung DYP, Chan SSC, Chan V, et al. Hardcore smoking after comprehensive smoke-free legislation and health warnings on cigarette packets in Hong Kong. Public Health. 2016;132:50–6.CrossRef
28.
go back to reference Cheung YTD, Wang MP, Ho SY, et al. Public support for electronic cigarette regulation in Hong Kong: a population-based cross-sectional study. Int J Environ Res Public Health. 2017;14(7):709.CrossRef Cheung YTD, Wang MP, Ho SY, et al. Public support for electronic cigarette regulation in Hong Kong: a population-based cross-sectional study. Int J Environ Res Public Health. 2017;14(7):709.CrossRef
29.
go back to reference Cheung YTD, Ho SY, Wang MP, et al. Pro-smoking responses and attitudes due to point-of-sale tobacco displays in never smokers: a cross-sectional study in Hong Kong. Tob Induc Dis 2018;16(July):32. Cheung YTD, Ho SY, Wang MP, et al. Pro-smoking responses and attitudes due to point-of-sale tobacco displays in never smokers: a cross-sectional study in Hong Kong. Tob Induc Dis 2018;16(July):32.
30.
go back to reference Olsen F, Abelsen B, Olsen JA. Improving response rate and quality of survey data with a scratch lottery ticket incentive. BMC Med Res Methodol. 2012;12(1):52.CrossRef Olsen F, Abelsen B, Olsen JA. Improving response rate and quality of survey data with a scratch lottery ticket incentive. BMC Med Res Methodol. 2012;12(1):52.CrossRef
31.
go back to reference Guo Y, Kopec JA, Cibere J, et al. Population survey features and response rates: a randomized experiment. Am J Public Health. 2016;106(8):1422–6.CrossRef Guo Y, Kopec JA, Cibere J, et al. Population survey features and response rates: a randomized experiment. Am J Public Health. 2016;106(8):1422–6.CrossRef
32.
go back to reference Gajic A, Cameron D, Hurley J. The cost-effectiveness of cash versus lottery incentives for a web-based, stated-preference community survey. Eur J Health Econ. 2012;13(6):789–99.CrossRef Gajic A, Cameron D, Hurley J. The cost-effectiveness of cash versus lottery incentives for a web-based, stated-preference community survey. Eur J Health Econ. 2012;13(6):789–99.CrossRef
33.
go back to reference Wu C, Thompson ME, Fong GT, et al. Methods of the international tobacco control (ITC) China survey. Tob Control. 2010;19(Suppl 2):i1–5.CrossRef Wu C, Thompson ME, Fong GT, et al. Methods of the international tobacco control (ITC) China survey. Tob Control. 2010;19(Suppl 2):i1–5.CrossRef
34.
go back to reference Young JM, O'Halloran A, McAulay C, et al. Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: randomized controlled trial. J Clin Epidemiol. 2015;68(6):693–7.CrossRef Young JM, O'Halloran A, McAulay C, et al. Unconditional and conditional incentives differentially improved general practitioners' participation in an online survey: randomized controlled trial. J Clin Epidemiol. 2015;68(6):693–7.CrossRef
35.
go back to reference Ulrich CM, Danis M, Koziol D, et al. Does it pay to pay?: a randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals. Nurs Res. 2005;54(3):178–83.CrossRef Ulrich CM, Danis M, Koziol D, et al. Does it pay to pay?: a randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals. Nurs Res. 2005;54(3):178–83.CrossRef
36.
go back to reference Toepoel V. Effects of incentives in surveys. In: Gideon L, editor. Handbook of survey methodology for the social sciences. New York, NY: Springer; 2012. p. 209–23.CrossRef Toepoel V. Effects of incentives in surveys. In: Gideon L, editor. Handbook of survey methodology for the social sciences. New York, NY: Springer; 2012. p. 209–23.CrossRef
37.
go back to reference Kahn KL, Liu H, Adams JL, et al. Methodological challenges associated with patient responses to follow-up longitudinal surveys regarding quality of care. Health Serv Res. 2003;38(6p1):1579–98.CrossRef Kahn KL, Liu H, Adams JL, et al. Methodological challenges associated with patient responses to follow-up longitudinal surveys regarding quality of care. Health Serv Res. 2003;38(6p1):1579–98.CrossRef
38.
go back to reference Collins RL, Ellickson PL, Hays RD, et al. Effects of incentive size and timing on response rates to a follow-up wave of a longitudinal mailed survey. Eval Rev. 2000;24(4):347–63.CrossRef Collins RL, Ellickson PL, Hays RD, et al. Effects of incentive size and timing on response rates to a follow-up wave of a longitudinal mailed survey. Eval Rev. 2000;24(4):347–63.CrossRef
39.
go back to reference Yu S, Alper HE, Nguyen A-M, et al. The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study. BMC Med Res Methodol. 2017;17(1):77.CrossRef Yu S, Alper HE, Nguyen A-M, et al. The effectiveness of a monetary incentive offer on survey response rates and response completeness in a longitudinal study. BMC Med Res Methodol. 2017;17(1):77.CrossRef
40.
go back to reference Rose SW, Emery SL, Ennett S, et al. Public support for family smoking prevention and tobacco control act point-of-Sale provisions: results of a National Study. Am J Public Health. 2015;105(10):e60–7.CrossRef Rose SW, Emery SL, Ennett S, et al. Public support for family smoking prevention and tobacco control act point-of-Sale provisions: results of a National Study. Am J Public Health. 2015;105(10):e60–7.CrossRef
41.
go back to reference Smith KC, Siebel C, Pham L, et al. News on tobacco and public attitudes toward smokefree air policies in the United States. Health Policy. 2008;86(1):42–52.CrossRef Smith KC, Siebel C, Pham L, et al. News on tobacco and public attitudes toward smokefree air policies in the United States. Health Policy. 2008;86(1):42–52.CrossRef
42.
go back to reference Lykke M, Pisinger C, Glümer C. Ready for a goodbye to tobacco? — assessment of support for endgame strategies on smoking among adults in a Danish regional health survey. Prev Med. 2016;83:5–10.CrossRef Lykke M, Pisinger C, Glümer C. Ready for a goodbye to tobacco? — assessment of support for endgame strategies on smoking among adults in a Danish regional health survey. Prev Med. 2016;83:5–10.CrossRef
43.
go back to reference James KM, Ziegenfuss JY, Tilburt JC, et al. Getting physicians to respond: the impact of incentive type and timing on physician survey response rates. Health Serv Res. 2011;46(1p1):232–42.CrossRef James KM, Ziegenfuss JY, Tilburt JC, et al. Getting physicians to respond: the impact of incentive type and timing on physician survey response rates. Health Serv Res. 2011;46(1p1):232–42.CrossRef
Metadata
Title
Effect of prepaid and promised financial incentive on follow-up survey response in cigarette smokers: a randomized controlled trial
Authors
Yee Tak Derek Cheung
Xue Weng
Man Ping Wang
Sai Yin Ho
Antonio Cho Shing Kwong
Vienna Wai Yin Lai
Tai Hing Lam
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0786-9

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue