Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

Effects of pre-notification, invitation length, questionnaire length and reminder on participation rate: a quasi-randomised controlled trial

Authors: Marie Koitsalu, Martin Eklund, Jan Adolfsson, Henrik Grönberg, Yvonne Brandberg

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Improving participation rates in epidemiologic studies using questionnaires and biological sampling is important for the generalizability of the outcome. The aim of this study was to examine the effects of pre-notification, invitation length, questionnaire length, and reminder on participation rate and to investigate whether some factors contributed to participants doing both the questionnaire and blood sampling as oppose to only one part.

Methods

Our study was embedded within the pilot testing of a large population-based study about prostate cancer screening. Our study sample consisted of 28.134 men between 50 and 69 years of age and living in the region of Stockholm (Sweden) invited to respond to a web-based questionnaire and to provide blood for prostate cancer testing. The men were randomly allocated according to birth of date to receive either: (a) a pre-notification postcard or not; (b) a shorter or a longer invitation letter; (c) a shorter or a longer web-based questionnaire, and (d) a reminder or not. The effects of the survey design factors were tested using chi-square.

Results

The use of a pre-notification (p < 0.0001), a longer questionnaire (p = 0.004) and the use of a reminder (p = 0.02) were associated with an increase in overall participation, i.e. responding to the questionnaire or providing blood for PCT or performing both components.

Conclusions

The results of this pilot study justified the use of a pre-notification and a reminder in the following large population based study since the benefits of increased participation traded off against the greater costs incurred. Furthermore, we were able to use the longer version of the questionnaire, which allowed us to collect more information without risking a lower response rate.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference van Gelder MM, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol. 2010;172(11):1292–8.CrossRefPubMed van Gelder MM, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol. 2010;172(11):1292–8.CrossRefPubMed
3.
go back to reference Scott A, Jeon SH, Joyce CM, Humphreys JS, Kalb G, Witt J, Leahy A. A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Med Res Methodol. 2011;11:126.CrossRefPubMedPubMedCentral Scott A, Jeon SH, Joyce CM, Humphreys JS, Kalb G, Witt J, Leahy A. A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Med Res Methodol. 2011;11:126.CrossRefPubMedPubMedCentral
4.
go back to reference Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163(3):197–203.CrossRefPubMed Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163(3):197–203.CrossRefPubMed
5.
go back to reference Galea S, Tracy M. Participation Rates in Epidemiologic Studies. Annals of Epidemiology. 2007;17(9):643–53.CrossRefPubMed Galea S, Tracy M. Participation Rates in Epidemiologic Studies. Annals of Epidemiology. 2007;17(9):643–53.CrossRefPubMed
6.
go back to reference Fan W, Yan Z. Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior. 2010;26(2):132–9.CrossRef Fan W, Yan Z. Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior. 2010;26(2):132–9.CrossRef
8.
go back to reference Zuidgeest M, Hendriks M, Koopman L, Spreeuwenberg P, Rademakers J. A comparison of a postal survey and mixed-mode survey using a questionnaire on patients’ experiences with breast care. J Med Internet Res. 2011;13(3):e68.CrossRefPubMedPubMedCentral Zuidgeest M, Hendriks M, Koopman L, Spreeuwenberg P, Rademakers J. A comparison of a postal survey and mixed-mode survey using a questionnaire on patients’ experiences with breast care. J Med Internet Res. 2011;13(3):e68.CrossRefPubMedPubMedCentral
9.
go back to reference Hohwu L, Lyshol H, Gissler M, Jonsson SH, Petzold M, Obel C. Web-based versus traditional paper questionnaires: a mixed-mode survey with a Nordic perspective. J Med Internet Res. 2013;15(8):e173.CrossRefPubMedPubMedCentral Hohwu L, Lyshol H, Gissler M, Jonsson SH, Petzold M, Obel C. Web-based versus traditional paper questionnaires: a mixed-mode survey with a Nordic perspective. J Med Internet Res. 2013;15(8):e173.CrossRefPubMedPubMedCentral
10.
go back to reference Gronberg H, Adolfsson J, Aly M, Nordstrom T, Wiklund P, Brandberg Y, Thompson J, Wiklund F, Lindberg J, Clements M, et al. Prostate cancer screening in men aged 50–69 years (STHLM3): a prospective population-based diagnostic study. Lancet Oncol. 2015;16(16):1667–76.CrossRefPubMed Gronberg H, Adolfsson J, Aly M, Nordstrom T, Wiklund P, Brandberg Y, Thompson J, Wiklund F, Lindberg J, Clements M, et al. Prostate cancer screening in men aged 50–69 years (STHLM3): a prospective population-based diagnostic study. Lancet Oncol. 2015;16(16):1667–76.CrossRefPubMed
11.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008.
12.
go back to reference Edwards P, Roberts I, Sandercock P, Frost C. Follow-up by mail in clinical trials: does questionnaire length matter? Control Clin Trials. 2004;25(1):31–52.CrossRefPubMed Edwards P, Roberts I, Sandercock P, Frost C. Follow-up by mail in clinical trials: does questionnaire length matter? Control Clin Trials. 2004;25(1):31–52.CrossRefPubMed
13.
go back to reference Sahlqvist S, Song Y, Bull F, Adams E, Preston J, Ogilvie D. iConnect c: Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial. BMC medical research methodology. 2011;11:62.CrossRefPubMedPubMedCentral Sahlqvist S, Song Y, Bull F, Adams E, Preston J, Ogilvie D. iConnect c: Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial. BMC medical research methodology. 2011;11:62.CrossRefPubMedPubMedCentral
14.
go back to reference Galesic M, Bosnjak M. Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey. Public Opinion Quarterly. 2009;73(2):349–60.CrossRef Galesic M, Bosnjak M. Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey. Public Opinion Quarterly. 2009;73(2):349–60.CrossRef
15.
go back to reference de Bernardo DH, Curtis A. Using Online and Paper Surveys: The Effectiveness of Mixed-Mode Methodology for Populations Over 50. Research on Aging. 2013;35(2):220–40.CrossRef de Bernardo DH, Curtis A. Using Online and Paper Surveys: The Effectiveness of Mixed-Mode Methodology for Populations Over 50. Research on Aging. 2013;35(2):220–40.CrossRef
Metadata
Title
Effects of pre-notification, invitation length, questionnaire length and reminder on participation rate: a quasi-randomised controlled trial
Authors
Marie Koitsalu
Martin Eklund
Jan Adolfsson
Henrik Grönberg
Yvonne Brandberg
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0467-5

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue