Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

The effect of an internet option and single-sided printing format to increase the response rate to a population-based study: a randomized controlled trial

Authors: Elisa Flüß, Christine M Bond, Gareth T Jones, Gary J Macfarlane

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Paper questionnaires are a common means to collect self-reported information in population-based epidemiological studies. Over the past decades, the response rates to epidemiological studies have been decreasing which can affect the selection process of eligible subjects and lead to non-response bias. Hence, research into strategies to increase questionnaire response rates is crucial. The aim of this study was therefore to explore the effectiveness of single-sided questionnaires and an internet option for response in increasing response rates to a population-based study.

Methods

A 2×2 factorial experiment was embedded within a large population-based study of pain and pain management. Persons in the study sample were 4600 residents in Grampian (north of Scotland) aged 25 years and over who were randomly selected from health board records. Sampled persons were randomly assigned to either receive a single-sided or double-sided questionnaire with or without an internet option to respond. The study questionnaire was distributed via post.

Results

The overall study response rate was 36.3%. When compared to the reference group that received no intervention (response rate = 35.5%), the response rate changed only marginally when single-sided questionnaires were distributed (35.8%) or when an option to reply via the internet was provided (34.3%). A somewhat higher increase in response rates was achieved when both strategies were employed (39.6%). Overall, no significant effect on response rate was determined for each strategy or their interaction.

Conclusions

Evidence from this study suggests that neither single-sided questionnaires nor the option to reply via the internet resulted in a significant increase in response rates to population-based studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Silman AJ, Macfarlane GJ: Epidemiological studies. A practical Guide. 2005, Cambridge: Cambridge University Press, 2 Silman AJ, Macfarlane GJ: Epidemiological studies. A practical Guide. 2005, Cambridge: Cambridge University Press, 2
2.
go back to reference Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed
3.
go back to reference Galea S: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-10.1016/j.annepidem.2007.03.013.CrossRefPubMed Galea S: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-10.1016/j.annepidem.2007.03.013.CrossRefPubMed
4.
go back to reference Morton LM: Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006, 163 (3): 197-CrossRefPubMed Morton LM: Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006, 163 (3): 197-CrossRefPubMed
5.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009, 3: MR000008 Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009, 3: MR000008
6.
go back to reference Nakash R: Maximising response to postal questionnaires–a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006, 6 (1): 5-10.1186/1471-2288-6-5.CrossRefPubMedPubMedCentral Nakash R: Maximising response to postal questionnaires–a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006, 6 (1): 5-10.1186/1471-2288-6-5.CrossRefPubMedPubMedCentral
7.
go back to reference Medway RL, Fulton J: When more gets you less: a meta-analysis of the effect of concurrent web options on mail survey response rates. Public Opin Q. 2012, 76 (4): 733-746. 10.1093/poq/nfs047.CrossRef Medway RL, Fulton J: When more gets you less: a meta-analysis of the effect of concurrent web options on mail survey response rates. Public Opin Q. 2012, 76 (4): 733-746. 10.1093/poq/nfs047.CrossRef
8.
go back to reference Brogger J, Nystad W, Cappelen I, Bakke P: No increase in response rate by adding a web response option to a postal population survey: a randomized trial. J Med Internet Res. 2007, 9 (5): e40-10.2196/jmir.9.5.e40.CrossRefPubMedPubMedCentral Brogger J, Nystad W, Cappelen I, Bakke P: No increase in response rate by adding a web response option to a postal population survey: a randomized trial. J Med Internet Res. 2007, 9 (5): e40-10.2196/jmir.9.5.e40.CrossRefPubMedPubMedCentral
9.
go back to reference Ziegenfuss JY, Beebe TJ, Rey E, Schleck C, Locke GR, Talley NJ: Internet option in a mail survey: More harm than good?. Epidemiology. 2010, 21 (4): 585-586. 10.1097/EDE.0b013e3181e09657.CrossRefPubMed Ziegenfuss JY, Beebe TJ, Rey E, Schleck C, Locke GR, Talley NJ: Internet option in a mail survey: More harm than good?. Epidemiology. 2010, 21 (4): 585-586. 10.1097/EDE.0b013e3181e09657.CrossRefPubMed
10.
go back to reference Schneider SJ, Cantor D, Malakhoff L, Arieira C, Segel P, Nguyen K, Tancreto JG: Telephone, internet, and paper data collection modes for the Census 2000 short form. J Official Stat. 2005, 21 (1): 89-101. Schneider SJ, Cantor D, Malakhoff L, Arieira C, Segel P, Nguyen K, Tancreto JG: Telephone, internet, and paper data collection modes for the Census 2000 short form. J Official Stat. 2005, 21 (1): 89-101.
11.
go back to reference Smyth JD, Dillman DA, Christian LM, O'Neill AC: Using the internet to survey small towns and communities: limitations and possibilities in the early 21st century. Am Behav Sci. 2010, 53 (9): 1423-1448. 10.1177/0002764210361695.CrossRef Smyth JD, Dillman DA, Christian LM, O'Neill AC: Using the internet to survey small towns and communities: limitations and possibilities in the early 21st century. Am Behav Sci. 2010, 53 (9): 1423-1448. 10.1177/0002764210361695.CrossRef
13.
go back to reference Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care. 1992, 30 (6): 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care. 1992, 30 (6): 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed
14.
go back to reference Von Korff M, Dworkin SF, Le Resche L: Graded chronic pain status: an epidemiologic evaluation. Pain. 1990, 40 (3): 279-291. 10.1016/0304-3959(90)91125-3.CrossRefPubMed Von Korff M, Dworkin SF, Le Resche L: Graded chronic pain status: an epidemiologic evaluation. Pain. 1990, 40 (3): 279-291. 10.1016/0304-3959(90)91125-3.CrossRefPubMed
15.
go back to reference Schwartz B: The paradox of choice. New York: Harper Perennial. 2004 Schwartz B: The paradox of choice. New York: Harper Perennial. 2004
Metadata
Title
The effect of an internet option and single-sided printing format to increase the response rate to a population-based study: a randomized controlled trial
Authors
Elisa Flüß
Christine M Bond
Gareth T Jones
Gary J Macfarlane
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-104

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue