Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

Improving participation rates by providing choice of participation mode: two randomized controlled trials

Authors: Naomi Heijmans, Jan van Lieshout, Michel Wensing

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

Low participation rates reduce effective sample size, statistical power and can increase risk for selection bias. Previous research suggests that offering choice of participation mode can improve participation rates. However, few head-to-head trials compared choice of participation mode using telephone interviews and postal questionnaires as modes of interest. Aiming to explore effects of choice of participation, two randomized controlled trials were performed comparing participation rates of patients provided with and without choice of participation mode, using interviews and questionnaires as participation modes.

Methods

Two trials were embedded in a larger study on cardiovascular risk management in primary care. Patients with a chronic cardiovascular condition recruited for the larger study were invited to participate in an additional survey on social networks, using invitations with and without choice of participation mode. Primary outcome was participation rate. Other outcomes of interest were participation rate conditional on willingness to participate, and initial willingness to participate. In trial 1 we compared outcomes after choice of participation mode (interview or questionnaire) with invitations for participation in a telephone interview. In Trial 2 results for choice of participation mode were compared with postal questionnaires.

Results

In Trial 1 no differences were found in participation rates (65% vs 66%, p = 0.853) although conditional participation rate was highest for interviews (90% vs 72%, p < .01). Initial willingness to participate was higher when choice of participation mode was provided (90% versus 73%, p < .01). In Trial 2 participation rate and conditional participation rate was higher when choice of participation mode was provided (59% vs 46%, p < .01 and 66% vs 53%, p < .01, respectively). No differences were found for initial willingness to participate (90% vs 86%, p = 0.146).

Conclusion

Offering choice of participation mode had benefit on participation rates compared to invitations to participate in questionnaires, but not when compared to invitations to participate in telephone interviews.

Trial registration

Current Controlled Trials ISRCTN89237105.
Literature
1.
go back to reference Dillman DA, Smyth JD, Christian LM, Internet, mail, and mixed-mode surveys. The tailored design method. In: Hoboken NJ, editor. Internet, mail, and mixed-mode surveys: the tailored design method. 3rd ed. US: John Wiley & Sons Inc; 2009. p. 499. Dillman DA, Smyth JD, Christian LM, Internet, mail, and mixed-mode surveys. The tailored design method. In: Hoboken NJ, editor. Internet, mail, and mixed-mode surveys: the tailored design method. 3rd ed. US: John Wiley & Sons Inc; 2009. p. 499.
2.
go back to reference Gilbert T. Mode preferences in the 2008 National Survey of College Graduates, Paper presented at the Annual Meeting of the American Association of Public Opionion Research, Hollywood, FL. 2009. Gilbert T. Mode preferences in the 2008 National Survey of College Graduates, Paper presented at the Annual Meeting of the American Association of Public Opionion Research, Hollywood, FL. 2009.
3.
go back to reference Levenstein R. Mode preference, mode choice, and data quality in the army defense, resilience, and retention study, Paper presented at the Annual Meeting of the American Association of Public Opionion Research, Hollywood, FL. 2009. Levenstein R. Mode preference, mode choice, and data quality in the army defense, resilience, and retention study, Paper presented at the Annual Meeting of the American Association of Public Opionion Research, Hollywood, FL. 2009.
4.
go back to reference Olson K, Smyth JD, Wood HM. Does giving people their preferred survey mode actually increase survey participation rates? An experimental examination. Public Opin Quart. 2012;76(4):611–35.CrossRef Olson K, Smyth JD, Wood HM. Does giving people their preferred survey mode actually increase survey participation rates? An experimental examination. Public Opin Quart. 2012;76(4):611–35.CrossRef
5.
go back to reference Dillman DA CJ, West KK. Influence of an invitation to answer by telephone on response to census questionnaires. Public Opin Quart. 1995;51:201–2019. Dillman DA CJ, West KK. Influence of an invitation to answer by telephone on response to census questionnaires. Public Opin Quart. 1995;51:201–2019.
6.
go back to reference Denniston M SK, Baker F, Brogan D, West M, Roche L. An experiment in data collection mode preference of long-term cancer survivors. Proceedings of survey research methods section of the American Statistical Association 2000:411–6 Denniston M SK, Baker F, Brogan D, West M, Roche L. An experiment in data collection mode preference of long-term cancer survivors. Proceedings of survey research methods section of the American Statistical Association 2000:411–6
7.
go back to reference Medway RL, Fulton J. When more gets you less: a meta-analysis of the effect of concurrent web options on mail survey response rates. Public Opin Quart. 2012;76(4):733–46.CrossRef Medway RL, Fulton J. When more gets you less: a meta-analysis of the effect of concurrent web options on mail survey response rates. Public Opin Quart. 2012;76(4):733–46.CrossRef
8.
go back to reference Radon K, Goldberg M, Becklake M, Pindur U, Hege I, Nowak D. Low acceptance of an internet-based online questionnaire by young adults. Epidemiology. 2002;13(6):748–9.CrossRefPubMed Radon K, Goldberg M, Becklake M, Pindur U, Hege I, Nowak D. Low acceptance of an internet-based online questionnaire by young adults. Epidemiology. 2002;13(6):748–9.CrossRefPubMed
9.
go back to reference Ziegenfuss JY, Beebe TJ, Rey E, Schleck C, Locke 3rd GR, Talley NJ. Internet option in a mail survey: more harm than good? Epidemiology. 2010;21(4):585–6.CrossRefPubMed Ziegenfuss JY, Beebe TJ, Rey E, Schleck C, Locke 3rd GR, Talley NJ. Internet option in a mail survey: more harm than good? Epidemiology. 2010;21(4):585–6.CrossRefPubMed
10.
go back to reference Boshuizen HC, Viet AL, Picavet HS, Botterweck A, van Loon AJ. Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public health. 2006;120(4):297–308.CrossRefPubMed Boshuizen HC, Viet AL, Picavet HS, Botterweck A, van Loon AJ. Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public health. 2006;120(4):297–308.CrossRefPubMed
11.
go back to reference Couper MP, Kapteyn A, Schonlau M, Winter J. Noncoverage and nonresponse in an Internet survey. Soc Sci Res. 2007;36(1):131–48.CrossRef Couper MP, Kapteyn A, Schonlau M, Winter J. Noncoverage and nonresponse in an Internet survey. Soc Sci Res. 2007;36(1):131–48.CrossRef
12.
go back to reference Vaartjes IKC, van Dis I, Visseren FLJ, Bots ML. Hart- en vaatziekten in Nederland 2013, cijfers over leefstijl, risicofactoren, ziekte en sterfte. Den Haag: Hartstichting; 2013. Vaartjes IKC, van Dis I, Visseren FLJ, Bots ML. Hart- en vaatziekten in Nederland 2013, cijfers over leefstijl, risicofactoren, ziekte en sterfte. Den Haag: Hartstichting; 2013.
14.
go back to reference Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, et al. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implementation science: IS. 2011;6:103.CrossRefPubMedPubMedCentral Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, et al. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implementation science: IS. 2011;6:103.CrossRefPubMedPubMedCentral
15.
go back to reference Heijmans N, van Lieshout J, Wensing M. Social networks of health care providers and patients in cardiovascular risk management: a study protocol. BMC Health Serv Res. 2014;14:265.CrossRefPubMedPubMedCentral Heijmans N, van Lieshout J, Wensing M. Social networks of health care providers and patients in cardiovascular risk management: a study protocol. BMC Health Serv Res. 2014;14:265.CrossRefPubMedPubMedCentral
16.
go back to reference Huntink E, Heijmans N, Wensing M, van Lieshout J. Effectiveness of a tailored intervention to improve cardiovascular risk management in primary care: study protocol for a randomised controlled trial. Trials. 2013;14:433.CrossRefPubMedPubMedCentral Huntink E, Heijmans N, Wensing M, van Lieshout J. Effectiveness of a tailored intervention to improve cardiovascular risk management in primary care: study protocol for a randomised controlled trial. Trials. 2013;14:433.CrossRefPubMedPubMedCentral
17.
go back to reference American Association for Public Opinion Research. Standard definitions: final dispositions of case codes and outcome rates for surveys, [7th major edn]. Ann Arbor, MI: American Association for Public Opinion Research; 2011. American Association for Public Opinion Research. Standard definitions: final dispositions of case codes and outcome rates for surveys, [7th major edn]. Ann Arbor, MI: American Association for Public Opinion Research; 2011.
18.
go back to reference Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W. Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001;27(7):349–61.PubMed Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W. Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001;27(7):349–61.PubMed
19.
go back to reference Harris LE, Weinberger M, Tierney WM. Assessing inner-city patients’ hospital experiences. A controlled trial of telephone interviews versus mailed surveys. Med care. 1997;35(1):70–6.CrossRefPubMed Harris LE, Weinberger M, Tierney WM. Assessing inner-city patients’ hospital experiences. A controlled trial of telephone interviews versus mailed surveys. Med care. 1997;35(1):70–6.CrossRefPubMed
20.
go back to reference Perkins JJ, Sanson-Fisher RW. An examination of self- and telephone-administered modes of administration for the Australian SF-36. J Clin Epidemiol. 1998;51(11):969–73.CrossRefPubMed Perkins JJ, Sanson-Fisher RW. An examination of self- and telephone-administered modes of administration for the Australian SF-36. J Clin Epidemiol. 1998;51(11):969–73.CrossRefPubMed
Metadata
Title
Improving participation rates by providing choice of participation mode: two randomized controlled trials
Authors
Naomi Heijmans
Jan van Lieshout
Michel Wensing
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-015-0021-2

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue