Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies

Authors: Siân Harrison, Jane Henderson, Fiona Alderdice, Maria A. Quigley

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Surveys are established methods for collecting population data that are unavailable from other sources; however, response rates to surveys are declining. A number of methods have been identified to increase survey returns yet response rates remain low. This paper evaluates the impact of five selected methods on the response rate to pilot surveys, conducted prior to a large-scale National Maternity Survey in England.

Methods

The pilot national maternity surveys were cross-sectional population-based questionnaire surveys of women who were three months postpartum selected at random from birth registrations. Women received a postal questionnaire, which they could complete on paper, online or verbally over the telephone. An initial pilot survey was conducted (pilot 1, n = 1000) to which the response rate was lower than expected. Therefore, a further pilot survey was conducted (pilot 2, n = 2000) using additional selected methods with the specific aim of increasing the response rate. The additional selected methods used for all women in pilot 2 were: pre-notification, a shorter questionnaire, more personable survey materials, an additional reminder, and inclusion of quick response (QR) codes to enable faster access to the online version of the survey. To assess the impact of the selected methods, response rates to pilot surveys 1 and 2 were compared.

Results

The response rate increased significantly from 28.7% in pilot 1 to 33.1% in pilot 2 (+ 4.4%, 95%CI:0.88–7.83, p = 0.02). Analysis of weekly returns according to time from initial and reminder mail-outs suggests that this increase was largely due to the additional reminder. Most respondents completed the paper questionnaire rather than taking part online or over the telephone in both pilot surveys. However, the overall response to the online questionnaire almost doubled from 1.8% in pilot 1 to 3.5% in pilot 2, corresponding to an absolute difference of 1.7% (95%CI:0.45–2.81, p = 0.01), suggesting that QR codes might have facilitated online participation.

Conclusions

Declining survey response rates may be ameliorated with the use of selected methods. Further studies should evaluate the effectiveness of each of these methods using randomised controlled trials and identify novel strategies for engaging populations in survey research.
Appendix
Available only for authorised users
Literature
7.
go back to reference Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.CrossRef Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.CrossRef
8.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane database systematic review. 2009 Jul 8;(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. Review. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane database systematic review. 2009 Jul 8;(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. Review.
9.
go back to reference Singer E, Ye C. The use and effects of incentives in surveys. Annals Am Academy Political and Social Science. 2013;645(1):112–41.CrossRef Singer E, Ye C. The use and effects of incentives in surveys. Annals Am Academy Political and Social Science. 2013;645(1):112–41.CrossRef
10.
go back to reference Robb KA, Gatting L, Wardle J. What impact do questionnaire length and monetary incentives have on mailed health psychology survey response? Br J Health Psychol. 2017;22(4):671–85.CrossRef Robb KA, Gatting L, Wardle J. What impact do questionnaire length and monetary incentives have on mailed health psychology survey response? Br J Health Psychol. 2017;22(4):671–85.CrossRef
11.
go back to reference Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, Rait G. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4:e003821.CrossRef Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, Rait G. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4:e003821.CrossRef
12.
go back to reference Hammink A, Giesen P, Wensing M. Pre-notification did not increase response rate in addition to follow-up: a randomized trial. J Clin Epidemiol. 2010;63(11):1276–8.CrossRef Hammink A, Giesen P, Wensing M. Pre-notification did not increase response rate in addition to follow-up: a randomized trial. J Clin Epidemiol. 2010;63(11):1276–8.CrossRef
13.
go back to reference Carey RN, Reid A, Driscoll TR, Glass DC, Benke G, Fritschi L. An advance letter did not increase the response rates in a telephone survey: a randomized trial. J Clin Epidemiol. 2013;66(12):1417–21.CrossRef Carey RN, Reid A, Driscoll TR, Glass DC, Benke G, Fritschi L. An advance letter did not increase the response rates in a telephone survey: a randomized trial. J Clin Epidemiol. 2013;66(12):1417–21.CrossRef
14.
go back to reference Nicolaas G, Smith P, Pickering K, Branson C. Increasing response rates in postal surveys while controlling costs: an experimental investigation. Social Research Practice. 2015;1:3–15. Nicolaas G, Smith P, Pickering K, Branson C. Increasing response rates in postal surveys while controlling costs: an experimental investigation. Social Research Practice. 2015;1:3–15.
16.
go back to reference Dillman DA, Smyth JD, Internet CLM. Phone, mail, and mixed-mode surveys: the tailored design method. 4th ed. Hoboken, New Jersey: Wiley; 2014. Dillman DA, Smyth JD, Internet CLM. Phone, mail, and mixed-mode surveys: the tailored design method. 4th ed. Hoboken, New Jersey: Wiley; 2014.
17.
go back to reference Draugalis JR, Coons SJ, Plaza CM. Best practices for survey research reports: a synopsis for authors and reviewers. Am J Pharm Educ. 2008;72(1):Article 11.CrossRef Draugalis JR, Coons SJ, Plaza CM. Best practices for survey research reports: a synopsis for authors and reviewers. Am J Pharm Educ. 2008;72(1):Article 11.CrossRef
19.
go back to reference Nakash RA, Hutton JL, Jorstad-Stein EC, Gates S, Lamb SE. Maximising response to postal questionnaires—a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006;6:5.CrossRef Nakash RA, Hutton JL, Jorstad-Stein EC, Gates S, Lamb SE. Maximising response to postal questionnaires—a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006;6:5.CrossRef
20.
go back to reference Yammarino FJ, Skinner SJ, Childers TL. Understanding mail survey response behavior: a meta-analysis. Public Opin Q. 1991;55(4):613–39.CrossRef Yammarino FJ, Skinner SJ, Childers TL. Understanding mail survey response behavior: a meta-analysis. Public Opin Q. 1991;55(4):613–39.CrossRef
21.
go back to reference Singer E, Bossarte RM. Incentives for survey participation: when are they “coercive”? Am J Preventative Med. 2006;31(5):411–41.CrossRef Singer E, Bossarte RM. Incentives for survey participation: when are they “coercive”? Am J Preventative Med. 2006;31(5):411–41.CrossRef
22.
go back to reference Draper H, Wilson S, Flanagan S, Ives J. Offering payments, reimbursement and incentives to patients and family doctors to encourage participation in research. Fam Pract. 2009;26(3):231–8.CrossRef Draper H, Wilson S, Flanagan S, Ives J. Offering payments, reimbursement and incentives to patients and family doctors to encourage participation in research. Fam Pract. 2009;26(3):231–8.CrossRef
23.
go back to reference Grady C. Money for research participant: does it jeopardize informed consent. Am J Bioeth. 2001;1(2):40–4 (5).CrossRef Grady C. Money for research participant: does it jeopardize informed consent. Am J Bioeth. 2001;1(2):40–4 (5).CrossRef
Metadata
Title
Methods to increase response rates to a population-based maternity survey: a comparison of two pilot studies
Authors
Siân Harrison
Jane Henderson
Fiona Alderdice
Maria A. Quigley
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0702-3

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue