Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

Maximising response from GPs to questionnaire surveys: do length or incentives make a difference?

Authors: Elizabeth Cottrell, Edward Roddy, Trishna Rathod, Elaine Thomas, Mark Porcheret, Nadine E Foster

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

General Practitioners (GPs) respond poorly to postal surveys. Consequently there is potential for reduced data quality and bias in the findings. In general population surveys, response to postal questionnaires may be improved by reducing their length and offering incentives. The aim of this study was to investigate whether questionnaire length and/or the offer of an incentive improves the response of GPs to a postal questionnaire survey.

Methods

A postal questionnaire survey was sent to 800 UK GPs randomly selected from Binley’s database; a database containing contact details of professionals working in UK general practices. The random sample of GPs was assigned to one of four groups of 200, each receiving a different questionnaire, either a standard (eight sides of A4) or an abbreviated (four sides of A4) questionnaire, with or without the offer of an incentive (a prize draw entry for a £100 voucher) for completion. The effects of questionnaire length and offer of incentive on response were calculated.

Results

Of 800 mailed questionnaires, 19 GPs did not meet inclusion criteria and 172 (adjusted response 22.0%) completed questionnaires were received. Among the four groups, response ranged from 20.1% (standard questionnaire with no incentive and abbreviated questionnaire with incentive) through 21.8% (standard questionnaire with incentive), to 26.0% (abbreviated questionnaire with no incentive). There were no significant differences in response between the four groups (p = 0.447), between the groups receiving the standard versus the abbreviated questionnaire (% difference -2.1% (95% confidence interval (CI) -7.9, 3.7)) or the groups offered an incentive versus no incentive (% difference -2.1% (95% CI -7.9, 3.7).

Conclusions

Strategies known to improve response to postal questionnaire surveys in the general population do not significantly improve the response to postal questionnaire surveys among GPs. Further refinements to these strategies, or more novel strategies, aimed at increasing response specifically among GPs need to be identified in order to maximise data quality and generalisability of research results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cartwright A: Professionals as responders: variations in and effects of response rates to questionnaires, 1961–77.Br Med J 1978,2(6149):1419–21. 10.1136/bmj.2.6149.1419CrossRefPubMedPubMedCentral Cartwright A: Professionals as responders: variations in and effects of response rates to questionnaires, 1961–77.Br Med J 1978,2(6149):1419–21. 10.1136/bmj.2.6149.1419CrossRefPubMedPubMedCentral
2.
go back to reference Brownell LW, Naik PC: Does method of distribution improve GPs' response rate in questionniare studies?J Epidemiol Commun H 2001, 55:687a. 10.1136/jech.55.9.687aCrossRef Brownell LW, Naik PC: Does method of distribution improve GPs' response rate in questionniare studies?J Epidemiol Commun H 2001, 55:687a. 10.1136/jech.55.9.687aCrossRef
3.
go back to reference Creavin ST, Creavin AL, Mallen CD: Do GPs respond to postal questionnaire surveys? A comprehensive review of primary care literature.Fam Pract 2011,28(4):461–7. 10.1093/fampra/cmr001CrossRefPubMed Creavin ST, Creavin AL, Mallen CD: Do GPs respond to postal questionnaire surveys? A comprehensive review of primary care literature.Fam Pract 2011,28(4):461–7. 10.1093/fampra/cmr001CrossRefPubMed
4.
go back to reference Bishop A, Foster NE, Thomas E, Hay EM: How does the self-reported clinical management of patients with low back pain relate to the attitudes and beliefs of health care practitioners? A survey of UK general practitioners and physiotherapists.Pain 2008, 135:187–95. 10.1016/j.pain.2007.11.010CrossRefPubMedPubMedCentral Bishop A, Foster NE, Thomas E, Hay EM: How does the self-reported clinical management of patients with low back pain relate to the attitudes and beliefs of health care practitioners? A survey of UK general practitioners and physiotherapists.Pain 2008, 135:187–95. 10.1016/j.pain.2007.11.010CrossRefPubMedPubMedCentral
5.
go back to reference Wynne-Jones G, Mallen CD, Main CJ, Dunn KM: Sickness certification and the GP: what really happens in practice?Fam Pract 2010, 27:344–50. 10.1093/fampra/cmp096CrossRefPubMed Wynne-Jones G, Mallen CD, Main CJ, Dunn KM: Sickness certification and the GP: what really happens in practice?Fam Pract 2010, 27:344–50. 10.1093/fampra/cmp096CrossRefPubMed
6.
go back to reference Clarson L: Do general practitioners monitor patients with osteoarthritis?Ann Rheum Dis 2011,70(Suppl3):771. Clarson L: Do general practitioners monitor patients with osteoarthritis?Ann Rheum Dis 2011,70(Suppl3):771.
7.
go back to reference Cockburn J, Campbell E, Gordon JJ, Sanson-Fisher RW: Response bias in a study of general practice.Fam Pract 1988,5(1):18–23. 10.1093/fampra/5.1.18CrossRefPubMed Cockburn J, Campbell E, Gordon JJ, Sanson-Fisher RW: Response bias in a study of general practice.Fam Pract 1988,5(1):18–23. 10.1093/fampra/5.1.18CrossRefPubMed
8.
go back to reference Stocks N, Gunnell D: What are the characteristics of general practitioners who routinely do not return postal questionnaires: a cross sectional study.J Epidemiol Community Health 2000,54(12):940–1. 10.1136/jech.54.12.940CrossRefPubMedPubMedCentral Stocks N, Gunnell D: What are the characteristics of general practitioners who routinely do not return postal questionnaires: a cross sectional study.J Epidemiol Community Health 2000,54(12):940–1. 10.1136/jech.54.12.940CrossRefPubMedPubMedCentral
9.
go back to reference Barclay S, Todd C, Finley I, Grande G, Wyatt P: Not another questionnaire! Maximising the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs.Fam Pract 2002, 19:105–11. 10.1093/fampra/19.1.105CrossRefPubMed Barclay S, Todd C, Finley I, Grande G, Wyatt P: Not another questionnaire! Maximising the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs.Fam Pract 2002, 19:105–11. 10.1093/fampra/19.1.105CrossRefPubMed
10.
go back to reference de Vaus D: Chapter 6: finding a sample. In Surveys in Social Research. 6th edition. Abingdon: Routledge; 2014:66–92. de Vaus D: Chapter 6: finding a sample. In Surveys in Social Research. 6th edition. Abingdon: Routledge; 2014:66–92.
11.
go back to reference Sibbald B, Addington-Hall J, Brenneman D, Freeling P: Telephone versus postal surveys of general practitioners: methodological considerations.Br J Gen Pract 1994,44(384):297–300.PubMedPubMedCentral Sibbald B, Addington-Hall J, Brenneman D, Freeling P: Telephone versus postal surveys of general practitioners: methodological considerations.Br J Gen Pract 1994,44(384):297–300.PubMedPubMedCentral
12.
go back to reference Kaner EFS, Haighton CA, McAvoy BR: "So much post, so busy with practice - so, no time!": a telephone survey of general practitioners' reasons for not participating in postal questionniare surveys.BJGP 1998, 48:1067–9.PubMedPubMedCentral Kaner EFS, Haighton CA, McAvoy BR: "So much post, so busy with practice - so, no time!": a telephone survey of general practitioners' reasons for not participating in postal questionniare surveys.BJGP 1998, 48:1067–9.PubMedPubMedCentral
13.
go back to reference Armstrong D, Ashworth M: When questionnaire response rates do matter: a survey of general practitioners and their views of NHS changes.Br J Gen Pract 2000,50(455):479–80.PubMedPubMedCentral Armstrong D, Ashworth M: When questionnaire response rates do matter: a survey of general practitioners and their views of NHS changes.Br J Gen Pract 2000,50(455):479–80.PubMedPubMedCentral
14.
go back to reference Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, et al.: Methods to increase response to postal and electronic questionnaires (Review).The Cochrane database of systematic reviews 2009., 3: doi:10.1002/14651858 Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, et al.: Methods to increase response to postal and electronic questionnaires (Review).The Cochrane database of systematic reviews 2009., 3: doi:10.1002/14651858
15.
go back to reference Draper H, Wilson S, Flanagan S, Ives J: Offering payments, reimbursement and incentives to patients and family doctors to encourage participation in research.Fam Pract 2009,26(3):231–8. 10.1093/fampra/cmp011CrossRefPubMed Draper H, Wilson S, Flanagan S, Ives J: Offering payments, reimbursement and incentives to patients and family doctors to encourage participation in research.Fam Pract 2009,26(3):231–8. 10.1093/fampra/cmp011CrossRefPubMed
16.
go back to reference Cottrill M: Surveys demand too much time. BMJ: BMJ Publishing Group Ltd; 1996. 313(7071):1552 Cottrill M: Surveys demand too much time. BMJ: BMJ Publishing Group Ltd; 1996. 313(7071):1552
17.
go back to reference Sim J, Wright C: Research in health care. Cheltenham: Stanley Thornes (Publishers) Ltd; 2000. Sim J, Wright C: Research in health care. Cheltenham: Stanley Thornes (Publishers) Ltd; 2000.
18.
go back to reference de Vaus D: Chapter 7: constructing questionnaires. In Surveys in Social Research. 6th edition. Abingdon: Routledge; 2014:93–120. de Vaus D: Chapter 7: constructing questionnaires. In Surveys in Social Research. 6th edition. Abingdon: Routledge; 2014:93–120.
19.
go back to reference Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, et al.: Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis.BMJ Open 2014,4(2):e003821–2013–003821.CrossRef Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, et al.: Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis.BMJ Open 2014,4(2):e003821–2013–003821.CrossRef
20.
go back to reference Jepson C, Asch DA, Hershey JC, Ubel PA: In a mailed physician survey, questionnaire length had a threshold effect on response rate.J Clin Epidemiol 2005,58(1):103–5. 10.1016/j.jclinepi.2004.06.004CrossRefPubMed Jepson C, Asch DA, Hershey JC, Ubel PA: In a mailed physician survey, questionnaire length had a threshold effect on response rate.J Clin Epidemiol 2005,58(1):103–5. 10.1016/j.jclinepi.2004.06.004CrossRefPubMed
21.
go back to reference Kowall B, Breckenkamp J, Heyer K, Berg-Beckhoff G: German wide cross sectional survey on health impacts of electromagnetic fields in the view of general practitioners.Int J Pub Health 2010,55(5):507–12. 10.1007/s00038-009-0110-2CrossRef Kowall B, Breckenkamp J, Heyer K, Berg-Beckhoff G: German wide cross sectional survey on health impacts of electromagnetic fields in the view of general practitioners.Int J Pub Health 2010,55(5):507–12. 10.1007/s00038-009-0110-2CrossRef
22.
go back to reference Glidewell L, Thomas R, MacLennan G, Bonetti D, Johnston M, Eccles MP, et al.: Do incentives, reminders or reduced burden improve healthcare professional response rates in postal questionnaires? Two randomised controlled trials.BMC Health Serv Res 2012, 12:250–6963–12–250.CrossRef Glidewell L, Thomas R, MacLennan G, Bonetti D, Johnston M, Eccles MP, et al.: Do incentives, reminders or reduced burden improve healthcare professional response rates in postal questionnaires? Two randomised controlled trials.BMC Health Serv Res 2012, 12:250–6963–12–250.CrossRef
23.
go back to reference Grava-Gubins I, Scott S: Effects of various methodologic strategies. Survey response rates among Canadian physicians and physicians in training.Can Fam Phys 2008,54(10):1424–30. Grava-Gubins I, Scott S: Effects of various methodologic strategies. Survey response rates among Canadian physicians and physicians in training.Can Fam Phys 2008,54(10):1424–30.
24.
go back to reference Thorpe C, Ryan B, McLean SL, Burt A, Stewart M, Brown JB, et al.: How to obtain excellent response rates when surveying physicians.Fam Pract 2009,26(1):65–8.CrossRefPubMed Thorpe C, Ryan B, McLean SL, Burt A, Stewart M, Brown JB, et al.: How to obtain excellent response rates when surveying physicians.Fam Pract 2009,26(1):65–8.CrossRefPubMed
25.
go back to reference Moore M, Post K, Smith H: 'Bin bag' study: a survey of the research requests received by general practitioners and the primary health care team.Br J Gen Pract 1999,49(448):905–6.PubMedPubMedCentral Moore M, Post K, Smith H: 'Bin bag' study: a survey of the research requests received by general practitioners and the primary health care team.Br J Gen Pract 1999,49(448):905–6.PubMedPubMedCentral
26.
go back to reference Hummers-Pradier E, Scheidt-Nave C, Martin H, Heinemann S, Kochen MM, Himmel W: Simply no time? Barriers to GPs' participation in primary health care research.Fam Pract 2008,25(2):105–12. 10.1093/fampra/cmn015CrossRefPubMed Hummers-Pradier E, Scheidt-Nave C, Martin H, Heinemann S, Kochen MM, Himmel W: Simply no time? Barriers to GPs' participation in primary health care research.Fam Pract 2008,25(2):105–12. 10.1093/fampra/cmn015CrossRefPubMed
27.
go back to reference Coyte PC, Hawker G, Croxford R, Attard C, Wright JG: Variation in rheumatologists and family physicians' perceptions of the indications for an outcomes of knee replacement surgery.J Rheumatol 1996,23(4):730–8.PubMed Coyte PC, Hawker G, Croxford R, Attard C, Wright JG: Variation in rheumatologists and family physicians' perceptions of the indications for an outcomes of knee replacement surgery.J Rheumatol 1996,23(4):730–8.PubMed
28.
go back to reference Chard J, Dickson J, Tallon D, Dieppe P: A comparison of the views of rheumatologists, general practitioners and patients on the treatment of osteoarthritis.Rheumatology 2002,41(10):1208–10. 10.1093/rheumatology/41.10.1208CrossRefPubMed Chard J, Dickson J, Tallon D, Dieppe P: A comparison of the views of rheumatologists, general practitioners and patients on the treatment of osteoarthritis.Rheumatology 2002,41(10):1208–10. 10.1093/rheumatology/41.10.1208CrossRefPubMed
29.
go back to reference Holden MA, Nicholls EE, Hay EM, Foster NE: Physical therapists' use of therapeutic exercise for patients with clinical knee osteoarthritis in the United Kingdom: in line with current recommendations?Phys Ther 2008,88(10):1109–21. 10.2522/ptj.20080077CrossRefPubMedPubMedCentral Holden MA, Nicholls EE, Hay EM, Foster NE: Physical therapists' use of therapeutic exercise for patients with clinical knee osteoarthritis in the United Kingdom: in line with current recommendations?Phys Ther 2008,88(10):1109–21. 10.2522/ptj.20080077CrossRefPubMedPubMedCentral
30.
go back to reference Mason V, Shaw A, Wiles N, Mulligan J, Peters T, Sharp D, et al.: GPs' experiences of primary care mental health research: a qualitative study of the barriers to recruitment.Fam Pract 2007,24(5):518–25. 10.1093/fampra/cmm047CrossRefPubMed Mason V, Shaw A, Wiles N, Mulligan J, Peters T, Sharp D, et al.: GPs' experiences of primary care mental health research: a qualitative study of the barriers to recruitment.Fam Pract 2007,24(5):518–25. 10.1093/fampra/cmm047CrossRefPubMed
31.
go back to reference Kaplowitz MD, Hadlock TD, Levine R: A comparison of web and mail survey response rates.Public Opin Quart 2004,68(1):94–101. 10.1093/poq/nfh006CrossRef Kaplowitz MD, Hadlock TD, Levine R: A comparison of web and mail survey response rates.Public Opin Quart 2004,68(1):94–101. 10.1093/poq/nfh006CrossRef
33.
go back to reference Cadwallader JS, Lebeau JP, Lasserre E, Letrilliart L: Patient and professional attitudes towards research in general practice: the RepR qualitative study.BMC Fam Pract 2014,15(1):136. 10.1186/1471-2296-15-136CrossRefPubMedPubMedCentral Cadwallader JS, Lebeau JP, Lasserre E, Letrilliart L: Patient and professional attitudes towards research in general practice: the RepR qualitative study.BMC Fam Pract 2014,15(1):136. 10.1186/1471-2296-15-136CrossRefPubMedPubMedCentral
Metadata
Title
Maximising response from GPs to questionnaire surveys: do length or incentives make a difference?
Authors
Elizabeth Cottrell
Edward Roddy
Trishna Rathod
Elaine Thomas
Mark Porcheret
Nadine E Foster
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-15-3

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue