Skip to main content
Top
Published in: BMC Health Services Research 1/2009

Open Access 01-12-2009 | Research article

Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study

Authors: Julia V Cook, Heather O Dickinson, Martin P Eccles

Published in: BMC Health Services Research | Issue 1/2009

Login to get access

Abstract

Background

Postal surveys are a frequently used method of data collection in health services research. Low response rates increase the potential for bias and threaten study validity. The objectives of this study were to estimate current response rates, to assess whether response rates are falling, to explore factors that might enhance response rates and to examine the potential for non-response bias in surveys mailed to healthcare professionals.

Methods

A random sample of postal or electronic surveys of healthcare workers (1996-2005) was identified from Medline, Embase or Psycinfo databases or Biomed Central. Outcome measures were survey response rate and non response analysis. Multilevel, multivariable logistic regression examined the relationship between response rate and publication type, healthcare profession, country and number of survey participants, questionnaire length and use of reminders.

Results

The analysis included 350 studies. Average response rate in doctors was 57.5% (95%CI: 55.2% to 59.8%) and significantly lower than the estimate for the prior 10 year period. Response rates were higher when reminders were sent (adjusted OR 1.3; 95%CI 1.1-1.6) but only half the studies did this. Response rates were also higher in studies with fewer than 1000 participants and in countries other than US, Canada, Australia and New Zealand. They were not significantly affected by publication type or healthcare profession (p > 0.05). Only 17% of studies attempted assessment of possible non-response bias.

Conclusion

Response rates to postal surveys of healthcare professionals are low and probably declining, almost certainly leading to unknown levels of bias. To improve the informativeness of postal survey findings, researchers should routinely consider the use of reminders and assess potential for non-response bias.
Appendix
Available only for authorised users
Literature
1.
go back to reference Asch D, Jedrziewski M, Christakis N: Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRefPubMed Asch D, Jedrziewski M, Christakis N: Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRefPubMed
2.
go back to reference Cummings S, Savitz L, Konrad T: Reported response rates to mailed physician questionnaires. Health Serv Res. 2001, 35: 1347-1355.PubMedPubMedCentral Cummings S, Savitz L, Konrad T: Reported response rates to mailed physician questionnaires. Health Serv Res. 2001, 35: 1347-1355.PubMedPubMedCentral
4.
go back to reference Moore M, Post K, Smith H: 'Bin Bag' study: a survey of the research requests received by general practitioners and the primary health care team. Br J Gen Pract. 1999, 49: 905-906.PubMedPubMedCentral Moore M, Post K, Smith H: 'Bin Bag' study: a survey of the research requests received by general practitioners and the primary health care team. Br J Gen Pract. 1999, 49: 905-906.PubMedPubMedCentral
5.
go back to reference Schafer J: Analysis of incomplete multivariate data. 1997, New York: Chapman & HallCrossRef Schafer J: Analysis of incomplete multivariate data. 1997, New York: Chapman & HallCrossRef
6.
go back to reference Little R, Rubin D: Statistical analysis with missing data. 2002, New Jersey: WileyCrossRef Little R, Rubin D: Statistical analysis with missing data. 2002, New Jersey: WileyCrossRef
7.
go back to reference Bowling A: Data collection methods in quantitative research: questionnaires, interviews and their response rates. Research methods in health: Investigating health and health services. 2004, Maidenhead: Open University Press, 257-272. Bowling A: Data collection methods in quantitative research: questionnaires, interviews and their response rates. Research methods in health: Investigating health and health services. 2004, Maidenhead: Open University Press, 257-272.
8.
go back to reference Edwards P, Roberts I, Clark M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Copper R: Methods to increase response rates to postal questionnaires. The Cochrane Database of Methodology Reviews. 2003, 4 Edwards P, Roberts I, Clark M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Copper R: Methods to increase response rates to postal questionnaires. The Cochrane Database of Methodology Reviews. 2003, 4
9.
go back to reference McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J: Design and use of questionnaires; a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J: Design and use of questionnaires; a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed
10.
go back to reference Field T, Cadoret C, Brown M, Ford M, Greene S, Hill D, Hornbrook M, Meenan R, White M, Zapka J: Surveying physicians: do components of the "Total Design Approach" to optimizing survey response rates apply to physicians?. Med Care. 2002, 40: 596-605. 10.1097/00005650-200207000-00006.CrossRefPubMed Field T, Cadoret C, Brown M, Ford M, Greene S, Hill D, Hornbrook M, Meenan R, White M, Zapka J: Surveying physicians: do components of the "Total Design Approach" to optimizing survey response rates apply to physicians?. Med Care. 2002, 40: 596-605. 10.1097/00005650-200207000-00006.CrossRefPubMed
11.
go back to reference Kellerman S, Herold J: Physician response to surveys. A review of the literature. Am J Prev Med. 2001, 20: 61-67. 10.1016/S0749-3797(00)00258-0.CrossRefPubMed Kellerman S, Herold J: Physician response to surveys. A review of the literature. Am J Prev Med. 2001, 20: 61-67. 10.1016/S0749-3797(00)00258-0.CrossRefPubMed
12.
go back to reference Campbell M, Thomson S, Ramsay C, MacLennan G, Grimshaw J: Sample size calculator for cluster randomised trials. Comput Biol Med. 2004, 34: 113-125. 10.1016/S0010-4825(03)00039-8.CrossRefPubMed Campbell M, Thomson S, Ramsay C, MacLennan G, Grimshaw J: Sample size calculator for cluster randomised trials. Comput Biol Med. 2004, 34: 113-125. 10.1016/S0010-4825(03)00039-8.CrossRefPubMed
13.
go back to reference Campbell M, Mollison J, Grimshaw J: Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001, 20: 391-399. 10.1002/1097-0258(20010215)20:3<391::AID-SIM800>3.0.CO;2-Z.CrossRefPubMed Campbell M, Mollison J, Grimshaw J: Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001, 20: 391-399. 10.1002/1097-0258(20010215)20:3<391::AID-SIM800>3.0.CO;2-Z.CrossRefPubMed
14.
go back to reference Rabe-Hesketh S, Skrondal A: Multilevel and longitudinal modeling using stata. 2008, College Station, TX: Stata Press Rabe-Hesketh S, Skrondal A: Multilevel and longitudinal modeling using stata. 2008, College Station, TX: Stata Press
15.
go back to reference Cook R, Weisberg S: Residuals and influence in regression. 1982, New York: Chapman & Hall Cook R, Weisberg S: Residuals and influence in regression. 1982, New York: Chapman & Hall
16.
go back to reference Busing N, Newbery P: Robust description of family practice. A look at the National Physician Survey. Can Fam Physician. 2005, 51: 640-642. 647-649PubMedPubMedCentral Busing N, Newbery P: Robust description of family practice. A look at the National Physician Survey. Can Fam Physician. 2005, 51: 640-642. 647-649PubMedPubMedCentral
17.
go back to reference Ching P, Willett W, Rimm E, Colditz G, Gortmaker S, Stampfer M: Activity level and risk of overweight in male health professionals. Am J Public Health. 1996, 86: 25-30.CrossRefPubMedPubMedCentral Ching P, Willett W, Rimm E, Colditz G, Gortmaker S, Stampfer M: Activity level and risk of overweight in male health professionals. Am J Public Health. 1996, 86: 25-30.CrossRefPubMedPubMedCentral
18.
go back to reference Dillman DA: Mail and internet surveys: The tailored design method. 2000, NY: John Wiley & Sons Dillman DA: Mail and internet surveys: The tailored design method. 2000, NY: John Wiley & Sons
Metadata
Title
Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study
Authors
Julia V Cook
Heather O Dickinson
Martin P Eccles
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2009
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-9-160

Other articles of this Issue 1/2009

BMC Health Services Research 1/2009 Go to the issue