Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Participant recruitment in sensitive surveys: a comparative trial of ‘opt in’ versus ‘opt out’ approaches

Authors: Katherine J Hunt, Natalie Shlomo, Julia Addington-Hall

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Although in health services survey research we strive for a high response rate, this must be balanced against the need to recruit participants ethically and considerately, particularly in surveys with a sensitive nature. In survey research there are no established recommendations to guide recruitment approach and an ‘opt-in’ system that requires potential participants to request a copy of the questionnaire by returning a reply slip is frequently adopted. However, in observational research the risk to participants is lower than in clinical research and so some surveys have used an ‘opt-out’ system. The effect of this approach on response and distress is unknown. We sought to investigate this in a survey of end of life care completed by bereaved relatives.

Methods

Out of a sample of 1422 bereaved relatives we assigned potential participants to one of two study groups: an ‘opt in’ group (n=711) where a letter of invitation was issued with a reply slip to request a copy of the questionnaire; or an ‘opt out’ group (n=711) where the survey questionnaire was provided alongside the invitation letter. We assessed response and distress between groups.

Results

From a sample of 1422, 473 participants returned questionnaires. Response was higher in the ‘opt out’ group than in the ‘opt in’ group (40% compared to 26.4%: χ2 =29.79, p-value<.01), there were no differences in distress or complaints about the survey between groups, and assignment to the ‘opt out’ group was an independent predictor of response (OR=1.84, 95% CI: 1.45-2.34). Moreover, the ‘opt in’ group were more likely to decline to participate (χ2=28.60, p-value<.01) and there was a difference in the pattern of questionnaire responses between study groups.

Conclusion

Given that the ‘opt out’ method of recruitment is associated with a higher response than the ‘opt in’ method, seems to have no impact on complaints or distress about the survey, and there are differences in the patterns of responses between groups, the ‘opt out’ method could be recommended as the most efficient way to recruit into surveys, even in those with a sensitive nature.
Literature
1.
go back to reference Angus VC, Entwistle VA, Emslie MJ, Walker KA, Andrew JE: The requirement for prior consent to participate on survey response rates: a population-based survey in Grampian. BMC Health Serv Res. 2003, 3: 21-10.1186/1472-6963-3-21.CrossRefPubMedPubMedCentral Angus VC, Entwistle VA, Emslie MJ, Walker KA, Andrew JE: The requirement for prior consent to participate on survey response rates: a population-based survey in Grampian. BMC Health Serv Res. 2003, 3: 21-10.1186/1472-6963-3-21.CrossRefPubMedPubMedCentral
2.
go back to reference Cartwright A: Health surveys in practice and in potential. 1983, London: King’s Fund Publishing Office Cartwright A: Health surveys in practice and in potential. 1983, London: King’s Fund Publishing Office
3.
go back to reference Iverson A, Liddell K, Fear N, Hotopf M, Wessely S: Consent, confidentiality, and the Data Protection Act. Br Med J. 2006, 332: 165-169. 10.1136/bmj.332.7534.165.CrossRef Iverson A, Liddell K, Fear N, Hotopf M, Wessely S: Consent, confidentiality, and the Data Protection Act. Br Med J. 2006, 332: 165-169. 10.1136/bmj.332.7534.165.CrossRef
4.
go back to reference Biener L, Garrett CA, Gilpin EA, Roman AM, Currivan DB: Consequences of declining survey response rates for smoking prevalence estimates. Am J Prev Med. 2004, 27: 254-257. 10.1016/j.amepre.2004.05.006.CrossRefPubMed Biener L, Garrett CA, Gilpin EA, Roman AM, Currivan DB: Consequences of declining survey response rates for smoking prevalence estimates. Am J Prev Med. 2004, 27: 254-257. 10.1016/j.amepre.2004.05.006.CrossRefPubMed
5.
go back to reference Steeh CG: Trends in nonresponse rates, 1952–1979. Pub Opinion Quart. 1981, 45: 40-57. 10.1086/268633.CrossRef Steeh CG: Trends in nonresponse rates, 1952–1979. Pub Opinion Quart. 1981, 45: 40-57. 10.1086/268633.CrossRef
6.
go back to reference Kiezebrink K, Crombie I, Irvine L, Swanson V, Power K, Wrieden W, Slane P: Strategies for achieving a high response rate in a home interview survey. BMC Med Res Methodology. 2009, 9: 46-10.1186/1471-2288-9-46.CrossRef Kiezebrink K, Crombie I, Irvine L, Swanson V, Power K, Wrieden W, Slane P: Strategies for achieving a high response rate in a home interview survey. BMC Med Res Methodology. 2009, 9: 46-10.1186/1471-2288-9-46.CrossRef
7.
go back to reference Baruch Y, Holtom B: Survey response rate levels and trends in organizational research. Human Relations. 2008, 61: 1139-1160. 10.1177/0018726708094863.CrossRef Baruch Y, Holtom B: Survey response rate levels and trends in organizational research. Human Relations. 2008, 61: 1139-1160. 10.1177/0018726708094863.CrossRef
8.
go back to reference Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17: 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17: 643-653. 10.1016/j.annepidem.2007.03.013.CrossRefPubMed
9.
go back to reference Kelley K, Clark B, Brown V, Sitzia J: Good practice in the conduct and reporting of survey research. Int J Qual Health Care. 2003, 15: 261-266. 10.1093/intqhc/mzg031.CrossRefPubMed Kelley K, Clark B, Brown V, Sitzia J: Good practice in the conduct and reporting of survey research. Int J Qual Health Care. 2003, 15: 261-266. 10.1093/intqhc/mzg031.CrossRefPubMed
10.
go back to reference Hewison J, Haines A: Overcoming barriers to recruitment in health research. Br Med J. 2006, 333: 300-302. 10.1136/bmj.333.7562.300.CrossRef Hewison J, Haines A: Overcoming barriers to recruitment in health research. Br Med J. 2006, 333: 300-302. 10.1136/bmj.333.7562.300.CrossRef
11.
go back to reference Duke S, Bennett H: A narrative review of the published ethical debates in palliative care research and an assessment of the adequacy to inform research governance. Pall Med. 2010, 24: 111-126. 10.1177/0269216309352714.CrossRef Duke S, Bennett H: A narrative review of the published ethical debates in palliative care research and an assessment of the adequacy to inform research governance. Pall Med. 2010, 24: 111-126. 10.1177/0269216309352714.CrossRef
12.
go back to reference Vellinga V, Cormican M, Hanahoe B, Bennett K, Murphy AW: Opt-out as an acceptable method of obtaining consent in medical research: a short report. BMC Med Res Methodology. 2011, 11: 40-10.1186/1471-2288-11-40.CrossRef Vellinga V, Cormican M, Hanahoe B, Bennett K, Murphy AW: Opt-out as an acceptable method of obtaining consent in medical research: a short report. BMC Med Res Methodology. 2011, 11: 40-10.1186/1471-2288-11-40.CrossRef
13.
go back to reference Gardiner C, Barnes S, Small N, Gott M, Payne S, Seamark D, Halpin D: Reconciling informed consent and ‘do no harm’: ethical challenges in palliative care research and practice in chronic obstructive pulmonary disease. Pall Med. 2010, 24: 468-472.CrossRef Gardiner C, Barnes S, Small N, Gott M, Payne S, Seamark D, Halpin D: Reconciling informed consent and ‘do no harm’: ethical challenges in palliative care research and practice in chronic obstructive pulmonary disease. Pall Med. 2010, 24: 468-472.CrossRef
14.
go back to reference Jungans C, Jones M: Consent bias in research: how to avoid it. Heart. 2007, 93: 1024-1025. 10.1136/hrt.2007.120113.CrossRef Jungans C, Jones M: Consent bias in research: how to avoid it. Heart. 2007, 93: 1024-1025. 10.1136/hrt.2007.120113.CrossRef
15.
go back to reference Clark AM, Jamieson R, Findlay IN: Registries and informed consent. N Engl J Med. 2004, 351: 612-614.CrossRefPubMed Clark AM, Jamieson R, Findlay IN: Registries and informed consent. N Engl J Med. 2004, 351: 612-614.CrossRefPubMed
16.
go back to reference Hunt KJ, Shlomo N, Richardson A, Addington-Hall JM: VOICES redesign and testing to inform a national end of life care survey. 2011, Southampton: University of Southampton Hunt KJ, Shlomo N, Richardson A, Addington-Hall JM: VOICES redesign and testing to inform a national end of life care survey. 2011, Southampton: University of Southampton
17.
go back to reference Nelson K, Garcia RE, Brown J, Mangione CM, Louis TA, Keelier E, Cretin S: Do patient consent procedures affect participation rates in health services research?. Med Care. 2002, 40: 283-288. 10.1097/00005650-200204000-00004.CrossRefPubMed Nelson K, Garcia RE, Brown J, Mangione CM, Louis TA, Keelier E, Cretin S: Do patient consent procedures affect participation rates in health services research?. Med Care. 2002, 40: 283-288. 10.1097/00005650-200204000-00004.CrossRefPubMed
18.
go back to reference Ingleton C, Morgan J, Hughes P, Noble B, Evans A, Clark D: Carer satisfaction with end of life care in Powys, Wales: a cross-sectional survey. Health Soc Care Community. 2004, 12: 43-52. 10.1111/j.1365-2524.2004.00467.x.CrossRefPubMed Ingleton C, Morgan J, Hughes P, Noble B, Evans A, Clark D: Carer satisfaction with end of life care in Powys, Wales: a cross-sectional survey. Health Soc Care Community. 2004, 12: 43-52. 10.1111/j.1365-2524.2004.00467.x.CrossRefPubMed
19.
go back to reference Junghans C, Feder G, Hemingway H, Timmis A, Jones M: Recruiting patients to medical research: double blind randomised trial of ‘opt in’ versus ‘opt out’ strategies. Br Med J. 2005, 331: 940-10.1136/bmj.38583.625613.AE.CrossRef Junghans C, Feder G, Hemingway H, Timmis A, Jones M: Recruiting patients to medical research: double blind randomised trial of ‘opt in’ versus ‘opt out’ strategies. Br Med J. 2005, 331: 940-10.1136/bmj.38583.625613.AE.CrossRef
20.
go back to reference French K: Methodological considerations in hospital patient opinion surveys. Int J Nurs Stud. 1981, 18: 7-32. 10.1016/0020-7489(81)90004-3.CrossRefPubMed French K: Methodological considerations in hospital patient opinion surveys. Int J Nurs Stud. 1981, 18: 7-32. 10.1016/0020-7489(81)90004-3.CrossRefPubMed
21.
go back to reference Koh ME, Duffett M, Willison DJ: Written informed consent and selection bias in observational studies using medical records: systematic review. Br Med J. 2009, 338: b866-10.1136/bmj.b866.CrossRef Koh ME, Duffett M, Willison DJ: Written informed consent and selection bias in observational studies using medical records: systematic review. Br Med J. 2009, 338: b866-10.1136/bmj.b866.CrossRef
22.
go back to reference Pegg MS: Overcoming barriers to health research: some research ethics committees believe in facilitating health research. Br Med J. 2006, 333: 398-CrossRef Pegg MS: Overcoming barriers to health research: some research ethics committees believe in facilitating health research. Br Med J. 2006, 333: 398-CrossRef
23.
go back to reference Walley T: Using personal health information in medical research. Br Med J. 2006, 332: 130-132. 10.1136/bmj.332.7534.130.CrossRef Walley T: Using personal health information in medical research. Br Med J. 2006, 332: 130-132. 10.1136/bmj.332.7534.130.CrossRef
24.
go back to reference Shlomo N, Schouten B, Skinner CJ: Estimation of an indicator of the representativeness of survey response. Journal of Statistical Planning and Inference 142. 2012, 201: 211- Shlomo N, Schouten B, Skinner CJ: Estimation of an indicator of the representativeness of survey response. Journal of Statistical Planning and Inference 142. 2012, 201: 211-
25.
go back to reference Boardman HF, Thomas E, Ogden H, Croft PR, Millson DS: A method to determine if consenters to population surveys are representative of the target population. J Public Health Med. 2005, 27: 129-137.CrossRef Boardman HF, Thomas E, Ogden H, Croft PR, Millson DS: A method to determine if consenters to population surveys are representative of the target population. J Public Health Med. 2005, 27: 129-137.CrossRef
26.
go back to reference Edwards P, Roberts I, Clarke M, diGiuseppe C, Pratap S, Wentz R, Kwan I: Increasing response to postal questionnaires: systematic review. Br Med J. 2002, 324: 1183-10.1136/bmj.324.7347.1183.CrossRef Edwards P, Roberts I, Clarke M, diGiuseppe C, Pratap S, Wentz R, Kwan I: Increasing response to postal questionnaires: systematic review. Br Med J. 2002, 324: 1183-10.1136/bmj.324.7347.1183.CrossRef
27.
go back to reference Crombie IK, McMurdo MET: Overcoming barriers to recruitment in health research: concerns of individual participants need to be dealt with. Br Med J. 2006, 333: 398-CrossRef Crombie IK, McMurdo MET: Overcoming barriers to recruitment in health research: concerns of individual participants need to be dealt with. Br Med J. 2006, 333: 398-CrossRef
28.
go back to reference Ellershaw J, Ward C: Care of the dying patient: the last hours or days of life. Br Med J. 2003, 326 (7379): 30-34. 10.1136/bmj.326.7379.30.CrossRef Ellershaw J, Ward C: Care of the dying patient: the last hours or days of life. Br Med J. 2003, 326 (7379): 30-34. 10.1136/bmj.326.7379.30.CrossRef
Metadata
Title
Participant recruitment in sensitive surveys: a comparative trial of ‘opt in’ versus ‘opt out’ approaches
Authors
Katherine J Hunt
Natalie Shlomo
Julia Addington-Hall
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-3

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue