Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Randomised trials comparing different healthcare settings: an exploratory review of the impact of pre-trial preferences on participation, and discussion of other methodological challenges

Authors: Mark S. Corbett, Judith Watson, Alison Eastwood

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

We recently published a systematic review of different healthcare settings (such as outpatient, community or home) for administering intravenous chemotherapy, and concluded that performing conventionally designed randomised trials was difficult. The main problems were achieving adequate trial accrual rates and recruiting a study population which adequately represented the target population of interest. These issues stemmed from the fact that potential participants may have had pre-trial perceptions about the trial settings they may be allocated; such preferences will sometimes be strong enough for patients to decline an invitation to participate in a trial. A patient preference trial design (in which patients can choose, or be randomised to, an intervention) may have obviated these recruitment issues, although none of the trials used such a design.

Methods

In order to gain a better understanding of the broader prevalence and extent of these preference issues (and any other methodological challenges), we undertook an exploratory review of settings trials in any area of healthcare treatment research. We searched The Cochrane Library and Google Scholar and used snowballing methods to identify trials comparing different healthcare settings.

Results

Trial accrual was affected by patient preferences for a setting in 15 of the 16 identified studies; birth setting trials were the most markedly affected, with between 68 % and 85 % of eligible women declining to participate specifically because of preference for a particular healthcare setting. Recruitment into substance abuse and chemotherapy setting studies was also notably affected by preferences. Only four trials used a preference design: the proportion of eligible patients choosing to participate via a preference group ranged from between 33 % and 67 %.

Conclusions

In trials of healthcare settings, accrual may be seriously affected by patient preferences. The use of trial designs which incorporate a preference component should therefore strongly be considered. When designing such trials, investigators should consider settings to be complex interventions, which are likely to have linked components which may be difficult to control for. Careful thought is also needed regarding the choice of comparator settings and the most appropriate outcome measures to be used.
Literature
1.
go back to reference Ulrich RS, Zimring C, Zhu XM, DuBose J, Seo HB, Choi YS, et al. A Review of the Research Literature on Evidence-Based Healthcare Design. Herd-Health Env Res. 2008;1(3):61–125. Ulrich RS, Zimring C, Zhu XM, DuBose J, Seo HB, Choi YS, et al. A Review of the Research Literature on Evidence-Based Healthcare Design. Herd-Health Env Res. 2008;1(3):61–125.
2.
go back to reference Elf M, Frost P, Lindahl G, Wijk H. Shared decision making in designing new healthcare environments-time to begin improving quality. BMC Health Serv Res. 2015;15. doi:10.1186/s12913-015-0782-7. Elf M, Frost P, Lindahl G, Wijk H. Shared decision making in designing new healthcare environments-time to begin improving quality. BMC Health Serv Res. 2015;15. doi:10.​1186/​s12913-015-0782-7.
3.
go back to reference The NIHR Health Services and Delivery Research (HS&DR) Programme. Applying for research funding. Southampton: HS&DR Programme, National Institue for Health Research. 2013. The NIHR Health Services and Delivery Research (HS&DR) Programme. Applying for research funding. Southampton: HS&DR Programme, National Institue for Health Research. 2013.
4.
go back to reference Corbett M, Heirs M, Rose M, Smith A, Stirk L, Richardson G, et al. The delivery of chemotherapy at home: an evidence synthesis. Health Serv Deliv Res. 2015;3(14):1–182.CrossRef Corbett M, Heirs M, Rose M, Smith A, Stirk L, Richardson G, et al. The delivery of chemotherapy at home: an evidence synthesis. Health Serv Deliv Res. 2015;3(14):1–182.CrossRef
6.
go back to reference King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, et al. Impact of participant and physician intervention preferences on randomized trials. A systematic review. JAMA. 2005;293(9):1089–99.CrossRefPubMed King M, Nazareth I, Lampe F, Bower P, Chandler M, Morou M, et al. Impact of participant and physician intervention preferences on randomized trials. A systematic review. JAMA. 2005;293(9):1089–99.CrossRefPubMed
8.
go back to reference Bradley C. Designing Medical and Educational Intervention Studies-a Review of Some Alternatives to Conventional Randomized Controlled Trials. Diabetes Care. 1993;16(2):509–18.CrossRefPubMed Bradley C. Designing Medical and Educational Intervention Studies-a Review of Some Alternatives to Conventional Randomized Controlled Trials. Diabetes Care. 1993;16(2):509–18.CrossRefPubMed
9.
go back to reference Moberly T. Service redesign should be tested as rigorously as new treatments, NHS chief says. BMJ. 2014;348:g3744.CrossRefPubMed Moberly T. Service redesign should be tested as rigorously as new treatments, NHS chief says. BMJ. 2014;348:g3744.CrossRefPubMed
10.
go back to reference Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ (Clinical research ed ). 2005;331(7524):1064–5.CrossRef Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ (Clinical research ed ). 2005;331(7524):1064–5.CrossRef
11.
12.
go back to reference Remonnay R, Devaux Y, Chauvin F, Dubost E, Carrere MO. Economic evaluation of antineoplastic chemotherapy administered at home or in hospitals. Int J Technol Assess Health Care. 2002;18(3):508–19.PubMed Remonnay R, Devaux Y, Chauvin F, Dubost E, Carrere MO. Economic evaluation of antineoplastic chemotherapy administered at home or in hospitals. Int J Technol Assess Health Care. 2002;18(3):508–19.PubMed
14.
go back to reference McKay JR, Alterman AI, McLellan AT, Boardman CR, Mulvaney FD, O’Brien CP. Random versus nonrandom assignment in the evaluation of treatment for cocaine abusers. J Consult Clin Psychol. 1998;66(4):697–701.CrossRefPubMed McKay JR, Alterman AI, McLellan AT, Boardman CR, Mulvaney FD, O’Brien CP. Random versus nonrandom assignment in the evaluation of treatment for cocaine abusers. J Consult Clin Psychol. 1998;66(4):697–701.CrossRefPubMed
15.
go back to reference McKay JR, Alterman AI, McLellan AT, Snider EC, O’Brien CP. Effect of random versus nonrandom assignment in a comparison of inpatient and day hospital rehabilitation for male alcoholics. J Consult Clin Psychol. 1995;63(1):70–8.CrossRefPubMed McKay JR, Alterman AI, McLellan AT, Snider EC, O’Brien CP. Effect of random versus nonrandom assignment in a comparison of inpatient and day hospital rehabilitation for male alcoholics. J Consult Clin Psychol. 1995;63(1):70–8.CrossRefPubMed
16.
go back to reference Dalal HM, Evans PH, Campbell JL, Taylor RS, Watt A, Read KL, et al. Home-based versus hospital-based rehabilitation after myocardial infarction: a randomized trial with preference arms-Cornwall Heart Attack Rehabilitation Management Study (CHARMS). Int J Cardiol. 2007;119(2):202–11. doi:10.1016/j.ijcard.2006.11.018.CrossRefPubMed Dalal HM, Evans PH, Campbell JL, Taylor RS, Watt A, Read KL, et al. Home-based versus hospital-based rehabilitation after myocardial infarction: a randomized trial with preference arms-Cornwall Heart Attack Rehabilitation Management Study (CHARMS). Int J Cardiol. 2007;119(2):202–11. doi:10.​1016/​j.​ijcard.​2006.​11.​018.CrossRefPubMed
18.
go back to reference Jolly K, Taylor R, Lip G, Greenfield S, Raftery J, Mant J, et al. The Birmingham Rehabilitation Uptake Maximisation Study (BRUM). Home-based compared with hospital-based cardiac rehabilitation in a multi-ethnic population: cost-effectiveness and patient adherence. Health Technol Assess. 2007;11(35):1–118.CrossRefPubMed Jolly K, Taylor R, Lip G, Greenfield S, Raftery J, Mant J, et al. The Birmingham Rehabilitation Uptake Maximisation Study (BRUM). Home-based compared with hospital-based cardiac rehabilitation in a multi-ethnic population: cost-effectiveness and patient adherence. Health Technol Assess. 2007;11(35):1–118.CrossRefPubMed
21.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337(7676). doi: 10.1136/bmj.a1655. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337(7676). doi: 10.​1136/​bmj.​a1655.
24.
go back to reference Wilson A, Hardy A, Armstrong N, Baines D, Baker R, Crossman R, et al. A cluster randomised controlled trial of the effectiveness and cost-effectiveness of intermediate care clinics for diabetes (ICCD). Final report. NIHR Service Delivery and Organisation programme: Southampton; 2013. Wilson A, Hardy A, Armstrong N, Baines D, Baker R, Crossman R, et al. A cluster randomised controlled trial of the effectiveness and cost-effectiveness of intermediate care clinics for diabetes (ICCD). Final report. NIHR Service Delivery and Organisation programme: Southampton; 2013.
25.
go back to reference Thurgood S, Crosby H, Raistrick D, Tober G. Service user, family and friends’ views on the meaning of a ‘good outcome’ of treatment for an addiction problem. Drug-Educ Prev Polic. 2014;21(4):324–32. doi:10.3109/09687637.2014.899987.CrossRef Thurgood S, Crosby H, Raistrick D, Tober G. Service user, family and friends’ views on the meaning of a ‘good outcome’ of treatment for an addiction problem. Drug-Educ Prev Polic. 2014;21(4):324–32. doi:10.​3109/​09687637.​2014.​899987.CrossRef
26.
go back to reference de C Williams DC, Nicholas MK, Richardson PH, Pither CE, Fernandes J. Generalizing from a controlled trial: the effects of patient preference versus randomization on the outcome of inpatient versus outpatient chronic pain management. Pain. 1993;83:57–65.CrossRef de C Williams DC, Nicholas MK, Richardson PH, Pither CE, Fernandes J. Generalizing from a controlled trial: the effects of patient preference versus randomization on the outcome of inpatient versus outpatient chronic pain management. Pain. 1993;83:57–65.CrossRef
28.
go back to reference Burchett H, Umoquit M, Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Policy. 2011;16(4):238–44. doi:10.1258/jhsrp.2011.010124.CrossRefPubMed Burchett H, Umoquit M, Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Policy. 2011;16(4):238–44. doi:10.​1258/​jhsrp.​2011.​010124.CrossRefPubMed
30.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:869. doi:10.1136/bmj.c869.CrossRef Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:869. doi:10.​1136/​bmj.​c869.CrossRef
Metadata
Title
Randomised trials comparing different healthcare settings: an exploratory review of the impact of pre-trial preferences on participation, and discussion of other methodological challenges
Authors
Mark S. Corbett
Judith Watson
Alison Eastwood
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1823-6

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue