Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Protocol

A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials

Authors: Heidi R. Gardner, Cynthia Fraser, Graeme MacLennan, Shaun Treweek

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

Randomised controlled trials guard against selection bias and therefore offer the fairest way of evaluating healthcare interventions such as medicinal products, devices and services. Recruitment to trials can be extremely difficult, and poor recruitment can lead to extensions to both time and budget and may result in an underpowered study which does not satisfactorily answer the original research question. In the worst cases, a trial may be abandoned, causing huge waste. The evidence to support the choice of recruitment interventions is currently weak. Non-randomised evaluations of recruitment interventions are currently rejected on grounds of poor methodological quality, but systematic evaluation and assessment of this substantial body of work (using Grading of Recommendations Assessment, Development and Evaluation (GRADE) where possible) may provide useful information to support and inform the recruitment decisions of trialists and the research priorities of methodology researchers.

Methods

The following databases will be searched for relevant studies: Cochrane Methodology Register, MEDLINE, EMBASE, CINAHL and PsycINFO. Any non-randomised study that includes a comparison of two or more interventions to improve recruitment to randomised controlled trials will be included. We will not apply any restrictions on publication date, language or journal. The primary outcome will be the number of individuals or centres recruited into a randomised controlled trial. The secondary outcome will be cost per recruit. Two reviewers will independently screen abstracts for eligible studies, and then, full texts of potentially relevant records will be reviewed. Disagreements will be resolved through discussion. The methodological quality of studies will be assessed using the Cochrane risk of bias tool for non-randomised studies, and the GRADE system will be used if studies are pooled.

Discussion

This review aims to summarise the evidence on methods used to improve recruitment to randomised controlled trials. Carrying out a systematic review including only data from non-randomised studies is a novel approach, and one which some may argue is futile. However, we believe that the systematic evaluation of what is likely to be a substantial amount of research activity is necessary, worthwhile, and will yield valuable results for the clinical trials community regardless of whether the outcomes find in favour of one or more interventions.
Should the results of this review suggest that non-randomised evaluations do have something to offer trialists planning their recruitment strategies, the review may be combined in the future with the Cochrane review of randomised evaluations to produce a full review of recruitment strategies encompassing both randomised and non-randomised evaluation methods.

Systematic review registration

PROSPERO CRD42016037718
Appendix
Available only for authorised users
Literature
1.
go back to reference Gheorghiade M, Vaduganathan M, Greene SJ, Mentz RJ, Adams Jr KF, Anker SD, Arnold M, Baschiera F, Cleland JG, Cotter G, Fonarow GC, Giordano C, Metra M, Misselwitz F, Muhlhofer E, Nodari S, Frank Peacock W, Pieske BM, Sabbah HN, Sato N, Shah MR, Stockbridge NL, Teerlink JR, van Veldhuisen DJ, Zalewski A, Zannad F, Butler J. Site selection in global clinical trials in patients hospitalized for heart failure: perceived problems and potential solutions. Heart Fail Rev. 2014;19(2):135–52.CrossRefPubMedPubMedCentral Gheorghiade M, Vaduganathan M, Greene SJ, Mentz RJ, Adams Jr KF, Anker SD, Arnold M, Baschiera F, Cleland JG, Cotter G, Fonarow GC, Giordano C, Metra M, Misselwitz F, Muhlhofer E, Nodari S, Frank Peacock W, Pieske BM, Sabbah HN, Sato N, Shah MR, Stockbridge NL, Teerlink JR, van Veldhuisen DJ, Zalewski A, Zannad F, Butler J. Site selection in global clinical trials in patients hospitalized for heart failure: perceived problems and potential solutions. Heart Fail Rev. 2014;19(2):135–52.CrossRefPubMedPubMedCentral
2.
go back to reference Odgaard-Jensen J, Vist GE, Timmer A, Kunz R, Akl EA, Schunemann H, Briel M, Nordmann AJ, Pregno S, Oxman AD. Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews. 2011;00001:(4)MR. Odgaard-Jensen J, Vist GE, Timmer A, Kunz R, Akl EA, Schunemann H, Briel M, Nordmann AJ, Pregno S, Oxman AD. Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews. 2011;00001:(4)MR.
3.
go back to reference Charlson ME, Horwitz RI. Applying results of randomised trials to clinical practice: impact of losses before randomisation. Br Med J (Clin Res Ed). 1984;289(6454):1281–4.CrossRef Charlson ME, Horwitz RI. Applying results of randomised trials to clinical practice: impact of losses before randomisation. Br Med J (Clin Res Ed). 1984;289(6454):1281–4.CrossRef
4.
go back to reference Haidich A, Ioannidis JPA. Patterns of patient enrolment in randomized controlled trials. J Clin Epidemiol. 2001;54(9):877–83.CrossRefPubMed Haidich A, Ioannidis JPA. Patterns of patient enrolment in randomized controlled trials. J Clin Epidemiol. 2001;54(9):877–83.CrossRefPubMed
5.
go back to reference Foy R, Parry J, Duggan A, Delaney B, Wilson S, Lewin-Van Den Broek NT, Lassen A, Vickers L, Myres P. How evidence based are recruitment strategies to randomized controlled trials in primary care? Experience from seven studies. Fam Pract. 2003;20(1):83–92.CrossRefPubMed Foy R, Parry J, Duggan A, Delaney B, Wilson S, Lewin-Van Den Broek NT, Lassen A, Vickers L, Myres P. How evidence based are recruitment strategies to randomized controlled trials in primary care? Experience from seven studies. Fam Pract. 2003;20(1):83–92.CrossRefPubMed
6.
go back to reference McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9 [Electronic Resource].CrossRefPubMedPubMedCentral McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9 [Electronic Resource].CrossRefPubMedPubMedCentral
7.
go back to reference Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.CrossRefPubMedPubMedCentral Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.CrossRefPubMedPubMedCentral
8.
go back to reference Raftery J, Young A, Stanton L, Milne R, Cook A, Turner D, Davidson P. Clinical trial metadata: defining and extracting metadata on the design, conduct, results and costs of 125 randomised clinical trials funded by the National Institute for Health Research Health Technology Assessment programme. Health Technol Assess. 2015;19(11):1–138.CrossRef Raftery J, Young A, Stanton L, Milne R, Cook A, Turner D, Davidson P. Clinical trial metadata: defining and extracting metadata on the design, conduct, results and costs of 125 randomised clinical trials funded by the National Institute for Health Research Health Technology Assessment programme. Health Technol Assess. 2015;19(11):1–138.CrossRef
9.
go back to reference Treweek S, Mitchell E, Pitkethly M, Cook J, Kjeldstrøm M, Johansen M, Taskila TK, Sullivan F, Wilson S, Jackson C, Jones R, Lockhart P. Strategies to improve recruitment to randomised controlled trials. Cochrane Database of Systematic Reviews 2010, Issue 4. Art. No.: MR000013. doi:10.1002/14651858.MR000013.pub5. Treweek S, Mitchell E, Pitkethly M, Cook J, Kjeldstrøm M, Johansen M, Taskila TK, Sullivan F, Wilson S, Jackson C, Jones R, Lockhart P. Strategies to improve recruitment to randomised controlled trials. Cochrane Database of Systematic Reviews 2010, Issue 4. Art. No.: MR000013. doi:10.​1002/​14651858.​MR000013.​pub5.
10.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ. GRADE working group: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ. GRADE working group: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6.CrossRefPubMedPubMedCentral
11.
go back to reference Smith V, Clarke M, Devane D, Begley C, Shorter G, Maguire L. SWAT 1: what effects do site visits by the principal investigator have on recruitment in a multicentre randomized trial? J Evid Based Med. 2013;6:136–7.CrossRefPubMed Smith V, Clarke M, Devane D, Begley C, Shorter G, Maguire L. SWAT 1: what effects do site visits by the principal investigator have on recruitment in a multicentre randomized trial? J Evid Based Med. 2013;6:136–7.CrossRefPubMed
12.
go back to reference Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, Rait G. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4(2):e003821.CrossRefPubMedPubMedCentral Brueton VC, Tierney JF, Stenning S, Meredith S, Harding S, Nazareth I, Rait G. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4(2):e003821.CrossRefPubMedPubMedCentral
13.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. 2009;00000:(3)MR. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. 2009;00000:(3)MR.
15.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ. GRADE working group: GRADE: going from evidence to recommendations. BMJ. 2008;336:1049–51.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ. GRADE working group: GRADE: going from evidence to recommendations. BMJ. 2008;336:1049–51.CrossRefPubMedPubMedCentral
16.
go back to reference Treweek S, Altman DG, Bower P, Campbell M, Chalmers I, Cotton S, et al. Making randomised trials more efficient: report of the first meeting to discuss the Trial Forge platform. Trials. 2015;16:261.CrossRefPubMedPubMedCentral Treweek S, Altman DG, Bower P, Campbell M, Chalmers I, Cotton S, et al. Making randomised trials more efficient: report of the first meeting to discuss the Trial Forge platform. Trials. 2015;16:261.CrossRefPubMedPubMedCentral
Metadata
Title
A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials
Authors
Heidi R. Gardner
Cynthia Fraser
Graeme MacLennan
Shaun Treweek
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0308-3

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue