Skip to main content
Top
Published in: Trials 1/2009

Open Access 01-12-2009 | Research

A review of reporting of participant recruitment and retention in RCTs in six major journals

Authors: Merran Toerien, Sara T Brookes, Chris Metcalfe, Isabel de Salis, Zelda Tomlin, Tim J Peters, Jonathan Sterne, Jenny L Donovan

Published in: Trials | Issue 1/2009

Login to get access

Abstract

Background

Poor recruitment and retention of participants in randomised controlled trials (RCTs) is problematic but common. Clear and detailed reporting of participant flow is essential to assess the generalisability and comparability of RCTs. Despite improved reporting since the implementation of the CONSORT statement, important problems remain. This paper aims: (i) to update and extend previous reviews evaluating reporting of participant recruitment and retention in RCTs; (ii) to quantify the level of participation throughout RCTs.

Methods

We reviewed all reports of RCTs of health care interventions and/or processes with individual randomisation, published July–December 2004 in six major journals. Short, secondary or interim reports, and Phase I/II trials were excluded. Data recorded were: general RCT details; inclusion of flow diagram; participant flow throughout trial; reasons for non-participation/withdrawal; target sample sizes.

Results

133 reports were reviewed. Overall, 79% included a flow diagram, but over a third were incomplete. The majority reported the flow of participants at each stage of the trial after randomisation. However, 40% failed to report the numbers assessed for eligibility. Percentages of participants retained at each stage were high: for example, 90% of eligible individuals were randomised, and 93% of those randomised were outcome assessed. On average, trials met their sample size targets. However, there were some substantial shortfalls: for example 21% of trials reporting a sample size calculation failed to achieve adequate numbers at randomisation, and 48% at outcome assessment. Reporting of losses to follow up was variable and difficult to interpret.

Conclusion

The majority of RCTs reported the flow of participants well after randomisation, although only two-thirds included a complete flow chart and there was great variability over the definition of "lost to follow up". Reporting of participant eligibility was poor, making assessments of recruitment practice and external validity difficult. Reporting of participant flow throughout RCTs could be improved by small changes to the CONSORT chart.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vist GE, Hagen KB, Devereaux PJ, Bryant D, Kristoffersen DT, Oxman AD: Systematic review to determine whether participation in a trial influences outcome. BMJ. 2005, 330 (7501): 1175-1181. 10.1136/bmj.330.7501.1175.CrossRefPubMedPubMedCentral Vist GE, Hagen KB, Devereaux PJ, Bryant D, Kristoffersen DT, Oxman AD: Systematic review to determine whether participation in a trial influences outcome. BMJ. 2005, 330 (7501): 1175-1181. 10.1136/bmj.330.7501.1175.CrossRefPubMedPubMedCentral
3.
go back to reference McKee M, Britton A, Black N, McPherson K, Sanderson C, Bain C: Interpreting the evidence: choosing between randomised and non-randomised studies. BMJ. 1999, 319 (7205): 312-315.CrossRefPubMedPubMedCentral McKee M, Britton A, Black N, McPherson K, Sanderson C, Bain C: Interpreting the evidence: choosing between randomised and non-randomised studies. BMJ. 1999, 319 (7205): 312-315.CrossRefPubMedPubMedCentral
4.
go back to reference Wright JR, Bouma S, Dayes I, Sussman J, Simunovic MR, Levine MN, Whelan TJ: The importance of reporting patient recruitment details in phase III trials. J Clin Oncol. 2006, 24 (6): 843-845. 10.1200/JCO.2005.02.6005.CrossRefPubMed Wright JR, Bouma S, Dayes I, Sussman J, Simunovic MR, Levine MN, Whelan TJ: The importance of reporting patient recruitment details in phase III trials. J Clin Oncol. 2006, 24 (6): 843-845. 10.1200/JCO.2005.02.6005.CrossRefPubMed
5.
go back to reference Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH: The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the Consolidated Standards of Reporting Trials (CONSORT) checklist. Control Clin Trials. 2002, 23: 380-388. 10.1016/S0197-2456(02)00214-3.CrossRefPubMed Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH: The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the Consolidated Standards of Reporting Trials (CONSORT) checklist. Control Clin Trials. 2002, 23: 380-388. 10.1016/S0197-2456(02)00214-3.CrossRefPubMed
6.
go back to reference Egger M, Jüni P, Bartlett C: Value of flow diagrams in reports of randomized controlled trials. JAMA. 2001, 285 (15): 1996-1999. 10.1001/jama.285.15.1996.CrossRefPubMed Egger M, Jüni P, Bartlett C: Value of flow diagrams in reports of randomized controlled trials. JAMA. 2001, 285 (15): 1996-1999. 10.1001/jama.285.15.1996.CrossRefPubMed
7.
go back to reference Gross CP, Mallory R, Heiat A, Krumholz HM: Reporting the recruitment process in clinical trials: who are these patients and how did they get there?. Ann Intern Med. 2002, 137: 10-16.CrossRefPubMed Gross CP, Mallory R, Heiat A, Krumholz HM: Reporting the recruitment process in clinical trials: who are these patients and how did they get there?. Ann Intern Med. 2002, 137: 10-16.CrossRefPubMed
8.
go back to reference Kane RL, Wang J, Garrard J: Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol. 2007, 60 (3): 241-249. 10.1016/j.jclinepi.2006.06.016.CrossRefPubMed Kane RL, Wang J, Garrard J: Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol. 2007, 60 (3): 241-249. 10.1016/j.jclinepi.2006.06.016.CrossRefPubMed
9.
go back to reference Moher D, Jones A, Lepage L: Use of the CONSORT statement and quality of reports of randomized trials. JAMA. 2001, 285 (15): 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, Lepage L: Use of the CONSORT statement and quality of reports of randomized trials. JAMA. 2001, 285 (15): 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed
10.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134 (8): 663-694.CrossRefPubMed Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134 (8): 663-694.CrossRefPubMed
11.
go back to reference Folkes A, Urquhart R, Grunfeld E: Are leading medical journals following their own policies on CONSORT reporting?. Contemp Clin Trials. 2008, 29 (6): 843-846. 10.1016/j.cct.2008.07.004.CrossRefPubMed Folkes A, Urquhart R, Grunfeld E: Are leading medical journals following their own policies on CONSORT reporting?. Contemp Clin Trials. 2008, 29 (6): 843-846. 10.1016/j.cct.2008.07.004.CrossRefPubMed
12.
go back to reference Mills EJ, Wu P, Gagnier J, Devereaux PJ: The quality of randomized trial reporting in leading medical journals since the revised CONSORT statement. Con Clin Trials. 2005, 26: 480-487. 10.1016/j.cct.2005.02.008.CrossRef Mills EJ, Wu P, Gagnier J, Devereaux PJ: The quality of randomized trial reporting in leading medical journals since the revised CONSORT statement. Con Clin Trials. 2005, 26: 480-487. 10.1016/j.cct.2005.02.008.CrossRef
14.
15.
go back to reference Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-10.1136/bmj.b1732.CrossRefPubMedPubMedCentral Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-10.1136/bmj.b1732.CrossRefPubMedPubMedCentral
16.
go back to reference Elkins JS, Khatabi T, Fung L, Rootenberg J, Johnston SC: Recruiting subjects for acute stroke trials: a meta-analysis. Stroke. 2006, 37: 123-128. 10.1161/01.STR.0000195149.44390.aa.CrossRefPubMed Elkins JS, Khatabi T, Fung L, Rootenberg J, Johnston SC: Recruiting subjects for acute stroke trials: a meta-analysis. Stroke. 2006, 37: 123-128. 10.1161/01.STR.0000195149.44390.aa.CrossRefPubMed
17.
go back to reference McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C: What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006, 7: 9-10.1186/1745-6215-7-9.CrossRefPubMedPubMedCentral McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C: What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006, 7: 9-10.1186/1745-6215-7-9.CrossRefPubMedPubMedCentral
19.
go back to reference Vale C, Stewart L, Tierney J: Trends in UK cancer trials: results from the UK Coordinating Committee for Cancer Research National Register of Cancer Trials. Br J Cancer. 2005, 92: 811-814. 10.1038/sj.bjc.6602425.CrossRefPubMedPubMedCentral Vale C, Stewart L, Tierney J: Trends in UK cancer trials: results from the UK Coordinating Committee for Cancer Research National Register of Cancer Trials. Br J Cancer. 2005, 92: 811-814. 10.1038/sj.bjc.6602425.CrossRefPubMedPubMedCentral
20.
go back to reference Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schünemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH: An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004, 57: 1232-1236. 10.1016/j.jclinepi.2004.03.017.CrossRefPubMed Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schünemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH: An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004, 57: 1232-1236. 10.1016/j.jclinepi.2004.03.017.CrossRefPubMed
Metadata
Title
A review of reporting of participant recruitment and retention in RCTs in six major journals
Authors
Merran Toerien
Sara T Brookes
Chris Metcalfe
Isabel de Salis
Zelda Tomlin
Tim J Peters
Jonathan Sterne
Jenny L Donovan
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Trials / Issue 1/2009
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-10-52

Other articles of this Issue 1/2009

Trials 1/2009 Go to the issue