Skip to main content
Top
Published in: BMC Medicine 1/2013

Open Access 01-12-2013 | Research article

Reporting of analyses from randomized controlled trials with multiple arms: a systematic review

Authors: Gabriel Baron, Elodie Perrodeau, Isabelle Boutron, Philippe Ravaud

Published in: BMC Medicine | Issue 1/2013

Login to get access

Abstract

Background

Multiple-arm randomized trials can be more complex in their design, data analysis, and result reporting than two-arm trials. We conducted a systematic review to assess the reporting of analyses in reports of randomized controlled trials (RCTs) with multiple arms.

Methods

The literature in the MEDLINE database was searched for reports of RCTs with multiple arms published in 2009 in the core clinical journals. Two reviewers extracted data using a standardized extraction form.

Results

In total, 298 reports were identified. Descriptions of the baseline characteristics and outcomes per group were missing in 45 reports (15.1%) and 48 reports (16.1%), respectively. More than half of the articles (n = 171, 57.4%) reported that a planned global test comparison was used (that is, assessment of the global differences between all groups), but 67 (39.2%) of these 171 articles did not report details of the planned analysis. Of the 116 articles reporting a global comparison test, 12 (10.3%) did not report the analysis as planned. In all, 60% of publications (n = 180) described planned pairwise test comparisons (that is, assessment of the difference between two groups), but 20 of these 180 articles (11.1%) did not report the pairwise test comparisons. Of the 204 articles reporting pairwise test comparisons, the comparisons were not planned for 44 (21.6%) of them. Less than half the reports (n = 137; 46%) provided baseline and outcome data per arm and reported the analysis as planned.

Conclusions

Our findings highlight discrepancies between the planning and reporting of analyses in reports of multiple-arm trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cook RJ, Farewell VT: Multiplicity considerations in the design and analysis of clinical trials. J R Statistic Soc A. 1996, 159 (1): 93-110. 10.2307/2983471.CrossRef Cook RJ, Farewell VT: Multiplicity considerations in the design and analysis of clinical trials. J R Statistic Soc A. 1996, 159 (1): 93-110. 10.2307/2983471.CrossRef
3.
go back to reference Freidlin B, Korn EL, Gray R, Martin A: Multi-arm clinical trials of new agents: some design considerations. Clin Cancer Res. 2008, 14 (14): 4368-4371. 10.1158/1078-0432.CCR-08-0325.CrossRefPubMed Freidlin B, Korn EL, Gray R, Martin A: Multi-arm clinical trials of new agents: some design considerations. Clin Cancer Res. 2008, 14 (14): 4368-4371. 10.1158/1078-0432.CCR-08-0325.CrossRefPubMed
5.
go back to reference Proschan MA: A multiple comparison procedure for three- and four-armed controlled clinical trials. Stat Med. 1999, 18 (7): 787-798. 10.1002/(SICI)1097-0258(19990415)18:7<787::AID-SIM77>3.0.CO;2-M.CrossRefPubMed Proschan MA: A multiple comparison procedure for three- and four-armed controlled clinical trials. Stat Med. 1999, 18 (7): 787-798. 10.1002/(SICI)1097-0258(19990415)18:7<787::AID-SIM77>3.0.CO;2-M.CrossRefPubMed
6.
go back to reference Schulz KF, Grimes DA: Multiplicity in randomised trials I: endpoints and treatments. Lancet. 2005, 365 (9470): 1591-1595. 10.1016/S0140-6736(05)66461-6.CrossRefPubMed Schulz KF, Grimes DA: Multiplicity in randomised trials I: endpoints and treatments. Lancet. 2005, 365 (9470): 1591-1595. 10.1016/S0140-6736(05)66461-6.CrossRefPubMed
7.
go back to reference Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365 (9465): 1159-1162. 10.1016/S0140-6736(05)71879-1.CrossRefPubMed Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365 (9465): 1159-1162. 10.1016/S0140-6736(05)71879-1.CrossRefPubMed
9.
go back to reference Vermorken JB, Parmar MK, Brady MF, Eisenhauer EA, Hogberg T, Ozols RF, Rochon J, Rustin GJ, Sagae S, Verheijen RH: Clinical trials in ovarian carcinoma: study methodology. Ann Oncol. 2005, 16 (Suppl 8): viii20-viii29.PubMed Vermorken JB, Parmar MK, Brady MF, Eisenhauer EA, Hogberg T, Ozols RF, Rochon J, Rustin GJ, Sagae S, Verheijen RH: Clinical trials in ovarian carcinoma: study methodology. Ann Oncol. 2005, 16 (Suppl 8): viii20-viii29.PubMed
10.
go back to reference Schulz KF, Grimes DA: Multiplicity in randomised trials II: subgroup and interim analyses. Lancet. 2005, 365 (9471): 1657-1661. 10.1016/S0140-6736(05)66516-6.CrossRefPubMed Schulz KF, Grimes DA: Multiplicity in randomised trials II: subgroup and interim analyses. Lancet. 2005, 365 (9471): 1657-1661. 10.1016/S0140-6736(05)66516-6.CrossRefPubMed
11.
go back to reference Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, Chichester: Wiley Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, Chichester: Wiley
12.
go back to reference Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004, 291 (20): 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004, 291 (20): 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed
13.
go back to reference Juszczak E, Altman D, Chan AW: A review of the methodology and reporting of multi-arm, parallel group, randomised clinical trials (RCTs). 3rd Joint Meeting of the International Society for Clinical Biostatistics and Society for Clinical Trials. 2003, London (UK) Juszczak E, Altman D, Chan AW: A review of the methodology and reporting of multi-arm, parallel group, randomised clinical trials (RCTs). 3rd Joint Meeting of the International Society for Clinical Biostatistics and Society for Clinical Trials. 2003, London (UK)
14.
go back to reference Moher D, Dulberg CS, Wells GA: Statistical power, sample size, and their reporting in randomized controlled trials. JAMA. 1994, 272 (2): 122-124. 10.1001/jama.1994.03520020048013.CrossRefPubMed Moher D, Dulberg CS, Wells GA: Statistical power, sample size, and their reporting in randomized controlled trials. JAMA. 1994, 272 (2): 122-124. 10.1001/jama.1994.03520020048013.CrossRefPubMed
15.
go back to reference Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-10.1136/bmj.b1732.CrossRefPubMedPubMedCentral Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-10.1136/bmj.b1732.CrossRefPubMedPubMedCentral
16.
go back to reference Boissel JP: How to deal with multiple treatment or dose groups in randomized clinical trials? Another approach. Fundam Clin Pharmacol. 2007, 21 (2): 155-156. 10.1111/j.1472-8206.2007.00478.x.CrossRefPubMed Boissel JP: How to deal with multiple treatment or dose groups in randomized clinical trials? Another approach. Fundam Clin Pharmacol. 2007, 21 (2): 155-156. 10.1111/j.1472-8206.2007.00478.x.CrossRefPubMed
17.
go back to reference Hothorn LA: How to deal with multiple treatment or dose groups in randomized clinical trials?. Fundam Clin Pharmacol. 2007, 21 (2): 137-154. 10.1111/j.1472-8206.2007.00469.x.CrossRefPubMed Hothorn LA: How to deal with multiple treatment or dose groups in randomized clinical trials?. Fundam Clin Pharmacol. 2007, 21 (2): 137-154. 10.1111/j.1472-8206.2007.00469.x.CrossRefPubMed
18.
go back to reference Proschan MA, Waclawiw MA: Practical guidelines for multiplicity adjustment in clinical trials. Control Clin Trials. 2000, 21 (6): 527-539. 10.1016/S0197-2456(00)00106-9.CrossRefPubMed Proschan MA, Waclawiw MA: Practical guidelines for multiplicity adjustment in clinical trials. Control Clin Trials. 2000, 21 (6): 527-539. 10.1016/S0197-2456(00)00106-9.CrossRefPubMed
19.
go back to reference Chan AW, Upshur R, Singh JA, Ghersi D, Chapuis F, Altman DG: Research protocols: waiving confidentiality for the greater good. BMJ. 2006, 332 (7549): 1086-1089. 10.1136/bmj.332.7549.1086.CrossRefPubMedPubMedCentral Chan AW, Upshur R, Singh JA, Ghersi D, Chapuis F, Altman DG: Research protocols: waiving confidentiality for the greater good. BMJ. 2006, 332 (7549): 1086-1089. 10.1136/bmj.332.7549.1086.CrossRefPubMedPubMedCentral
20.
go back to reference Hill CL, LaValley MP, Felson DT: Discrepancy between published report and actual conduct of randomized clinical trials. J Clin Epidemiol. 2002, 55 (8): 783-786. 10.1016/S0895-4356(02)00440-7.CrossRefPubMed Hill CL, LaValley MP, Felson DT: Discrepancy between published report and actual conduct of randomized clinical trials. J Clin Epidemiol. 2002, 55 (8): 783-786. 10.1016/S0895-4356(02)00440-7.CrossRefPubMed
21.
go back to reference Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B: Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004, 328 (7430): 22-24. 10.1136/bmj.328.7430.22.CrossRefPubMedPubMedCentral Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B: Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004, 328 (7430): 22-24. 10.1136/bmj.328.7430.22.CrossRefPubMedPubMedCentral
22.
go back to reference Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328 (7441): 702-708. 10.1136/bmj.328.7441.702.CrossRefPubMedPubMedCentral Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328 (7441): 702-708. 10.1136/bmj.328.7441.702.CrossRefPubMedPubMedCentral
23.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
Metadata
Title
Reporting of analyses from randomized controlled trials with multiple arms: a systematic review
Authors
Gabriel Baron
Elodie Perrodeau
Isabelle Boutron
Philippe Ravaud
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2013
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-11-84

Other articles of this Issue 1/2013

BMC Medicine 1/2013 Go to the issue