Skip to main content
Top
Published in: Systematic Reviews 1/2012

Open Access 01-12-2012 | Research

Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane reviewa

Authors: Lucy Turner, Larissa Shamseer, Douglas G Altman, Kenneth F Schulz, David Moher

Published in: Systematic Reviews | Issue 1/2012

Login to get access

Abstract

Background

The Consolidated Standards of Reporting Trials (CONSORT) Statement is intended to facilitate better reporting of randomised clinical trials (RCTs). A systematic review recently published in the Cochrane Library assesses whether journal endorsement of CONSORT impacts the completeness of reporting of RCTs; those findings are summarised here.

Methods

Evaluations assessing the completeness of reporting of RCTs based on any of 27 outcomes formulated based on the 1996 or 2001 CONSORT checklists were included; two primary comparisons were evaluated. The 27 outcomes were: the 22 items of the 2001 CONSORT checklist, four sub-items describing blinding and a ‘total summary score’ of aggregate items, as reported. Relative risks (RR) and 99% confidence intervals were calculated to determine effect estimates for each outcome across evaluations.

Results

Fifty-three reports describing 50 evaluations of 16,604 RCTs were assessed for adherence to at least one of 27 outcomes. Sixty-nine of 81 meta-analyses show relative benefit from CONSORT endorsement on completeness of reporting. Between endorsing and non-endorsing journals, 25 outcomes are improved with CONSORT endorsement, five of these significantly (α = 0.01). The number of evaluations per meta-analysis was often low with substantial heterogeneity; validity was assessed as low or unclear for many evaluations.

Conclusions

The results of this review suggest that journal endorsement of CONSORT may benefit the completeness of reporting of RCTs they publish. No evidence suggests that endorsement hinders the completeness of RCT reporting. However, despite relative improvements when CONSORT is endorsed by journals, the completeness of reporting of trials remains sub-optimal. Journals are not sending a clear message about endorsement to authors submitting manuscripts for publication. As such, fidelity of endorsement as an ‘intervention’ has been weak to date. Journals need to take further action regarding their endorsement and implementation of CONSORT to facilitate accurate, transparent and complete reporting of trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.1996.03540080059030.CrossRefPubMed Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.1996.03540080059030.CrossRefPubMed
2.
go back to reference Moher D, Schulz KF, Altman D: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001, 285: 1987-1991. 10.1001/jama.285.15.1987.CrossRefPubMed Moher D, Schulz KF, Altman D: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001, 285: 1987-1991. 10.1001/jama.285.15.1987.CrossRefPubMed
3.
go back to reference Schulz K, Altman D, Moher D: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral Schulz K, Altman D, Moher D: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral
4.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, CONSORT GROUP (Consolidated Standards of Reporting Trials): The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-CrossRefPubMed Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, CONSORT GROUP (Consolidated Standards of Reporting Trials): The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-CrossRefPubMed
5.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
6.
go back to reference Gabriel SE, Normand ST: Getting the methods right - the foundation of patient-centered outcomes research. N Engl J Med. 2012, 367: 787-790. 10.1056/NEJMp1207437.CrossRefPubMed Gabriel SE, Normand ST: Getting the methods right - the foundation of patient-centered outcomes research. N Engl J Med. 2012, 367: 787-790. 10.1056/NEJMp1207437.CrossRefPubMed
8.
go back to reference Moher D, Jones A, Lepage L, CONSORT Group (Consolidated Standards for Reporting of Trials): Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, Lepage L, CONSORT Group (Consolidated Standards for Reporting of Trials): Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed
9.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-PubMed
10.
go back to reference Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Does the CONSORT Statement influence the quality of reporting of RCTs published in medical journals?. Cochrane Database Syst Rev. 2012, 11: Art. No. MR000030 Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Does the CONSORT Statement influence the quality of reporting of RCTs published in medical journals?. Cochrane Database Syst Rev. 2012, 11: Art. No. MR000030
12.
go back to reference O’Connor AM, Sargeant JM, Gardner IA, Dickson JS, Torrence ME, Dewey CE, Wills R: The REFLECT statement: methods and processes of creating reporting guidelines for randomized controlled trials for livestock and food safety by modifying the CONSORT statement. Zoonoses Public Health. 2010, 57: 95-104. 10.1111/j.1863-2378.2009.01311.x.CrossRefPubMed O’Connor AM, Sargeant JM, Gardner IA, Dickson JS, Torrence ME, Dewey CE, Wills R: The REFLECT statement: methods and processes of creating reporting guidelines for randomized controlled trials for livestock and food safety by modifying the CONSORT statement. Zoonoses Public Health. 2010, 57: 95-104. 10.1111/j.1863-2378.2009.01311.x.CrossRefPubMed
13.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed
14.
go back to reference Chalmers I, Glasziou P: Avoidable waste in the production and reporting of research evidence. Obstet Gynecol. 2009, 114: 1341-10.1097/AOG.0b013e3181c3020d.CrossRefPubMed Chalmers I, Glasziou P: Avoidable waste in the production and reporting of research evidence. Obstet Gynecol. 2009, 114: 1341-10.1097/AOG.0b013e3181c3020d.CrossRefPubMed
15.
go back to reference Altman DG, Moher D, Schulz KF: Improving the reporting of randomised trials: the CONSORT Statement and beyond. Statist Med. 2012, 31: 2985-2997. 10.1002/sim.5402.CrossRef Altman DG, Moher D, Schulz KF: Improving the reporting of randomised trials: the CONSORT Statement and beyond. Statist Med. 2012, 31: 2985-2997. 10.1002/sim.5402.CrossRef
16.
go back to reference Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L: Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008, 93: 3810-3816. 10.1210/jc.2008-0817.CrossRefPubMed Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L: Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008, 93: 3810-3816. 10.1210/jc.2008-0817.CrossRefPubMed
17.
go back to reference Lai TY, Wong VW, Lam RF, Cheng AC, Lam DS, Leung GM: Quality of reporting of key methodological items of randomized controlled trials in clinical ophthalmic journals. Ophthalmic Epidemiol. 2007, 14: 390-398. 10.1080/09286580701344399.CrossRefPubMed Lai TY, Wong VW, Lam RF, Cheng AC, Lam DS, Leung GM: Quality of reporting of key methodological items of randomized controlled trials in clinical ophthalmic journals. Ophthalmic Epidemiol. 2007, 14: 390-398. 10.1080/09286580701344399.CrossRefPubMed
18.
go back to reference Anttila H, Malmivaara A, Kunz R, Autti-Rämö I, Mäkelä M: Quality of reporting of randomized, controlled trials in cerebral palsy. Pediatrics. 2006, 117: 2222-2230. 10.1542/peds.2005-1630.CrossRefPubMed Anttila H, Malmivaara A, Kunz R, Autti-Rämö I, Mäkelä M: Quality of reporting of randomized, controlled trials in cerebral palsy. Pediatrics. 2006, 117: 2222-2230. 10.1542/peds.2005-1630.CrossRefPubMed
19.
go back to reference Higgins J, Altman DG: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. Edited by: Higgins JP, Green S. 2008, John Wiley & Sons, Chichester, 187-241.CrossRef Higgins J, Altman DG: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. Edited by: Higgins JP, Green S. 2008, John Wiley & Sons, Chichester, 187-241.CrossRef
20.
go back to reference Hartling L, Ospina M, Liang Y, Dryden DM, Hooton N, Seida JK, Klassen TP: Risk of bias versus quality assessment of randomised controlled trials: cross sectional study. BMJ: British Medical Journal. 2009, 339: b4012-10.1136/bmj.b4012.CrossRefPubMedPubMedCentral Hartling L, Ospina M, Liang Y, Dryden DM, Hooton N, Seida JK, Klassen TP: Risk of bias versus quality assessment of randomised controlled trials: cross sectional study. BMJ: British Medical Journal. 2009, 339: b4012-10.1136/bmj.b4012.CrossRefPubMedPubMedCentral
21.
go back to reference Mills E, Wu P, Gagnier J, Heels-Ansdell D, Montori VM: An analysis of general medical and specialist journals that endorse CONSORT found that reporting was not enforced consistently. J Clin Epidemiol. 2005, 58: 662-10.1016/j.jclinepi.2005.01.004.CrossRefPubMed Mills E, Wu P, Gagnier J, Heels-Ansdell D, Montori VM: An analysis of general medical and specialist journals that endorse CONSORT found that reporting was not enforced consistently. J Clin Epidemiol. 2005, 58: 662-10.1016/j.jclinepi.2005.01.004.CrossRefPubMed
22.
go back to reference Hirst A, Altman DG: Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals. PLoS One. 2012, 7: e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral Hirst A, Altman DG: Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals. PLoS One. 2012, 7: e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral
23.
go back to reference Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘Instructions to Authors’. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.CrossRefPubMedPubMedCentral Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘Instructions to Authors’. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.CrossRefPubMedPubMedCentral
Metadata
Title
Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane reviewa
Authors
Lucy Turner
Larissa Shamseer
Douglas G Altman
Kenneth F Schulz
David Moher
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2012
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-1-60

Other articles of this Issue 1/2012

Systematic Reviews 1/2012 Go to the issue