Skip to main content
Top
Published in: Trials 1/2008

Open Access 01-12-2008 | Research

Reporting of clinical trials: a review of research funders' guidelines

Authors: Kerry Dwan, Carrol Gamble, Paula R Williamson, Douglas G Altman

Published in: Trials | Issue 1/2008

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) represent the gold standard methodological design to evaluate the effectiveness of an intervention in humans but they are subject to bias, including study publication bias and outcome reporting bias. National and international organisations and charities give recommendations for good research practice in relation to RCTs but to date no review of these guidelines has been undertaken with respect to reporting bias.

Methods

National and international organisations and UK based charities listed on the Association for Medical Research Charities website were contacted in 2007; they were considered eligible for this review if they funded RCTs. Guidelines were obtained and assessed in relation to what was written about trial registration, protocol adherence and trial publication. It was also noted whether any monitoring against these guidelines was undertaken. This information was necessary to discover how much guidance researchers are given on the publication of results, in order to prevent study publication bias and outcome reporting bias.

Results

Seventeen organisations and 56 charities were eligible of 140 surveyed for this review, although there was no response from 12. Trial registration, protocol adherence, trial publication and monitoring against the guidelines were often explicitly discussed or implicitly referred too. However, only eleven of these organisations or charities mentioned the publication of negative as well as positive outcomes and just three of the organisations specifically stated that the statistical analysis plan should be strictly adhered to and all changes should be reported.

Conclusion

Our review indicates that there is a need to provide more detailed guidance for those conducting and reporting clinical trials to help prevent the selective reporting of results. Statements found in the guidelines generally refer to publication bias rather than outcome reporting bias. Current guidelines need to be updated and include the statement that all primary and secondary outcomes prespecified in the protocol should be fully reported and should not be selected for inclusion in the final report based on their results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kane JL, Wang J, Garrard J: Reporting in randomised clinical trials improved after adoption of the CONSORT statement. Journal of Clinical Epidemiology. 2007, 60: 241-249. 10.1016/j.jclinepi.2006.06.016.CrossRefPubMed Kane JL, Wang J, Garrard J: Reporting in randomised clinical trials improved after adoption of the CONSORT statement. Journal of Clinical Epidemiology. 2007, 60: 241-249. 10.1016/j.jclinepi.2006.06.016.CrossRefPubMed
2.
go back to reference Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A-W, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JPA, Simes J, Williamson PR: Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias. PLoS ONE. 2008, 3 (8): e3081-10.1371/journal.pone.0003081. doi:10.1371/journal.pone.0003081CrossRefPubMedPubMedCentral Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A-W, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JPA, Simes J, Williamson PR: Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias. PLoS ONE. 2008, 3 (8): e3081-10.1371/journal.pone.0003081. doi:10.1371/journal.pone.0003081CrossRefPubMedPubMedCentral
3.
go back to reference Decullier E, Lheritier V, Chapuis F: Fate of biomedical research protocols and publication bias in France: retrospective cohort study. BMJ. 2005, 331: 19-24. 10.1136/bmj.38488.385995.8F.CrossRefPubMedPubMedCentral Decullier E, Lheritier V, Chapuis F: Fate of biomedical research protocols and publication bias in France: retrospective cohort study. BMJ. 2005, 331: 19-24. 10.1136/bmj.38488.385995.8F.CrossRefPubMedPubMedCentral
4.
go back to reference Ioannidis JPA: Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998, 279: 281-286. 10.1001/jama.279.4.281.CrossRefPubMed Ioannidis JPA: Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998, 279: 281-286. 10.1001/jama.279.4.281.CrossRefPubMed
5.
6.
go back to reference Rothstein H, Sutton AJ, Borenstein M: Publication bias in meta-analysis: prevention, assessment and adjustments. 2005, Chichester, WileyCrossRef Rothstein H, Sutton AJ, Borenstein M: Publication bias in meta-analysis: prevention, assessment and adjustments. 2005, Chichester, WileyCrossRef
7.
go back to reference Hutton JL, Williamson PR: Bias in meta-analysis due to outcome variable selection within studies. Appl Stat. 2000, 49 (3): 359-370. Hutton JL, Williamson PR: Bias in meta-analysis due to outcome variable selection within studies. Appl Stat. 2000, 49 (3): 359-370.
8.
go back to reference Hahn S, Williamson PR, Hutton JL: Investigation of within-study selective reporting in clinical research: follow-up of applications submitted to a local research ethics committee. Journal of Evaluation in Clinical Practice. 2002, 8 (3): 353-359. 10.1046/j.1365-2753.2002.00314.x.CrossRefPubMed Hahn S, Williamson PR, Hutton JL: Investigation of within-study selective reporting in clinical research: follow-up of applications submitted to a local research ethics committee. Journal of Evaluation in Clinical Practice. 2002, 8 (3): 353-359. 10.1046/j.1365-2753.2002.00314.x.CrossRefPubMed
9.
go back to reference Melander H, Ahlqvist-Rastad , Meijer G, Beermann B: Evidence b(i)ased medicine – selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003, 326: 1171-1173. 10.1136/bmj.326.7400.1171.CrossRefPubMedPubMedCentral Melander H, Ahlqvist-Rastad , Meijer G, Beermann B: Evidence b(i)ased medicine – selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003, 326: 1171-1173. 10.1136/bmj.326.7400.1171.CrossRefPubMedPubMedCentral
10.
go back to reference Chan A-W, Krleža-Jerić K, Schmidt I, Altman DG: Outcome reporting bias in randomised trials funded by the Canadian Institutes of Health Research. Canadian Medical Association Journal. 2004, 171 (7): 735-740. 10.1503/cmaj.1041086.CrossRefPubMedPubMedCentral Chan A-W, Krleža-Jerić K, Schmidt I, Altman DG: Outcome reporting bias in randomised trials funded by the Canadian Institutes of Health Research. Canadian Medical Association Journal. 2004, 171 (7): 735-740. 10.1503/cmaj.1041086.CrossRefPubMedPubMedCentral
11.
go back to reference Chan A-W, Hróbjartsson A, Haahr M, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to publications. Journal of the American Medical Association. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed Chan A-W, Hróbjartsson A, Haahr M, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to publications. Journal of the American Medical Association. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed
12.
go back to reference Ghersi D: Issues in the design, conduct and reporting of clinical trials that impact on the quality of decision making. PhD Thesis. 2007, University of Sydney, School of Public Health, Faculty of Medicine Ghersi D: Issues in the design, conduct and reporting of clinical trials that impact on the quality of decision making. PhD Thesis. 2007, University of Sydney, School of Public Health, Faculty of Medicine
13.
go back to reference Von Elm E, Röllin A, Blümle A, Huwiler K, Witschi M, Egger M: Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. Swiss Med Wkly. 2008, 138 (13–14): 197-203.PubMed Von Elm E, Röllin A, Blümle A, Huwiler K, Witschi M, Egger M: Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. Swiss Med Wkly. 2008, 138 (13–14): 197-203.PubMed
14.
go back to reference Chan A-W, Altman DG: Identifying outcome reporting bias in randomised trials on Pubmed: review of publications and survey of authors. BMJ. 2005, 330: 753-759. 10.1136/bmj.38356.424606.8F.CrossRefPubMedPubMedCentral Chan A-W, Altman DG: Identifying outcome reporting bias in randomised trials on Pubmed: review of publications and survey of authors. BMJ. 2005, 330: 753-759. 10.1136/bmj.38356.424606.8F.CrossRefPubMedPubMedCentral
15.
go back to reference Tannock IF: False-positive results in clinical trials: multiple significance tests and the problem of unreported comparisons. Journal of the National Cancer Institute. 1996, 88: 206-207. 10.1093/jnci/88.3-4.206.CrossRefPubMed Tannock IF: False-positive results in clinical trials: multiple significance tests and the problem of unreported comparisons. Journal of the National Cancer Institute. 1996, 88: 206-207. 10.1093/jnci/88.3-4.206.CrossRefPubMed
16.
go back to reference World Health Organization: World Health Organization international clinical trials registry platform: Unique ID assignment. 2005, Geneva: World Health Organization, (accessed September 2008)., [http://www.who.int/ictrp/en/] World Health Organization: World Health Organization international clinical trials registry platform: Unique ID assignment. 2005, Geneva: World Health Organization, (accessed September 2008)., [http://​www.​who.​int/​ictrp/​en/​]
18.
go back to reference Directive 2001/20/EC of the European Parliament and of the Council of 4 April 2001 on the approximation of the laws, regulations and administrative provisions of the Member States relating to the implementation of good clinical practice in the conduct of clinical trials on medicinal products for human use. Med Etika Bioet. 2001, 9 (1-2): 12-19. Directive 2001/20/EC of the European Parliament and of the Council of 4 April 2001 on the approximation of the laws, regulations and administrative provisions of the Member States relating to the implementation of good clinical practice in the conduct of clinical trials on medicinal products for human use. Med Etika Bioet. 2001, 9 (1-2): 12-19.
19.
go back to reference World Medical Association: World Medical Association Declaration of Helsinki: ethical principles for research involving human subjects. Adopted by the 18th WMA, Helsinki, Finland, June, 1964. Amended by the 52nd WMA General Assembly, Edinburgh, Scotland, October, 2000. 2000, Ferney-Voltaire: World Medical Association, (accessed September 2008)., [http://www.wma.net/e/policy/b3.htm] World Medical Association: World Medical Association Declaration of Helsinki: ethical principles for research involving human subjects. Adopted by the 18th WMA, Helsinki, Finland, June, 1964. Amended by the 52nd WMA General Assembly, Edinburgh, Scotland, October, 2000. 2000, Ferney-Voltaire: World Medical Association, (accessed September 2008)., [http://​www.​wma.​net/​e/​policy/​b3.​htm]
20.
go back to reference Moher D, Schulz KF, Altman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Lancet. 2001, 357: 1191-94. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed Moher D, Schulz KF, Altman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Lancet. 2001, 357: 1191-94. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed
21.
go back to reference Dixon JR: The International Conference on Harmonization Good Clinical Practice Guideline. Qual Assur. 1999, 6 (2): 65-74. Dixon JR: The International Conference on Harmonization Good Clinical Practice Guideline. Qual Assur. 1999, 6 (2): 65-74.
23.
go back to reference Grant AM, Altman DG, Babiker A, Campbell MK, Clemens FJ, Darbyshire JH, Elbourne DR, McLeer SK, Parmar MKB, Pocock SJ, Spiegelhalter DJ, Sydes MR, Walker AE, Wallace SA, the DAMOCLES study group: Issues in data monitoring and interim analysis of trials (The DAMOCLES project). Health Technology Assessment. 2005, 9 (7): 1-223.CrossRef Grant AM, Altman DG, Babiker A, Campbell MK, Clemens FJ, Darbyshire JH, Elbourne DR, McLeer SK, Parmar MKB, Pocock SJ, Spiegelhalter DJ, Sydes MR, Walker AE, Wallace SA, the DAMOCLES study group: Issues in data monitoring and interim analysis of trials (The DAMOCLES project). Health Technology Assessment. 2005, 9 (7): 1-223.CrossRef
24.
go back to reference Association of Medical Research Charities: Guidelines on good research practice. 2002, Association of Medical Research Charities Association of Medical Research Charities: Guidelines on good research practice. 2002, Association of Medical Research Charities
26.
go back to reference Wager E, Field AE, Grossman L: Good publication practice for pharmaceutical companies. Current Medical Research and Opinion. 2003, 19 (3): 149-154. 10.1185/030079903125001767.CrossRefPubMed Wager E, Field AE, Grossman L: Good publication practice for pharmaceutical companies. Current Medical Research and Opinion. 2003, 19 (3): 149-154. 10.1185/030079903125001767.CrossRefPubMed
29.
go back to reference MRC Guidelines for Good Clinical Practice in Clinical Trials: 1998, London: Medical Research Council MRC Guidelines for Good Clinical Practice in Clinical Trials: 1998, London: Medical Research Council
31.
go back to reference Ghersi D, Clarke M, Berlin J, Gulmezoglu M, Kush R, Lumbiganon P, Moher D, Rockgold F, Sim I, Wager E: Reporting the findings of clinical trials: a discussion. Bull World Health Organ. 2008, 86 (6): 492-493. 10.2471/BLT.08.053769.CrossRefPubMedPubMedCentral Ghersi D, Clarke M, Berlin J, Gulmezoglu M, Kush R, Lumbiganon P, Moher D, Rockgold F, Sim I, Wager E: Reporting the findings of clinical trials: a discussion. Bull World Health Organ. 2008, 86 (6): 492-493. 10.2471/BLT.08.053769.CrossRefPubMedPubMedCentral
Metadata
Title
Reporting of clinical trials: a review of research funders' guidelines
Authors
Kerry Dwan
Carrol Gamble
Paula R Williamson
Douglas G Altman
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Trials / Issue 1/2008
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-9-66

Other articles of this Issue 1/2008

Trials 1/2008 Go to the issue