Top

Open Access 01-12-2018 | Commentary

Promoting public access to clinical trial protocols: challenges and recommendations

Authors: An-Wen Chan, Asbjørn Hróbjartsson

Published in: Trials | Issue 1/2018

Abstract

Background

Recognizing the value of promoting public access to clinical trial protocols, Trials pioneered the way for their publication over a decade ago. However, despite major advances in the public accessibility of information about trial methods and results, protocol sharing remains relatively rare.

Main body

Protocol sharing facilitates the critical appraisal of clinical trials and helps to identify and deter the selective reporting of outcomes and analyses. Challenges to the routine availability of high quality trial protocols include the gaps in incentives and adherence mechanisms, limited venues for sharing the original and final protocol versions, and the need for mechanisms to ensure transparent and complete protocol content.

Conclusions

We propose recommendations for addressing key challenges to protocol sharing in order to promote routine public access to protocols for the benefit of patients and other users of evidence from clinical trials.

Chan A-W, Song F, Vickers A, Jefferson T, Dickersin K, Gøtzsche PC, et al. Increasing value and reducing waste: Addressing inaccessible research. Lancet. 2014;383(9913):257–66. https://doi.org/10.1016/S0140-6736(13)62296-5 CrossRefPubMedPubMedCentral

Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 Statement: Defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. https://doi.org/10.7326/0003-4819-158-3-201302050-00583 CrossRefPubMedPubMedCentral

Altman D, Furberg C, Grimshaw J, Rothwell P. Trials - using the opportunities of electronic publishing to improve the reporting of randomised trials. Trials. 2006;7:6. https://doi.org/10.1186/1745-6215-7-6 CrossRefPubMedPubMedCentral

van Rosmalen BV, Alldinger I, Cieslak KP, Wennink R, Clarke M, Ali UA, et al. Worldwide trends in volume and quality of published protocols of randomized controlled trials. PLoS One. 2017;12(3):e0187389.CrossRefPubMedPubMedCentral

Chalmers I, Altman DG. How can medical journals help prevent poor medical research? Some opportunities presented by electronic publishing. Lancet. 1999;353(9151):490–3. https://doi.org/10.1016/S0140-6736(98)07618-1 CrossRefPubMed

Lassere M, Johnson K. The power of the protocol. Lancet. 2002;360(9346):1620–2. https://doi.org/10.1016/S0140-6736(02)11652-7 CrossRefPubMed

Chan A-W. Bias, spin, and misreporting: Time for full access to trial protocols and results. PLoS Med. 2008;5(11):e230. https://doi.org/10.1371/journal.pmed.0050230 CrossRefPubMedPubMedCentral

Hamm MP, Hartling L, Milne A, Tjosvold L, Vandermeer B, Thomson D, et al. A descriptive analysis of a representative sample of pediatric randomized controlled trials published in 2007. BMC Pediatr. 2010;10:96. https://doi.org/10.1186/1471-2431-10-96 CrossRefPubMedPubMedCentral

Chan A-W, Upshur R, Singh JA, Ghersi D, Chapuis F, Altman DG. Research protocols: waiving confidentiality for the greater good. BMJ. 2006;332(7549):1086–9. https://doi.org/10.1136/bmj.332.7549.1086 CrossRefPubMedPubMedCentral

10.

Lucey M, Clark J, Glasziou P. Public availability of trial protocols. Lancet. 2017;390(10113):e54–5. https://doi.org/10.1016/S0140-6736(17)33255-5 CrossRefPubMed

11.

Taichman DB, Backus J, Baethge C, Bauchner H, de Leeuw PW, Drazen JM, et al. Sharing clinical trial data – a proposal from the International Committee of Medical Journal Editors. N Engl J Med. 2016;374(4):384–6. https://doi.org/10.1056/NEJMe1515172 CrossRefPubMed

12.

Zarin DA, Tse T, Williams RJ, Carr S. Trial Reporting in ClinicalTrials.gov - The Final Rule. N Engl J Med. 2016;375(20):1998–2004. https://doi.org/10.1056/NEJMsr1611785 CrossRefPubMedPubMedCentral

13.

European Commission. Guidance on posting and publication of result-related information on clinical trials in relation to the implementation of Article 57(2) of Regulation (EC) No 726/2004 and Article 41(2) of Regulation (EC) No 1901/2006. Official Journal of the European Union. 2012. https://ec.europa.eu/health/files/eudralex/vol-10/2012_302-03/2012_302-03_en.pdf. Accessed 12 Feb 2018.

14.

Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, et al. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;(Issue 11):MR000030. https://doi.org/10.1002/14651858.MR000030.pub2.

15.

Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–6. https://doi.org/10.1016/S0140-6736(13)62228-X CrossRefPubMed

16.

Hróbjartsson A, Boutron I. Blinding in randomized clinical trials: imposed impartiality. Clin Pharmacol Ther. 2011;90(5):732–6. https://doi.org/10.1038/clpt.2011.207 CrossRefPubMed

17.

Hróbjartsson A, Pildal J, Chan A-W, Haahr MT, Altman DG, Gøtzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. J Clin Epidemiol. 2009;62(9):967–73. https://doi.org/10.1016/j.jclinepi.2009.04.003 CrossRefPubMed

18.

Pildal J, Chan A-W, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: Cohort study. BMJ. 2005;330:1049–52. https://doi.org/10.1136/bmj.38414.422650.8F CrossRefPubMedPubMedCentral

19.

Jørgensen L, Paludan-Muller AS, Laursen DR, Savovic J, Boutron I, Sterne JA, et al. Evaluation of the Cochrane tool for assessing risk of bias in randomized clinical trials: overview of published comments and analysis of user practice in Cochrane and non-Cochrane reviews. Syst Rev. 2016;5:80. https://doi.org/10.1186/s13643-016-0259-8 CrossRefPubMedPubMedCentral

20.

Chan A-W, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–65. https://doi.org/10.1001/jama.291.20.2457 CrossRefPubMed

21.

Dwan K, Altman DG, Clarke M, Gamble C, Higgins JP, Sterne JA, et al. Evidence for the selective reporting of analyses and discrepancies in clinical trials: a systematic review of cohort studies of clinical trials. PLoS Med. 2014;11(6):e1001666. https://doi.org/10.1371/journal.pmed.1001666 CrossRefPubMedPubMedCentral

22.

Chan A-W, Pello A, Kitchen J, Axentiev A, Virtanen JI, Liu A, et al. Association of trial registration with reporting of primary outcomes in protocols and publications. JAMA. 2017;318(17):1709–11. https://doi.org/10.1001/jama.2017.13001 CrossRefPubMed

23.

Redmond S, von Elm E, Blümle A, Gengler M, Gsponer T, Egger M. Cohort study of trials submitted to ethics committee identified discrepant reporting of outcomes in publications. J Clin Epidemiol. 2013;66(12):1367–75. https://doi.org/10.1016/j.jclinepi.2013.06.020 CrossRefPubMed

24.

van den Bogert CA, Souverein PC, Brekelmans CT, Janssen SW, Koëter GH, Leufkens HG, et al. Primary endpoint discrepancies were found in one in ten clinical drug trials. Results of an inception cohort study. J Clin Epidemiol. 2017;89:199–208. https://doi.org/10.1016/j.jclinepi.2017.05.012 CrossRefPubMed

25.

Dwan K, Altman DG, Cresswell L, Blundell M, Gamble CL, Williamson PR. Comparison of protocols and registry entries to published reports for randomised controlled trials. Cochrane Database Syst Rev. 2011;(Issue 1):MR000031. https://doi.org/10.1002/14651858.MR000031.pub2.

26.

Gøtzsche PC, Hróbjartsson A, Johansen HK, Haahr MT, Altman DG, Chan A-W. Constraints on publication rights in industry-initiated clinical trials. JAMA. 2006;295(14):1645–6. https://doi.org/10.1001/jama.295.14.1645 CrossRefPubMed

27.

Gøtzsche PC, Hróbjartsson A, Johansen HK, Haahr MT, Altman DG, Chan A-W. Ghost authorship in industry-initiated randomised trials. PLoS Med. 2007;4(1):e19. https://doi.org/10.1371/journal.pmed.0040019 CrossRefPubMedPubMedCentral

28.

Vera-Badillo FE, Napoleone M, Krzyzanowska MK, Alibhai SM, Chan AW, Ocana A, et al. Honorary and ghost authorship in reports of randomised clinical trials in oncology. Eur J Cancer. 2016;66:1–8. https://doi.org/10.1016/j.ejca.2016.06.023 CrossRefPubMed

29.

Lundh A, Krogsboll LT, Gotzsche PC. Sponsors’ participation in conduct and reporting of industry trials: a descriptive study. Trials. 2012;13:146. https://doi.org/10.1186/1745-6215-13-146 CrossRefPubMedPubMedCentral

30.

Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.CrossRefPubMed

31.

Zhang S, Liang F, Li W, Tannock I. Comparison of eligibility criteria between protocols, registries, and publications of cancer clinical trials. J Natl Cancer Inst. 2016;108(11):djw129. https://doi.org/10.1093/jnci/djw129 CrossRef

32.

Blümle A, Meerpohl JJ, Rucker G, Antes G, Schumacher M, von Elm E. Reporting of eligibility criteria of randomised trials: cohort study comparing trial protocols with subsequent articles. BMJ. 2011;342:d1828. https://doi.org/10.1136/bmj.d1828 CrossRefPubMedPubMedCentral

33.

Gandhi M, Ameli N, Bacchetti P, Sharp GB, French AL, Young M, et al. Eligibility criteria for HIV clinical trials and generalizability of results: the gap between published reports and study protocols. AIDS. 2005;19(16):1885–96.CrossRefPubMed

34.

Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. https://doi.org/10.1136/bmj.g1687 CrossRefPubMed

35.

van Lent M, IntHout J, Out HJ. Differences between information in registries and articles did not influence publication acceptance. J Clin Epidemiol. 2015;68(9):1059–67. https://doi.org/10.1016/j.jclinepi.2014.11.019 CrossRefPubMed

36.

Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302(9):977–84. https://doi.org/10.1001/jama.2009.1242 CrossRefPubMed

37.

Walker KF, Stevenson G, Thornton JG. Discrepancies between registration and publication of randomised controlled trials: an observational study. JRSM Open. 2014;5(5):2042533313517688. https://doi.org/10.1177/2042533313517688 CrossRefPubMedPubMedCentral

38.

Hannink G, Gooszen HG, Rovers MM. Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions. Ann Surg. 2013;257(5):818–23. https://doi.org/10.1097/SLA.0b013e3182864fa3 CrossRefPubMed

39.

Fleming PS, Koletsi D, Dwan K, Pandis N. Outcome discrepancies and selective reporting: Impacting the leading journals? PLoS One. 2015;10(5):e0127495. https://doi.org/10.1371/journal.pone.0127495 CrossRefPubMedPubMedCentral

40.

You B, Gan HK, Pond G, Chen EX. Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review. J Clin Oncol. 2012;30(2):210–6. https://doi.org/10.1200/JCO.2011.37.0890 CrossRefPubMed

41.

Viergever RF, Karam G, Reis A, Ghersi D. The quality of registration of clinical trials: still a problem. PLoS One. 2014;9(1):e84727. https://doi.org/10.1371/journal.pone.0084727 CrossRefPubMedPubMedCentral

42.

World Health Organization. International Clinical Trials Registry Platform (ICTRP). 2018. http://www.who.int/ictrp/en/. Accessed 2 Jan 2018.

43.

Reveiz L, Chan A-W, Krleža-Jerić K, Granados CE, Pinart M, Etxeandia I, et al. Reporting of methodologic information on trial registries for quality assessment: a study of trial records retrieved from the WHO search portal. PLoS One. 2010;5(8):e12484. https://doi.org/10.1371/journal.pone.0012484 CrossRefPubMedPubMedCentral

44.

Perlmutter A, Tran VT, Dechartres A, Ravaud P. Statistical controversies in clinical research: comparison of primary outcomes in protocols, public clinical-trial registries and publications: the example of oncology trials. Ann Oncol. 2017;28(4):688–95. https://doi.org/10.1093/annonc/mdw682 PubMed

45.

Wilsdon J, Allen L, Belfiore E, Campbell P, Curry S, Hill S, et al. The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. Bristol: Higher Education Funding Council for England; 2015. https://doi.org/10.13140/RG.2.1.4929.1363 CrossRef

46.

Hicks D, Wouters P, Waltman L, de Rijcke S, Rafols I. Bibliometrics: The Leiden Manifesto for Research Metrics. Nature. 2015;520:429.CrossRefPubMed

47.

Benedictus R. From Output to Impact. 2017. https://www.nrin.nl/ri-collection/rcr-practice/policy/output-impact/. Accessed 2 Jan 2018.

48.

Dijstelbloem H, Huisman F, Miedema F, Mijnhardt W. English: Science in Transition. 2015. http://www.scienceintransition.nl/english. Accessed 8 Jan 2018.

49.

Stretton S, Lew RA, Ely JA, Snape MJ, Carey LC, Haley C, et al. Sponsor-imposed publication restrictions disclosed on ClinicalTrials.gov. Account Res. 2016;23(2):67–78. https://doi.org/10.1080/08989621.2015.1020375 CrossRefPubMed

50.

Schulman KA, Seils DM, Timbie JW, Sugarman J, Dame LA, Weinfurt KP, et al. A national survey of provisions in clinical-trial agreements between medical schools and industry sponsors. N Engl J Med. 2002;347(17):1335–41. https://doi.org/10.1056/NEJMsa020349 CrossRefPubMed

51.

Kasenda B, von Elm E, You JJ, Blümle A, Tomonaga Y, Saccilotto R, et al. Agreements between industry and academia on publication rights: A retrospective study of protocols and publications of randomized clinical trials. PLoS Med. 2016;13(6) https://doi.org/10.1371/journal.pmed.1002046.

52.

Siegel JP. Editorial review of protocols for clinical trials. N Engl J Med. 1990;323(19):1355. https://doi.org/10.1056/NEJM199011083231921 PubMed

53.

Jones G, Abbasi K. Trial protocols at the BMJ. BMJ. 2004;329(7479):1360. https://doi.org/10.1136/bmj.329.7479.1360 CrossRefPubMedPubMedCentral

54.

The Lancet. Types of Article and Manuscript Requirements. 2017. http://thelancet.com/lancet/information-for-authors/article-types-manuscript-requirements. Accessed 8 Jan 2018.

55.

PLOS Medicine. Submission Guidelines. 2017. http://journals.plos.org/plosmedicine/s/submission-guidelines. Accessed 2 Jan 2018.

56.

Annals of Internal Medicine. Information for Authors. 2018. http://annals.org/aim/pages/authors. Accessed 2 Jan 2018.

57.

Gøtzsche PC, Jørgensen AW. Opening up data at the European Medicines Agency. BMJ. 2011;342:d2686. https://doi.org/10.1136/bmj.d2686 CrossRefPubMed

58.

Davis AL, Miller JD. The European Medicines Agency and Publication of Clinical Study Reports: A Challenge for the US FDA. JAMA. 2017;317(9):905–6. https://doi.org/10.1001/jama.2017.0918 CrossRefPubMed

59.

Zarin DA, Tse T, Ross JS. Trial-results reporting and academic medical centers. N Engl J Med. 2015;372(24):2371–2. https://doi.org/10.1056/NEJMc1505965 CrossRefPubMed

60.

European Federation of Pharmaceutical Industries and Associations (EFPIA) and The Pharmaceutical Research and Manufacturers of America (PhRMA). Principles for Responsible Clinical Trial Data Sharing. 2013. http://phrma-docs.phrma.org/sites/default/files/pdf/PhRMAPrinciplesForResponsibleClinicalTrialDataSharing.pdf. Accessed 2 Jan 2018.

61.

Clinical Study Data Request. 2018. https://clinicalstudydatarequest.com/Default.aspx. Accessed 2 Jan 2018.

62.

Clinical Study Data Request. Study Sponsors. 2018. https://clinicalstudydatarequest.com/Study-Sponsors-Info.aspx. Accessed 2 Jan 2018.

63.

Boutron I, Dechartres A, Baron G, Li J, Ravaud P. Sharing of data from industry-funded registered clinical trials. JAMA. 2016;315(24):2729–30. https://doi.org/10.1001/jama.2016.6310 CrossRefPubMed

64.

GlaxoSmithKline. Clinical Study Register. 2017. https://www.gsk-clinicalstudyregister.com. Accessed 2 Jan 2018.

65.

Li T, Boutron I, Salman RA, Cobo E, Flemyng E, Grimshaw JM, et al. Review and publication of protocol submissions to Trials - what have we learned in 10 years? Trials. 2016;18:34. https://doi.org/10.1186/s13063-016-1743-0 CrossRefPubMedPubMedCentral

66.

Getz KA, Stergiopoulos S, Short M, Surgeon L, Krauss R, Pretorius S, et al. The impact of protocol amendments on clinical trial performance and cost. Ther Innov Regul Sci. 2016;50(4):436–41. https://doi.org/10.1177/2168479016632271 CrossRef

67.

Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. https://doi.org/10.1136/bmj.e7586 CrossRefPubMedPubMedCentral

68.

Chan A-W, Krleža-Jerić K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ. 2004;171:735–40.CrossRefPubMedPubMedCentral

69.

Al-Marzouki S, Roberts I, Evans S, Marshall T. Selective reporting in clinical trials: analysis of trial protocols accepted by The Lancet. Lancet. 2008;372(9634):201. https://doi.org/10.1016/S0140-6736(08)61060-0 CrossRefPubMed

70.

Ross S, Magee L, Walker M, Wood S. Protecting intellectual property associated with Canadian academic clinical trials – approaches and impact. Trials. 2012;13:243. https://doi.org/10.1186/1745-6215-13-243 CrossRefPubMedPubMedCentral

71.

Reveiz L, Krleža-Jerić K, Chan A-W, de Aguiar S. Do trialists endorse clinical trial registration? Survey of a PubMed sample. Trials. 2007;8:30. https://doi.org/10.1186/1745-6215-8-30 CrossRefPubMedPubMedCentral

72.

Lurie P, Zieve A. Sometimes the silence can be like the thunder: access to pharmaceutical data at the FDA. Law Contemp Probl. 2006;69(3):85–97.

73.

Krleža-Jerić K. Clinical trial registration: the differing views of industry, the WHO, and the Ottawa Group. PLoS Med. 2005;2(11):e378. https://doi.org/10.1371/journal.pmed.0020378 CrossRefPubMedPubMedCentral

74.

European Medicines Agency EMA/240810/2013. European Medicines Agency policy on publication of clinical data for medicinal products for human use, POLICY/0070. 2016. http://www.ema.europa.eu/docs/en_GB/document_library/Other/2014/10/WC500174796.pdf. Accessed 2 Jan 2018.

75.

Eichler HG, Abadie E, Breckenridge A, Leufkens H, Rasi G. Open clinical trial data for all? A view from regulators. PLoS Med. 2012;9(4):e1001202. https://doi.org/10.1371/journal.pmed.1001202 CrossRefPubMedPubMedCentral

76.

US District Court for the District Court of Columbia. Public Citizen Health Research v. Food and Drug, 964 F. Supp. 413 (D.D.C. 1997). 1997. https://law.justia.com/cases/federal/district-courts/FSupp/964/413/1410001/. Accessed 8 Jan 2018.

77.

Basu AP, Pearse JE, Rapley T. Publishing protocols for trials of complex interventions before trial completion - potential pitfalls, solutions and the need for public debate. Trials. 2017;18:5. https://doi.org/10.1186/s13063-016-1757-7 CrossRefPubMedPubMedCentral

78.

Askie L. Trial registration records, updates, and protocols. Lancet. 2016;388(10042):341–2. https://doi.org/10.1016/S0140-6736(16)30965-5 CrossRefPubMed

79.

Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 2010;7(9):e1000326. https://doi.org/10.1371/journal.pmed.1000326 CrossRefPubMedPubMedCentral

80.

Bouton TC, Phillips PJ, Mitnick CD, Peloquin CA, Eisenach K, Patientia RF, et al. An optimized background regimen design to evaluate the contribution of levofloxacin to multidrug-resistant tuberculosis treatment regimens: study protocol for a randomized controlled trial. Trials. 2017;18(1):563. https://doi.org/10.1186/s13063-017-2292-x CrossRefPubMedPubMedCentral

81.

Chan A-W, Tetzlaff JM, Altman DG, Dickersin K, Moher D. SPIRIT 2013: New guidance for content of clinical trial protocols. Lancet. 2013;381:91–2. https://doi.org/10.1016/S0140-6736(12)62160-6.

82.

SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials). Implementation Tools. 2017. http://www.spirit-statement.org/implementation-tools/. Accessed 2 Jan 2018.

Title: Promoting public access to clinical trial protocols: challenges and recommendations
Authors: An-Wen Chan
Asbjørn Hróbjartsson
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: Trials / Issue 1/2018
Electronic ISSN: 1745-6215
DOI: https://doi.org/10.1186/s13063-018-2510-1

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Promoting public access to clinical trial protocols: challenges and recommendations

Abstract

Background

Main body

Conclusions

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Abstract

Background

Main body

Conclusions

Please log in to get access to this content