Skip to main content
Top
Published in: Trials 1/2018

Open Access 01-12-2018 | Research

Registration, results reporting, and publication bias of clinical trials supporting FDA approval of neuropsychiatric drugs before and after FDAAA: a retrospective cohort study

Authors: Constance X. Zou, Jessica E. Becker, Adam T. Phillips, James M. Garritano, Harlan M. Krumholz, Jennifer E. Miller, Joseph S. Ross

Published in: Trials | Issue 1/2018

Login to get access

Abstract

Background

Mandatory trial registration, and later results reporting, were proposed to mitigate selective clinical trial publication and outcome reporting. The Food and Drug Administration (FDA) Amendments Act (FDAAA) was enacted by Congress on September 27, 2007, requiring the registration of all non-phase I clinical trials involving FDA-regulated medical interventions and results reporting for approved drugs. The association between FDAAA enactment and the registration, results reporting, and publication bias of neuropsychiatric trials has not been studied.

Methods

We conducted a retrospective cohort study of all efficacy trials supporting FDA new drug approvals between 2005 to 2014 for neuropsychiatric indications. Trials were categorized as pre- or post-FDAAA based on initiation and/or completion dates. The main outcomes were the proportions of trials registered and reporting results in ClinicalTrials.gov, and the degree of publication bias, estimated using the relative risks pre- and post-FDAAA of both the publication of positive vs non-positive trials, as well as of publication of positive vs non-positive trials without misleading interpretations. Registration and results reporting proportions were compared pre- and post-FDAAA using the two-tailed Fisher exact test, and the degrees of publication bias were compared by calculating the ratio of relative risks (RRR) for each period.

Results

The FDA approved 37 new drugs for neuropsychiatric indications between 2005 and 2014 on the basis of 142 efficacy trials, of which 101 were pre-FDAAA and 41 post-FDAAA. Post-FDAAA trials were significantly more likely to be registered (100% vs 64%; p < 0.001) and report results (100% vs 10%; p < 0.001) than pre-FDAAA trials. Pre-FDAAA, positive trials were more likely to be published (relative risk [RR] = 1.52; 95% confidence interval [CI] = 1.17–1.99; p = 0.002) and published without misleading interpretations (RR = 2.47; CI = 1.57–3.73; p < 0.001) than those with non-positive results. In contrast, post-FDAAA positive trials were equally likely to have been published (RR = 1; CI = 1–1, p = NA) and published without misleading interpretations (RR = 1.20; CI = 0.84–1.72; p = 0.30). The likelihood of publication bias pre-FDAAA vs post-FDAAA was greater for positive vs non-positive trials (RRR = 1.52; CI = 1.16–1.99; p = 0.002) and for publication without misleading interpretations (RRR = 2.06, CI = 1.17–3.61, p = 0.01).

Conclusions

The enactment of FDAAA was followed by significantly higher proportions of trials that were registered and reporting results on ClinicalTrials.gov and significantly lower degrees of publication bias among trials supporting recent FDA approval of drugs for neuropsychiatric indications.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dickersin K, Chalmers I. Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO. JRSM. 2011;104:532–8.CrossRef Dickersin K, Chalmers I. Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO. JRSM. 2011;104:532–8.CrossRef
2.
go back to reference Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2012;344:d7292.CrossRef Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2012;344:d7292.CrossRef
3.
go back to reference Decullier E, Huot L, Chapuis FR. Fate of protocols submitted to a French national funding scheme: a cohort study. PLOS One. 2014;9:e99561.CrossRef Decullier E, Huot L, Chapuis FR. Fate of protocols submitted to a French national funding scheme: a cohort study. PLOS One. 2014;9:e99561.CrossRef
4.
go back to reference Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303:2058–64.CrossRef Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303:2058–64.CrossRef
5.
go back to reference Miller JE, Korn D, Ross JS. Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012. BMJ Open. 2015;5:e009758.CrossRef Miller JE, Korn D, Ross JS. Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012. BMJ Open. 2015;5:e009758.CrossRef
6.
go back to reference Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF. Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013;347:f6104.CrossRef Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF. Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013;347:f6104.CrossRef
7.
go back to reference Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358:252–60.CrossRef Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358:252–60.CrossRef
8.
go back to reference Smithy JW, Downing NS, Ross JS. Publication of pivotal efficacy trials for novel therapeutic agents approved between 2005 and 2011: a cross-sectional study. JAMA Intern Med. 2014;174:1518–20.CrossRef Smithy JW, Downing NS, Ross JS. Publication of pivotal efficacy trials for novel therapeutic agents approved between 2005 and 2011: a cross-sectional study. JAMA Intern Med. 2014;174:1518–20.CrossRef
9.
go back to reference Chen R, Desai NR, Ross JS, Zhang W, Chau KH, Wayda B, Murugiah K, Lu DY, Mittal A, Krumholz HM. Publication and reporting of clinical trial results: cross sectional analysis across academic medical centers. BMJ. 2016;352:i637.CrossRef Chen R, Desai NR, Ross JS, Zhang W, Chau KH, Wayda B, Murugiah K, Lu DY, Mittal A, Krumholz HM. Publication and reporting of clinical trial results: cross sectional analysis across academic medical centers. BMJ. 2016;352:i637.CrossRef
10.
go back to reference Lee K, Bacchetti P, Sim I. Publication of clinical trials supporting successful new drug applications: a literature analysis. PLOS Med. 2008;5:e191.CrossRef Lee K, Bacchetti P, Sim I. Publication of clinical trials supporting successful new drug applications: a literature analysis. PLOS Med. 2008;5:e191.CrossRef
11.
go back to reference Dickersin K, Min Y-I, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA. 1992;267:374–8.CrossRef Dickersin K, Min Y-I, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA. 1992;267:374–8.CrossRef
12.
go back to reference Suñé P, Suñé JM, Montoro JB. Positive outcomes influence the rate and time to publication, but not the impact factor of publications of clinical trial results. PLOS One. 2013;8:e54583.CrossRef Suñé P, Suñé JM, Montoro JB. Positive outcomes influence the rate and time to publication, but not the impact factor of publications of clinical trial results. PLOS One. 2013;8:e54583.CrossRef
13.
go back to reference Ioannidis JPA. Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials? Philos Ethics Humanit Med. 2008;3:14.CrossRef Ioannidis JPA. Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials? Philos Ethics Humanit Med. 2008;3:14.CrossRef
14.
go back to reference Dwan K, Gamble C, Williamson PR, Kirkham JJ, Reporting Bias Group. Systematic review of the empirical evidence of study publication bias and outcome reporting bias — an updated review. PLOS One. 2013;8:e66844.CrossRef Dwan K, Gamble C, Williamson PR, Kirkham JJ, Reporting Bias Group. Systematic review of the empirical evidence of study publication bias and outcome reporting bias — an updated review. PLOS One. 2013;8:e66844.CrossRef
15.
go back to reference Song F, Parekh-Bhurke S, Hooper L, Loke YK, Ryder JJ, Sutton AJ, Hing CB, Harvey I. Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies. BMC Med Res Methodol. 2009;9:79.CrossRef Song F, Parekh-Bhurke S, Hooper L, Loke YK, Ryder JJ, Sutton AJ, Hing CB, Harvey I. Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies. BMC Med Res Methodol. 2009;9:79.CrossRef
16.
go back to reference Turner EH. Publication bias, with a focus on psychiatry: causes and solutions. CNS Drugs. 2013;27:457–68.CrossRef Turner EH. Publication bias, with a focus on psychiatry: causes and solutions. CNS Drugs. 2013;27:457–68.CrossRef
17.
go back to reference Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, Abi-Jaoude E. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.CrossRef Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, Abi-Jaoude E. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.CrossRef
18.
go back to reference Eyding D, Lelgemann M, Grouven U, Härter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B. Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010;341:c4737.CrossRef Eyding D, Lelgemann M, Grouven U, Härter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B. Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010;341:c4737.CrossRef
20.
go back to reference Nassir Ghaemi S, Shirzadi AA, Filkowski M. Publication bias and the pharmaceutical industry: the case of lamotrigine in bipolar disorder. Medscape J Med. 2008;10:211.PubMedPubMedCentral Nassir Ghaemi S, Shirzadi AA, Filkowski M. Publication bias and the pharmaceutical industry: the case of lamotrigine in bipolar disorder. Medscape J Med. 2008;10:211.PubMedPubMedCentral
21.
go back to reference Doshi P, Dickersin K, Healy D, Vedula SS, Jefferson T. Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ. 2013;346:f2865.CrossRef Doshi P, Dickersin K, Healy D, Vedula SS, Jefferson T. Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ. 2013;346:f2865.CrossRef
22.
go back to reference Anderson GM, Juurlink D, Detsky AS. Newly approved does not always mean new and improved. JAMA. 2008;299:1598–600.CrossRef Anderson GM, Juurlink D, Detsky AS. Newly approved does not always mean new and improved. JAMA. 2008;299:1598–600.CrossRef
23.
go back to reference Roest AM, de Jonge P, Williams CD, de Vries YA, Schoevers RA, Turner EH. Reporting bias in clinical trials investigating the efficacy of second-generation antidepressants in the treatment of anxiety disorders: a report of 2 meta-analyses. JAMA Psychiatry. 2015;72:500–10.CrossRef Roest AM, de Jonge P, Williams CD, de Vries YA, Schoevers RA, Turner EH. Reporting bias in clinical trials investigating the efficacy of second-generation antidepressants in the treatment of anxiety disorders: a report of 2 meta-analyses. JAMA Psychiatry. 2015;72:500–10.CrossRef
24.
go back to reference Turner EH, Knoepflmacher D, Shapley L. Publication bias in antipsychotic trials: an analysis of efficacy comparing the published literature to the US Food and Drug Administration database. PLOS Med. 2012;9:e1001189.CrossRef Turner EH, Knoepflmacher D, Shapley L. Publication bias in antipsychotic trials: an analysis of efficacy comparing the published literature to the US Food and Drug Administration database. PLOS Med. 2012;9:e1001189.CrossRef
27.
go back to reference De Angelis CD, Drazen JM, Frizelle FAP, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJPM, et al. Is this clinical trial fully registered? — A statement from the International Committee of Medical Journal Editors. 2009;352:2436–8. https://doi.org/10.1056/NEJMe058127.CrossRef De Angelis CD, Drazen JM, Frizelle FAP, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJPM, et al. Is this clinical trial fully registered? — A statement from the International Committee of Medical Journal Editors. 2009;352:2436–8. https://​doi.​org/​10.​1056/​NEJMe058127.CrossRef
28.
go back to reference McGauran N, Wieseler B, Kreis J, Schüler Y-B, Kölsch H, Kaiser T. Reporting bias in medical research — a narrative review. Trials. 2010;11:37.CrossRef McGauran N, Wieseler B, Kreis J, Schüler Y-B, Kölsch H, Kaiser T. Reporting bias in medical research — a narrative review. Trials. 2010;11:37.CrossRef
29.
go back to reference Chan L, Heinemann AW. Clinical trial registration: the time has come. Am J Occup Ther. 2016;70:7001070010p1–2.CrossRef Chan L, Heinemann AW. Clinical trial registration: the time has come. Am J Occup Ther. 2016;70:7001070010p1–2.CrossRef
30.
go back to reference Abaid LN, Grimes DA, Schulz KF. Reducing publication bias of prospective clinical trials through trial registration. Contraception. 2007;76:339–41.CrossRef Abaid LN, Grimes DA, Schulz KF. Reducing publication bias of prospective clinical trials through trial registration. Contraception. 2007;76:339–41.CrossRef
31.
go back to reference Weibel S, Elia N, Kranke P. The transparent clinical trial: Why we need complete and informative prospective trial registration. Eur J Anaesthesiol (EJA). 2016;33:72–4.CrossRef Weibel S, Elia N, Kranke P. The transparent clinical trial: Why we need complete and informative prospective trial registration. Eur J Anaesthesiol (EJA). 2016;33:72–4.CrossRef
32.
go back to reference Dal-Re R, Ross JS, Marusic A. Compliance with prospective trial registration guidance remained low in high-impact journals and has implications for primary end point reporting. J Clin Epidemiol. 2016;75:100–7.CrossRef Dal-Re R, Ross JS, Marusic A. Compliance with prospective trial registration guidance remained low in high-impact journals and has implications for primary end point reporting. J Clin Epidemiol. 2016;75:100–7.CrossRef
33.
go back to reference Mann E, Nguyen N, Fleischer S, Meyer G. Compliance with trial registration in five core journals of clinical geriatrics: a survey of original publications on randomised controlled trials from 2008 to 2012. Age Ageing. 2014;43:872–6.CrossRef Mann E, Nguyen N, Fleischer S, Meyer G. Compliance with trial registration in five core journals of clinical geriatrics: a survey of original publications on randomised controlled trials from 2008 to 2012. Age Ageing. 2014;43:872–6.CrossRef
35.
go back to reference Phillips AT, Desai NR, Krumholz HM, Zou CX, Miller JE, Ross JS. Association of the FDA Amendment Act with trial registration, publication, and outcome reporting. Trials. 2017;18:333.CrossRef Phillips AT, Desai NR, Krumholz HM, Zou CX, Miller JE, Ross JS. Association of the FDA Amendment Act with trial registration, publication, and outcome reporting. Trials. 2017;18:333.CrossRef
38.
go back to reference Downing NS, Aminawung JA, Shah ND, Krumholz HM, Ross JS. Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005-2012. JAMA. 2014;311:368–77.CrossRef Downing NS, Aminawung JA, Shah ND, Krumholz HM, Ross JS. Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005-2012. JAMA. 2014;311:368–77.CrossRef
39.
go back to reference Turner EH. How to access and process FDA drug approval packages for use in research. BMJ. 2013;347:f5992.CrossRef Turner EH. How to access and process FDA drug approval packages for use in research. BMJ. 2013;347:f5992.CrossRef
40.
go back to reference FDA. Design considerations for pivotal clinical investigations for medical devices. Guidance for industry, clinical investigators, institutional review boards and Food and Drug Administration staff. Silver Spring: FDA Center for Biologics Evaluation and Research; 2013. FDA. Design considerations for pivotal clinical investigations for medical devices. Guidance for industry, clinical investigators, institutional review boards and Food and Drug Administration staff. Silver Spring: FDA Center for Biologics Evaluation and Research; 2013.
41.
go back to reference Clauw DJ, Mease P, Palmer RH, Gendreau RM, Wang Y. Milnacipran for the treatment of fibromyalgia in adults: a 15-week, multicenter, randomized, double-blind, placebo-controlled, multiple-dose clinical trial. Clin Ther. 2008;30:1988–2004.CrossRef Clauw DJ, Mease P, Palmer RH, Gendreau RM, Wang Y. Milnacipran for the treatment of fibromyalgia in adults: a 15-week, multicenter, randomized, double-blind, placebo-controlled, multiple-dose clinical trial. Clin Ther. 2008;30:1988–2004.CrossRef
44.
go back to reference Centers for Disease Control and Prevention (CDC). Epi Info Companion App for iOS. 3.1.1 edition. Atlanta: Department of Health and Human Services-CDC; 2013. Centers for Disease Control and Prevention (CDC). Epi Info Companion App for iOS. 3.1.1 edition. Atlanta: Department of Health and Human Services-CDC; 2013.
Metadata
Title
Registration, results reporting, and publication bias of clinical trials supporting FDA approval of neuropsychiatric drugs before and after FDAAA: a retrospective cohort study
Authors
Constance X. Zou
Jessica E. Becker
Adam T. Phillips
James M. Garritano
Harlan M. Krumholz
Jennifer E. Miller
Joseph S. Ross
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Trials / Issue 1/2018
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-018-2957-0

Other articles of this Issue 1/2018

Trials 1/2018 Go to the issue