Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Research

The association of funding source on effect size in randomized controlled trials: 2013–2015 – a cross-sectional survey and meta-analysis

Authors: Alberto Falk Delgado, Anna Falk Delgado

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

Trials financed by for-profit organizations have been associated with favorable outcomes of new treatments, although the effect size of funding source impact on outcome is unknown. The aim of this study was to estimate the effect size for a favorable outcome in randomized controlled trials (RCTs), stratified by funding source, that have been published in general medical journals.

Methods

Parallel-group RCTs published in The Lancet, New England Journal of Medicine, and JAMA between 2013 and 2015 were identified. RCTs with binary primary endpoints were included. The primary outcome was the OR of patients’ having a favorable outcome in the intervention group compared with the control group. The OR of a favorable outcome in each trial was calculated by the number of positive events that occurred in the intervention and control groups. A meta-analytic technique with random effects model was used to calculate summary OR. Data were stratified by funding source as for-profit, mixed, and nonprofit. Prespecified sensitivity, subgroup, and metaregression analyses were performed.

Results

Five hundred nine trials were included. The OR for a favorable outcome in for-profit-funded RCTs was 1.92 (95% CI 1.72–2.14), which was higher than mixed source-funded RCTs (OR 1.34, 95% CI 1.25–1.43) and nonprofit-funded RCTs (OR 1.32, 95% CI 1.26–1.39). The OR for a favorable outcome was higher for both clinical and surrogate endpoints in for-profit-funded trials than in RCTs with other funding sources. Excluding drug trials lowered the OR for a favorable outcome in for-profit-funded RCTs. The OR for a favorable surrogate outcome in drug trials was higher in for-profit-funded trials than in nonprofit-funded trials.

Conclusions

For-profit-funded RCTs have a higher OR for a favorable outcome than nonprofit- and mixed source-funded RCTs. This difference is associated mainly with the use of surrogate endpoints in for-profit-financed drug trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012;12:MR000033.PubMed Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012;12:MR000033.PubMed
2.
go back to reference Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289(4):454–65.CrossRefPubMed Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289(4):454–65.CrossRefPubMed
3.
go back to reference Ridker PM, Torres J. Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA. 2006;295(19):2270–4.CrossRefPubMed Ridker PM, Torres J. Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA. 2006;295(19):2270–4.CrossRefPubMed
4.
go back to reference Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, et al. The uncertainty principle and industry-sponsored research. Lancet. 2000;356(9230):635–8.CrossRefPubMed Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, et al. The uncertainty principle and industry-sponsored research. Lancet. 2000;356(9230):635–8.CrossRefPubMed
5.
go back to reference Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921–8.CrossRefPubMed Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921–8.CrossRefPubMed
6.
go back to reference Kjaergard LL, Als-Nielsen B. Association between competing interests and authors’ conclusions: epidemiological study of randomised clinical trials published in the BMJ. BMJ. 2002;325(7358):249.CrossRefPubMedPubMedCentral Kjaergard LL, Als-Nielsen B. Association between competing interests and authors’ conclusions: epidemiological study of randomised clinical trials published in the BMJ. BMJ. 2002;325(7358):249.CrossRefPubMedPubMedCentral
7.
go back to reference Roper N, Zhang N, Korenstein D. Industry collaboration and randomized clinical trial design and outcomes. JAMA Intern Med. 2014;174(10):1695–6.CrossRefPubMed Roper N, Zhang N, Korenstein D. Industry collaboration and randomized clinical trial design and outcomes. JAMA Intern Med. 2014;174(10):1695–6.CrossRefPubMed
8.
go back to reference Aneja A, Esquitin R, Shah K, Iyengar R, Nisenbaum R, Melo M, et al. Authors’ self-declared financial conflicts of interest do not impact the results of major cardiovascular trials. J Am Coll Cardiol. 2013;61(11):1137–43.CrossRefPubMed Aneja A, Esquitin R, Shah K, Iyengar R, Nisenbaum R, Melo M, et al. Authors’ self-declared financial conflicts of interest do not impact the results of major cardiovascular trials. J Am Coll Cardiol. 2013;61(11):1137–43.CrossRefPubMed
10.
go back to reference Friedrich JO, Adhikari NKJ, Beyene J. Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data. BMC Med Res Methodol. 2007;7:5.CrossRefPubMedPubMedCentral Friedrich JO, Adhikari NKJ, Beyene J. Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data. BMC Med Res Methodol. 2007;7:5.CrossRefPubMedPubMedCentral
12.
go back to reference Montedori A, Bonacini MI, Casazza G, Luchetta ML, Duca P, Cozzolino F, et al. Modified versus standard intention-to-treat reporting: are there differences in methodological quality, sponsorship, and findings in randomized trials? A cross-sectional study. Trials. 2011;12:58.CrossRefPubMedPubMedCentral Montedori A, Bonacini MI, Casazza G, Luchetta ML, Duca P, Cozzolino F, et al. Modified versus standard intention-to-treat reporting: are there differences in methodological quality, sponsorship, and findings in randomized trials? A cross-sectional study. Trials. 2011;12:58.CrossRefPubMedPubMedCentral
13.
go back to reference Ioannidis JPA, Haidich AB, Pappa M, Pantazis N, Kokori SI, Tektonidou MG, et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies. JAMA. 2001;286(7):821–30.CrossRefPubMed Ioannidis JPA, Haidich AB, Pappa M, Pantazis N, Kokori SI, Tektonidou MG, et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies. JAMA. 2001;286(7):821–30.CrossRefPubMed
14.
15.
go back to reference Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003;326(7400):1167–70.CrossRefPubMedPubMedCentral Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003;326(7400):1167–70.CrossRefPubMedPubMedCentral
16.
go back to reference Lesser LI, Ebbeling CB, Goozner M, Wypij D, Ludwig DS. Relationship between funding source and conclusion among nutrition-related scientific articles. PLoS Med. 2007;4(1):e5.CrossRefPubMedPubMedCentral Lesser LI, Ebbeling CB, Goozner M, Wypij D, Ludwig DS. Relationship between funding source and conclusion among nutrition-related scientific articles. PLoS Med. 2007;4(1):e5.CrossRefPubMedPubMedCentral
17.
go back to reference Barden J, Derry S, McQuay HJ, Moore RA. Bias from industry trial funding? A framework, a suggested approach, and a negative result. Pain. 2006;121(3):207–18.CrossRefPubMed Barden J, Derry S, McQuay HJ, Moore RA. Bias from industry trial funding? A framework, a suggested approach, and a negative result. Pain. 2006;121(3):207–18.CrossRefPubMed
18.
go back to reference Davis JM, Chen N, Glick ID. Issues that may determine the outcome of antipsychotic trials: industry sponsorship and extrapyramidal side effect. Neuropsychopharmacology. 2008;33(5):971–5.CrossRefPubMed Davis JM, Chen N, Glick ID. Issues that may determine the outcome of antipsychotic trials: industry sponsorship and extrapyramidal side effect. Neuropsychopharmacology. 2008;33(5):971–5.CrossRefPubMed
19.
go back to reference Etter JF, Burri M, Stapleton J. The impact of pharmaceutical company funding on results of randomized trials of nicotine replacement therapy for smoking cessation: a meta-analysis. Addiction. 2007;102(5):815–22.CrossRefPubMed Etter JF, Burri M, Stapleton J. The impact of pharmaceutical company funding on results of randomized trials of nicotine replacement therapy for smoking cessation: a meta-analysis. Addiction. 2007;102(5):815–22.CrossRefPubMed
20.
go back to reference Vlad SC, LaValley MP, McAlindon TE, Felson DT. Glucosamine for pain in osteoarthritis: why do trial results differ? Arthritis Rheum. 2007;56(7):2267–77.CrossRefPubMed Vlad SC, LaValley MP, McAlindon TE, Felson DT. Glucosamine for pain in osteoarthritis: why do trial results differ? Arthritis Rheum. 2007;56(7):2267–77.CrossRefPubMed
21.
go back to reference Jacobson DA, Bhanot K, Yarascavitch B, Chuback J, Rosenbloom E, Bhandari M. Levels of evidence: a comparison between top medical journals and general pediatric journals. BMC Pediatr. 2015;15:3.CrossRefPubMedPubMedCentral Jacobson DA, Bhanot K, Yarascavitch B, Chuback J, Rosenbloom E, Bhandari M. Levels of evidence: a comparison between top medical journals and general pediatric journals. BMC Pediatr. 2015;15:3.CrossRefPubMedPubMedCentral
22.
go back to reference Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.CrossRefPubMed Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.CrossRefPubMed
23.
go back to reference Kjaergard LL, Nikolova D, Gluud C. Randomized clinical trials in Hepatology: predictors of quality. Hepatology. 1999;30(5):1134–8.CrossRefPubMed Kjaergard LL, Nikolova D, Gluud C. Randomized clinical trials in Hepatology: predictors of quality. Hepatology. 1999;30(5):1134–8.CrossRefPubMed
24.
go back to reference Cho MK, Bero LA. The quality of drug studies published in symposium proceedings. Ann Intern Med. 1996;124(5):485–9.CrossRefPubMed Cho MK, Bero LA. The quality of drug studies published in symposium proceedings. Ann Intern Med. 1996;124(5):485–9.CrossRefPubMed
25.
go back to reference Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003;326(7400):1171–3.CrossRefPubMedPubMedCentral Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B. Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003;326(7400):1171–3.CrossRefPubMedPubMedCentral
26.
go back to reference Madigan D, Sigelman DW, Mayer JW, Furberg CD, Avorn J. Under-reporting of cardiovascular events in the rofecoxib Alzheimer disease studies. Am Heart J. 2012;164(2):186–93.CrossRefPubMed Madigan D, Sigelman DW, Mayer JW, Furberg CD, Avorn J. Under-reporting of cardiovascular events in the rofecoxib Alzheimer disease studies. Am Heart J. 2012;164(2):186–93.CrossRefPubMed
27.
28.
go back to reference Kasenda B, von Elm E, You J, Blümle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311(10):1045–51.CrossRefPubMed Kasenda B, von Elm E, You J, Blümle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311(10):1045–51.CrossRefPubMed
29.
go back to reference Svensson S, Menkes DB, Lexchin J. Surrogate outcomes in clinical trials: a cautionary tale. JAMA Intern Med. 2013;173(8):611–2.CrossRefPubMed Svensson S, Menkes DB, Lexchin J. Surrogate outcomes in clinical trials: a cautionary tale. JAMA Intern Med. 2013;173(8):611–2.CrossRefPubMed
30.
go back to reference Kesselheim AS, Robertson CT, Myers JA, Rose SL, Gillet V, Ross KM, et al. A randomized study of how physicians interpret research funding disclosures. N Engl J Med. 2012;367(12):1119–27.CrossRefPubMedPubMedCentral Kesselheim AS, Robertson CT, Myers JA, Rose SL, Gillet V, Ross KM, et al. A randomized study of how physicians interpret research funding disclosures. N Engl J Med. 2012;367(12):1119–27.CrossRefPubMedPubMedCentral
31.
go back to reference De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351(12):1250–1.CrossRefPubMed De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351(12):1250–1.CrossRefPubMed
32.
go back to reference Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.CrossRefPubMedPubMedCentral
33.
go back to reference Taichman DB, Backus J, Baethge C, Bauchner H, de Leeuw PW, Drazen JM, et al. Sharing clinical trial data: a proposal from the International Committee of Medical Journal Editors. PLoS Med. 2016;13(1):e1001950.CrossRefPubMedPubMedCentral Taichman DB, Backus J, Baethge C, Bauchner H, de Leeuw PW, Drazen JM, et al. Sharing clinical trial data: a proposal from the International Committee of Medical Journal Editors. PLoS Med. 2016;13(1):e1001950.CrossRefPubMedPubMedCentral
34.
go back to reference Ebrahim S, Sohani ZN, Montoya L, Agarwal A, Thorlund K, Mills EJ, et al. Reanalyses of randomized clinical trial data. JAMA. 2014;312(10):1024–32.CrossRefPubMed Ebrahim S, Sohani ZN, Montoya L, Agarwal A, Thorlund K, Mills EJ, et al. Reanalyses of randomized clinical trial data. JAMA. 2014;312(10):1024–32.CrossRefPubMed
Metadata
Title
The association of funding source on effect size in randomized controlled trials: 2013–2015 – a cross-sectional survey and meta-analysis
Authors
Alberto Falk Delgado
Anna Falk Delgado
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-1872-0

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue