Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Correspondence

Recommendations for a uniform assessment of publication bias related to funding source

Authors: Marlies van Lent, John Overbeke, Henk J Out

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Numerous studies on publication bias in clinical drug research have been undertaken, particularly on the association between sponsorship and favourable outcomes. However, no standardized methodology for the classification of outcomes and sponsorship has been described. Dissimilarities and ambiguities in this assessment impede the ability to compare and summarize results of studies on publication bias. To guide authors undertaking such studies, this paper provides recommendations for a uniform assessment of publication bias related to funding source.

Methods and results

As part of ongoing research into publication bias, 472 manuscripts on randomised controlled trials (RCTs) with drugs, submitted to eight medical journals from January 2010 through April 2012, were reviewed. Information on trial results and sponsorship was extracted from manuscripts. During the start of this evaluation, several problems related to the classification of outcomes, inclusion of post-hoc analyses and follow-up studies of RCTs in the study sample, and assessment of the role of the funding source were encountered. A comprehensive list of recommendations addressing these problems was composed. To assess internal validity, reliability and usability of these recommendations were tested through evaluation of manuscripts submitted to journals included in our study.

Conclusions

The proposed recommendations represent a first step towards a uniform method of classifying trial outcomes and sponsorship. This is essential to draw valid conclusions on the role of the funding source in publication bias and will ensure consistency across future studies.
Literature
1.
go back to reference Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, Decullier E, Easterbrook PJ, Von EE, Gamble C, et al: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008, 3 (8): e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, Decullier E, Easterbrook PJ, Von EE, Gamble C, et al: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008, 3 (8): e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral
2.
go back to reference Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K: Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009, MR000006- Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K: Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009, MR000006-
3.
go back to reference Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R: Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008, 358: 252-260. 10.1056/NEJMsa065779.CrossRefPubMed Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R: Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008, 358: 252-260. 10.1056/NEJMsa065779.CrossRefPubMed
4.
go back to reference Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003, 289: 454-465. 10.1001/jama.289.4.454.CrossRefPubMed Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003, 289: 454-465. 10.1001/jama.289.4.454.CrossRefPubMed
5.
go back to reference Bourgeois FT, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010, 153: 158-166. 10.7326/0003-4819-153-3-201008030-00006.CrossRefPubMedPubMedCentral Bourgeois FT, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010, 153: 158-166. 10.7326/0003-4819-153-3-201008030-00006.CrossRefPubMedPubMedCentral
6.
go back to reference Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L: Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012, 12: MR000033 Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L: Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012, 12: MR000033
7.
go back to reference Krzyzanowska MK, Pintilie M, Tannock IF: Factors associated with failure to publish large randomized trials presented at an oncology meeting. JAMA. 2003, 290: 495-501. 10.1001/jama.290.4.495.CrossRefPubMed Krzyzanowska MK, Pintilie M, Tannock IF: Factors associated with failure to publish large randomized trials presented at an oncology meeting. JAMA. 2003, 290: 495-501. 10.1001/jama.290.4.495.CrossRefPubMed
8.
go back to reference Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009, 302: 977-984. 10.1001/jama.2009.1242.CrossRefPubMed Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009, 302: 977-984. 10.1001/jama.2009.1242.CrossRefPubMed
9.
go back to reference Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral
10.
go back to reference Tungaraza T, Poole R: Influence of drug company authorship and sponsorship on drug trial outcomes. Br J Psychiatry. 2007, 191: 82-83. 10.1192/bjp.bp.106.024547.CrossRefPubMed Tungaraza T, Poole R: Influence of drug company authorship and sponsorship on drug trial outcomes. Br J Psychiatry. 2007, 191: 82-83. 10.1192/bjp.bp.106.024547.CrossRefPubMed
11.
go back to reference Peppercorn J, Blood E, Winer E, Partridge A: Association between pharmaceutical involvement and outcomes in breast cancer clinical trials. Cancer. 2007, 109: 1239-1246. 10.1002/cncr.22528.CrossRefPubMed Peppercorn J, Blood E, Winer E, Partridge A: Association between pharmaceutical involvement and outcomes in breast cancer clinical trials. Cancer. 2007, 109: 1239-1246. 10.1002/cncr.22528.CrossRefPubMed
12.
go back to reference Ridker PM, Torres J: Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA. 2006, 295: 2270-2274. 10.1001/jama.295.19.2270.CrossRefPubMed Ridker PM, Torres J: Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA. 2006, 295: 2270-2274. 10.1001/jama.295.19.2270.CrossRefPubMed
13.
go back to reference Als-Nielsen B, Chen W, Gluud C, Kjaergard LL: Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events?. JAMA. 2003, 290: 921-928. 10.1001/jama.290.7.921.CrossRefPubMed Als-Nielsen B, Chen W, Gluud C, Kjaergard LL: Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events?. JAMA. 2003, 290: 921-928. 10.1001/jama.290.7.921.CrossRefPubMed
14.
go back to reference Finucane TE, Boult CE: Association of funding and findings of pharmaceutical research at a meeting of a medical professional society. Am J Med. 2004, 117: 842-845. 10.1016/j.amjmed.2004.05.029.CrossRefPubMed Finucane TE, Boult CE: Association of funding and findings of pharmaceutical research at a meeting of a medical professional society. Am J Med. 2004, 117: 842-845. 10.1016/j.amjmed.2004.05.029.CrossRefPubMed
15.
go back to reference Schulz KF, Altman DG, Moher D: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-10.1136/bmj.c332.CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-10.1136/bmj.c332.CrossRefPubMedPubMedCentral
16.
go back to reference Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral
17.
go back to reference Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012, 11: MR000030 Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012, 11: MR000030
20.
go back to reference Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral
21.
go back to reference Sismondo S: Pharmaceutical company funding and its consequences: a qualitative systematic review. Contemp Clin Trials. 2008, 29: 109-113. 10.1016/j.cct.2007.08.001.CrossRefPubMed Sismondo S: Pharmaceutical company funding and its consequences: a qualitative systematic review. Contemp Clin Trials. 2008, 29: 109-113. 10.1016/j.cct.2007.08.001.CrossRefPubMed
22.
go back to reference Lexchin J: Those who have the gold make the evidence: how the pharmaceutical industry biases the outcomes of clinical trials of medications. Sci Eng Ethics. 2012, 18: 247-261. 10.1007/s11948-011-9265-3.CrossRefPubMed Lexchin J: Those who have the gold make the evidence: how the pharmaceutical industry biases the outcomes of clinical trials of medications. Sci Eng Ethics. 2012, 18: 247-261. 10.1007/s11948-011-9265-3.CrossRefPubMed
23.
go back to reference Olson CM, Rennie D, Cook D, Dickersin K, Flanagin A, Hogan JW, Zhu Q, Reiling J, Pace B: Publication bias in editorial decision making. JAMA. 2002, 287: 2825-2828. 10.1001/jama.287.21.2825.CrossRefPubMed Olson CM, Rennie D, Cook D, Dickersin K, Flanagin A, Hogan JW, Zhu Q, Reiling J, Pace B: Publication bias in editorial decision making. JAMA. 2002, 287: 2825-2828. 10.1001/jama.287.21.2825.CrossRefPubMed
24.
go back to reference Lynch JR, Cunningham MR, Warme WJ, Schaad DC, Wolf FM, Leopold SS: Commercially funded and United States-based research is more likely to be published; good-quality studies with negative outcomes are not. J Bone Joint Surg Am. 2007, 89: 1010-1018. 10.2106/JBJS.F.01152.CrossRefPubMed Lynch JR, Cunningham MR, Warme WJ, Schaad DC, Wolf FM, Leopold SS: Commercially funded and United States-based research is more likely to be published; good-quality studies with negative outcomes are not. J Bone Joint Surg Am. 2007, 89: 1010-1018. 10.2106/JBJS.F.01152.CrossRefPubMed
25.
go back to reference Okike K, Kocher MS, Mehlman CT, Heckman JD, Bhandari M: Publication bias in orthopaedic research: an analysis of scientific factors associated with publication in the journal of bone and joint surgery (american volume). J Bone Joint Surg Am. 2008, 90: 595-601. 10.2106/JBJS.G.00279.CrossRefPubMed Okike K, Kocher MS, Mehlman CT, Heckman JD, Bhandari M: Publication bias in orthopaedic research: an analysis of scientific factors associated with publication in the journal of bone and joint surgery (american volume). J Bone Joint Surg Am. 2008, 90: 595-601. 10.2106/JBJS.G.00279.CrossRefPubMed
26.
go back to reference Boutron I, Dutton S, Ravaud P, Altman DG: Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed Boutron I, Dutton S, Ravaud P, Altman DG: Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed
27.
go back to reference Lundh A, Krogsboll LT, Gotzsche PC: Sponsors’ participation in conduct and reporting of industry trials: a descriptive study. Trials. 2012, 13: 146-10.1186/1745-6215-13-146.CrossRefPubMedPubMedCentral Lundh A, Krogsboll LT, Gotzsche PC: Sponsors’ participation in conduct and reporting of industry trials: a descriptive study. Trials. 2012, 13: 146-10.1186/1745-6215-13-146.CrossRefPubMedPubMedCentral
28.
go back to reference Rochon PA, Hoey J, Chan AW, Ferris LE, Lexchin J, Kalkar SR, Sekeres M, Wu W, Van Laethem M, Gruneir A, et al: Financial conflicts of interest checklist 2010 for clinical research studies. Open Med. 2010, 4: e69-e91.PubMedPubMedCentral Rochon PA, Hoey J, Chan AW, Ferris LE, Lexchin J, Kalkar SR, Sekeres M, Wu W, Van Laethem M, Gruneir A, et al: Financial conflicts of interest checklist 2010 for clinical research studies. Open Med. 2010, 4: e69-e91.PubMedPubMedCentral
Metadata
Title
Recommendations for a uniform assessment of publication bias related to funding source
Authors
Marlies van Lent
John Overbeke
Henk J Out
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-120

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue