Skip to main content
Top
Published in: Journal of General Internal Medicine 10/2020

01-10-2020 | Original Research

Evaluation of Selective Outcome Reporting Bias in Efficacy Endpoints in Print and Television Advertisements for Oncology Drugs

Authors: Cole Wayant, B.S., Greg Aran, D.O., Bradley S. Johnson, B.S., Matt Vassar, Ph.D.

Published in: Journal of General Internal Medicine | Issue 10/2020

Login to get access

Abstract

Importance

Selective outcome reporting bias in oncology drug advertisements may encourage misconceptions about a drug’s efficacy profile.

Objective

We sought to determine the rates of selective outcome reporting in published cancer clinical trials and in television and print advertisements for anticancer medications. We also quantified the number of advertisements that did not include or cite any studies with mature overall survival (OS) data (i.e., data with all required patient events for final analysis).

Design/Setting/Participants

We conducted a cross-sectional investigation of advertisements uploaded to the AdPharm Database (repository of pharmaceutical advertisements); the clinical trials supporting the ads; and the trial registrations associated with the trials. Data were extracted by two investigators who were blinded to each other’s data.

Main outcome measures

The first co-primary objective was to investigate selective outcome reporting between trial registrations and published trials. The second co-primary objective was to investigate selective outcome reporting between the same published trials and drug advertisements.

Results

We included 74 advertisements and 48 clinical trials. Print ads were the most common (n = 66), and most print advertisements were targeted to health care providers (n = 55, 83.3%). Overall, 41/48 (85.4%) trials were registered prior to study enrollment, and 41/48 (85.4%) did not deviate from the registered primary endpoints. Across all advertisements (n = 74), statistically significant endpoints were more often reported (unadjusted risk ratio [uRR] 1.26; 95% confidence interval [CI] (1.14–1.40)) and 22/55 (40.0%) advertisements cited trials with immature overall survival data (i.e., data without the required number of events for final analysis).

Conclusions

In our sample, statistically significant endpoints were more commonly reported than nonsignificant endpoints. Immature endpoints (those analyzed before the required number of accrued patient events) were often reported. By reporting only significant endpoints and those that are immature, advertisers may encourage misconceptions about a drug’s efficacy profile.
Literature
1.
go back to reference Donohue JM, Cevasco M, Rosenthal MB. A Decade of Direct-to-Consumer Advertising of Prescription Drugs. N Engl J Med. 2007;357(7):673-681.CrossRef Donohue JM, Cevasco M, Rosenthal MB. A Decade of Direct-to-Consumer Advertising of Prescription Drugs. N Engl J Med. 2007;357(7):673-681.CrossRef
3.
go back to reference Stange KC. Time to ban direct-to-consumer prescription drug marketing. Ann Fam Med. 2007;5(2):101-104.CrossRef Stange KC. Time to ban direct-to-consumer prescription drug marketing. Ann Fam Med. 2007;5(2):101-104.CrossRef
4.
go back to reference Connors AL. Big bad pharma: an ethical analysis of physician-directed and consumer-directed marketing tactics. Albany Law Rev. 2009;73(1):243-282.PubMed Connors AL. Big bad pharma: an ethical analysis of physician-directed and consumer-directed marketing tactics. Albany Law Rev. 2009;73(1):243-282.PubMed
5.
go back to reference Delbaere M, Smith MC. Health care knowledge and consumer learning: the case of direct-to-consumer drug advertising. Health Mark Q. 2006;23(3):9-29.CrossRef Delbaere M, Smith MC. Health care knowledge and consumer learning: the case of direct-to-consumer drug advertising. Health Mark Q. 2006;23(3):9-29.CrossRef
6.
go back to reference Boden WE, Diamond GA. DTCA for PTCA—crossing the line in consumer health education? N Engl J Med. 2008;358(21):2197-2200.CrossRef Boden WE, Diamond GA. DTCA for PTCA—crossing the line in consumer health education? N Engl J Med. 2008;358(21):2197-2200.CrossRef
7.
go back to reference Frosch DL, Krueger PM, Hornik RC, Cronholm PF, Barg FK. Creating demand for prescription drugs: a content analysis of television direct-to-consumer advertising. Ann Fam Med. 2007;5(1):6-13.CrossRef Frosch DL, Krueger PM, Hornik RC, Cronholm PF, Barg FK. Creating demand for prescription drugs: a content analysis of television direct-to-consumer advertising. Ann Fam Med. 2007;5(1):6-13.CrossRef
8.
go back to reference Almasi EA, Stafford RS, Kravitz RL, Mansfield PR. What are the public health effects of direct-to-consumer drug advertising? PLoS Med. 2006;3(3):e145.CrossRef Almasi EA, Stafford RS, Kravitz RL, Mansfield PR. What are the public health effects of direct-to-consumer drug advertising? PLoS Med. 2006;3(3):e145.CrossRef
9.
10.
go back to reference Frosch DL, Grande D, Tarn DM, Kravitz RL. A Decade of Controversy: Balancing Policy With Evidence in the Regulation of Prescription Drug Advertising. Am J Public Health. 2010;100(1):24-32.CrossRef Frosch DL, Grande D, Tarn DM, Kravitz RL. A Decade of Controversy: Balancing Policy With Evidence in the Regulation of Prescription Drug Advertising. Am J Public Health. 2010;100(1):24-32.CrossRef
11.
go back to reference Schnipper LE, Abel GA. Direct-to-Consumer Drug Advertising in Oncology Is Not Beneficial to Patients or Public Health. JAMA Oncol. 2016;2(11):1397-1398.CrossRef Schnipper LE, Abel GA. Direct-to-Consumer Drug Advertising in Oncology Is Not Beneficial to Patients or Public Health. JAMA Oncol. 2016;2(11):1397-1398.CrossRef
12.
go back to reference Abel GA, Chen K, Taback N, Hassett MJ, Schrag D, Weeks JC. Impact of oncology-related direct-to-consumer advertising: Association with appropriate and inappropriate prescriptions. Cancer. 2013;119(5):1065-1072.CrossRef Abel GA, Chen K, Taback N, Hassett MJ, Schrag D, Weeks JC. Impact of oncology-related direct-to-consumer advertising: Association with appropriate and inappropriate prescriptions. Cancer. 2013;119(5):1065-1072.CrossRef
13.
go back to reference Kim H. Trouble Spots in Online Direct-to-Consumer Prescription Drug Promotion: A Content Analysis of FDA Warning Letters. Int J Health Policy Manag. 2015;4(12):813-821.CrossRef Kim H. Trouble Spots in Online Direct-to-Consumer Prescription Drug Promotion: A Content Analysis of FDA Warning Letters. Int J Health Policy Manag. 2015;4(12):813-821.CrossRef
14.
go back to reference Kroschinsky F, Stölzel F, von Bonin S, et al. New drugs, new toxicities: severe side effects of modern targeted and immunotherapy of cancer and their management. Crit Care. 2017;21(1):89.CrossRef Kroschinsky F, Stölzel F, von Bonin S, et al. New drugs, new toxicities: severe side effects of modern targeted and immunotherapy of cancer and their management. Crit Care. 2017;21(1):89.CrossRef
15.
go back to reference Mariotto AB, Yabroff KR, Shao Y, Feuer EJ, Brown ML. Projections of the cost of cancer care in the United States: 2010-2020. J Natl Cancer Inst. 2011;103(2):117-128.CrossRef Mariotto AB, Yabroff KR, Shao Y, Feuer EJ, Brown ML. Projections of the cost of cancer care in the United States: 2010-2020. J Natl Cancer Inst. 2011;103(2):117-128.CrossRef
16.
go back to reference Chan A-W, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457-2465.CrossRef Chan A-W, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457-2465.CrossRef
17.
go back to reference Wittes J. On changing a long-term clinical trial midstream. Stat Med. 2002;21(19):2789-2795.CrossRef Wittes J. On changing a long-term clinical trial midstream. Stat Med. 2002;21(19):2789-2795.CrossRef
18.
go back to reference Wayant C, Scheckel C, Hicks C, et al. Evidence of selective reporting bias in hematology journals: A systematic review. PLoS One. 2017;12(6):e0178379.CrossRef Wayant C, Scheckel C, Hicks C, et al. Evidence of selective reporting bias in hematology journals: A systematic review. PLoS One. 2017;12(6):e0178379.CrossRef
19.
go back to reference Kirkham JJ, Dwan KM, Altman DG, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365.CrossRef Kirkham JJ, Dwan KM, Altman DG, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365.CrossRef
20.
go back to reference Rankin J, Ross A, Baker J, O’Brien M, Scheckel C, Vassar M. Selective outcome reporting in obesity clinical trials: a cross-sectional review. Clin Obes. 2017;7(4):245-254.CrossRef Rankin J, Ross A, Baker J, O’Brien M, Scheckel C, Vassar M. Selective outcome reporting in obesity clinical trials: a cross-sectional review. Clin Obes. 2017;7(4):245-254.CrossRef
21.
go back to reference Raghav KPS, Mahajan S, Yao JC, et al. From Protocols to Publications: A Study in Selective Reporting of Outcomes in Randomized Trials in Oncology. J Clin Oncol. 2015;33(31):3583-3590.CrossRef Raghav KPS, Mahajan S, Yao JC, et al. From Protocols to Publications: A Study in Selective Reporting of Outcomes in Randomized Trials in Oncology. J Clin Oncol. 2015;33(31):3583-3590.CrossRef
22.
go back to reference Klara K, Kim J, Ross JS. Direct-to-Consumer Broadcast Advertisements for Pharmaceuticals: Off-Label Promotion and Adherence to FDA Guidelines. J Gen Intern Med. 2018;33(5):651-658.CrossRef Klara K, Kim J, Ross JS. Direct-to-Consumer Broadcast Advertisements for Pharmaceuticals: Off-Label Promotion and Adherence to FDA Guidelines. J Gen Intern Med. 2018;33(5):651-658.CrossRef
23.
go back to reference Chen H, Cohen P, Chen S. How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies. Commun Stat Simul Comput. 2010;39(4):860-864.CrossRef Chen H, Cohen P, Chen S. How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies. Commun Stat Simul Comput. 2010;39(4):860-864.CrossRef
24.
go back to reference VanderWeele TJ, Ding P. Sensitivity Analysis in Observational Research: Introducing the E-Value. Ann Intern Med. 2017;167(4):268-274.CrossRef VanderWeele TJ, Ding P. Sensitivity Analysis in Observational Research: Introducing the E-Value. Ann Intern Med. 2017;167(4):268-274.CrossRef
25.
go back to reference Dwan K, Altman DG, Clarke M, et al. Evidence for the selective reporting of analyses and discrepancies in clinical trials: a systematic review of cohort studies of clinical trials. PLoS Med . 2014;11(6):e1001666.CrossRef Dwan K, Altman DG, Clarke M, et al. Evidence for the selective reporting of analyses and discrepancies in clinical trials: a systematic review of cohort studies of clinical trials. PLoS Med . 2014;11(6):e1001666.CrossRef
27.
go back to reference Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921-928.CrossRef Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921-928.CrossRef
28.
go back to reference Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome: systematic review with meta-analysis. Intensive Care Med. 2018;44(10):1603-1612.CrossRef Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome: systematic review with meta-analysis. Intensive Care Med. 2018;44(10):1603-1612.CrossRef
29.
go back to reference Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2017;2:MR000033. Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2017;2:MR000033.
30.
go back to reference Haslam A, Hey SP, Gill J, Prasad V. A systematic review of trial-level meta-analyses measuring the strength of association between surrogate end-points and overall survival in oncology. Eur J Cancer. 2019;106:196-211.CrossRef Haslam A, Hey SP, Gill J, Prasad V. A systematic review of trial-level meta-analyses measuring the strength of association between surrogate end-points and overall survival in oncology. Eur J Cancer. 2019;106:196-211.CrossRef
31.
go back to reference Wayant C, Vassar M. A comparison of matched interim analysis publications and final analysis publications in oncology clinical trials. Ann Oncol. 2018;29(12):2384-2390.CrossRef Wayant C, Vassar M. A comparison of matched interim analysis publications and final analysis publications in oncology clinical trials. Ann Oncol. 2018;29(12):2384-2390.CrossRef
32.
go back to reference Booth CM, Eisenhauer EA. Progression-free survival: meaningful or simply measurable? J Clin Oncol. 2012;30(10):1030-1033.CrossRef Booth CM, Eisenhauer EA. Progression-free survival: meaningful or simply measurable? J Clin Oncol. 2012;30(10):1030-1033.CrossRef
33.
go back to reference Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010;303(12):1180-1187.CrossRef Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010;303(12):1180-1187.CrossRef
36.
go back to reference Boutron I, Altman DG, Hopewell S, Vera-Badillo F, Tannock I, Ravaud P. Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial. J Clin Oncol. 2014;32(36):4120-4126.CrossRef Boutron I, Altman DG, Hopewell S, Vera-Badillo F, Tannock I, Ravaud P. Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial. J Clin Oncol. 2014;32(36):4120-4126.CrossRef
Metadata
Title
Evaluation of Selective Outcome Reporting Bias in Efficacy Endpoints in Print and Television Advertisements for Oncology Drugs
Authors
Cole Wayant, B.S.
Greg Aran, D.O.
Bradley S. Johnson, B.S.
Matt Vassar, Ph.D.
Publication date
01-10-2020
Publisher
Springer International Publishing
Published in
Journal of General Internal Medicine / Issue 10/2020
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-020-06028-1

Other articles of this Issue 10/2020

Journal of General Internal Medicine 10/2020 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.