Skip to main content
Top
Published in: Journal of General Internal Medicine 4/2019

01-04-2019 | Review Paper

Use of Mortality as an Endpoint in Noninferiority Trials May Lead to Ethically Problematic Conclusions

Authors: Andrew M. Hersh, MD, Robert J. Walter, MD, DHCE, Scott K. Abberegg, MD, MPH

Published in: Journal of General Internal Medicine | Issue 4/2019

Login to get access

Abstract

Background

Noninferiority trials are becoming more common. Their design often requires investigators to “trade” a secondary benefit for efficacy. Use of mortality as an outcome of interest leads to important ethical conflicts whereby researchers must establish a minimal clinically important difference for mortality, a process which has the potential to result in problematic conclusions.

Objective

We sought to investigate the frequency of the use of mortality as an outcome in noninferiority trials, as well as to determine the average pre-specified noninferiority (“delta”) values.

Design

We searched MEDLINE for reports of parallel-group randomized controlled noninferiority trials published in five high-impact general medical journals.

Main Outcome Measures

Data abstracted from articles including trial design parameters, results, and interpretation of results based on CONSORT recommendations.

Results

One hundred seventy-three manuscripts reporting 196 noninferiority comparisons were included in our analysis. Of these, over a third (67 trials) used mortality either as their sole endpoint (11 trials) or as part of a composite endpoint (56 trials). Nine trials were consort A, 21 trials consort B, 19 trials consort C, 12 were consort F, 4 consort G, and 2 were consort H. Four analyses showed statistically significant more deaths in the new treatment arm, while meeting consort criteria as “inconclusive” (consort G), (Behringer et al. in Lancet. 385(9976):1418–1427, 2015; Kaul et al. in N Engl J Med. 373(18):1709–1719, 2015; Bwakura-Dangarembizi et al. in N Engl J Med. 370(1):41–53, 2014) and thirteen trials utilizing mortality as an endpoint and had an absolute increase of > 3%, and six had an absolute increase of > 5%.

Conclusions

The use of mortality as an outcome in noninferiority trials is not rare and scenarios where the new treatment is statistically worse, but a conclusion of noninferiority or inconclusive do occur. We highlight these issues and propose simple steps to reduce the risk of ethically dubious conclusions.
Literature
1.
go back to reference Soonawala D, Middelburg RA, Egger M, Vandenbroucke JP, Dekkers OM. Efficacy of experimental treatments compared with standard treatments in non-inferiority trials: a meta-analysis of randomized controlled trials. Int J Epidemiol. 2010;39(6):1567–1581.CrossRefPubMed Soonawala D, Middelburg RA, Egger M, Vandenbroucke JP, Dekkers OM. Efficacy of experimental treatments compared with standard treatments in non-inferiority trials: a meta-analysis of randomized controlled trials. Int J Epidemiol. 2010;39(6):1567–1581.CrossRefPubMed
2.
go back to reference Le Henanff A, Giraudeau B, Baron G, Ravaud P. Quality of reporting of noninferiority and equivalence randomized trials. JAMA. 2006;295(10):1147–1151.CrossRefPubMed Le Henanff A, Giraudeau B, Baron G, Ravaud P. Quality of reporting of noninferiority and equivalence randomized trials. JAMA. 2006;295(10):1147–1151.CrossRefPubMed
3.
go back to reference Flacco ME, Manzoli L, Boccia S, et al. Head-to-head randomized trials are mostly industry sponsored and almost always favor the industry sponsor. J Clin Epidemiol. 2015;68(7):811–820.CrossRefPubMed Flacco ME, Manzoli L, Boccia S, et al. Head-to-head randomized trials are mostly industry sponsored and almost always favor the industry sponsor. J Clin Epidemiol. 2015;68(7):811–820.CrossRefPubMed
4.
go back to reference Garattini S, Bertele’ V. Non-inferiority trials are unethical because they disregard patients' interests. Lancet. 2007;370(9602):1875–1877.CrossRefPubMed Garattini S, Bertele’ V. Non-inferiority trials are unethical because they disregard patients' interests. Lancet. 2007;370(9602):1875–1877.CrossRefPubMed
5.
go back to reference Lesaffre E. Superiority, equivalence, and non-inferiority trials. Bull NYU Hosp Jt Dis. 2008;66(2):150–154.PubMed Lesaffre E. Superiority, equivalence, and non-inferiority trials. Bull NYU Hosp Jt Dis. 2008;66(2):150–154.PubMed
6.
go back to reference Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG, Group C. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594–2604.CrossRefPubMed Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG, Group C. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594–2604.CrossRefPubMed
7.
go back to reference Aberegg SK, Hersh AM, Samore MH. Empirical Consequences of Current Recommendations for the Design and Interpretation of Noninferiority Trials. J Gen Intern Med. 2018;33(1):88–96.CrossRefPubMed Aberegg SK, Hersh AM, Samore MH. Empirical Consequences of Current Recommendations for the Design and Interpretation of Noninferiority Trials. J Gen Intern Med. 2018;33(1):88–96.CrossRefPubMed
8.
go back to reference Schulman S, Kearon C, Kakkar AK, et al. Extended use of dabigatran, warfarin, or placebo in venous thromboembolism. N Engl J Med. 2013;368(8):709–718.CrossRefPubMed Schulman S, Kearon C, Kakkar AK, et al. Extended use of dabigatran, warfarin, or placebo in venous thromboembolism. N Engl J Med. 2013;368(8):709–718.CrossRefPubMed
9.
go back to reference Motzer RJ, Hutson TE, Cella D, et al. Pazopanib versus sunitinib in metastatic renal-cell carcinoma. N Engl J Med. 2013;369(8):722–731.CrossRefPubMed Motzer RJ, Hutson TE, Cella D, et al. Pazopanib versus sunitinib in metastatic renal-cell carcinoma. N Engl J Med. 2013;369(8):722–731.CrossRefPubMed
10.
go back to reference von Birgelen C, Sen H, Lam MK, et al. Third-generation zotarolimus-eluting and everolimus-eluting stents in all-comer patients requiring a percutaneous coronary intervention (DUTCH PEERS): a randomised, single-blind, multicentre, non-inferiority trial. Lancet. 2014;383(9915):413–423.CrossRef von Birgelen C, Sen H, Lam MK, et al. Third-generation zotarolimus-eluting and everolimus-eluting stents in all-comer patients requiring a percutaneous coronary intervention (DUTCH PEERS): a randomised, single-blind, multicentre, non-inferiority trial. Lancet. 2014;383(9915):413–423.CrossRef
11.
go back to reference Pilgrim T, Heg D, Roffi M, et al. Ultrathin strut biodegradable polymer sirolimus-eluting stent versus durable polymer everolimus-eluting stent for percutaneous coronary revascularisation (BIOSCIENCE): a randomised, single-blind, non-inferiority trial. Lancet. 2014;384(9960):2111–2122.CrossRefPubMed Pilgrim T, Heg D, Roffi M, et al. Ultrathin strut biodegradable polymer sirolimus-eluting stent versus durable polymer everolimus-eluting stent for percutaneous coronary revascularisation (BIOSCIENCE): a randomised, single-blind, non-inferiority trial. Lancet. 2014;384(9960):2111–2122.CrossRefPubMed
12.
go back to reference Büller HR, Prins MH, Lensin AW, et al. Oral rivaroxaban for the treatment of symptomatic pulmonary embolism. N Engl J Med. 2012;366(14):1287–1297.CrossRefPubMed Büller HR, Prins MH, Lensin AW, et al. Oral rivaroxaban for the treatment of symptomatic pulmonary embolism. N Engl J Med. 2012;366(14):1287–1297.CrossRefPubMed
13.
go back to reference Raungaard B, Jensen LO, Tilsted HH, et al. Zotarolimus-eluting durable-polymer-coated stent versus a biolimus-eluting biodegradable-polymer-coated stent in unselected patients undergoing percutaneous coronary intervention (SORT OUT VI): a randomised non-inferiority trial. Lancet. 2015;385(9977):1527–1535.CrossRefPubMed Raungaard B, Jensen LO, Tilsted HH, et al. Zotarolimus-eluting durable-polymer-coated stent versus a biolimus-eluting biodegradable-polymer-coated stent in unselected patients undergoing percutaneous coronary intervention (SORT OUT VI): a randomised non-inferiority trial. Lancet. 2015;385(9977):1527–1535.CrossRefPubMed
14.
go back to reference Feres F, Costa RA, Abizaid A, et al. Three vs twelve months of dual antiplatelet therapy after zotarolimus-eluting stents: the OPTIMIZE randomized trial. JAMA. 2013;310(23):2510–2522.PubMed Feres F, Costa RA, Abizaid A, et al. Three vs twelve months of dual antiplatelet therapy after zotarolimus-eluting stents: the OPTIMIZE randomized trial. JAMA. 2013;310(23):2510–2522.PubMed
15.
go back to reference Jacobs AK, Normand SL, Massaro JM, et al. Nonemergency PCI at hospitals with or without on-site cardiac surgery. N Engl J Med. 2013;368(16):1498–1508.CrossRefPubMed Jacobs AK, Normand SL, Massaro JM, et al. Nonemergency PCI at hospitals with or without on-site cardiac surgery. N Engl J Med. 2013;368(16):1498–1508.CrossRefPubMed
16.
go back to reference Ellis SG, Kereiakes DJ, Metzger DC, et al. Everolimus-Eluting Bioresorbable Scaffolds for Coronary Artery Disease. N Engl J Med. 2015;373(20):1905–1915.CrossRefPubMed Ellis SG, Kereiakes DJ, Metzger DC, et al. Everolimus-Eluting Bioresorbable Scaffolds for Coronary Artery Disease. N Engl J Med. 2015;373(20):1905–1915.CrossRefPubMed
17.
go back to reference Smits PC, Hofma S, Togni M, et al. Abluminal biodegradable polymer biolimus-eluting stent versus durable polymer everolimus-eluting stent (COMPARE II): a randomised, controlled, non-inferiority trial. Lancet. 2013;381(9867):651–660.CrossRefPubMed Smits PC, Hofma S, Togni M, et al. Abluminal biodegradable polymer biolimus-eluting stent versus durable polymer everolimus-eluting stent (COMPARE II): a randomised, controlled, non-inferiority trial. Lancet. 2013;381(9867):651–660.CrossRefPubMed
18.
go back to reference Pritchard-Jones K, Bergeron C, de Camargo B, et al. Omission of doxorubicin from the treatment of stage II-III, intermediate-risk Wilms' tumour (SIOP WT 2001): an open-label, non-inferiority, randomised controlled trial. Lancet. 2015;386(9999):1156–1164.CrossRefPubMed Pritchard-Jones K, Bergeron C, de Camargo B, et al. Omission of doxorubicin from the treatment of stage II-III, intermediate-risk Wilms' tumour (SIOP WT 2001): an open-label, non-inferiority, randomised controlled trial. Lancet. 2015;386(9999):1156–1164.CrossRefPubMed
19.
go back to reference Rosenfield K, Matsumura JS, Chaturvedi S, et al. Randomized Trial of Stent versus Surgery for Asymptomatic Carotid Stenosis. N Engl J Med. 2016;374(11):1011–1020.CrossRefPubMed Rosenfield K, Matsumura JS, Chaturvedi S, et al. Randomized Trial of Stent versus Surgery for Asymptomatic Carotid Stenosis. N Engl J Med. 2016;374(11):1011–1020.CrossRefPubMed
20.
go back to reference Crook JM, O'Callaghan CJ, Duncan G, et al. Intermittent androgen suppression for rising PSA level after radiotherapy. N Engl J Med. 2012;367(10):895–903.CrossRefPubMedPubMedCentral Crook JM, O'Callaghan CJ, Duncan G, et al. Intermittent androgen suppression for rising PSA level after radiotherapy. N Engl J Med. 2012;367(10):895–903.CrossRefPubMedPubMedCentral
21.
go back to reference Ardehali A, Esmailian F, Deng M, et al. Ex-vivo perfusion of donor hearts for human heart transplantation (PROCEED II): a prospective, open-label, multicentre, randomised non-inferiority trial. Lancet. 2015;385(9987):2577–2584.CrossRefPubMed Ardehali A, Esmailian F, Deng M, et al. Ex-vivo perfusion of donor hearts for human heart transplantation (PROCEED II): a prospective, open-label, multicentre, randomised non-inferiority trial. Lancet. 2015;385(9987):2577–2584.CrossRefPubMed
22.
go back to reference Stone GW, Sabik JF, Serruys PW, et al. Everolimus-Eluting Stents or Bypass Surgery for Left Main Coronary Artery Disease. N Engl J Med. 2016;375(23):2223–2235.CrossRefPubMed Stone GW, Sabik JF, Serruys PW, et al. Everolimus-Eluting Stents or Bypass Surgery for Left Main Coronary Artery Disease. N Engl J Med. 2016;375(23):2223–2235.CrossRefPubMed
23.
go back to reference Merle CS, Fielding K, Sow OB, et al. A four-month gatifloxacin-containing regimen for treating tuberculosis. N Engl J Med. 2014;371(17):1588–1598.CrossRefPubMed Merle CS, Fielding K, Sow OB, et al. A four-month gatifloxacin-containing regimen for treating tuberculosis. N Engl J Med. 2014;371(17):1588–1598.CrossRefPubMed
24.
go back to reference Christiansen EH, Jensen LO, Thayssen P, et al. Biolimus-eluting biodegradable polymer-coated stent versus durable polymer-coated sirolimus-eluting stent in unselected patients receiving percutaneous coronary intervention (SORT OUT V): a randomised non-inferiority trial. Lancet. 2013;381(9867):661–669.CrossRefPubMed Christiansen EH, Jensen LO, Thayssen P, et al. Biolimus-eluting biodegradable polymer-coated stent versus durable polymer-coated sirolimus-eluting stent in unselected patients receiving percutaneous coronary intervention (SORT OUT V): a randomised non-inferiority trial. Lancet. 2013;381(9867):661–669.CrossRefPubMed
25.
go back to reference Paton NI, Kityo C, Hoppe A, et al. Assessment of second-line antiretroviral regimens for HIV therapy in Africa. N Engl J Med. 2014;371(3):234–247.CrossRefPubMed Paton NI, Kityo C, Hoppe A, et al. Assessment of second-line antiretroviral regimens for HIV therapy in Africa. N Engl J Med. 2014;371(3):234–247.CrossRefPubMed
26.
go back to reference Kirchhof P, Andresen D, Bosch R, et al. Short-term versus long-term antiarrhythmic drug treatment after cardioversion of atrial fibrillation (Flec-SL): a prospective, randomised, open-label, blinded endpoint assessment trial. Lancet. 2012;380(9838):238–246.CrossRefPubMed Kirchhof P, Andresen D, Bosch R, et al. Short-term versus long-term antiarrhythmic drug treatment after cardioversion of atrial fibrillation (Flec-SL): a prospective, randomised, open-label, blinded endpoint assessment trial. Lancet. 2012;380(9838):238–246.CrossRefPubMed
27.
go back to reference Johnson P, Federico M, Kirkwood A, et al. Adapted Treatment Guided by Interim PET-CT Scan in Advanced Hodgkin's Lymphoma. N Engl J Med. 2016;374(25):2419–2429.CrossRefPubMedPubMedCentral Johnson P, Federico M, Kirkwood A, et al. Adapted Treatment Guided by Interim PET-CT Scan in Advanced Hodgkin's Lymphoma. N Engl J Med. 2016;374(25):2419–2429.CrossRefPubMedPubMedCentral
28.
go back to reference Radford J, Illidge T, Counsell N, et al. Results of a trial of PET-directed therapy for early-stage Hodgkin's lymphoma. N Engl J Med. 2015;372(17):1598–1607.CrossRefPubMed Radford J, Illidge T, Counsell N, et al. Results of a trial of PET-directed therapy for early-stage Hodgkin's lymphoma. N Engl J Med. 2015;372(17):1598–1607.CrossRefPubMed
29.
go back to reference Park SJ, Ahn JM, Kim YH, et al. Trial of everolimus-eluting stents or bypass surgery for coronary disease. N Engl J Med. 2015;372(13):1204–1212.CrossRefPubMed Park SJ, Ahn JM, Kim YH, et al. Trial of everolimus-eluting stents or bypass surgery for coronary disease. N Engl J Med. 2015;372(13):1204–1212.CrossRefPubMed
30.
go back to reference Anderson CS, Robinson T, Lindley RI, et al. Low-Dose versus Standard-Dose Intravenous Alteplase in Acute Ischemic Stroke. N Engl J Med. 2016;374(24):2313–2323.CrossRefPubMed Anderson CS, Robinson T, Lindley RI, et al. Low-Dose versus Standard-Dose Intravenous Alteplase in Acute Ischemic Stroke. N Engl J Med. 2016;374(24):2313–2323.CrossRefPubMed
31.
go back to reference Bousser MG, Amarenco P, Chamorro A, et al. Terutroban versus aspirin in patients with cerebral ischaemic events (PERFORM): a randomised, double-blind, parallel-group trial. Lancet. 2011;377(9782):2013–2022.CrossRefPubMed Bousser MG, Amarenco P, Chamorro A, et al. Terutroban versus aspirin in patients with cerebral ischaemic events (PERFORM): a randomised, double-blind, parallel-group trial. Lancet. 2011;377(9782):2013–2022.CrossRefPubMed
32.
go back to reference Paul M, Bishara J, Yahav D, et al. Trimethoprim-sulfamethoxazole versus vancomycin for severe infections caused by meticillin resistant Staphylococcus aureus: randomised controlled trial. BMJ. 2015;350:h2219.CrossRefPubMedPubMedCentral Paul M, Bishara J, Yahav D, et al. Trimethoprim-sulfamethoxazole versus vancomycin for severe infections caused by meticillin resistant Staphylococcus aureus: randomised controlled trial. BMJ. 2015;350:h2219.CrossRefPubMedPubMedCentral
33.
34.
go back to reference Behringer K, Goergen H, Hitz F, et al. Omission of dacarbazine or bleomycin, or both, from the ABVD regimen in treatment of early-stage favourable Hodgkin's lymphoma (GHSG HD13): an open-label, randomised, non-inferiority trial. Lancet. 2015;385(9976):1418–1427.CrossRefPubMed Behringer K, Goergen H, Hitz F, et al. Omission of dacarbazine or bleomycin, or both, from the ABVD regimen in treatment of early-stage favourable Hodgkin's lymphoma (GHSG HD13): an open-label, randomised, non-inferiority trial. Lancet. 2015;385(9976):1418–1427.CrossRefPubMed
35.
go back to reference Kaul U, Bangalore S, Seth A, et al. Paclitaxel-Eluting versus Everolimus-Eluting Coronary Stents in Diabetes. N Engl J Med. 2015;373(18):1709–1719.CrossRefPubMed Kaul U, Bangalore S, Seth A, et al. Paclitaxel-Eluting versus Everolimus-Eluting Coronary Stents in Diabetes. N Engl J Med. 2015;373(18):1709–1719.CrossRefPubMed
36.
go back to reference Bwakura-Dangarembizi M, Kendall L, Bakeera-Kitaka S, et al. A randomized trial of prolonged co-trimoxazole in HIV-infected children in Africa. N Engl J Med. 2014;370(1):41–53.CrossRefPubMedPubMedCentral Bwakura-Dangarembizi M, Kendall L, Bakeera-Kitaka S, et al. A randomized trial of prolonged co-trimoxazole in HIV-infected children in Africa. N Engl J Med. 2014;370(1):41–53.CrossRefPubMedPubMedCentral
37.
38.
go back to reference Mulvenna P, Nankivell M, Barton R, et al. Dexamethasone and supportive care with or without whole brain radiotherapy in treating patients with non-small cell lung cancer with brain metastases unsuitable for resection or stereotactic radiotherapy (QUARTZ): results from a phase 3, non-inferiority, randomised trial. Lancet. 2016;388(10055):2004–2014.CrossRefPubMedPubMedCentral Mulvenna P, Nankivell M, Barton R, et al. Dexamethasone and supportive care with or without whole brain radiotherapy in treating patients with non-small cell lung cancer with brain metastases unsuitable for resection or stereotactic radiotherapy (QUARTZ): results from a phase 3, non-inferiority, randomised trial. Lancet. 2016;388(10055):2004–2014.CrossRefPubMedPubMedCentral
40.
go back to reference Gladstone B, Vach W. Analyzing noninferiority trials: it is time for advantage deficit assessment – an observational study of published noninferiority trials. Open Access J Clin Trials. 2015;7:11–21.CrossRef Gladstone B, Vach W. Analyzing noninferiority trials: it is time for advantage deficit assessment – an observational study of published noninferiority trials. Open Access J Clin Trials. 2015;7:11–21.CrossRef
Metadata
Title
Use of Mortality as an Endpoint in Noninferiority Trials May Lead to Ethically Problematic Conclusions
Authors
Andrew M. Hersh, MD
Robert J. Walter, MD, DHCE
Scott K. Abberegg, MD, MPH
Publication date
01-04-2019
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 4/2019
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-018-4813-z

Other articles of this Issue 4/2019

Journal of General Internal Medicine 4/2019 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine