Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Empirical comparison of methods for analyzing multiple time-to-event outcomes in a non-inferiority trial: a breast cancer study

Authors: Sameer Parpia, Lehana Thabane, Jim A Julian, Timothy J Whelan, Mark N Levine

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Subjects with breast cancer enrolled in trials may experience multiple events such as local recurrence, distant recurrence or death. These events are not independent; the occurrence of one may increase the risk of another, or prevent another from occurring. The most commonly used Cox proportional hazards (Cox-PH) model ignores the relationships between events, resulting in a potential impact on the treatment effect and conclusions. The use of statistical methods to analyze multiple time-to-event events has mainly been focused on superiority trials. However, their application to non-inferiority trials is limited. We evaluate four statistical methods for multiple time-to-event endpoints in the context of a non-inferiority trial.

Methods

Three methods for analyzing multiple events data, namely, i) the competing risks (CR) model, ii) the marginal model, and iii) the frailty model were compared with the Cox-PH model using data from a previously-reported non-inferiority trial comparing hypofractionated radiotherapy with conventional radiotherapy for the prevention of local recurrence in patients with early stage breast cancer who had undergone breast conserving surgery. These methods were also compared using two simulated examples, scenario A where the hazards for distant recurrence and death were higher in the control group, and scenario B. where the hazards of distant recurrence and death were higher in the experimental group. Both scenarios were designed to have a non-inferiority margin of 1.50.

Results

In the breast cancer trial, the methods produced primary outcome results similar to those using the Cox-PH model: namely, a local recurrence hazard ratio (HR) of 0.95 and a 95% confidence interval (CI) of 0.62 to 1.46. In Scenario A, non-inferiority was observed with the Cox-PH model (HR = 1.04; CI of 0.80 to 1.35), but not with the CR model (HR = 1.37; CI of 1.06 to 1.79), and the average marginal and frailty model showed a positive effect of the experimental treatment. The results in Scenario A contrasted with Scenario B with non-inferiority being observed with the CR model (HR = 1.10; CI of 0.87 to 1.39), but not with the Cox-PH model (HR = 1.46; CI of 1.15 to 1.85), and the marginal and frailty model showed a negative effect of the experimental treatment.

Conclusion

When subjects are at risk for multiple events in non-inferiority trials, researchers need to consider using the CR, marginal and frailty models in addition to the Cox-PH model in order to provide additional information in describing the disease process and to assess the robustness of the results. In the presence of competing risks, the Cox-PH model is appropriate for investigating the biologic effect of treatment, whereas the CR models yields the actual effect of treatment in the study.
Appendix
Available only for authorised users
Literature
1.
go back to reference Andersen PK, Borgan O, Gill RD, Keiding N: Statistical models based on counting processes. 1993, New York: SpringerCrossRef Andersen PK, Borgan O, Gill RD, Keiding N: Statistical models based on counting processes. 1993, New York: SpringerCrossRef
2.
go back to reference Cox D: Regrssion models and life-tables. J Roy Stat Soc B Meth. 1972, 43: 187-220. Cox D: Regrssion models and life-tables. J Roy Stat Soc B Meth. 1972, 43: 187-220.
3.
go back to reference Gooley TA, Leisenring W, Crowley J, Storer BE: Estimation of failure probabilities in the presence of competing risks: new representations of old estimators. Stat Med. 1999, 18: 695-706. 10.1002/(SICI)1097-0258(19990330)18:6<695::AID-SIM60>3.0.CO;2-O.CrossRefPubMed Gooley TA, Leisenring W, Crowley J, Storer BE: Estimation of failure probabilities in the presence of competing risks: new representations of old estimators. Stat Med. 1999, 18: 695-706. 10.1002/(SICI)1097-0258(19990330)18:6<695::AID-SIM60>3.0.CO;2-O.CrossRefPubMed
4.
go back to reference Kim HT: Cumulative incidence in competing risks data and competing risks regression analysis. Clin Cancer Res. 2007, 13: 559-565. 10.1158/1078-0432.CCR-06-1210.CrossRefPubMed Kim HT: Cumulative incidence in competing risks data and competing risks regression analysis. Clin Cancer Res. 2007, 13: 559-565. 10.1158/1078-0432.CCR-06-1210.CrossRefPubMed
5.
go back to reference Williamson PR, Kolamunnage-Dona R, Tudur Smith C: The influence of competing-risks setting on the choice of hypothesis test for treatment effect. Biostatistics. 2007, 8: 689-694.CrossRefPubMed Williamson PR, Kolamunnage-Dona R, Tudur Smith C: The influence of competing-risks setting on the choice of hypothesis test for treatment effect. Biostatistics. 2007, 8: 689-694.CrossRefPubMed
6.
go back to reference Tai B-C, Grundy RG, Machin D: On the importance of accounting for competing risks in paediatric cancer trials designed to delay or avoid radiotherapy: I. Basic concepts and first analyses. Int J Radiat Oncol Biol Phys. 2010, 76: 1493-1499. 10.1016/j.ijrobp.2009.03.035.CrossRefPubMed Tai B-C, Grundy RG, Machin D: On the importance of accounting for competing risks in paediatric cancer trials designed to delay or avoid radiotherapy: I. Basic concepts and first analyses. Int J Radiat Oncol Biol Phys. 2010, 76: 1493-1499. 10.1016/j.ijrobp.2009.03.035.CrossRefPubMed
7.
go back to reference Fine J, Gray R: A proportional hazards model for the sub-distribution of a competing risk. J Am Stat Assoc. 1999, 94: 496-509. 10.1080/01621459.1999.10474144.CrossRef Fine J, Gray R: A proportional hazards model for the sub-distribution of a competing risk. J Am Stat Assoc. 1999, 94: 496-509. 10.1080/01621459.1999.10474144.CrossRef
8.
go back to reference Wei LJ, Glidden DV: An overview of statistical methods for multiple failure time data in clinical trials. Stat Med. 1997, 16: 833-839. 10.1002/(SICI)1097-0258(19970430)16:8<833::AID-SIM538>3.0.CO;2-2.CrossRefPubMed Wei LJ, Glidden DV: An overview of statistical methods for multiple failure time data in clinical trials. Stat Med. 1997, 16: 833-839. 10.1002/(SICI)1097-0258(19970430)16:8<833::AID-SIM538>3.0.CO;2-2.CrossRefPubMed
9.
go back to reference Hougaard P: Analysis of Multivariate Survival Data. 2000, New York, NY: SpringerCrossRef Hougaard P: Analysis of Multivariate Survival Data. 2000, New York, NY: SpringerCrossRef
10.
go back to reference Bakoyannis G, Touloumi G: Practical methods for competing risks data: A review. Stat Methods Med Res. 2011, 3: 257-272. Bakoyannis G, Touloumi G: Practical methods for competing risks data: A review. Stat Methods Med Res. 2011, 3: 257-272.
11.
go back to reference Whelan T, MacKenzie R, Julian J, Levine M, Shelley W, Grimard L, Lada B, Lukka H, Perera F, Fyles A, Laukkanen E, Gulavita S, Benk V, Szechtman B: Randomized trial of breast irradiation schedules after lumpectomy for women with lymph node-negative breast cancer. J Natl Cancer Inst. 2002, 94: 1143-1150. 10.1093/jnci/94.15.1143.CrossRefPubMed Whelan T, MacKenzie R, Julian J, Levine M, Shelley W, Grimard L, Lada B, Lukka H, Perera F, Fyles A, Laukkanen E, Gulavita S, Benk V, Szechtman B: Randomized trial of breast irradiation schedules after lumpectomy for women with lymph node-negative breast cancer. J Natl Cancer Inst. 2002, 94: 1143-1150. 10.1093/jnci/94.15.1143.CrossRefPubMed
12.
go back to reference Whelan TJ, Pignol J-P, Levine MN, Julian JA, MacKenzie R, Parpia S, Shelley W, Grimard L, Bowen J, Lukka H, Perera F, Fyles A, Schneider K, Gulavita S, Freeman C: Long-term results of hypofractionated radiation therapy for breast cancer. N Engl J Med. 2010, 362: 513-520. 10.1056/NEJMoa0906260.CrossRefPubMed Whelan TJ, Pignol J-P, Levine MN, Julian JA, MacKenzie R, Parpia S, Shelley W, Grimard L, Bowen J, Lukka H, Perera F, Fyles A, Schneider K, Gulavita S, Freeman C: Long-term results of hypofractionated radiation therapy for breast cancer. N Engl J Med. 2010, 362: 513-520. 10.1056/NEJMoa0906260.CrossRefPubMed
13.
go back to reference Parmar M, Machin D: Survival Analysis: A Practical Approach. 1995, Chichester, UK: John Wiley and Sons Parmar M, Machin D: Survival Analysis: A Practical Approach. 1995, Chichester, UK: John Wiley and Sons
14.
go back to reference Kalbfleisch J, Prentice R: The Statistical Analysis of Failure Time Data. 1980, New York, USA: John Wiley and Sons Kalbfleisch J, Prentice R: The Statistical Analysis of Failure Time Data. 1980, New York, USA: John Wiley and Sons
15.
go back to reference Parpia S, Julian JA, Thabane L, Lee AYY, Rickles FR, Levine MN: Competing events in patients with malignant disease who are at risk for recurrent venous thromboembolism. Contemp Clin Trials. 2011, 32: 829-833. 10.1016/j.cct.2011.07.005.CrossRefPubMed Parpia S, Julian JA, Thabane L, Lee AYY, Rickles FR, Levine MN: Competing events in patients with malignant disease who are at risk for recurrent venous thromboembolism. Contemp Clin Trials. 2011, 32: 829-833. 10.1016/j.cct.2011.07.005.CrossRefPubMed
16.
go back to reference Ghosh D: Methods for analysis of multiple events in the presence of death. Control Clin Trials. 2000, 21: 115-126. 10.1016/S0197-2456(00)00043-X.CrossRefPubMed Ghosh D: Methods for analysis of multiple events in the presence of death. Control Clin Trials. 2000, 21: 115-126. 10.1016/S0197-2456(00)00043-X.CrossRefPubMed
17.
go back to reference Lim HJ, Liu J, Melzer-Lange M: Comparison of methods for analyzing recurrent events data: application to the Emergency Department Visits of Pediatric Firearm Victims. Accid Anal Prev. 2007, 39: 290-299. 10.1016/j.aap.2006.07.009.CrossRefPubMed Lim HJ, Liu J, Melzer-Lange M: Comparison of methods for analyzing recurrent events data: application to the Emergency Department Visits of Pediatric Firearm Victims. Accid Anal Prev. 2007, 39: 290-299. 10.1016/j.aap.2006.07.009.CrossRefPubMed
18.
go back to reference Metcalfe C, Thompson SG: Wei, Lin and Weissfeld’s marginal analysis of multivariate failure time data: should it be applied to a recurrent events outcome?. Stat Methods Med Res. 2007, 16: 103-122. 10.1177/0962280206071926.CrossRefPubMed Metcalfe C, Thompson SG: Wei, Lin and Weissfeld’s marginal analysis of multivariate failure time data: should it be applied to a recurrent events outcome?. Stat Methods Med Res. 2007, 16: 103-122. 10.1177/0962280206071926.CrossRefPubMed
19.
go back to reference Li QH, Lagakos SW: Use of the Wei-Lin-Weissfeld method for the analysis of a recurring and a terminating event. Stat Med. 1997, 16: 925-940. 10.1002/(SICI)1097-0258(19970430)16:8<925::AID-SIM545>3.0.CO;2-2.CrossRefPubMed Li QH, Lagakos SW: Use of the Wei-Lin-Weissfeld method for the analysis of a recurring and a terminating event. Stat Med. 1997, 16: 925-940. 10.1002/(SICI)1097-0258(19970430)16:8<925::AID-SIM545>3.0.CO;2-2.CrossRefPubMed
20.
go back to reference Wienke A: Frailty Models in Survival Analysis. 2010, Boca Raton, FL: Chapman & Hall/CRCCrossRef Wienke A: Frailty Models in Survival Analysis. 2010, Boca Raton, FL: Chapman & Hall/CRCCrossRef
21.
go back to reference Therneau T, Grambsch P: Modeling Survival Data. 2000, New York, NY: SpringerCrossRef Therneau T, Grambsch P: Modeling Survival Data. 2000, New York, NY: SpringerCrossRef
22.
go back to reference Duchateau L, Janssen P: Evolution of recurrent asthma event rate over time in frailty models. J Roy Stat Soc C Appl Stat. 2003, 52: 355-363. 10.1111/1467-9876.00409.CrossRef Duchateau L, Janssen P: Evolution of recurrent asthma event rate over time in frailty models. J Roy Stat Soc C Appl Stat. 2003, 52: 355-363. 10.1111/1467-9876.00409.CrossRef
23.
go back to reference Duchateau L, Janssen P: The Frailty Model. 2010, New York, NY: Springer Duchateau L, Janssen P: The Frailty Model. 2010, New York, NY: Springer
24.
go back to reference Freidlin B, Korn EL: Testing treatment effects in the presence of competing risks. Stat Med. 2005, 24: 1703-1712. 10.1002/sim.2054.CrossRefPubMed Freidlin B, Korn EL: Testing treatment effects in the presence of competing risks. Stat Med. 2005, 24: 1703-1712. 10.1002/sim.2054.CrossRefPubMed
25.
go back to reference Clayton D: A model for association in bivariate life tables and its application in epidemiological of familial studies tendency in chronic disease incidence. Biometrika. 1978, 65: 141-151. 10.1093/biomet/65.1.141.CrossRef Clayton D: A model for association in bivariate life tables and its application in epidemiological of familial studies tendency in chronic disease incidence. Biometrika. 1978, 65: 141-151. 10.1093/biomet/65.1.141.CrossRef
26.
go back to reference Hougaard P: A Class of Multivariate Failure Time Distributions. Biometrika. 1986, 73: 671-678. Hougaard P: A Class of Multivariate Failure Time Distributions. Biometrika. 1986, 73: 671-678.
27.
go back to reference B-Choo T, Stavola BLD, Gruttola VD, Gebski V, Machin D: First-event or marginal estimation of cause-specific hazards for analysing correlated multivariate failure-time data ?. Stat Med. 2008, 27: 922-936. 10.1002/sim.2944.CrossRef B-Choo T, Stavola BLD, Gruttola VD, Gebski V, Machin D: First-event or marginal estimation of cause-specific hazards for analysing correlated multivariate failure-time data ?. Stat Med. 2008, 27: 922-936. 10.1002/sim.2944.CrossRef
28.
go back to reference Pintilie M: Competing Risks: A Practical Perspective. 2006, Chichester, UK: John Wiley and SonsCrossRef Pintilie M: Competing Risks: A Practical Perspective. 2006, Chichester, UK: John Wiley and SonsCrossRef
29.
30.
go back to reference Tai B-C, Wee J, Machin D: Analysis and design of randomised clinical trials involving competing risks endpoints. Trials. 2011, 12: 127-10.1186/1745-6215-12-127.CrossRefPubMedPubMedCentral Tai B-C, Wee J, Machin D: Analysis and design of randomised clinical trials involving competing risks endpoints. Trials. 2011, 12: 127-10.1186/1745-6215-12-127.CrossRefPubMedPubMedCentral
31.
go back to reference Allignol A, Schumacher M, Wanner C, Drechsler C, Beyersmann J: Understanding competing risks: a simulation point of view. BMC Med Res Methodol. 2011, 11: 86-10.1186/1471-2288-11-86.CrossRefPubMedPubMedCentral Allignol A, Schumacher M, Wanner C, Drechsler C, Beyersmann J: Understanding competing risks: a simulation point of view. BMC Med Res Methodol. 2011, 11: 86-10.1186/1471-2288-11-86.CrossRefPubMedPubMedCentral
32.
go back to reference Liu L, Huang X: The use of Gaussian quadrature for estimation in frailty proportional hazards models. Stat Med. 2008, 27: 2665-2683. 10.1002/sim.3077.CrossRefPubMed Liu L, Huang X: The use of Gaussian quadrature for estimation in frailty proportional hazards models. Stat Med. 2008, 27: 2665-2683. 10.1002/sim.3077.CrossRefPubMed
33.
go back to reference Dixon SN, Darlington GA, Desmond AF: A competing risks model for correlated data based on the subdistribution hazard. Lifetime Data Anal. 2011, 17: 473-495. 10.1007/s10985-011-9198-9.CrossRefPubMed Dixon SN, Darlington GA, Desmond AF: A competing risks model for correlated data based on the subdistribution hazard. Lifetime Data Anal. 2011, 17: 473-495. 10.1007/s10985-011-9198-9.CrossRefPubMed
Metadata
Title
Empirical comparison of methods for analyzing multiple time-to-event outcomes in a non-inferiority trial: a breast cancer study
Authors
Sameer Parpia
Lehana Thabane
Jim A Julian
Timothy J Whelan
Mark N Levine
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-44

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue