Skip to main content
Top
Published in: Clinical Research in Cardiology 5/2018

01-05-2018 | Original Paper

Time-to-first-event versus recurrent-event analysis: points to consider for selecting a meaningful analysis strategy in clinical trials with composite endpoints

Authors: Geraldine Rauch, Meinhard Kieser, Harald Binder, Antoni Bayes-Genis, Antje Jahn-Eimermacher

Published in: Clinical Research in Cardiology | Issue 5/2018

Login to get access

Abstract

Background

Composite endpoints combining several event types of clinical interest often define the primary efficacy outcome in cardiologic trials. They are commonly evaluated as time-to-first-event, thereby following the recommendations of regulatory agencies. However, to assess the patient’s full disease burden and to identify preventive factors or interventions, subsequent events following the first one should be considered as well. This is especially important in cohort studies and RCTs with a long follow-up leading to a higher number of observed events per patients. So far, there exist no recommendations which approach should be preferred.

Design

Recently, the Cardiovascular Round Table of the European Society of Cardiology indicated the need to investigate “how to interpret results if recurrent-event analysis results differ […] from time-to-first-event analysis” (Anker et al., Eur J Heart Fail 18:482–489, 2016). This work addresses this topic by means of a systematic simulation study.

Methods

This paper compares two common analysis strategies for composite endpoints differing with respect to the incorporation of recurrent events for typical data scenarios motivated by a clinical trial.

Results

We show that the treatment effects estimated from a time-to-first-event analysis (Cox model) and a recurrent-event analysis (Andersen–Gill model) can systematically differ, particularly in cardiovascular trials. Moreover, we provide guidance on how to interpret these results and recommend points to consider for the choice of a meaningful analysis strategy.

Conclusions

When planning trials with a composite endpoint, researchers, and regulatory agencies should be aware that the model choice affects the estimated treatment effect and its interpretation.
Literature
1.
go back to reference Anker SD, Schroeder S, Atar D et al (2016) Traditional and new composite endpoints in heart failure clinical trials: facilitating comprehensive efficacy assessments and improving trial efficiency. Eur J Heart Fail 18:482–489CrossRefPubMed Anker SD, Schroeder S, Atar D et al (2016) Traditional and new composite endpoints in heart failure clinical trials: facilitating comprehensive efficacy assessments and improving trial efficiency. Eur J Heart Fail 18:482–489CrossRefPubMed
2.
go back to reference Kip KE, Hollabaugh K, Marroquin OC, Williams DO (2008) The problem with composite end points in cardiovascular studies: the story of major adverse cardiac events and percutaneous coronary intervention. J Am Coll Cardiol 51:701–707CrossRefPubMed Kip KE, Hollabaugh K, Marroquin OC, Williams DO (2008) The problem with composite end points in cardiovascular studies: the story of major adverse cardiac events and percutaneous coronary intervention. J Am Coll Cardiol 51:701–707CrossRefPubMed
3.
go back to reference Metcalfe C, Thompson SG, Cowie MR, Sharples LD (2003) The use of hospital admission data as a measure of outcome in clinical studies of heart failure. Eur Heart J 24:105–112CrossRefPubMed Metcalfe C, Thompson SG, Cowie MR, Sharples LD (2003) The use of hospital admission data as a measure of outcome in clinical studies of heart failure. Eur Heart J 24:105–112CrossRefPubMed
4.
go back to reference Hartman MHT, Prins JKB, Schurer RAJ, Lipsic E, Lexis CPH, van der Horst-Schrivers ANA, van Veldhuisen DJ, van der Horst ICC, van der Harst P (2017) Two-year follow-up of 4 months metformin treatment vs. placebo in ST-elevation myocardial infarction: data from the GIPS-III RCT. Clin Res Cardiol 106:939–946CrossRefPubMedPubMedCentral Hartman MHT, Prins JKB, Schurer RAJ, Lipsic E, Lexis CPH, van der Horst-Schrivers ANA, van Veldhuisen DJ, van der Horst ICC, van der Harst P (2017) Two-year follow-up of 4 months metformin treatment vs. placebo in ST-elevation myocardial infarction: data from the GIPS-III RCT. Clin Res Cardiol 106:939–946CrossRefPubMedPubMedCentral
5.
go back to reference Coiro S, Girerd N, Rossignol P, Bauersachs J, Pitt B, Fay R, Ambrosio G, Solomon SD, Dickstein K, Zannad F (2017) Association of digitalis treatment with outcomes following myocardial infarction in patients with heart failure or evidence of left ventricular dysfunction: an analysis from the high-risk myocardial infarction database initiative. Clin Res Cardiol 106:722–733CrossRefPubMed Coiro S, Girerd N, Rossignol P, Bauersachs J, Pitt B, Fay R, Ambrosio G, Solomon SD, Dickstein K, Zannad F (2017) Association of digitalis treatment with outcomes following myocardial infarction in patients with heart failure or evidence of left ventricular dysfunction: an analysis from the high-risk myocardial infarction database initiative. Clin Res Cardiol 106:722–733CrossRefPubMed
6.
go back to reference Cotter G, Davison BA, Butler J, Collins SP, Ezekowitz JA, Felker GM, Filippatos G, Levy PD, Metra M, Ponikowski P, Teerlink JR, Voors AA, Senger S, Bharucha D, Goin K, Soergel DG, Pang PS (2017) Relationship between baseline systolic blood pressure and long-term outcomes in acute heart failure patients treated with TRV027: an exploratory subgroup analysis of BLAST-AHF. Clin Res Cardiol. https://doi.org/10.1007/s00392-017-1168-0 (Epub ahead of print; pMID 28986703) PubMedCentral Cotter G, Davison BA, Butler J, Collins SP, Ezekowitz JA, Felker GM, Filippatos G, Levy PD, Metra M, Ponikowski P, Teerlink JR, Voors AA, Senger S, Bharucha D, Goin K, Soergel DG, Pang PS (2017) Relationship between baseline systolic blood pressure and long-term outcomes in acute heart failure patients treated with TRV027: an exploratory subgroup analysis of BLAST-AHF. Clin Res Cardiol. https://​doi.​org/​10.​1007/​s00392-017-1168-0 (Epub ahead of print; pMID 28986703) PubMedCentral
7.
go back to reference Chi GYH (2005) Some issues with composite endpoints in clinical trials. Fund Clin Pharmacol 19:609–619CrossRef Chi GYH (2005) Some issues with composite endpoints in clinical trials. Fund Clin Pharmacol 19:609–619CrossRef
8.
go back to reference Schüler S, Mucha A, Doherty P, Kieser M, Rauch G (2014) Easily applicable multiple testing procedures to improve the interpretation of clinical trials with composite endpoints. Int J Cardiol 15:126 – 32CrossRef Schüler S, Mucha A, Doherty P, Kieser M, Rauch G (2014) Easily applicable multiple testing procedures to improve the interpretation of clinical trials with composite endpoints. Int J Cardiol 15:126 – 32CrossRef
9.
go back to reference Ferreira-Gonzàles I, Permanyer-Miralda G, Domingo-Salvany A et al (2007) Problems with the use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ 334:786–793CrossRef Ferreira-Gonzàles I, Permanyer-Miralda G, Domingo-Salvany A et al (2007) Problems with the use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ 334:786–793CrossRef
10.
go back to reference Anker SD, McMurray JJ (2012) Time to move on from ‘time-to-first’: should all events be included in the analysis of clinical trials? Eur Heart J 33:2764–2765CrossRefPubMed Anker SD, McMurray JJ (2012) Time to move on from ‘time-to-first’: should all events be included in the analysis of clinical trials? Eur Heart J 33:2764–2765CrossRefPubMed
11.
go back to reference Andersen PK, Gill RD (1982) Cox’s regression model for counting processes: a large sample study. Ann Stat 1:1100–1120CrossRef Andersen PK, Gill RD (1982) Cox’s regression model for counting processes: a large sample study. Ann Stat 1:1100–1120CrossRef
12.
go back to reference Rogers JK, Pocock SJ, McMurray JJ (2014) Analysing recurrent hospitalizations in heart failure: a review of statistical methodology, with application to CHARM-preserved. Eur J Heart Fail 16:33–40CrossRefPubMed Rogers JK, Pocock SJ, McMurray JJ (2014) Analysing recurrent hospitalizations in heart failure: a review of statistical methodology, with application to CHARM-preserved. Eur J Heart Fail 16:33–40CrossRefPubMed
13.
go back to reference Rogers JK, Jhund PS, Perez AC (2014) Effect of rosuvastatin on repeat heart failure hospitalizations: the CORONA trial (controlled rosuvastatin multinational trial in heart failure). J Am Coll Cardiol HF 2:289–297 Rogers JK, Jhund PS, Perez AC (2014) Effect of rosuvastatin on repeat heart failure hospitalizations: the CORONA trial (controlled rosuvastatin multinational trial in heart failure). J Am Coll Cardiol HF 2:289–297
14.
go back to reference Abraham WT. Adamson PB, Bourge RC et al (2011) Wireless pulmonary artery haemodynamic monitoring in chronic heart failure: a randomised controlled trial. Lancet 377:658–666CrossRefPubMed Abraham WT. Adamson PB, Bourge RC et al (2011) Wireless pulmonary artery haemodynamic monitoring in chronic heart failure: a randomised controlled trial. Lancet 377:658–666CrossRefPubMed
15.
go back to reference Rogers JK, McMurray JJ, Pocock SJ et al (2012) Eplerenone in patients with systolic heart failure and mild symptoms analysis of repeat hospitalizations. Circulation 126:2317–2323CrossRefPubMed Rogers JK, McMurray JJ, Pocock SJ et al (2012) Eplerenone in patients with systolic heart failure and mild symptoms analysis of repeat hospitalizations. Circulation 126:2317–2323CrossRefPubMed
16.
go back to reference Beyersmann J, Schumacher M, Allignol A (2012) Multistate modeling of competing risks. In: Gentleman R, Hornik K, Parmigiani G (eds) Competing risks and the multistate models with R. Springer, New York, pp 41–54CrossRef Beyersmann J, Schumacher M, Allignol A (2012) Multistate modeling of competing risks. In: Gentleman R, Hornik K, Parmigiani G (eds) Competing risks and the multistate models with R. Springer, New York, pp 41–54CrossRef
17.
go back to reference Rauch G, Beyersmann J (2013) Planning and evaluating clinical trials with composite time-to-first event endpoints in a competing risk framework. Stat Med 32:3595 – 608CrossRefPubMed Rauch G, Beyersmann J (2013) Planning and evaluating clinical trials with composite time-to-first event endpoints in a competing risk framework. Stat Med 32:3595 – 608CrossRefPubMed
18.
go back to reference Rauch G, Rauch B, Schüler S, Kieser M (2015) Opportunities and challenges of clinical trials in cardiology using composite primary endpoints. World J Cardiol 7:1–5CrossRefPubMedPubMedCentral Rauch G, Rauch B, Schüler S, Kieser M (2015) Opportunities and challenges of clinical trials in cardiology using composite primary endpoints. World J Cardiol 7:1–5CrossRefPubMedPubMedCentral
19.
go back to reference Chan PS (2006) Keeping apples and oranges separate: reassessing clinical trials that use composite end points as their primary outcome (letter). J Am Coll Cardiol 48:850CrossRefPubMed Chan PS (2006) Keeping apples and oranges separate: reassessing clinical trials that use composite end points as their primary outcome (letter). J Am Coll Cardiol 48:850CrossRefPubMed
20.
go back to reference Jahn-Eimermacher A (2008) Comparison of the Andersen–Gill model with poisson and negative binomial regression on recurrent event data. Comput Stat Data 52:4989–4997CrossRef Jahn-Eimermacher A (2008) Comparison of the Andersen–Gill model with poisson and negative binomial regression on recurrent event data. Comput Stat Data 52:4989–4997CrossRef
21.
go back to reference Ip EH, Efendi A, Molenberghs G, Bertoni AG (2015) Comparison of risks of cardiovascular events in the elderly using standard survival analysis and multiple-events and recurrent-events methods. BMC Med Res Methodol 15:15CrossRefPubMedPubMedCentral Ip EH, Efendi A, Molenberghs G, Bertoni AG (2015) Comparison of risks of cardiovascular events in the elderly using standard survival analysis and multiple-events and recurrent-events methods. BMC Med Res Methodol 15:15CrossRefPubMedPubMedCentral
22.
go back to reference Ieva F, Jackson CH, Sharples LD (2015) Multi-state modelling of repeated hospitalization and death in patients with heart failure: the use of large administrative databases in clinical epidemiology. Stat Methods Med Res 26(3):1350–1372CrossRefPubMedPubMedCentral Ieva F, Jackson CH, Sharples LD (2015) Multi-state modelling of repeated hospitalization and death in patients with heart failure: the use of large administrative databases in clinical epidemiology. Stat Methods Med Res 26(3):1350–1372CrossRefPubMedPubMedCentral
23.
go back to reference Castañeda J, Gerritse B (2010) Appraisal of several methods to model time to multiple events per subject: modelling time to hospitalizations and death. Rev Colomb Estad 33:43–61 Castañeda J, Gerritse B (2010) Appraisal of several methods to model time to multiple events per subject: modelling time to hospitalizations and death. Rev Colomb Estad 33:43–61
24.
go back to reference Bakal JA, McAlister FA, Liu W, Ezekowitz JA (2014) Heart failure re-admission: measuring the ever shortening gap between repeat heart failure hospitalizations. Plos One 9:e106494CrossRefPubMedPubMedCentral Bakal JA, McAlister FA, Liu W, Ezekowitz JA (2014) Heart failure re-admission: measuring the ever shortening gap between repeat heart failure hospitalizations. Plos One 9:e106494CrossRefPubMedPubMedCentral
25.
go back to reference Cheung YB, Xu Y, Tan SH, Cutts F, Milligan P (2010) Estimation of intervention effects using first or multiple episodes in clinical trials: the Andersen–Gill model re-examined. Stat Med 29:328–336CrossRefPubMed Cheung YB, Xu Y, Tan SH, Cutts F, Milligan P (2010) Estimation of intervention effects using first or multiple episodes in clinical trials: the Andersen–Gill model re-examined. Stat Med 29:328–336CrossRefPubMed
26.
go back to reference Jahn-Eimermacher A, Ingel K, Preussler S, Bayes-Genis A, Binder H (2017) A DAG-based comparison of interventional effect underestimation between composite endpoint and multi-state analysis in cardiovascular trials. BMC Med Res Methodol 17(1):92CrossRefPubMedPubMedCentral Jahn-Eimermacher A, Ingel K, Preussler S, Bayes-Genis A, Binder H (2017) A DAG-based comparison of interventional effect underestimation between composite endpoint and multi-state analysis in cardiovascular trials. BMC Med Res Methodol 17(1):92CrossRefPubMedPubMedCentral
27.
go back to reference Rauch G, Kieser M, Ulrich S, Doherty P, Rauch B, Schneider S, Riemer T et al (2014) Competing time-to-event endpoints in cardiology trials—a simulation study to illustrate the importance of an adequate statistical analysis. Eur J Prev Cardiol 21:74–80CrossRefPubMed Rauch G, Kieser M, Ulrich S, Doherty P, Rauch B, Schneider S, Riemer T et al (2014) Competing time-to-event endpoints in cardiology trials—a simulation study to illustrate the importance of an adequate statistical analysis. Eur J Prev Cardiol 21:74–80CrossRefPubMed
28.
go back to reference Prentice RL, Williams BJ, Peterson AV (1981) On the regression analysis of multivariate failure time data. Biometrika 68:373–379CrossRef Prentice RL, Williams BJ, Peterson AV (1981) On the regression analysis of multivariate failure time data. Biometrika 68:373–379CrossRef
29.
go back to reference Jahn-Eimermacher A, Ingel K, Ozga AK, Preussler S, Binder H (2015) Simulating recurrent event data with hazard functions defined on a total time scale. BMC Med Res Methodol 15:16CrossRefPubMedPubMedCentral Jahn-Eimermacher A, Ingel K, Ozga AK, Preussler S, Binder H (2015) Simulating recurrent event data with hazard functions defined on a total time scale. BMC Med Res Methodol 15:16CrossRefPubMedPubMedCentral
31.
go back to reference Ingel K, Jahn-Eimermacher A (2014) Sample-size calculation and reestimation for a semiparametric analysis of recurrent event data taking robust standard errors into account. Biom J 56:631–648CrossRefPubMed Ingel K, Jahn-Eimermacher A (2014) Sample-size calculation and reestimation for a semiparametric analysis of recurrent event data taking robust standard errors into account. Biom J 56:631–648CrossRefPubMed
Metadata
Title
Time-to-first-event versus recurrent-event analysis: points to consider for selecting a meaningful analysis strategy in clinical trials with composite endpoints
Authors
Geraldine Rauch
Meinhard Kieser
Harald Binder
Antoni Bayes-Genis
Antje Jahn-Eimermacher
Publication date
01-05-2018
Publisher
Springer Berlin Heidelberg
Published in
Clinical Research in Cardiology / Issue 5/2018
Print ISSN: 1861-0684
Electronic ISSN: 1861-0692
DOI
https://doi.org/10.1007/s00392-018-1205-7

Other articles of this Issue 5/2018

Clinical Research in Cardiology 5/2018 Go to the issue

Letter to the Editors

Cor triatriatum sinister