Skip to main content
Top
Published in: Trials 1/2013

Open Access 01-12-2013 | Methodology

Impact of lack-of-benefit stopping rules on treatment effect estimates of two-arm multi-stage (TAMS) trials with time to event outcome

Authors: Babak Choodari-Oskooei, Mahesh KB Parmar, Patrick Royston, Jack Bowden

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Background

In 2011, Royston et al. described technical details of a two-arm, multi-stage (TAMS) design. The design enables a trial to be stopped part-way through recruitment if the accumulating data suggests a lack of benefit of the experimental arm. Such interim decisions can be made using data on an available ‘intermediate’ outcome. At the conclusion of the trial, the definitive outcome is analyzed. Typical intermediate and definitive outcomes in cancer might be progression-free and overall survival, respectively. In TAMS designs, the stopping rule applied at the interim stage(s) affects the sampling distribution of the treatment effect estimator, potentially inducing bias that needs addressing.

Methods

We quantified the bias in the treatment effect estimator in TAMS trials according to the size of the treatment effect and for different designs. We also retrospectively ‘redesigned’ completed cancer trials as TAMS trials and used the bootstrap to quantify bias.

Results

In trials in which the experimental treatment is better than the control and which continue to their planned end, the bias in the estimate of treatment effect is small and of no practical importance. In trials stopped for lack of benefit at an interim stage, the treatment effect estimate is biased at the time of interim assessment. This bias is markedly reduced by further patient follow-up and reanalysis at the planned ‘end’ of the trial.

Conclusions

Provided that all patients in a TAMS trial are followed up to the planned end of the trial, the bias in the estimated treatment effect is of no practical importance. Bias correction is then unnecessary.
Appendix
Available only for authorised users
Literature
1.
go back to reference Royston P, Barthel FMS, Parmar MKB, Choodari-Oskooei B, Isham V: Designs for clinical trials with time-to-event outcomes based on stopping guidelines for lack of efficacy. Trials. 2011, 12: 81-10.1186/1745-6215-12-81.CrossRefPubMedPubMedCentral Royston P, Barthel FMS, Parmar MKB, Choodari-Oskooei B, Isham V: Designs for clinical trials with time-to-event outcomes based on stopping guidelines for lack of efficacy. Trials. 2011, 12: 81-10.1186/1745-6215-12-81.CrossRefPubMedPubMedCentral
2.
go back to reference Piantadosi S: Clinical Trials: A Methodologic Perspective. 2005, New York: John WileyCrossRef Piantadosi S: Clinical Trials: A Methodologic Perspective. 2005, New York: John WileyCrossRef
3.
go back to reference James ND, Sydes MR, Clarke NW, Mason MD, Dearnaley DP, Anderson J, Popert RJ, Sanders K, Morgan RC, Stansfeld J, Dwyer J, Masters J, Parmar MKB: Stampede: systemic therapy for advancing or metastatic prostate cancer.a multi-arm multi-stage randomised controlled trial. Clin Oncol. 2008, 20: 577-581. 10.1016/j.clon.2008.07.002.CrossRef James ND, Sydes MR, Clarke NW, Mason MD, Dearnaley DP, Anderson J, Popert RJ, Sanders K, Morgan RC, Stansfeld J, Dwyer J, Masters J, Parmar MKB: Stampede: systemic therapy for advancing or metastatic prostate cancer.a multi-arm multi-stage randomised controlled trial. Clin Oncol. 2008, 20: 577-581. 10.1016/j.clon.2008.07.002.CrossRef
4.
go back to reference Emerson SS: Issues in the use of adaptive clinical trial designs. Stat Med. 2006, 25: 3270-3296. 10.1002/sim.2626.CrossRefPubMed Emerson SS: Issues in the use of adaptive clinical trial designs. Stat Med. 2006, 25: 3270-3296. 10.1002/sim.2626.CrossRefPubMed
5.
go back to reference Royston P, Parmar MKB, Qian W: Novel designs for multi-arm clinical trials with survival outcomes, with an application in ovarian cancer. Stat Med. 2003, 22 (14): 2239-2256. 10.1002/sim.1430.CrossRefPubMed Royston P, Parmar MKB, Qian W: Novel designs for multi-arm clinical trials with survival outcomes, with an application in ovarian cancer. Stat Med. 2003, 22 (14): 2239-2256. 10.1002/sim.1430.CrossRefPubMed
6.
go back to reference Barthel FMS, Royston P, Parmar MKB: A menu-driven facility for sample size calculation in novel multi-arm, multi-stage randomised controlled trials with a time-to-event outcome. Stata J. 2009, 9 (4): 505-523. Barthel FMS, Royston P, Parmar MKB: A menu-driven facility for sample size calculation in novel multi-arm, multi-stage randomised controlled trials with a time-to-event outcome. Stata J. 2009, 9 (4): 505-523.
7.
go back to reference Therneau TM, Grambsch PM: Modeling Survival Data: Extending the Cox Model. 2000, New York: SpringerCrossRef Therneau TM, Grambsch PM: Modeling Survival Data: Extending the Cox Model. 2000, New York: SpringerCrossRef
8.
go back to reference Zhang JJ, Blumenthal GM, He K, Tang S, Cortazar P, Sridhara R: Overestimation of the effect size in group sequential trials. Clin Cancer Res. 2012, 10.1158/1078-0432.CCR-11-3118. Zhang JJ, Blumenthal GM, He K, Tang S, Cortazar P, Sridhara R: Overestimation of the effect size in group sequential trials. Clin Cancer Res. 2012, 10.1158/1078-0432.CCR-11-3118.
9.
go back to reference Bookman MA, Brady MF, McGuire WP, Harper PG, Alberts DS, Friedlander M, Colombo N, Fowler JM, Argenta PA, De Geest K, Mutch DG, Burger RA, Swart AM, Trimble EL, Accario-Winslow C, Roth LM: Evaluation of new platinum-based treatment regimens in advanced-stage ovarian cancer: a phase III trial of the gynecologic cancer intergroup. J Clin Oncol. 2009, 27: 1419-1425. 10.1200/JCO.2008.19.1684.CrossRefPubMedPubMedCentral Bookman MA, Brady MF, McGuire WP, Harper PG, Alberts DS, Friedlander M, Colombo N, Fowler JM, Argenta PA, De Geest K, Mutch DG, Burger RA, Swart AM, Trimble EL, Accario-Winslow C, Roth LM: Evaluation of new platinum-based treatment regimens in advanced-stage ovarian cancer: a phase III trial of the gynecologic cancer intergroup. J Clin Oncol. 2009, 27: 1419-1425. 10.1200/JCO.2008.19.1684.CrossRefPubMedPubMedCentral
10.
go back to reference MRC Renal Cancer Collaborators: Interferon-alpha and survival in metastatic renal carcinoma: early results of a randomised trial. Lancet. 1999, 353: 14-17.CrossRef MRC Renal Cancer Collaborators: Interferon-alpha and survival in metastatic renal carcinoma: early results of a randomised trial. Lancet. 1999, 353: 14-17.CrossRef
11.
go back to reference Gore ME, Griffin CL, Hancock B, Patel PM, Pyle L, Aitchison M, James N, Oliver RTD, Mardiak J, Hussain T, Sylvester R, Parmar MKB, Royston P, Mulders PFA: Interferon alfa-2a versus combination therapy with interferon alfa-2a, interleukin-2, and fluorouracil in patients with untreated metastatic renal cell carcinoma (MRC RE04/EORTC GU 30012): an open-label randomised trial. Lancet. 2010, 375: 641-648. 10.1016/S0140-6736(09)61921-8.CrossRefPubMedPubMedCentral Gore ME, Griffin CL, Hancock B, Patel PM, Pyle L, Aitchison M, James N, Oliver RTD, Mardiak J, Hussain T, Sylvester R, Parmar MKB, Royston P, Mulders PFA: Interferon alfa-2a versus combination therapy with interferon alfa-2a, interleukin-2, and fluorouracil in patients with untreated metastatic renal cell carcinoma (MRC RE04/EORTC GU 30012): an open-label randomised trial. Lancet. 2010, 375: 641-648. 10.1016/S0140-6736(09)61921-8.CrossRefPubMedPubMedCentral
12.
go back to reference The International Collaborative Ovarian Neoplasm (ICON) Group: Paclitaxel plus carboplatin versus standard chemotherapy with either single-agent carboplatin or cyclophosphamide, doxorubicin, and cisplatin in women with ovarian cancer: the ICON3 randomised trial. Lancet. 2002, 360: 505-515.CrossRef The International Collaborative Ovarian Neoplasm (ICON) Group: Paclitaxel plus carboplatin versus standard chemotherapy with either single-agent carboplatin or cyclophosphamide, doxorubicin, and cisplatin in women with ovarian cancer: the ICON3 randomised trial. Lancet. 2002, 360: 505-515.CrossRef
13.
go back to reference The ICON and AGO Collaborators: Paclitaxel plus platinumbased chemotherapy versus conventional platinum-based chemotherapy in women with relapsed ovarian cancer: the ICON4/AGO-2.2 trial. Lancet. 2003, 361: 2099-2106.CrossRef The ICON and AGO Collaborators: Paclitaxel plus platinumbased chemotherapy versus conventional platinum-based chemotherapy in women with relapsed ovarian cancer: the ICON4/AGO-2.2 trial. Lancet. 2003, 361: 2099-2106.CrossRef
14.
go back to reference Barthel FMS, Parmar MKB, Royston P: How do multi-stage multi-arm trials compare to the traditional two-arm parallel group design – a reanalysis of 4 trials. Trials. 2009, 10.1186/1745-6215-10-21. Barthel FMS, Parmar MKB, Royston P: How do multi-stage multi-arm trials compare to the traditional two-arm parallel group design – a reanalysis of 4 trials. Trials. 2009, 10.1186/1745-6215-10-21.
15.
go back to reference Grambsch PM, Therneau TM: Proportional hazards tests and diagnostics based on weighted residuals. Biometrika. 1994, 81: 515-526. 10.1093/biomet/81.3.515.CrossRef Grambsch PM, Therneau TM: Proportional hazards tests and diagnostics based on weighted residuals. Biometrika. 1994, 81: 515-526. 10.1093/biomet/81.3.515.CrossRef
16.
go back to reference Goodman SN: Stopping trials for efficacy: an almost unbiased view. Clin Trials. 2009, 6: 133-135. 10.1177/1740774509103609.CrossRefPubMed Goodman SN: Stopping trials for efficacy: an almost unbiased view. Clin Trials. 2009, 6: 133-135. 10.1177/1740774509103609.CrossRefPubMed
17.
go back to reference Freidlin B, Korn EL: Stopping clinical trials early for benefit: impact on estimation. Clin Trials. 2009, 6: 119-125. 10.1177/1740774509102310.CrossRefPubMed Freidlin B, Korn EL: Stopping clinical trials early for benefit: impact on estimation. Clin Trials. 2009, 6: 119-125. 10.1177/1740774509102310.CrossRefPubMed
18.
go back to reference Cohen A, Sackrowitz H: Two stage conditionally unbiased estimators of the selected mean. Stat Probability Lett. 1989, 8: 273-278. 10.1016/0167-7152(89)90133-8.CrossRef Cohen A, Sackrowitz H: Two stage conditionally unbiased estimators of the selected mean. Stat Probability Lett. 1989, 8: 273-278. 10.1016/0167-7152(89)90133-8.CrossRef
19.
go back to reference Bowden J, Glimm E: Unbiased estimation of selected treatment means in two-stage trials. Biometrical J. 2008, 50 (4): 515-527. 10.1002/bimj.200810442.CrossRef Bowden J, Glimm E: Unbiased estimation of selected treatment means in two-stage trials. Biometrical J. 2008, 50 (4): 515-527. 10.1002/bimj.200810442.CrossRef
20.
go back to reference Sill MW, Sampson AR: Extension of a two-stage conditionally unbiased estimator of the selected population to the bivariate normal case. Commun Stat Theory Methods. 2007, 36: 801-813. 10.1080/03610920601034072.CrossRef Sill MW, Sampson AR: Extension of a two-stage conditionally unbiased estimator of the selected population to the bivariate normal case. Commun Stat Theory Methods. 2007, 36: 801-813. 10.1080/03610920601034072.CrossRef
21.
go back to reference Bauer P, Koenig F, Brannath W, Poscha M: Selection and bias - two hostile brothers. Stat Med. 2010, 29 (1): 1-13.PubMed Bauer P, Koenig F, Brannath W, Poscha M: Selection and bias - two hostile brothers. Stat Med. 2010, 29 (1): 1-13.PubMed
Metadata
Title
Impact of lack-of-benefit stopping rules on treatment effect estimates of two-arm multi-stage (TAMS) trials with time to event outcome
Authors
Babak Choodari-Oskooei
Mahesh KB Parmar
Patrick Royston
Jack Bowden
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-23

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue