Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Power Loss | Research article

Optimality criteria for futility stopping boundaries for group sequential designs with a continuous endpoint

Authors: Xieran Li, Carolin Herrmann, Geraldine Rauch

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

In clinical trials with fixed study designs, statistical inference is only made when the trial is completed. In contrast, group sequential designs allow an early stopping of the trial at interim, either for efficacy when the treatment effect is significant or for futility when the treatment effect seems too small to justify a continuation of the trial. Efficacy stopping boundaries based on alpha spending functions have been widely discussed in the statistical literature, and there is also solid work on the choice of adequate futility stopping boundaries. Still, futility boundaries are often chosen with little or completely without theoretical justification, in particular in investigator initiated trails. Some authors contributed to fill this gap. In here, we rely on an idea of Schüler et al. (2017) who discuss optimality criteria for futility boundaries for the special case of trials with (multiple) time-to-event endpoints. Their concept can be adopted to define “optimal” futility boundaries (with respect to given performance indicators) for continuous endpoints.

Methods

We extend Schülers’ definition for “optimal” futility boundaries to the most common study situation of a single continuous primary endpoint compared between two groups. First, we introduce the analytic algorithm to derive these futility boundaries. Second, the new concept is applied to a real clinical trial example. Finally, the performance of a study design with an “optimal” futility boundary is compared to designs with arbitrarily chosen futility boundaries.

Results

The presented concept of deriving futility boundaries allows to control the probability of wrongly stopping for futility, that means stopping for futility even if the treatment effect is promizing. At the same time, the loss in power is also controlled by this approach. Moreover, “optimal” futility boundaries improve the probability of correctly stopping for futility under the null hypothesis of no difference between two groups.

Conclusions

The choice of futility boundaries should be thoroughly investigated at the planning stage. The sometimes met, arbitrary choice of futility boundaries can lead to a substantial negative impact on performance. Applying futility boundaries with predefined optimization criteria increases efficiency of group sequential designs. Other optimization criteria than proposed in here might be incorporated.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pocock S. Group sequential methods in the design and analysis of clinical trials. Biometrika. 1977; 64(2):191–9.CrossRef Pocock S. Group sequential methods in the design and analysis of clinical trials. Biometrika. 1977; 64(2):191–9.CrossRef
2.
go back to reference O’Brien P, Fleming T. A multiple testing procedure for clinical trials. Biometrics. 1979; 35(3):549–56.CrossRef O’Brien P, Fleming T. A multiple testing procedure for clinical trials. Biometrics. 1979; 35(3):549–56.CrossRef
3.
go back to reference DeMets D, Ware J. Group sequential methods for clinical trials with a one-sided hypothesis. Biometrika. 1980; 67:651–60.CrossRef DeMets D, Ware J. Group sequential methods for clinical trials with a one-sided hypothesis. Biometrika. 1980; 67:651–60.CrossRef
4.
go back to reference Lan K, DeMets D. Discrete sequential boundaries for clinical trials. Biometrika. 1983; 70:659–63.CrossRef Lan K, DeMets D. Discrete sequential boundaries for clinical trials. Biometrika. 1983; 70:659–63.CrossRef
5.
go back to reference Wang S, Tsiatis AA. Approximately optimal one-parameter boundaries for group sequential trials. Biometrics. 1987; 43:193–9.CrossRef Wang S, Tsiatis AA. Approximately optimal one-parameter boundaries for group sequential trials. Biometrics. 1987; 43:193–9.CrossRef
6.
go back to reference Bretz F, Koenig F, Brannath W, Glimm E, Posch M. Adaptive designs for confirmatory clinical trials. Stat Med. 2009; 28(8):1181–217.CrossRef Bretz F, Koenig F, Brannath W, Glimm E, Posch M. Adaptive designs for confirmatory clinical trials. Stat Med. 2009; 28(8):1181–217.CrossRef
7.
go back to reference DeMets D, Ware J. Asymmetric group sequential boundaries for monitoring clinical trials. Biometrika. 1982; 69(3):661–3.CrossRef DeMets D, Ware J. Asymmetric group sequential boundaries for monitoring clinical trials. Biometrika. 1982; 69(3):661–3.CrossRef
8.
go back to reference Whitehead J, Stratton I. Group sequential clinical trials with triangular continuation regions. Biometrics. 1983; 39:227–36.CrossRef Whitehead J, Stratton I. Group sequential clinical trials with triangular continuation regions. Biometrics. 1983; 39:227–36.CrossRef
9.
go back to reference Chang M, Hwang I, Shin W. Group sequential designs using both type I and type II error probability spending functions. Commun Stat Theory Methods. 1998; 27(6):1323–39.CrossRef Chang M, Hwang I, Shin W. Group sequential designs using both type I and type II error probability spending functions. Commun Stat Theory Methods. 1998; 27(6):1323–39.CrossRef
10.
go back to reference Pampallona S, Tsiatis A. Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis. J Stat Plan Infer. 1994; 42:19–35.CrossRef Pampallona S, Tsiatis A. Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis. J Stat Plan Infer. 1994; 42:19–35.CrossRef
11.
go back to reference Pampallona S, Tsiatis AA, Kim K. Interim monitoring of group sequential trials using spending functions for the type I and type II error probabilities. Drug Inf J. 2001; 35(4):1113–21.CrossRef Pampallona S, Tsiatis AA, Kim K. Interim monitoring of group sequential trials using spending functions for the type I and type II error probabilities. Drug Inf J. 2001; 35(4):1113–21.CrossRef
12.
go back to reference Rudser K, Emerson S. Implementing type I & type II error spending for two-sided group sequential designs. Contemp Clin Trials. 2008; 29:351–8.CrossRef Rudser K, Emerson S. Implementing type I & type II error spending for two-sided group sequential designs. Contemp Clin Trials. 2008; 29:351–8.CrossRef
13.
go back to reference He P, Lai T, Liao O. Futility stopping in clinical trials. Stat Interface. 2012; 5:415–23.CrossRef He P, Lai T, Liao O. Futility stopping in clinical trials. Stat Interface. 2012; 5:415–23.CrossRef
14.
go back to reference Gallo P, Mao L, Shih VH. Alternative views on setting clinical trial futility criteria. J Biopharm Stat. 2014; 24(5):976–93.CrossRef Gallo P, Mao L, Shih VH. Alternative views on setting clinical trial futility criteria. J Biopharm Stat. 2014; 24(5):976–93.CrossRef
15.
go back to reference Xi D, Gallo P, Ohlssen D. On the optimal timing of futility interim analyses. Stat Biopharm Res. 2977; 9:293–301.CrossRef Xi D, Gallo P, Ohlssen D. On the optimal timing of futility interim analyses. Stat Biopharm Res. 2977; 9:293–301.CrossRef
16.
go back to reference Pilz M, Kunzmann K, Herrmann C, Rauch G, Kieser M. A variational approach to optimal two-stage designs. Stat Med. 2019; 38(21):4159–71.CrossRef Pilz M, Kunzmann K, Herrmann C, Rauch G, Kieser M. A variational approach to optimal two-stage designs. Stat Med. 2019; 38(21):4159–71.CrossRef
17.
go back to reference Ondra T, Jobjörnsson S, Beckman RA, Burman C-F, König F, Stallard N, Posch M. Optimized adaptive enrichment designs. Stat Methods Med Res. 2019; 28(7):2096–111.CrossRef Ondra T, Jobjörnsson S, Beckman RA, Burman C-F, König F, Stallard N, Posch M. Optimized adaptive enrichment designs. Stat Methods Med Res. 2019; 28(7):2096–111.CrossRef
18.
go back to reference Schüler S, Kieser M, Rauch G. Choice of futility boundaries for group sequential designs with two endpoints. BMC Med Res Methodol. 2017; 17(119). Schüler S, Kieser M, Rauch G. Choice of futility boundaries for group sequential designs with two endpoints. BMC Med Res Methodol. 2017; 17(119).
23.
go back to reference Bauer P, Köhne K. Evaluation of experiments with adaptive interim analyses. 1029–41. 1994. Bauer P, Köhne K. Evaluation of experiments with adaptive interim analyses. 1029–41. 1994.
24.
go back to reference Fisher RA. “Statistical methods for research workers”. Statistical methods for research workers. 1934; 5th Ed. Fisher RA. “Statistical methods for research workers”. Statistical methods for research workers. 1934; 5th Ed.
25.
go back to reference Diener M, Bruckner T, Contin P, Halloran C, Glanemann M, Schlitt H, Mössner J, Kieser M, Werner J, Büchler M, Seiler C. ChroPac-trial: duodenum-preserving pancreatic head resection versus pancreatoduodenectomy for chronic pancreatitis. Trial protocol of a randomised controlled multicentre trial. Trials. 2010; 11:47.CrossRef Diener M, Bruckner T, Contin P, Halloran C, Glanemann M, Schlitt H, Mössner J, Kieser M, Werner J, Büchler M, Seiler C. ChroPac-trial: duodenum-preserving pancreatic head resection versus pancreatoduodenectomy for chronic pancreatitis. Trial protocol of a randomised controlled multicentre trial. Trials. 2010; 11:47.CrossRef
Metadata
Title
Optimality criteria for futility stopping boundaries for group sequential designs with a continuous endpoint
Authors
Xieran Li
Carolin Herrmann
Geraldine Rauch
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Power Loss
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01141-5

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue