Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Evaluation of a multi-arm multi-stage Bayesian design for phase II drug selection trials – an example in hemato-oncology

Authors: Louis Jacob, Maria Uvarova, Sandrine Boulet, Inva Begaj, Sylvie Chevret

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Multi-Arm Multi-Stage designs aim at comparing several new treatments to a common reference, in order to select or drop any treatment arm to move forward when such evidence already exists based on interim analyses. We redesigned a Bayesian adaptive design initially proposed for dose-finding, focusing our interest in the comparison of multiple experimental drugs to a control on a binary criterion measure.

Methods

We redesigned a phase II clinical trial that randomly allocates patients across three (one control and two experimental) treatment arms to assess dropping decision rules. We were interested in dropping any arm due to futility, either based on historical control rate (first rule) or comparison across arms (second rule), and in stopping experimental arm due to its ability to reach a sufficient response rate (third rule), using the difference of response probabilities in Bayes binomial trials between the treated and control as a measure of treatment benefit. Simulations were then conducted to investigate the decision operating characteristics under a variety of plausible scenarios, as a function of the decision thresholds.

Results

Our findings suggest that one experimental treatment was less efficient than the control and could have been dropped from the trial based on a sample of approximately 20 instead of 40 patients. In the simulation study, stopping decisions were reached sooner for the first rule than for the second rule, with close mean estimates of response rates and small bias. According to the decision threshold, the mean sample size to detect the required 0.15 absolute benefit ranged from 63 to 70 (rule 3) with false negative rates of less than 2 % (rule 1) up to 6 % (rule 2). In contrast, detecting a 0.15 inferiority in response rates required a sample size ranging on average from 23 to 35 (rules 1 and 2, respectively) with a false positive rate ranging from 3.6 to 0.6 % (rule 3).

Conclusion

Adaptive trial design is a good way to improve clinical trials. It allows removing ineffective drugs and reducing the trial sample size, while maintaining unbiased estimates. Decision thresholds can be set according to predefined fixed error decision rates.

Trial registration

ClinicalTrials.gov Identifier: NCT01342692.
Literature
1.
go back to reference Luce BR, Kramer JM, Goodman SN, Connor JT, Tunis S, Whicher D, Schwartz JS. Rethinking randomized clinical trials for comparative effectiveness research: the need for transformational change. Ann Intern Med. 2009;151:206–9. PMID: 19567619.CrossRefPubMed Luce BR, Kramer JM, Goodman SN, Connor JT, Tunis S, Whicher D, Schwartz JS. Rethinking randomized clinical trials for comparative effectiveness research: the need for transformational change. Ann Intern Med. 2009;151:206–9. PMID: 19567619.CrossRefPubMed
3.
go back to reference Rubinstein LV, Korn EL, Freidlin B, Hunsberger S, Ivy SP, Smith MA. Design issues of randomized phase II trials and a proposal for phase II screening trials. J Clin Oncol Off J Am Soc Clin Oncol. 2005;23:7199–206. doi:10.1200/JCO.2005.01.149. PMID: 16192604.CrossRef Rubinstein LV, Korn EL, Freidlin B, Hunsberger S, Ivy SP, Smith MA. Design issues of randomized phase II trials and a proposal for phase II screening trials. J Clin Oncol Off J Am Soc Clin Oncol. 2005;23:7199–206. doi:10.​1200/​JCO.​2005.​01.​149. PMID: 16192604.CrossRef
4.
go back to reference Ellenberg SS. Select-drop designs in clinical trials. Am Heart J. 2000;139:S158–160. PMID: 10740123.CrossRefPubMed Ellenberg SS. Select-drop designs in clinical trials. Am Heart J. 2000;139:S158–160. PMID: 10740123.CrossRefPubMed
11.
go back to reference Whitehead J, Cleary F, Turner A. Bayesian sample sizes for exploratory clinical trials comparing multiple experimental treatments with a control. Stat Med. 2015;34(12):2048–61. doi:10.1002/sim.6469. PMID: 25765252.CrossRefPubMed Whitehead J, Cleary F, Turner A. Bayesian sample sizes for exploratory clinical trials comparing multiple experimental treatments with a control. Stat Med. 2015;34(12):2048–61. doi:10.​1002/​sim.​6469. PMID: 25765252.CrossRefPubMed
15.
go back to reference Thall PF, Simon R. Practical Bayesian guidelines for phase IIB clinical trials. Biometrics. 1994;50:337–49. PMID: 7980801.CrossRefPubMed Thall PF, Simon R. Practical Bayesian guidelines for phase IIB clinical trials. Biometrics. 1994;50:337–49. PMID: 7980801.CrossRefPubMed
21.
go back to reference Morita S, Thall PF, Müller P: Evaluating the Impact of Prior Assumptions in Bayesian Biostatistics. Stat. Biosci. 2010, 2:1–17. [doi: 10.1007/s12561-010-9018-x] [PMID: 20668651PMCID: PMC2910452]. Morita S, Thall PF, Müller P: Evaluating the Impact of Prior Assumptions in Bayesian Biostatistics. Stat. Biosci. 2010, 2:1–17. [doi: 10.​1007/​s12561-010-9018-x] [PMID: 20668651PMCID: PMC2910452].
22.
go back to reference Moatti M, Zohar S, Facon T, Moreau P, Mary J-Y, Chevret S. Modeling of experts’ divergent prior beliefs for a sequential phase III clinical trial. Clin Trials Lond Engl. 2013;10:505–14. doi:10.1177/1740774513493528. PMID: 23820061.CrossRef Moatti M, Zohar S, Facon T, Moreau P, Mary J-Y, Chevret S. Modeling of experts’ divergent prior beliefs for a sequential phase III clinical trial. Clin Trials Lond Engl. 2013;10:505–14. doi:10.​1177/​1740774513493528​. PMID: 23820061.CrossRef
23.
go back to reference Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR. Bayesian methods in health technology assessment: a review. Health Technol Assess Winch Engl. 2000;4:1–130. PMID: 11134920. Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR. Bayesian methods in health technology assessment: a review. Health Technol Assess Winch Engl. 2000;4:1–130. PMID: 11134920.
24.
go back to reference Taylor JMG, Braun TM, Li Z. Comparing an experimental agent to a standard agent: relative merits of a one-arm or randomized two-arm Phase II design. Clin Trials Lond Engl. 2006;3:335–48. doi:10.1177/1740774506070654. PMID: 17060208. Taylor JMG, Braun TM, Li Z. Comparing an experimental agent to a standard agent: relative merits of a one-arm or randomized two-arm Phase II design. Clin Trials Lond Engl. 2006;3:335–48. doi:10.​1177/​1740774506070654​. PMID: 17060208.
25.
go back to reference Ratain MJ, Sargent DJ. Optimising the design of phase II oncology trials: the importance of randomisation. Eur. J. Cancer Oxf. Engl. 1990 2009, 45:275–280. [doi: 10.1016/j.ejca.2008.10.029] [PMID: 19059773]. Ratain MJ, Sargent DJ. Optimising the design of phase II oncology trials: the importance of randomisation. Eur. J. Cancer Oxf. Engl. 1990 2009, 45:275–280. [doi: 10.​1016/​j.​ejca.​2008.​10.​029] [PMID: 19059773].
26.
go back to reference Baron G, Perrodeau E, Boutron I, Ravaud P. Reporting of analyses from randomized controlled trials with multiple arms: a systematic review. BMC Med. 2013, 11:84. [doi: 10.1186/1741-7015-11-84] [PMID: 23531230PMCID: PMC3621416]. Baron G, Perrodeau E, Boutron I, Ravaud P. Reporting of analyses from randomized controlled trials with multiple arms: a systematic review. BMC Med. 2013, 11:84. [doi: 10.​1186/​1741-7015-11-84] [PMID: 23531230PMCID: PMC3621416].
27.
29.
go back to reference Cai C, Yuan Y, Johnson VE. Bayesian adaptive phase II screening design for combination trials. Clin. Trials Lond. Engl. 2013, 10:353–362. [doi: 10.1177/1740774512470316] [PMID: 23359875PMCID: PMC3867529]. Cai C, Yuan Y, Johnson VE. Bayesian adaptive phase II screening design for combination trials. Clin. Trials Lond. Engl. 2013, 10:353–362. [doi: 10.​1177/​1740774512470316​] [PMID: 23359875PMCID: PMC3867529].
31.
go back to reference Pan H, Xie F, Liu P, Xia J, Ji Y. A phase I/II seamless dose escalation/expansion with adaptive randomization scheme (SEARS). Clin. Trials Lond. Engl. 2014, 11:49–59. [doi: 10.1177/1740774513500081] [PMID: 24137041PMCID: PMC4281526]. Pan H, Xie F, Liu P, Xia J, Ji Y. A phase I/II seamless dose escalation/expansion with adaptive randomization scheme (SEARS). Clin. Trials Lond. Engl. 2014, 11:49–59. [doi: 10.​1177/​1740774513500081​] [PMID: 24137041PMCID: PMC4281526].
32.
go back to reference Freidlin B, Korn EL. Monitoring for lack of benefit: a critical component of a randomized clinical trial. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2009, 27:629–633. [doi: 10.1200/JCO.2008.17.8905] [PMID: 19064977PMCID: PMC2645857]. Freidlin B, Korn EL. Monitoring for lack of benefit: a critical component of a randomized clinical trial. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2009, 27:629–633. [doi: 10.​1200/​JCO.​2008.​17.​8905] [PMID: 19064977PMCID: PMC2645857].
33.
go back to reference Brannath W, Zuber E, Branson M, Bretz F, Gallo P, Posch M, Racine-Poon A. Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncology. Stat Med. 2009;28:1445–63. doi:10.1002/sim.3559.CrossRefPubMed Brannath W, Zuber E, Branson M, Bretz F, Gallo P, Posch M, Racine-Poon A. Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncology. Stat Med. 2009;28:1445–63. doi:10.​1002/​sim.​3559.CrossRefPubMed
35.
Metadata
Title
Evaluation of a multi-arm multi-stage Bayesian design for phase II drug selection trials – an example in hemato-oncology
Authors
Louis Jacob
Maria Uvarova
Sandrine Boulet
Inva Begaj
Sylvie Chevret
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0166-7

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue