Skip to main content
Top
Published in: Trials 1/2014

Open Access 01-12-2014 | Research

Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency

Authors: Amelie Elsäßer, Jan Regnstrom, Thorsten Vetter, Franz Koenig, Robert James Hemmings, Martina Greco, Marisa Papaluca-Amati, Martin Posch

Published in: Trials | Issue 1/2014

Login to get access

Abstract

Background

Since the first methodological publications on adaptive study design approaches in the 1990s, the application of these approaches in drug development has raised increasing interest among academia, industry and regulators. The European Medicines Agency (EMA) as well as the Food and Drug Administration (FDA) have published guidance documents addressing the potentials and limitations of adaptive designs in the regulatory context. Since there is limited experience in the implementation and interpretation of adaptive clinical trials, early interaction with regulators is recommended. The EMA offers such interactions through scientific advice and protocol assistance procedures.

Methods

We performed a text search of scientific advice letters issued between 1 January 2007 and 8 May 2012 that contained relevant key terms. Letters containing questions related to adaptive clinical trials in phases II or III were selected for further analysis. From the selected letters, important characteristics of the proposed design and its context in the drug development program, as well as the responses of the Committee for Human Medicinal Products (CHMP)/Scientific Advice Working Party (SAWP), were extracted and categorized. For 41 more recent procedures (1 January 2009 to 8 May 2012), additional details of the trial design and the CHMP/SAWP responses were assessed. In addition, case studies are presented as examples.

Results

Over a range of 5½ years, 59 scientific advices were identified that address adaptive study designs in phase II and phase III clinical trials. Almost all were proposed as confirmatory phase III or phase II/III studies. The most frequently proposed adaptation was sample size reassessment, followed by dropping of treatment arms and population enrichment. While 12 (20%) of the 59 proposals for an adaptive clinical trial were not accepted, the great majority of proposals were accepted (15, 25%) or conditionally accepted (32, 54%). In the more recent 41 procedures, the most frequent concerns raised by CHMP/SAWP were insufficient justifications of the adaptation strategy, type I error rate control and bias.

Conclusions

For the majority of proposed adaptive clinical trials, an overall positive opinion was given albeit with critical comments. Type I error rate control, bias and the justification of the design are common issues raised by the CHMP/SAWP.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bauer P, Kohne K: Evaluation of experiments with adaptive interim analyses. Biometrics. 1994, 50: 1029-1041. 10.2307/2533441.CrossRefPubMed Bauer P, Kohne K: Evaluation of experiments with adaptive interim analyses. Biometrics. 1994, 50: 1029-1041. 10.2307/2533441.CrossRefPubMed
2.
go back to reference Proschan MA, Hunsberger SA: Designed extension of studies based on conditional power. Biometrics. 1995, 51: 1315-1324. 10.2307/2533262.CrossRefPubMed Proschan MA, Hunsberger SA: Designed extension of studies based on conditional power. Biometrics. 1995, 51: 1315-1324. 10.2307/2533262.CrossRefPubMed
3.
go back to reference European Medicines Agency: Reflection Paper on Methodological Issues in Confirmatory Clinical Trials Planned with an Adaptive Design (CHMP/EWP/2459/02). 2007, London European Medicines Agency: Reflection Paper on Methodological Issues in Confirmatory Clinical Trials Planned with an Adaptive Design (CHMP/EWP/2459/02). 2007, London
4.
go back to reference U.S. Food and Drug Administration: Guidance for Industry – Adaptive Design Clinical Trials for Drugs and Biologics (Draft Guidance). 2010, Rockville U.S. Food and Drug Administration: Guidance for Industry – Adaptive Design Clinical Trials for Drugs and Biologics (Draft Guidance). 2010, Rockville
5.
go back to reference Regnstrom J, Koenig F, Aronsson B, Reimer T, Svendsen K, Tsigkos S, Flamion B, Eichler H-G, Vamvakas S: Factors associated with success of market authorisation applications for pharmaceutical drugs submitted to the European Medicines Agency. Eur J Clin Pharmacol. 2010, 66: 39-48. 10.1007/s00228-009-0756-y.CrossRefPubMed Regnstrom J, Koenig F, Aronsson B, Reimer T, Svendsen K, Tsigkos S, Flamion B, Eichler H-G, Vamvakas S: Factors associated with success of market authorisation applications for pharmaceutical drugs submitted to the European Medicines Agency. Eur J Clin Pharmacol. 2010, 66: 39-48. 10.1007/s00228-009-0756-y.CrossRefPubMed
6.
go back to reference Morgan CC, Huyck S, Jenkins M, Chen L, Bedding A, Christopher SC, Gaydos B, Wathen JK: Adaptive Design: Results of 2012 Survey on Perception and Use. Ther Innov Regul Sci. 2014, 48: 473-481. 10.1177/2168479014522468.CrossRef Morgan CC, Huyck S, Jenkins M, Chen L, Bedding A, Christopher SC, Gaydos B, Wathen JK: Adaptive Design: Results of 2012 Survey on Perception and Use. Ther Innov Regul Sci. 2014, 48: 473-481. 10.1177/2168479014522468.CrossRef
7.
go back to reference Gaydos B, Koch A, Miller F, Posch M, Vandemeulenbroecke M, Wang S-J: Perspective on adaptive designs: 4 years European Medicines Agency reflection paper, 1 year draft US FDA guidance – where are we now?. Clin Invest. 2012, 2: 235-240. 10.4155/cli.12.5.CrossRef Gaydos B, Koch A, Miller F, Posch M, Vandemeulenbroecke M, Wang S-J: Perspective on adaptive designs: 4 years European Medicines Agency reflection paper, 1 year draft US FDA guidance – where are we now?. Clin Invest. 2012, 2: 235-240. 10.4155/cli.12.5.CrossRef
8.
go back to reference European Medicines Agency: Points to Consider on Multiplicity Issues in Clinical Trials (CPMP/EWP/908/99). 2002, London European Medicines Agency: Points to Consider on Multiplicity Issues in Clinical Trials (CPMP/EWP/908/99). 2002, London
9.
go back to reference European Medicines Agency: Guideline on Data Monitoring Committees (EMEA/CHMP/EWP/5872/03). 2005, London European Medicines Agency: Guideline on Data Monitoring Committees (EMEA/CHMP/EWP/5872/03). 2005, London
10.
go back to reference European Medicines Agency: Guideline on Clinical Trials in Small Populations (CHMP/EWP/83561/2005). 2006, London European Medicines Agency: Guideline on Clinical Trials in Small Populations (CHMP/EWP/83561/2005). 2006, London
11.
go back to reference Müller HH, Schäfer H: Adaptive group sequential designs for clinical trials: combining the advantages of adaptive and of classical group sequential approaches. Biometrics. 2001, 57: 886-891. 10.1111/j.0006-341X.2001.00886.x.CrossRefPubMed Müller HH, Schäfer H: Adaptive group sequential designs for clinical trials: combining the advantages of adaptive and of classical group sequential approaches. Biometrics. 2001, 57: 886-891. 10.1111/j.0006-341X.2001.00886.x.CrossRefPubMed
12.
go back to reference Posch M, Bauer P: Adaptive two stage designs and the conditional error function. Biom J. 1999, 41: 689-696. 10.1002/(SICI)1521-4036(199910)41:6<689::AID-BIMJ689>3.0.CO;2-P.CrossRef Posch M, Bauer P: Adaptive two stage designs and the conditional error function. Biom J. 1999, 41: 689-696. 10.1002/(SICI)1521-4036(199910)41:6<689::AID-BIMJ689>3.0.CO;2-P.CrossRef
14.
go back to reference Lehmacher W, Wassmer G: Adaptive sample size calculations in group sequential trials. Biometrics. 1999, 55: 1286-1290. 10.1111/j.0006-341X.1999.01286.x.CrossRefPubMed Lehmacher W, Wassmer G: Adaptive sample size calculations in group sequential trials. Biometrics. 1999, 55: 1286-1290. 10.1111/j.0006-341X.1999.01286.x.CrossRefPubMed
15.
go back to reference Chi L, Hung HM, Wang SJ: Modification of sample size in group sequential clinical trials. Biometrics. 1999, 55: 853-857. 10.1111/j.0006-341X.1999.00853.x.CrossRef Chi L, Hung HM, Wang SJ: Modification of sample size in group sequential clinical trials. Biometrics. 1999, 55: 853-857. 10.1111/j.0006-341X.1999.00853.x.CrossRef
16.
go back to reference Chen YH, DeMets DL, Gordon Lan KK: Increasing the sample size when the unblinded interim result is promising. Stat Med. 2004, 23: 1023-1038. 10.1002/sim.1688.CrossRefPubMed Chen YH, DeMets DL, Gordon Lan KK: Increasing the sample size when the unblinded interim result is promising. Stat Med. 2004, 23: 1023-1038. 10.1002/sim.1688.CrossRefPubMed
17.
go back to reference Mehta CR, Pocock SJ: Adaptive increase in sample size when interim results are promising: a practical guide with examples. Stat Med. 2011, 30: 3267-3284. 10.1002/sim.4102.CrossRefPubMed Mehta CR, Pocock SJ: Adaptive increase in sample size when interim results are promising: a practical guide with examples. Stat Med. 2011, 30: 3267-3284. 10.1002/sim.4102.CrossRefPubMed
18.
go back to reference Bauer P, Posch M: Modification of the sample size and the schedule of interim analyses in survival trials based on data inspections by H. Schäfer and H.‒H. Müller, Statistics in Medicine 2001; 20:3741–3751. Stat Med. 2004, 23: 1333-1334. 10.1002/sim.1759.CrossRefPubMed Bauer P, Posch M: Modification of the sample size and the schedule of interim analyses in survival trials based on data inspections by H. Schäfer and H.‒H. Müller, Statistics in Medicine 2001; 20:3741–3751. Stat Med. 2004, 23: 1333-1334. 10.1002/sim.1759.CrossRefPubMed
19.
go back to reference Jenkins M, Stone A, Jennison C: An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints. Pharm Stat. 2011, 10: 347-356. 10.1002/pst.472.CrossRefPubMed Jenkins M, Stone A, Jennison C: An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints. Pharm Stat. 2011, 10: 347-356. 10.1002/pst.472.CrossRefPubMed
20.
go back to reference Irle S, Schäfer H: Interim design modifications in time-to-event studies. J Am Stat Assoc. 2012, 107: 341-348. 10.1080/01621459.2011.644141.CrossRef Irle S, Schäfer H: Interim design modifications in time-to-event studies. J Am Stat Assoc. 2012, 107: 341-348. 10.1080/01621459.2011.644141.CrossRef
21.
go back to reference Hommel G: Adaptive modifications of hypotheses after an interim analysis. Biom J. 2001, 43: 581-589. 10.1002/1521-4036(200109)43:5<581::AID-BIMJ581>3.0.CO;2-J.CrossRef Hommel G: Adaptive modifications of hypotheses after an interim analysis. Biom J. 2001, 43: 581-589. 10.1002/1521-4036(200109)43:5<581::AID-BIMJ581>3.0.CO;2-J.CrossRef
22.
go back to reference Posch M, Koenig F, Branson M, Brannath W, Dunger‒Baldauf C, Bauer P: Testing and estimation in flexible group sequential designs with adaptive treatment selection. Stat Med. 2005, 24: 3697-3714. 10.1002/sim.2389.CrossRefPubMed Posch M, Koenig F, Branson M, Brannath W, Dunger‒Baldauf C, Bauer P: Testing and estimation in flexible group sequential designs with adaptive treatment selection. Stat Med. 2005, 24: 3697-3714. 10.1002/sim.2389.CrossRefPubMed
23.
go back to reference Bretz F, Koenig F, Brannath W, Glimm E, Posch M: Adaptive designs for confirmatory clinical trials. Stat Med. 2009, 28: 1181-1217. 10.1002/sim.3538.CrossRefPubMed Bretz F, Koenig F, Brannath W, Glimm E, Posch M: Adaptive designs for confirmatory clinical trials. Stat Med. 2009, 28: 1181-1217. 10.1002/sim.3538.CrossRefPubMed
24.
go back to reference Koenig F, Brannath W, Bretz F, Posch M: Adaptive Dunnett tests for treatment selection. Stat Med. 2008, 27: 1612-1625. 10.1002/sim.3048.CrossRefPubMed Koenig F, Brannath W, Bretz F, Posch M: Adaptive Dunnett tests for treatment selection. Stat Med. 2008, 27: 1612-1625. 10.1002/sim.3048.CrossRefPubMed
25.
go back to reference European Medicines Agency: Qualification Of Novel Methodologies For Drug Development: Guidance To Applicants (CHMP/SAWP/72894/2008 R). 2008, London European Medicines Agency: Qualification Of Novel Methodologies For Drug Development: Guidance To Applicants (CHMP/SAWP/72894/2008 R). 2008, London
26.
go back to reference Bauer P, Koenig F, Brannath W, Posch M: Selection and bias - Two hostile brothers. Stat Med. 2010, 29: 1-13.PubMed Bauer P, Koenig F, Brannath W, Posch M: Selection and bias - Two hostile brothers. Stat Med. 2010, 29: 1-13.PubMed
27.
go back to reference Wang SJ, James Hung HM, O’Neill RT: Impacts on type I error rate with inappropriate use of learn and confirm in confirmatory adaptive design trials. Biom J. 2010, 52: 798-810. 10.1002/bimj.200900207.CrossRefPubMed Wang SJ, James Hung HM, O’Neill RT: Impacts on type I error rate with inappropriate use of learn and confirm in confirmatory adaptive design trials. Biom J. 2010, 52: 798-810. 10.1002/bimj.200900207.CrossRefPubMed
Metadata
Title
Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency
Authors
Amelie Elsäßer
Jan Regnstrom
Thorsten Vetter
Franz Koenig
Robert James Hemmings
Martina Greco
Marisa Papaluca-Amati
Martin Posch
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Trials / Issue 1/2014
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-15-383

Other articles of this Issue 1/2014

Trials 1/2014 Go to the issue