Skip to main content
Top
Published in: BMC Cancer 1/2020

Open Access 01-12-2020 | Software

A web application for the design of multi-arm clinical trials

Authors: Michael J. Grayling, James MS. Wason

Published in: BMC Cancer | Issue 1/2020

Login to get access

Abstract

Background

Multi-arm designs provide an effective means of evaluating several treatments within the same clinical trial. Given the large number of treatments now available for testing in many disease areas, it has been argued that their utilisation should increase. However, for any given clinical trial there are numerous possible multi-arm designs that could be used, and choosing between them can be a difficult task. This task is complicated further by a lack of available easy-to-use software for designing multi-arm trials.

Results

To aid the wider implementation of multi-arm clinical trial designs, we have developed a web application for sample size calculation when using a variety of popular multiple comparison corrections. Furthermore, the application supports sample size calculation to control several varieties of power, as well as the determination of optimised arm-wise allocation ratios. It is built using the Shiny package in the R programming language, is free to access on any device with an internet browser, and requires no programming knowledge to use. It incorporates a variety of features to make it easier to use, including help boxes and warning messages. Using design parameters motivated by a recently completed phase II oncology trial, we demonstrate that the application can effectively determine and evaluate complex multi-arm trial designs.

Conclusions

The application provides the core information required by statisticians and clinicians to review the operating characteristics of a chosen multi-arm clinical trial design. The range of designs supported by the application is broader than other currently available software solutions. Its primary limitation, particularly from a regulatory agency point of view, is its lack of validation. However, we present an approach to efficiently confirming its results via simulation.
Appendix
Available only for authorised users
Literature
1.
go back to reference JA DiMasi, HG Grabowski, RW Hansen, Innovation in the pharmaceutical industry: new estimates of R&D costs. J Health Econ. 47:, 20–33 (2016).CrossRef JA DiMasi, HG Grabowski, RW Hansen, Innovation in the pharmaceutical industry: new estimates of R&D costs. J Health Econ. 47:, 20–33 (2016).CrossRef
2.
go back to reference Biotechnology Innovation Organization (BIO), Biomedtracker, AMPLION, Clinical development success rates 2006-2015 (2016). Biotechnology Innovation Organization (BIO), Biomedtracker, AMPLION, Clinical development success rates 2006-2015 (2016).
3.
go back to reference MKB Parmar, J Carpenter, MR Sydes, More multiarm randomised trials of superiority are needed. Lancet. 384(9940), 283–4 (2014).CrossRef MKB Parmar, J Carpenter, MR Sydes, More multiarm randomised trials of superiority are needed. Lancet. 384(9940), 283–4 (2014).CrossRef
4.
go back to reference T Jaki, JMS Wason, Multi-arm multi-stage trials can improve the efficiency of finding effective treatments for stroke: a case study. BMC Cardiovasc Disord. 18(1), 215 (2018).CrossRef T Jaki, JMS Wason, Multi-arm multi-stage trials can improve the efficiency of finding effective treatments for stroke: a case study. BMC Cardiovasc Disord. 18(1), 215 (2018).CrossRef
5.
go back to reference JMS Wason, L Stecher, AP Mander, Correcting for multiple-testing in multi-arm trials: is it necessary and is it done?Trials. 15:, 364 (2014).CrossRef JMS Wason, L Stecher, AP Mander, Correcting for multiple-testing in multi-arm trials: is it necessary and is it done?Trials. 15:, 364 (2014).CrossRef
6.
go back to reference G Baron, E Perrodeau, I Boutron, P Ravaud, Reporting of analyses from randomized controlled trials with multiple arms: a systematic review. BMC Med. 11:, 84 (2013).CrossRef G Baron, E Perrodeau, I Boutron, P Ravaud, Reporting of analyses from randomized controlled trials with multiple arms: a systematic review. BMC Med. 11:, 84 (2013).CrossRef
7.
go back to reference E Juszczak, DG Altman, S Hopewell, K Schulz, Reporting of multi-arm parallel-group randomized trials: extension of the CONSORT 2010 statement. JAMA. 321(16), 1610–20 (2019).CrossRef E Juszczak, DG Altman, S Hopewell, K Schulz, Reporting of multi-arm parallel-group randomized trials: extension of the CONSORT 2010 statement. JAMA. 321(16), 1610–20 (2019).CrossRef
8.
go back to reference KJ Rothman, No adjustments are needed for multiple comparisons. Epidemiology. 1(1), 43–6 (1990).CrossRef KJ Rothman, No adjustments are needed for multiple comparisons. Epidemiology. 1(1), 43–6 (1990).CrossRef
9.
go back to reference RJ Cook, VT Farewell, Multiplicity considerations in the design and analysis of clinical trials. J R Stat Soc Ser A. 159(1), 93–110 (1996).CrossRef RJ Cook, VT Farewell, Multiplicity considerations in the design and analysis of clinical trials. J R Stat Soc Ser A. 159(1), 93–110 (1996).CrossRef
10.
go back to reference MA Proschan, MA Waclawiw, Practical guidelines for multiplicity adjustment in clinical trials. Control Clin Trials. 21(6), 527–39 (2000).CrossRef MA Proschan, MA Waclawiw, Practical guidelines for multiplicity adjustment in clinical trials. Control Clin Trials. 21(6), 527–39 (2000).CrossRef
11.
go back to reference R Bender, S Lange, Adjusting for multiple testing - when and how?J Clin Epidemiol. 54(4), 343–349 (2001).CrossRef R Bender, S Lange, Adjusting for multiple testing - when and how?J Clin Epidemiol. 54(4), 343–349 (2001).CrossRef
12.
go back to reference RJ Feise, Do multiple outcome measures require p-value adjustment?,. BMC Med Res Methodol. 2:, 8 (2002).CrossRef RJ Feise, Do multiple outcome measures require p-value adjustment?,. BMC Med Res Methodol. 2:, 8 (2002).CrossRef
13.
go back to reference MD Hughes, Multiplicity in clinical trials. Encycl Biostat. 5:, 3446–51 (2005). MD Hughes, Multiplicity in clinical trials. Encycl Biostat. 5:, 3446–51 (2005).
14.
go back to reference B Freidlin, EL Korn, R Gray, A Martin, Multi-arm clinical trials of new agents: some design considerations. Clin Cancer Res. 14:, 4368–4371 (2008).CrossRef B Freidlin, EL Korn, R Gray, A Martin, Multi-arm clinical trials of new agents: some design considerations. Clin Cancer Res. 14:, 4368–4371 (2008).CrossRef
15.
go back to reference G Li, M Taljaard, ER Van den Heuvel, MAH Levine, DJ Cook, GA Wells, PJ Devereaux, L Thabane, An introduction to multiplicity issues in clinical trials: the what, why, when and how. Int J Epidemiol. 46(2), 746–55 (2016). G Li, M Taljaard, ER Van den Heuvel, MAH Levine, DJ Cook, GA Wells, PJ Devereaux, L Thabane, An introduction to multiplicity issues in clinical trials: the what, why, when and how. Int J Epidemiol. 46(2), 746–55 (2016).
18.
go back to reference DR Howard, JM Brown, S Todd, WM Gregory, Recommendations on multiple testing adjustment in multi-arm trials with a shared control group. Stat Methods Med Res. 27(5), 1513–30 (2018).CrossRef DR Howard, JM Brown, S Todd, WM Gregory, Recommendations on multiple testing adjustment in multi-arm trials with a shared control group. Stat Methods Med Res. 27(5), 1513–30 (2018).CrossRef
19.
go back to reference Y Hochberg, AC Tamhane, Multiple Comparison Procedures (Wiley, New York, 1987).CrossRef Y Hochberg, AC Tamhane, Multiple Comparison Procedures (Wiley, New York, 1987).CrossRef
21.
go back to reference F Bretz, T Hothorn, P Westfall, Multiple Comparisons using R (CRC Press, Boca Raton, 2010). F Bretz, T Hothorn, P Westfall, Multiple Comparisons using R (CRC Press, Boca Raton, 2010).
22.
go back to reference AJ Sankoh, RBS D’Agostino, MF Huque, Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues. Stat Med. 22(20), 3133–50 (2003).CrossRef AJ Sankoh, RBS D’Agostino, MF Huque, Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues. Stat Med. 22(20), 3133–50 (2003).CrossRef
23.
go back to reference A Atkinson, A Donev, R Tobias, Optimum Experimental Designs, with SAS (Oxford University Press, Oxford, 2007). A Atkinson, A Donev, R Tobias, Optimum Experimental Designs, with SAS (Oxford University Press, Oxford, 2007).
27.
go back to reference CE Bonferroni, Teoria statistica delle classi e calcolo delle probabilità. Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commerciali di Firenze. 8:, 3–62 (1936). CE Bonferroni, Teoria statistica delle classi e calcolo delle probabilità. Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commerciali di Firenze. 8:, 3–62 (1936).
28.
go back to reference Z Šidák, Rectangular confidence regions for the means of multivariate normal distributions. J Am Stat Assoc. 62(318), 626–33 (1967). Z Šidák, Rectangular confidence regions for the means of multivariate normal distributions. J Am Stat Assoc. 62(318), 626–33 (1967).
29.
go back to reference CW Dunnett, A multiple comparison procedure for comparing several treatments with a control. J Am Stat Assoc. 50(272), 1096–121 (1955).CrossRef CW Dunnett, A multiple comparison procedure for comparing several treatments with a control. J Am Stat Assoc. 50(272), 1096–121 (1955).CrossRef
30.
go back to reference S Holm, A simple sequentially rejective multiple test procedure. Scand J Stat. 6(2), 65–70 (1979). S Holm, A simple sequentially rejective multiple test procedure. Scand J Stat. 6(2), 65–70 (1979).
31.
go back to reference Y Hochberg, A sharper bonferroni procedure for multiple tests of significance. Biometrika. 75(4), 800–2 (1988).CrossRef Y Hochberg, A sharper bonferroni procedure for multiple tests of significance. Biometrika. 75(4), 800–2 (1988).CrossRef
32.
go back to reference Y Benjamini, Y Hochberg, Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 57(1), 289–300 (1995). Y Benjamini, Y Hochberg, Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 57(1), 289–300 (1995).
33.
go back to reference Y Benjamini, D Yekutieli, The control of the false discovery rate in multiple testing under dependency. Annals Stat. 29(4), 1165–88 (1995). Y Benjamini, D Yekutieli, The control of the false discovery rate in multiple testing under dependency. Annals Stat. 29(4), 1165–88 (1995).
34.
go back to reference J Wason, D Magirr, M Law, T Jaki, Some recommendations for multi-arm multi-stage trials. Stat Methods Med Res. 25(2), 716–27 (2016).CrossRef J Wason, D Magirr, M Law, T Jaki, Some recommendations for multi-arm multi-stage trials. Stat Methods Med Res. 25(2), 716–27 (2016).CrossRef
35.
go back to reference O Sverdlov, WF Rosenberger, On recent advances in optimal allocation designs in clinical trials. J Stat Theory Pract. 7(4), 753–73 (2013).CrossRef O Sverdlov, WF Rosenberger, On recent advances in optimal allocation designs in clinical trials. J Stat Theory Pract. 7(4), 753–73 (2013).CrossRef
37.
go back to reference L Jacob, U M, S Boulet, I Begaj, S Chevret, Evaluation of a multi-arm multi-stage Bayesian design for phase II drug selection trials - an example in hemato-oncology. BMC Med Res Methodol. 16:, 67 (2016).CrossRef L Jacob, U M, S Boulet, I Begaj, S Chevret, Evaluation of a multi-arm multi-stage Bayesian design for phase II drug selection trials - an example in hemato-oncology. BMC Med Res Methodol. 16:, 67 (2016).CrossRef
45.
go back to reference S Chow, H Wang, J Shao, Sample Size Calculations in Clinical Research (Chapman & Hall, Boca Raton, 2008). S Chow, H Wang, J Shao, Sample Size Calculations in Clinical Research (Chapman & Hall, Boca Raton, 2008).
46.
go back to reference GM Wheeler, MJ Sweeting, AP Mander, AplusB: A Web Application for Investigating A + B Designs for Phase I Cancer Clinical Trials. PLoS ONE. 11(7), 0159026 (2016).CrossRef GM Wheeler, MJ Sweeting, AP Mander, AplusB: A Web Application for Investigating A + B Designs for Phase I Cancer Clinical Trials. PLoS ONE. 11(7), 0159026 (2016).CrossRef
47.
go back to reference NA Wages, GR Petroni, A web tool for designing and conducting phase I trials using the continual reassessment method. BMC Cancer. 18:, 133 (2018).CrossRef NA Wages, GR Petroni, A web tool for designing and conducting phase I trials using the continual reassessment method. BMC Cancer. 18:, 133 (2018).CrossRef
48.
go back to reference D Magirr, T Jaki, J Whitehead, A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection. Biometrika. 99(2), 494–501 (2012).CrossRef D Magirr, T Jaki, J Whitehead, A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection. Biometrika. 99(2), 494–501 (2012).CrossRef
49.
go back to reference J Wason, N Stallard, J Bowden, C Jennison, A multi-stage drop-the-losers design for multi-arm clinical trials. Stat Methods Med Res. 26(1), 508–24 (2017).CrossRef J Wason, N Stallard, J Bowden, C Jennison, A multi-stage drop-the-losers design for multi-arm clinical trials. Stat Methods Med Res. 26(1), 508–24 (2017).CrossRef
50.
go back to reference FMS Barthel, P Royston, MKB Parmar, A menu-driven facility for sample-size calculation in novel multiarm, multistage randomized controlled trials with a time-to-event outcome. Stata J. 9(4), 505–23 (2009).CrossRef FMS Barthel, P Royston, MKB Parmar, A menu-driven facility for sample-size calculation in novel multiarm, multistage randomized controlled trials with a time-to-event outcome. Stata J. 9(4), 505–23 (2009).CrossRef
51.
go back to reference T Jaki, P Pallmann, D Magirr, The R package MAMS for designing multi-arm multi-stage clinical trials. J Stat Softw. 88(4), 1–25 (2019).CrossRef T Jaki, P Pallmann, D Magirr, The R package MAMS for designing multi-arm multi-stage clinical trials. J Stat Softw. 88(4), 1–25 (2019).CrossRef
52.
go back to reference M Dimairo, E Coates, P Pallmann, S Todd, SA Julious, T Jaki, J Wason, AP Mander, CJ Weir, F Koenig, MK Walton, K Biggs, J Nicholl, T Hamasaki, MA Proschan, JA Scott, Y Ando, D Hind, DG Altman, Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design. BMC Med. 16:, 210 (2018).CrossRef M Dimairo, E Coates, P Pallmann, S Todd, SA Julious, T Jaki, J Wason, AP Mander, CJ Weir, F Koenig, MK Walton, K Biggs, J Nicholl, T Hamasaki, MA Proschan, JA Scott, Y Ando, D Hind, DG Altman, Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design. BMC Med. 16:, 210 (2018).CrossRef
Metadata
Title
A web application for the design of multi-arm clinical trials
Authors
Michael J. Grayling
James MS. Wason
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2020
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/s12885-020-6525-0

Other articles of this Issue 1/2020

BMC Cancer 1/2020 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine