Skip to main content
Top
Published in: BMC Medicine 1/2022

Open Access 01-12-2022 | Correspondence

Practical guidance for planning resources required to support publicly-funded adaptive clinical trials

Authors: James M. S. Wason, Munyaradzi Dimairo, Katie Biggs, Sarah Bowden, Julia Brown, Laura Flight, Jamie Hall, Thomas Jaki, Rachel Lowe, Philip Pallmann, Mark A. Pilling, Claire Snowdon, Matthew R. Sydes, Sofía S. Villar, Christopher J. Weir, Nina Wilson, Christina Yap, Helen Hancock, Rebecca Maier

Published in: BMC Medicine | Issue 1/2022

Login to get access

Abstract

Adaptive designs are a class of methods for improving efficiency and patient benefit of clinical trials. Although their use has increased in recent years, research suggests they are not used in many situations where they have potential to bring benefit. One barrier to their more widespread use is a lack of understanding about how the choice to use an adaptive design, rather than a traditional design, affects resources (staff and non-staff) required to set-up, conduct and report a trial. The Costing Adaptive Trials project investigated this issue using quantitative and qualitative research amongst UK Clinical Trials Units. Here, we present guidance that is informed by our research, on considering the appropriate resourcing of adaptive trials. We outline a five-step process to estimate the resources required and provide an accompanying costing tool. The process involves understanding the tasks required to undertake a trial, and how the adaptive design affects them. We identify barriers in the publicly funded landscape and provide recommendations to trial funders that would address them. Although our guidance and recommendations are most relevant to UK non-commercial trials, many aspects are relevant more widely.
Appendix
Available only for authorised users
Literature
1.
go back to reference DiMasi JA, Grabowski HG, Hansen RW. Innovation in the pharmaceutical industry: New estimates of R&D costs. J Health Econ. 2016;47:20–33.CrossRef DiMasi JA, Grabowski HG, Hansen RW. Innovation in the pharmaceutical industry: New estimates of R&D costs. J Health Econ. 2016;47:20–33.CrossRef
2.
go back to reference Bentley C, Cressman S, van der Hoek K, Arts K, Dancey J, Peacock S. Conducting clinical trials—costs, impacts, and the value of clinical trials networks: A scoping review. Clin Trials. 2019;16:183–93.CrossRef Bentley C, Cressman S, van der Hoek K, Arts K, Dancey J, Peacock S. Conducting clinical trials—costs, impacts, and the value of clinical trials networks: A scoping review. Clin Trials. 2019;16:183–93.CrossRef
4.
go back to reference Burnett T, Mozgunov P, Pallmann P, Villar SS, Wheeler GM, Jaki T. Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs. BMC Med. 2020;18:352.CrossRef Burnett T, Mozgunov P, Pallmann P, Villar SS, Wheeler GM, Jaki T. Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs. BMC Med. 2020;18:352.CrossRef
5.
go back to reference Gallo P. Operational challenges in adaptive design implementation. Pharm Stat. 2006;5:119–24.CrossRef Gallo P. Operational challenges in adaptive design implementation. Pharm Stat. 2006;5:119–24.CrossRef
6.
go back to reference Gallo P. Confidentiality and Trial Integrity Issues for Adaptive Designs. Drug Inf J. 2006;40:445–50.CrossRef Gallo P. Confidentiality and Trial Integrity Issues for Adaptive Designs. Drug Inf J. 2006;40:445–50.CrossRef
7.
go back to reference Wilson N, Biggs K, Bowden S, Brown J, Dimairo M, Flight L, et al. Costs and staffing resource requirements for adaptive clinical trials: quantitative and qualitative results from the Costing Adaptive Trials project. BMC Med. 2021;19:251.CrossRef Wilson N, Biggs K, Bowden S, Brown J, Dimairo M, Flight L, et al. Costs and staffing resource requirements for adaptive clinical trials: quantitative and qualitative results from the Costing Adaptive Trials project. BMC Med. 2021;19:251.CrossRef
8.
go back to reference Martin L, Hutchens M, Hawkins C, Radnov A. How much do clinical trials cost? Nat Rev Drug Discov. 2017;16:381–2.CrossRef Martin L, Hutchens M, Hawkins C, Radnov A. How much do clinical trials cost? Nat Rev Drug Discov. 2017;16:381–2.CrossRef
9.
go back to reference Park JJH, Siden E, Zoratti MJ, Dron L, Harari O, Singer J, et al. Systematic review of basket trials, umbrella trials, and platform trials: a landscape analysis of master protocols. Trials. 2019;20:572.CrossRef Park JJH, Siden E, Zoratti MJ, Dron L, Harari O, Singer J, et al. Systematic review of basket trials, umbrella trials, and platform trials: a landscape analysis of master protocols. Trials. 2019;20:572.CrossRef
10.
go back to reference Saaiq M, Ashraf B. Modifying, “Pico” Question into “Picos” Model for More Robust and Reproducible Presentation of the Methodology Employed in A Scientific Study. World J Plast Surg. 2017;6:390–2.PubMedPubMedCentral Saaiq M, Ashraf B. Modifying, “Pico” Question into “Picos” Model for More Robust and Reproducible Presentation of the Methodology Employed in A Scientific Study. World J Plast Surg. 2017;6:390–2.PubMedPubMedCentral
11.
go back to reference Wason JMS, Brocklehurst P, Yap C. When to keep it simple – adaptive designs are not always useful. BMC Med. 2019;17:152.CrossRef Wason JMS, Brocklehurst P, Yap C. When to keep it simple – adaptive designs are not always useful. BMC Med. 2019;17:152.CrossRef
12.
go back to reference Wason JMS, Trippa L. A comparison of Bayesian adaptive randomization and multi-stage designs for multi-arm clinical trials. Stat Med. 2014;33:2206–21.CrossRef Wason JMS, Trippa L. A comparison of Bayesian adaptive randomization and multi-stage designs for multi-arm clinical trials. Stat Med. 2014;33:2206–21.CrossRef
13.
go back to reference Grieve AP. Response-adaptive clinical trials: case studies in the medical literature. Pharm Stat. 2017;16:64–86.CrossRef Grieve AP. Response-adaptive clinical trials: case studies in the medical literature. Pharm Stat. 2017;16:64–86.CrossRef
14.
go back to reference Wason JMS, Jaki T. Optimal design of multi-arm multi-stage trials. Stat Med. 2012;31:4269–79.CrossRef Wason JMS, Jaki T. Optimal design of multi-arm multi-stage trials. Stat Med. 2012;31:4269–79.CrossRef
15.
go back to reference Wason J, Stallard N, Bowden J, Jennison C. A multi-stage drop-the-losers design for multi-arm clinical trials. Stat Methods Med Res. 2017;26:508–24.CrossRef Wason J, Stallard N, Bowden J, Jennison C. A multi-stage drop-the-losers design for multi-arm clinical trials. Stat Methods Med Res. 2017;26:508–24.CrossRef
16.
go back to reference Park JJH, Harari O, Dron L, Lester RT, Thorlund K, Mills EJ. An overview of platform trials with a checklist for clinical readers. J Clin Epidemiol. 2020;125:1–8.CrossRef Park JJH, Harari O, Dron L, Lester RT, Thorlund K, Mills EJ. An overview of platform trials with a checklist for clinical readers. J Clin Epidemiol. 2020;125:1–8.CrossRef
17.
go back to reference Brown S, Nixon J, Ransom M, Gilberts R, Dewhirst N, McGinnis E, et al. Multiple Interventions for Diabetic Foot Ulcer Treatment Trial (MIDFUT): study protocol for a randomised controlled trial. BMJ Open. 2020;10: e035947.CrossRef Brown S, Nixon J, Ransom M, Gilberts R, Dewhirst N, McGinnis E, et al. Multiple Interventions for Diabetic Foot Ulcer Treatment Trial (MIDFUT): study protocol for a randomised controlled trial. BMJ Open. 2020;10: e035947.CrossRef
18.
go back to reference Day SJ. Statistics Notes: Blinding in clinical trials and other studies. BMJ. 2000;321:504–504.CrossRef Day SJ. Statistics Notes: Blinding in clinical trials and other studies. BMJ. 2000;321:504–504.CrossRef
20.
go back to reference Thorn JC, Davies CF, Brookes ST, Noble SM, Dritsaki M, Gray E, et al. Content of Health Economics Analysis Plans (HEAPs) for Trial-Based Economic Evaluations: Expert Delphi Consensus Survey. Value Health. 2021;24:539–47.CrossRef Thorn JC, Davies CF, Brookes ST, Noble SM, Dritsaki M, Gray E, et al. Content of Health Economics Analysis Plans (HEAPs) for Trial-Based Economic Evaluations: Expert Delphi Consensus Survey. Value Health. 2021;24:539–47.CrossRef
21.
go back to reference Schiavone F, Bathia R, Letchemanan K, Masters L, Amos C, Bara A, et al. This is a platform alteration: A trial management perspective on the operational aspects of adaptive and platform and umbrella protocols. Trials. 2019;20:264.CrossRef Schiavone F, Bathia R, Letchemanan K, Masters L, Amos C, Bara A, et al. This is a platform alteration: A trial management perspective on the operational aspects of adaptive and platform and umbrella protocols. Trials. 2019;20:264.CrossRef
22.
go back to reference Hague D, Townsend S, Masters L, Rauchenberger M, Van Looy N, Diaz-Montana C, et al. Changing platforms without stopping the train: experiences of data management and data management systems when adapting platform protocols by adding and closing comparisons. Trials. 2019;20:294.CrossRef Hague D, Townsend S, Masters L, Rauchenberger M, Van Looy N, Diaz-Montana C, et al. Changing platforms without stopping the train: experiences of data management and data management systems when adapting platform protocols by adding and closing comparisons. Trials. 2019;20:294.CrossRef
23.
go back to reference Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, et al. The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. BMJ. 2020;369: m115.CrossRef Dimairo M, Pallmann P, Wason J, Todd S, Jaki T, Julious SA, et al. The Adaptive designs CONSORT Extension (ACE) statement: a checklist with explanation and elaboration guideline for reporting randomised trials that use an adaptive design. BMJ. 2020;369: m115.CrossRef
24.
go back to reference Robertson DS, Choodari-Oskooei B, Dimairo M, Flight L, Pallmann P, Jaki T. Point estimation for adaptive trial designs. ArXiv210508836 Stat. 2021. Robertson DS, Choodari-Oskooei B, Dimairo M, Flight L, Pallmann P, Jaki T. Point estimation for adaptive trial designs. ArXiv210508836 Stat. 2021.
25.
go back to reference Flight L, Julious S, Brennan A, Todd S, Hind D. How can health economics be used in the design and analysis of adaptive clinical trials? A qualitative analysis. Trials. 2020;21:252.CrossRef Flight L, Julious S, Brennan A, Todd S, Hind D. How can health economics be used in the design and analysis of adaptive clinical trials? A qualitative analysis. Trials. 2020;21:252.CrossRef
26.
go back to reference Laura Flight. The use of health economics in the design and analysis of adaptive clinical trials (PhD Thesis). 2020. Laura Flight. The use of health economics in the design and analysis of adaptive clinical trials (PhD Thesis). 2020.
27.
go back to reference Macdougall J. Analysis of Dose--Response Studies---Emax Model. In: Dose Finding in Drug Development. New York: Springer New York; 2006. p. 127–45. Macdougall J. Analysis of Dose--Response Studies---Emax Model. In: Dose Finding in Drug Development. New York: Springer New York; 2006. p. 127–45.
29.
go back to reference Herbert E, Julious SA, Goodacre S. Progression criteria in trials with an internal pilot: an audit of publicly funded randomised controlled trials. Trials. 2019;20:493.CrossRef Herbert E, Julious SA, Goodacre S. Progression criteria in trials with an internal pilot: an audit of publicly funded randomised controlled trials. Trials. 2019;20:493.CrossRef
30.
go back to reference Fenwick E, Steuten L, Knies S, Ghabri S, Basu A, Murray JF, et al. Value of Information Analysis for Research Decisions—An Introduction: Report 1 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force. Value Health. 2020;23:139–50.CrossRef Fenwick E, Steuten L, Knies S, Ghabri S, Basu A, Murray JF, et al. Value of Information Analysis for Research Decisions—An Introduction: Report 1 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force. Value Health. 2020;23:139–50.CrossRef
31.
go back to reference Rothery C, Strong M, Koffijberg H (Erik), Basu A, Ghabri S, Knies S, et al. Value of Information Analytical Methods: Report 2 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force. Value Health. 2020;23:277–86. Rothery C, Strong M, Koffijberg H (Erik), Basu A, Ghabri S, Knies S, et al. Value of Information Analytical Methods: Report 2 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force. Value Health. 2020;23:277–86.
32.
go back to reference Flight L, Arshad F, Barnsley R, Patel K, Julious S, Brennan A, et al. A Review of Clinical Trials With an Adaptive Design and Health Economic Analysis. Value Health J Int Soc Pharmacoecon Outcomes Res. 2019;22:391–8.CrossRef Flight L, Arshad F, Barnsley R, Patel K, Julious S, Brennan A, et al. A Review of Clinical Trials With an Adaptive Design and Health Economic Analysis. Value Health J Int Soc Pharmacoecon Outcomes Res. 2019;22:391–8.CrossRef
33.
go back to reference Mohiuddin S, Fenwick E, Payne K. Use of value of information in UK health technology assessments. Int J Technol Assess Health Care. 2014;30:553–70.CrossRef Mohiuddin S, Fenwick E, Payne K. Use of value of information in UK health technology assessments. Int J Technol Assess Health Care. 2014;30:553–70.CrossRef
34.
go back to reference Chick S, Forster M, Pertile P. A Bayesian decision theoretic model of sequential experimentation with delayed response. J R Stat Soc Ser B Stat Methodol. 2017;79:1439–62.CrossRef Chick S, Forster M, Pertile P. A Bayesian decision theoretic model of sequential experimentation with delayed response. J R Stat Soc Ser B Stat Methodol. 2017;79:1439–62.CrossRef
35.
go back to reference Flight L, Julious S, Brennan A, Todd S. Expected Value of Sample Information to Guide the Design of Group Sequential Clinical Trials. Med Decis Making. 2021;:0272989X2110450. Flight L, Julious S, Brennan A, Todd S. Expected Value of Sample Information to Guide the Design of Group Sequential Clinical Trials. Med Decis Making. 2021;:0272989X2110450.
36.
go back to reference Blagden SP, Billingham L, Brown LC, Buckland SW, Cooper AM, Ellis S, et al. Effective delivery of Complex Innovative Design (CID) cancer trials—a consensus statement. Br J Cancer. 2020;122:473–82.CrossRef Blagden SP, Billingham L, Brown LC, Buckland SW, Cooper AM, Ellis S, et al. Effective delivery of Complex Innovative Design (CID) cancer trials—a consensus statement. Br J Cancer. 2020;122:473–82.CrossRef
38.
go back to reference Thorlund K, Haggstrom J, Park JJ, Mills EJ. Key design considerations for adaptive clinical trials: a primer for clinicians. BMJ. 2018;360: k698.CrossRef Thorlund K, Haggstrom J, Park JJ, Mills EJ. Key design considerations for adaptive clinical trials: a primer for clinicians. BMJ. 2018;360: k698.CrossRef
39.
go back to reference Jaki T. Uptake of novel statistical methods for early-phase clinical studies in the UK public sector. Clin Trials. 2013;10:344–6.CrossRef Jaki T. Uptake of novel statistical methods for early-phase clinical studies in the UK public sector. Clin Trials. 2013;10:344–6.CrossRef
40.
go back to reference Dimairo M, Boote J, Julious SA, Nicholl JP, Todd S. Missing steps in a staircase: A qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials. 2015;16:1–16.CrossRef Dimairo M, Boote J, Julious SA, Nicholl JP, Todd S. Missing steps in a staircase: A qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials. 2015;16:1–16.CrossRef
41.
go back to reference Speich B, Gloy V, Schur N, Ewald H, Hemkens LG, Schwenkglenks M, et al. A scoping review shows that several nonvalidated budget planning tools for randomized trials are available. J Clin Epidemiol. 2020;117:9–19.CrossRef Speich B, Gloy V, Schur N, Ewald H, Hemkens LG, Schwenkglenks M, et al. A scoping review shows that several nonvalidated budget planning tools for randomized trials are available. J Clin Epidemiol. 2020;117:9–19.CrossRef
42.
go back to reference Speich B, von Niederhäusern B, Blum CA, Keiser J, Schur N, Fürst T, et al. Retrospective assessment of resource use and costs in two investigator-initiated randomized trials exemplified a comprehensive cost item list. J Clin Epidemiol. 2018;96:73–83.CrossRef Speich B, von Niederhäusern B, Blum CA, Keiser J, Schur N, Fürst T, et al. Retrospective assessment of resource use and costs in two investigator-initiated randomized trials exemplified a comprehensive cost item list. J Clin Epidemiol. 2018;96:73–83.CrossRef
43.
go back to reference Speich B, von Niederhäusern B, Schur N, Hemkens LG, Fürst T, Bhatnagar N, et al. Systematic review on costs and resource use of randomized clinical trials shows a lack of transparent and comprehensive data. J Clin Epidemiol. 2018;96:1–11.CrossRef Speich B, von Niederhäusern B, Schur N, Hemkens LG, Fürst T, Bhatnagar N, et al. Systematic review on costs and resource use of randomized clinical trials shows a lack of transparent and comprehensive data. J Clin Epidemiol. 2018;96:1–11.CrossRef
44.
go back to reference Emerson SC, Rudser KD, Emerson SS. Exploring the benefits of adaptive sequential designs in time-to-event endpoint settings. Stat Med. 2011;30:1199–217.CrossRef Emerson SC, Rudser KD, Emerson SS. Exploring the benefits of adaptive sequential designs in time-to-event endpoint settings. Stat Med. 2011;30:1199–217.CrossRef
45.
go back to reference Mahlich J, Bartol A, Dheban S. Can adaptive clinical trials help to solve the productivity crisis of the pharmaceutical industry? - a scenario analysis. Health Econ Rev. 2021;11:4.CrossRef Mahlich J, Bartol A, Dheban S. Can adaptive clinical trials help to solve the productivity crisis of the pharmaceutical industry? - a scenario analysis. Health Econ Rev. 2021;11:4.CrossRef
Metadata
Title
Practical guidance for planning resources required to support publicly-funded adaptive clinical trials
Authors
James M. S. Wason
Munyaradzi Dimairo
Katie Biggs
Sarah Bowden
Julia Brown
Laura Flight
Jamie Hall
Thomas Jaki
Rachel Lowe
Philip Pallmann
Mark A. Pilling
Claire Snowdon
Matthew R. Sydes
Sofía S. Villar
Christopher J. Weir
Nina Wilson
Christina Yap
Helen Hancock
Rebecca Maier
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2022
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-022-02445-7

Other articles of this Issue 1/2022

BMC Medicine 1/2022 Go to the issue