Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Research

How can health economics be used in the design and analysis of adaptive clinical trials? A qualitative analysis

Authors: Laura Flight, Steven Julious, Alan Brennan, Susan Todd, Daniel Hind

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Introduction

Adaptive designs offer a flexible approach, allowing changes to a trial based on examinations of the data as it progresses. Adaptive clinical trials are becoming a popular choice, as the prudent use of finite research budgets and accurate decision-making are priorities for healthcare providers around the world. The methods of health economics, which aim to maximise the health gained for money spent, could be incorporated into the design and analysis of adaptive clinical trials to make them more efficient. We aimed to understand the perspectives of stakeholders in health technology assessments to inform recommendations for the use of health economics in adaptive clinical trials.

Methods

A qualitative study explored the attitudes of key stakeholders—including researchers, decision-makers and members of the public—towards the use of health economics in the design and analysis of adaptive clinical trials. Data were collected using interviews and focus groups (29 participants). A framework analysis was used to identify themes in the transcripts.

Results

It was considered that answering the clinical research question should be the priority in a clinical trial, notwithstanding the importance of cost-effectiveness for decision-making. Concerns raised by participants included handling the volatile nature of cost data at interim analyses; implementing this approach in global trials; resourcing adaptive trials which are designed and adapted based on health economic outcomes; and training stakeholders in these methods so that they can be implemented and appropriately interpreted.

Conclusion

The use of health economics in the design and analysis of adaptive clinical trials has the potential to increase the efficiency of health technology assessments worldwide. Recommendations are made concerning the development of methods allowing the use of health economics in adaptive clinical trials, and suggestions are given to facilitate their implementation in practice.
Appendix
Available only for authorised users
Literature
3.
go back to reference Australian Government: Department of Health and Ageing. Guidelines for preparing submissions to the Pharmaceutical Benefits Advisory Committee (Version 4.3). Technical report. 2008. https://pbac.pbs.gov.au/. Australian Government: Department of Health and Ageing. Guidelines for preparing submissions to the Pharmaceutical Benefits Advisory Committee (Version 4.3). Technical report. 2008. https://​pbac.​pbs.​gov.​au/​.
4.
go back to reference Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015.
6.
go back to reference Strong M, Oakley JE, Brennan A, Breeze P. Estimating the expected value of sample information using the probabilistic sensitivity analysis sample: a fast, nonparametric regression-based method. Med Dec Making. 2015; 35(5):570–83.CrossRef Strong M, Oakley JE, Brennan A, Breeze P. Estimating the expected value of sample information using the probabilistic sensitivity analysis sample: a fast, nonparametric regression-based method. Med Dec Making. 2015; 35(5):570–83.CrossRef
7.
go back to reference Bauer P, Brannath W. The advantages and disadvantages of adaptive designs for clinical trials. Drug Discov Today. 2004; 9(8):351–7.PubMedCrossRef Bauer P, Brannath W. The advantages and disadvantages of adaptive designs for clinical trials. Drug Discov Today. 2004; 9(8):351–7.PubMedCrossRef
9.
go back to reference Jennison C, Turnbull BW. Group sequential methods with applications to clinical trials. Boca Raton: Chapman and Hall/CRC; 2000. Jennison C, Turnbull BW. Group sequential methods with applications to clinical trials. Boca Raton: Chapman and Hall/CRC; 2000.
11.
go back to reference Flight L, Arshad F, Barnsley R, Patel K, Julious S, Brennan A, Todd S. A review of clinical trials with an adaptive design and health economic analysis. Value Health. 2019; 22(4):391–8.PubMedCrossRef Flight L, Arshad F, Barnsley R, Patel K, Julious S, Brennan A, Todd S. A review of clinical trials with an adaptive design and health economic analysis. Value Health. 2019; 22(4):391–8.PubMedCrossRef
12.
go back to reference Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. Thousand Oaks: SAGE Publications; 2013. Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. Thousand Oaks: SAGE Publications; 2013.
16.
go back to reference Clarke V, Braun V. Successful qualitative research: a practical guide for beginners. London: SAGE Publications Inc.; 2013. Clarke V, Braun V. Successful qualitative research: a practical guide for beginners. London: SAGE Publications Inc.; 2013.
17.
go back to reference Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Fam Health Int. 2006; 18(1):59–82. Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Fam Health Int. 2006; 18(1):59–82.
18.
go back to reference Pope C, Mays N. Qualitative research in health care, 2nd ed. Oxford: BMJ Publishing; 2000. Pope C, Mays N. Qualitative research in health care, 2nd ed. Oxford: BMJ Publishing; 2000.
19.
go back to reference Creswell JW, Hanson WE, Clark Plano VL, Morales A. Qualitative research designs: selection and implementation. Couns Psychol. 2007; 35(2):236–64.CrossRef Creswell JW, Hanson WE, Clark Plano VL, Morales A. Qualitative research designs: selection and implementation. Couns Psychol. 2007; 35(2):236–64.CrossRef
20.
21.
go back to reference Francis JJ, Johnston M, Robertson C, Glidewell L, Entwistle V, Eccles MP, Grimshaw JM. What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychol Health. 2010; 25(10):1229–45.PubMedCrossRef Francis JJ, Johnston M, Robertson C, Glidewell L, Entwistle V, Eccles MP, Grimshaw JM. What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychol Health. 2010; 25(10):1229–45.PubMedCrossRef
22.
go back to reference Ritchie J, Spencer L. Qualitative data analysis for applied policy research. Analysing Qual Data. 1993:;173–94. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. Analysing Qual Data. 1993:;173–94.
23.
go back to reference Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research,. BMC Med Res Methodol. 2013; 13(1):117.PubMedPubMedCentralCrossRef Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research,. BMC Med Res Methodol. 2013; 13(1):117.PubMedPubMedCentralCrossRef
24.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007; 19(6):349–57.PubMedCrossRef Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007; 19(6):349–57.PubMedCrossRef
25.
go back to reference Beauchamp TL, Childress JF, et al.Principles of biomedical ethics. Oxford: Oxford University Press; 2001. Beauchamp TL, Childress JF, et al.Principles of biomedical ethics. Oxford: Oxford University Press; 2001.
26.
go back to reference Rawls J. A theory of justice. Cambridge: Belknap; 1971. Rawls J. A theory of justice. Cambridge: Belknap; 1971.
27.
30.
go back to reference Chow S-C, Corey R, Lin M. On the independence of data monitoring committee in adaptive design clinical trials,. J Biopharm Stat. 2012; 22(4):853–67.PubMedCrossRef Chow S-C, Corey R, Lin M. On the independence of data monitoring committee in adaptive design clinical trials,. J Biopharm Stat. 2012; 22(4):853–67.PubMedCrossRef
31.
go back to reference Whitehead J. The design and analysis of sequential clinical trials. Chichester: Wiley; 1997.CrossRef Whitehead J. The design and analysis of sequential clinical trials. Chichester: Wiley; 1997.CrossRef
32.
go back to reference Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, Holmes J, Mander AP, Sydes MR, Villar SS, et al.Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med. 2018; 16(1):29.PubMedPubMedCentralCrossRef Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, Hampson LV, Holmes J, Mander AP, Sydes MR, Villar SS, et al.Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med. 2018; 16(1):29.PubMedPubMedCentralCrossRef
33.
go back to reference Bothwell LE, Avorn J, Khan NF, Kesselheim AS. Adaptive design clinical trials: a review of the literature and ClinicalTrials. gov. BMJ Open. 2018; 8(2):018320.CrossRef Bothwell LE, Avorn J, Khan NF, Kesselheim AS. Adaptive design clinical trials: a review of the literature and ClinicalTrials. gov. BMJ Open. 2018; 8(2):018320.CrossRef
34.
go back to reference Mohiuddin S, Fenwick E, Payne K. Use of value of information in UK health technology assessments. Int J Technol Assess Health Care. 2014; 30(6):553–70.PubMedCrossRef Mohiuddin S, Fenwick E, Payne K. Use of value of information in UK health technology assessments. Int J Technol Assess Health Care. 2014; 30(6):553–70.PubMedCrossRef
35.
go back to reference Dimairo M, Coates E, Pallmann P, Todd S, Julious SA, Jaki T, Wason J, Mander AP, Weir CJ, Koenig F, et al.Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design. BMC Med. 2018; 16(1):210.PubMedPubMedCentralCrossRef Dimairo M, Coates E, Pallmann P, Todd S, Julious SA, Jaki T, Wason J, Mander AP, Weir CJ, Koenig F, et al.Development process of a consensus-driven CONSORT extension for randomised trials using an adaptive design. BMC Med. 2018; 16(1):210.PubMedPubMedCentralCrossRef
37.
go back to reference Heath A, Kunst NR, Jackson C, Strong M, Alarid-Escudero F, Goldhaber-Fiebert JD, Baio G, Menzies NA, Jalal H. Calculating the expected value of sample information in practice: considerations from three case studies. arXiv preprint arXiv:1905.12013. 2019. Heath A, Kunst NR, Jackson C, Strong M, Alarid-Escudero F, Goldhaber-Fiebert JD, Baio G, Menzies NA, Jalal H. Calculating the expected value of sample information in practice: considerations from three case studies. arXiv preprint arXiv:1905.12013. 2019.
38.
go back to reference Kunst NR, Wilson E, Alarid-Escudero F, Baio G, Brennan A, Fairley M, Glynn D, Goldhaber-Fiebert JD, Jackson C, Jalal H, et al.Computing the expected value of sample information efficiently: expertise and skills required for four model-based methods. arXiv preprint arXiv:1910.03368. 2019. Kunst NR, Wilson E, Alarid-Escudero F, Baio G, Brennan A, Fairley M, Glynn D, Goldhaber-Fiebert JD, Jackson C, Jalal H, et al.Computing the expected value of sample information efficiently: expertise and skills required for four model-based methods. arXiv preprint arXiv:1910.03368. 2019.
39.
go back to reference DAMOCLES Study Group. A proposed charter for clinical trial data monitoring committees: helping them to do their job well. Lancet. 2005; 365(9460):711–22.CrossRef DAMOCLES Study Group. A proposed charter for clinical trial data monitoring committees: helping them to do their job well. Lancet. 2005; 365(9460):711–22.CrossRef
42.
go back to reference Thorn J, Ridyard C, Hughes D, Wordsworth S, Mihaylova B, Noble SM, Hollingworth W. Health economics analysis plans: the current state of play. Trials. 2017; 18(Suppl 1):P144. Thorn J, Ridyard C, Hughes D, Wordsworth S, Mihaylova B, Noble SM, Hollingworth W. Health economics analysis plans: the current state of play. Trials. 2017; 18(Suppl 1):P144.
43.
go back to reference Forster M, Brealey S, Chick S, Keding A, Corbacho B, Alban A, Rangan A, et al.Cost-effective clinical trial design: application of a Bayesian sequential stopping rule to the ProFHER pragmatic trial. Technical report. 2019. Forster M, Brealey S, Chick S, Keding A, Corbacho B, Alban A, Rangan A, et al.Cost-effective clinical trial design: application of a Bayesian sequential stopping rule to the ProFHER pragmatic trial. Technical report. 2019.
44.
go back to reference Husbands SK. PhD Thesis, Model-building process. University of Birmingham. 2016; (February). Husbands SK. PhD Thesis, Model-building process. University of Birmingham. 2016; (February).
45.
go back to reference Koerkamp B, Nikken J, Oei E, Stijnen T. Value of information analysis used to determine the necessity of additional research: MR imaging in acute knee trauma as an example. Radiology. 2008; 246(2):420–5.CrossRef Koerkamp B, Nikken J, Oei E, Stijnen T. Value of information analysis used to determine the necessity of additional research: MR imaging in acute knee trauma as an example. Radiology. 2008; 246(2):420–5.CrossRef
46.
go back to reference Legocki LJ, Meurer WJ, Frederiksen S, Lewis RJ, Durkalski VL, Berry DA, Barsan WG, Fetters MD. Clinical trialist perspectives on the ethics of adaptive clinical trials: a mixed-methods analysis. BMC Med Ethics. 2015; 16(1):27.PubMedPubMedCentralCrossRef Legocki LJ, Meurer WJ, Frederiksen S, Lewis RJ, Durkalski VL, Berry DA, Barsan WG, Fetters MD. Clinical trialist perspectives on the ethics of adaptive clinical trials: a mixed-methods analysis. BMC Med Ethics. 2015; 16(1):27.PubMedPubMedCentralCrossRef
47.
go back to reference Meurer WJ, Legocki L, Mawocha S, Frederiksen SM, Guetterman TC, Barsan W, et al.Attitudes and opinions regarding confirmatory adaptive clinical trials: a mixed methods analysis from the Adaptive Designs Accelerating Promising Trials into Treatments (ADAPT-IT) project. Trials. 2016; 17(1):373.PubMedPubMedCentralCrossRef Meurer WJ, Legocki L, Mawocha S, Frederiksen SM, Guetterman TC, Barsan W, et al.Attitudes and opinions regarding confirmatory adaptive clinical trials: a mixed methods analysis from the Adaptive Designs Accelerating Promising Trials into Treatments (ADAPT-IT) project. Trials. 2016; 17(1):373.PubMedPubMedCentralCrossRef
49.
go back to reference Cook J, Drummond M, Heyse J. Multiple primary endpoints in clinical trials. Stat Methods Med Res. 2004; 13:157–76.PubMedCrossRef Cook J, Drummond M, Heyse J. Multiple primary endpoints in clinical trials. Stat Methods Med Res. 2004; 13:157–76.PubMedCrossRef
50.
go back to reference Koerkamp BG, Spronk S, Stijnen T, Hunink MGM. Value of information analyses of economic randomized controlled trials: the treatment of intermittent claudication. Value Health. 2010; 13(2):242–50.CrossRef Koerkamp BG, Spronk S, Stijnen T, Hunink MGM. Value of information analyses of economic randomized controlled trials: the treatment of intermittent claudication. Value Health. 2010; 13(2):242–50.CrossRef
51.
go back to reference Tuffaha HW, Reynolds H, Gordon LG, Rickard CM, Scuffham P. Value of information analysis optimizing future trial design from a pilot study on catheter securement devices. Clin Trials (London, England). 2014; 11(6):648–56.CrossRef Tuffaha HW, Reynolds H, Gordon LG, Rickard CM, Scuffham P. Value of information analysis optimizing future trial design from a pilot study on catheter securement devices. Clin Trials (London, England). 2014; 11(6):648–56.CrossRef
52.
go back to reference Trotta F, Apolone G, Garattini S, Tafuri G. Stopping a trial early in oncology: for patients or for industry?Ann Oncol. 2008; 19(7):1347–53.PubMedCrossRef Trotta F, Apolone G, Garattini S, Tafuri G. Stopping a trial early in oncology: for patients or for industry?Ann Oncol. 2008; 19(7):1347–53.PubMedCrossRef
53.
go back to reference Ashby D, Tanb S-B. Where’s the utility of clinical trials? Bayesian data-monitoring. Clin Trials. 2005; 2:197–208.PubMedCrossRef Ashby D, Tanb S-B. Where’s the utility of clinical trials? Bayesian data-monitoring. Clin Trials. 2005; 2:197–208.PubMedCrossRef
54.
go back to reference Hollingworth W, McKell-Redwood D, Hampson L, Metcalfe C. Cost–utility analysis conducted alongside randomized controlled trials: are economic end points considered in sample size calculations and does it matter?Clin Trials. 2013; 10(1):43–53.PubMedCrossRef Hollingworth W, McKell-Redwood D, Hampson L, Metcalfe C. Cost–utility analysis conducted alongside randomized controlled trials: are economic end points considered in sample size calculations and does it matter?Clin Trials. 2013; 10(1):43–53.PubMedCrossRef
55.
go back to reference Briggs AH, Gray AM. Power and sample size calculations for stochastic cost-effectiveness analysis. Med Decis Making Int J Soc Med Decis Making. 1998; 18(2):81–92.CrossRef Briggs AH, Gray AM. Power and sample size calculations for stochastic cost-effectiveness analysis. Med Decis Making Int J Soc Med Decis Making. 1998; 18(2):81–92.CrossRef
56.
go back to reference O’Brien BJ, Drummond MF, Labelle RJ, Willan A. In search of power and significance: issues in the design and analysis of stochastic cost-effectiveness studies in health care. Medical Care. 1994; 32(2):150–63.PubMedCrossRef O’Brien BJ, Drummond MF, Labelle RJ, Willan A. In search of power and significance: issues in the design and analysis of stochastic cost-effectiveness studies in health care. Medical Care. 1994; 32(2):150–63.PubMedCrossRef
Metadata
Title
How can health economics be used in the design and analysis of adaptive clinical trials? A qualitative analysis
Authors
Laura Flight
Steven Julious
Alan Brennan
Susan Todd
Daniel Hind
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-4137-2

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue