Skip to main content
Top
Published in: Trials 1/2015

Open Access 01-12-2015 | Research

Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials

Authors: Munyaradzi Dimairo, Jonathan Boote, Steven A. Julious, Jonathan P. Nicholl, Susan Todd

Published in: Trials | Issue 1/2015

Login to get access

Abstract

Background

Despite the promising benefits of adaptive designs (ADs), their routine use, especially in confirmatory trials, is lagging behind the prominence given to them in the statistical literature. Much of the previous research to understand barriers and potential facilitators to the use of ADs has been driven from a pharmaceutical drug development perspective, with little focus on trials in the public sector. In this paper, we explore key stakeholders’ experiences, perceptions and views on barriers and facilitators to the use of ADs in publicly funded confirmatory trials.

Methods

Semi-structured, in-depth interviews of key stakeholders in clinical trials research (CTU directors, funding board and panel members, statisticians, regulators, chief investigators, data monitoring committee members and health economists) were conducted through telephone or face-to-face sessions, predominantly in the UK. We purposively selected participants sequentially to optimise maximum variation in views and experiences. We employed the framework approach to analyse the qualitative data.

Results

We interviewed 27 participants. We found some of the perceived barriers to be: lack of knowledge and experience coupled with paucity of case studies, lack of applied training, degree of reluctance to use ADs, lack of bridge funding and time to support design work, lack of statistical expertise, some anxiety about the impact of early trial stopping on researchers’ employment contracts, lack of understanding of acceptable scope of ADs and when ADs are appropriate, and statistical and practical complexities. Reluctance to use ADs seemed to be influenced by: therapeutic area, unfamiliarity, concerns about their robustness in decision-making and acceptability of findings to change practice, perceived complexities and proposed type of AD, among others.

Conclusions

There are still considerable multifaceted, individual and organisational obstacles to be addressed to improve uptake, and successful implementation of ADs when appropriate. Nevertheless, inferred positive change in attitudes and receptiveness towards the appropriate use of ADs by public funders are supportive and are a stepping stone for the future utilisation of ADs by researchers.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bretz F, Koenig F, Brannath W, Glimm E, Posch M. Adaptive designs for confirmatory clinical trials. Stat Med. 2009;28:1181–217.CrossRefPubMed Bretz F, Koenig F, Brannath W, Glimm E, Posch M. Adaptive designs for confirmatory clinical trials. Stat Med. 2009;28:1181–217.CrossRefPubMed
3.
go back to reference Morgan CC, Huyck S, Jenkins M, Chen L, Bedding A, Coffey CS, et al. Adaptive design: results of 2012 survey on perception and use. Ther Innov Regul Sci. 2014;48:473–81.CrossRef Morgan CC, Huyck S, Jenkins M, Chen L, Bedding A, Coffey CS, et al. Adaptive design: results of 2012 survey on perception and use. Ther Innov Regul Sci. 2014;48:473–81.CrossRef
4.
go back to reference Millard WB. The gold standard’s flexible alloy: adaptive designs on the advance. Ann Emerg Med. 2012;60:22A–7.CrossRefPubMed Millard WB. The gold standard’s flexible alloy: adaptive designs on the advance. Ann Emerg Med. 2012;60:22A–7.CrossRefPubMed
5.
go back to reference Gallo P, Chuang-Stein C, Dragalin V, Gaydos B, Krams M, Pinheiro J. Adaptive designs in clinical drug development--an executive summary of the PhRMA working group. J Biopharm Stat. 2006;16:275–83. discussion 285–91, 293–8, 311–2.CrossRefPubMed Gallo P, Chuang-Stein C, Dragalin V, Gaydos B, Krams M, Pinheiro J. Adaptive designs in clinical drug development--an executive summary of the PhRMA working group. J Biopharm Stat. 2006;16:275–83. discussion 285–91, 293–8, 311–2.CrossRefPubMed
6.
go back to reference Krams M, Burman C-F, Dragalin V, Gaydos B, Grieve AP, Pinheiro J, et al. Adaptive designs in clinical drug development: opportunities, challenges, and scope reflections following PhRMA’s November 2006 workshop. J Biopharm Stat. 2007;17:957–64.CrossRefPubMed Krams M, Burman C-F, Dragalin V, Gaydos B, Grieve AP, Pinheiro J, et al. Adaptive designs in clinical drug development: opportunities, challenges, and scope reflections following PhRMA’s November 2006 workshop. J Biopharm Stat. 2007;17:957–64.CrossRefPubMed
7.
go back to reference Chang M, Chow S-C, Pong A. Adaptive design in clinical research: issues, opportunities, and recommendations. J Biopharm Stat. 2006;16:299–309. discussion 311–2.CrossRefPubMed Chang M, Chow S-C, Pong A. Adaptive design in clinical research: issues, opportunities, and recommendations. J Biopharm Stat. 2006;16:299–309. discussion 311–2.CrossRefPubMed
9.
go back to reference Coffey CS, Kairalla JA. Adaptive clinical trials: progress and challenges. Drugs R&D. 2008;9:229–42.CrossRef Coffey CS, Kairalla JA. Adaptive clinical trials: progress and challenges. Drugs R&D. 2008;9:229–42.CrossRef
10.
go back to reference Gallo P. Confidentiality and trial integrity issues for adaptive designs. Drug Inf J. 2006;40:445–50. Gallo P. Confidentiality and trial integrity issues for adaptive designs. Drug Inf J. 2006;40:445–50.
11.
go back to reference Coffey CS, Levin B, Clark C, Timmerman C, Wittes J, Gilbert P, et al. Overview, hurdles, and future work in adaptive designs: perspectives from a National Institutes of Health-funded workshop. Clin Trials. 2012;9:671–80.CrossRefPubMed Coffey CS, Levin B, Clark C, Timmerman C, Wittes J, Gilbert P, et al. Overview, hurdles, and future work in adaptive designs: perspectives from a National Institutes of Health-funded workshop. Clin Trials. 2012;9:671–80.CrossRefPubMed
13.
go back to reference Jaki T. Uptake of novel statistical methods for early-phase clinical studies in the UK public sector. Clin Trials. 2013;10:344–6.CrossRefPubMed Jaki T. Uptake of novel statistical methods for early-phase clinical studies in the UK public sector. Clin Trials. 2013;10:344–6.CrossRefPubMed
14.
go back to reference Quinlan J, Gaydos B, Maca J, Krams M. Barriers and opportunities for implementation of adaptive designs in pharmaceutical product development. Clin Trials. 2010;7:167–73.CrossRefPubMed Quinlan J, Gaydos B, Maca J, Krams M. Barriers and opportunities for implementation of adaptive designs in pharmaceutical product development. Clin Trials. 2010;7:167–73.CrossRefPubMed
15.
go back to reference Englander M. The interview: data collection in descriptive phenomenological human scientific research*. J Phenomenological Psychol. 2012;43:13–35.CrossRef Englander M. The interview: data collection in descriptive phenomenological human scientific research*. J Phenomenological Psychol. 2012;43:13–35.CrossRef
16.
go back to reference Legard R, Keegan J, Ward K. In-depth Interviews. In: Ritchie J, Lewis J, editors. Qualitative research practice: a guide for social science students and researchers. 1st ed. London, UK: Sage; 2003. p. 138–69. Legard R, Keegan J, Ward K. In-depth Interviews. In: Ritchie J, Lewis J, editors. Qualitative research practice: a guide for social science students and researchers. 1st ed. London, UK: Sage; 2003. p. 138–69.
17.
go back to reference O’Reilly M, Parker N. Unsatisfactory Saturation: a critical exploration of the notion of saturated sample sizes in qualitative research. Qual Res. 2013;13(2):190–197.CrossRef O’Reilly M, Parker N. Unsatisfactory Saturation: a critical exploration of the notion of saturated sample sizes in qualitative research. Qual Res. 2013;13(2):190–197.CrossRef
18.
go back to reference Mason M. Sample Size and Saturation in PhD Studies Using Qualitative Interviews. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 11(3), Art. 8. 2010. Mason M. Sample Size and Saturation in PhD Studies Using Qualitative Interviews. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 11(3), Art. 8. 2010.
19.
go back to reference Creswell JW. Qualitative Inquiry and Research Design: Choosing Among Five Traditions. 2nd Ed. Thousand Oaks, CA, US: SAGE Publications, Inc; 2007. Creswell JW. Qualitative Inquiry and Research Design: Choosing Among Five Traditions. 2nd Ed. Thousand Oaks, CA, US: SAGE Publications, Inc; 2007.
20.
21.
go back to reference Coyne I. Sampling in qualitative research. Purposeful and theoretical sampling; merging or clear boundaries? J Adv Nurs. 1997;26:623–30.CrossRefPubMed Coyne I. Sampling in qualitative research. Purposeful and theoretical sampling; merging or clear boundaries? J Adv Nurs. 1997;26:623–30.CrossRefPubMed
25.
go back to reference Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.CrossRefPubMedPubMedCentral Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.CrossRefPubMedPubMedCentral
26.
27.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.CrossRef
28.
go back to reference Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ (Clin Res ed). 2000;320:114–6.CrossRef Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ (Clin Res ed). 2000;320:114–6.CrossRef
29.
go back to reference Pope C, Ziebland S, Mays N. Analysing Qualitative Data. In: Pope C, Mays N, editors. Qualitative Research in Health Care. 3rd ed. Oxford, UK: Blackwell Publishing Ltd; 2006. p. 63–81.CrossRef Pope C, Ziebland S, Mays N. Analysing Qualitative Data. In: Pope C, Mays N, editors. Qualitative Research in Health Care. 3rd ed. Oxford, UK: Blackwell Publishing Ltd; 2006. p. 63–81.CrossRef
30.
go back to reference Ritchie J, Lewis J. Qualitative research practice: a guide for Social Sience Students and Researcher. 1st Ed. London: SAGE Publications, Inc; 2003. Ritchie J, Lewis J. Qualitative research practice: a guide for Social Sience Students and Researcher. 1st Ed. London: SAGE Publications, Inc; 2003.
31.
go back to reference Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.CrossRefPubMed Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.CrossRefPubMed
32.
go back to reference Funk SG, Champagne MT, Wiese RA, Tornquist EM. BARRIERS: the barriers to research utilization scale. Appl Nurs Res. 1991;4:39–45.CrossRefPubMed Funk SG, Champagne MT, Wiese RA, Tornquist EM. BARRIERS: the barriers to research utilization scale. Appl Nurs Res. 1991;4:39–45.CrossRefPubMed
33.
go back to reference Gifford WA, Graham ID, Davies BL. Multi-level barriers analysis to promote guideline based nursing care: a leadership strategy from home health care. J Nurs Manag. 2013;21:762–70.CrossRefPubMed Gifford WA, Graham ID, Davies BL. Multi-level barriers analysis to promote guideline based nursing care: a leadership strategy from home health care. J Nurs Manag. 2013;21:762–70.CrossRefPubMed
34.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International J Qual Health Care. 2007;19:349–57.CrossRef Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International J Qual Health Care. 2007;19:349–57.CrossRef
36.
go back to reference Quinlan J, Krams M. Implementing adaptive designs: logistical and operational considerations. Drug Inf J. 2006;40:437–44. Quinlan J, Krams M. Implementing adaptive designs: logistical and operational considerations. Drug Inf J. 2006;40:437–44.
38.
44.
go back to reference Cook T, DeMets DL. Review of draft FDA adaptive design guidance. J Biopharm Stat. 2010;20:1132–42.CrossRefPubMed Cook T, DeMets DL. Review of draft FDA adaptive design guidance. J Biopharm Stat. 2010;20:1132–42.CrossRefPubMed
45.
go back to reference Elsäßer A, Regnstrom J, Vetter T, Koenig F, Hemmings RJ, Greco M, et al. Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European medicines agency. Trials. 2014;15:383.CrossRefPubMedPubMedCentral Elsäßer A, Regnstrom J, Vetter T, Koenig F, Hemmings RJ, Greco M, et al. Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European medicines agency. Trials. 2014;15:383.CrossRefPubMedPubMedCentral
46.
go back to reference Parmar MKB, Carpenter J, Sydes MR. More multiarm randomised trials of superiority are needed. Lancet. 2014;384:283–4.CrossRefPubMed Parmar MKB, Carpenter J, Sydes MR. More multiarm randomised trials of superiority are needed. Lancet. 2014;384:283–4.CrossRefPubMed
47.
go back to reference DAMOCLES Study Group. A proposed charter for clinical trial data monitoring committees: helping them to do their job well. Lancet. 2005;365:711–22.CrossRef DAMOCLES Study Group. A proposed charter for clinical trial data monitoring committees: helping them to do their job well. Lancet. 2005;365:711–22.CrossRef
48.
go back to reference Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.CrossRefPubMedPubMedCentral Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.CrossRefPubMedPubMedCentral
49.
go back to reference McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? a review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? a review of trials funded by two UK funding agencies. Trials. 2006;7:9.CrossRefPubMedPubMedCentral
52.
go back to reference Chen YHJ, Gesser R, Luxembourg A. A seamless Phase IIB/III adaptive outcome trial: design rationale and implementation challenges. Clinical trials (London, England). 2014. Chen YHJ, Gesser R, Luxembourg A. A seamless Phase IIB/III adaptive outcome trial: design rationale and implementation challenges. Clinical trials (London, England). 2014.
53.
go back to reference Baraniuk S, Tilley BC, del Junco DJ, Fox EE, van Belle G, Wade CE, et al. Pragmatic randomized optimal platelet and Plasma ratios (PROPPR) Trial: design, rationale and implementation. Injury. 2014;45:1287–95.CrossRefPubMedPubMedCentral Baraniuk S, Tilley BC, del Junco DJ, Fox EE, van Belle G, Wade CE, et al. Pragmatic randomized optimal platelet and Plasma ratios (PROPPR) Trial: design, rationale and implementation. Injury. 2014;45:1287–95.CrossRefPubMedPubMedCentral
54.
go back to reference Pritchett Y, Jemiai Y, Chang Y, Bhan I, Agarwal R, Zoccali C, et al. The use of group sequential, information-based sample size re-estimation in the design of the PRIMO study of chronic kidney disease. Clin Trials. 2011;8:165–74.CrossRefPubMed Pritchett Y, Jemiai Y, Chang Y, Bhan I, Agarwal R, Zoccali C, et al. The use of group sequential, information-based sample size re-estimation in the design of the PRIMO study of chronic kidney disease. Clin Trials. 2011;8:165–74.CrossRefPubMed
55.
go back to reference Sydes MR, Parmar MKB, James ND, Clarke NW, Dearnaley DP, Mason MD, et al. Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009;10:39.CrossRefPubMedPubMedCentral Sydes MR, Parmar MKB, James ND, Clarke NW, Dearnaley DP, Mason MD, et al. Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009;10:39.CrossRefPubMedPubMedCentral
56.
go back to reference Bratton DJ, Phillips PPJ, Parmar MKB. A multi-arm multi-stage clinical trial design for binary outcomes with application to tuberculosis. BMC Med Res Methodol. 2013;13:139.CrossRefPubMedPubMedCentral Bratton DJ, Phillips PPJ, Parmar MKB. A multi-arm multi-stage clinical trial design for binary outcomes with application to tuberculosis. BMC Med Res Methodol. 2013;13:139.CrossRefPubMedPubMedCentral
57.
go back to reference Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review Syst Rev. 2012;1:60.PubMed Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review Syst Rev. 2012;1:60.PubMed
58.
go back to reference Altman DG, Moher D, Schulz KF. Improving the reporting of randomised trials: the CONSORT Statement and beyond. Stat Med. 2012;31:2985–97.CrossRefPubMed Altman DG, Moher D, Schulz KF. Improving the reporting of randomised trials: the CONSORT Statement and beyond. Stat Med. 2012;31:2985–97.CrossRefPubMed
60.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ (Clin Res ed). 2008;337:a1655. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ (Clin Res ed). 2008;337:a1655.
61.
go back to reference Stallard N, Hamborg T, Parsons N, Friede T. Adaptive designs for confirmatory clinical trials with subgroup selection. J Biopharm Stat. 2014;24:168–87.CrossRefPubMed Stallard N, Hamborg T, Parsons N, Friede T. Adaptive designs for confirmatory clinical trials with subgroup selection. J Biopharm Stat. 2014;24:168–87.CrossRefPubMed
62.
go back to reference Freidlin B, Korn EL. Biomarker enrichment strategies: matching trial design to biomarker credentials. Nat Rev Clin Oncol. 2014;11:81–90.CrossRefPubMed Freidlin B, Korn EL. Biomarker enrichment strategies: matching trial design to biomarker credentials. Nat Rev Clin Oncol. 2014;11:81–90.CrossRefPubMed
Metadata
Title
Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials
Authors
Munyaradzi Dimairo
Jonathan Boote
Steven A. Julious
Jonathan P. Nicholl
Susan Todd
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Trials / Issue 1/2015
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-015-0958-9

Other articles of this Issue 1/2015

Trials 1/2015 Go to the issue