Skip to main content
Top
Published in: Trials 1/2023

Open Access 01-12-2023 | Methodology

A retrospective analysis of conditional power assumptions in clinical trials with continuous or binary endpoints

Authors: Julia M. Edwards, Stephen J. Walters, Steven A. Julious

Published in: Trials | Issue 1/2023

Login to get access

Abstract

Background

Adaptive clinical trials may use conditional power (CP) to make decisions at interim analyses, requiring assumptions about the treatment effect for remaining patients. It is critical that these assumptions are understood by those using CP in decision-making, as well as timings of these decisions.

Methods

Data for 21 outcomes from 14 published clinical trials were made available for re-analysis. CP curves for accruing outcome information were calculated using and compared with a pre-specified objective criteria for original and transformed versions of the trial data using four future treatment effect assumptions: (i) observed current trend, (ii) hypothesised effect, (iii) 80% optimistic confidence limit, (iv) 90% optimistic confidence limit.

Results

The hypothesised effect assumption met objective criteria when the true effect was close to that planned, but not when smaller than planned. The opposite was seen using the current trend assumption. Optimistic confidence limit assumptions appeared to offer a compromise between the two, performing well against objective criteria when the end observed effect was as planned or smaller.

Conclusion

The current trend assumption could be the preferable assumption when there is a wish to stop early for futility. Interim analyses could be undertaken as early as 30% of patients have data available. Optimistic confidence limit assumptions should be considered when using CP to make trial decisions, although later interim timings should be considered where logistically feasible.
Appendix
Available only for authorised users
Literature
1.
go back to reference Noordzij MF, Dekker FW, Zoccali C, et al. Kidney Disease and Population Health: Sample size calculations. Nephron Clin Pract. 2011;118(4):319–23.CrossRef Noordzij MF, Dekker FW, Zoccali C, et al. Kidney Disease and Population Health: Sample size calculations. Nephron Clin Pract. 2011;118(4):319–23.CrossRef
3.
go back to reference Mehta C, Pocock SJ. Adaptive increase in sample size when interim results are promising: a practical guide with examples. Stat Med. 2011;30(28):3267–84.CrossRefPubMed Mehta C, Pocock SJ. Adaptive increase in sample size when interim results are promising: a practical guide with examples. Stat Med. 2011;30(28):3267–84.CrossRefPubMed
4.
go back to reference Glimm E. Comments on ‘Adaptive increase in sample size when interim results are promising: a practical guide with examples’ by C. R. Mehta and S. J. Pocock. Stat Med. 2012;31(1):98–9.CrossRefPubMed Glimm E. Comments on ‘Adaptive increase in sample size when interim results are promising: a practical guide with examples’ by C. R. Mehta and S. J. Pocock. Stat Med. 2012;31(1):98–9.CrossRefPubMed
5.
go back to reference Bauer P, Koenig F. The reassessment of trial perspectives from interim data - A critical view. Stat Med. 2006;25(1):23–36.CrossRefPubMed Bauer P, Koenig F. The reassessment of trial perspectives from interim data - A critical view. Stat Med. 2006;25(1):23–36.CrossRefPubMed
7.
go back to reference Denne JS. Sample size recalculation using conditional power. Stat Med. 2001;20(17-18):3645–60.CrossRef Denne JS. Sample size recalculation using conditional power. Stat Med. 2001;20(17-18):3645–60.CrossRef
8.
go back to reference Kunzmann K, Grayling MJ, Lee KM, et al. Conditional power and friends: the why and how of (un)planned, unblinded sample size recalculations in confirmatory trials. Stat Med. 2022;41(5):877–90.CrossRefPubMedPubMedCentral Kunzmann K, Grayling MJ, Lee KM, et al. Conditional power and friends: the why and how of (un)planned, unblinded sample size recalculations in confirmatory trials. Stat Med. 2022;41(5):877–90.CrossRefPubMedPubMedCentral
9.
go back to reference Herson J, Buyse M, Wittes JT. On stopping a randomized clinical trial for futility. In: Designs for clinical trials; 2012. p. 109–37.CrossRef Herson J, Buyse M, Wittes JT. On stopping a randomized clinical trial for futility. In: Designs for clinical trials; 2012. p. 109–37.CrossRef
10.
go back to reference Powell JT, Sweeting MJ, Thompson M, et al. Endovascular or open repair strategy for ruptured abdominal aortic aneurysm: 30 day outcomes from IMPROVE randomised trial. Br Med J. 2014;348:f7661.CrossRef Powell JT, Sweeting MJ, Thompson M, et al. Endovascular or open repair strategy for ruptured abdominal aortic aneurysm: 30 day outcomes from IMPROVE randomised trial. Br Med J. 2014;348:f7661.CrossRef
11.
go back to reference Bosanquet K, Adamson J, Atherton K, et al. The CASPER-PLUS Trial: collaborative care for screen-positive elders with major depressive disorder. Health Technol Assess. 2017;21(67):1–252.CrossRefPubMedPubMedCentral Bosanquet K, Adamson J, Atherton K, et al. The CASPER-PLUS Trial: collaborative care for screen-positive elders with major depressive disorder. Health Technol Assess. 2017;21(67):1–252.CrossRefPubMedPubMedCentral
12.
go back to reference Rothwell JC, Julious SA, Cooper CL. A study of target effect sizes in randomised controlled trials published in the Health Technology Assessment journal. Trials. 2018;19(1):544.CrossRefPubMedPubMedCentral Rothwell JC, Julious SA, Cooper CL. A study of target effect sizes in randomised controlled trials published in the Health Technology Assessment journal. Trials. 2018;19(1):544.CrossRefPubMedPubMedCentral
13.
go back to reference Pomeroy VM, Hunter SM, Johansen-Berg H, et al. Functional strength training versus movement performance therapy for upper limb motor recovery early after stroke: a RCT. Effic Mechan Eval. 2018;5(3):1–112.CrossRef Pomeroy VM, Hunter SM, Johansen-Berg H, et al. Functional strength training versus movement performance therapy for upper limb motor recovery early after stroke: a RCT. Effic Mechan Eval. 2018;5(3):1–112.CrossRef
14.
go back to reference Littlewood C, Bateman M, Brown K, et al. A self-managed single exercise programme versus usual physiotherapy treatment for rotator cuff tendinopathy: a randomised controlled trial (the SELF study). Clin Rehabil. 2016;30(7):686–96.CrossRefPubMed Littlewood C, Bateman M, Brown K, et al. A self-managed single exercise programme versus usual physiotherapy treatment for rotator cuff tendinopathy: a randomised controlled trial (the SELF study). Clin Rehabil. 2016;30(7):686–96.CrossRefPubMed
15.
go back to reference Thomas KJ, MacPherson H, Thorpe L, et al. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006;333(7569):623–6.CrossRefPubMedPubMedCentral Thomas KJ, MacPherson H, Thorpe L, et al. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006;333(7569):623–6.CrossRefPubMedPubMedCentral
16.
go back to reference Lewis H, Adamson J, Atherton K, et al. Collaborative care and active surveillance for screen-positive EldeRs with subthreshold depression (CASPER): a multicentre randomised controlled trial of clinical effectiveness. Health Technol Assess. 2017;21(8):1–196.CrossRefPubMedPubMedCentral Lewis H, Adamson J, Atherton K, et al. Collaborative care and active surveillance for screen-positive EldeRs with subthreshold depression (CASPER): a multicentre randomised controlled trial of clinical effectiveness. Health Technol Assess. 2017;21(8):1–196.CrossRefPubMedPubMedCentral
17.
go back to reference Meador KJ, Yang H, Pina-Garza JE, et al. Cognitive effects of adjunctive perampanel for partial-onset seizures: a randomized trial. Epilepsia. 2016;57(2):243–51.CrossRefPubMedPubMedCentral Meador KJ, Yang H, Pina-Garza JE, et al. Cognitive effects of adjunctive perampanel for partial-onset seizures: a randomized trial. Epilepsia. 2016;57(2):243–51.CrossRefPubMedPubMedCentral
19.
go back to reference Farndon L, Vernon W, Walters SJ, et al. The effectiveness of salicylic acid plasters compared with ‘usual’ scalpel debridement of corns: a randomised controlled trial. J Foot Ankle Res. 2013;6:40.CrossRefPubMedPubMedCentral Farndon L, Vernon W, Walters SJ, et al. The effectiveness of salicylic acid plasters compared with ‘usual’ scalpel debridement of corns: a randomised controlled trial. J Foot Ankle Res. 2013;6:40.CrossRefPubMedPubMedCentral
20.
go back to reference Sharples L, Everett C, Singh J, et al. Amaze: A double-blind, multicentre randomised controlled trial to investigate the clinical effectiveness and cost effectiveness of adding an ablation device-based maze procedure as an adjunct to routine cardiac surgery for patients with pre-existing atria. Health Technol Assess. 2018;22(19):1–32.CrossRefPubMedPubMedCentral Sharples L, Everett C, Singh J, et al. Amaze: A double-blind, multicentre randomised controlled trial to investigate the clinical effectiveness and cost effectiveness of adding an ablation device-based maze procedure as an adjunct to routine cardiac surgery for patients with pre-existing atria. Health Technol Assess. 2018;22(19):1–32.CrossRefPubMedPubMedCentral
21.
go back to reference Goodacre S, Bradburn M, Fitzgerald E, et al. The RATPAC (randomised assessment of treatment using panel assay of cardiac markers) trial: a randomized controlled trial of point-of-care cardiac markers in the emergency department. Health Technol Assess. 2011;15(23):1–108.CrossRefPubMedPubMedCentral Goodacre S, Bradburn M, Fitzgerald E, et al. The RATPAC (randomised assessment of treatment using panel assay of cardiac markers) trial: a randomized controlled trial of point-of-care cardiac markers in the emergency department. Health Technol Assess. 2011;15(23):1–108.CrossRefPubMedPubMedCentral
22.
go back to reference Goodacre S, Cohen J, Bradburn M, et al. The 3Mg trial: a randomised controlled trial of intravenous or nebulised magnesium sulphate versus placebo in adults with acute severe asthma. Health Technol Assess. 2014;18(22):1–168.CrossRefPubMedPubMedCentral Goodacre S, Cohen J, Bradburn M, et al. The 3Mg trial: a randomised controlled trial of intravenous or nebulised magnesium sulphate versus placebo in adults with acute severe asthma. Health Technol Assess. 2014;18(22):1–168.CrossRefPubMedPubMedCentral
23.
go back to reference Meltzer E, Stahlman J, Leflein J, et al. Preferences of adult patients with allergic rhinitis for the sensory attributes of fluticasone furoate versus fluticasone propionate nasal sprays: a randomized, multicenter, double-blind, single-dose, crossover study. Clin Ther. 2008;30(2):271–9.CrossRefPubMed Meltzer E, Stahlman J, Leflein J, et al. Preferences of adult patients with allergic rhinitis for the sensory attributes of fluticasone furoate versus fluticasone propionate nasal sprays: a randomized, multicenter, double-blind, single-dose, crossover study. Clin Ther. 2008;30(2):271–9.CrossRefPubMed
Metadata
Title
A retrospective analysis of conditional power assumptions in clinical trials with continuous or binary endpoints
Authors
Julia M. Edwards
Stephen J. Walters
Steven A. Julious
Publication date
01-12-2023
Publisher
BioMed Central
Published in
Trials / Issue 1/2023
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-023-07202-6

Other articles of this Issue 1/2023

Trials 1/2023 Go to the issue