Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2024

Open Access 01-12-2024 | Research

Group sequential designs for pragmatic clinical trials with early outcomes: methods and guidance for planning and implementation

Authors: Nick R. Parsons, Joydeep Basu, Nigel Stallard

Published in: BMC Medical Research Methodology | Issue 1/2024

Login to get access

Abstract

Background

Group sequential designs are one of the most widely used methodologies for adaptive design in randomized clinical trials. In settings where early outcomes are available, they offer large gains in efficiency compared to a fixed design. However, such designs are underused and used predominantly in therapeutic areas where there is expertise and experience in implementation. One barrier to their greater use is the requirement to undertake simulation studies at the planning stage that require considerable knowledge, coding experience and additional costs. Based on some modest assumptions about the likely patterns of recruitment and the covariance structure of the outcomes, some simple analytic expressions are presented that negate the need to undertake simulations.

Methods

A model for longitudinal outcomes with an assumed approximate multivariate normal distribution and three contrasting simple recruitment models are described, based on fixed, increasing and decreasing rates. For assumed uniform and exponential correlation models, analytic expressions for the variance of the treatment effect and the effects of the early outcomes on reducing this variance at the primary outcome time-point are presented. Expressions for the minimum and maximum values show how the correlations and timing of the early outcomes affect design efficiency.

Results

Simulations showed how patterns of information accrual varied between correlation and recruitment models, and consequentially to some general guidance for planning a trial. Using a previously reported group sequential trial as an exemplar, it is shown how the analytic expressions given here could have been used as a quick and flexible planning tool, avoiding the need for extensive simulation studies based on individual participant data.

Conclusions

The analytic expressions described can be routinely used at the planning stage of a putative trial, based on some modest assumptions about the likely number of outcomes and when they might occur and the expected recruitment patterns. Numerical simulations showed that these models behaved sensibly and allowed a range of design options to be explored in a way that would have been difficult and time-consuming if the previously described method of simulating individual trial participant data had been used.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hatfield I, Allison A, Flight L, Julious SA, Dimairo M. Adaptive designs undertaken in clinical research: a review of registered clinical trials. Trials. 2016;17(1):150.CrossRefPubMedPubMedCentral Hatfield I, Allison A, Flight L, Julious SA, Dimairo M. Adaptive designs undertaken in clinical research: a review of registered clinical trials. Trials. 2016;17(1):150.CrossRefPubMedPubMedCentral
2.
go back to reference Jennison C, Turnbull BW. Group sequential methods with applications to clinical trials. Boca Raton: Chapman and Hall; 2000. Jennison C, Turnbull BW. Group sequential methods with applications to clinical trials. Boca Raton: Chapman and Hall; 2000.
3.
go back to reference Dimairo M, Boote J, Julious SA, Nicholl JP, Todd S. Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials. 2015;16:430.CrossRefPubMedPubMedCentral Dimairo M, Boote J, Julious SA, Nicholl JP, Todd S. Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials. 2015;16:430.CrossRefPubMedPubMedCentral
7.
go back to reference Metcalfe A, Parsons H, Parsons N, Brown J, Fox J, Gemperle Mannion E, et al. Subacromial balloon spacer for irreparable rotator cuff tears of the shoulder (START:REACTS): a group-sequential, double-blind, multicentre randomised controlled trial. Lancet. 2022;399:1954–63.CrossRefPubMed Metcalfe A, Parsons H, Parsons N, Brown J, Fox J, Gemperle Mannion E, et al. Subacromial balloon spacer for irreparable rotator cuff tears of the shoulder (START:REACTS): a group-sequential, double-blind, multicentre randomised controlled trial. Lancet. 2022;399:1954–63.CrossRefPubMed
10.
go back to reference Galbraith S, Marschner IC. Interim analysis of continuous long-term endpoints in clinical trials with longitudinal outcomes. Stat Med. 2003;22(11):1787–805.CrossRefPubMed Galbraith S, Marschner IC. Interim analysis of continuous long-term endpoints in clinical trials with longitudinal outcomes. Stat Med. 2003;22(11):1787–805.CrossRefPubMed
11.
go back to reference Jennison C, Turnbull BW. Group-sequential analysis incorporating covariate information. J Am Stat Assoc. 1997;92:1330–41.MathSciNetCrossRef Jennison C, Turnbull BW. Group-sequential analysis incorporating covariate information. J Am Stat Assoc. 1997;92:1330–41.MathSciNetCrossRef
12.
go back to reference Van Lancker K, Vandebosch A, Vansteelandt S. Improving interim decisions in randomized trials by exploiting information on short-term endpoints and prognostic baseline covariates. Pharm Stat. 2020;19:583–601.CrossRefPubMed Van Lancker K, Vandebosch A, Vansteelandt S. Improving interim decisions in randomized trials by exploiting information on short-term endpoints and prognostic baseline covariates. Pharm Stat. 2020;19:583–601.CrossRefPubMed
13.
go back to reference Viele K, McGlothlin A, Broglio K. Interpretation of clinical trials that stopped early. JAMA. 2016;315(15):1646–7.CrossRefPubMed Viele K, McGlothlin A, Broglio K. Interpretation of clinical trials that stopped early. JAMA. 2016;315(15):1646–7.CrossRefPubMed
15.
go back to reference Todd S, Whitehead J, Facey KM. Point and interval estimation following a sequential clinical trial. Biometrika. 1996 06;83(2):453–461. Todd S, Whitehead J, Facey KM. Point and interval estimation following a sequential clinical trial. Biometrika. 1996 06;83(2):453–461.
18.
go back to reference Spiessens B, Lesaffre E, Verbeke G, Kim K, DeMets DL. An overview of group sequential methods in longitudinal clinical trials. Stat Methods Med Res. 2000;9(5):497–515.CrossRefPubMed Spiessens B, Lesaffre E, Verbeke G, Kim K, DeMets DL. An overview of group sequential methods in longitudinal clinical trials. Stat Methods Med Res. 2000;9(5):497–515.CrossRefPubMed
19.
go back to reference Spiessens B, Lesaffre E, Verbeke G. A comparison of group sequential methods for binary longitudinal data. Stat Med. 2003;22(4):501–15.CrossRefPubMed Spiessens B, Lesaffre E, Verbeke G. A comparison of group sequential methods for binary longitudinal data. Stat Med. 2003;22(4):501–15.CrossRefPubMed
20.
go back to reference Kim K, Anastasios AT. Independent increments in group sequential tests: a review. Stat Oper Res Trans. 2020;44(2):223–64.MathSciNet Kim K, Anastasios AT. Independent increments in group sequential tests: a review. Stat Oper Res Trans. 2020;44(2):223–64.MathSciNet
21.
go back to reference Qian T, Rosenblum M, Qiu H. Improving power in group sequential, randomized trials by adjusting for prognostic baseline variables and shortterm outcomes. Johns Hopkins University, Dept of Biostatistics Working Papers, Working paper 285. 2016;5(5):5. Qian T, Rosenblum M, Qiu H. Improving power in group sequential, randomized trials by adjusting for prognostic baseline variables and shortterm outcomes. Johns Hopkins University, Dept of Biostatistics Working Papers, Working paper 285. 2016;5(5):5.
22.
go back to reference Diggle P, Diggle P. Analysis of longitudinal data. 2nd ed. Oxford statistical science series. Oxford: Oxford University Press; 2002.CrossRef Diggle P, Diggle P. Analysis of longitudinal data. 2nd ed. Oxford statistical science series. Oxford: Oxford University Press; 2002.CrossRef
24.
go back to reference Pinheiro JC, Bates D. Mixed-Effects Models in S and S-PLUS. Statistics and Computing. New York: Springer; 2009. Pinheiro JC, Bates D. Mixed-Effects Models in S and S-PLUS. Statistics and Computing. New York: Springer; 2009.
25.
go back to reference Lan KKG, Reboussin DM, DeMets DL. Information and information fractions for design and sequential monitoring of clinical trials. Commun Stat Theory Methods. 1994;23(2):403–20.CrossRef Lan KKG, Reboussin DM, DeMets DL. Information and information fractions for design and sequential monitoring of clinical trials. Commun Stat Theory Methods. 1994;23(2):403–20.CrossRef
Metadata
Title
Group sequential designs for pragmatic clinical trials with early outcomes: methods and guidance for planning and implementation
Authors
Nick R. Parsons
Joydeep Basu
Nigel Stallard
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2024
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-024-02174-w

Other articles of this Issue 1/2024

BMC Medical Research Methodology 1/2024 Go to the issue