Skip to main content
Top
Published in: Trials 1/2019

Open Access 01-12-2019 | Research

Progression criteria in trials with an internal pilot: an audit of publicly funded randomised controlled trials

Authors: Esther Herbert, Steven A. Julious, Steve Goodacre

Published in: Trials | Issue 1/2019

Login to get access

Abstract

Background

With millions of pounds spent annually on medical research in the UK, it is important that studies are spending funds wisely. Internal pilots offer the chance to stop a trial early if it becomes apparent that the study will not be able to recruit enough patients to show whether an intervention is clinically effective. This study aims to assess the use of internal pilots in individually randomised controlled trials funded by the Health Technology Assessment (HTA) programme and to summarise the progression criteria chosen in these trials.

Methods

Studies were identified from reports of the HTA committees’ funding decisions from 2012 to 2016. In total, 242 trials were identified of which 134 were eligible to be included in the audit. Protocols for the eligible studies were located on the NIHR Journals website, and if protocols were not available online then study managers were contacted to provide information.

Results

Over two-thirds (72.4%) of studies said in their protocol that they would include an internal pilot phase for their study and 37.8% of studies without an internal pilot had done an external pilot study to assess the feasibility of the full study. A typical study with an internal pilot has a target sample size of 510 over 24 months and aims to recruit one-fifth of their total target sample size within the first one-third of their recruitment time.
There has been an increase in studies adopting a three-tiered structure for their progression rules in recent years, with 61.5% (16/26) of studies using the system in 2016 compared to just 11.8% (2/17) in 2015. There was also a rise in the number of studies giving a target recruitment rate in their progression criteria: 42.3% (11/26) in 2016 compared to 35.3% (6/17) in 2015.

Conclusions

Progression criteria for an internal pilot are usually well specified but targets vary widely. For the actual criteria, red/amber/green systems have increased in popularity in recent years. Trials should justify the targets they have set, especially where targets are low.
Literature
4.
go back to reference Birkett MA, Day SJ. Internal pilot studies for estimating sample size. Stat Med. 1994;13(23–24):2455–63.CrossRef Birkett MA, Day SJ. Internal pilot studies for estimating sample size. Stat Med. 1994;13(23–24):2455–63.CrossRef
5.
go back to reference Walters SJ, Bonacho dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.CrossRef Walters SJ, Bonacho dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.CrossRef
8.
go back to reference Avery KNL, Williamson PR, Gamble C, et al. Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open. 2017;7(2):e013537.CrossRef Avery KNL, Williamson PR, Gamble C, et al. Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open. 2017;7(2):e013537.CrossRef
9.
go back to reference R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018. R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018.
10.
go back to reference Palmer R, Cooper C, Enderby P, et al. Clinical and cost effectiveness of computer treatment for aphasia post stroke (Big CACTUS): study protocol for a randomised controlled trial. Trials. 2015;16(1):18.CrossRef Palmer R, Cooper C, Enderby P, et al. Clinical and cost effectiveness of computer treatment for aphasia post stroke (Big CACTUS): study protocol for a randomised controlled trial. Trials. 2015;16(1):18.CrossRef
11.
go back to reference Palmer R, Enderby P, Cooper C, et al. Computer therapy compared with usual care for people with long-standing aphasia poststroke. Stroke. 2012;43(7):1904–11.CrossRef Palmer R, Enderby P, Cooper C, et al. Computer therapy compared with usual care for people with long-standing aphasia poststroke. Stroke. 2012;43(7):1904–11.CrossRef
14.
go back to reference Julious SA, Horspool MJ, Davis S, Franklin M, Smithson WH, Norman P, et al. Open-label, cluster randomised controlled trial and economic evaluation of a brief letter from a GP on unscheduled medical contacts associated with the start of the school year: the PLEASANT trial. BMJ Open. 2018;8(4):e017367. Julious SA, Horspool MJ, Davis S, Franklin M, Smithson WH, Norman P, et al. Open-label, cluster randomised controlled trial and economic evaluation of a brief letter from a GP on unscheduled medical contacts associated with the start of the school year: the PLEASANT trial. BMJ Open. 2018;8(4):e017367.
Metadata
Title
Progression criteria in trials with an internal pilot: an audit of publicly funded randomised controlled trials
Authors
Esther Herbert
Steven A. Julious
Steve Goodacre
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Trials / Issue 1/2019
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-019-3578-y

Other articles of this Issue 1/2019

Trials 1/2019 Go to the issue