Skip to main content
Top
Published in: Trials 1/2016

Open Access 01-12-2016 | Commentary

Stopping guidelines for an effectiveness trial: what should the protocol specify?

Authors: Jon E. Tyson, Claudia Pedroza, Dennis Wallace, Carl D’Angio, Edward F. Bell, Abhik Das

Published in: Trials | Issue 1/2016

Login to get access

Abstract

Background

Despite long-standing problems in decisions to stop clinical trials, stopping guidelines are often vague or unspecified in the trial protocol. Clear, well-conceived guidelines are especially important to assist the data monitoring committees for effectiveness trials.

Main text

To specify better stopping guidelines in the protocol for such trials, the clinical investigators and trial statistician should carefully consider the following kinds of questions:
1.
How should the relative importance of the treatment benefits and hazards be assessed?
 
2.
For decisions to stop a trial for benefit:
(a)
What would be the minimum clinically important difference for the study population?
 
(b)
How should the probability that the benefit exceeds that difference be assessed?
 
(c)
When should the interim analyses include data from other trials?
 
(d)
Would the evidence meet state-of-the-art standards for treatment recommendations and practice guidelines?
 
 
3.
Should less evidence be required to stop the trial for harm than for benefit?
 
4.
When should conventional stopping guidelines for futility be used for comparative effectiveness trials?
 

Conclusion

Both clinical and statistical expertise are required to address such challenging questions for effectiveness trials. Their joint consideration by clinical investigators and statisticians is needed to define better stopping guidelines before starting the trial.
Literature
2.
go back to reference Grant AM, Altman DG, Babiker AB, Campbell MK, Clemens FJ, Darbyshire JH, et al. Issues in data monitoring and interim analysis of trials. Health Technol Assess. 2005;9:1–238. iii–iv.CrossRef Grant AM, Altman DG, Babiker AB, Campbell MK, Clemens FJ, Darbyshire JH, et al. Issues in data monitoring and interim analysis of trials. Health Technol Assess. 2005;9:1–238. iii–iv.CrossRef
3.
go back to reference Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G. Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol. 2008;61:241–6.CrossRefPubMed Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G. Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol. 2008;61:241–6.CrossRefPubMed
4.
go back to reference Guyatt GH, Briel M, Glasziou P, Bassler D, Montori VM. Problems of stopping trials early. BMJ. 2012;344:e3863.CrossRefPubMed Guyatt GH, Briel M, Glasziou P, Bassler D, Montori VM. Problems of stopping trials early. BMJ. 2012;344:e3863.CrossRefPubMed
5.
go back to reference Zannad F, Gattis Stough W, McMurray JJV, Remme WJ, Pitt B, Borer JS, et al. When to stop a clinical trial early for benefit: lessons learned and future approaches. Circ Heart Fail. 2012;5:294–302.CrossRefPubMed Zannad F, Gattis Stough W, McMurray JJV, Remme WJ, Pitt B, Borer JS, et al. When to stop a clinical trial early for benefit: lessons learned and future approaches. Circ Heart Fail. 2012;5:294–302.CrossRefPubMed
6.
go back to reference Pocock SJ. Current controversies in data monitoring for clinical trials. Clin Trials. 2006;3:513–21.CrossRefPubMed Pocock SJ. Current controversies in data monitoring for clinical trials. Clin Trials. 2006;3:513–21.CrossRefPubMed
7.
go back to reference Pocock SJ. Interim analyses for randomized clinical trials: the group sequential approach. Biometrics. 1982;38:153–62.CrossRefPubMed Pocock SJ. Interim analyses for randomized clinical trials: the group sequential approach. Biometrics. 1982;38:153–62.CrossRefPubMed
8.
go back to reference O’Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics. 1979;35:549–56.CrossRefPubMed O’Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics. 1979;35:549–56.CrossRefPubMed
9.
go back to reference Geller NL, Pocock SJ. Interim analyses in randomized clinical trials: ramifications and guidelines for practitioners. Biometrics. 1987;43:213–23.CrossRefPubMed Geller NL, Pocock SJ. Interim analyses in randomized clinical trials: ramifications and guidelines for practitioners. Biometrics. 1987;43:213–23.CrossRefPubMed
10.
go back to reference DeMets DL, Pocock SJ, Julian DG. The agonising negative trend in monitoring of clinical trials. Lancet. 1999;354:1983–8.CrossRefPubMed DeMets DL, Pocock SJ, Julian DG. The agonising negative trend in monitoring of clinical trials. Lancet. 1999;354:1983–8.CrossRefPubMed
11.
12.
go back to reference Ellenberg SS, Fleming TR, DeMets DL. Data monitoring committees in clinical trials: a practical perspective. Chichester: Wiley; 2003. Ellenberg SS, Fleming TR, DeMets DL. Data monitoring committees in clinical trials: a practical perspective. Chichester: Wiley; 2003.
14.
go back to reference Fletcher RH, Fletcher SW. Clinical epidemiology: the essentials. 4th ed. Philadelphia: Lippincott Williams & Wilkins; 2005. Fletcher RH, Fletcher SW. Clinical epidemiology: the essentials. 4th ed. Philadelphia: Lippincott Williams & Wilkins; 2005.
15.
go back to reference Sinclair JC. Weighing risks and benefits in treating the individual patient. Clin Perinatol. 2003;30:251–68.CrossRefPubMed Sinclair JC. Weighing risks and benefits in treating the individual patient. Clin Perinatol. 2003;30:251–68.CrossRefPubMed
16.
go back to reference Marcucci M, Sinclair JC. A generalised model for individualising a treatment recommendation based on group-level evidence from randomised clinical trials. BMJ Open. 2013;3:e003143.CrossRefPubMedPubMedCentral Marcucci M, Sinclair JC. A generalised model for individualising a treatment recommendation based on group-level evidence from randomised clinical trials. BMJ Open. 2013;3:e003143.CrossRefPubMedPubMedCentral
18.
go back to reference McAlister FA, Straus SE, Guyatt GH, Haynes RB. Users’ guides to the medical literature: XX. Integrating research evidence with the care of the individual patient. Evidence-Based Medicine Working Group. JAMA. 2000;283:2829–36.CrossRefPubMed McAlister FA, Straus SE, Guyatt GH, Haynes RB. Users’ guides to the medical literature: XX. Integrating research evidence with the care of the individual patient. Evidence-Based Medicine Working Group. JAMA. 2000;283:2829–36.CrossRefPubMed
19.
go back to reference Andrews JC, Schünemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, et al. GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation’s direction and strength. J Clin Epidemiol. 2013;66:726–35.CrossRefPubMed Andrews JC, Schünemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, et al. GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation’s direction and strength. J Clin Epidemiol. 2013;66:726–35.CrossRefPubMed
20.
go back to reference Vandvik PO, Brandt L, Alonso-Coello P, Treweek S, Akl EA, Kristiansen A, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest. 2013;144:381–9.CrossRefPubMed Vandvik PO, Brandt L, Alonso-Coello P, Treweek S, Akl EA, Kristiansen A, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest. 2013;144:381–9.CrossRefPubMed
22.
go back to reference Fayers PM, Ashby D, Parmar MK. Tutorial in biostatistics: Bayesian data monitoring in clinical trials. Stat Med. 1997;16:1413–30.CrossRefPubMed Fayers PM, Ashby D, Parmar MK. Tutorial in biostatistics: Bayesian data monitoring in clinical trials. Stat Med. 1997;16:1413–30.CrossRefPubMed
23.
25.
go back to reference Harrell FE, Shih YC. Using full probability models to compute probabilities of actual interest to decision makers. Int J Technol Assess Health Care. 2001;17:17–26.CrossRefPubMed Harrell FE, Shih YC. Using full probability models to compute probabilities of actual interest to decision makers. Int J Technol Assess Health Care. 2001;17:17–26.CrossRefPubMed
26.
go back to reference Parmar MK, Griffiths GO, Spiegelhalter DJ, Souhami RL, Altman DG, van der Scheuren E, et al. Monitoring of large randomised clinical trials: a new approach with Bayesian methods. Lancet. 2001;358:375–81.CrossRefPubMed Parmar MK, Griffiths GO, Spiegelhalter DJ, Souhami RL, Altman DG, van der Scheuren E, et al. Monitoring of large randomised clinical trials: a new approach with Bayesian methods. Lancet. 2001;358:375–81.CrossRefPubMed
27.
go back to reference Wijeysundera DN, Austin PC, Hux JE, Beattie WS, Laupacis A. Bayesian statistical inference enhances the interpretation of contemporary randomized controlled trials. J Clin Epidemiol. 2009;62:13–21. e5.CrossRefPubMed Wijeysundera DN, Austin PC, Hux JE, Beattie WS, Laupacis A. Bayesian statistical inference enhances the interpretation of contemporary randomized controlled trials. J Clin Epidemiol. 2009;62:13–21. e5.CrossRefPubMed
28.
go back to reference Chalmers I, Sinclair JC. Promoting perinatal health: is it time for a change of emphasis in research? Early Hum Dev. 1985;10:171–91.CrossRefPubMed Chalmers I, Sinclair JC. Promoting perinatal health: is it time for a change of emphasis in research? Early Hum Dev. 1985;10:171–91.CrossRefPubMed
30.
go back to reference Hughes MD, Pocock SJ. Stopping rules and estimation problems in clinical trials. Stat Med. 1988;7:1231–42.CrossRefPubMed Hughes MD, Pocock SJ. Stopping rules and estimation problems in clinical trials. Stat Med. 1988;7:1231–42.CrossRefPubMed
31.
go back to reference Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010;303:1180–7.CrossRefPubMed Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010;303:1180–7.CrossRefPubMed
33.
go back to reference DeMets DL, Friedman LM, Furberg CD. Data Monitoring in clinical trials. New York: Springer; 2006.CrossRef DeMets DL, Friedman LM, Furberg CD. Data Monitoring in clinical trials. New York: Springer; 2006.CrossRef
34.
go back to reference Piantadosi S. Clinical trials: a methodologic perspective. 2nd ed. Hoboken: Wiley; 2005.CrossRef Piantadosi S. Clinical trials: a methodologic perspective. 2nd ed. Hoboken: Wiley; 2005.CrossRef
35.
go back to reference Demets DL. Futility approaches to interim monitoring by data monitoring committees. Clin Trials. 2006;3:522–9.CrossRefPubMed Demets DL. Futility approaches to interim monitoring by data monitoring committees. Clin Trials. 2006;3:522–9.CrossRefPubMed
36.
go back to reference Spiegelhalter DJ. Bayesian approaches to clinical trials and health care evaluation. Chichester: Wiley; 2004. Spiegelhalter DJ. Bayesian approaches to clinical trials and health care evaluation. Chichester: Wiley; 2004.
38.
go back to reference Saville BR, Connor JT, Ayers GD, Alvarez J. The utility of Bayesian predictive probabilities for interim monitoring of clinical trials. Clin Trials. 2014;11:485–93.CrossRefPubMedPubMedCentral Saville BR, Connor JT, Ayers GD, Alvarez J. The utility of Bayesian predictive probabilities for interim monitoring of clinical trials. Clin Trials. 2014;11:485–93.CrossRefPubMedPubMedCentral
39.
go back to reference Vickers AJ, Kattan MW, Sargent D. Method for evaluating prediction models that apply the results of randomized trials to individual patients. Trials. 2007;8:14.CrossRefPubMedPubMedCentral Vickers AJ, Kattan MW, Sargent D. Method for evaluating prediction models that apply the results of randomized trials to individual patients. Trials. 2007;8:14.CrossRefPubMedPubMedCentral
Metadata
Title
Stopping guidelines for an effectiveness trial: what should the protocol specify?
Authors
Jon E. Tyson
Claudia Pedroza
Dennis Wallace
Carl D’Angio
Edward F. Bell
Abhik Das
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1367-4

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue