Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Review

A framework for the design, conduct and interpretation of randomised controlled trials in the presence of treatment changes

Authors: Susanna Dodd, Ian R. White, Paula Williamson

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

When a randomised trial is subject to deviations from randomised treatment, analysis according to intention-to-treat does not estimate two important quantities: relative treatment efficacy and effectiveness in a setting different from that in the trial. Even in trials of a predominantly pragmatic nature, there may be numerous reasons to consider the extent, and impact on analysis, of such deviations from protocol. Simple methods such as per-protocol or as-treated analyses, which exclude or censor patients on the basis of their adherence, usually introduce selection and confounding biases. However, there exist appropriate causal estimation methods which seek to overcome these inherent biases, but these methods remain relatively unfamiliar and are rarely implemented in trials.

Methods

This paper demonstrates when it may be of interest to look beyond intention-to-treat analysis for answers to alternative causal research questions through illustrative case studies. We seek to guide trialists on how to handle treatment changes in the design, conduct and planning the analysis of a trial; these changes may be planned or unplanned, and may or may not be permitted in the protocol. We highlight issues that must be considered at the trial planning stage relating to: the definition of nonadherence and the causal research question of interest, trial design, data collection, monitoring, statistical analysis and sample size.

Results and conclusions

During trial planning, trialists should define their causal research questions of interest, anticipate the likely extent of treatment changes and use these to inform trial design, including the extent of data collection and data monitoring. A series of concise recommendations is presented to guide trialists when considering undertaking causal analyses.
Literature
1.
go back to reference World Health Organisation. In: Sabaté E, editor. Adherence to long-term therapies: evidence for action. Geneva: World Health Organisation; 2003. p. 212. World Health Organisation. In: Sabaté E, editor. Adherence to long-term therapies: evidence for action. Geneva: World Health Organisation; 2003. p. 212.
2.
go back to reference Haynes RB, McDonald HP, Garg AX. Helping patients follow prescribed treatment. JAMA. 2002;288(22):2880–3.CrossRefPubMed Haynes RB, McDonald HP, Garg AX. Helping patients follow prescribed treatment. JAMA. 2002;288(22):2880–3.CrossRefPubMed
3.
go back to reference Donovan J. Patient decision making: the missing ingredient in compliance research. Int J Technol Assess Health Care. 1995;11(3):443–55.CrossRefPubMed Donovan J. Patient decision making: the missing ingredient in compliance research. Int J Technol Assess Health Care. 1995;11(3):443–55.CrossRefPubMed
4.
5.
go back to reference White IR. Uses and limitations of randomization-based efficacy estimators. Stat Methods Med Res. 2005;14:327–47.CrossRefPubMed White IR. Uses and limitations of randomization-based efficacy estimators. Stat Methods Med Res. 2005;14:327–47.CrossRefPubMed
6.
go back to reference Latimer NR, Abrams KR, Lambert PC, Crowther MJ, Wailoo AJ, Morden JP, et al. Adjusting survival time estimates to account for treatment switching in randomized controlled trials—an economic evaluation context: methods, limitations, and recommendations. Med Decis Mak. 2014;34(3):387–402.CrossRef Latimer NR, Abrams KR, Lambert PC, Crowther MJ, Wailoo AJ, Morden JP, et al. Adjusting survival time estimates to account for treatment switching in randomized controlled trials—an economic evaluation context: methods, limitations, and recommendations. Med Decis Mak. 2014;34(3):387–402.CrossRef
7.
8.
go back to reference Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19(3):237–70.CrossRefPubMed Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19(3):237–70.CrossRefPubMed
9.
go back to reference Sheiner LB, Rubin DB. Intention-to-treat analysis and the goals of clinical trials. Clin Pharmacol Ther. 1995;57(1):6–15.CrossRefPubMed Sheiner LB, Rubin DB. Intention-to-treat analysis and the goals of clinical trials. Clin Pharmacol Ther. 1995;57(1):6–15.CrossRefPubMed
10.
go back to reference Bellamy SL, Lin JY, Have TRT. An introduction to causal modeling in clinical trials. Clin Trials. 2007;4(1):58–73.CrossRefPubMed Bellamy SL, Lin JY, Have TRT. An introduction to causal modeling in clinical trials. Clin Trials. 2007;4(1):58–73.CrossRefPubMed
11.
go back to reference Dodd S, Williamson P, White I. Adjustment for treatment changes in epilepsy trials: a comparison of causal methods for time-to-event outcomes. Statistical Methods in Medical Research. 2017. In press. Dodd S, Williamson P, White I. Adjustment for treatment changes in epilepsy trials: a comparison of causal methods for time-to-event outcomes. Statistical Methods in Medical Research. 2017. In press.
12.
go back to reference White IR, Babiker AG, Walker S, Darbyshire JH. Randomization-based methods for correcting for treatment changes: examples from the Concorde trial. Stat Med. 1999;18:2617–34.CrossRefPubMed White IR, Babiker AG, Walker S, Darbyshire JH. Randomization-based methods for correcting for treatment changes: examples from the Concorde trial. Stat Med. 1999;18:2617–34.CrossRefPubMed
13.
go back to reference Working Party MRC. Medical Research Council trial of treatment of hypertension in older adults: principal results. BMJ. 1992;304(6824):405–12.CrossRef Working Party MRC. Medical Research Council trial of treatment of hypertension in older adults: principal results. BMJ. 1992;304(6824):405–12.CrossRef
14.
go back to reference White IR, Pocock SJ. Statistical reporting of clinical trials with individual changes from allocated treatment. Stat Med. 1996;15(3):249–62.CrossRefPubMed White IR, Pocock SJ. Statistical reporting of clinical trials with individual changes from allocated treatment. Stat Med. 1996;15(3):249–62.CrossRefPubMed
15.
go back to reference White IR, Goetghebeur EJT. Clinical trials comparing two treatment policies: which aspects of the treatment policies make a difference? Stat Med. 1998;17(3):319–39.CrossRefPubMed White IR, Goetghebeur EJT. Clinical trials comparing two treatment policies: which aspects of the treatment policies make a difference? Stat Med. 1998;17(3):319–39.CrossRefPubMed
16.
go back to reference Marson A, Al-Kharusi A, Alwaidh M, Appleton R, Baker G, Chadwick D, et al. The SANAD study of effectiveness of carbamazepine, gabapentin, lamotrigine, oxcarbazepine, or topiramate for treatment of partial epilepsy: an unblinded randomised controlled trial. Lancet. 2007;369:1000–15.CrossRefPubMedPubMedCentral Marson A, Al-Kharusi A, Alwaidh M, Appleton R, Baker G, Chadwick D, et al. The SANAD study of effectiveness of carbamazepine, gabapentin, lamotrigine, oxcarbazepine, or topiramate for treatment of partial epilepsy: an unblinded randomised controlled trial. Lancet. 2007;369:1000–15.CrossRefPubMedPubMedCentral
17.
go back to reference Marson A, Al-Kharusi A, Alwaidh M, Appleton R, Baker G, Chadwick D, et al. The SANAD study of effectiveness of valproate, lamotrigine or topiramate for generalised and unclassifiable epilepsy: an unblinded randomised controlled trial. Lancet. 2007;369:1016–26.CrossRefPubMedPubMedCentral Marson A, Al-Kharusi A, Alwaidh M, Appleton R, Baker G, Chadwick D, et al. The SANAD study of effectiveness of valproate, lamotrigine or topiramate for generalised and unclassifiable epilepsy: an unblinded randomised controlled trial. Lancet. 2007;369:1016–26.CrossRefPubMedPubMedCentral
18.
go back to reference Sommer A, Djunaedi E, Loeden AA, Tarwotjo I, West Jr K, Tilden R, et al. Impact of vitamin A supplementation on childhood mortality: a randomised controlled community trial. Lancet. 1986;327(8491):1169–73.CrossRef Sommer A, Djunaedi E, Loeden AA, Tarwotjo I, West Jr K, Tilden R, et al. Impact of vitamin A supplementation on childhood mortality: a randomised controlled community trial. Lancet. 1986;327(8491):1169–73.CrossRef
19.
go back to reference Robson V, Dodd S, Thomas S. Standardized antibacterial honey (Medihoney™) with standard therapy in wound care: randomized clinical trial. J Adv Nurs. 2009;65(3):565–75.CrossRefPubMed Robson V, Dodd S, Thomas S. Standardized antibacterial honey (Medihoney™) with standard therapy in wound care: randomized clinical trial. J Adv Nurs. 2009;65(3):565–75.CrossRefPubMed
20.
go back to reference The Coronary Drug Project Research Group. Influence of adherence to treatment and response of cholesterol on mortality in the Coronary Drug Project. N Engl J Med. 1980;303:1038–41.CrossRef The Coronary Drug Project Research Group. Influence of adherence to treatment and response of cholesterol on mortality in the Coronary Drug Project. N Engl J Med. 1980;303:1038–41.CrossRef
21.
go back to reference Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14:369–95.CrossRefPubMed Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14:369–95.CrossRefPubMed
22.
go back to reference Hirano K, Imbens GW, Rubin DB, Zhou X-H. Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics. 2000;1(1):69–88.CrossRefPubMed Hirano K, Imbens GW, Rubin DB, Zhou X-H. Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics. 2000;1(1):69–88.CrossRefPubMed
23.
go back to reference Fischer-Lapp K, Goetghebeur E. Practical properties of some structural mean analyses of the effect of compliance in randomized trials. Control Clin Trials. 1999;20(6):531–46.CrossRefPubMed Fischer-Lapp K, Goetghebeur E. Practical properties of some structural mean analyses of the effect of compliance in randomized trials. Control Clin Trials. 1999;20(6):531–46.CrossRefPubMed
24.
go back to reference Dunn G, Maracy M, Dowrick C, Ayuso-Mateos JL, Dalgard OS, Page H, et al. Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. Br J Psychiatry J Ment Sci. 2003;183:323–31.CrossRef Dunn G, Maracy M, Dowrick C, Ayuso-Mateos JL, Dalgard OS, Page H, et al. Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. Br J Psychiatry J Ment Sci. 2003;183:323–31.CrossRef
25.
go back to reference Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24(10):1455–81.CrossRefPubMed Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24(10):1455–81.CrossRefPubMed
26.
27.
go back to reference Lunceford JK, Davidian M, Tsiatis AA. Estimation of survival distributions of treatment policies in two-stage randomization designs in clinical trials. Biometrics. 2002;58(1):48–57.CrossRefPubMed Lunceford JK, Davidian M, Tsiatis AA. Estimation of survival distributions of treatment policies in two-stage randomization designs in clinical trials. Biometrics. 2002;58(1):48–57.CrossRefPubMed
28.
go back to reference Shortreed SM, Moodie EEM. Estimating the optimal dynamic antipsychotic treatment regime: evidence from the sequential multiple-assignment randomized Clinical Antipsychotic Trials of Intervention and Effectiveness Schizophrenia Study. J R Stat Soc: Ser C: Appl Stat. 2012;61(4):577–99.CrossRef Shortreed SM, Moodie EEM. Estimating the optimal dynamic antipsychotic treatment regime: evidence from the sequential multiple-assignment randomized Clinical Antipsychotic Trials of Intervention and Effectiveness Schizophrenia Study. J R Stat Soc: Ser C: Appl Stat. 2012;61(4):577–99.CrossRef
30.
go back to reference Dusing R, Lottermoser K, Mengden T. Compliance with drug therapy—new answers to an old question. Nephrol Dial Transplant. 2001;16(7):1317–21.CrossRefPubMed Dusing R, Lottermoser K, Mengden T. Compliance with drug therapy—new answers to an old question. Nephrol Dial Transplant. 2001;16(7):1317–21.CrossRefPubMed
32.
go back to reference Vrijens B, De Geest S, Hughes DA, Przemyslaw K, Demonceau J, Ruppar T, et al. A new taxonomy for describing and defining adherence to medications. Br J Clin Pharmacol. 2012;73(5):691–705.CrossRefPubMedPubMedCentral Vrijens B, De Geest S, Hughes DA, Przemyslaw K, Demonceau J, Ruppar T, et al. A new taxonomy for describing and defining adherence to medications. Br J Clin Pharmacol. 2012;73(5):691–705.CrossRefPubMedPubMedCentral
33.
go back to reference Frangakis CE, Rubin DB. Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika. 1999;86(2):365–79.CrossRef Frangakis CE, Rubin DB. Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika. 1999;86(2):365–79.CrossRef
34.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, CONSORT, et al. Explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;2010:340. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, CONSORT, et al. Explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;2010:340.
35.
go back to reference Pocock SJ, Abdalla M. The hope and the hazards of using compliance data in randomized controlled trials. Stat Med. 1998;17(3):303–17.CrossRefPubMed Pocock SJ, Abdalla M. The hope and the hazards of using compliance data in randomized controlled trials. Stat Med. 1998;17(3):303–17.CrossRefPubMed
36.
go back to reference Serebruany V, Oshrine B, Alex I, Atar D, Michelson A, Ferguson J. Noncompliance in cardiovascular clinical trials. Am Heart J. 2005;150:882–6.CrossRefPubMed Serebruany V, Oshrine B, Alex I, Atar D, Michelson A, Ferguson J. Noncompliance in cardiovascular clinical trials. Am Heart J. 2005;150:882–6.CrossRefPubMed
37.
go back to reference International Conference on Harmonisation E9 Expert Working Group. ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. Statistics in Medicine. 1999;18(15):1905–42. International Conference on Harmonisation E9 Expert Working Group. ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. Statistics in Medicine. 1999;18(15):1905–42.
39.
go back to reference Newcombe RG. Explanatory and pragmatic estimates of the treatment effect when deviations from allocated treatment occur. Stat Med. 1988;7(11):1179–86.CrossRefPubMed Newcombe RG. Explanatory and pragmatic estimates of the treatment effect when deviations from allocated treatment occur. Stat Med. 1988;7(11):1179–86.CrossRefPubMed
Metadata
Title
A framework for the design, conduct and interpretation of randomised controlled trials in the presence of treatment changes
Authors
Susanna Dodd
Ian R. White
Paula Williamson
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-2240-9

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue