Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Assessing methods for dealing with treatment switching in randomised controlled trials: a simulation study

Authors: James P Morden, Paul C Lambert, Nicholas Latimer, Keith R Abrams, Allan J Wailoo

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

We investigate methods used to analyse the results of clinical trials with survival outcomes in which some patients switch from their allocated treatment to another trial treatment. These included simple methods which are commonly used in medical literature and may be subject to selection bias if patients switching are not typical of the population as a whole. Methods which attempt to adjust the estimated treatment effect, either through adjustment to the hazard ratio or via accelerated failure time models, were also considered. A simulation study was conducted to assess the performance of each method in a number of different scenarios.

Results

16 different scenarios were identified which differed by the proportion of patients switching, underlying prognosis of switchers and the size of true treatment effect. 1000 datasets were simulated for each of these and all methods applied. Selection bias was observed in simple methods when the difference in survival between switchers and non-switchers were large. A number of methods, particularly the AFT method of Branson and Whitehead were found to give less biased estimates of the true treatment effect in these situations.

Conclusions

Simple methods are often not appropriate to deal with treatment switching. Alternative approaches such as the Branson & Whitehead method to adjust for switching should be considered.
Appendix
Available only for authorised users
Literature
1.
go back to reference Peduzzi P, Wittes J, Detre K: Analysis as-randomized and the problem of nonadherence - An example from the Veterans Affairs randomized trial of coronary-artery bypass-surgery. Statistics in Medicine. 1993, 12 (13): 1185-1195. 10.1002/sim.4780121102.CrossRefPubMed Peduzzi P, Wittes J, Detre K: Analysis as-randomized and the problem of nonadherence - An example from the Veterans Affairs randomized trial of coronary-artery bypass-surgery. Statistics in Medicine. 1993, 12 (13): 1185-1195. 10.1002/sim.4780121102.CrossRefPubMed
2.
go back to reference Tappenden P, Chilcott J, Ward S, Eggington S, Hind D, Hummel S: Methodological issues in the economic analysis of cancer treatments. European Journal of Cancer. 2006, 42 (17): 2867-2875. 10.1016/j.ejca.2006.08.010.CrossRefPubMed Tappenden P, Chilcott J, Ward S, Eggington S, Hind D, Hummel S: Methodological issues in the economic analysis of cancer treatments. European Journal of Cancer. 2006, 42 (17): 2867-2875. 10.1016/j.ejca.2006.08.010.CrossRefPubMed
3.
go back to reference White IR, Carpenter J, Pocock SJ, Henderson RA: Adjusting treatment comparisons to account for non-randomized interventions: an example from an angina trial. Statistics in Medicine. 2003, 22 (5): 781-793. 10.1002/sim.1369.CrossRefPubMed White IR, Carpenter J, Pocock SJ, Henderson RA: Adjusting treatment comparisons to account for non-randomized interventions: an example from an angina trial. Statistics in Medicine. 2003, 22 (5): 781-793. 10.1002/sim.1369.CrossRefPubMed
6.
go back to reference White IR: Uses and limitations of randomization-based efficacy estimators. Statistical Methods in Medical Research. 2005, 14 (4): 327-347. 10.1191/0962280205sm406oa.CrossRefPubMed White IR: Uses and limitations of randomization-based efficacy estimators. Statistical Methods in Medical Research. 2005, 14 (4): 327-347. 10.1191/0962280205sm406oa.CrossRefPubMed
7.
go back to reference Lee Y, Ellenberg J, Hirtz D, Nelson K: Analysis of clinical trials by treatment actually received: is it really an option?. Stat Med. 1991, 10: 1595-1605. 10.1002/sim.4780101011.CrossRefPubMed Lee Y, Ellenberg J, Hirtz D, Nelson K: Analysis of clinical trials by treatment actually received: is it really an option?. Stat Med. 1991, 10: 1595-1605. 10.1002/sim.4780101011.CrossRefPubMed
8.
go back to reference Fergusson D, Aaron SD, Guyatt G, Herbert P: Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis. BMJ. 2002, 325: 652-654. 10.1136/bmj.325.7365.652.CrossRefPubMedPubMedCentral Fergusson D, Aaron SD, Guyatt G, Herbert P: Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis. BMJ. 2002, 325: 652-654. 10.1136/bmj.325.7365.652.CrossRefPubMedPubMedCentral
9.
go back to reference Goetghebeur E, Loeys T: Beyond intention to treat. Epidemiologic Reviews. 2002, 24: 85-90. 10.1093/epirev/24.1.85.CrossRefPubMed Goetghebeur E, Loeys T: Beyond intention to treat. Epidemiologic Reviews. 2002, 24: 85-90. 10.1093/epirev/24.1.85.CrossRefPubMed
10.
go back to reference Horwitz R, Horwitz S: Adherence to treatment and health outcomes. Arch Intern Med. 1993, 153: 1863-1868. 10.1001/archinte.153.16.1863.CrossRefPubMed Horwitz R, Horwitz S: Adherence to treatment and health outcomes. Arch Intern Med. 1993, 153: 1863-1868. 10.1001/archinte.153.16.1863.CrossRefPubMed
11.
go back to reference White IR, Walker S, Babiker AG, Darbyshire JH: Impact of treatment changes on the interpretation of the Concorde trial. Aids. 1997, 11 (8): 999-1006. 10.1097/00002030-199708000-00008.CrossRefPubMed White IR, Walker S, Babiker AG, Darbyshire JH: Impact of treatment changes on the interpretation of the Concorde trial. Aids. 1997, 11 (8): 999-1006. 10.1097/00002030-199708000-00008.CrossRefPubMed
12.
go back to reference Law MG, Kaldor JM: Survival analyses of randomized clinical trials adjusted for patients who switch treatments. Statistics in Medicine. 1996, 15: 2069-2076. 10.1002/(SICI)1097-0258(19961015)15:19<2069::AID-SIM347>3.0.CO;2-V.CrossRefPubMed Law MG, Kaldor JM: Survival analyses of randomized clinical trials adjusted for patients who switch treatments. Statistics in Medicine. 1996, 15: 2069-2076. 10.1002/(SICI)1097-0258(19961015)15:19<2069::AID-SIM347>3.0.CO;2-V.CrossRefPubMed
13.
go back to reference White IR: Letters to the editor: Survival analyses of randomized clinical trials adjusted for patients who switch treatments. Statistics in Medicine. 1997, 16: 2619-2625. 10.1002/(SICI)1097-0258(19971130)16:22<2619::AID-SIM699>3.0.CO;2-X.CrossRefPubMed White IR: Letters to the editor: Survival analyses of randomized clinical trials adjusted for patients who switch treatments. Statistics in Medicine. 1997, 16: 2619-2625. 10.1002/(SICI)1097-0258(19971130)16:22<2619::AID-SIM699>3.0.CO;2-X.CrossRefPubMed
14.
go back to reference Loeys T, Goetghebeur E: A causal proportional hazards estimator for the effect of treatment actually received in a randomized trial with all-or-nothing compliance. Biometrics. 2003, 59: 100-105. 10.1111/1541-0420.00012.CrossRefPubMed Loeys T, Goetghebeur E: A causal proportional hazards estimator for the effect of treatment actually received in a randomized trial with all-or-nothing compliance. Biometrics. 2003, 59: 100-105. 10.1111/1541-0420.00012.CrossRefPubMed
15.
go back to reference Kim LG, White IR: Compliance-adjusted intervention effects in survival data. The Stata Journal. 2004, 4 (Number 3): 257-264. Kim LG, White IR: Compliance-adjusted intervention effects in survival data. The Stata Journal. 2004, 4 (Number 3): 257-264.
16.
go back to reference Rubin D: More powerful randomization-based p-values in double-blind trials with non-compliance. Statistics in Medicine. 1998, 17: 371-385. 10.1002/(SICI)1097-0258(19980215)17:3<371::AID-SIM768>3.0.CO;2-O.CrossRefPubMed Rubin D: More powerful randomization-based p-values in double-blind trials with non-compliance. Statistics in Medicine. 1998, 17: 371-385. 10.1002/(SICI)1097-0258(19980215)17:3<371::AID-SIM768>3.0.CO;2-O.CrossRefPubMed
18.
go back to reference Jo B: Model misspecification sensitivity analysis in estimating causal effects of interventions with non-compliance. Statistics in Medicine. 2002, 21: 3161-3181. 10.1002/sim.1267.CrossRefPubMed Jo B: Model misspecification sensitivity analysis in estimating causal effects of interventions with non-compliance. Statistics in Medicine. 2002, 21: 3161-3181. 10.1002/sim.1267.CrossRefPubMed
19.
go back to reference Collett D: Modelling survival data in medical research. 2003, Chapman and Hall Collett D: Modelling survival data in medical research. 2003, Chapman and Hall
20.
go back to reference Robins JM, Tsiatis AA: Correcting for non-compliance in randomized trials using rank preserving structural failure time models. Communications in Statistics-Theory and Methods. 1991, 20 (8): 2609-2631. 10.1080/03610929108830654.CrossRef Robins JM, Tsiatis AA: Correcting for non-compliance in randomized trials using rank preserving structural failure time models. Communications in Statistics-Theory and Methods. 1991, 20 (8): 2609-2631. 10.1080/03610929108830654.CrossRef
21.
go back to reference White IR, Walker S, Babiker A: strbee: Randomization-based efficacy estimator. The Stata Journal. 2002, 2 (Number 2): 140-150. White IR, Walker S, Babiker A: strbee: Randomization-based efficacy estimator. The Stata Journal. 2002, 2 (Number 2): 140-150.
22.
go back to reference White IR, Babiker AG, Walker S, Darbyshire JH: Randomization-based methods for correcting for treatment changes: Examples from the Concorde trial. Statistics in Medicine. 1999, 18 (19): 2617-2634. 10.1002/(SICI)1097-0258(19991015)18:19<2617::AID-SIM187>3.0.CO;2-E.CrossRefPubMed White IR, Babiker AG, Walker S, Darbyshire JH: Randomization-based methods for correcting for treatment changes: Examples from the Concorde trial. Statistics in Medicine. 1999, 18 (19): 2617-2634. 10.1002/(SICI)1097-0258(19991015)18:19<2617::AID-SIM187>3.0.CO;2-E.CrossRefPubMed
23.
go back to reference Branson M, Whitehead J: Estimating a treatment effect in survival studies in which patients switch treatment. Statistics in Medicine. 2002, 21: 2449-2463. 10.1002/sim.1219.CrossRefPubMed Branson M, Whitehead J: Estimating a treatment effect in survival studies in which patients switch treatment. Statistics in Medicine. 2002, 21: 2449-2463. 10.1002/sim.1219.CrossRefPubMed
24.
go back to reference Efron B, Tibshirini R: An introduction to the bootstrap. 1993, Monographs on Statistics and Applied Probability. Chapman and Hall LondonCrossRef Efron B, Tibshirini R: An introduction to the bootstrap. 1993, Monographs on Statistics and Applied Probability. Chapman and Hall LondonCrossRef
25.
go back to reference Walker AS, White IR, Babiker AG: Parametric randomization-based methods for correcting for treatment changes in the assessment of the causal effect of treatment. Statistics in Medicine. 2004, 23 (4): 571-590. 10.1002/sim.1618.CrossRefPubMed Walker AS, White IR, Babiker AG: Parametric randomization-based methods for correcting for treatment changes in the assessment of the causal effect of treatment. Statistics in Medicine. 2004, 23 (4): 571-590. 10.1002/sim.1618.CrossRefPubMed
26.
go back to reference Hougaard P: A class of multivariate failure time distributions. Biometrika. 1986, 73 (3): 671-678. Hougaard P: A class of multivariate failure time distributions. Biometrika. 1986, 73 (3): 671-678.
27.
go back to reference Oakes D: Bivariate survival models induced by frailties. Journal of the American Statistical Association. 1989, 84 (406): 487-493. 10.2307/2289934.CrossRef Oakes D: Bivariate survival models induced by frailties. Journal of the American Statistical Association. 1989, 84 (406): 487-493. 10.2307/2289934.CrossRef
30.
go back to reference Bender R, Augustin T, Blettner M: Generating survival times to simulate Cox proportional hazards models. Statistics in Medicine. 2005, 24: 1713-1723. 10.1002/sim.2059.CrossRefPubMed Bender R, Augustin T, Blettner M: Generating survival times to simulate Cox proportional hazards models. Statistics in Medicine. 2005, 24: 1713-1723. 10.1002/sim.2059.CrossRefPubMed
31.
go back to reference Coleman M, Babb P, Damieckil P, Grosclaude P, Honjo S, Jones J, Knerer G, Pitard A, Quinn M, Sloggett A, De Stavola B: Cancer survival trends in England and Wales, 1971-1995: deprivation and NHS region. 1999, Office of National Statistics Coleman M, Babb P, Damieckil P, Grosclaude P, Honjo S, Jones J, Knerer G, Pitard A, Quinn M, Sloggett A, De Stavola B: Cancer survival trends in England and Wales, 1971-1995: deprivation and NHS region. 1999, Office of National Statistics
32.
go back to reference Lambert P, Smith L, Jones D, Botha J: Additive and multiplicative covariate regression models for relative survival incorporating fractional polynomials for time-dependent effects. Statistics in Medicine. 2005, 24: 3871-3885. 10.1002/sim.2399.CrossRefPubMed Lambert P, Smith L, Jones D, Botha J: Additive and multiplicative covariate regression models for relative survival incorporating fractional polynomials for time-dependent effects. Statistics in Medicine. 2005, 24: 3871-3885. 10.1002/sim.2399.CrossRefPubMed
33.
go back to reference Burton A, Altman DG, Royston P, Holder RL: The design of simulation studies in medical statistics. Statistics in Medicine. 2006, 25: 4279-4292. 10.1002/sim.2673.CrossRefPubMed Burton A, Altman DG, Royston P, Holder RL: The design of simulation studies in medical statistics. Statistics in Medicine. 2006, 25: 4279-4292. 10.1002/sim.2673.CrossRefPubMed
34.
go back to reference Bradburn M, Clark T, Love S, Altman D: Survival analysis part II: Mulitvariate data analysis - an introduction to concepts and methods. British Journal of Cancer. 2003, 89: 431-436. 10.1038/sj.bjc.6601119.CrossRefPubMedPubMedCentral Bradburn M, Clark T, Love S, Altman D: Survival analysis part II: Mulitvariate data analysis - an introduction to concepts and methods. British Journal of Cancer. 2003, 89: 431-436. 10.1038/sj.bjc.6601119.CrossRefPubMedPubMedCentral
35.
go back to reference White IR: Letter to the editor: Estimating treatment effects in randomized trials with treatment switching. Statistics in Medicine. 2006, 25: 1619-1622. 10.1002/sim.2453.CrossRef White IR: Letter to the editor: Estimating treatment effects in randomized trials with treatment switching. Statistics in Medicine. 2006, 25: 1619-1622. 10.1002/sim.2453.CrossRef
36.
go back to reference White IR, Pocock SJ: Statistical reporting of clinical trials with individual changes from allocated treatment. Statistics in Medicine. 1996, 15 (3): 249-262. 10.1002/(SICI)1097-0258(19960215)15:3<249::AID-SIM160>3.0.CO;2-J.CrossRefPubMed White IR, Pocock SJ: Statistical reporting of clinical trials with individual changes from allocated treatment. Statistics in Medicine. 1996, 15 (3): 249-262. 10.1002/(SICI)1097-0258(19960215)15:3<249::AID-SIM160>3.0.CO;2-J.CrossRefPubMed
39.
go back to reference Hernan M, Lanoy E, Costagliola D, Robins J: Comparison of Dynamic Treatment Regimes via Inverse Probability Weighting. Basic and Clinical Pharmacology and Toxicology. 2006, 98: 237-242. 10.1111/j.1742-7843.2006.pto_329.x.CrossRefPubMed Hernan M, Lanoy E, Costagliola D, Robins J: Comparison of Dynamic Treatment Regimes via Inverse Probability Weighting. Basic and Clinical Pharmacology and Toxicology. 2006, 98: 237-242. 10.1111/j.1742-7843.2006.pto_329.x.CrossRefPubMed
40.
go back to reference Shao J, Chang M, Chow S: Statistical inference for cancer trials with treatment switching. Statistics in Medicine. 2005, 24: 1783-1790. 10.1002/sim.2128.CrossRefPubMed Shao J, Chang M, Chow S: Statistical inference for cancer trials with treatment switching. Statistics in Medicine. 2005, 24: 1783-1790. 10.1002/sim.2128.CrossRefPubMed
41.
go back to reference Odondi L, McNamee R: Performance of statistical methods for analysing survival data in the presence of non-random compliance. Statistics in Medicine. 2010, 29: 2994-3003. 10.1002/sim.4070.CrossRefPubMed Odondi L, McNamee R: Performance of statistical methods for analysing survival data in the presence of non-random compliance. Statistics in Medicine. 2010, 29: 2994-3003. 10.1002/sim.4070.CrossRefPubMed
42.
go back to reference NICE: Bevacizumab (first-line), sorafenib (first- and second-line), sunitinib (second-line) and temsirolimus (first-line) for the treatment of advanced and/or metastatic renal cell carcinoma. (TA 178). TA 178. 2009, [http://guidance.nice.org.uk/TA178] NICE: Bevacizumab (first-line), sorafenib (first- and second-line), sunitinib (second-line) and temsirolimus (first-line) for the treatment of advanced and/or metastatic renal cell carcinoma. (TA 178). TA 178. 2009, [http://​guidance.​nice.​org.​uk/​TA178]
Metadata
Title
Assessing methods for dealing with treatment switching in randomised controlled trials: a simulation study
Authors
James P Morden
Paul C Lambert
Nicholas Latimer
Keith R Abrams
Allan J Wailoo
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-4

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue