Skip to main content
Top
Published in: Trials 1/2023

Open Access 01-12-2023 | Research

Cross-sectional analysis characterizing the use of rank preserving structural failure time in oncology studies: changes to hazard ratio and frequency of inappropriate use

Authors: Vinay Prasad, Myung Sun Kim, Alyson Haslam

Published in: Trials | Issue 1/2023

Login to get access

Abstract

Background

Rank preserving structural failure time (RPSFT) is a statistical method to correct or adjust for crossover in clinical trials, by estimating the counterfactual effect on overall survival (OS) when control arm patients do not receive the interventional drug when their tumor progresses. We sought to examine the strength of correlation between differences in uncorrected and corrected OS hazard ratios and percentage of crossover, and characterize instances of fundamental and sequential efficacy.

Methods

In a cross-sectional analysis (2003–2023), we reviewed oncology randomized trials that used RPSFT analysis to adjust the OS hazard ratio for patients who crossed over to an anti-cancer drug. We calculated the percentage of RPSFT studies evaluating a drug for fundamental efficacy (with or without a standard of care (SOC)) or sequential efficacy and the correlation between the OS hazard ratio difference (unadjusted and adjusted) and the percentage of crossover.

Results

Among 65 studies, the median difference between the uncorrected and corrected OS hazard ratio was −0.1 (quartile 1, quartile 3 : −0.3 to −0.06). The median percentage of crossover was 56% (quartile 1, quartile 3: 37% to 72%). All studies were funded by the industry or had authors who were employees of the industry. Twelve studies (19%) tested a drug’s fundamental efficacy when there was no SOC; 34 studies (52%) tested a drug’s fundamental efficacy when there was already a SOC; and 19 studies (29%) tested a drug’s sequential efficacy. The correlation between the uncorrected and corrected OS hazard ratio difference and the percentage of crossover was 0.44 (95% CI: 0.21 to 0.63).

Conclusions

RPSFT is a common tactic used by the industry to reinterpret trial results. Nineteen percent of RPSFT use is appropriate. We recognize that while crossover can bias OS results, the allowance and handling of crossover in trials should be limited to appropriate circumstances.
Appendix
Available only for authorised users
Literature
1.
go back to reference Robins JM, Tsiatis AA. Correcting for non-compliance in randomized trials using rank preserving structural failure time models. Commun Stat. 1991;20(8):2609–31.CrossRef Robins JM, Tsiatis AA. Correcting for non-compliance in randomized trials using rank preserving structural failure time models. Commun Stat. 1991;20(8):2609–31.CrossRef
2.
go back to reference Watkins C, Huang X, Latimer N, Tang Y, Wright EJ. Adjusting overall survival for treatment switches: commonly used methods and practical application. Pharm Stat. 2013;12(6):348–57.CrossRefPubMed Watkins C, Huang X, Latimer N, Tang Y, Wright EJ. Adjusting overall survival for treatment switches: commonly used methods and practical application. Pharm Stat. 2013;12(6):348–57.CrossRefPubMed
3.
go back to reference Ouwens M, Hauch O, Franzén S. A validation study of the rank-preserving structural failure time model: confidence intervals and unique, multiple, and erroneous solutions. Med Decis Mak. 2018;38(4):509–19.CrossRef Ouwens M, Hauch O, Franzén S. A validation study of the rank-preserving structural failure time model: confidence intervals and unique, multiple, and erroneous solutions. Med Decis Mak. 2018;38(4):509–19.CrossRef
4.
go back to reference Latimer NR, Abrams KR, Lambert PC, Crowther MJ, Wailoo AJ, Morden JP, et al. Adjusting survival time estimates to account for treatment switching in randomized controlled trials–an economic evaluation context: methods, limitations, and recommendations. Med Decis Mak. 2014;34(3):387–402.CrossRef Latimer NR, Abrams KR, Lambert PC, Crowther MJ, Wailoo AJ, Morden JP, et al. Adjusting survival time estimates to account for treatment switching in randomized controlled trials–an economic evaluation context: methods, limitations, and recommendations. Med Decis Mak. 2014;34(3):387–402.CrossRef
7.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
8.
9.
go back to reference R Core Team. R: A language and environment for statistical## computing. R Foundation for Statistical Computing. Vienna: R Core Team; 2021. R Core Team. R: A language and environment for statistical## computing. R Foundation for Statistical Computing. Vienna: R Core Team; 2021.
10.
go back to reference Wickham H. ggplot2 - Elegant Graphics for Data Analysis. 2nd ed. Cham: Springer International Publishing; 2016. Wickham H. ggplot2 - Elegant Graphics for Data Analysis. 2nd ed. Cham: Springer International Publishing; 2016.
11.
go back to reference Garner M, Lemon J, Fellows I, Singh P. irr: Various Coefficients of Interrater Reliability and Agreement. Matthias Gamer; 2019. Garner M, Lemon J, Fellows I, Singh P. irr: Various Coefficients of Interrater Reliability and Agreement. Matthias Gamer; 2019.
12.
go back to reference Balduzzi S, Rücker G, Schwarzer G. How to perform a meta-analysis with R: a practical tutorial. Evid Based Ment Health. 2019;22(4):153–60.CrossRefPubMed Balduzzi S, Rücker G, Schwarzer G. How to perform a meta-analysis with R: a practical tutorial. Evid Based Ment Health. 2019;22(4):153–60.CrossRefPubMed
13.
go back to reference Haslam A, Lythgoe MP, Greenstreet Akman E, Prasad V. Characteristics of Cost-effectiveness Studies for Oncology Drugs Approved in the United States From 2015–2020. JAMA Netw Open. 2021;4(11): e2135123.CrossRefPubMedPubMedCentral Haslam A, Lythgoe MP, Greenstreet Akman E, Prasad V. Characteristics of Cost-effectiveness Studies for Oncology Drugs Approved in the United States From 2015–2020. JAMA Netw Open. 2021;4(11): e2135123.CrossRefPubMedPubMedCentral
14.
go back to reference Ishak KJ, Proskorovsky I, Korytowsky B, Sandin R, Faivre S, Valle J. Methods for adjusting for bias due to crossover in oncology trials. Pharmacoeconomics. 2014;32(6):533–46.CrossRefPubMed Ishak KJ, Proskorovsky I, Korytowsky B, Sandin R, Faivre S, Valle J. Methods for adjusting for bias due to crossover in oncology trials. Pharmacoeconomics. 2014;32(6):533–46.CrossRefPubMed
15.
go back to reference Jönsson L, Sandin R, Ekman M, Ramsberg J, Charbonneau C, Huang X, et al. Analyzing overall survival in randomized controlled trials with crossover and implications for economic evaluation. Value Health. 2014;17(6):707–13.CrossRefPubMed Jönsson L, Sandin R, Ekman M, Ramsberg J, Charbonneau C, Huang X, et al. Analyzing overall survival in randomized controlled trials with crossover and implications for economic evaluation. Value Health. 2014;17(6):707–13.CrossRefPubMed
16.
go back to reference Fojo T, Mailankody S, Lo A. Unintended consequences of expensive cancer therapeutics—the pursuit of marginal indications and a me-too mentality that stifles innovation and creativity: the John Conley Lecture. JAMA Otolaryngol Head Neck Surg. 2014;140(12):1225–36.CrossRefPubMed Fojo T, Mailankody S, Lo A. Unintended consequences of expensive cancer therapeutics—the pursuit of marginal indications and a me-too mentality that stifles innovation and creativity: the John Conley Lecture. JAMA Otolaryngol Head Neck Surg. 2014;140(12):1225–36.CrossRefPubMed
17.
go back to reference Ladanie A, Schmitt AM, Speich B, Naudet F, Agarwal A, Pereira TV, et al. Clinical trial evidence supporting US food and drug administration approval of novel cancer therapies between 2000 and 2016. JAMA Netw Open. 2020;3(11): e2024406.CrossRefPubMedPubMedCentral Ladanie A, Schmitt AM, Speich B, Naudet F, Agarwal A, Pereira TV, et al. Clinical trial evidence supporting US food and drug administration approval of novel cancer therapies between 2000 and 2016. JAMA Netw Open. 2020;3(11): e2024406.CrossRefPubMedPubMedCentral
18.
go back to reference Daugherty CK, Ratain MJ, Emanuel EJ, Farrell AT, Schilsky RL. Ethical, scientific, and regulatory perspectives regarding the use of placebos in cancer clinical trials. J Clin Oncol. 2008;26(8):1371–8.CrossRefPubMed Daugherty CK, Ratain MJ, Emanuel EJ, Farrell AT, Schilsky RL. Ethical, scientific, and regulatory perspectives regarding the use of placebos in cancer clinical trials. J Clin Oncol. 2008;26(8):1371–8.CrossRefPubMed
19.
go back to reference Latimer NR, White IR, Abrams KR, Siebert U. Causal inference for long-term survival in randomised trials with treatment switching: Should re-censoring be applied when estimating counterfactual survival times? Stat Methods Med Res. 2019;28(8):2475–93.CrossRefPubMed Latimer NR, White IR, Abrams KR, Siebert U. Causal inference for long-term survival in randomised trials with treatment switching: Should re-censoring be applied when estimating counterfactual survival times? Stat Methods Med Res. 2019;28(8):2475–93.CrossRefPubMed
23.
go back to reference Schober P, Boer C, Schwarte LA. Correlation Coefficients. Anesthesia & Analgesia. 2018;126(5):1763–8.CrossRef Schober P, Boer C, Schwarte LA. Correlation Coefficients. Anesthesia & Analgesia. 2018;126(5):1763–8.CrossRef
24.
go back to reference Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69–71.PubMedPubMedCentral Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69–71.PubMedPubMedCentral
Metadata
Title
Cross-sectional analysis characterizing the use of rank preserving structural failure time in oncology studies: changes to hazard ratio and frequency of inappropriate use
Authors
Vinay Prasad
Myung Sun Kim
Alyson Haslam
Publication date
01-12-2023
Publisher
BioMed Central
Published in
Trials / Issue 1/2023
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-023-07412-y

Other articles of this Issue 1/2023

Trials 1/2023 Go to the issue