Skip to main content
Top
Published in: Respiratory Research 1/2020

Open Access 01-12-2020 | COPD Exacerbation | Research

Improving the evaluation of COPD exacerbation treatment effects by accounting for early treatment discontinuations: a post-hoc analysis of randomized clinical trials

Authors: Agnieszka Król, Robert Palmér, Virginie Rondeau, Stephen Rennard, Ulf G. Eriksson, Alexandra Jauhiainen

Published in: Respiratory Research | Issue 1/2020

Login to get access

Abstract

Background

Chronic obstructive pulmonary disease (COPD) clinical trials aimed at evaluating treatment effects on exacerbations often suffer from early discontinuations of randomized treatment. Treatment discontinuations imply a loss of information and should ideally be considered in the statistical analysis of trial results, particularly if the discontinuations are related to the disease or treatment itself. Here, we explore this issue by investigating (1) whether there exists an association between the risks of exacerbation and treatment discontinuation in COPD clinical trials and (2) whether disregarding this association can cause bias in exacerbation treatment effect estimates. We focus on the hypothetical estimand, i.e. the treatment effect that would have been observed had all subjects completed the trial as planned.

Methods

The association between exacerbation and discontinuation risks was analysed by applying a joint frailty (random effect) model – allowing for the simultaneous analysis of multiple types of correlated events – to data from five Phase III-IV COPD clinical trials. Specifically, the impact of the association on exacerbation treatment effect estimates was assessed by comparing the treatment hazard ratios of the joint frailty model to the rate/hazard ratios of two related statistical models (the negative binomial and shared frailty models), which both assume discontinuations to be unrelated to the trial outcome. The models were also compared using simulated data.

Results

A statistically significant (p < 0.0001), positive association between exacerbation and discontinuation risks was found in all trials. Importantly, simulations confirmed that – with such an association – models disregarding the association risk producing biased results (> 5 percentage point difference in hazard/rate ratio). For some treatment comparisons in the clinical trials, the difference in treatment effect estimates between the joint frailty and the other models was as high as 10–15 percentage points. The difference was affected by the strength of the exacerbation-discontinuation association, the population heterogeneity in exacerbation risk, and the difference in discontinuation rates between treatment arms.

Conclusions

We have identified an association between the risks of exacerbation and treatment discontinuation in five COPD clinical trials. We recommend using the joint frailty model to account for this association when estimating exacerbation treatment effects, particularly when targeting the hypothetical estimand.
Appendix
Available only for authorised users
Literature
1.
go back to reference Decramer M, Molenberghs G, Liu D, Celli B, Kesten S, Lystig T, et al. Premature discontinuation during the UPLIFT study. Respir Med. 2011;105(10):1523–30.CrossRef Decramer M, Molenberghs G, Liu D, Celli B, Kesten S, Lystig T, et al. Premature discontinuation during the UPLIFT study. Respir Med. 2011;105(10):1523–30.CrossRef
2.
go back to reference Eriksson G, Calverley PM, Jenkins CR, Anzueto AR, Make BJ, Lindberg M, et al. The effect of COPD severity and study duration on exacerbation outcome in randomized controlled trials. Int J Chron Obstruct Pulmon Dis. 2017;12:1457–68.CrossRef Eriksson G, Calverley PM, Jenkins CR, Anzueto AR, Make BJ, Lindberg M, et al. The effect of COPD severity and study duration on exacerbation outcome in randomized controlled trials. Int J Chron Obstruct Pulmon Dis. 2017;12:1457–68.CrossRef
3.
go back to reference Suissa S, Ernst P, Vandemheen KL, Aaron SD. Methodological issues in therapeutic trials of COPD. Eur Respir J. 2008;31(5):927–33.CrossRef Suissa S, Ernst P, Vandemheen KL, Aaron SD. Methodological issues in therapeutic trials of COPD. Eur Respir J. 2008;31(5):927–33.CrossRef
4.
go back to reference Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. BMJ. 2013;346:e8668.CrossRef Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. BMJ. 2013;346:e8668.CrossRef
5.
go back to reference Kesten S, Plautz M, Piquette CA, Habib MP, Niewoehner DE. Premature discontinuation of patients: a potential bias in COPD clinical trials. Eur Respir J. 2007;30(5):898–906.CrossRef Kesten S, Plautz M, Piquette CA, Habib MP, Niewoehner DE. Premature discontinuation of patients: a potential bias in COPD clinical trials. Eur Respir J. 2007;30(5):898–906.CrossRef
6.
go back to reference Little RJ, D'Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355–60.CrossRef Little RJ, D'Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355–60.CrossRef
7.
go back to reference Keene ON, Calverley PM, Jones PW, Vestbo J, Anderson JA. Statistical analysis of exacerbation rates in COPD: TRISTAN and ISOLDE revisited. Eur Respir J. 2008;32(1):17–24.CrossRef Keene ON, Calverley PM, Jones PW, Vestbo J, Anderson JA. Statistical analysis of exacerbation rates in COPD: TRISTAN and ISOLDE revisited. Eur Respir J. 2008;32(1):17–24.CrossRef
8.
go back to reference Aaron SD, Fergusson D, Marks GB, Suissa S, Vandemheen KL, Doucette S, et al. Counting, analysing and reporting exacerbations of COPD in randomised controlled trials. Thorax. 2008;63(2):122–8.CrossRef Aaron SD, Fergusson D, Marks GB, Suissa S, Vandemheen KL, Doucette S, et al. Counting, analysing and reporting exacerbations of COPD in randomised controlled trials. Thorax. 2008;63(2):122–8.CrossRef
9.
go back to reference Vestbo J. Counting, analysing and reporting exacerbations of COPD in randomised controlled trials. Thorax. 2008;63(8):749–50 author reply 50.CrossRef Vestbo J. Counting, analysing and reporting exacerbations of COPD in randomised controlled trials. Thorax. 2008;63(8):749–50 author reply 50.CrossRef
10.
go back to reference Keene ON, Roger JH, Hartley BF, Kenward MG. Missing data sensitivity analysis for recurrent event data using controlled imputation. Pharm Stat. 2014;13(4):258–64.CrossRef Keene ON, Roger JH, Hartley BF, Kenward MG. Missing data sensitivity analysis for recurrent event data using controlled imputation. Pharm Stat. 2014;13(4):258–64.CrossRef
11.
go back to reference Liu D, Menjoge S. Statistical analysis of chronic obstructive pulmonary disease (COPD) exacerbations. Eur Respir J. 2008;32(5):1422–3 author reply 3.CrossRef Liu D, Menjoge S. Statistical analysis of chronic obstructive pulmonary disease (COPD) exacerbations. Eur Respir J. 2008;32(5):1422–3 author reply 3.CrossRef
12.
go back to reference Watz H, Tetzlaff K, Wouters EF, Kirsten A, Magnussen H, Rodriguez-Roisin R, et al. Blood eosinophil count and exacerbations in severe chronic obstructive pulmonary disease after withdrawal of inhaled corticosteroids: a post-hoc analysis of the WISDOM trial. Lancet Respir Med. 2016;4(5):390–8.CrossRef Watz H, Tetzlaff K, Wouters EF, Kirsten A, Magnussen H, Rodriguez-Roisin R, et al. Blood eosinophil count and exacerbations in severe chronic obstructive pulmonary disease after withdrawal of inhaled corticosteroids: a post-hoc analysis of the WISDOM trial. Lancet Respir Med. 2016;4(5):390–8.CrossRef
13.
go back to reference Martinez FJ, Calverley PM, Goehring UM, Brose M, Fabbri LM, Rabe KF. Effect of roflumilast on exacerbations in patients with severe chronic obstructive pulmonary disease uncontrolled by combination therapy (REACT): a multicentre randomised controlled trial. Lancet. 2015;385(9971):857–66.CrossRef Martinez FJ, Calverley PM, Goehring UM, Brose M, Fabbri LM, Rabe KF. Effect of roflumilast on exacerbations in patients with severe chronic obstructive pulmonary disease uncontrolled by combination therapy (REACT): a multicentre randomised controlled trial. Lancet. 2015;385(9971):857–66.CrossRef
14.
go back to reference Martinez FJ, Rabe KF, Sethi S, Pizzichini E, McIvor A, Anzueto A, et al. Effect of Roflumilast and inhaled corticosteroid/long-acting beta2-agonist on chronic obstructive pulmonary disease exacerbations (RE(2) SPOND). A randomized clinical trial. Am J Respir Crit Care Med. 2016;194(5):559–67.CrossRef Martinez FJ, Rabe KF, Sethi S, Pizzichini E, McIvor A, Anzueto A, et al. Effect of Roflumilast and inhaled corticosteroid/long-acting beta2-agonist on chronic obstructive pulmonary disease exacerbations (RE(2) SPOND). A randomized clinical trial. Am J Respir Crit Care Med. 2016;194(5):559–67.CrossRef
15.
go back to reference Cook RJ, Lawless JF. The statistical analysis of recurrent events. New York. London: Springer; 2011. Cook RJ, Lawless JF. The statistical analysis of recurrent events. New York. London: Springer; 2011.
16.
go back to reference Andersen PK, Gill RD. Cox's regression model for counting processes: a large sample study. Ann Stat. 1982;10(4):1100–20.CrossRef Andersen PK, Gill RD. Cox's regression model for counting processes: a large sample study. Ann Stat. 1982;10(4):1100–20.CrossRef
18.
go back to reference Keene ON, Ruberg S, Schacht A, Akacha M, Lawrance R, Berglind A, et al. What matters most? Different stakeholder perspectives on estimands for an invented case study in COPD. Pharm Stat. 2020. Keene ON, Ruberg S, Schacht A, Akacha M, Lawrance R, Berglind A, et al. What matters most? Different stakeholder perspectives on estimands for an invented case study in COPD. Pharm Stat. 2020.
19.
go back to reference Roger JH, Bratton DJ, Mayer B, Abellan JJ, Keene ON. Treatment policy estimands for recurrent event data using data collected after cessation of randomised treatment. Pharm Stat. 2019;18(1):85–95.CrossRef Roger JH, Bratton DJ, Mayer B, Abellan JJ, Keene ON. Treatment policy estimands for recurrent event data using data collected after cessation of randomised treatment. Pharm Stat. 2019;18(1):85–95.CrossRef
20.
go back to reference Liu L, Wolfe RA, Huang X. Shared frailty models for recurrent events and a terminal event. Biometrics. 2004;60(3):747–56.CrossRef Liu L, Wolfe RA, Huang X. Shared frailty models for recurrent events and a terminal event. Biometrics. 2004;60(3):747–56.CrossRef
21.
go back to reference Rondeau V, Mathoulin-Pelissier S, Jacqmin-Gadda H, Brouste V, Soubeyran P. Joint frailty models for recurring events and death using maximum penalized likelihood estimation: application on cancer events. Biostatistics. 2007;8(4):708–21.CrossRef Rondeau V, Mathoulin-Pelissier S, Jacqmin-Gadda H, Brouste V, Soubeyran P. Joint frailty models for recurring events and death using maximum penalized likelihood estimation: application on cancer events. Biostatistics. 2007;8(4):708–21.CrossRef
22.
go back to reference Rennard SI, Tashkin DP, McElhattan J, Goldman M, Ramachandran S, Martin UJ, et al. Efficacy and tolerability of budesonide/formoterol in one hydrofluoroalkane pressurized metered-dose inhaler in patients with chronic obstructive pulmonary disease: results from a 1-year randomized controlled clinical trial. Drugs. 2009;69(5):549–65.CrossRef Rennard SI, Tashkin DP, McElhattan J, Goldman M, Ramachandran S, Martin UJ, et al. Efficacy and tolerability of budesonide/formoterol in one hydrofluoroalkane pressurized metered-dose inhaler in patients with chronic obstructive pulmonary disease: results from a 1-year randomized controlled clinical trial. Drugs. 2009;69(5):549–65.CrossRef
23.
go back to reference Sharafkhaneh A, Southard JG, Goldman M, Uryniak T, Martin UJ. Effect of budesonide/formoterol pMDI on COPD exacerbations: a double-blind, randomized study. Respir Med. 2012;106(2):257–68.CrossRef Sharafkhaneh A, Southard JG, Goldman M, Uryniak T, Martin UJ. Effect of budesonide/formoterol pMDI on COPD exacerbations: a double-blind, randomized study. Respir Med. 2012;106(2):257–68.CrossRef
24.
go back to reference Tashkin DP, Rennard SI, Martin P, Ramachandran S, Martin UJ, Silkoff PE, et al. Efficacy and safety of budesonide and formoterol in one pressurized metered-dose inhaler in patients with moderate to very severe chronic obstructive pulmonary disease: results of a 6-month randomized clinical trial. Drugs. 2008;68(14):1975–2000.CrossRef Tashkin DP, Rennard SI, Martin P, Ramachandran S, Martin UJ, Silkoff PE, et al. Efficacy and safety of budesonide and formoterol in one pressurized metered-dose inhaler in patients with moderate to very severe chronic obstructive pulmonary disease: results of a 6-month randomized clinical trial. Drugs. 2008;68(14):1975–2000.CrossRef
26.
go back to reference Król A, Mauguen A, Mazroui Y, Laurent A, Michiels S, Rondeau V. Tutorial in Joint Modeling and Prediction: A Statistical Software for Correlated Longitudinal Outcomes, Recurrent Events and a Terminal Event. J Stat Software. 2017;1:3. Król A, Mauguen A, Mazroui Y, Laurent A, Michiels S, Rondeau V. Tutorial in Joint Modeling and Prediction: A Statistical Software for Correlated Longitudinal Outcomes, Recurrent Events and a Terminal Event. J Stat Software. 2017;1:3.
27.
go back to reference Tibshirani R. The lasso method for variable selection in the cox model. Stat Med. 1997;16(4):385–95.CrossRef Tibshirani R. The lasso method for variable selection in the cox model. Stat Med. 1997;16(4):385–95.CrossRef
28.
go back to reference Jenkins CR, Celli B, Anderson JA, Ferguson GT, Jones PW, Vestbo J, et al. Seasonality and determinants of moderate and severe COPD exacerbations in the TORCH study. Eur Respir J. 2012;39(1):38–45.CrossRef Jenkins CR, Celli B, Anderson JA, Ferguson GT, Jones PW, Vestbo J, et al. Seasonality and determinants of moderate and severe COPD exacerbations in the TORCH study. Eur Respir J. 2012;39(1):38–45.CrossRef
29.
go back to reference Calverley PM, Spencer S, Willits L, Burge PS, Jones PW, Group IS. Withdrawal from treatment as an outcome in the ISOLDE study of COPD. Chest. 2003;124(4):1350–6.CrossRef Calverley PM, Spencer S, Willits L, Burge PS, Jones PW, Group IS. Withdrawal from treatment as an outcome in the ISOLDE study of COPD. Chest. 2003;124(4):1350–6.CrossRef
30.
go back to reference Rogliani P, Calzetta L, Cazzola M, Matera MG. Drug safety evaluation of roflumilast for the treatment of COPD: a meta-analysis. Expert Opin Drug Saf. 2016;15(8):1133–46.CrossRef Rogliani P, Calzetta L, Cazzola M, Matera MG. Drug safety evaluation of roflumilast for the treatment of COPD: a meta-analysis. Expert Opin Drug Saf. 2016;15(8):1133–46.CrossRef
31.
go back to reference Make BJ, Eriksson G, Calverley PM, Jenkins CR, Postma DS, Peterson S, et al. A score to predict short-term risk of COPD exacerbations (SCOPEX). Int J Chron Obstruct Pulmon Dis. 2015;10:201–9.CrossRef Make BJ, Eriksson G, Calverley PM, Jenkins CR, Postma DS, Peterson S, et al. A score to predict short-term risk of COPD exacerbations (SCOPEX). Int J Chron Obstruct Pulmon Dis. 2015;10:201–9.CrossRef
32.
go back to reference Jenkins CR, Postma DS, Anzueto AR, Make BJ, Peterson S, Eriksson G, et al. Reliever salbutamol use as a measure of exacerbation risk in chronic obstructive pulmonary disease. BMC Pulm Med. 2015;15:97.CrossRef Jenkins CR, Postma DS, Anzueto AR, Make BJ, Peterson S, Eriksson G, et al. Reliever salbutamol use as a measure of exacerbation risk in chronic obstructive pulmonary disease. BMC Pulm Med. 2015;15:97.CrossRef
33.
go back to reference Calverley PM, Tetzlaff K, Dusser D, Wise RA, Mueller A, Metzdorf N, et al. Determinants of exacerbation risk in patients with COPD in the TIOSPIR study. Int J Chron Obstruct Pulmon Dis. 2017;12:3391–405.CrossRef Calverley PM, Tetzlaff K, Dusser D, Wise RA, Mueller A, Metzdorf N, et al. Determinants of exacerbation risk in patients with COPD in the TIOSPIR study. Int J Chron Obstruct Pulmon Dis. 2017;12:3391–405.CrossRef
34.
go back to reference Hurst JR, Vestbo J, Anzueto A, Locantore N, Mullerova H, Tal-Singer R, et al. Susceptibility to exacerbation in chronic obstructive pulmonary disease. N Engl J Med. 2010;363(12):1128–38.CrossRef Hurst JR, Vestbo J, Anzueto A, Locantore N, Mullerova H, Tal-Singer R, et al. Susceptibility to exacerbation in chronic obstructive pulmonary disease. N Engl J Med. 2010;363(12):1128–38.CrossRef
35.
go back to reference Lee SD, Huang MS, Kang J, Lin CH, Park MJ, Oh YM, et al. The COPD assessment test (CAT) assists prediction of COPD exacerbations in high-risk patients. Respir Med. 2014;108(4):600–8.CrossRef Lee SD, Huang MS, Kang J, Lin CH, Park MJ, Oh YM, et al. The COPD assessment test (CAT) assists prediction of COPD exacerbations in high-risk patients. Respir Med. 2014;108(4):600–8.CrossRef
36.
go back to reference Burgel PR, Paillasseur JL, Caillaud D, Tillie-Leblond I, Chanez P, Escamilla R, et al. Clinical COPD phenotypes: a novel approach using principal component and cluster analyses. Eur Respir J. 2010;36(3):531–9.CrossRef Burgel PR, Paillasseur JL, Caillaud D, Tillie-Leblond I, Chanez P, Escamilla R, et al. Clinical COPD phenotypes: a novel approach using principal component and cluster analyses. Eur Respir J. 2010;36(3):531–9.CrossRef
Metadata
Title
Improving the evaluation of COPD exacerbation treatment effects by accounting for early treatment discontinuations: a post-hoc analysis of randomized clinical trials
Authors
Agnieszka Król
Robert Palmér
Virginie Rondeau
Stephen Rennard
Ulf G. Eriksson
Alexandra Jauhiainen
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Respiratory Research / Issue 1/2020
Electronic ISSN: 1465-993X
DOI
https://doi.org/10.1186/s12931-020-01419-8

Other articles of this Issue 1/2020

Respiratory Research 1/2020 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.