Top

Trials

Published in:

Open Access 01-12-2016 | Research

A systematic review of randomised controlled trials in rheumatoid arthritis: the reporting and handling of missing data in composite outcomes

Authors: Fowzia Ibrahim, Brian D. M. Tom, David L. Scott, Andrew Toby Prevost

Published in: Trials | Issue 1/2016

Abstract

Background

Most reported outcome measures in rheumatoid arthritis (RA) trials are composite, whose components comprise single measures that are combined into one outcome. The aims of this review were to assess the range of missing data rates in primary composite outcomes and to document the current practice for handling and reporting missing data in published RA trials compared to the Consolidated Standards of Reporting Trials (CONSORT) recommendations.

Methods

A systematic search for randomised controlled trials was conducted for RA trials published between 2008 and 2013 in four rheumatology and four high impact general medical journals.

Results

A total of 51 trials with a composite primary outcome were identified, of which 38 (75 %) used the binary American College of Rheumatology responder index and 13 (25 %) used the Disease Activity Score for 28 joints (DAS28). Forty-four trials (86 %) reported on an intention-to-treat analysis population, while 7 trials (14 %) analysed according to a modified intention-to-treat population. Missing data rates for the primary composite outcome ranged from 2–53 % and were above 30 % in 9 trials, 20–30 % in 11 trials, 10–20 % in 18 trials and below 10 % in 13 trials. Thirty-eight trials (75 %) used non-responder imputation and 10 (20 %) used last observation carried forward to impute missing composite outcome data at the primary time point. The rate of dropout was on average 61 % times higher in the placebo group compared to the treatment group in the 34 placebo controlled trials (relative rate 1.61, 95 % CI: 1.29, 2.02). Thirty-seven trials (73 %) did not report the use of sensitivity analyses to assess the handling of missing data in the primary analysis as recommended by CONSORT guidelines.

Conclusions

This review highlights an improvement in rheumatology trial practice since the revision of CONSORT guidelines, in terms of power calculation and participant’s flow diagram. However, there is a need to improve the handling and reporting of missing composite outcome data and their components in RA trials. In particular, sensitivity analyses need to be more widely used in RA trials because imputation is widespread and generally uses single imputation methods, and in this area the missing data rates are commonly differentially higher in the placebo group.

Available only for authorised users

Scott DL, Wolfe F, Huizinga TW. Rheumatoid arthritis. Lancet. 2010;376(9746):1094–108. doi:10.1016/s0140-6736(10)60826-4.CrossRefPubMed

Felson DT, Anderson JJ, Boers M, Bombardier C, Chernoff M, Fried B, et al. The American College of Rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials. The Committee on Outcome Measures in Rheumatoid Arthritis Clinical Trials. Arthritis Rheum. 1993;36(6):729–40.CrossRefPubMed

Felson DT, Anderson JJ, Meenan RF. Time for changes in the design, analysis, and reporting of rheumatoid arthritis clinical trials. Arthritis Rheum. 1990;33(1):140–9.CrossRefPubMed

Prevoo ML, van 't Hof MA, Kuper HH, van Leeuwen MA, van de Putte LB, van Riel PL. Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995;38(1):44–8.CrossRefPubMed

Felson DT, Anderson JJ, Boers M, Bombardier C, Furst D, Goldsmith C, et al. American College of Rheumatology. Preliminary definition of improvement in rheumatoid arthritis. Arthritis Rheum. 1995;38(6):727–35.CrossRefPubMed

Wittkop L, Smith C, Fox Z, Sabin C, Richert L, Aboulker JP, et al. Methodological issues in the use of composite endpoints in clinical trials: examples from the HIV field. Clinical trials (London, England). 2010;7(1):19–35. doi:10.1177/1740774509356117.

Ferreira-Gonzalez I, Busse JW, Heels-Ansdell D, Montori VM, Akl EA, Bryant DM, et al. Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ (Clinical research ed). 2007;334(7597):786.

Cohn JN, Tognoni G. Valsartan Heart Failure Trial I. A randomized trial of the angiotensin-receptor blocker valsartan in chronic heart failure. N Engl J Med. 2001;345(23):1667–75. doi:10.1056/NEJMoa010713.CrossRefPubMed

Quan H, Zhang D, Zhang J, Devlamynck L. Analysis of a binary composite endpoint with missing data in components. Stat Med. 2007;26(26):4703–18. doi:10.1002/sim.2893.CrossRefPubMed

10.

Senn S, Julious S. Measurement in clinical trials: A neglected issue for statisticians? Stat Med. 2009;28(26):3189–209. doi:10.1002/sim.3603.CrossRefPubMed

11.

Carpenter JR, Kenward MG. Missing data in randomised controlled trials—a practical guide. Birmingham: National Institute for Health Research, Publication RM03/JH17/MK. 2008. http://www.pcpoh.bham.ac.uk/publichealth/methodology/projects/RM03_JH17_MK.shtml. Accessed 30 Apr 2015.

12.

Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ (Clin Res Ed). 1999;319(7211):670–4.CrossRef

13.

Wood AM, White IR, Thompson SG. Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clin Trials. 2004;1(4):368–76.CrossRefPubMed

14.

Murphy JF. Consort 2010 statement on randomised controlled trials. Ir Med J. 2010;103(5):132.PubMed

15.

Schulz KF, Altman DG, Moher D, Group C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ (Clin Res Ed). 2010;340:c332. doi:10.1136/bmj.c332.CrossRef

16.

Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. W64.CrossRefPubMed

17.

Dougados M, Kissel K, Sheeran T, Tak PP, Conaghan PG, Mola EM, et al. Adding tocilizumab or switching to tocilizumab monotherapy in methotrexate inadequate responders: 24-week symptomatic and structural results of a 2-year randomised controlled strategy trial in rheumatoid arthritis (ACT-RAY). Ann Rheum Dis. 2013;72(1):43–50. doi:10.1136/annrheumdis-2011-201282.CrossRefPubMed

18.

Emery P, Keystone E, Tony HP, Cantagrel A, van Vollenhoven R, Sanchez A, et al. IL-6 receptor inhibition with tocilizumab improves treatment outcomes in patients with rheumatoid arthritis refractory to anti-tumour necrosis factor biologicals: results from a 24-week multicentre randomised placebo-controlled trial. Ann Rheum Dis. 2008;67(11):1516–23. doi:10.1136/ard.2008.092932.CrossRefPubMedPubMedCentral

19.

Yazici Y, Curtis JR, Ince A, Baraf H, Malamet RL, Teng LL, et al. Efficacy of tocilizumab in patients with moderate to severe active rheumatoid arthritis and a previous inadequate response to disease-modifying antirheumatic drugs: the ROSE study. Ann Rheum Dis. 2012;71(2):198–205. doi:10.1136/ard.2010.148700.CrossRefPubMed

20.

Smolen JS, Beaulieu A, Rubbert-Roth A, Ramos-Remus C, Rovensky J, Alecock E, et al. Effect of interleukin-6 receptor inhibition with tocilizumab in patients with rheumatoid arthritis (OPTION study): a double-blind, placebo-controlled, randomised trial. Lancet. 2008;371(9617):987–97. doi:10.1016/s0140-6736(08)60453-5.CrossRefPubMed

21.

Smolen J, Landewe RB, Mease P, Brzezicki J, Mason D, Luijtens K, et al. Efficacy and safety of certolizumab pegol plus methotrexate in active rheumatoid arthritis: the RAPID 2 study. A randomised controlled trial. Ann Rheum Dis. 2009;68(6):797–804. doi:10.1136/ard.2008.101659.CrossRefPubMed

22.

Weinblatt ME, Bingham 3rd CO, Mendelsohn AM, Kim L, Mack M, Lu J, et al. Intravenous golimumab is effective in patients with active rheumatoid arthritis despite methotrexate therapy with responses as early as week 2: results of the phase 3, randomised, multicentre, double-blind, placebo-controlled GO-FURTHER trial. Ann Rheum Dis. 2013;72(3):381–9. doi:10.1136/annrheumdis-2012-201411.CrossRefPubMed

23.

Moreland LW, O’Dell JR, Paulus HE, Curtis JR, Bathon JM, St Clair EW, et al. A randomized comparative effectiveness study of oral triple therapy versus etanercept plus methotrexate in early aggressive rheumatoid arthritis: the treatment of Early Aggressive Rheumatoid Arthritis Trial. Arthritis Rheum. 2012;64(9):2824–35. doi:10.1002/art.34498.CrossRefPubMedPubMedCentral

24.

Emery P, Breedveld FC, Hall S, Durez P, Chang DJ, Robertson D, et al. Comparison of methotrexate monotherapy with a combination of methotrexate and etanercept in active, early, moderate to severe rheumatoid arthritis (COMET): a randomised, double-blind, parallel treatment trial. Lancet. 2008;372(9636):375–82. doi:10.1016/s0140-6736(08)61000-4.CrossRefPubMed

25.

Gabay C, Emery P, van Vollenhoven R, Dikranian A, Alten R, Pavelka K, et al. Tocilizumab monotherapy versus adalimumab monotherapy for treatment of rheumatoid arthritis (ADACTA): a randomised, double-blind, controlled phase 4 trial. Lancet. 2013;381(9877):1541–50.CrossRefPubMed

26.

van der Heijde D, Tanaka Y, Fleischmann R, Keystone E, Kremer J, Zerbini C, et al. Tofacitinib (CP-690,550) in patients with rheumatoid arthritis receiving methotrexate: twelve-month data from a twenty-four-month phase III randomized radiographic study. Arthritis Rheum. 2013;65(3):559–70. doi:10.1002/art.37816.CrossRefPubMed

27.

White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9(4):396–407. doi:10.1177/1740774512450098.CrossRefPubMedPubMedCentral

28.

Thabane L, Mbuagbaw L, Zhang SY, Samaan Z, Marcucci M, Ye CL, et al. A tutorial on sensitivity analyses in clinical trials: the what, why, when and how. BMC Med Res Methodol. 2013;13:92. doi:10.1186/1471-2288-13-92.CrossRefPubMedPubMedCentral

29.

Little RJ, D’Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355–60. doi:10.1056/NEJMsr1203730.CrossRefPubMedPubMedCentral

30.

O’Neill RT, Temple R. The prevention and treatment of missing data in clinical trials: an FDA perspective on the importance of dealing with it. Clin Pharmacol Ther. 2012;91(3):550–4. doi:10.1038/clpt.2011.340.CrossRefPubMed

31.

White IR, Horton NJ, Carpenter J, Pocock SJ. Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ (Clin Res Ed). 2011;342:d40. doi:10.1136/bmj.d40.CrossRef

32.

Hewitt CE, Kumaravel B, Dumville JC, Torgerson DJ. Trial attrition study group. Assessing the impact of attrition in randomized controlled trials. J Clin Epidemiol. 2010;63(11):1264–70. doi:10.1016/j.jclinepi.2010.01.010.CrossRefPubMed

33.

Baron G, Boutron I, Giraudeau B, Ravaud P. Violation of the intent-to-treat principle and rate of missing data in superiority trials assessing structural outcomes in rheumatic diseases. Arthritis Rheum. 2005;52(6):1858–65. doi:10.1002/art.21116.CrossRefPubMed

Title: A systematic review of randomised controlled trials in rheumatoid arthritis: the reporting and handling of missing data in composite outcomes
Authors: Fowzia Ibrahim
Brian D. M. Tom
David L. Scott
Andrew Toby Prevost
Publication date: 01-12-2016
Publisher: BioMed Central
Published in: Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI: https://doi.org/10.1186/s13063-016-1402-5

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

A systematic review of randomised controlled trials in rheumatoid arthritis: the reporting and handling of missing data in composite outcomes

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2016

Combining long-lasting insecticidal nets and indoor residual spraying for malaria prevention in Ethiopia: study protocol for a cluster randomized controlled trial

Improving delivery of secondary prophylaxis for rheumatic heart disease in remote Indigenous communities: study protocol for a stepped-wedge randomised trial

A metadata schema for data objects in clinical research

Adjunctive intraocular and peri-ocular steroid (triamcinolone acetonide) versus standard treatment in eyes undergoing vitreoretinal surgery for open globe trauma (ASCOT): study protocol for a phase III, multi-centre, double-masked randomised controlled trial

A survey of facilitators and barriers to recruitment to the MAGNETIC trial

TSCQ study: a randomized, controlled, open-label trial of daily trimethoprim-sulfamethoxazole or weekly chloroquine among adults on antiretroviral therapy in Malawi: study protocol for a randomized controlled trial