Skip to main content
Top
Published in: Trials 1/2014

Open Access 01-12-2014 | Review

A review of the handling of missing longitudinal outcome data in clinical trials

Authors: Matthew Powney, Paula Williamson, Jamie Kirkham, Ruwanthi Kolamunnage-Dona

Published in: Trials | Issue 1/2014

Login to get access

Abstract

The aim of this review was to establish the frequency with which trials take into account missingness, and to discover what methods trialists use for adjustment in randomised controlled trials with longitudinal measurements. Failing to address the problems that can arise from missing outcome data can result in misleading conclusions. Missing data should be addressed as a means of a sensitivity analysis of the complete case analysis results. One hundred publications of randomised controlled trials with longitudinal measurements were selected randomly from trial publications from the years 2005 to 2012. Information was extracted from these trials, including whether reasons for dropout were reported, what methods were used for handing the missing data, whether there was any explanation of the methods for missing data handling, and whether a statistician was involved in the analysis. The main focus of the review was on missing data post dropout rather than missing interim data. Of all the papers in the study, 9 (9%) had no missing data. More than half of the papers included in the study failed to make any attempt to explain the reasons for their choice of missing data handling method. Of the papers with clear missing data handling methods, 44 papers (50%) used adequate methods of missing data handling, whereas 30 (34%) of the papers used missing data methods which may not have been appropriate. In the remaining 17 papers (19%), it was difficult to assess the validity of the methods used. An imputation method was used in 18 papers (20%). Multiple imputation methods were introduced in 1987 and are an efficient way of accounting for missing data in general, and yet only 4 papers used these methods. Out of the 18 papers which used imputation, only 7 displayed the results as a sensitivity analysis of the complete case analysis results. 61% of the papers that used an imputation explained the reasons for their chosen method. Just under a third of the papers made no reference to reasons for missing outcome data. There was little consistency in reporting of missing data within longitudinal trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rubin D: Inference and missing data. Biometrika. 1976, 63 (3): 581-592. 10.1093/biomet/63.3.581.CrossRef Rubin D: Inference and missing data. Biometrika. 1976, 63 (3): 581-592. 10.1093/biomet/63.3.581.CrossRef
2.
go back to reference Acuna E, Caroline R: The treatment of missing values and its effect on classifier accuracy. Classification, Clustering, and Data Mining Applications. 2004, Berlin Heidelberg: Springer, 639–647 Acuna E, Caroline R: The treatment of missing values and its effect on classifier accuracy. Classification, Clustering, and Data Mining Applications. 2004, Berlin Heidelberg: Springer, 639–647
3.
go back to reference Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clin Trials. 2004, 1 (4): 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clin Trials. 2004, 1 (4): 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed
4.
go back to reference Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, Wood AM, Carpenter JR: Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ: British Med J. 2009, 338: b2393-10.1136/bmj.b2393.CrossRef Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, Wood AM, Carpenter JR: Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ: British Med J. 2009, 338: b2393-10.1136/bmj.b2393.CrossRef
5.
go back to reference Hedeker D, Gibbons RD: Missing data in longitudinal studies. 2006, New York, USA: John Wiley & Sons, 279–312 Hedeker D, Gibbons RD: Missing data in longitudinal studies. 2006, New York, USA: John Wiley & Sons, 279–312
6.
go back to reference Rubin D: Multiple imputation for nonresponse in surveys. 1987, New York, USA: John Wiley & SonsCrossRef Rubin D: Multiple imputation for nonresponse in surveys. 1987, New York, USA: John Wiley & SonsCrossRef
7.
go back to reference Schafer JL: Analysis of incomplete multivariate data. 1997, London, UK: Chapman & HallCrossRef Schafer JL: Analysis of incomplete multivariate data. 1997, London, UK: Chapman & HallCrossRef
8.
go back to reference Van Buuren S, Oudshoorn K: Flexible multivariate imputation by MICE. 1999, Leiden, The Netherlands: TNO Prevention Center Van Buuren S, Oudshoorn K: Flexible multivariate imputation by MICE. 1999, Leiden, The Netherlands: TNO Prevention Center
9.
go back to reference Carpenter JR, Kenward M: Missing data in clinical trials - a practical guide. 2008, Birmingham, UK: National Institute for Health Research, Publication RM03/JH17/MK Carpenter JR, Kenward M: Missing data in clinical trials - a practical guide. 2008, Birmingham, UK: National Institute for Health Research, Publication RM03/JH17/MK
10.
go back to reference McCleary L: Using multiple imputation for analysis of incomplete data in clinical research. Nurs Res. 2002, 51 (5): 339-343. 10.1097/00006199-200209000-00012.CrossRefPubMed McCleary L: Using multiple imputation for analysis of incomplete data in clinical research. Nurs Res. 2002, 51 (5): 339-343. 10.1097/00006199-200209000-00012.CrossRefPubMed
11.
go back to reference Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Medicine. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Medicine. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral
12.
go back to reference Powell C, Kolamunnage-Dona R, Lowe J, Boland A, Petrou S, Doull I, Hood K, Williamson P: Magnesium sulphate in acute severe asthma in children (MAGNETIC): a randomised, placebo-controlled trial. Lancet Respir Med. 2013, 1 (4): 301-308. 10.1016/S2213-2600(13)70037-7.CrossRefPubMed Powell C, Kolamunnage-Dona R, Lowe J, Boland A, Petrou S, Doull I, Hood K, Williamson P: Magnesium sulphate in acute severe asthma in children (MAGNETIC): a randomised, placebo-controlled trial. Lancet Respir Med. 2013, 1 (4): 301-308. 10.1016/S2213-2600(13)70037-7.CrossRefPubMed
Metadata
Title
A review of the handling of missing longitudinal outcome data in clinical trials
Authors
Matthew Powney
Paula Williamson
Jamie Kirkham
Ruwanthi Kolamunnage-Dona
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Trials / Issue 1/2014
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-15-237

Other articles of this Issue 1/2014

Trials 1/2014 Go to the issue