Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Reporting of loss to follow-up information in randomised controlled trials with time-to-event outcomes: a literature survey

Authors: Elke Vervölgyi, Mandy Kromp, Guido Skipka, Ralf Bender, Thomas Kaiser

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

To assess the reporting of loss to follow-up (LTFU) information in articles on randomised controlled trials (RCTs) with time-to-event outcomes, and to assess whether discrepancies affect the validity of study results.

Methods

Literature survey of all issues of the BMJ, Lancet, JAMA, and New England Journal of Medicine published between 2003 and 2005. Eligible articles were reports of RCTs including at least one Kaplan-Meier plot. Articles were classified as "assessable" if sufficient information was available to assess LTFU. In these articles, LTFU information was derived from Kaplan-Meier plots, extracted from the text, and compared. Articles were then classified as "consistent" or "not consistent". Sensitivity analyses were performed to assess the validity of study results.

Results

319 eligible articles were identified. 187 (59%) were classified as "assessable", as they included sufficient information for evaluation; 140 of 319 (44%) presented consistent LTFU information between the Kaplan-Meier plot and text. 47 of 319 (15%) were classified as "not consistent". These 47 articles were included in sensitivity analyses. When various imputation methods were used, the results of a chi2-test applied to the corresponding 2 × 2 table changed and hence were not robust in about half of the studies.

Conclusions

Less than half of the articles on RCTs using Kaplan-Meier plots provide assessable and consistent LTFU information, thus questioning the validity of the results and conclusions of many studies presenting survival analyses. Authors should improve the presentation of both Kaplan-Meier plots and LTFU information, and reviewers of study publications and journal editors should critically appraise the validity of the information provided.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kaplan EL, Meier P: Nonparametric estimation from incomplete observations. Journal of the American Statistical Association. 1958, 53: 457-481. 10.2307/2281868.CrossRef Kaplan EL, Meier P: Nonparametric estimation from incomplete observations. Journal of the American Statistical Association. 1958, 53: 457-481. 10.2307/2281868.CrossRef
2.
go back to reference Ryan TP, Woodall WH: The most-cited statistical papers. Journal of Applied Statistics. 2005, 32: 461-474. 10.1080/02664760500079373.CrossRef Ryan TP, Woodall WH: The most-cited statistical papers. Journal of Applied Statistics. 2005, 32: 461-474. 10.1080/02664760500079373.CrossRef
5.
go back to reference Pocock SJ, Clayton TC, Altman DG: Survival plots of time-to-event outcomes in clinical trials: good practice and pitfalls. Lancet. 2002, 359 (1686-1689): Pocock SJ, Clayton TC, Altman DG: Survival plots of time-to-event outcomes in clinical trials: good practice and pitfalls. Lancet. 2002, 359 (1686-1689):
6.
go back to reference Altman DG: Practical Statistics for Medical Research. 1999, Chapman & Hall/CRC Altman DG: Practical Statistics for Medical Research. 1999, Chapman & Hall/CRC
7.
go back to reference Altman DG, De Stavola BL, Love SB, Stepniewska KA: Review of survival analyses published in cancer journals. British Journal of Cancer. 1995, 72 (511-518): Altman DG, De Stavola BL, Love SB, Stepniewska KA: Review of survival analyses published in cancer journals. British Journal of Cancer. 1995, 72 (511-518):
8.
go back to reference Mathoulin-Pelissier S, Gourgou-Bourgade S, Bonnetain F, Kramar A: Survival end point reporting in randomized cancer clinical trials: A review of major journals. Journal of Clinical Oncology. 2008, 26 (3721-3726): Mathoulin-Pelissier S, Gourgou-Bourgade S, Bonnetain F, Kramar A: Survival end point reporting in randomized cancer clinical trials: A review of major journals. Journal of Clinical Oncology. 2008, 26 (3721-3726):
9.
go back to reference Schemper M, & Smith TL: A note on quantifying follow-up studies of failure time. Controlled Clinical Trials. 1996, 17 (343-346): Schemper M, & Smith TL: A note on quantifying follow-up studies of failure time. Controlled Clinical Trials. 1996, 17 (343-346):
12.
go back to reference Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, Sterne J, Donovan JL: A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009, 10 (52): Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, Sterne J, Donovan JL: A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009, 10 (52):
14.
go back to reference Andersen PK, Borgan O, Gill RD, Keiding N: Statistical Models Based on Counting Processes. 1997, New York: Springer, 2 Andersen PK, Borgan O, Gill RD, Keiding N: Statistical Models Based on Counting Processes. 1997, New York: Springer, 2
15.
go back to reference Pintilie M: Competing Risks: A Practical Perspective. 2006, Chichester, England: John Wiley & Sons, Ltd, 1CrossRef Pintilie M: Competing Risks: A Practical Perspective. 2006, Chichester, England: John Wiley & Sons, Ltd, 1CrossRef
16.
go back to reference Guyatt GH, Sackett DL, Cook DJ: Users' guide to the medical literature. 2. How to use an article about therapy or prevention. A. Are the results of the study valid?. Journal of the American Medical Association. 1993, 270: 2598-2601. 10.1001/jama.270.21.2598.CrossRefPubMed Guyatt GH, Sackett DL, Cook DJ: Users' guide to the medical literature. 2. How to use an article about therapy or prevention. A. Are the results of the study valid?. Journal of the American Medical Association. 1993, 270: 2598-2601. 10.1001/jama.270.21.2598.CrossRefPubMed
17.
go back to reference Royston P, Parmar MK, Altman DG: Visualizing length of survival in time-to-event studies: a complement to Kaplan-Meier plots. J Natl Cancer Inst. 2008, 100: 92-97. 10.1093/jnci/djm265.CrossRefPubMed Royston P, Parmar MK, Altman DG: Visualizing length of survival in time-to-event studies: a complement to Kaplan-Meier plots. J Natl Cancer Inst. 2008, 100: 92-97. 10.1093/jnci/djm265.CrossRefPubMed
18.
go back to reference Clark TG, Altman DG, De Stavola BL: Quantification of the completeness of follow-up. Lancet. 2002, 359: 1309-1310. 10.1016/S0140-6736(02)08272-7.CrossRefPubMed Clark TG, Altman DG, De Stavola BL: Quantification of the completeness of follow-up. Lancet. 2002, 359: 1309-1310. 10.1016/S0140-6736(02)08272-7.CrossRefPubMed
19.
go back to reference Montori VM, Guyatt GH: Intention-to-treat principle. Can Med Ass J. 2001, 165: 1339-1341. Montori VM, Guyatt GH: Intention-to-treat principle. Can Med Ass J. 2001, 165: 1339-1341.
20.
go back to reference Shih WJ: Problems in dealing with missing data and informative censoring in clinical trials. Current Controlled Trials in Cardiovascular Medicine. 2002, 3 (1): 4-10.1186/1468-6708-3-4.CrossRefPubMedPubMedCentral Shih WJ: Problems in dealing with missing data and informative censoring in clinical trials. Current Controlled Trials in Cardiovascular Medicine. 2002, 3 (1): 4-10.1186/1468-6708-3-4.CrossRefPubMedPubMedCentral
21.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
22.
go back to reference Altman DG: Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ. 2005, 330 (7499): 1056-1057. 10.1136/bmj.330.7499.1056.CrossRefPubMedPubMedCentral Altman DG: Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ. 2005, 330 (7499): 1056-1057. 10.1136/bmj.330.7499.1056.CrossRefPubMedPubMedCentral
23.
go back to reference Akl EA, Briel M, You JJ, Lamontagne F, Gangji A, Cukierman-Yaffe T, Alshurafa M, Sun X, Nerenberg KA, Johnston BC, et al: Lost to follow-up Information in Trials (LOST-IT): a protocol on the potential impact. Trials. 2009, 10 (40): Akl EA, Briel M, You JJ, Lamontagne F, Gangji A, Cukierman-Yaffe T, Alshurafa M, Sun X, Nerenberg KA, Johnston BC, et al: Lost to follow-up Information in Trials (LOST-IT): a protocol on the potential impact. Trials. 2009, 10 (40):
Metadata
Title
Reporting of loss to follow-up information in randomised controlled trials with time-to-event outcomes: a literature survey
Authors
Elke Vervölgyi
Mandy Kromp
Guido Skipka
Ralf Bender
Thomas Kaiser
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-130

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue