Skip to main content
Top
Published in: Trials 1/2009

Open Access 01-12-2009 | Study protocol

LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact

Authors: Elie A Akl, Matthias Briel, John J You, Francois Lamontagne, Azim Gangji, Tali Cukierman-Yaffe, Mohamad Alshurafa, Xin Sun, Kara A Nerenberg, Bradley C Johnston, Claudio Vera, Edward J Mills, Dirk Bassler, Arturo Salazar, Neera Bhatnagar, Jason W Busse, Zara Khalid, SD Walter, Deborah J Cook, Holger J Schünemann, Douglas G Altman, Gordon H Guyatt

Published in: Trials | Issue 1/2009

Login to get access

Abstract

Background

Incomplete ascertainment of outcomes in randomized controlled trials (RCTs) is likely to bias final study results if reasons for unavailability of patient data are associated with the outcome of interest. The primary objective of this study is to assess the potential impact of loss to follow-up on the estimates of treatment effect. The secondary objectives are to describe, for published RCTs, (1) the reporting of loss to follow-up information, (2) the analytic methods used for handling loss to follow-up information, and (3) the extent of reported loss to follow-up.

Methods

We will conduct a systematic review of reports of RCTs recently published in five top general medical journals. Eligible RCTs will demonstrate statistically significant effect estimates with respect to primary outcomes that are patient-important and expressed as binary data. Teams of 2 reviewers will independently determine eligibility and extract relevant information from each eligible trial using standardized, pre-piloted forms. To assess the potential impact of loss to follow-up on the estimates of treatment effect we will, for varying assumptions about the outcomes of participants lost to follow-up (LTFU), calculate (1) the percentage of RCTs that lose statistical significance and (2) the mean change in effect estimate across RCTs. The different assumptions we will test are the following: (1) none of the LTFU participants had the event; (2) all LTFU participants had the event; (3) all LTFU participants in the treatment group had the event; none of those in the control group had it (worst case scenario); (4) the event incidence among LTFU participants (relative to observed participants) increased, with a higher relative increase in the intervention group; and (5) the event incidence among LTFU participants (relative to observed participants) increased in the intervention group and decreased in the control group.

Discussion

We aim to make our objectives and methods transparent. The results of this study may have important implications for both clinical trialists and users of the medical literature.
Appendix
Available only for authorised users
Literature
1.
go back to reference Montori VM, Guyatt GH: Intention-to-treat principle. 2001, 165: 1339-1341. Montori VM, Guyatt GH: Intention-to-treat principle. 2001, 165: 1339-1341.
2.
go back to reference Altman DG: Missing outcomes: addressing the dilemma. Open Med. 2009, 3: e21-e23. Altman DG: Missing outcomes: addressing the dilemma. Open Med. 2009, 3: e21-e23.
3.
go back to reference Fielding S, Maclennan G, Cook JA, Ramsay CR: A review of RCTs in four medical journals to assess the use of imputation to overcome missing data in quality of life outcomes. Trials. 2008, 9: 51-10.1186/1745-6215-9-51.CrossRefPubMedPubMedCentral Fielding S, Maclennan G, Cook JA, Ramsay CR: A review of RCTs in four medical journals to assess the use of imputation to overcome missing data in quality of life outcomes. Trials. 2008, 9: 51-10.1186/1745-6215-9-51.CrossRefPubMedPubMedCentral
4.
go back to reference Moher D, Schulz KF, Altman D, for the CG: The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials. JAMA. 2001, 285: 1987-1991. 10.1001/jama.285.15.1987.CrossRefPubMed Moher D, Schulz KF, Altman D, for the CG: The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials. JAMA. 2001, 285: 1987-1991. 10.1001/jama.285.15.1987.CrossRefPubMed
5.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, for the CG: The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, for the CG: The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed
6.
7.
go back to reference Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clinical Trials. 2004, 1: 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clinical Trials. 2004, 1: 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed
8.
go back to reference Gravel J, Opatrny L, Shapiro S: The intention-to-treat approach in randomized controlled trials: Are authors saying what they do and doing what they say?. Clinical Trials. 2007, 4: 350-356. 10.1177/1740774507081223.CrossRefPubMed Gravel J, Opatrny L, Shapiro S: The intention-to-treat approach in randomized controlled trials: Are authors saying what they do and doing what they say?. Clinical Trials. 2007, 4: 350-356. 10.1177/1740774507081223.CrossRefPubMed
9.
go back to reference Baron B, Boutron Bruno I, Ravaud G: Violation of the intent-to-treat principle and rate of missing data in superiority trials assessing structural outcomes in rheumatic diseases. Arthritis & Rheumatism. 2005, 52: 1858-1865. 10.1002/art.21116.CrossRef Baron B, Boutron Bruno I, Ravaud G: Violation of the intent-to-treat principle and rate of missing data in superiority trials assessing structural outcomes in rheumatic diseases. Arthritis & Rheumatism. 2005, 52: 1858-1865. 10.1002/art.21116.CrossRef
10.
go back to reference Kjaergard LL, Villumsen J, Gluud C, Kjaergard LL, Villumsen J, Gluud C: Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Annals of Internal Medicine. 2001, 135: 982-989.CrossRefPubMed Kjaergard LL, Villumsen J, Gluud C, Kjaergard LL, Villumsen J, Gluud C: Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Annals of Internal Medicine. 2001, 135: 982-989.CrossRefPubMed
11.
go back to reference Balk EM, Bonis PA, Moskowitz H, Schmid CH, Ioannidis JP, Wang C, Lau J, Balk EM, Bonis PAL, Moskowitz H: Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials.[see comment]. JAMA. 2002, 287: 2973-2982. 10.1001/jama.287.22.2973.CrossRefPubMed Balk EM, Bonis PA, Moskowitz H, Schmid CH, Ioannidis JP, Wang C, Lau J, Balk EM, Bonis PAL, Moskowitz H: Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials.[see comment]. JAMA. 2002, 287: 2973-2982. 10.1001/jama.287.22.2973.CrossRefPubMed
12.
go back to reference Schulz KF, Chalmers I, Hayes RJ, Altman DG, Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.[see comment]. JAMA. 1995, 273: 408-412. 10.1001/jama.273.5.408.CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG, Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.[see comment]. JAMA. 1995, 273: 408-412. 10.1001/jama.273.5.408.CrossRefPubMed
13.
go back to reference Tierney JF, Stewart LA: Investigating patient exclusion bias in meta-analysis. International Journal of Epidemiology. 2005, 34: 79-87. 10.1093/ije/dyh300.CrossRefPubMed Tierney JF, Stewart LA: Investigating patient exclusion bias in meta-analysis. International Journal of Epidemiology. 2005, 34: 79-87. 10.1093/ije/dyh300.CrossRefPubMed
14.
go back to reference Geng EH, Emenyonu N, Bwana MB, Glidden DV, Martin JN: Sampling-Based Approach to Determining Outcomes of Patients Lost to Follow-Up in Antiretroviral Therapy Scale-Up Programs in Africa. JAMA. 2008, 300: 506-507. 10.1001/jama.300.5.506.CrossRefPubMedPubMedCentral Geng EH, Emenyonu N, Bwana MB, Glidden DV, Martin JN: Sampling-Based Approach to Determining Outcomes of Patients Lost to Follow-Up in Antiretroviral Therapy Scale-Up Programs in Africa. JAMA. 2008, 300: 506-507. 10.1001/jama.300.5.506.CrossRefPubMedPubMedCentral
15.
go back to reference Ioannidis JP, Bassett R, Hughes MD, Volberding PA, Sacks HS, Lau J, Ioannidis JP, Bassett R, Hughes MD, Volberding PA: Predictors and impact of patients lost to follow-up in a long-term randomized trial of immediate versus deferred antiretroviral treatment. J Acquir Immune Defic Syndr Hum Retrovirol. 1997, 16 (1): 22-30.CrossRefPubMed Ioannidis JP, Bassett R, Hughes MD, Volberding PA, Sacks HS, Lau J, Ioannidis JP, Bassett R, Hughes MD, Volberding PA: Predictors and impact of patients lost to follow-up in a long-term randomized trial of immediate versus deferred antiretroviral treatment. J Acquir Immune Defic Syndr Hum Retrovirol. 1997, 16 (1): 22-30.CrossRefPubMed
16.
go back to reference Schulz KF, Grimes DA, Altman DG, Hayes RJ: Blinding and exclusions after allocation in randomised controlled trials: survey of published parallel group trials in obstetrics and gynaecology. BMJ. 1996, 312: 742-744.CrossRefPubMedPubMedCentral Schulz KF, Grimes DA, Altman DG, Hayes RJ: Blinding and exclusions after allocation in randomised controlled trials: survey of published parallel group trials in obstetrics and gynaecology. BMJ. 1996, 312: 742-744.CrossRefPubMedPubMedCentral
18.
go back to reference Guyatt G, Montori V, Devereaux PJ, Schunemann H, Bhandari M, Guyatt G, Montori V, Devereaux PJ, Schunemann H, Bhandari M: Patients at the center: in our practice, and in our use of language. ACP Journal Club. 2004, 140: A11-12.PubMed Guyatt G, Montori V, Devereaux PJ, Schunemann H, Bhandari M, Guyatt G, Montori V, Devereaux PJ, Schunemann H, Bhandari M: Patients at the center: in our practice, and in our use of language. ACP Journal Club. 2004, 140: A11-12.PubMed
19.
go back to reference Ferreira-Gonzalez I, Permanyer-Miralda G, Domingo-Salvany A, Busse JW, Heels-Ansdell D, Montori VM, Akl EA, Bryant DM, Alonso-Coello P, Alonso J: Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ. 2007, 334: 786-10.1136/bmj.39136.682083.AE.CrossRefPubMedPubMedCentral Ferreira-Gonzalez I, Permanyer-Miralda G, Domingo-Salvany A, Busse JW, Heels-Ansdell D, Montori VM, Akl EA, Bryant DM, Alonso-Coello P, Alonso J: Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ. 2007, 334: 786-10.1136/bmj.39136.682083.AE.CrossRefPubMedPubMedCentral
20.
go back to reference Landis JR, Koch GG, Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG, Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
21.
go back to reference Godlee F: Publishing study protocols: making them visible will improve registration, reporting and recruitment. BMC News and Views. 2001, 2: 4- Godlee F: Publishing study protocols: making them visible will improve registration, reporting and recruitment. BMC News and Views. 2001, 2: 4-
22.
go back to reference Montori VM, Devereaux PJ, Adhikari NKJ, Burns KEA, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM: Randomized Trials Stopped Early for Benefit: A Systematic Review. JAMA. 2005, 294: 2203-2209. 10.1001/jama.294.17.2203.CrossRefPubMed Montori VM, Devereaux PJ, Adhikari NKJ, Burns KEA, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM: Randomized Trials Stopped Early for Benefit: A Systematic Review. JAMA. 2005, 294: 2203-2209. 10.1001/jama.294.17.2203.CrossRefPubMed
23.
go back to reference Lee KP, Schotland M, Bacchetti P, Bero LA: Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed Lee KP, Schotland M, Bacchetti P, Bero LA: Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed
Metadata
Title
LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact
Authors
Elie A Akl
Matthias Briel
John J You
Francois Lamontagne
Azim Gangji
Tali Cukierman-Yaffe
Mohamad Alshurafa
Xin Sun
Kara A Nerenberg
Bradley C Johnston
Claudio Vera
Edward J Mills
Dirk Bassler
Arturo Salazar
Neera Bhatnagar
Jason W Busse
Zara Khalid
SD Walter
Deborah J Cook
Holger J Schünemann
Douglas G Altman
Gordon H Guyatt
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Trials / Issue 1/2009
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-10-40

Other articles of this Issue 1/2009

Trials 1/2009 Go to the issue