Skip to main content
Top
Published in: Trials 1/2011

Open Access 01-12-2011 | Research

Modified versus standard intention-to-treat reporting: Are there differences in methodological quality, sponsorship, and findings in randomized trials? A cross-sectional study

Authors: Alessandro Montedori, Maria Isabella Bonacini, Giovanni Casazza, Maria Laura Luchetta, Piergiorgio Duca, Francesco Cozzolino, Iosief Abraha

Published in: Trials | Issue 1/2011

Login to get access

Abstract

Background

Randomized controlled trials (RCTs) that use the modified intention-to-treat (mITT) approach are increasingly being published. Such trials have a preponderance of post-randomization exclusions, industry sponsorship, and favourable findings, and little is known whether in terms of these items mITT trials are different with respect to trials that report a standard intention-to-treat.

Methods

To determine differences in the methodological quality, sponsorship, authors' conflicts of interest, and findings among trials with different "types" of intention-to-treat, we undertook a cross-sectional study of RCTs published in 2006 in three general medical journals (the Journal of the American Medical Association, the New England Journal of Medicine and the Lancet) and three specialty journals (Antimicrobial Agents and Chemotherapy, the American Heart Journal and the Journal of Clinical Oncology). Trials were categorized based on the "type" of intention-to-treat reporting as follows: ITT, trials reporting the use of standard ITT approach; mITT, trials reporting the use of a "modified intention-to-treat" approach; and "no ITT", trials not reporting the use of any intention-to-treat approach. Two pairs of reviewers independently extracted the data in duplicate. The strength of the associations between the "type" of intention-to-treat reporting and the quality of reporting (sample size calculation, flow-chart, lost to follow-up), the methodological quality of the trials (sequence generation, allocation concealment, and blinding), the funding source, and the findings was determined. Odds ratios (OR) were calculated with 95% confidence intervals (CI).

Results

Of the 367 RCTs included, 197 were classified as ITT, 56 as mITT, and 114 as "no ITT" trials. The quality of reporting and the methodological quality of the mITT trials were similar to those of the ITT trials; however, the mITT trials were more likely to report post-randomization exclusions (adjusted OR 3.43 [95%CI, 1.70 to 6.95]; P < 0.001). We found a strong association between trials classified as mITT and for-profit agency sponsorship (adjusted OR 7.41 [95%CI, 3.14 to 17.48]; P < .001) as well as the presence of authors' conflicts of interest (adjusted OR 5.14 [95%CI, 2.12 to 12.48]; P < .001). There was no association between mITT reporting and favourable results; in general, however, trials with for-profit agency sponsorship were significantly associated with favourable results (adjusted OR 2.30; [95%CI, 1.28 to 4.16]; P = 0.006).

Conclusion

We found that the mITT trials were significantly more likely to perform post-randomization exclusions and were strongly associated with industry funding and authors' conflicts of interest.
Appendix
Available only for authorised users
Literature
1.
go back to reference Gravel J, Opatrny L, Shapiro S: The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?. Clin Trials. 2007, 4: 350-356. 10.1177/1740774507081223.CrossRefPubMed Gravel J, Opatrny L, Shapiro S: The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?. Clin Trials. 2007, 4: 350-356. 10.1177/1740774507081223.CrossRefPubMed
2.
3.
go back to reference Kruse RL, Alper BS, Reust C, Stevermer JJ, Shannon S, Williams RH: Intention-to-treat analysis: who is in? Who is out?. J Fam Pract. 2002, 51: 969-971.PubMed Kruse RL, Alper BS, Reust C, Stevermer JJ, Shannon S, Williams RH: Intention-to-treat analysis: who is in? Who is out?. J Fam Pract. 2002, 51: 969-971.PubMed
4.
go back to reference Ruiz-Canela M, Martinez-Gonzalez MA, de Irala-Estevez J: Intention to treat analysis is related to methodological quality. BMJ. 2000, 320: 1007-10.1136/bmj.320.7240.1007.CrossRefPubMedPubMedCentral Ruiz-Canela M, Martinez-Gonzalez MA, de Irala-Estevez J: Intention to treat analysis is related to methodological quality. BMJ. 2000, 320: 1007-10.1136/bmj.320.7240.1007.CrossRefPubMedPubMedCentral
5.
go back to reference Abraha I, Montedori A: Modified intention to treat reporting in randomised controlled trials: systematic review. BMJ. 2010, 340: c2697-10.1136/bmj.c2697.CrossRefPubMedPubMedCentral Abraha I, Montedori A: Modified intention to treat reporting in randomised controlled trials: systematic review. BMJ. 2010, 340: c2697-10.1136/bmj.c2697.CrossRefPubMedPubMedCentral
6.
go back to reference Edwards SJ, Lilford RJ, Braunholtz DA, Jackson JC, Hewison J, Thornton J: Ethical issues in the design and conduct of randomised controlled trials. Health Technol Assess. 1998, 2: i-vi. 1-132PubMed Edwards SJ, Lilford RJ, Braunholtz DA, Jackson JC, Hewison J, Thornton J: Ethical issues in the design and conduct of randomised controlled trials. Health Technol Assess. 1998, 2: i-vi. 1-132PubMed
7.
go back to reference Gotzsche PC: Believability of relative risks and odds ratios in abstracts: cross sectional study. BMJ. 2006, 333: 231-234. 10.1136/bmj.38895.410451.79.CrossRefPubMedPubMedCentral Gotzsche PC: Believability of relative risks and odds ratios in abstracts: cross sectional study. BMJ. 2006, 333: 231-234. 10.1136/bmj.38895.410451.79.CrossRefPubMedPubMedCentral
8.
go back to reference Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, Kuderer NM, Lyman GH: The uncertainty principle and industry-sponsored research. Lancet. 2000, 356: 635-638. 10.1016/S0140-6736(00)02605-2.CrossRefPubMed Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, Kuderer NM, Lyman GH: The uncertainty principle and industry-sponsored research. Lancet. 2000, 356: 635-638. 10.1016/S0140-6736(00)02605-2.CrossRefPubMed
9.
go back to reference Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003, 289: 454-465. 10.1001/jama.289.4.454.CrossRefPubMed Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003, 289: 454-465. 10.1001/jama.289.4.454.CrossRefPubMed
10.
go back to reference Abraha I, Montedori A, Romagnoli C: Modified Intention to Treat: frequency, definition and implication for clinical trials [abstract]. XV Cochrane Colloquium. 2007, Sao Paulo, Brazil, 86-87. Abraha I, Montedori A, Romagnoli C: Modified Intention to Treat: frequency, definition and implication for clinical trials [abstract]. XV Cochrane Colloquium. 2007, Sao Paulo, Brazil, 86-87.
11.
go back to reference Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral
12.
go back to reference Schulz KF, Grimes DA, Altman DG, Hayes RJ: Blinding and exclusions after allocation in randomised controlled trials: survey of published parallel group trials in obstetrics and gynaecology. BMJ. 1996, 312: 742-744.CrossRefPubMedPubMedCentral Schulz KF, Grimes DA, Altman DG, Hayes RJ: Blinding and exclusions after allocation in randomised controlled trials: survey of published parallel group trials in obstetrics and gynaecology. BMJ. 1996, 312: 742-744.CrossRefPubMedPubMedCentral
13.
go back to reference Tierney JF, Stewart LA: Investigating patient exclusion bias in meta-analysis. Int J Epidemiol. 2005, 34: 79-87. 10.1093/ije/dyh300.CrossRefPubMed Tierney JF, Stewart LA: Investigating patient exclusion bias in meta-analysis. Int J Epidemiol. 2005, 34: 79-87. 10.1093/ije/dyh300.CrossRefPubMed
14.
go back to reference Nuesch E, Trelle S, Reichenbach S, Rutjes AW, Burgi E, Scherer M, Altman DG, Juni P: The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study. BMJ. 2009, 339: b3244-10.1136/bmj.b3244.CrossRefPubMedPubMedCentral Nuesch E, Trelle S, Reichenbach S, Rutjes AW, Burgi E, Scherer M, Altman DG, Juni P: The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study. BMJ. 2009, 339: b3244-10.1136/bmj.b3244.CrossRefPubMedPubMedCentral
15.
go back to reference Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B: Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003, 326: 1171-1173. 10.1136/bmj.326.7400.1171.CrossRefPubMedPubMedCentral Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B: Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003, 326: 1171-1173. 10.1136/bmj.326.7400.1171.CrossRefPubMedPubMedCentral
16.
go back to reference Patsopoulos NA, Ioannidis JP, Analatos AA: Origin and funding of the most frequently cited papers in medicine: database analysis. BMJ. 2006, 332: 1061-1064. 10.1136/bmj.38768.420139.80.CrossRefPubMedPubMedCentral Patsopoulos NA, Ioannidis JP, Analatos AA: Origin and funding of the most frequently cited papers in medicine: database analysis. BMJ. 2006, 332: 1061-1064. 10.1136/bmj.38768.420139.80.CrossRefPubMedPubMedCentral
17.
go back to reference Rochon PA, Gurwitz JH, Simms RW, Fortin PR, Felson DT, Minaker KL, Chalmers TC: A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994, 154: 157-163. 10.1001/archinte.154.2.157.CrossRefPubMed Rochon PA, Gurwitz JH, Simms RW, Fortin PR, Felson DT, Minaker KL, Chalmers TC: A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994, 154: 157-163. 10.1001/archinte.154.2.157.CrossRefPubMed
18.
go back to reference Safer DJ: Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis. 2002, 190: 583-592. 10.1097/00005053-200209000-00002.CrossRefPubMed Safer DJ: Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis. 2002, 190: 583-592. 10.1097/00005053-200209000-00002.CrossRefPubMed
19.
go back to reference Johansen HK, Gotzsche PC: Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. JAMA. 1999, 282: 1752-1759. 10.1001/jama.282.18.1752.CrossRefPubMed Johansen HK, Gotzsche PC: Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. JAMA. 1999, 282: 1752-1759. 10.1001/jama.282.18.1752.CrossRefPubMed
20.
21.
go back to reference Schulz KF, Altman DG, Moher D: CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010, 152: 726-732.CrossRefPubMed Schulz KF, Altman DG, Moher D: CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010, 152: 726-732.CrossRefPubMed
Metadata
Title
Modified versus standard intention-to-treat reporting: Are there differences in methodological quality, sponsorship, and findings in randomized trials? A cross-sectional study
Authors
Alessandro Montedori
Maria Isabella Bonacini
Giovanni Casazza
Maria Laura Luchetta
Piergiorgio Duca
Francesco Cozzolino
Iosief Abraha
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Trials / Issue 1/2011
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-12-58

Other articles of this Issue 1/2011

Trials 1/2011 Go to the issue