Skip to main content
Top
Published in: BMC Cancer 1/2013

Open Access 01-12-2013 | Research article

Systematic evaluation of the methodology of randomized controlled trials of anticoagulation in patients with cancer

Authors: Gabriel Rada, Holger J Schünemann, Nawman Labedi, Pierre El-Hachem, Victor F Kairouz, Elie A Akl

Published in: BMC Cancer | Issue 1/2013

Login to get access

Abstract

Background

Randomized controlled trials (RCTs) that are inappropriately designed or executed may provide biased findings and mislead clinical practice. In view of recent interest in the treatment and prevention of thrombotic complications in cancer patients we evaluated the characteristics, risk of bias and their time trends in RCTs of anticoagulation in patients with cancer.

Methods

We conducted a comprehensive search, including a search of four electronic databases (MEDLINE, EMBASE, ISI the Web of Science, and CENTRAL) up to February 2010. We included RCTs in which the intervention and/or comparison consisted of: vitamin K antagonists, unfractionated heparin (UFH), low molecular weight heparin (LMWH), direct thrombin inhibitors or fondaparinux. We performed descriptive analyses and assessed the association between the variables of interest and the year of publication.

Results

We included 67 RCTs with 24,071 participants. In twenty one trials (31%) DVT diagnosis was triggered by clinical suspicion; the remaining trials either screened for DVT or were unclear about their approach. 41 (61%), 22 (33%), and 11 (16%) trials respectively reported on major bleeding, minor bleeding, and thrombocytopenia. The percentages of trials satisfying risk of bias criteria were: adequate sequence generation (85%), adequate allocation concealment (61%), participants’ blinding (39%), data collectors’ blinding (44%), providers’ blinding (41%), outcome assessors’ blinding (75%), data analysts’ blinding (15%), intention to treat analysis (57%), no selective outcome reporting (12%), no stopping early for benefit (97%). The mean follow-up rate was 96%. Adequate allocation concealment and the reporting of intention to treat analysis were the only two quality criteria that improved over time.

Conclusions

Many RCTs of anticoagulation in patients with cancer appear to use insufficiently rigorous outcome assessment methods and to have deficiencies in key methodological features. It is not clear whether this reflects a problem in the design, conduct or the reporting of these trials, or both. Future trials should avoid the shortcomings described in this article.
Appendix
Available only for authorised users
Literature
1.
go back to reference Louzada ML, Majeed H, Dao V, Wells PS: Risk of recurrent venous thromboembolism according to malignancy characteristics in patients with cancer-associated thrombosis: a systematic review of observational and intervention studies. Blood Coagul Fibrinolysis. 2011, 22 (2): 86-91.CrossRefPubMed Louzada ML, Majeed H, Dao V, Wells PS: Risk of recurrent venous thromboembolism according to malignancy characteristics in patients with cancer-associated thrombosis: a systematic review of observational and intervention studies. Blood Coagul Fibrinolysis. 2011, 22 (2): 86-91.CrossRefPubMed
2.
go back to reference Khorana AA, Francis CW, Culakova E, Kuderer NM, Lyman GH: Thromboembolism is a leading cause of death in cancer patients receiving outpatient chemotherapy. J Thromb Haemost. 2007, 5 (3): 632-634.CrossRefPubMed Khorana AA, Francis CW, Culakova E, Kuderer NM, Lyman GH: Thromboembolism is a leading cause of death in cancer patients receiving outpatient chemotherapy. J Thromb Haemost. 2007, 5 (3): 632-634.CrossRefPubMed
3.
go back to reference Akl EA, Labedi N, Barba M, Terrenato I, Sperati F, Muti P, Schunemann H: Anticoagulation for the long-term treatment of venous thromboembolism in patients with cancer. Cochrane Database Syst Rev. 2011,   (6): CD006650-PubMed Akl EA, Labedi N, Barba M, Terrenato I, Sperati F, Muti P, Schunemann H: Anticoagulation for the long-term treatment of venous thromboembolism in patients with cancer. Cochrane Database Syst Rev. 2011,   (6): CD006650-PubMed
4.
go back to reference Akl EA, Vasireddi SR, Gunukula S, Barba M, Sperati F, Terrenato I, Muti P, Schunemann H: Anticoagulation for the initial treatment of venous thromboembolism in patients with cancer. Cochrane Database Syst Rev. 2011, 4: CD006649-PubMed Akl EA, Vasireddi SR, Gunukula S, Barba M, Sperati F, Terrenato I, Muti P, Schunemann H: Anticoagulation for the initial treatment of venous thromboembolism in patients with cancer. Cochrane Database Syst Rev. 2011, 4: CD006649-PubMed
5.
go back to reference Akl EA, Vasireddi SR, Gunukula S, Yosuico VE, Barba M, Sperati F, Cook D, Schunemann H: Anticoagulation for patients with cancer and central venous catheters. Cochrane Database Syst Rev. 2011, 4: CD006468-PubMed Akl EA, Vasireddi SR, Gunukula S, Yosuico VE, Barba M, Sperati F, Cook D, Schunemann H: Anticoagulation for patients with cancer and central venous catheters. Cochrane Database Syst Rev. 2011, 4: CD006468-PubMed
6.
go back to reference Akl EA, Labedi N, Terrenato I, Barba M, Sperati F, Sempos EV, Muti P, Cook D, Schunemann H: Low molecular weight heparin versus unfractionated heparin for perioperative thromboprophylaxis in patients with cancer. Cochrane Database Syst Rev. 2011, 11: CD009447-PubMed Akl EA, Labedi N, Terrenato I, Barba M, Sperati F, Sempos EV, Muti P, Cook D, Schunemann H: Low molecular weight heparin versus unfractionated heparin for perioperative thromboprophylaxis in patients with cancer. Cochrane Database Syst Rev. 2011, 11: CD009447-PubMed
7.
go back to reference Akl EA, Gunukula S, Barba M, Yosuico VE, van Doormaal FF, Kuipers S, Middeldorp S, Dickinson HO, Bryant A, Schunemann H: Parenteral anticoagulation in patients with cancer who have no therapeutic or prophylactic indication for anticoagulation. Cochrane Database Syst Rev. 2011, 4: CD006652-PubMed Akl EA, Gunukula S, Barba M, Yosuico VE, van Doormaal FF, Kuipers S, Middeldorp S, Dickinson HO, Bryant A, Schunemann H: Parenteral anticoagulation in patients with cancer who have no therapeutic or prophylactic indication for anticoagulation. Cochrane Database Syst Rev. 2011, 4: CD006652-PubMed
8.
go back to reference Akl EA, Vasireddi SR, Gunukula S, Yosuico VE, Barba M, Terrenato I, Sperati F, Schunemann H: Oral anticoagulation in patients with cancer who have no therapeutic or prophylactic indication for anticoagulation. Cochrane Database Syst Rev. 2011, CD006466-12 Akl EA, Vasireddi SR, Gunukula S, Yosuico VE, Barba M, Terrenato I, Sperati F, Schunemann H: Oral anticoagulation in patients with cancer who have no therapeutic or prophylactic indication for anticoagulation. Cochrane Database Syst Rev. 2011, CD006466-12
9.
go back to reference Higgins JP, Altman DG, Sterne JA: Chapter 8.5: The Cochrane Collaboration’s tool for assessing risk of bias. Cochrane Handbook for Systematic Reviews of Interventions Version 510 Available from wwwcochrane-handbookorg edn. Edited by: Higgins JPT. 2011, GS: The Cochrane Collaboration Higgins JP, Altman DG, Sterne JA: Chapter 8.5: The Cochrane Collaboration’s tool for assessing risk of bias. Cochrane Handbook for Systematic Reviews of Interventions Version 510 Available from wwwcochrane-handbookorg edn. Edited by: Higgins JPT. 2011, GS: The Cochrane Collaboration
10.
go back to reference Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al: GRADE guidelines: 4. Rating the quality of evidence--study limitations (risk of bias). J Clin Epidemiol. 2011, 64 (4): 407-415.CrossRefPubMed Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al: GRADE guidelines: 4. Rating the quality of evidence--study limitations (risk of bias). J Clin Epidemiol. 2011, 64 (4): 407-415.CrossRefPubMed
11.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010, 63 (8): e1-e37.CrossRefPubMed Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010, 63 (8): e1-e37.CrossRefPubMed
12.
go back to reference Berghmans T, Meert AP, Mascaux C, Paesmans M, Lafitte JJ, Sculier JP: Citation indexes do not reflect methodological quality in lung cancer randomised trials. Ann Oncol. 2003, 14 (5): 715-721.CrossRefPubMed Berghmans T, Meert AP, Mascaux C, Paesmans M, Lafitte JJ, Sculier JP: Citation indexes do not reflect methodological quality in lung cancer randomised trials. Ann Oncol. 2003, 14 (5): 715-721.CrossRefPubMed
13.
go back to reference Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B: Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004, 328 (7430): 22-24.CrossRefPubMedPubMedCentral Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B: Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004, 328 (7430): 22-24.CrossRefPubMedPubMedCentral
14.
go back to reference Shakespeare TP, Thiagarajan A, Gebski V: Evaluation of the quality of radiotherapy randomized trials for painful bone metastases. Cancer. 2005, 103 (9): 1976-1981.CrossRefPubMed Shakespeare TP, Thiagarajan A, Gebski V: Evaluation of the quality of radiotherapy randomized trials for painful bone metastases. Cancer. 2005, 103 (9): 1976-1981.CrossRefPubMed
15.
go back to reference Tuech JJ, Pessaux P, Moutel G, Thoma V, Schraub S, Herve C: Methodological quality and reporting of ethical requirements in phase III cancer trials. J Med Ethics. 2005, 31 (5): 251-255.CrossRefPubMedPubMedCentral Tuech JJ, Pessaux P, Moutel G, Thoma V, Schraub S, Herve C: Methodological quality and reporting of ethical requirements in phase III cancer trials. J Med Ethics. 2005, 31 (5): 251-255.CrossRefPubMedPubMedCentral
16.
go back to reference Lai R, Chu R, Fraumeni M, Thabane L: Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006, 24 (7): 1136-1144.CrossRefPubMed Lai R, Chu R, Fraumeni M, Thabane L: Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006, 24 (7): 1136-1144.CrossRefPubMed
17.
go back to reference Akl EA, Sun X, Busse JW, Johnston BC, Briel M, Mulla S, You JJ, Bassler D, Lamontagne F, Vera C, et al: Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid. J Clin Epidemiol. 2012, 65 (3): 262-267.CrossRefPubMed Akl EA, Sun X, Busse JW, Johnston BC, Briel M, Mulla S, You JJ, Bassler D, Lamontagne F, Vera C, et al: Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid. J Clin Epidemiol. 2012, 65 (3): 262-267.CrossRefPubMed
18.
go back to reference Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A: Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA. 1989, 262 (15): 2101-2107.CrossRefPubMed Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A: Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA. 1989, 262 (15): 2101-2107.CrossRefPubMed
19.
go back to reference Marsoni S, Torri W, Taiana A, Gambino A, Grilli R, Liati P, Franzosi MG, Pistotti V, Parazzini F, Focarile F, et al: Critical review of the quality and development of randomized clinical trials (RCTs) and their influence on the treatment of advanced epithelial ovarian cancer. Ann Oncol. 1990, 1 (5): 343-350.PubMed Marsoni S, Torri W, Taiana A, Gambino A, Grilli R, Liati P, Franzosi MG, Pistotti V, Parazzini F, Focarile F, et al: Critical review of the quality and development of randomized clinical trials (RCTs) and their influence on the treatment of advanced epithelial ovarian cancer. Ann Oncol. 1990, 1 (5): 343-350.PubMed
20.
go back to reference Rinck GC, van den Bos GA, Kleijnen J, de Haes HJ, Schade E, Veenhof CH: Methodologic issues in effectiveness research on palliative cancer care: a systematic review. J Clin Oncol. 1997, 15 (4): 1697-1707.PubMed Rinck GC, van den Bos GA, Kleijnen J, de Haes HJ, Schade E, Veenhof CH: Methodologic issues in effectiveness research on palliative cancer care: a systematic review. J Clin Oncol. 1997, 15 (4): 1697-1707.PubMed
21.
go back to reference Luce S, Paesmans M, Berghmans T, Castaigne C, Sotiriou C, Vermylen P, Sculier JP: [Critical review of the randomized trials assessing the role of adjuvant thoracic irradiation and chemotherapy in the treatment of limited-stage small cell lung cancer]. Rev Mal Respir. 1998, 15 (5): 633-641.PubMed Luce S, Paesmans M, Berghmans T, Castaigne C, Sotiriou C, Vermylen P, Sculier JP: [Critical review of the randomized trials assessing the role of adjuvant thoracic irradiation and chemotherapy in the treatment of limited-stage small cell lung cancer]. Rev Mal Respir. 1998, 15 (5): 633-641.PubMed
22.
go back to reference Sculier JP, Berghmans T, Castaigne C, Luce S, Sotiriou C, Vermylen P, Paesmans M: Maintenance chemotherapy for small cell lung cancer: a critical review of the literature. Lung Cancer. 1998, 19 (2): 141-151.CrossRefPubMed Sculier JP, Berghmans T, Castaigne C, Luce S, Sotiriou C, Vermylen P, Paesmans M: Maintenance chemotherapy for small cell lung cancer: a critical review of the literature. Lung Cancer. 1998, 19 (2): 141-151.CrossRefPubMed
23.
go back to reference George S, Schell MJ, Detterbeck FC, Socinski MA: Adjuvant Chemotherapy for Resected Non-Small Cell Carcinoma of the Lung: Why We Still Don't Know. Oncologist. 1998, 3 (1): 35-44.PubMed George S, Schell MJ, Detterbeck FC, Socinski MA: Adjuvant Chemotherapy for Resected Non-Small Cell Carcinoma of the Lung: Why We Still Don't Know. Oncologist. 1998, 3 (1): 35-44.PubMed
24.
go back to reference Boutron I, Estellat C, Guittet L, Dechartres A, Sackett DL, Hrobjartsson A, Ravaud P: Methods of blinding in reports of randomized controlled trials assessing pharmacologic treatments: a systematic review. PLoS Med. 2006, 3 (10): e425-CrossRefPubMedPubMedCentral Boutron I, Estellat C, Guittet L, Dechartres A, Sackett DL, Hrobjartsson A, Ravaud P: Methods of blinding in reports of randomized controlled trials assessing pharmacologic treatments: a systematic review. PLoS Med. 2006, 3 (10): e425-CrossRefPubMedPubMedCentral
25.
26.
go back to reference Porta N, Bonet C, Cobo E: Discordance between reported intention-to-treat and per protocol analyses. J Clin Epidemiol. 2007, 60 (7): 663-669.CrossRefPubMed Porta N, Bonet C, Cobo E: Discordance between reported intention-to-treat and per protocol analyses. J Clin Epidemiol. 2007, 60 (7): 663-669.CrossRefPubMed
27.
go back to reference Guyatt G, Eikelboom J, Gould M, Garcia D, Crowther M, Murad M, Kahn S, Falck-Ytter Y, Francis C, Lansberg M, et al: Approach to Outcome Measurement in the Prevention of Thrombosis in Surgical and Medical Patients: ACCP Evidence-Based Clinical Practice Guidelines (Ninth Edition). Chest. 2012, 141 (2 suppl): e185S-e194S.CrossRefPubMedPubMedCentral Guyatt G, Eikelboom J, Gould M, Garcia D, Crowther M, Murad M, Kahn S, Falck-Ytter Y, Francis C, Lansberg M, et al: Approach to Outcome Measurement in the Prevention of Thrombosis in Surgical and Medical Patients: ACCP Evidence-Based Clinical Practice Guidelines (Ninth Edition). Chest. 2012, 141 (2 suppl): e185S-e194S.CrossRefPubMedPubMedCentral
28.
go back to reference Abdel-Razeq HN, Mansour AH, Ismael YM: Incidental pulmonary embolism in cancer patients: clinical characteristics and outcome–a comprehensive cancer center experience. Vasc Health Risk Manag. 2011, 7: 153-158.CrossRefPubMedPubMedCentral Abdel-Razeq HN, Mansour AH, Ismael YM: Incidental pulmonary embolism in cancer patients: clinical characteristics and outcome–a comprehensive cancer center experience. Vasc Health Risk Manag. 2011, 7: 153-158.CrossRefPubMedPubMedCentral
29.
go back to reference Tallon Guerola P, Arenas Jimenez J, de la Hoz RJ, Massuti Sureda B, Garcia Marco JM: [The clinical and radiological characteristics and evolution of incidentally diagnosed pulmonary thromboembolism]. Radiologia. 2008, 50 (3): 239-243.CrossRefPubMed Tallon Guerola P, Arenas Jimenez J, de la Hoz RJ, Massuti Sureda B, Garcia Marco JM: [The clinical and radiological characteristics and evolution of incidentally diagnosed pulmonary thromboembolism]. Radiologia. 2008, 50 (3): 239-243.CrossRefPubMed
30.
go back to reference Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326 (7400): 1167-1170.CrossRefPubMedPubMedCentral Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326 (7400): 1167-1170.CrossRefPubMedPubMedCentral
31.
go back to reference Bero L, Oostvogel F, Bacchetti P, Lee K: Factors associated with findings of published trials of drug-drug comparisons: why some statins appear more efficacious than others. PLoS Med. 2007, 4 (6): e184-CrossRefPubMedPubMedCentral Bero L, Oostvogel F, Bacchetti P, Lee K: Factors associated with findings of published trials of drug-drug comparisons: why some statins appear more efficacious than others. PLoS Med. 2007, 4 (6): e184-CrossRefPubMedPubMedCentral
32.
go back to reference Dechartres A, Charles P, Hopewell S, Ravaud P, Altman DG: Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2011, 64 (2): 136-144.CrossRefPubMed Dechartres A, Charles P, Hopewell S, Ravaud P, Altman DG: Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2011, 64 (2): 136-144.CrossRefPubMed
Metadata
Title
Systematic evaluation of the methodology of randomized controlled trials of anticoagulation in patients with cancer
Authors
Gabriel Rada
Holger J Schünemann
Nawman Labedi
Pierre El-Hachem
Victor F Kairouz
Elie A Akl
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2013
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/1471-2407-13-76

Other articles of this Issue 1/2013

BMC Cancer 1/2013 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine