Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2016

Open Access 01-12-2016 | Research

Citation bias favoring positive clinical trials of thrombolytics for acute ischemic stroke: a cross-sectional analysis

Authors: Benjamin S. Misemer, Timothy F. Platts-Mills, Christopher W. Jones

Published in: Trials | Issue 1/2016

Login to get access

Abstract

Background

Citation bias occurs when positive trials involving a medical intervention receive more citations than neutral or negative trials of similar quality. Several large clinical trials have studied the use of thrombolytic agents for the treatment of acute ischemic stroke with differing results, thereby presenting an opportunity to assess these trials for evidence of citation bias. We compared citation rates among positive, neutral, and negative trials of alteplase (tPA) and other thrombolytic agents for stroke.

Methods

We used a 2014 Cochrane Review of thrombolytic therapy for the treatment of acute stroke to identify non-pilot, English-language stroke trials published in MEDLINE-indexed journals comparing thrombolytic therapy with control. We classified trials as positive if there was a statistically significant primary outcome difference favoring the intervention, neutral if there was no difference in primary outcome, or negative for a significant primary outcome difference favoring the control group. Trials were also considered negative if safety concerns supported stopping the trial early. Using Scopus, we collected citation counts through 2015 and compared citation rates according to trial outcomes.

Results

Eight tPA trials met inclusion criteria: two were positive, four were neutral, and two were negative. The two positive trials received 9080 total citations, the four neutral trials received 4847 citations, and the two negative trials received 1096 citations. The mean annual per-trial citation rates were 333 citations per year for positive trials, 96 citations per year for neutral trials, and 35 citations per year for negative trials. Trials involving other thrombolytic agents were not cited as often, though as with tPA, positive trials were cited more frequently than neutral or negative trials.

Conclusions

Positive trials of tPA for ischemic stroke are cited approximately three times as often as neutral trials, and nearly 10 times as often as negative trials, indicating the presence of substantial citation bias.
Appendix
Available only for authorised users
Literature
1.
Naghavi M, Wang H, Lozano R, Davis A, Liang X, Zhou M, Vollset SE, Ozgoren AA. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;385(9963):117–71.CrossRef
2.
Brown MD, Burton JH, Nazarian DJ, Promes SB. Clinical policy: use of intravenous tissue plasminogen activator for the management of acute ischemic stroke in the emergency department. Ann Emerg Med. 2015;66(3):322–33. e331.CrossRefPubMed
3.
European Stroke Organisation Executive Committee; ESOW. Guidelines for management of ischaemic stroke and transient ischaemic attack 2008. Cerebrovasc Dis. 2008;25(5):457–507.CrossRef
4.
Jauch EC, Saver JL, Adams Jr HP, Bruno A, Connors JJ, Demaerschalk BM, Khatri P, McMullan Jr PW, Qureshi AI, Rosenfield K, et al. Guidelines for the early management of patients with acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2013;44(3):870–947.CrossRefPubMed
5.
Alper BS, Malone-Moses M, McLellan JS, Prasad K, Manheimer E. Thrombolysis in acute ischaemic stroke: time for a rethink? BMJ. 2015;350:h1075.CrossRefPubMed
6.
7.
Jannot AS, Agoritsas T, Gayet-Ageron A, Perneger TV. Citation bias favoring statistically significant studies was present in medical research. J Clin Epidemiol. 2013;66(3):296–301.CrossRefPubMed
8.
Callaham M, Wears RL, Weber E. Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA. 2002;287(21):2847–50.CrossRefPubMed
9.
Wardlaw JM, Murray V, Berge E, del Zoppo GJ. Thrombolysis for acute ischaemic stroke. Cochrane Database Syst Rev. 2014;7:CD000213.PubMedCentral
10.
Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.CrossRefPubMed
11.
The National Institute of Neurological Disorders and Stroke rt-PA stroke study group. Tissue plasminogen activator for acute ischaemic stroke. N Engl J Med. 1995;333(24):1581–7.CrossRef
12.
Hacke W, Kaste M, Bluhmki E, Brozman M, Davalos A, Guidetti D, Larrue V, Lees KR, Medeghri Z, Machnig T, et al. Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. N Engl J Med. 2008;359(13):1317–29.CrossRefPubMed
13.
Hacke W, Kaste M, Fieschi C, Toni D, Lesaffre E, von Kummer R, Boysen G, Bluhmki E, Hoxter G, Mahagne MH, et al. Intravenous thrombolysis with recombinant tissue plasminogen activator for acute hemispheric stroke. The European Cooperative Acute Stroke Study (ECASS). JAMA. 1995;274(13):1017–25.CrossRefPubMed
14.
Hacke W, Kaste M, Fieschi C, von Kummer R, Davalos A, Meier D, Larrue V, Bluhmki E, Davis S, Donnan G, et al. Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European-Australasian Acute Stroke Study Investigators. Lancet. 1998;352(9136):1245–51.CrossRefPubMed
15.
Davis SM, Donnan GA, Parsons MW, Levi C, Butcher KS, Peeters A, Barber PA, Bladin C, De Silva DA, Byrnes G, et al. Effects of alteplase beyond 3 h after stroke in the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET): a placebo-controlled randomised trial. Lancet Neurol. 2008;7(4):299–309.CrossRefPubMed
16.
Sandercock P, Wardlaw JM, Lindley RI, Dennis M, Cohen G, Murray G, Innes K, Venables G, Czlonkowska A, Kobayashi A, et al. The benefits and harms of intravenous thrombolysis with recombinant tissue plasminogen activator within 6 h of acute ischaemic stroke (the third international stroke trial [IST-3]): a randomised controlled trial. Lancet. 2012;379(9834):2352–63.CrossRefPubMed
17.
Clark WM, Albers GW, Madden KP, Hamilton S. The rtPA (alteplase) 0- to 6-hour acute stroke trial, part A (A0276g): results of a double-blind, placebo-controlled, multicenter study. Thrombolytic therapy in acute ischemic stroke study investigators. Stroke. 2000;31(4):811–6.CrossRefPubMed
18.
Clark WM, Wissman S, Albers GW, Jhamandas JH, Madden KP, Hamilton S. Recombinant tissue-type plasminogen activator (alteplase) for ischemic stroke 3 to 5 hours after symptom onset. The ATLANTIS Study: a randomized controlled trial. Alteplase Thrombolysis for Acute Noninterventional Therapy in Ischemic Stroke. JAMA. 1999;282(21):2019–26.CrossRefPubMed
19.
Furlan A, Higashida R, Wechsler L, Gent M, Rowley H, Kase C, Pessin M, Ahuja A, Callahan F, Clark WM, et al. Intra-arterial prourokinase for acute ischemic stroke. The PROACT II study: a randomized controlled trial. Prolyse in Acute Cerebral Thromboembolism. JAMA. 1999;282(21):2003–11.CrossRefPubMed
20.
Hacke W, Albers G, Al-Rawi Y, Bogousslavsky J, Davalos A, Eliasziw M, Fischer M, Furlan A, Kaste M, Lees KR, et al. The Desmoteplase in Acute Ischemic Stroke trial (DIAS): a phase II MRI-based 9-hour window acute stroke thrombolysis trial with intravenous desmoteplase. Stroke. 2005;36(1):66–73.CrossRefPubMed
21.
Hacke W, Furlan AJ, Al-Rawi Y, Davalos A, Fiebach JB, Gruber F, Kaste M, Lipka LJ, Pedraza S, Ringleb PA, et al. Intravenous desmoteplase in patients with acute ischaemic stroke selected by MRI perfusion-diffusion weighted imaging or perfusion CT (DIAS-2): a prospective, randomised, double-blind, placebo-controlled study. Lancet Neurol. 2009;8(2):141–50.CrossRefPubMed
22.
Ogawa A, Mori E, Minematsu K, Taki W, Takahashi A, Nemoto S, Miyamoto S, Sasaki M, Inoue T, Group MJS. Randomized trial of intraarterial infusion of urokinase within 6 hours of middle cerebral artery stroke: the Middle cerebral artery Embolism Local fibrinolytic intervention Trial (MELT) Japan. Stroke. 2007;38(10):2633–9.CrossRefPubMed
23.
Donnan GA, Davis SM, Chambers BR, Gates PC, Hankey GJ, McNeil JJ, Rosen D, Stewart-Wynne EG, Tuck RR. Streptokinase for acute ischemic stroke with relationship to time of administration: Australian Streptokinase (ASK) Trial Study Group. JAMA. 1996;276(12):961–6.CrossRefPubMed
24.
The Multicentre Acute Stroke Trial - Europe Study Group. Thrombolytic therapy with streptokinase in acute ischaemic stroke. N Engl J Med. 1996;335(3):145–50.CrossRef
25.
Multicentre Acute Stroke Trial - Italy (MAST-I) Group. Randomised controlled trial of streptokinase, aspirin, and combination of both in treatment of acute ischaemic stroke. Lancet. 1995;346(8989):1509–14.
26.
Beel J, Gipp B. Google Scholar’s ranking algorithm: an introductory overview. In: Larsen B, Leta J, editors. Proceedings of the 12th International Conference on Scientometrics and Informetrics, vol. 1. Rio de Janeiro: International Society for Scientometrics and Informetrics; 2009. p. 230–41.
27.
28.
Petersen AM, Fortunato S, Pan RK, Kaski K, Penner O, Rungi A, Riccaboni M, Stanley HE, Pammolli F. Reputation and impact in academic careers. Proc Natl Acad Sci U S A. 2014;111(43):15316–21.CrossRefPubMedPubMedCentral
29.
Emberson J, Lees KR, Lyden P, Blackwell L, Albers G, Bluhmki E, Brott T, Cohen G, Davis S, Donnan G, et al. Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomised trials. Lancet. 2014;384(9958):1929–35.CrossRefPubMedPubMedCentral
30.
Whiteley WN, Emberson J, Lees KR, Blackwell L, Albers G, Bluhmki E, Brott T, Cohen G, Davis S, Donnan G, et al. Risk of intracerebral haemorrhage with alteplase after acute ischaemic stroke: a secondary analysis of an individual patient data meta-analysis. Lancet Neurol. 2016;15(9):925–33.CrossRefPubMed
31.
32.
Chauvin A, Ravaud P, Baron G, Barnes C, Boutron I. The most important tasks for peer reviewers evaluating a randomized controlled trial are not congruent with the tasks most often requested by journal editors. BMC Med. 2015;13:158.CrossRefPubMedPubMedCentral
Metadata
Title
Citation bias favoring positive clinical trials of thrombolytics for acute ischemic stroke: a cross-sectional analysis
Authors
Benjamin S. Misemer
Timothy F. Platts-Mills
Christopher W. Jones
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1595-7

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue

Study protocol

Systemic therapy for vulval Erosive Lichen Planus (the ‘hELP’ trial): study protocol for a randomised controlled trial

Study protocol

The Stroke and Carer Optimal Health Program (SCOHP) to enhance psychosocial health: study protocol for a randomized controlled trial

Study protocol

Standardised Chinese herbal treatment delivered by GPs compared with individualised treatment administered by practitioners of Chinese herbal medicine for women with recurrent urinary tract infections (RUTI): study protocol for a randomised controlled trial

Research

The ethical issues regarding consent to clinical trials with pre-term or sick neonates: a systematic review (framework synthesis) of the analytical (theoretical/philosophical) research

Study protocol

The effect of chiropractic treatment on the reaction and response times of special operation forces military personnel: study protocol for a randomized controlled trial

Study protocol

Exercise prior to assisted fertilization in overweight and obese women (FertilEX): study protocol for a randomized controlled trial