Skip to main content
Top
Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 6/2016

01-06-2016 | Reports of Original Investigations

The relationship between study findings and publication outcome in anesthesia research: a retrospective observational study examining publication bias

Authors: Simon W. Chong, MBBS, Neil F. Collins, MBBS, Christine Y. Wu, MBBS, Grace M. Liskaser, Philip J. Peyton, MD, PhD, MBBS

Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Issue 6/2016

Login to get access

Abstract

Purpose

Many areas of medicine have shown bias towards the publication of studies with positive results. To estimate publication bias in the anesthesia literature, we reviewed all abstracts presented at the American Society of Anesthesiologists (ASA) annual meetings over a four-year period and compared study results (positive vs negative) with publication outcomes.

Methods

This review included all abstracts from the 2001-2004 ASA annual meetings performed as randomized-controlled trials in humans. We scored their outcome results as positive or negative and assessed abstract quality using a 13-point scoring system. We then performed a systematic literature search to identify any subsequent publication of the studies and calculated the relative risk (RR) for journal publication by comparing positive vs negative studies.

Results

Of 5,918 abstracts reviewed, 1,052 met inclusion criteria, and 564 (53.6%) of the abstracts proceeded to publication. The RR for abstracts with positive results proceeding to journal publication was 1.42 (95% confidence interval, 1.22 to 1.66; P < 0.001). This result did not change significantly after adjusting for study size and abstract quality score during logistic regression modelling. There was no significant difference in the abstract quality score between positive vs negative studies or between abstracts proceeding vs not proceeding to publication.

Conclusions

Approximately half of the ASA annual meeting abstracts proceed to publication. After adjustment for study quality and size, abstracts with positive results were more likely to proceed to journal publication than those with negative results, suggesting publication bias in the anesthesia literature.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith H Jr. Publication bias and clinical trials. Control Clin Trials 1987; 8: 343-53.CrossRefPubMed Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith H Jr. Publication bias and clinical trials. Control Clin Trials 1987; 8: 343-53.CrossRefPubMed
2.
go back to reference Scherer RW, Dickersin K, Langenberg P. Full publication of results initially presented in abstracts. A meta-analysis. JAMA 1994; 272: 158-62.PubMed Scherer RW, Dickersin K, Langenberg P. Full publication of results initially presented in abstracts. A meta-analysis. JAMA 1994; 272: 158-62.PubMed
3.
go back to reference Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998; 279: 281-6.CrossRefPubMed Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998; 279: 281-6.CrossRefPubMed
4.
go back to reference Hall R, de Antueno C, Webber A; Canadian Research Ethics Board. Publication bias in the medical literature: a review by a Canadian Research Ethics Board. Can. J Anesth 2007; 54: 380-8.CrossRefPubMed Hall R, de Antueno C, Webber A; Canadian Research Ethics Board. Publication bias in the medical literature: a review by a Canadian Research Ethics Board. Can. J Anesth 2007; 54: 380-8.CrossRefPubMed
5.
go back to reference Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008; 358: 252-60.CrossRefPubMed Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008; 358: 252-60.CrossRefPubMed
6.
7.
go back to reference De Oliveira GS, Jr Chang R, Kendall MC, Fitzgerald PC, McCarthy RJ. Publication bias in the anesthesiology literature. Anesth Analg 2012; 114: 1042-8.CrossRefPubMed De Oliveira GS, Jr Chang R, Kendall MC, Fitzgerald PC, McCarthy RJ. Publication bias in the anesthesiology literature. Anesth Analg 2012; 114: 1042-8.CrossRefPubMed
8.
go back to reference Hopewell S, Clarke M, Stewart L, Tierney J. Time to publication for results of clinical trials. Cochrane Database Syst Rev 2007; 18: Mr000011. Hopewell S, Clarke M, Stewart L, Tierney J. Time to publication for results of clinical trials. Cochrane Database Syst Rev 2007; 18: Mr000011.
9.
go back to reference Lefebvre C, Manheimer E, Glanville J; Cochrane Information Retrieval Methods Group. Chapter 6: Searching for studies. In: Higgins JP, Green S (Eds). Cochrane Handbook for Systematic Reviews of Interventions; 2011. Lefebvre C, Manheimer E, Glanville J; Cochrane Information Retrieval Methods Group. Chapter 6: Searching for studies. In: Higgins JP, Green S (Eds). Cochrane Handbook for Systematic Reviews of Interventions; 2011.
10.
go back to reference Hopewell S, Clarke M, Askie L. Reporting of trials presented in conference abstracts needs to be improved. J Clin Epidemiol 2006; 59: 681-4.CrossRefPubMed Hopewell S, Clarke M, Askie L. Reporting of trials presented in conference abstracts needs to be improved. J Clin Epidemiol 2006; 59: 681-4.CrossRefPubMed
11.
go back to reference Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 2001; 357: 1191-4.CrossRefPubMed Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 2001; 357: 1191-4.CrossRefPubMed
12.
go back to reference Scherer RW, Langenberg P, von Elm E. Full publication of results initially presented in abstracts. Cochrane Database Syst Rev 2007; 18: MR000005. Scherer RW, Langenberg P, von Elm E. Full publication of results initially presented in abstracts. Cochrane Database Syst Rev 2007; 18: MR000005.
13.
14.
go back to reference van Lent M, Overbeke J, Out HJ. Role of editorial and peer review processes in publication bias: analysis of drug trials submitted to eight medical journals. PLoS One 2014; 9: e104846.CrossRefPubMedPubMedCentral van Lent M, Overbeke J, Out HJ. Role of editorial and peer review processes in publication bias: analysis of drug trials submitted to eight medical journals. PLoS One 2014; 9: e104846.CrossRefPubMedPubMedCentral
15.
go back to reference Carvalho B, Drover DR, Ginosar Y, Cohen SE, Riley ET. Intrathecal fentanyl added to bupivacaine and morphine for cesarean delivery may induce a subtle acute opioid tolerance. Int J Obstet Anesth 2012; 21: 29-34.CrossRefPubMed Carvalho B, Drover DR, Ginosar Y, Cohen SE, Riley ET. Intrathecal fentanyl added to bupivacaine and morphine for cesarean delivery may induce a subtle acute opioid tolerance. Int J Obstet Anesth 2012; 21: 29-34.CrossRefPubMed
16.
go back to reference Pang W, Liu YC, Maboudou E, et al. Metoclopramide improves the quality of tramadol PCA indistinguishable to morphine PCA: a prospective, randomized, double blind clinical comparison. Pain Med 2013; 14: 1426-34.CrossRefPubMed Pang W, Liu YC, Maboudou E, et al. Metoclopramide improves the quality of tramadol PCA indistinguishable to morphine PCA: a prospective, randomized, double blind clinical comparison. Pain Med 2013; 14: 1426-34.CrossRefPubMed
18.
go back to reference Weibel S, Elia N, Kranke P. The transparent clinical trial: why we need complete and informative prospective trial registration. Eur J Anaesthesiol 2016; 33: 72-4.CrossRefPubMed Weibel S, Elia N, Kranke P. The transparent clinical trial: why we need complete and informative prospective trial registration. Eur J Anaesthesiol 2016; 33: 72-4.CrossRefPubMed
19.
go back to reference DeAngelis CD, Drazen JM, Frizelle FA, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. JAMA 2004; 292: 1363-4.CrossRefPubMed DeAngelis CD, Drazen JM, Frizelle FA, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. JAMA 2004; 292: 1363-4.CrossRefPubMed
20.
go back to reference Wager E, Williams P, OPEN Project (Overcome failure to Publish nEgative fiNdings) Consortium. “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study. BMJ 2013; 347: f5248.CrossRefPubMedPubMedCentral Wager E, Williams P, OPEN Project (Overcome failure to Publish nEgative fiNdings) Consortium. “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study. BMJ 2013; 347: f5248.CrossRefPubMedPubMedCentral
21.
go back to reference Teoh DC, Schramm B. Changes in clinical research in anaesthesia and intensive care from 1974-2004. Anaesth Intensive Care 2006; 34: 753-7.PubMed Teoh DC, Schramm B. Changes in clinical research in anaesthesia and intensive care from 1974-2004. Anaesth Intensive Care 2006; 34: 753-7.PubMed
22.
go back to reference Langford RA, Huang GH, Leslie K. Quality and reporting of trial design in scientific papers in Anaesthesia over 25 years. Anaesthesia 2009; 64: 60-4.CrossRefPubMed Langford RA, Huang GH, Leslie K. Quality and reporting of trial design in scientific papers in Anaesthesia over 25 years. Anaesthesia 2009; 64: 60-4.CrossRefPubMed
Metadata
Title
The relationship between study findings and publication outcome in anesthesia research: a retrospective observational study examining publication bias
Authors
Simon W. Chong, MBBS
Neil F. Collins, MBBS
Christine Y. Wu, MBBS
Grace M. Liskaser
Philip J. Peyton, MD, PhD, MBBS
Publication date
01-06-2016
Publisher
Springer US
Published in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Issue 6/2016
Print ISSN: 0832-610X
Electronic ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-016-0631-0

Other articles of this Issue 6/2016

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 6/2016 Go to the issue