Skip to main content
Top
Published in: Systematic Reviews 1/2024

Open Access 01-12-2024 | Methodology

Publication bias in otorhinolaryngology meta-analyses in 2021

Authors: Fatemeh Mohammadian, Shahin Bastaninejad, Shirin Irani

Published in: Systematic Reviews | Issue 1/2024

Login to get access

Abstract

Introduction

One concern in meta-analyses is the presence of publication bias (PB) which leads to the dissemination of inflated results. In this study, we assessed how much the meta-analyses in the field of otorhinolaryngology in 2021 evaluated the presence of PB.

Methods

Six of the most influential journals in the field were selected. A search was conducted, and data were extracted from the included studies. In cases where PB was not assessed by the authors, we evaluated the risk of its presence by designing funnel plots and performing statistical tests.

Results

Seventy-five systematic reviews were included. Fifty-one percent of them used at least one method for assessing the risk of PB, with the visual inspection of a funnel plot being the most frequent method used. Twenty-nine percent of the studies reported a high risk of PB presence. We replicated the results of 11 meta-analyses that did not assess the risk of PB and found that 63.6% were at high risk. We also found that a considerable proportion of the systematic reviews that found a high risk of PB did not take it into consideration when making conclusions and discussing their results.

Discussion

Our results indicate that systematic reviews published in some of the most influential journals in the field do not implement enough measures in their search strategies to reduce the risk of PB, nor do they assess the risk of its presence or take the risk of its presence into consideration when inferring their results.
Appendix
Available only for authorised users
Literature
4.
go back to reference Higgins JPT, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. 2019. Higgins JPT, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. 2019.
5.
go back to reference Jill E, Laura L, Alfred B and Sally M. Finding what works in health care. 2011. Jill E, Laura L, Alfred B and Sally M. Finding what works in health care. 2011.
18.
go back to reference Richard JL and David BP. Summing Up: The Science of Reviewing Research Harvard University Press: Cambridge, MA, 1984, xiii+ 191 pp. Educ Res 1986; 15: 16–17 , publisher = Sage Publications Sage CA Thousand Oaks, CA. Richard JL and David BP. Summing Up: The Science of Reviewing Research Harvard University Press: Cambridge, MA, 1984, xiii+ 191 pp. Educ Res 1986; 15: 16–17 , publisher = Sage Publications Sage CA Thousand Oaks, CA.
27.
go back to reference Page MJ, Higgins JPT and Sterne JAC. Assessing risk of bias due to missing results in a synthesis. Cochrane Handb Syst Rev Interv. 2022. Page MJ, Higgins JPT and Sterne JAC. Assessing risk of bias due to missing results in a synthesis. Cochrane Handb Syst Rev Interv. 2022.
29.
go back to reference Team RC. R: A language and environment for statistical computing. 2013. Team RC. R: A language and environment for statistical computing. 2013.
30.
go back to reference Guido S. meta: an R package for meta-analysis. R news. 2007;7:40–5. Guido S. meta: an R package for meta-analysis. R news. 2007;7:40–5.
35.
go back to reference Hartling L, Featherstone R, Nuspl M, et al. Grey literature in systematic reviews: a cross-sectional study of the contribution of non-English reports, unpublished studies and dissertations to the results of meta-analyses in child-relevant reviews. BMC Med Res Methodol. 2017;17(64):20170419. https://doi.org/10.1186/s12874-017-0347-z.CrossRef Hartling L, Featherstone R, Nuspl M, et al. Grey literature in systematic reviews: a cross-sectional study of the contribution of non-English reports, unpublished studies and dissertations to the results of meta-analyses in child-relevant reviews. BMC Med Res Methodol. 2017;17(64):20170419. https://​doi.​org/​10.​1186/​s12874-017-0347-z.CrossRef
38.
go back to reference Egger M, Juni P, Bartlett C, et al. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess (Winchester, England). 2003; 7:1–76. Egger M, Juni P, Bartlett C, et al. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess (Winchester, England). 2003; 7:1–76.
42.
Metadata
Title
Publication bias in otorhinolaryngology meta-analyses in 2021
Authors
Fatemeh Mohammadian
Shahin Bastaninejad
Shirin Irani
Publication date
01-12-2024
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2024
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-023-02404-0

Other articles of this Issue 1/2024

Systematic Reviews 1/2024 Go to the issue