Skip to main content
Top
Published in: Techniques in Coloproctology 9/2019

01-09-2019 | Controversies in Colorectal Surgery

Why most published meta-analysis findings are false

Authors: B. Doleman, J. P. Williams, J. Lund

Published in: Techniques in Coloproctology | Issue 9/2019

Login to get access

Excerpt

Almost a decade after the controversial paper ‘why most published research findings are false’ was written [1], we re-visit this concern with regard to published meta-analyses. Although reading the title of this article may make some pause for thought (or vehemently disagree), if you simply subscribe to the findings of Ioannidis’s paper then the logical conclusion is that the meta-analyses of primary studies are equally susceptible to being false. Indeed, it was asserted in the paper that meta-analyses of small, inconclusive studies (very common) are probably false [1]. But how can this be when meta-analyses sit unchallenged at the top of the hierarchy of evidence (despite being retrospective and observational in nature)? We will first examine the evidence for our assertion, and then provide reasons why meta-analyses are poor predictors of results from large trials gained from the authors’ experience in perioperative meta-analyses. …
Literature
1.
go back to reference Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2:e124CrossRef Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2:e124CrossRef
2.
go back to reference LeLorier J, Gregoire G, Benhaddad A, Lapierre J, Derderian F (1997) Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med 337:536–542CrossRef LeLorier J, Gregoire G, Benhaddad A, Lapierre J, Derderian F (1997) Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med 337:536–542CrossRef
3.
go back to reference Sivakumar H, Peyton PJ (2016) Poor agreement in significant findings between meta-analyses and subsequent large randomized trials in perioperative medicine. Br J Anaesth 117:431–441CrossRef Sivakumar H, Peyton PJ (2016) Poor agreement in significant findings between meta-analyses and subsequent large randomized trials in perioperative medicine. Br J Anaesth 117:431–441CrossRef
4.
go back to reference Doleman B, Sutton AJ, Sherwin M, Lund JN, Williams JP (2018) Baseline morphine consumption may explain between-study heterogeneity in meta-analyses of adjuvant analgesics and improve precision and accuracy of effect estimates. Anesth Analg 126:648–660CrossRef Doleman B, Sutton AJ, Sherwin M, Lund JN, Williams JP (2018) Baseline morphine consumption may explain between-study heterogeneity in meta-analyses of adjuvant analgesics and improve precision and accuracy of effect estimates. Anesth Analg 126:648–660CrossRef
5.
go back to reference Hedin RJ, Umberham BA, Detweiler BN, Kollmorgen L, Vassar M (2016) Publication bias and nonreporting found in majority of systematic reviews and meta-analyses in anesthesiology journals. Anesth Analg 123:1018–1025CrossRef Hedin RJ, Umberham BA, Detweiler BN, Kollmorgen L, Vassar M (2016) Publication bias and nonreporting found in majority of systematic reviews and meta-analyses in anesthesiology journals. Anesth Analg 123:1018–1025CrossRef
6.
go back to reference Imberger G, Gluud C, Boylan J, Wetterslev J (2015) Systematic reviews of anesthesiologic interventions reported as statistically significant: problems with power, precision, and type 1 error protection. Anesth Analg 121:1611–1622CrossRef Imberger G, Gluud C, Boylan J, Wetterslev J (2015) Systematic reviews of anesthesiologic interventions reported as statistically significant: problems with power, precision, and type 1 error protection. Anesth Analg 121:1611–1622CrossRef
7.
go back to reference Detweiler BN, Kollmorgen LE, Umberham BA, Hedin RJ, Vassar BM (2016) Risk of bias and methodological appraisal practices in systematic reviews published in anaesthetic journals: a meta-epidemiological study. Anaesthesia 71:955–968CrossRef Detweiler BN, Kollmorgen LE, Umberham BA, Hedin RJ, Vassar BM (2016) Risk of bias and methodological appraisal practices in systematic reviews published in anaesthetic journals: a meta-epidemiological study. Anaesthesia 71:955–968CrossRef
8.
go back to reference Conway A, Conway Z, Soalheira K, Sutherland J (2017) High quality of evidence is uncommon in Cochrane systematic reviews in anaesthesia, critical care and emergency medicine. Eur J Anaesth 34:808CrossRef Conway A, Conway Z, Soalheira K, Sutherland J (2017) High quality of evidence is uncommon in Cochrane systematic reviews in anaesthesia, critical care and emergency medicine. Eur J Anaesth 34:808CrossRef
Metadata
Title
Why most published meta-analysis findings are false
Authors
B. Doleman
J. P. Williams
J. Lund
Publication date
01-09-2019
Publisher
Springer International Publishing
Published in
Techniques in Coloproctology / Issue 9/2019
Print ISSN: 1123-6337
Electronic ISSN: 1128-045X
DOI
https://doi.org/10.1007/s10151-019-02020-y

Other articles of this Issue 9/2019

Techniques in Coloproctology 9/2019 Go to the issue