Skip to main content
Top
Published in: Journal of General Internal Medicine 2/2018

01-02-2018 | Editorial

From the Editors’ Desk: Bias in Systematic Reviews—Let the Reader Beware

Authors: Jeffrey L. Jackson, MD, MPH, Akira Kuriyama, MD, MPH

Published in: Journal of General Internal Medicine | Issue 2/2018

Login to get access

Excerpt

Systematic reviews are relied upon by clinicians and policymakers as high-quality evidence for decision-making. In some hierarchies of evidence quality, systematic reviews are ranked at the top, higher than randomized controlled trials. A properly conducted systematic review that is based on high-quality articles provides very strong evidence; policymakers recognize this value and solicit many such reviews. Busy clinicians rely on well-executed systematic reviews to quickly synthesize the literature and guide them in managing patients. However, there are important inherent weaknesses that can limit the quality of systematic reviews and can lead to erroneous conclusions. Consumers of systematic reviews should approach them with a healthy sense of skepticism. Unfortunately, many of these weaknesses may not be obvious to the various stakeholders who routinely invest their trust in such reviews. …
Literature
1.
go back to reference Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Intern Med. 2011;155(1):39–51.CrossRefPubMed Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study. Ann Intern Med. 2011;155(1):39–51.CrossRefPubMed
2.
go back to reference Moher D, Fortin P, Jadad AR, et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet. 1996;347(8998):363–6.CrossRefPubMed Moher D, Fortin P, Jadad AR, et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet. 1996;347(8998):363–6.CrossRefPubMed
5.
go back to reference O'Malley PG, Balden E, Tomkins G, Santoro J, Kroenke K, Jackson JL. Treatment of fibromyalgia with antidepressants: a meta-analysis. J Gen Intern Med. 2000;15(9):659–66.CrossRefPubMedPubMedCentral O'Malley PG, Balden E, Tomkins G, Santoro J, Kroenke K, Jackson JL. Treatment of fibromyalgia with antidepressants: a meta-analysis. J Gen Intern Med. 2000;15(9):659–66.CrossRefPubMedPubMedCentral
6.
go back to reference Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291:2457–65.CrossRefPubMed Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291:2457–65.CrossRefPubMed
7.
go back to reference Balshem H, Helfand M, Schünemann HJ. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–6.CrossRefPubMed Balshem H, Helfand M, Schünemann HJ. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–6.CrossRefPubMed
10.
go back to reference Rose M, Bjorner JB, Becker J, Fries JF, Ware JE. Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol. 2008;61(1):17–33.CrossRefPubMed Rose M, Bjorner JB, Becker J, Fries JF, Ware JE. Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol. 2008;61(1):17–33.CrossRefPubMed
Metadata
Title
From the Editors’ Desk: Bias in Systematic Reviews—Let the Reader Beware
Authors
Jeffrey L. Jackson, MD, MPH
Akira Kuriyama, MD, MPH
Publication date
01-02-2018
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 2/2018
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-017-4236-2

Other articles of this Issue 2/2018

Journal of General Internal Medicine 2/2018 Go to the issue