Skip to main content
Top
Published in: BMC Medicine 1/2003

Open Access 01-12-2003 | Research article

Systematic reviews: a cross-sectional study of location and citation counts

Authors: Victor M Montori, Nancy L Wilczynski, Douglas Morgan, R Brian Haynes, the Hedges Team

Published in: BMC Medicine | Issue 1/2003

Login to get access

Abstract

Background

Systematic reviews summarize all pertinent evidence on a defined health question. They help clinical scientists to direct their research and clinicians to keep updated. Our objective was to determine the extent to which systematic reviews are clustered in a large collection of clinical journals and whether review type (narrative or systematic) affects citation counts.

Methods

We used hand searches of 170 clinical journals in the fields of general internal medicine, primary medical care, nursing, and mental health to identify review articles (year 2000). We defined 'review' as any full text article that was bannered as a review, overview, or meta-analysis in the title or in a section heading, or that indicated in the text that the intention of the authors was to review or summarize the literature on a particular topic. We obtained citation counts for review articles in the five journals that published the most systematic reviews.

Results

11% of the journals concentrated 80% of all systematic reviews. Impact factors were weakly correlated with the publication of systematic reviews (R2 = 0.075, P = 0.0035). There were more citations for systematic reviews (median 26.5, IQR 12 – 56.5) than for narrative reviews (8, 20, P <.0001 for the difference). Systematic reviews had twice as many citations as narrative reviews published in the same journal (95% confidence interval 1.5 – 2.7).

Conclusions

A few clinical journals published most systematic reviews. Authors cited systematic reviews more often than narrative reviews, an indirect endorsement of the 'hierarchy of evidence'.
Literature
1.
go back to reference Guyatt GH, Haynes B, Jaeschke R, Cook D, Greenhalgh T, Meade M, Green L, Naylor C, Wilson M, McAlister FA, Richardson W, Montori V, Bucher H: Introduction: The philosophy of evidence-based medicine. In: Users' Guides to the Medical Literature: A Manual of Evidence-Based Clinical Practice. Edited by: Guyatt GH, Rennie D. 2002, Chicago: American Medical Association, 121-140. Guyatt GH, Haynes B, Jaeschke R, Cook D, Greenhalgh T, Meade M, Green L, Naylor C, Wilson M, McAlister FA, Richardson W, Montori V, Bucher H: Introduction: The philosophy of evidence-based medicine. In: Users' Guides to the Medical Literature: A Manual of Evidence-Based Clinical Practice. Edited by: Guyatt GH, Rennie D. 2002, Chicago: American Medical Association, 121-140.
2.
go back to reference Oxman A, Guyatt GH, Cook D, Montori V: Summarizing the evidence. In: Users' Guides to the Medical Literature A manual for evidence-based clinical practice. Edited by: Guyatt GH, Rennie D. 2002, Chicago: AMA Press, 155-173. Oxman A, Guyatt GH, Cook D, Montori V: Summarizing the evidence. In: Users' Guides to the Medical Literature A manual for evidence-based clinical practice. Edited by: Guyatt GH, Rennie D. 2002, Chicago: AMA Press, 155-173.
3.
go back to reference Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC: A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. Jama. 1992, 268 (2): 240-248. 10.1001/jama.268.2.240.CrossRefPubMed Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC: A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. Jama. 1992, 268 (2): 240-248. 10.1001/jama.268.2.240.CrossRefPubMed
4.
go back to reference Mulrow CD: The medical review article: state of the science. Ann Intern Med. 1987, 106 (3): 485-488.CrossRefPubMed Mulrow CD: The medical review article: state of the science. Ann Intern Med. 1987, 106 (3): 485-488.CrossRefPubMed
5.
go back to reference McAlister FA, Clark HD, van Walraven C, Straus SE, Lawson FM, Moher D, Mulrow CD: The medical review article revisited: has the science improved?. Ann Intern Med. 1999, 131 (12): 947-951.CrossRefPubMed McAlister FA, Clark HD, van Walraven C, Straus SE, Lawson FM, Moher D, Mulrow CD: The medical review article revisited: has the science improved?. Ann Intern Med. 1999, 131 (12): 947-951.CrossRefPubMed
6.
go back to reference Chalmers I: The Cochrane collaboration: preparing, maintaining, and disseminating systematic reviews of the effects of health care. Ann N Y Acad Sci. 1993, 703: 156-163. discussion 163–155.CrossRefPubMed Chalmers I: The Cochrane collaboration: preparing, maintaining, and disseminating systematic reviews of the effects of health care. Ann N Y Acad Sci. 1993, 703: 156-163. discussion 163–155.CrossRefPubMed
7.
go back to reference Clarke M: The Cochrane Collaboration: providing and obtaining the best evidence about the effects of health care. Eval Health Prof. 2002, 25 (1): 8-11. 10.1177/0163278702025001002.CrossRefPubMed Clarke M: The Cochrane Collaboration: providing and obtaining the best evidence about the effects of health care. Eval Health Prof. 2002, 25 (1): 8-11. 10.1177/0163278702025001002.CrossRefPubMed
8.
go back to reference Montori VM, Smieja M, Guyatt GH: Publication bias: a brief review for clinicians. Mayo Clin Proc. 2000, 75 (12): 1284-1288.CrossRefPubMed Montori VM, Smieja M, Guyatt GH: Publication bias: a brief review for clinicians. Mayo Clin Proc. 2000, 75 (12): 1284-1288.CrossRefPubMed
9.
go back to reference Dickersin K, Higgins K, Meinert CL: Identification of meta-analyses. The need for standard terminology. Control Clin Trials. 1990, 11 (1): 52-66. 10.1016/0197-2456(90)90032-W.CrossRefPubMed Dickersin K, Higgins K, Meinert CL: Identification of meta-analyses. The need for standard terminology. Control Clin Trials. 1990, 11 (1): 52-66. 10.1016/0197-2456(90)90032-W.CrossRefPubMed
10.
go back to reference Hunt DL, McKibbon KA: Locating and appraising systematic reviews. Ann Intern Med. 1997, 126 (7): 532-538.CrossRefPubMed Hunt DL, McKibbon KA: Locating and appraising systematic reviews. Ann Intern Med. 1997, 126 (7): 532-538.CrossRefPubMed
11.
go back to reference Shojania KG, Bero LA: Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract. 2001, 4 (4): 157-162.PubMed Shojania KG, Bero LA: Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract. 2001, 4 (4): 157-162.PubMed
12.
go back to reference White V, Glanville J, Lefebvre C, Sheldon T: A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. J Information Sci. 2001, 27: 357-370. 10.1177/0165551014233798.CrossRef White V, Glanville J, Lefebvre C, Sheldon T: A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. J Information Sci. 2001, 27: 357-370. 10.1177/0165551014233798.CrossRef
14.
go back to reference Haynes RB, Wilczynski N, McKibbon KA, Walker CJ, Sinclair JC: Developing optimal search strategies for detecting clinically sound studies in MEDLINE. J Am Med Inform Assoc. 1994, 1 (6): 447-458.CrossRefPubMedPubMedCentral Haynes RB, Wilczynski N, McKibbon KA, Walker CJ, Sinclair JC: Developing optimal search strategies for detecting clinically sound studies in MEDLINE. J Am Med Inform Assoc. 1994, 1 (6): 447-458.CrossRefPubMedPubMedCentral
15.
go back to reference Wilczynski NL, McKibbon KA, Haynes RB: Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature. Medinfo. 2001, 10 (Pt 1): 390-393. Wilczynski NL, McKibbon KA, Haynes RB: Enhancing retrieval of best evidence for health care from bibliographic databases: calibration of the hand search of the literature. Medinfo. 2001, 10 (Pt 1): 390-393.
16.
go back to reference Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. Jama. 2002, 287 (21): 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. Jama. 2002, 287 (21): 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed
Metadata
Title
Systematic reviews: a cross-sectional study of location and citation counts
Authors
Victor M Montori
Nancy L Wilczynski
Douglas Morgan
R Brian Haynes
the Hedges Team
Publication date
01-12-2003
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2003
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-1-2