Skip to main content
Top
Published in: Annals of Surgical Oncology 9/2016

01-09-2016 | Healthcare Policy and Outcomes

Benchmarking the Scientific and Educational Impact of the Annals of Surgical Oncology

Authors: Charles M. Balch, MD, FACS, V. Suzanne Klimberg, MD, Kelly M. McMasters, MD, PhD, Timothy M. Pawlik, MD, MPH, PhD, Kenneth K. Tanabe, MD, FACS, Mitchell C. Posner, MD, Deborah Whippen, BA, Mark S. Roh, MD, MMM, FACS

Published in: Annals of Surgical Oncology | Issue 9/2016

Login to get access

Excerpt

The impact of a medical or scientific journal is often attributed to the 2-year citation index, as well as its rank order relative to other journals in its universe of subjects. These rankings are derived from impact factors based on a system devised by the Institute for Scientific Information (now Thomson Reuters) in the 1950s. An original purpose of the journal impact factor ranking was to provide an evaluative resource to medical libraries for decision making about which journals to include in their holdings. Currently, there is an active dialogue among scientific journals about the strengths and weaknesses of the impact factor ranking system as an evaluative tool.17 Indeed, some journal editors have been highly critical, even to the point of suggesting abandonment of the impact factor as a journal metric.4 Recently, the Editor of the Proceedings of The National Academy of Sciences stated that “the scientific community must not rely exclusively on the impact factor of journals.”2 One shortcoming of a journal’s impact factor is that it can be skewed by publication of an isolated, but highly cited paper. In addition, citation data do not distinguish between review articles (which usually generate a higher number of citations, including self-citations) versus original peer-reviewed scientific articles, or editorials (which are generally not counted as a source document in the denominator when calculating the impact factor, while the number of citations can be used in the numerator of the calculation of the mean citations per source article). The 2-year impact factor can also understate citations when a journal publishes high impact and highly cited articles late in the year; this is an issue of concern for the Annals of Surgical Oncology because important papers from the annual meeting of the Society of Surgical Oncology (SSO) and the American Society of Breast Surgeons are published late in the year. Because of the perceived limitations of the traditional journal ranking system, additional evaluative tools and schemas have been used to benchmark the value of medical journals.3,6,7
Literature
2.
go back to reference Verma IM. Impact, not impact factor. Proc Natl Acad Sci USA. 2015;112:7875–7876.CrossRef Verma IM. Impact, not impact factor. Proc Natl Acad Sci USA. 2015;112:7875–7876.CrossRef
3.
go back to reference The impact factor game. It is time to find a better way to assess the scientific literature. PLOS Med. 2006;3:e291.CrossRef The impact factor game. It is time to find a better way to assess the scientific literature. PLOS Med. 2006;3:e291.CrossRef
4.
go back to reference Coats AJ, Shewan LG. Impact factor: vagaries, inconsistencies and illogicalities; should it be abandoned? Nucl Med Rev Cent East Eur. 2012;15:132–6. Coats AJ, Shewan LG. Impact factor: vagaries, inconsistencies and illogicalities; should it be abandoned? Nucl Med Rev Cent East Eur. 2012;15:132–6.
5.
go back to reference Smith R. Commentary: the power of the unrelenting impact factor: is it a force for good or harm? Int J Epidemiol. 2006;35:1129–30.CrossRefPubMed Smith R. Commentary: the power of the unrelenting impact factor: is it a force for good or harm? Int J Epidemiol. 2006;35:1129–30.CrossRefPubMed
6.
go back to reference Brown T. Journal quality metrics: options to consider other than impact factors. Am J Occup Ther. 2011;65:346–50.CrossRefPubMed Brown T. Journal quality metrics: options to consider other than impact factors. Am J Occup Ther. 2011;65:346–50.CrossRefPubMed
7.
go back to reference Rizkallah J, Sin DD. Integrative approach to quality assessment of medical journals using impact factor, eigenfactor, and article influence scores. PLoS One. 2010;5:e10204.CrossRefPubMedPubMedCentral Rizkallah J, Sin DD. Integrative approach to quality assessment of medical journals using impact factor, eigenfactor, and article influence scores. PLoS One. 2010;5:e10204.CrossRefPubMedPubMedCentral
8.
go back to reference Cantin M, Munoz M, Roa I. Comparison between impact factor, Eigenfactor score, and SCImago journal rank indicator in anatomy and morphology journals. Int J Morph. 2015;33:1183–8.CrossRef Cantin M, Munoz M, Roa I. Comparison between impact factor, Eigenfactor score, and SCImago journal rank indicator in anatomy and morphology journals. Int J Morph. 2015;33:1183–8.CrossRef
9.
go back to reference Kianifar H, Sadeghi R, Zarifmahmoudi L. Comparison between impact factor, Eigenfactor metrics, and SCimago journal rank indicator of pediatric neurology journals. Acta Inform Med. 2014;22:103–6.CrossRefPubMedPubMedCentral Kianifar H, Sadeghi R, Zarifmahmoudi L. Comparison between impact factor, Eigenfactor metrics, and SCimago journal rank indicator of pediatric neurology journals. Acta Inform Med. 2014;22:103–6.CrossRefPubMedPubMedCentral
10.
go back to reference Ramin S, Sarraf Shirazi A. Comparison between impact factor, SCImago journal rank indicator and Eigenfactor score of nuclear medicine journals. Int J Cardiol. 2015;201:454–6.CrossRef Ramin S, Sarraf Shirazi A. Comparison between impact factor, SCImago journal rank indicator and Eigenfactor score of nuclear medicine journals. Int J Cardiol. 2015;201:454–6.CrossRef
11.
go back to reference Falagas ME, Kouranos VD, Arencibia-Jorge R, et al. Comparison of SCImago journal rank indicator with journal impact factor. FASEB J. 2008;22:2623–8.CrossRefPubMed Falagas ME, Kouranos VD, Arencibia-Jorge R, et al. Comparison of SCImago journal rank indicator with journal impact factor. FASEB J. 2008;22:2623–8.CrossRefPubMed
12.
go back to reference Jamali J, Salehi-Marzijarani M, Ayatollahi SM. factors affecting journal quality indicator in Scopus (SCImago Journal Rank) in obstetrics and gynecology journals: a longitudinal study (1999–2013). Acta Inform Med. 2014;22:385–8.CrossRefPubMedPubMedCentral Jamali J, Salehi-Marzijarani M, Ayatollahi SM. factors affecting journal quality indicator in Scopus (SCImago Journal Rank) in obstetrics and gynecology journals: a longitudinal study (1999–2013). Acta Inform Med. 2014;22:385–8.CrossRefPubMedPubMedCentral
13.
go back to reference Kulasegarah J, Fenton JE. Comparison of the h index with standard bibliometric indicators to rank influential otolaryngologists in Europe and North America. Eur Arch Otorhinolaryngol. 2010;267:455–8.CrossRefPubMed Kulasegarah J, Fenton JE. Comparison of the h index with standard bibliometric indicators to rank influential otolaryngologists in Europe and North America. Eur Arch Otorhinolaryngol. 2010;267:455–8.CrossRefPubMed
Metadata
Title
Benchmarking the Scientific and Educational Impact of the Annals of Surgical Oncology
Authors
Charles M. Balch, MD, FACS
V. Suzanne Klimberg, MD
Kelly M. McMasters, MD, PhD
Timothy M. Pawlik, MD, MPH, PhD
Kenneth K. Tanabe, MD, FACS
Mitchell C. Posner, MD
Deborah Whippen, BA
Mark S. Roh, MD, MMM, FACS
Publication date
01-09-2016
Publisher
Springer International Publishing
Published in
Annals of Surgical Oncology / Issue 9/2016
Print ISSN: 1068-9265
Electronic ISSN: 1534-4681
DOI
https://doi.org/10.1245/s10434-016-5270-8

Other articles of this Issue 9/2016

Annals of Surgical Oncology 9/2016 Go to the issue