Skip to main content
Top
Published in: European Orthopaedics and Traumatology 3/2013

01-09-2013 | Original Article

Association of scientific and nonscientific factors to citation rates of articles of renowned orthopedic journals

Authors: Mazda Farshad, Claudia Sidler, Christian Gerber

Published in: European Orthopaedics and Traumatology | Issue 3/2013

Login to get access

Abstract

Purpose

The physician often relies on the prestige of a journal to identify the most relevant articles to be read in his field. This investigation studied associations of scientific and nonscientific criteria with the citation frequency of articles in two top-ranked international orthopedic journals.

Methods

The 100 most (mean, 88 citations/5 years for cases) and 100 least (mean, two citations/5 years for controls) cited articles published between 2000 and 2004 in the Journal of Bone and Joint Surgery and the Bone & Joint Journal (formerly known as JBJS (Br)), two of the most distributed general orthopedic journals, were identified. The association of scientific and nonscientific factors on their citation rate was quantified.

Results

Randomized controlled trials, as well as multicenter studies with large sample sizes, were significantly more frequent in the high citation rate group. The unadjusted odds of a highly cited article to be supported by industry were 2.8 (95 % confidence interval 1.5, 5.6; p < 0.05) if compared with a lowly cited article.

Conclusion

Beside scientific factors, nonscientific factors such as industrial support seem associated to the citation rate of published articles. This, together with publication bias, questions whether scientific facts reach the readers in a balanced fashion.
Level of Evidence 3
Literature
1.
go back to reference Neuberger J, Counsell C (2002) Impact factors: uses and abuses. Eur J Gastroenterol Hepatol 14(3):209–211PubMedCrossRef Neuberger J, Counsell C (2002) Impact factors: uses and abuses. Eur J Gastroenterol Hepatol 14(3):209–211PubMedCrossRef
2.
go back to reference Rieder S, Bruse CS, Michalski CW, Kleeff J, Friess H The impact factor ranking—a challenge for scientists and publishers. Langenbecks Arch Surg 395 Suppl 1:69–73. doi:10.1007/s00423-010-0623-4 Rieder S, Bruse CS, Michalski CW, Kleeff J, Friess H The impact factor ranking—a challenge for scientists and publishers. Langenbecks Arch Surg 395 Suppl 1:69–73. doi:10.1007/s00423-010-0623-4
3.
go back to reference Bhandari M, Busse J, Devereaux PJ, Montori VM, Swiontkowski M, Tornetta Iii P, Einhorn TA, Khera V, Schemitsch EH (2007) Factors associated with citation rates in the orthopedic literature. Can J Surg 50(2):119–123PubMed Bhandari M, Busse J, Devereaux PJ, Montori VM, Swiontkowski M, Tornetta Iii P, Einhorn TA, Khera V, Schemitsch EH (2007) Factors associated with citation rates in the orthopedic literature. Can J Surg 50(2):119–123PubMed
4.
go back to reference Kurmis AP (2003) Understanding the limitations of the journal impact factor. J Bone Joint Surg Am 85-A(12):2449–2454PubMed Kurmis AP (2003) Understanding the limitations of the journal impact factor. J Bone Joint Surg Am 85-A(12):2449–2454PubMed
5.
go back to reference Garfield E (1999) Journal impact factor: a brief review. CMAJ 161(8):979–980PubMed Garfield E (1999) Journal impact factor: a brief review. CMAJ 161(8):979–980PubMed
7.
go back to reference Walsh EF, Weinstein JN (1998) Spine: scientific citation index and its impact factor. Spine (Phila Pa 1976) 23(10):1087–1090CrossRef Walsh EF, Weinstein JN (1998) Spine: scientific citation index and its impact factor. Spine (Phila Pa 1976) 23(10):1087–1090CrossRef
8.
go back to reference Leimu R, Koricheva J (2005) What determines the citation frequency of ecological papers. Trends Ecol Evol 20(1):28–32PubMedCrossRef Leimu R, Koricheva J (2005) What determines the citation frequency of ecological papers. Trends Ecol Evol 20(1):28–32PubMedCrossRef
9.
go back to reference Saper CB (1999) What's in a citation impact factor? A journal by any other measure. J Comp Neurol 411(1):1–2PubMedCrossRef Saper CB (1999) What's in a citation impact factor? A journal by any other measure. J Comp Neurol 411(1):1–2PubMedCrossRef
10.
go back to reference Nieminen P, Carpenter J, Rucker G, Schumacher M (2006) The relationship between quality of research and citation frequency. BMC Med Res Methodol 6:42PubMedCrossRef Nieminen P, Carpenter J, Rucker G, Schumacher M (2006) The relationship between quality of research and citation frequency. BMC Med Res Methodol 6:42PubMedCrossRef
11.
12.
go back to reference Filion KB, Pless IB (2008) Factors related to the frequency of citation of epidemiologic publications. Epidemiol Perspect Innov 5:3PubMedCrossRef Filion KB, Pless IB (2008) Factors related to the frequency of citation of epidemiologic publications. Epidemiol Perspect Innov 5:3PubMedCrossRef
14.
go back to reference MacCallum CJ, Parthasarathy H (2006) Open access increases citation rate. PLoS Biol 4 (5):e176. MacCallum CJ, Parthasarathy H (2006) Open access increases citation rate. PLoS Biol 4 (5):e176.
15.
go back to reference Piwowar HA, Day RS, Fridsma DB (2007) Sharing detailed research data is associated with increased citation rate. PLoS One 2(3):e308PubMedCrossRef Piwowar HA, Day RS, Fridsma DB (2007) Sharing detailed research data is associated with increased citation rate. PLoS One 2(3):e308PubMedCrossRef
16.
go back to reference Habibzadeh F, Yadollahie M Are shorter article titles more attractive for citations? Cross-sectional study of 22 scientific journals. Croat Med J 51 (2):165–170 Habibzadeh F, Yadollahie M Are shorter article titles more attractive for citations? Cross-sectional study of 22 scientific journals. Croat Med J 51 (2):165–170
17.
go back to reference Callaham M, Wears RL, Weber E (2002) Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA 287(21):2847–2850PubMedCrossRef Callaham M, Wears RL, Weber E (2002) Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA 287(21):2847–2850PubMedCrossRef
18.
go back to reference Patsopoulos NA, Analatos AA, Ioannidis JP (2005) Relative citation impact of various study designs in the health sciences. JAMA 293(19):2362–2366PubMedCrossRef Patsopoulos NA, Analatos AA, Ioannidis JP (2005) Relative citation impact of various study designs in the health sciences. JAMA 293(19):2362–2366PubMedCrossRef
20.
go back to reference Kulkarni AV, Aziz B, Shams I, Busse JW (2009) Comparisons of citations in web of science, scopus, and google scholar for articles published in general medical journals. JAMA 302(10):1092–1096PubMedCrossRef Kulkarni AV, Aziz B, Shams I, Busse JW (2009) Comparisons of citations in web of science, scopus, and google scholar for articles published in general medical journals. JAMA 302(10):1092–1096PubMedCrossRef
21.
go back to reference Garrett WE Jr, Swiontkowski MF, Weinstein JN, Callaghan J, Rosier RN, Berry DJ, Harrast J, Derosa GP (2006) American board of orthopaedic surgery practice of the orthopaedic surgeon: part-ii, certification examination case mix. J Bone Joint Surg Am 88(3):660–667PubMedCrossRef Garrett WE Jr, Swiontkowski MF, Weinstein JN, Callaghan J, Rosier RN, Berry DJ, Harrast J, Derosa GP (2006) American board of orthopaedic surgery practice of the orthopaedic surgeon: part-ii, certification examination case mix. J Bone Joint Surg Am 88(3):660–667PubMedCrossRef
22.
23.
go back to reference Hopewell S, Clarke M (2003) How important is the size of a reprint order? Int J Technol Assess Health Care 19(4):711–714PubMedCrossRef Hopewell S, Clarke M (2003) How important is the size of a reprint order? Int J Technol Assess Health Care 19(4):711–714PubMedCrossRef
24.
go back to reference Lundh A, Barbateskovic M, Hrobjartsson A, Gotzsche PC (2010) Conflicts of interest at medical journals: the influence of industry-supported randomised trials on journal impact factors and revenue—cohort study. PLoS Med 7(10):e1000354PubMedCrossRef Lundh A, Barbateskovic M, Hrobjartsson A, Gotzsche PC (2010) Conflicts of interest at medical journals: the influence of industry-supported randomised trials on journal impact factors and revenue—cohort study. PLoS Med 7(10):e1000354PubMedCrossRef
25.
go back to reference Leopold SS, Warme WJ, Fritz Braunlich E, Shott S (2003) Association between funding source and study outcome in orthopaedic research. Clin Orthop Relat Res 415:293–301PubMedCrossRef Leopold SS, Warme WJ, Fritz Braunlich E, Shott S (2003) Association between funding source and study outcome in orthopaedic research. Clin Orthop Relat Res 415:293–301PubMedCrossRef
26.
go back to reference Okike K, Kocher MS, Mehlman CT, Bhandari M (2008) Industry-sponsored research. Injury 39(6):666–680PubMedCrossRef Okike K, Kocher MS, Mehlman CT, Bhandari M (2008) Industry-sponsored research. Injury 39(6):666–680PubMedCrossRef
27.
go back to reference Sarmiento A (2003) The relationship between orthopaedics and industry must be reformed. Clin Orthop Relat Res 412:38–44PubMedCrossRef Sarmiento A (2003) The relationship between orthopaedics and industry must be reformed. Clin Orthop Relat Res 412:38–44PubMedCrossRef
28.
go back to reference Shah RV, Albert TJ, Bruegel-Sanchez V, Vaccaro AR, Hilibrand AS, Grauer JN (2005) Industry support and correlation to study outcome for papers published in spine. Spine (Phila Pa 1976) 30(9):1099–1104, discussion 1105CrossRef Shah RV, Albert TJ, Bruegel-Sanchez V, Vaccaro AR, Hilibrand AS, Grauer JN (2005) Industry support and correlation to study outcome for papers published in spine. Spine (Phila Pa 1976) 30(9):1099–1104, discussion 1105CrossRef
Metadata
Title
Association of scientific and nonscientific factors to citation rates of articles of renowned orthopedic journals
Authors
Mazda Farshad
Claudia Sidler
Christian Gerber
Publication date
01-09-2013
Publisher
Springer Berlin Heidelberg
Published in
European Orthopaedics and Traumatology / Issue 3/2013
Print ISSN: 1867-4569
Electronic ISSN: 1867-4577
DOI
https://doi.org/10.1007/s12570-013-0174-6

Other articles of this Issue 3/2013

European Orthopaedics and Traumatology 3/2013 Go to the issue