Skip to main content
Top
Published in: Insights into Imaging 1/2020

Open Access 01-12-2020 | Original Article

Peer review practices by medical imaging journals

Authors: Thomas C. Kwee, Hugo J. A. Adams, Robert M. Kwee

Published in: Insights into Imaging | Issue 1/2020

Login to get access

Abstract

Objective

To investigate peer review practices by medical imaging journals.

Methods

Journals in the category "radiology, nuclear medicine and medical imaging" of the 2018 Journal Citation Reports were included.

Results

Of 119 included journals, 62 (52.1%) used single-blinded peer review, 49 (41.2%) used double-blinded peer review, two (1.7%) used open peer review and one (0.8%) used both single-blinded and double-blinded peer reviews, while the peer review model of five journals (4.2%) remained unclear. The use of single-blinded peer review was significantly associated with a journal’s impact factor (correlation coefficient of 0.218, P = 0.022). On subgroup analysis, only subspecialty medical imaging journals had a significant association between the use of single-blinded peer review and a journal’s impact factor (correlation coefficient of 0.354, P = 0.025). Forty-eight journals (40.3%) had a reviewer preference option, 48 journals (40.3%) did not have a reviewer recommendation option, and 23 journals (19.3%) obliged authors to indicate reviewers on their manuscript submission systems. Sixty-four journals (53.8%) did not provide an explicit option on their manuscript submission Web site to indicate nonpreferred reviewers, whereas 55 (46.2%) did. There were no significant associations between the option or obligation to indicate preferred or nonpreferred reviewers and a journal’s impact factor.

Conclusion

Single-blinded peer review and the option or obligation to indicate preferred or nonpreferred reviewers are frequently employed by medical imaging journals. Single-blinded review is (weakly) associated with a higher impact factor, also for subspecialty journals. The option or obligation to indicate preferred or nonpreferred reviewers is evenly distributed among journals, regardless of impact factor.
Literature
1.
go back to reference Wager E, Godlee F, Jefferson T (2002) How to survive peer review. BMJ books Wager E, Godlee F, Jefferson T (2002) How to survive peer review. BMJ books
2.
go back to reference Kelly J, Sadeghieh T, Adeli K (2014) Peer review in scientific publications: benefits, critiques, and a survival guide. EJIFCC 25:227–243PubMedPubMedCentral Kelly J, Sadeghieh T, Adeli K (2014) Peer review in scientific publications: benefits, critiques, and a survival guide. EJIFCC 25:227–243PubMedPubMedCentral
3.
go back to reference Callaham ML, Tercier J (2007) The relationship of previous training and experience of journal peer reviewers to subsequent review quality. PLoS Med 4:e40CrossRef Callaham ML, Tercier J (2007) The relationship of previous training and experience of journal peer reviewers to subsequent review quality. PLoS Med 4:e40CrossRef
6.
go back to reference Smith R (2006) Peer review: a flawed process at the heart of science and journals. J R Soc Med 99:178–182CrossRef Smith R (2006) Peer review: a flawed process at the heart of science and journals. J R Soc Med 99:178–182CrossRef
7.
go back to reference Haffar S, Bazerbachi F, Murad MH (2019) Peer review bias: a critical review. Mayo Clin Proc 94:670–676CrossRef Haffar S, Bazerbachi F, Murad MH (2019) Peer review bias: a critical review. Mayo Clin Proc 94:670–676CrossRef
8.
go back to reference Shaw DM (2015) Blinded by the light: anonymization should be used in peer review to prevent bias, not protect referees. EMBO Rep 16:894–897CrossRef Shaw DM (2015) Blinded by the light: anonymization should be used in peer review to prevent bias, not protect referees. EMBO Rep 16:894–897CrossRef
9.
go back to reference Okike K, Hug KT, Kocher MS, Leopold SS (2016) Single-blind vs double-blind peer review in the setting of author prestige. JAMA 316:1315–1316CrossRef Okike K, Hug KT, Kocher MS, Leopold SS (2016) Single-blind vs double-blind peer review in the setting of author prestige. JAMA 316:1315–1316CrossRef
10.
go back to reference Tomkins A, Zhang M, Heavlin WD (2017) Reviewer bias in single- versus double-blind peer review. Proc Natl Acad Sci U S A 114:12708–12713CrossRef Tomkins A, Zhang M, Heavlin WD (2017) Reviewer bias in single- versus double-blind peer review. Proc Natl Acad Sci U S A 114:12708–12713CrossRef
11.
go back to reference Witteman HO, Hendricks M, Straus S, Tannenbaum C (2019) Are gender gaps due to evaluations of the applicant or the science? A natural experiment at a national funding agency. Lancet 393:531–540CrossRef Witteman HO, Hendricks M, Straus S, Tannenbaum C (2019) Are gender gaps due to evaluations of the applicant or the science? A natural experiment at a national funding agency. Lancet 393:531–540CrossRef
12.
go back to reference Haug CJ (2015) Peer-review fraud – hacking the scientific publication process. N Engl J Med 373:2393–2395CrossRef Haug CJ (2015) Peer-review fraud – hacking the scientific publication process. N Engl J Med 373:2393–2395CrossRef
13.
go back to reference Teixeira da Silva JA, Al-Khatib A (2018) Should authors be requested to suggest peer reviewers? Sci Eng Ethics 24:275–285CrossRef Teixeira da Silva JA, Al-Khatib A (2018) Should authors be requested to suggest peer reviewers? Sci Eng Ethics 24:275–285CrossRef
15.
go back to reference Siegelman SS (1991) Assassins and zealots: variations in peer review. Special report. Radiology 178:637–642CrossRef Siegelman SS (1991) Assassins and zealots: variations in peer review. Special report. Radiology 178:637–642CrossRef
16.
go back to reference Berquist TH (2012) Peer review: is the process broken? AJR Am J Roentgenol 199:243CrossRef Berquist TH (2012) Peer review: is the process broken? AJR Am J Roentgenol 199:243CrossRef
17.
go back to reference Berquist TH (2014) Peer review: should we modify our process? AJR Am J Roentgenol 202:463–464CrossRef Berquist TH (2014) Peer review: should we modify our process? AJR Am J Roentgenol 202:463–464CrossRef
18.
go back to reference Berquist TH (2017) Peer review: is the process broken? AJR Am J Roentgenol 209:1–2CrossRef Berquist TH (2017) Peer review: is the process broken? AJR Am J Roentgenol 209:1–2CrossRef
19.
go back to reference Katz DS, Gardner JB, Hoffmann JC et al (2016) Ethical issues in radiology journalism, peer review, and research. AJR Am J Roentgenol 207:820–825CrossRef Katz DS, Gardner JB, Hoffmann JC et al (2016) Ethical issues in radiology journalism, peer review, and research. AJR Am J Roentgenol 207:820–825CrossRef
20.
go back to reference Katz DS, Proto AV, Olmsted WW (2002) Incidence and nature of unblinding by authors: our experience at two radiology journals with double-blinded peer review policies. AJR Am J Roentgenol 179:1415–1417CrossRef Katz DS, Proto AV, Olmsted WW (2002) Incidence and nature of unblinding by authors: our experience at two radiology journals with double-blinded peer review policies. AJR Am J Roentgenol 179:1415–1417CrossRef
21.
go back to reference O’Connor EE, Cousar M, Lentini JA, Castillo M, Halm K, Zeffiro TA (2017) Efficacy of double-blind peer review in an imaging subspecialty journal. AJNR Am J Neuroradiol 38:230–235CrossRef O’Connor EE, Cousar M, Lentini JA, Castillo M, Halm K, Zeffiro TA (2017) Efficacy of double-blind peer review in an imaging subspecialty journal. AJNR Am J Neuroradiol 38:230–235CrossRef
22.
go back to reference Liebeskind DS (2003) The fallacy of double-blinded peer review. AJR Am J Roentgenol 181:1422 (author reply 1422-1423)CrossRef Liebeskind DS (2003) The fallacy of double-blinded peer review. AJR Am J Roentgenol 181:1422 (author reply 1422-1423)CrossRef
23.
go back to reference Kurmis AP (2003) Understanding the limitations of the journal impact factor. J Bone Joint Surg Am 85:2449–2454CrossRef Kurmis AP (2003) Understanding the limitations of the journal impact factor. J Bone Joint Surg Am 85:2449–2454CrossRef
Metadata
Title
Peer review practices by medical imaging journals
Authors
Thomas C. Kwee
Hugo J. A. Adams
Robert M. Kwee
Publication date
01-12-2020
Publisher
Springer Berlin Heidelberg
Published in
Insights into Imaging / Issue 1/2020
Electronic ISSN: 1869-4101
DOI
https://doi.org/10.1186/s13244-020-00921-3

Other articles of this Issue 1/2020

Insights into Imaging 1/2020 Go to the issue