Skip to main content
Top
Published in: European Radiology 2/2019

01-02-2019 | Experimental

Epidemiology of systematic reviews in imaging journals: evaluation of publication trends and sustainability?

Authors: M. Alabousi, A. Alabousi, T. A. McGrath, K. D. Cobey, B. Budhram, R. A. Frank, F. Nguyen, J. P. Salameh, A. Dehmoobad Sharifabadi, M. D. F. McInnes

Published in: European Radiology | Issue 2/2019

Login to get access

Abstract

Purpose

To evaluate the epidemiology of systematic reviews (SRs) published in imaging journals.

Methods

A MEDLINE search identified SRs published in imaging journals from 1 January 2000–31 December 2016. Articles retrieved were screened against inclusion criteria. Demographic and methodological characteristics were extracted from studies. Temporal trends were evaluated using linear regression and Pearson’s correlation coefficients.

Results

921 SRs were included that reported on 27,435 primary studies, 85,276,484 patients and were cited 26,961 times. The SR publication rate increased 23-fold (r=0.92, p<0.001) while the proportion of SRs to non-SRs increased 13-fold (r = 0.94, p<0.001) from 2000 (0.10%) to 2016 (1.33%). Diagnostic test accuracy (DTA) SRs were most frequent (46.5%) followed by therapeutic SRs (16.6%). Most SRs did not report funding status (54.2%). The median author team size was five; this increased over time (r=0.20, p<0.001). Of the studies, 67.3% included an imaging specialist co-author; this decreased over time (r=-0.57, p=0.017). Most SRs included a meta-analysis (69.6%). Journal impact factor positively correlated with SR publication rates (r=0.54, p<0.001). Magnetic resonance imaging (MRI) and ‘vascular and interventional radiology’ were the most frequently studied imaging modality and subspecialty, respectively. The USA, UK, China, Netherlands and Canada were the top five publishing countries.

Conclusions

The SR publication rate is increasing rapidly compared with the rate of growth of non-SRs; however, they still make up just over 1% of all studies. Authors, reviewers and editors should be aware of methodological and reporting standards specific to imaging systematic reviews including those for DTA and individual patient data.

Key Points

• Systematic review publication rate has increased 23-fold from 2000–2016.
• The proportion of systematic reviews to non-systematic reviews has increased 13-fold.
• The USA, UK and China are the most frequent published countries; those from the USA and China are increasing the most rapidly.
Appendix
Available only for authorised users
Literature
1.
go back to reference Murad MH, Montori VM (2013) Synthesizing evidence: shifting the focus from individual studies to the body of evidence. JAMA 309(21):2217–2218CrossRef Murad MH, Montori VM (2013) Synthesizing evidence: shifting the focus from individual studies to the body of evidence. JAMA 309(21):2217–2218CrossRef
2.
go back to reference Page MJ, Shamseer L, Altman DG et al (2016) Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS Med 13(5):e1002028CrossRef Page MJ, Shamseer L, Altman DG et al (2016) Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS Med 13(5):e1002028CrossRef
3.
go back to reference Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (2007) Epidemiology and reporting characteristics of systematic reviews. PLoS Med 4(3):e78CrossRef Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (2007) Epidemiology and reporting characteristics of systematic reviews. PLoS Med 4(3):e78CrossRef
4.
go back to reference Ioannidis JP (2016) The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q 94(3):485–514.5CrossRef Ioannidis JP (2016) The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q 94(3):485–514.5CrossRef
5.
go back to reference Berkman ND, Lohr KN, Ansari MT et al (2015) Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol 68(11):1312–1324CrossRef Berkman ND, Lohr KN, Ansari MT et al (2015) Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol 68(11):1312–1324CrossRef
6.
go back to reference Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ (1995) Users' guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA 274(22):1800–1804CrossRef Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ (1995) Users' guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA 274(22):1800–1804CrossRef
8.
go back to reference Bastian H, Glasziou P, Chalmers I (2010) Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med 7(9):e1000326CrossRef Bastian H, Glasziou P, Chalmers I (2010) Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med 7(9):e1000326CrossRef
9.
go back to reference Ioannidis JP, Greenland S, Hlatky MA et al (2014) Increasing value and reducing waste in research design, conduct, and analysis. Lancet 383(9912):166–175CrossRef Ioannidis JP, Greenland S, Hlatky MA et al (2014) Increasing value and reducing waste in research design, conduct, and analysis. Lancet 383(9912):166–175CrossRef
10.
go back to reference Moher D, Glasziou P, Chalmers I et al (2016) Increasing value and reducing waste in biomedical research: who's listening? Lancet 387(10027):1573–1586CrossRef Moher D, Glasziou P, Chalmers I et al (2016) Increasing value and reducing waste in biomedical research: who's listening? Lancet 387(10027):1573–1586CrossRef
11.
go back to reference Tunis AS, McInnes MD, Hanna R, Esmail K (2013) Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology 269(2):413–426CrossRef Tunis AS, McInnes MD, Hanna R, Esmail K (2013) Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology 269(2):413–426CrossRef
12.
go back to reference McGrath TA, McInnes MD, Korevaar DA, Bossuyt PM (2016) Meta-Analyses of Diagnostic Accuracy in Imaging Journals: Analysis of Pooling Techniques and Their Effect on Summary Estimates of Diagnostic Accuracy. Radiology 281(1):78–85CrossRef McGrath TA, McInnes MD, Korevaar DA, Bossuyt PM (2016) Meta-Analyses of Diagnostic Accuracy in Imaging Journals: Analysis of Pooling Techniques and Their Effect on Summary Estimates of Diagnostic Accuracy. Radiology 281(1):78–85CrossRef
13.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6(7):e1000097CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG, Group P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6(7):e1000097CrossRef
15.
go back to reference McInnes MDF, Moher D, Thombs BD et al (2018) Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA 319(4):388–396CrossRef McInnes MDF, Moher D, Thombs BD et al (2018) Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA 319(4):388–396CrossRef
16.
go back to reference Issa Y, Kempeneers MA, van Santvoort HC, Bollen TL, Bipat S, Boermeester MA (2017) Diagnostic performance of imaging modalities in chronic pancreatitis: a systematic review and meta-analysis. Eur Radiol 27(9):3820–3844CrossRef Issa Y, Kempeneers MA, van Santvoort HC, Bollen TL, Bipat S, Boermeester MA (2017) Diagnostic performance of imaging modalities in chronic pancreatitis: a systematic review and meta-analysis. Eur Radiol 27(9):3820–3844CrossRef
17.
go back to reference Sevcenco S, Spick C, Helbich TH et al (2017) Malignancy rates and diagnostic performance of the Bosniak classification for the diagnosis of cystic renal lesions in computed tomography - a systematic review and meta-analysis. Eur Radiol 27(6):2239–2247CrossRef Sevcenco S, Spick C, Helbich TH et al (2017) Malignancy rates and diagnostic performance of the Bosniak classification for the diagnosis of cystic renal lesions in computed tomography - a systematic review and meta-analysis. Eur Radiol 27(6):2239–2247CrossRef
18.
go back to reference Porté F, Uppara M, Malietzis G et al (2017) CT colonography for surveillance of patients with colorectal cancer: Systematic review and meta-analysis of diagnostic efficacy. Eur Radiol 27(1):51–60CrossRef Porté F, Uppara M, Malietzis G et al (2017) CT colonography for surveillance of patients with colorectal cancer: Systematic review and meta-analysis of diagnostic efficacy. Eur Radiol 27(1):51–60CrossRef
19.
go back to reference Connolly MJ, McInnes MDF, El-Khodary M, McGrath TA, Schieda N (2017) Diagnostic accuracy of virtual non-contrast enhanced dual-energy CT for diagnosis of adrenal adenoma: A systematic review and meta-analysis. Eur Radiol 27(10):4324–4335CrossRef Connolly MJ, McInnes MDF, El-Khodary M, McGrath TA, Schieda N (2017) Diagnostic accuracy of virtual non-contrast enhanced dual-energy CT for diagnosis of adrenal adenoma: A systematic review and meta-analysis. Eur Radiol 27(10):4324–4335CrossRef
20.
go back to reference Lee SY, Kim HJ, Shin YR, Park HJ, Lee YG, Oh SJ (2017) Prognostic significance of focal lesions and diffuse infiltration on MRI for multiple myeloma: a meta-analysis. Eur Radiol 27(6):2333–2347CrossRef Lee SY, Kim HJ, Shin YR, Park HJ, Lee YG, Oh SJ (2017) Prognostic significance of focal lesions and diffuse infiltration on MRI for multiple myeloma: a meta-analysis. Eur Radiol 27(6):2333–2347CrossRef
21.
go back to reference Stewart LA, Clarke M, Rovers M et al (2015) Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. JAMA 313(16):1657–1665CrossRef Stewart LA, Clarke M, Rovers M et al (2015) Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. JAMA 313(16):1657–1665CrossRef
22.
go back to reference Hutton B, Salanti G, Caldwell DM et al (2015) The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 162(11):777–784CrossRef Hutton B, Salanti G, Caldwell DM et al (2015) The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 162(11):777–784CrossRef
23.
go back to reference Shojania KG, Bero LA (2001) Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract 4(4):157–162 Shojania KG, Bero LA (2001) Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract 4(4):157–162
25.
go back to reference Sardanelli F, Bashir H, Berzaczy D et al (2014) The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: report from the EuroAIM Evidence-based Radiology Working Group. Radiology 272(2):533–540CrossRef Sardanelli F, Bashir H, Berzaczy D et al (2014) The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: report from the EuroAIM Evidence-based Radiology Working Group. Radiology 272(2):533–540CrossRef
26.
go back to reference Dang W, McInnes MD, Kielar AZ, Hong J (2015) A Comprehensive Analysis of Authorship in Radiology Journals. PLoS One 10(9):e0139005CrossRef Dang W, McInnes MD, Kielar AZ, Hong J (2015) A Comprehensive Analysis of Authorship in Radiology Journals. PLoS One 10(9):e0139005CrossRef
27.
go back to reference Zou KH, Tuncali K, Silverman SG (2003) Correlation and simple linear regression. Radiology 227(3):617–622CrossRef Zou KH, Tuncali K, Silverman SG (2003) Correlation and simple linear regression. Radiology 227(3):617–622CrossRef
28.
go back to reference Riley RD, Lambert PC, Abo-Zaid G (2010) Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ 340:c221CrossRef Riley RD, Lambert PC, Abo-Zaid G (2010) Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ 340:c221CrossRef
29.
go back to reference Ioannidis JP, Chang CQ, Lam TK, Schully SD, Khoury MJ (2013) The geometric increase in meta-analyses from China in the genomic era. PLoS One 8(6):e65602CrossRef Ioannidis JP, Chang CQ, Lam TK, Schully SD, Khoury MJ (2013) The geometric increase in meta-analyses from China in the genomic era. PLoS One 8(6):e65602CrossRef
30.
go back to reference van der Pol CB, McInnes MD, Petrcich W, Tunis AS, Hanna R (2015) Is quality and completeness of reporting of systematic reviews and meta-analyses published in high impact radiology journals associated with citation rates? PLoS One 10(3):e0119892CrossRef van der Pol CB, McInnes MD, Petrcich W, Tunis AS, Hanna R (2015) Is quality and completeness of reporting of systematic reviews and meta-analyses published in high impact radiology journals associated with citation rates? PLoS One 10(3):e0119892CrossRef
31.
go back to reference Fleming PS, Koletsi D, Seehra J, Pandis N (2014) Systematic reviews published in higher impact clinical journals were of higher quality. J Clin Epidemiol 67(7):754–759CrossRef Fleming PS, Koletsi D, Seehra J, Pandis N (2014) Systematic reviews published in higher impact clinical journals were of higher quality. J Clin Epidemiol 67(7):754–759CrossRef
32.
go back to reference Brinjikji W, Klunder A, Kallmes DF (2013) The 100 most-cited articles in the imaging literature. Radiology 269(1):272–276CrossRef Brinjikji W, Klunder A, Kallmes DF (2013) The 100 most-cited articles in the imaging literature. Radiology 269(1):272–276CrossRef
33.
go back to reference Pagni M, Khan NR, Cohen HL, Choudhri AF (2014) Highly cited works in radiology: the top 100 cited articles in radiologic journals. Acad Radiol 21(8):1056–1066CrossRef Pagni M, Khan NR, Cohen HL, Choudhri AF (2014) Highly cited works in radiology: the top 100 cited articles in radiologic journals. Acad Radiol 21(8):1056–1066CrossRef
34.
go back to reference Yoon DY, Yun EJ, Ku YJ et al (2013) Citation classics in radiology journals: the 100 top-cited articles, 1945-2012. AJR Am J Roentgenol 201(3):471–481CrossRef Yoon DY, Yun EJ, Ku YJ et al (2013) Citation classics in radiology journals: the 100 top-cited articles, 1945-2012. AJR Am J Roentgenol 201(3):471–481CrossRef
35.
go back to reference McInnes MD, Bossuyt PM (2015) Pitfalls of Systematic Reviews and Meta-Analyses in Imaging Research. Radiology 277(1):13–21CrossRef McInnes MD, Bossuyt PM (2015) Pitfalls of Systematic Reviews and Meta-Analyses in Imaging Research. Radiology 277(1):13–21CrossRef
36.
go back to reference Glasziou P, Altman DG, Bossuyt P et al (2014) Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383(9913):267–276CrossRef Glasziou P, Altman DG, Bossuyt P et al (2014) Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383(9913):267–276CrossRef
37.
go back to reference Siontis KC, Hernandez-Boussard T, Ioannidis JP (2013) Overlapping meta-analyses on the same topic: survey of published studies. BMJ 347:f4501CrossRef Siontis KC, Hernandez-Boussard T, Ioannidis JP (2013) Overlapping meta-analyses on the same topic: survey of published studies. BMJ 347:f4501CrossRef
38.
go back to reference PRISMA: Transparent Reporting of Systematic Reviews and Meta-analyses (2015) Preferred Reporting Items for a Systematic Review and Meta-analysis, Ottawa. Available via http://www.prisma-statement.org. Accessed 13 Feb 2018 PRISMA: Transparent Reporting of Systematic Reviews and Meta-analyses (2015) Preferred Reporting Items for a Systematic Review and Meta-analysis, Ottawa. Available via http://​www.​prisma-statement.​org. Accessed 13 Feb 2018
Metadata
Title
Epidemiology of systematic reviews in imaging journals: evaluation of publication trends and sustainability?
Authors
M. Alabousi
A. Alabousi
T. A. McGrath
K. D. Cobey
B. Budhram
R. A. Frank
F. Nguyen
J. P. Salameh
A. Dehmoobad Sharifabadi
M. D. F. McInnes
Publication date
01-02-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 2/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5567-z

Other articles of this Issue 2/2019

European Radiology 2/2019 Go to the issue