Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

A survey of prevalence of narrative and systematic reviews in five major medical journals

Authors: Clovis Mariano Faggion Jr, Nikolaos P. Bakas, Jason Wasiak

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Systematic reviews may provide less biased evidence than narrative reviews because they observe a strict methodology, similarly to primary studies. Hence, for clinical research questions, systematic reviews should be the study design of choice. It would be important to evaluate the prevalence and characteristics of narrative and systematic reviews published in prominent medical journals. Researchers and clinicians give great value to articles published in such scientific journals. This study sought to evaluate the prevalence and characteristics of narrative and systematic reviews in the five highest-ranked general medical journals and investigate the associations among type of review, number of citations, and impact factor (IF).

Methods

We surveyed the five highest-ranked medical journals (The New England Journal of Medicine, The Lancet, The Journal of the American Medical Association, The BMJ, and Annals of Internal Medicine) for narrative and systematic reviews published between June 2015 and June 2016. We independently selected and extracted the data from the reviews by strictly following the pre-determined eligibility criteria (Systematic and narrative reviews that focused on the management of diseases). We conducted regression analyses to investigate the associations among review type, number of citations, and IF. We also descriptively reported narrative reviews containing some methodology that might be reproducible.

Results

Two hundred seventy-five reviews were included: 75 (27%) systematic; 126 (46%) narrative with some methodology reported, and 74 (27%) narrative reviews. In comparison to systematic reviews, narrative reviews were more frequently published in journals with higher IF (risk ratio [RR] = 1.114 (95% CI 1.080 to 1.149). Systematic reviews received more citations than narrative reviews (group formed by narrative and narrative with some methodology reported (RR = 0.985 95% CI 0.978 to 0.991).

Conclusions

Non-systematic evidence is the most prevalent type of evidence in reviews published in the five highest-ranked general medical journals. Narrative reviews were more frequently published in journals with higher IF. We recommend that journals limit their space for narrative information, and to address clinical research questions, these journals consider publishing systematic evidence exclusively.
Appendix
Available only for authorised users
Literature
1.
Moher D, Glasziou P, Chalmers I, Nasser M, Bossuyt PM, Korevaar DA, Graham ID, Ravaud P, Boutron I. Increasing value and reducing waste in biomedical research: who's listening? Lancet. 2016;387:1573–86.CrossRefPubMed
2.
Fardi A, Kodonas K, Gogos C, Economides N. Top-cited articles in endodontic journals. J Endod. 2011;37:1183–90.CrossRefPubMed
3.
Feijoo JF, Limeres J, Fernández-Varela M, Ramos I, Diz P. The 100 most cited articles in dentistry. Clin Oral Investig. 2014;18:699–706.CrossRefPubMed
4.
Faggion CM Jr, Málaga L, Monje A, Trescher AL, Listl S, Alarcón MA. The 300 most cited articles published in periodontology. Clin Oral Investig. 2016; [Epub ahead of print]
5.
6.
7.
Bhandari M, Montori VM, Devereaux PJ, Wilczynski NL, Morgan D, Haynes RB. Doubling the impact: publication of systematic review articles in orthopaedic journals. J Bone Joint Surg Am. 2004;86-A:1012–6.CrossRefPubMed
8.
Montori VM, Wilczynski NL, Morgan D, Haynes RB, Hedges Team. Systematic reviews: a cross-sectional study of location and citation counts. BMC Med. 2003;1:2.CrossRefPubMedPubMedCentral
9.
Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA. 2005;293:2362–6.CrossRefPubMed
10.
Conde-Taboada A, Aranegui B, García-Doval I, Dávila-Seijo P, González-Castro U. The use of systematic reviews in clinical trials and narrative reviews in dermatology: is the best evidence being used? Actas Dermosifiliogr. 2014;105:295–9.CrossRefPubMed
11.
12.
Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral
13.
Whiting P, Savović J, Higgins JP, Caldwell DM, Reeves BC, Shea B, Davies P, Kleijnen J, Churchill R, ROBIS group. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–34.CrossRefPubMedPubMedCentral
14.
Haddaway NR, Land M, Macura B. "a little learning is a dangerous thing": a call for better understanding of the term 'systematic review'. Environ Int. 2017;99:356–60.CrossRefPubMed
15.
16.
17.
Lee KP, Boyd EA, Holroyd-Leduc JM, Bacchetti P, Bero LA. Predictors of publication: characteristics of submitted manuscripts associated with acceptance at major biomedical journals. Med J Aust. 2006;184:621–6.PubMed
18.
Lee KP, Schotland M, Bacchetti P, Bero LA. Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002;287:2805–8.CrossRefPubMed
19.
Jasny BR, Chin G, Chong L, Vignieri S. Data replication & reproducibility. Again, and again, and again .... Introduction. Science. 2011;334:1225.CrossRefPubMed
20.
21.
22.
Page MJ, Altman DG, Shamseer L, McKenzie JE, Ahmadzai N, Wolfe D, Yazdi F, Catalá-López F, Tricco AC, Moher D. Reproducible research practices are underused in systematic reviews of biomedical interventions. J Clin Epidemiol. 2017; doi:10.​1016/​j.​jclinepi.​2017.​10.​017. [Epub ahead of print]
23.
24.
25.
Wasiak J, Tyack Z, Ware R, Goodwin N, Faggion CM Jr. Poor methodological quality and reporting standards of systematic reviews in burn care management. Int Wound J. 2017;14:754–63
26.
Wasiak J, Shen AY, Ware R, O'Donohoe TJ, Faggion CM Jr. Methodological quality and reporting of systematic reviews in hand and wrist pathology. J Hand Surg Eur Vol. 2017;42:852–56
Metadata
Title
A survey of prevalence of narrative and systematic reviews in five major medical journals
Authors
Clovis Mariano Faggion Jr
Nikolaos P. Bakas
Jason Wasiak
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0453-y

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue

Research article

A scoping review of comparisons between abstracts and full reports in primary biomedical research

Research article

Measurement properties of the Danish version of the Awareness and Beliefs about Cancer (ABC) measure

Research Article

Binomial outcomes in dataset with some clusters of size two: can the dependence of twins be accounted for? A simulation study comparing the reliability of statistical methods based on a dataset of preterm infants

Research article

The development of CHAMP: a checklist for the appraisal of moderators and predictors

Research article

Testing a systematic approach to identify and prioritise barriers to successful implementation of a complex healthcare intervention

Research article

Inter-rater reliability of AMSTAR is dependent on the pair of reviewers