Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Compliance of systematic reviews in ophthalmology with the PRISMA statement

Authors: Seon-Young Lee, Harkiran Sagoo, Reem Farwana, Katharine Whitehurst, Alex Fowler, Riaz Agha

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Systematic reviews and meta-analyses are becoming increasingly important methods to summarize published research. Studies of ophthalmology may present additional challenges because of their potentially complex study designs. The aim of this study was to evaluate the reporting quality of systematic reviews and meta-analyses on topics in ophthalmology to determine compliance with the PRISMA guidelines. We assessed articles published between 2010 and 2015 in the five major relevant journals with the highest impact factors.

Methods

The MEDLINE and EMBASE databases were searched to identify systematic reviews published between January 2010 and December 2015 in the following 5 major ophthalmology journals: Progress in Retinal and Eye Research, Ophthalmology, Archives of Ophthalmology, American Journal of Ophthalmology, and Survey of Ophthalmology. The screening, identification, and scoring of articles were independently performed by two teams, and the results were submitted to statistical analysis to determine medians, ranges, and 95% CIs.

Results

A total of 115 articles were included. The median compliance was 15 out of 27 items (56%), the range was 5–26 (26–96%), and the inter-quartile range was 10 (37%). Compliance was highest in items related to the ‘description of rationale’ (item 3, 100%) and sequentially lower in ‘the general interpretation of results’ (item 26, 96%) and ‘the inclusion of a structured summary in the abstract’ (item 2, 90%). Compliance was poorest in the items ‘indication of review protocol and registration’ (item 5, 9%), ‘specification of risk of biases that may affect the cumulative evidence’ (item 15, 24%), and ‘description of clear objectives in the introduction’ (item 4, 26%).

Conclusion

The reporting quality of systematic reviews and meta-analyses in ophthalmology should be significantly improved. While we recommend the use of the PRISMA criteria as a guideline before journal submission, additional research aimed at identifying potential barriers to compliance may be required to improve compliance with PRISMA guidelines.
Appendix
Available only for authorised users
Literature
4.
go back to reference Li T. Publishing systematic reviews in ophthalmology: new guidance for authors. Ophthalmology. 2014;121(2):438–9.CrossRefPubMed Li T. Publishing systematic reviews in ophthalmology: new guidance for authors. Ophthalmology. 2014;121(2):438–9.CrossRefPubMed
6.
go back to reference Peters JPM, Hooft L, Grolman W, et al. Reporting quality of systematic reviews and meta-analyses of Otorhinolaryngologic articles based on the PRISMA statement. PLoS One. 2015;10:e0136540.CrossRefPubMedPubMedCentral Peters JPM, Hooft L, Grolman W, et al. Reporting quality of systematic reviews and meta-analyses of Otorhinolaryngologic articles based on the PRISMA statement. PLoS One. 2015;10:e0136540.CrossRefPubMedPubMedCentral
7.
go back to reference Fleming PS, Seehra J, Polychronopoulou A, et al. A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod. 2013;83(1):158–63.CrossRefPubMed Fleming PS, Seehra J, Polychronopoulou A, et al. A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod. 2013;83(1):158–63.CrossRefPubMed
8.
go back to reference Tunis AS, MD MI, Hanna R, et al. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013 Nov;269(2):413–26.CrossRefPubMed Tunis AS, MD MI, Hanna R, et al. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013 Nov;269(2):413–26.CrossRefPubMed
12.
go back to reference Yao AC, Khajuria A, Camm CF, et al. The reporting quality of parallel randomised controlled trials in ophthalmic surgery in 2011: a systematic review. Eye. 2014;28:1341–9.CrossRefPubMedPubMedCentral Yao AC, Khajuria A, Camm CF, et al. The reporting quality of parallel randomised controlled trials in ophthalmic surgery in 2011: a systematic review. Eye. 2014;28:1341–9.CrossRefPubMedPubMedCentral
13.
go back to reference Agha RA, Lee SY, Lee-Jeong KJ, et al. Reporting quality of observational studies in plastic surgery needs improvement; a systematic review. Ann Plast Surg. 2015 Jan 30; [Epub ahead of print] Agha RA, Lee SY, Lee-Jeong KJ, et al. Reporting quality of observational studies in plastic surgery needs improvement; a systematic review. Ann Plast Surg. 2015 Jan 30; [Epub ahead of print]
17.
go back to reference Viera AJ, Garrett JM. Understanding Interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding Interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
18.
go back to reference Tam WWS, Lo KKH, Khalechelvam P. Endorsement of PRISMA statement and quality of systematic reviews and meta-analyses published in nursing journals: a cross-sectional study. BMJ Open. 2017;7:e013905.CrossRefPubMedPubMedCentral Tam WWS, Lo KKH, Khalechelvam P. Endorsement of PRISMA statement and quality of systematic reviews and meta-analyses published in nursing journals: a cross-sectional study. BMJ Open. 2017;7:e013905.CrossRefPubMedPubMedCentral
23.
go back to reference Smith TS, Kulatilake P, Brown L, et al. Do surgery journals insist on reporting by CONSORT and PRISMA? A follow-up survey of ‘instructions to authors’. Ann Med Surg. 2015;4:17–21.CrossRef Smith TS, Kulatilake P, Brown L, et al. Do surgery journals insist on reporting by CONSORT and PRISMA? A follow-up survey of ‘instructions to authors’. Ann Med Surg. 2015;4:17–21.CrossRef
25.
go back to reference Chen H, Jhanji V. Survey of systematic reviews and meta-analyses published in ophthalmology. BMJ. 2012;96:896–9. Chen H, Jhanji V. Survey of systematic reviews and meta-analyses published in ophthalmology. BMJ. 2012;96:896–9.
28.
go back to reference Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1) doi: 10.1186/2046-4053-4-1. Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1) doi: 10.​1186/​2046-4053-4-1.
Metadata
Title
Compliance of systematic reviews in ophthalmology with the PRISMA statement
Authors
Seon-Young Lee
Harkiran Sagoo
Reem Farwana
Katharine Whitehurst
Alex Fowler
Riaz Agha
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0450-1

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue