Top

BMC Ophthalmology

Published in:

Open Access 01-12-2017 | Research article

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews

Authors: Evan Mayo-Wilson, Sueko Matsumura Ng, Roy S. Chuck, Tianjing Li

Published in: BMC Ophthalmology | Issue 1/2017

Abstract

Background

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP.

Methods

Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as “reliable” when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review.

Results

We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions.

Conclusions

Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Available only for authorised users

Institute of Medicine. Clinical practice guidelines we can trust. Washington, DC: The National Academies Press; 2011.

Li T, Vedula SS, Scherer R, Dickersin K. What comparative effectiveness research is needed? A framework for using guidelines and systematic reviews to identify evidence gaps and research priorities. Ann Intern Med. 2012;156(5):367–77. https://doi.org/10.7326/0003-4819-156-5-201203060-00009.CrossRefPubMedPubMedCentral

Institute of Medicine. Finding what works in health care: standards for systematic reviews. Washington, DC: The National Academies Press; 2011.

Lindsley K, Li T, Ssemanda E, Virgili G, Dickersin K. Interventions for age-related macular degeneration: are practice guidelines based on systematic reviews? Ophthalmology. 2016;123(4):884–97. https://doi.org/10.1016/j.ophtha.2015.12.004.CrossRefPubMedPubMedCentral

Naidoo KS, Leasher J, Bourne RR, Flaxman SR, Jonas JB, Keeffe J, et al. Global vision impairment and blindness due to uncorrected refractive error, 1990-2010. Optom Vis Sci. 2016;93(3):227–34. https://doi.org/10.1097/OPX.0000000000000796.CrossRefPubMed

Li T. Register systematic reviews. CMAJ. 2010;182(8):805. https://doi.org/10.1503/cmaj.110-2064.CrossRefPubMedPubMedCentral

American Academy of Opthalmology. Refractive errors and refractive surgery. San Francisco; 2012. https://www.aao.org/preferred-practice-pattern/refractive-errors--surgery-ppp-2013.

Eden J, Levit L, Berg A, Morton S. Finding what works in health care. Washington, D.C.: National Academies Press; 2011.

Li T, Ervin AM, Scherer R, Jampel H, Dickersin K. Setting priorities for comparative effectiveness research: a case study using primary open-angle glaucoma. Ophthalmology. 2010;117(10):1937–45. https://doi.org/10.1016/j.ophtha.2010.07.004.CrossRefPubMedPubMedCentral

10.

Critical Appraisal Skills Programme (CASP). Critical appraisal skills programme (CASP) [internet]. 2015 [cited 10 Nov 2015]. Available from: http://www.casp-uk.net/casp-tools-checklists.

11.

Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10. https://doi.org/10.1186/1471-2288-7-10.CrossRefPubMedPubMedCentral

12.

Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. W64CrossRefPubMed

13.

Yu T, Li T, Lee KJ, Friedman DS, Dickersin K, Puhan MA. Setting priorities for comparative effectiveness research on management of primary angle closure: a survey of Asia-Pacific clinicians. J Glaucoma. 2015;24(5):348–55. https://doi.org/10.1097/IJG.0b013e31829e5616.CrossRefPubMedPubMedCentral

14.

Li T, Vedula SS, Hadar N, Parkin C, Lau J, Dickersin K. Innovations in data collection, management, and archiving for systematic reviews. Ann Intern Med. 2015;162(4):287–94. https://doi.org/10.7326/M14-1603.CrossRefPubMed

15.

Barsam A, Allan Bruce DS. Excimer laser refractive surgery versus phakic intraocular lenses for the correction of moderate to high myopia. Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007679.pub4.

16.

Li S-M, Zhan S, Li S-Y, Peng X-X, Hu J, Law Hua A, et al. Laser-assisted subepithelial keratectomy (LASEK) versus photorefractive keratectomy (PRK) for correction of myopia. Cochrane Database Syst Rev. 2016;2:CD009799. https://doi.org/10.1002/14651858.CD009799.pub2.PubMedPubMedCentral

17.

Li SM, Wu SS, Kang MT, Liu Y, Jia SM, Li SY, et al. Atropine slows myopia progression more in Asian than white children by meta-analysis. Optom Vis Sci. 2014;91(3):342–50. https://doi.org/10.1097/opx.0000000000000178.PubMed

18.

Shortt Alex J, Allan Bruce DS, Evans JR. Laser-assisted in-situ keratomileusis (LASIK) versus photorefractive keratectomy (PRK) for myopia. Cochrane Database Syst Rev. 2013;1:CD005135. https://doi.org/10.1002/14651858.CD005135.pub3.

19.

Settas G, Settas C, Minos E, Yeung Ian YL. Photorefractive keratectomy (PRK) versus laser assisted in situ keratomileusis (LASIK) for hyperopia correction. Cochrane Database Syst Rev. 2012;6:CD007112. https://doi.org/10.1002/14651858.CD007112.pub3.

20.

Walline Jeffrey J, Lindsley K, Vedula Satyanarayana S, Cotter Susan A, Mutti Donald O, Twelker JD. Interventions to slow progression of myopia in children. Cochrane Database Syst Rev. 2011;12:CD004916. https://doi.org/10.1002/14651858.CD004916.pub3.

21.

Wei Mao L, Liu Jian P, Li N, Liu M. Acupuncture for slowing the progression of myopia in children and adolescents. Cochrane Database Syst Rev. 2011; https://doi.org/10.1002/14651858.CD007842.pub2.

22.

Li SM, Ji YZ, Wu SS, Zhan SY, Wang B, Liu LR, et al. Multifocal versus single vision lenses intervention to slow progression of myopia in school-age children: a meta-analysis. Surv Ophthalmol. 2011;56(5):451–60. https://doi.org/10.1016/j.survophthal.2011.06.002.CrossRefPubMed

23.

Shortt AJAB. Photorefractive keratectomy (PRK) versus laser-assisted in-situ keratomileusis (LASIK) for myopia. Cochrane Database Syst Rev. 2006;2:CD005135.

24.

Virgili G, Menchini F. Laser photocoagulation for choroidal neovascularisation in pathologic myopia. Cochrane Database Syst Rev. 2005;4:CD004765.

25.

Saw SM, Shih-Yen EC, Koh A, Tan D. Interventions to retard myopia progression in children: an evidence-based update. Ophthalmology. 2002;109(3):415–21.CrossRefPubMed

26.

Liu YM, Xie P. The safety of orthokeratology - a systematic review. Eye and Contact Lens. 2016;42(1):35–42.CrossRefPubMed

27.

Sun Y, Xu F, Zhang T, Liu M, Wang D, Chen Y, et al. Orthokeratology to control myopia progression: a meta-analysis. PLoS One. 2015;10(4):e0124535.

28.

Si JK, Tang K, Bi HS, Guo DD, Guo JG, Wang XR. Orthokeratology for myopia control: a meta-analysis. Optom Vis Sci. 2015;92(3):252–7. https://doi.org/10.1097/opx.0000000000000505.CrossRefPubMed

29.

Pearce MG. Clinical outcomes following the dispensing of ready-made and recycled spectacles: a systematic literature review. Clin Exp Optom. 2014;97(3):225–33.

30.

Wen D, Huang J, Li X, Savini G, Feng Y, Lin Q, Wang Q. Laser-assisted subepithelial keratectomy versus epipolis laser in situ keratomileusis for myopia: a meta-analysis of clinical outcomes. Clin Exp Ophthalmol. 2014;42(4):323–33.

31.

Chen S, Feng Y, Stojanovic A, Jankov MR 2nd, Wang Q. IntraLase femtosecond laser vs mechanical microkeratomes in LASIK for myopia: a systematic review and meta-analysis. J Refract Surg. 2012;28(1):15–24. https://doi.org/10.3928/1081597x-20111228-02.CrossRefPubMed

32.

Zhang ZH, Jin HY, Suo Y, Patel SV, Montes-Mico R, Manche EE, et al. Femtosecond laser versus mechanical microkeratome laser in situ keratomileusis for myopia: Metaanalysis of randomized controlled trials. J Cataract Refract Surg. 2011;37(12):2151–9. https://doi.org/10.1016/j.jcrs.2011.05.043.CrossRefPubMed

33.

Feng YF, Chen SH, Stojanovic A, Wang QM. Comparison of clinical outcomes between ‘on-flap’ and ‘off-flap’ epi-LASIK for myopia: a meta-analysis. Ophthalmologica. 2012;227(1):45–54. https://doi.org/10.1159/000331280.CrossRefPubMed

34.

Feng Y, Yu J, Wang Q. Meta-analysis of wavefront-guided vs. wavefront-optimized LASIK for myopia. Optom Vis Sci. 2011;88(12):1463–9. https://doi.org/10.1097/OPX.0b013e3182333a50.PubMed

35.

Fares U, Suleman H, Al-Aqaba MA, Otri AM, Said DG, Dua HS. Efficacy, predictability, and safety of wavefront-guided refractive laser treatment: metaanalysis. J Cataract Refract Surg. 2011;37(8):1465–75.

36.

Fernandes P, Gonzalez-Meijome JM, Madrid-Costa D, Ferrer-Blasco T, Jorge J, Montes-Mico R. Implantable collamer posterior chamber intraocular lenses: a review of potential complications. J Refract Surg. 2011;27(10):765–76.CrossRefPubMed

37.

Song YY, Wang H, Wang BS, Qi H, Rong ZX, Chen HZ. Atropine in ameliorating the progression of myopia in children with mild to moderate myopia: a meta-analysis of controlled clinical trials. J Ocul Pharmacol Ther. 2011;27(4):361–8.

38.

Chen SH, Feng YF, Stojanovic A, Wang QM. Meta-analysis of clinical outcomes comparing surface ablation for correction of myopia with and without 0.02% Mitomycin C. J Refract Surg. 2011;27(7):530–41. https://doi.org/10.3928/1081597x-20110112-02.CrossRefPubMed

39.

Chen L, Ye T, Yang X. Evaluation of the long-term effects of photorefractive keratectomy correction for myopia in China. Eur J Ophthalmol. 2011;21(4):355–62.

40.

Zhao LQ, Wei RL, Cheng JW, Li Y, Cai JP, Ma XY. Meta-analysis: clinical outcomes of laser-assisted subepithelial keratectomy and photorefractive keratectomy in myopia. Ophthalmology. 2010;117(10):1912–22.

41.

Huang D, Schallhorn SC, Sugar A, Farjo AA, Majmudar PA, Trattler WB, et al. Phakic intraocular lens implantation for the correction of myopia: a report by the American Academy of ophthalmology. Ophthalmology. 2009;116(11):2244–58. https://doi.org/10.1016/j.ophtha.2009.08.018.CrossRefPubMed

42.

Solomon KD. Fernandez de Castro LE, Sandoval HP, Biber JM, Groat B, Neff KD et al. LASIK world literature review: quality of life and patient satisfaction. Ophthalmology. 2009;116(4):691–701.CrossRefPubMed

43.

Cui M, Chen XM, Lu P. Comparison of laser epithelial keratomileusis and photorefractive keratectomy for the correction of myopia: a meta-analysis. Chin Med J. 2008;121(22):2331–5.PubMed

44.

Szczotka-Flynn L, Diaz M. Risk of corneal inflammatory events with silicone hydrogel and low Dk hydrogel extended contact lens wear: a meta-analysis. Optom Vis Sci. 2007;84(4):247–56.CrossRefPubMed

45.

Varley GA, Huang D, Rapuano CJ, Schallhorn S, Boxer Wachler BS, Sugar A. LASIK for hyperopia, hyperopic astigmatism, and mixed astigmatism: a report by the American Academy of ophthalmology. Ophthalmology. 2004;111(8):1604–17.CrossRefPubMed

46.

Chang MA, Jain S, Azar DT. Infections following laser in situ keratomileusis: an integration of the published literature. Surv Ophthalmol. 2004;49(3):269–80.CrossRefPubMed

47.

Yang XJ, Yan HT, Nakahori Y. Evaluation of the effectiveness of laser in situ keratomileusis and photorefractive keratectomy for myopia: a meta-analysis. J Med Investig. 2003;50(3–4):180–6.

48.

Sugar A, Rapuano CJ, Culbertson WW, Huang D, Varley GA, Agapitos PJ, et al. Laser in situ keratomileusis for myopia and astigmatism: safety and efficacy: a report by the American Academy of ophthalmology. Ophthalmology. 2002;109(1):175–87.CrossRefPubMed

49.

Rapuano CJ, Sugar A, Koch DD, Agapitos PJ, Culbertson WW, de Luise VP, et al. Intrastromal corneal ring segments for low myopia: a report by the American Academy of ophthalmology. Ophthalmology. 2001;108(10):1922–8.CrossRefPubMed

50.

Jain S, Arora I, Azar DT. Success of monovision in presbyopes: review of the literature and potential applications to refractive surgery. Surv Ophthalmol. 1996;40(6):491–9.CrossRefPubMed

51.

Liang GL, Wu J, Shi JT, Liu J, He FY, Xu W. Implantable collamer lens versus iris-fixed phakic intraocular lens implantation to correct myopia: a meta-analysis. PLoS One. 2014;9(8):e104649. https://doi.org/10.1371/journal.pone.0104649.CrossRefPubMedPubMedCentral

52.

Kobashi H, Kamiya K, Hoshi K, Igarashi A, Shimizu K. Wavefront-guided versus non-wavefront-guided photorefractive keratectomy for myopia: meta-analysis of randomized controlled trials. PLoS One. 2014;9(7):e103605. https://doi.org/10.1371/journal.pone.0103605.CrossRefPubMedPubMedCentral

53.

Zhao LQ, Zhu H, Li LM. Laser-assisted subepithelial keratectomy versus laser in situ Keratomileusis in myopia: a systematic review and meta-analysis. ISRN Ophthalmol. 2014;2014:672146. https://doi.org/10.1155/2014/672146.CrossRefPubMedPubMedCentral

54.

Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, et al. Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study. PLoS Med. 2016;13(5):e1002028. https://doi.org/10.1371/journal.pmed.1002028.CrossRefPubMedPubMedCentral

55.

Pussegoda K, Turner L, Garritty C, Mayhew A, Skidmore B, Stevens A, et al. Systematic review adherence to methodological or reporting quality. Syst Rev. 2017;6(1):131. https://doi.org/10.1186/s13643-017-0527-2.CrossRefPubMedPubMedCentral

56.

Atkinson KM, Koenka AC, Sanchez CE, Moshontz H, Cooper H. Reporting standards for literature searches and report inclusion criteria: making research syntheses more transparent and easy to replicate. Res Synth Methods. 2015;6(1):87–95. https://doi.org/10.1002/jrsm.1127.CrossRefPubMed

57.

Rosman L, Twose C, Li M, Li T, Saldanha I, Dickersin K. Teaching searching in an intensive systematic review course: “how many citations should I expect to review?” (poster). Quebec City: 21st Cochrane Colloquium; 2013.

58.

Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. https://doi.org/10.1136/bmj.d5928.CrossRefPubMedPubMedCentral

59.

Clark HD, Wells GA, Huet C, McAlister FA, Salmi LR, Fergusson D, et al. Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999;20(5):448–52.CrossRefPubMed

60.

Juni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999;282(11):1054–60.CrossRefPubMed

61.

Moher D, Jadad AR, Tugwell P. Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996;12(2):195–208.CrossRefPubMed

62.

Ioannidis JP. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 2016;94(3):485–514. https://doi.org/10.1111/1468-0009.12210.CrossRefPubMedPubMedCentral

63.

Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1. https://doi.org/10.1186/2046-4053-4-1.CrossRefPubMedPubMedCentral

64.

Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097.CrossRefPubMedPubMedCentral

65.

Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from http://handbook.cochrane.org.

Title: The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews
Authors: Evan Mayo-Wilson
Sueko Matsumura Ng
Roy S. Chuck
Tianjing Li
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: BMC Ophthalmology / Issue 1/2017
Electronic ISSN: 1471-2415
DOI: https://doi.org/10.1186/s12886-017-0561-9

At a glance: The STEP trials

Springer Medicine

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews

Abstract

Background

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2017

Combined Brown syndrome and superior oblique palsy without a trochlear nerve: case report

Corneal biomechanical properties in healthy children measured by corneal visualization scheimpflug technology

Tablets at the bedside - iPad-based visual field test used in the diagnosis of Intrasellar Haemangiopericytoma: a case report

Visual prognosis better in eyes with less severe reduction of visual acuity one year after onset of Leber hereditary optic neuropathy caused by the 11,778 mutation

Damage to the macula associated with LED-derived blue laser exposure: A case report

Near work, outdoor activity, and myopia in children in rural China: the Handan offspring myopia study