Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

Quality assessment of systematic reviews or meta-analyses of nursing interventions conducted by Korean reviewers

Authors: Hyun-Ju Seo, Kyeong Uoon Kim

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

A systematic review is used to investigate the best available evidence of clinical safety and effectiveness of healthcare intervention. This requires methodological rigor in order to minimize bias and random error. The purpose of this study is to assess the quality of systematic reviews or meta-analyses for nursing interventions conducted by Korean researchers.

Methods

We searched electronic databases from 1950 to July 2010, including ovidMEDLINE, ovidEMBASE, and Korean databases, including KoreaMed, Korean Medical Database, and Korean studies Information Service System etc. Two reviewers independently screened and selected all references, and assessed the quality of systematic reviews or meta-analyses using the “Assessment of Multiple Systematic Reviews" (AMSTAR) tool.

Results

Twenty two systematic reviews or meta-analyses were included in this study. The median overall score (out of 11) for included reviews was 5 (range 2–11) and the mean overall score for AMSTAR was 4.7 (95% confidence interval 3.8-5.7). Nine out of 22 reviews were rated as low quality (AMSTAR score 0–4), 11 were rated as moderate quality (AMSTAR score 5–8), and two reviews were categorized as high quality (AMSTAR score 9–11).

Conclusions

The methodological quality of published reviews on nursing interventions conducted by Korean reviewers was assessed as low to moderate. In order to use the best available evidence in clinical decision making, reviewers should conduct systematic reviews or meta- analyses using rigorous research methods.
Appendix
Available only for authorised users
Literature
1.
go back to reference DiCenso A, Cullum N, Ciliska D: Implementing evidence based nursing: some misconceptions. Evid Based Nurs. 1998, 1: 38-40. 10.1136/ebn.1.2.38.CrossRef DiCenso A, Cullum N, Ciliska D: Implementing evidence based nursing: some misconceptions. Evid Based Nurs. 1998, 1: 38-40. 10.1136/ebn.1.2.38.CrossRef
2.
go back to reference Chalmers I, Altman DG: Systematic review (eds). 1995, London: British Medical Journal Publishing Group Chalmers I, Altman DG: Systematic review (eds). 1995, London: British Medical Journal Publishing Group
3.
go back to reference Melchiors AC, Correr CJ, Venson R, Pontarolo R: An analysis of quality of systematic reviews on pharmacist health interventions. Int J Clin Pharm. 2012, 34: 32-42. 10.1007/s11096-011-9592-0.CrossRefPubMed Melchiors AC, Correr CJ, Venson R, Pontarolo R: An analysis of quality of systematic reviews on pharmacist health interventions. Int J Clin Pharm. 2012, 34: 32-42. 10.1007/s11096-011-9592-0.CrossRefPubMed
5.
go back to reference Slutsky J, Atkins D, Chang S: Collins Sharp B: Methods Reference Guide for Effectiveness and Comparative Effectiveness Reviews. 2008, US Rockville (MD): Agency for Healthcare Research and Quality Slutsky J, Atkins D, Chang S: Collins Sharp B: Methods Reference Guide for Effectiveness and Comparative Effectiveness Reviews. 2008, US Rockville (MD): Agency for Healthcare Research and Quality
6.
go back to reference Sequeira-Byron P, Fedorowicz Z, Jagannath VA, Sharif MO: An AMSTAR assessment of the methodological quality of systematic reviews of oral healthcare interventions published in the Journal of Applied Oral Science (JAOS). J Appl Oral Sci. 2011, 19: 440-447. 10.1590/S1678-77572011000500002.CrossRefPubMedPubMedCentral Sequeira-Byron P, Fedorowicz Z, Jagannath VA, Sharif MO: An AMSTAR assessment of the methodological quality of systematic reviews of oral healthcare interventions published in the Journal of Applied Oral Science (JAOS). J Appl Oral Sci. 2011, 19: 440-447. 10.1590/S1678-77572011000500002.CrossRefPubMedPubMedCentral
7.
go back to reference Papageorgiou SN, Papadopoulos MA, Athanasiou AE: Evaluation of methodology and quality characteristics of systematic reviews in orthodontics. Orthod Craniofac Res. 2011, 14: 116-137. 10.1111/j.1601-6343.2011.01522.x.CrossRefPubMed Papageorgiou SN, Papadopoulos MA, Athanasiou AE: Evaluation of methodology and quality characteristics of systematic reviews in orthodontics. Orthod Craniofac Res. 2011, 14: 116-137. 10.1111/j.1601-6343.2011.01522.x.CrossRefPubMed
8.
go back to reference Lundh A, Knijnenburg SL, Jørgensen AW, van Dalen EC, Kremer LC: Quality of systematic reviews in pediatric oncology - a systematic review. Cancer Treat Rev. 2009, 35: 645-652. 10.1016/j.ctrv.2009.08.010.CrossRefPubMed Lundh A, Knijnenburg SL, Jørgensen AW, van Dalen EC, Kremer LC: Quality of systematic reviews in pediatric oncology - a systematic review. Cancer Treat Rev. 2009, 35: 645-652. 10.1016/j.ctrv.2009.08.010.CrossRefPubMed
9.
go back to reference Ma B, Guo J, Qi G, Li H, Peng J, Zhang Y, Ding Y, Yang K: Epidemiology, quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals. PLoS One. 2011, 6: e20185-10.1371/journal.pone.0020185.CrossRefPubMedPubMedCentral Ma B, Guo J, Qi G, Li H, Peng J, Zhang Y, Ding Y, Yang K: Epidemiology, quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals. PLoS One. 2011, 6: e20185-10.1371/journal.pone.0020185.CrossRefPubMedPubMedCentral
11.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic review. BMC Med Res Methodol. 2007, 7: 10-10.1186/1471-2288-7-10.CrossRefPubMedPubMedCentral Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic review. BMC Med Res Methodol. 2007, 7: 10-10.1186/1471-2288-7-10.CrossRefPubMedPubMedCentral
12.
go back to reference Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M: AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic review. J Clin Epidemiol. 2009, 62: 1013-1020. 10.1016/j.jclinepi.2008.10.009.CrossRefPubMed Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M: AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic review. J Clin Epidemiol. 2009, 62: 1013-1020. 10.1016/j.jclinepi.2008.10.009.CrossRefPubMed
13.
go back to reference Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM: External validation of a measurement tool to assess systematic review (AMSTAR). PLoS One. 2007, 2: e1350-10.1371/journal.pone.0001350.CrossRefPubMedPubMedCentral Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM: External validation of a measurement tool to assess systematic review (AMSTAR). PLoS One. 2007, 2: e1350-10.1371/journal.pone.0001350.CrossRefPubMedPubMedCentral
14.
go back to reference Mikton C, Butchart A: Child maltreatment prevention: a systematic review of reviews. Bull World Health Organ. 2009, 87: 353-361. 10.2471/BLT.08.057075.CrossRefPubMedPubMedCentral Mikton C, Butchart A: Child maltreatment prevention: a systematic review of reviews. Bull World Health Organ. 2009, 87: 353-361. 10.2471/BLT.08.057075.CrossRefPubMedPubMedCentral
15.
go back to reference Shin HS, Hyun MS, Ku MO, Cho MO, Kim SY, Jeong JS, Jeong GH, Seomoon GA, Son YJ: Analysis of research papers published in the journal of the Korea academy of nursing-focused on research trends, intervention studies, and level of evidence in the research. J Korean Acad Nurs. 2010, 40: 139-149. 10.4040/jkan.2010.40.1.139. KoreanCrossRefPubMed Shin HS, Hyun MS, Ku MO, Cho MO, Kim SY, Jeong JS, Jeong GH, Seomoon GA, Son YJ: Analysis of research papers published in the journal of the Korea academy of nursing-focused on research trends, intervention studies, and level of evidence in the research. J Korean Acad Nurs. 2010, 40: 139-149. 10.4040/jkan.2010.40.1.139. KoreanCrossRefPubMed
16.
go back to reference Moja LP, Telaro E, D'Amico R, Moschetti I, Coe L, Liberati A: Assessment of methodological quality of primary studies by systematic reviews: results of the meta quality cross sectional study. BMJ. 2005, 330: 1053-10.1136/bmj.38414.515938.8F.CrossRefPubMedPubMedCentral Moja LP, Telaro E, D'Amico R, Moschetti I, Coe L, Liberati A: Assessment of methodological quality of primary studies by systematic reviews: results of the meta quality cross sectional study. BMJ. 2005, 330: 1053-10.1136/bmj.38414.515938.8F.CrossRefPubMedPubMedCentral
17.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic review and meta analysis of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34. 10.1016/j.jclinepi.2009.06.006.CrossRefPubMed Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic review and meta analysis of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34. 10.1016/j.jclinepi.2009.06.006.CrossRefPubMed
18.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: PRISMA Group: Reprint-preferred reporting items for systematic review and meta analysis: the PRISMA statement. Phys Ther. 2009, 89: 873-880.PubMed Moher D, Liberati A, Tetzlaff J, Altman DG: PRISMA Group: Reprint-preferred reporting items for systematic review and meta analysis: the PRISMA statement. Phys Ther. 2009, 89: 873-880.PubMed
Metadata
Title
Quality assessment of systematic reviews or meta-analyses of nursing interventions conducted by Korean reviewers
Authors
Hyun-Ju Seo
Kyeong Uoon Kim
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-129

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue