Skip to main content
Top
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Methodology

Quality of reporting of systematic reviews published in “evidence-based” Chinese journals

Authors: Jin-long Li, Long Ge, Ji-chun Ma, Qiao-ling Zeng, Lu Yao, Ni An, Jie-xian Ding, Yu-hong Gan, Jin-hui Tian

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

The number of systematic reviews (SRs)/meta-analyses (MAs) has increased dramatically in China over the past decades. However, evaluation of quality of reporting of systematic reviews published has not been undertaken. The objective of this study is to evaluate the quality of reporting of SRs/MAs assessing efficacy and/or harms of clinical interventions published in “evidence-based” Chinese journals.

Methods

Web-based database searches were conducted for the Chinese Journal of Evidence-based Medicine, the Journal of Evidence-Based Medicine, the Chinese Journal of Evidence Based Pediatrics, and the Chinese Journal of Evidence-Based Cardiovascular Medicine. SRs/MAs assessing efficacy and/or harms of clinical interventions were included. The cut-off was December 31st 2011. The PRISMA statement was applied to assess the quality of reporting. Each item was assessed as follows: ‘Yes’ for total compliance, scored ‘1’; ‘partial’ for partial compliance, scored ‘0.5’; and ‘No’ for non-compliance, scored ‘0’. The review was considered to have major flaws if it received a total score of ≤15.0, minor flaws if it received a total score of 15.5 to 21.0, and minimal flaws if it received a total score 21.5 to 27.0. Odds ratios were used for binary variables, and the mean difference was used for continuous variables. Analyses were performed using RevMan 5.0 software.

Results

Overall, 487 SRs/MAs were identified and assessed. The included reviews had medium quality with minor flaws based on PRISMA total scores (range: 8.5–26.0; mean: 19.6 ± 3.3). The stratified analysis showed that SRs/MAs with more than 3 authors, from a university, hospital + university cooperation, multiple affiliations (≥2), and funding have significantly higher quality of reporting of SRs/MAs; 58% of the included reviews were considered to have minor flaws (total score of 15.6 to 21.0). Only 9.6% of reviews were considered to have major flaws. Specific areas needing improvement in reporting include the abstract, protocol and registration, and characteristics of the search.

Conclusions

The reporting of SRs published in “evidence-based” Chinese journals is poor and needs to be improved in order for reviews to be useful. SR authors should use the PRISMA checklist to ensure complete and accurate accounts of their SRs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ: Users’ guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA. 1995, 274: 1800-1804. 10.1001/jama.1995.03530220066035.CrossRefPubMed Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ: Users’ guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA. 1995, 274: 1800-1804. 10.1001/jama.1995.03530220066035.CrossRefPubMed
2.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34. 10.1016/j.jclinepi.2009.06.006.CrossRefPubMed Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34. 10.1016/j.jclinepi.2009.06.006.CrossRefPubMed
3.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surq. 2010, 8 (5): 336-341. 10.1016/j.ijsu.2010.02.007.CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surq. 2010, 8 (5): 336-341. 10.1016/j.ijsu.2010.02.007.CrossRef
4.
go back to reference Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomized controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Rev Esp Salud Publica. 2000, 74 (2): 107-118.CrossRefPubMed Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomized controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Rev Esp Salud Publica. 2000, 74 (2): 107-118.CrossRefPubMed
5.
go back to reference Jadad AR, McQuay HJ: Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. Clin Epidemiol. 1996, 49 (2): 235-243. 10.1016/0895-4356(95)00062-3.CrossRef Jadad AR, McQuay HJ: Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. Clin Epidemiol. 1996, 49 (2): 235-243. 10.1016/0895-4356(95)00062-3.CrossRef
6.
go back to reference Petticrew M: Systematic reviews from astronomy to zoology: myths and misconceptions. BMJ. 2000, 322: 98-101.CrossRef Petticrew M: Systematic reviews from astronomy to zoology: myths and misconceptions. BMJ. 2000, 322: 98-101.CrossRef
7.
go back to reference Willis BH, Quigley M: The assessment of the quality of reporting of meta-analyses in diagnostic research: a systematic review. J BMC Med Res Methodol. 2011, 11: 163-10.1186/1471-2288-11-163.CrossRef Willis BH, Quigley M: The assessment of the quality of reporting of meta-analyses in diagnostic research: a systematic review. J BMC Med Res Methodol. 2011, 11: 163-10.1186/1471-2288-11-163.CrossRef
8.
go back to reference Ma B, Guo J, Qi G, Li H, Peng J, Zhang Y, Ding Y, Yang K: Quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals. PLoS One. 2011, 6 (5): e20185-10.1371/journal.pone.0020185.CrossRefPubMedPubMedCentral Ma B, Guo J, Qi G, Li H, Peng J, Zhang Y, Ding Y, Yang K: Quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals. PLoS One. 2011, 6 (5): e20185-10.1371/journal.pone.0020185.CrossRefPubMedPubMedCentral
9.
go back to reference Shen J, Yao L, Li Y, Clarke M, Gan Q, Li Y, Fan Y, Gou Y, Wang L: Visualization Studies on Evidence-Based Medicine Domain Knowledge (Series 3): visualization for dissemination of evidence-based medicine information. Chin J Evid-based Med. 2011, 11 (8): 858-867. Shen J, Yao L, Li Y, Clarke M, Gan Q, Li Y, Fan Y, Gou Y, Wang L: Visualization Studies on Evidence-Based Medicine Domain Knowledge (Series 3): visualization for dissemination of evidence-based medicine information. Chin J Evid-based Med. 2011, 11 (8): 858-867.
10.
go back to reference Dong JW: International Statistical Classification of Diseases and Related Health Problems. 2008, Beijing: People’s Health Publishing House Dong JW: International Statistical Classification of Diseases and Related Health Problems. 2008, Beijing: People’s Health Publishing House
11.
go back to reference Wang J, Liu Q, Wong CG, Wang Y, Li L, Lei X, Zhang F: Quality assessment for Chinese systematic reviews/meta-analyses in public health. Chin J Evid-based Med. 2010, 12: 1367-1374. Wang J, Liu Q, Wong CG, Wang Y, Li L, Lei X, Zhang F: Quality assessment for Chinese systematic reviews/meta-analyses in public health. Chin J Evid-based Med. 2010, 12: 1367-1374.
12.
go back to reference An N, Xu JF, Ge L, Liang L, Shi XT, Zhou WW, Liu YC, Ma JC, Tian JH: Report quality assessment of systematic reviews or meta-analyses of interventions published in Chinese journal of evidence-based pediatrics. Chin J Evid Bases Pediatr. 2013, 8 (2): 87-92. An N, Xu JF, Ge L, Liang L, Shi XT, Zhou WW, Liu YC, Ma JC, Tian JH: Report quality assessment of systematic reviews or meta-analyses of interventions published in Chinese journal of evidence-based pediatrics. Chin J Evid Bases Pediatr. 2013, 8 (2): 87-92.
Metadata
Title
Quality of reporting of systematic reviews published in “evidence-based” Chinese journals
Authors
Jin-long Li
Long Ge
Ji-chun Ma
Qiao-ling Zeng
Lu Yao
Ni An
Jie-xian Ding
Yu-hong Gan
Jin-hui Tian
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-58

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue