Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

Methodology and reporting quality of reporting guidelines: systematic review

Authors: Xiaoqin Wang, Yaolong Chen, Nan Yang, Wei Deng, Qi Wang, Nan Li, Liang Yao, Dang Wei, Gen Chen, Kehu Yang

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

With increasing attention put on the methodology of reporting guidelines, Moher et al. conducted a review of reporting guidelines up to December 2009. Information gaps appeared on many aspects. Therefore, in 2010, the Guidance for Developers of Health Research Reporting Guidelines was developed. With more than four years passed and a considerable investment was put into reporting guideline development, a large number of new, updated, and expanded reporting guidelines have become available since January 2010. We aimed to systematically review the reporting guidelines published since January 2010, and investigate the application of the Guidance.

Methods

We systematically searched databases including the Cochrane Methodology Register, MEDLINE, and EMBASE, and retrieved EQUATOR and the website (if available) to find reporting guidelines as well as their accompanying documents. We screened the titles and abstracts resulting from searches and extracted data. We focused on the methodology and reporting of the included guidelines, and described information with a series of tables and narrative summaries. Data were summarized descriptively using frequencies, proportions, and medians as appropriate.

Results

Twenty-eight and 32 reporting guidelines were retrieved from databases and EQUATOR network, respectively. Reporting guidelines were designed for a broad spectrum of types of research. A considerable number of reporting guidelines were published and updated in recent years. Methods of initial items were given in 45 (75 %) guidelines. Thirty-eight (63 %) guidelines reported they have reached consensus, and 35 (58 %) described their consensus methods. Only 9 (15 %) guidelines followed the Guidance.

Conclusions

Only few guidelines were developed complying with the Guidance. More attention should be paid to the quality of reporting guidelines.
Appendix
Available only for authorised users
Literature
1.
go back to reference Simera I, Moher D, Hoey J, Schulz KF, Altman DG. A catalogue of reporting guidelines for health research. Eur J Clin Invest. 2010;40(1):35–53.CrossRefPubMed Simera I, Moher D, Hoey J, Schulz KF, Altman DG. A catalogue of reporting guidelines for health research. Eur J Clin Invest. 2010;40(1):35–53.CrossRefPubMed
2.
go back to reference Simera I, Altman DG, Moher D, Schulz KF, Hoey J. Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors. PLoS Med. 2008;5(6):e139.CrossRefPubMedPubMedCentral Simera I, Altman DG, Moher D, Schulz KF, Hoey J. Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors. PLoS Med. 2008;5(6):e139.CrossRefPubMedPubMedCentral
3.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral
4.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Standards for reporting of diagnostic accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Chem. 2003;49(1):1–6.CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Standards for reporting of diagnostic accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Chem. 2003;49(1):1–6.CrossRefPubMed
5.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10):e296.CrossRef von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10):e296.CrossRef
6.
go back to reference Kilkenny C, Browne WJ, Cuthill IC, Altman DG. Animal research: reporting in vivo experiments—the ARRIVE guidelines. J Cereb Blood Flow Metab. 2011;31(4):991–3.CrossRefPubMedPubMedCentral Kilkenny C, Browne WJ, Cuthill IC, Altman DG. Animal research: reporting in vivo experiments—the ARRIVE guidelines. J Cereb Blood Flow Metab. 2011;31(4):991–3.CrossRefPubMedPubMedCentral
7.
go back to reference Shiffman RN, Shekelle P, Overhage JM, Slutsky J, Grimshaw J, Deshpande AM. Standardized reporting of clinical practice guidelines: a proposal from the Conference on Guideline Standardization. Ann Intern Med. 2003;139(6):493–8.CrossRefPubMed Shiffman RN, Shekelle P, Overhage JM, Slutsky J, Grimshaw J, Deshpande AM. Standardized reporting of clinical practice guidelines: a proposal from the Conference on Guideline Standardization. Ann Intern Med. 2003;139(6):493–8.CrossRefPubMed
8.
go back to reference Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Does use of the CONSORT Statement impact the completeness of reporting of randomized controlled trials published in medical journals? A Cochrane review. Syst Rev. 2012;1:60.CrossRefPubMedPubMedCentral Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Does use of the CONSORT Statement impact the completeness of reporting of randomized controlled trials published in medical journals? A Cochrane review. Syst Rev. 2012;1:60.CrossRefPubMedPubMedCentral
10.
go back to reference Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, et al. Describing reporting guidelines for health research: a systematic review. J Clin Epidemiol. 2011;64(7):718–42.CrossRefPubMed Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, et al. Describing reporting guidelines for health research: a systematic review. J Clin Epidemiol. 2011;64(7):718–42.CrossRefPubMed
11.
go back to reference Custer RL, Scarcella JA, Stewart BR. The modified Delphi technique-a rotational modification. 1999. Custer RL, Scarcella JA, Stewart BR. The modified Delphi technique-a rotational modification. 1999.
13.
go back to reference Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRefPubMed Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRefPubMed
14.
go back to reference Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998; 2(3): i–iv, 1–88. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998; 2(3): i–iv, 1–88.
15.
16.
go back to reference Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.CrossRefPubMed Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.CrossRefPubMed
17.
go back to reference Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 2011;6(6):e20476.CrossRefPubMedPubMedCentral Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 2011;6(6):e20476.CrossRefPubMedPubMedCentral
19.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010;63(8):e1–37.CrossRefPubMed Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010;63(8):e1–37.CrossRefPubMed
20.
go back to reference World Health Organization. WHO handbook for guideline development. Geneva: World Health Organization; 2011. World Health Organization. WHO handbook for guideline development. Geneva: World Health Organization; 2011.
21.
go back to reference Drazen JM, Van Der Weyden MB, Sahni P, Rosenberg J, Marusic A, Laine C, et al. Uniform format for disclosure of competing interests in ICMJE journals. N Engl J Med. 2009;361(19):1896–7.CrossRefPubMed Drazen JM, Van Der Weyden MB, Sahni P, Rosenberg J, Marusic A, Laine C, et al. Uniform format for disclosure of competing interests in ICMJE journals. N Engl J Med. 2009;361(19):1896–7.CrossRefPubMed
Metadata
Title
Methodology and reporting quality of reporting guidelines: systematic review
Authors
Xiaoqin Wang
Yaolong Chen
Nan Yang
Wei Deng
Qi Wang
Nan Li
Liang Yao
Dang Wei
Gen Chen
Kehu Yang
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-015-0069-z

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue