Skip to main content
Top
Published in: Systematic Reviews 1/2012

Open Access 01-12-2012 | Protocol

Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol

Authors: Larissa Shamseer, Adrienne Stevens, Becky Skidmore, Lucy Turner, Douglas G Altman, Allison Hirst, John Hoey, Anita Palepu, Iveta Simera, Kenneth Schulz, David Moher

Published in: Systematic Reviews | Issue 1/2012

Login to get access

Abstract

Background

Reporting of health research is often inadequate and incomplete. Complete and transparent reporting is imperative to enable readers to assess the validity of research findings for use in healthcare and policy decision-making. To this end, many guidelines, aimed at improving the quality of health research reports, have been developed for reporting a variety of research types. Despite efforts, many reporting guidelines are underused. In order to increase their uptake, evidence of their effectiveness is important and will provide authors, peer reviewers and editors with an important resource for use and implementation of pertinent guidance. The objective of this study was to assess whether endorsement of reporting guidelines by journals influences the completeness of reporting of health studies.

Methods

Guidelines providing a minimum set of items to guide authors in reporting a specific type of research, developed with explicit methodology, and using a consensus process will be identified from an earlier systematic review and from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network’s reporting guidelines library. MEDLINE, EMBASE, the Cochrane Methodology Register and Scopus will be searched for evaluations of those reporting guidelines; relevant evaluations from the recently conducted CONSORT systematic review will also be included. Single data extraction with 10% verification of study characteristics, 20% of outcomes and complete verification of aspects of study validity will be carried out. We will include evaluations of reporting guidelines that assess the completeness of reporting: (1) before and after journal endorsement, and/or (2) between endorsing and non-endorsing journals. For a given guideline, analyses will be conducted for individual and the total sum of items. When possible, standard, pooled effects with 99% confidence intervals using random effects models will be calculated.

Discussion

Evidence on which guidelines have been evaluated and which are associated with improved completeness of reporting is important for various stakeholders, including editors who consider which guidelines to endorse in their journal editorial policies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365: 1159-1162. 10.1016/S0140-6736(05)71879-1.CrossRefPubMed Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365: 1159-1162. 10.1016/S0140-6736(05)71879-1.CrossRefPubMed
2.
go back to reference Chan S, Bhandari M: The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg Am. 2007, 89: 1970-1978. 10.2106/JBJS.F.01591.CrossRefPubMed Chan S, Bhandari M: The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg Am. 2007, 89: 1970-1978. 10.2106/JBJS.F.01591.CrossRefPubMed
3.
go back to reference Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral
4.
go back to reference Smith BA, Lee HJ, Lee JH, Choi M, Jones DE, Bausell RB, Broome ME: Quality of reporting randomized controlled trials (RCTs) in the nursing literature: application of the Consolidated Standards of Reporting Trials (CONSORT). Nurs Outlook. 2008, 56: 31-37. 10.1016/j.outlook.2007.09.002.CrossRefPubMed Smith BA, Lee HJ, Lee JH, Choi M, Jones DE, Bausell RB, Broome ME: Quality of reporting randomized controlled trials (RCTs) in the nursing literature: application of the Consolidated Standards of Reporting Trials (CONSORT). Nurs Outlook. 2008, 56: 31-37. 10.1016/j.outlook.2007.09.002.CrossRefPubMed
5.
go back to reference Yesupriya A, Evangelou E, Kavvoura F, Patsopoulos N, Clyne M, Walsh M, Lin BK, Yu W, Gwinn M, Ioannidis JP, Khoury MJ: Reporting of human genome epidemiology (HuGE) association studies: an empirical assessment. BMC Med Res Methodol. 2008, 8: 31-10.1186/1471-2288-8-31.CrossRefPubMedPubMedCentral Yesupriya A, Evangelou E, Kavvoura F, Patsopoulos N, Clyne M, Walsh M, Lin BK, Yu W, Gwinn M, Ioannidis JP, Khoury MJ: Reporting of human genome epidemiology (HuGE) association studies: an empirical assessment. BMC Med Res Methodol. 2008, 8: 31-10.1186/1471-2288-8-31.CrossRefPubMedPubMedCentral
6.
go back to reference Zhang D, Yin P, Freemantle N, Jordan R, Zhong N, Cheng KK: An assessment of the quality of randomised controlled trials conducted in China. Trials. 2008, 9: 22-10.1186/1745-6215-9-22.CrossRefPubMedPubMedCentral Zhang D, Yin P, Freemantle N, Jordan R, Zhong N, Cheng KK: An assessment of the quality of randomised controlled trials conducted in China. Trials. 2008, 9: 22-10.1186/1745-6215-9-22.CrossRefPubMedPubMedCentral
7.
go back to reference Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med. 2010, 7: e1000217-10.1371/journal.pmed.1000217.CrossRefPubMedPubMedCentral Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med. 2010, 7: e1000217-10.1371/journal.pmed.1000217.CrossRefPubMedPubMedCentral
8.
go back to reference Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, Schulz KF, Miller D, Simera I, Grimshaw J, Hoey J: Describing reporting guidelines for health research: a systematic review. J Clin Epidemiol. 2011, 64: 718-742. 10.1016/j.jclinepi.2010.09.013.CrossRefPubMed Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, Schulz KF, Miller D, Simera I, Grimshaw J, Hoey J: Describing reporting guidelines for health research: a systematic review. J Clin Epidemiol. 2011, 64: 718-742. 10.1016/j.jclinepi.2010.09.013.CrossRefPubMed
10.
go back to reference Moher D: personal communication. 2011, Barriers and facilitators to CONSORT endorsement Moher D: personal communication. 2011, Barriers and facilitators to CONSORT endorsement
11.
go back to reference Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AHS, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, Safe Surgery Saves Lives Study Group: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360 (5): 491-499. 10.1056/NEJMsa0810119.CrossRefPubMed Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AHS, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, Safe Surgery Saves Lives Study Group: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360 (5): 491-499. 10.1056/NEJMsa0810119.CrossRefPubMed
12.
go back to reference Simera I, Altman DG, Moher D, Schulz KF, Hoey J: Guidelines for reporting health research: the EQUATOR Network’s survey of guideline authors. PLoS Med. 2008, 5: e139-10.1371/journal.pmed.0050139.CrossRefPubMedPubMedCentral Simera I, Altman DG, Moher D, Schulz KF, Hoey J: Guidelines for reporting health research: the EQUATOR Network’s survey of guideline authors. PLoS Med. 2008, 5: e139-10.1371/journal.pmed.0050139.CrossRefPubMedPubMedCentral
13.
go back to reference Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials, the CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.1996.03540080059030.CrossRefPubMed Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials, the CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.1996.03540080059030.CrossRefPubMed
14.
go back to reference Moher D, Schulz K, Altman D, CONSORT: The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. BMC Med Res Methodol. 2001, 1: 2-10.1186/1471-2288-1-2.CrossRefPubMedPubMedCentral Moher D, Schulz K, Altman D, CONSORT: The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. BMC Med Res Methodol. 2001, 1: 2-10.1186/1471-2288-1-2.CrossRefPubMedPubMedCentral
15.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gøtzsche PC, Lang T, CONSORT GROUP (Consolidated Standards of Reporting Trials): The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gøtzsche PC, Lang T, CONSORT GROUP (Consolidated Standards of Reporting Trials): The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed
16.
go back to reference Schulz K, Altman D, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-10.1136/bmj.c332.CrossRefPubMedPubMedCentral Schulz K, Altman D, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-10.1136/bmj.c332.CrossRefPubMedPubMedCentral
17.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
18.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185 (5): 263-267.PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185 (5): 263-267.PubMed
19.
go back to reference Moher D, Plint AC, Altman DG, Schulz KF, Kober T, Galloway EK, Weeks L, Dias S: Consolidated Standards of Reporting Trials (CONSORT) and the Quality of Reporting of Randomized Controlled Trials (Protocol). 2010, Cochrane Database of Systematic Reviews Moher D, Plint AC, Altman DG, Schulz KF, Kober T, Galloway EK, Weeks L, Dias S: Consolidated Standards of Reporting Trials (CONSORT) and the Quality of Reporting of Randomized Controlled Trials (Protocol). 2010, Cochrane Database of Systematic Reviews
20.
go back to reference Turner L, Moher D, Shamseer L, Weeks L, Peters J, Plint A, Altman DG, Schulz KF: The influence of CONSORT on the quality of reporting of randomized controlled trials: an updated review. Trials. 2011, 12 (suppl 1): A47-10.1186/1745-6215-12-S1-A47.CrossRefPubMedCentral Turner L, Moher D, Shamseer L, Weeks L, Peters J, Plint A, Altman DG, Schulz KF: The influence of CONSORT on the quality of reporting of randomized controlled trials: an updated review. Trials. 2011, 12 (suppl 1): A47-10.1186/1745-6215-12-S1-A47.CrossRefPubMedCentral
21.
go back to reference Smidt N, Rutjes AWS, Van der Windt D, Ostelo R, Bossuyt PM, Reitsma JB, Bouter LM, de Vet HC: The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology. 2006, 67: 792-797. 10.1212/01.wnl.0000238386.41398.30.CrossRefPubMed Smidt N, Rutjes AWS, Van der Windt D, Ostelo R, Bossuyt PM, Reitsma JB, Bouter LM, de Vet HC: The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology. 2006, 67: 792-797. 10.1212/01.wnl.0000238386.41398.30.CrossRefPubMed
22.
go back to reference Prady SL, Richmond SJ, Morton VM, MacPherson H: A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008, 3: e1577-10.1371/journal.pone.0001577.CrossRefPubMedPubMedCentral Prady SL, Richmond SJ, Morton VM, MacPherson H: A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008, 3: e1577-10.1371/journal.pone.0001577.CrossRefPubMedPubMedCentral
23.
go back to reference Rajkumar SV, Harousseau J, Durie B, Anderson KC, Dimopoulos M, Kyle R, Blade J, Richardson P, Orlowski R, Siegel D, Jagannath S, Facon T, Avet-Loiseau H, Lonial S, Palumbo A, Zonder J, Ludwig H, Vesole D, Sezer O, Munshi NC, San Miguel J, International Myeloma Workshop Consensus Panel 1: Consensus recommendations for the uniform reporting of clinical trials: report of the International Myeloma Workshop Consensus Panel 1. Blood. 2011, 117: 4691-4695. 10.1182/blood-2010-10-299487.CrossRefPubMedPubMedCentral Rajkumar SV, Harousseau J, Durie B, Anderson KC, Dimopoulos M, Kyle R, Blade J, Richardson P, Orlowski R, Siegel D, Jagannath S, Facon T, Avet-Loiseau H, Lonial S, Palumbo A, Zonder J, Ludwig H, Vesole D, Sezer O, Munshi NC, San Miguel J, International Myeloma Workshop Consensus Panel 1: Consensus recommendations for the uniform reporting of clinical trials: report of the International Myeloma Workshop Consensus Panel 1. Blood. 2011, 117: 4691-4695. 10.1182/blood-2010-10-299487.CrossRefPubMedPubMedCentral
24.
go back to reference Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952. 10.1016/j.jclinepi.2008.10.012.CrossRefPubMed Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952. 10.1016/j.jclinepi.2008.10.012.CrossRefPubMed
26.
go back to reference Cochrane Effective Practice and Organisation of Care Review Group (EPOC): Data Collection Checklist. 2002 Cochrane Effective Practice and Organisation of Care Review Group (EPOC): Data Collection Checklist. 2002
27.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, STROBE Initiative: Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007, 335: 806-808. 10.1136/bmj.39335.541782.AD.CrossRefPubMedPubMedCentral von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, STROBE Initiative: Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007, 335: 806-808. 10.1136/bmj.39335.541782.AD.CrossRefPubMedPubMedCentral
28.
go back to reference Wells GB, Shea B, O'Connell D, Peterson J, Welch V, Losos M, Tugwell P: The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2000, University of Liverpool, Liverpool, UK Wells GB, Shea B, O'Connell D, Peterson J, Welch V, Losos M, Tugwell P: The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 2000, University of Liverpool, Liverpool, UK
29.
go back to reference Higgins JPT, Altman DG: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, The Cochrane Collaboration, 187-242. 510CrossRef Higgins JPT, Altman DG: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, The Cochrane Collaboration, 187-242. 510CrossRef
30.
go back to reference Deeks JJ, Higgins JPT, Altman DG: Analysing data and undertaking meta-analyses. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2011, The Cochrane Collaboration, 510 Deeks JJ, Higgins JPT, Altman DG: Analysing data and undertaking meta-analyses. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2011, The Cochrane Collaboration, 510
31.
go back to reference Review Manager (RevMan). 2011; 5.1. The Cochrane Collaboration. Review Manager (RevMan). 2011; 5.1. The Cochrane Collaboration.
32.
go back to reference Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-analysis. 2005 Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-analysis. 2005
33.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009, 339: b2535-10.1136/bmj.b2535.CrossRefPubMedPubMedCentral
34.
go back to reference Hirst A, Altman DG: Are peer reviewers encouraged to use reporting guidelines? A survey of 116 health research journals. PLoS ONE. 2012, 7 (4): e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral Hirst A, Altman DG: Are peer reviewers encouraged to use reporting guidelines? A survey of 116 health research journals. PLoS ONE. 2012, 7 (4): e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral
Metadata
Title
Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol
Authors
Larissa Shamseer
Adrienne Stevens
Becky Skidmore
Lucy Turner
Douglas G Altman
Allison Hirst
John Hoey
Anita Palepu
Iveta Simera
Kenneth Schulz
David Moher
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2012
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-1-24

Other articles of this Issue 1/2012

Systematic Reviews 1/2012 Go to the issue