Skip to main content
Top
Published in: European Radiology 8/2019

01-08-2019 | Imaging Informatics and Artificial Intelligence

Impact and perceived value of journal reporting guidelines among Radiology authors and reviewers

Authors: Marc Dewey, Deborah Levine, Patrick M. Bossuyt, Herbert Y. Kressel

Published in: European Radiology | Issue 8/2019

Login to get access

Abstract

Objectives

To analyse the author-perceived impact on the final manuscript and perceived value of journal reporting guidelines among Radiology authors and reviewers.

Methods

This survey was conducted among all corresponding authors of original research submissions to Radiology. Separately, we surveyed active Radiology reviewers. Results were analysed using logistic multivariate regression.

Results

Overall, 60% of authors (831/1391) completed the survey. Only 15% (120/821) had used the guideline and checklist when designing the study, significantly more so for PRISMA (55%, 16/29) compared with STARD and STROBE users (17%, 52/310; p < 0.001 and 10%, 46/443; p < 0.001). For 23% of the surveyed manuscripts (189/821), authors used the guidelines when writing the manuscript; these authors more often reported an impact on the final manuscript (i.e. changes in the content, 57%, 107/189) compared to those who used the guideline when submitting the manuscript (35%, 95/272; p < 0.001; OR 0.433, 95% confidence interval [CI] 0.288–0.648, p < 0.001) or when the checklist was requested by the editorial office (17%, 41/240; p < 0.001; OR 0.156, CI 0.097–0.247, p < 0.001). The perceived value of the reporting guideline was rated significantly higher the earlier the authors used the guideline in the research process (p < 0.001). The checklist was used by 77% of reviewers (200/259) some or all of the time; 60% (119/199) said it affected their reviews.

Conclusion

Reporting guidelines had more author-perceived impact on the final manuscript and higher perceived value the earlier they were used, suggesting that there is a need for enhanced education on the use of these guidelines.

Key Points

• Only 15% of authors had used the respective reporting guideline and checklist when designing the study.
• Almost 4 out of 5 Radiology authors and half of reviewers judged the guideline checklists to be useful or very useful.
• Reporting guidelines had more author-perceived impact on manuscripts, i.e. changes that were made in the final manuscript, the earlier authors used them in the research process.
Appendix
Available only for authorised users
Literature
2.
go back to reference Rennie D, Flanagin A (2014) Research on peer review and biomedical publication: furthering the quest to improve the quality of reporting. JAMA 311:1019–1020CrossRefPubMed Rennie D, Flanagin A (2014) Research on peer review and biomedical publication: furthering the quest to improve the quality of reporting. JAMA 311:1019–1020CrossRefPubMed
4.
go back to reference Moher D, Hopewell S, Schulz KF et al (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:c869CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF et al (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:c869CrossRefPubMedPubMedCentral
5.
go back to reference Schulz KF, Altman DG, Moher D; CONSORT Group (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 340:c332 Schulz KF, Altman DG, Moher D; CONSORT Group (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 340:c332
6.
7.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Radiology 226:24–28CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Radiology 226:24–28CrossRefPubMed
8.
go back to reference Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700CrossRefPubMedPubMedCentral
9.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535 Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535
10.
go back to reference von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP; STROBE Initiative (2007) Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 335:806–808 von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP; STROBE Initiative (2007) Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 335:806–808
11.
go back to reference O'Leary JD, Crawford MW (2013) Review article: reporting guidelines in the biomedical literature. Can J Anaesth 60:813–821CrossRefPubMed O'Leary JD, Crawford MW (2013) Review article: reporting guidelines in the biomedical literature. Can J Anaesth 60:813–821CrossRefPubMed
12.
go back to reference Grant SP, Mayo-Wilson E, Melendez-Torres GJ, Montgomery P (2013) Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications. PLoS One 8:e65442CrossRefPubMedPubMedCentral Grant SP, Mayo-Wilson E, Melendez-Torres GJ, Montgomery P (2013) Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications. PLoS One 8:e65442CrossRefPubMedPubMedCentral
13.
go back to reference Cobo E, Cortés J, Ribera JM et al (2011) Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ 343:d6783 Cobo E, Cortés J, Ribera JM et al (2011) Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ 343:d6783
14.
go back to reference Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ (2018) ARRIVE has not ARRIVEd: support for the ARRIVE (animal research: reporting of in vivo experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS One 13:e0197882CrossRefPubMedPubMedCentral Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ (2018) ARRIVE has not ARRIVEd: support for the ARRIVE (animal research: reporting of in vivo experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS One 13:e0197882CrossRefPubMedPubMedCentral
15.
go back to reference Moher D, Jones A, Lepage L; CONSORT Group (Consolidated Standards for Reporting of Trials) (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995 Moher D, Jones A, Lepage L; CONSORT Group (Consolidated Standards for Reporting of Trials) (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995
16.
go back to reference Plint AC, Moher D, Morrison A et al (2006) Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 185:263–267PubMed Plint AC, Moher D, Morrison A et al (2006) Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 185:263–267PubMed
17.
go back to reference Korevaar DA, Wang J, van Enst WA et al (2015) Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 274:781–789CrossRefPubMed Korevaar DA, Wang J, van Enst WA et al (2015) Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 274:781–789CrossRefPubMed
18.
go back to reference Pouwels KB, Widyakusuma NN, Groenwold RH, Hak E (2016) Quality of reporting of confounding remained suboptimal after the STROBE guideline. J Clin Epidemiol 69:217–224CrossRefPubMed Pouwels KB, Widyakusuma NN, Groenwold RH, Hak E (2016) Quality of reporting of confounding remained suboptimal after the STROBE guideline. J Clin Epidemiol 69:217–224CrossRefPubMed
19.
go back to reference Page MJ, Moher D (2017) Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement and extensions: a scoping review. Syst Rev 6:263CrossRefPubMedPubMedCentral Page MJ, Moher D (2017) Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement and extensions: a scoping review. Syst Rev 6:263CrossRefPubMedPubMedCentral
20.
go back to reference Levine D, Kressel HY (2016) Radiology 2016: the care and scientific rigor used to process and evaluate original research manuscripts for publication. Radiology 278:6–10CrossRefPubMed Levine D, Kressel HY (2016) Radiology 2016: the care and scientific rigor used to process and evaluate original research manuscripts for publication. Radiology 278:6–10CrossRefPubMed
21.
go back to reference McInnes MD, Bossuyt PM (2015) Pitfalls of systematic reviews and meta-analyses in imaging research. Radiology 277:13–21CrossRefPubMed McInnes MD, Bossuyt PM (2015) Pitfalls of systematic reviews and meta-analyses in imaging research. Radiology 277:13–21CrossRefPubMed
22.
go back to reference Mannocci A, Saulle R, Colamesta V et al (2015) What is the impact of reporting guidelines on public health journals in Europe? The case of STROBE, CONSORT and PRISMA. J Public Health (Oxf) 37:737–740 Mannocci A, Saulle R, Colamesta V et al (2015) What is the impact of reporting guidelines on public health journals in Europe? The case of STROBE, CONSORT and PRISMA. J Public Health (Oxf) 37:737–740
23.
go back to reference Barnes C, Boutron I, Giraudeau B, Porcher R, Altman DG, Ravaud P (2015) Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Med 13:221CrossRefPubMedPubMedCentral Barnes C, Boutron I, Giraudeau B, Porcher R, Altman DG, Ravaud P (2015) Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Med 13:221CrossRefPubMedPubMedCentral
24.
go back to reference Schueler S, Walther S, Schuetz GM, Schlattmann P, Dewey M (2013) Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (quality assessment of diagnostic accuracy studies included in systematic reviews) items on sensitivity and specificity. Eur Radiol 23:1603–1622CrossRefPubMed Schueler S, Walther S, Schuetz GM, Schlattmann P, Dewey M (2013) Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (quality assessment of diagnostic accuracy studies included in systematic reviews) items on sensitivity and specificity. Eur Radiol 23:1603–1622CrossRefPubMed
26.
go back to reference Sardanelli F, Alì M, Hunink MG, Houssami N, Sconfienza LM, Di Leo G (2018) To share or not to share? Expected pros and cons of data sharing in radiological research. Eur Radiol 28:2328–2335 Sardanelli F, Alì M, Hunink MG, Houssami N, Sconfienza LM, Di Leo G (2018) To share or not to share? Expected pros and cons of data sharing in radiological research. Eur Radiol 28:2328–2335
Metadata
Title
Impact and perceived value of journal reporting guidelines among Radiology authors and reviewers
Authors
Marc Dewey
Deborah Levine
Patrick M. Bossuyt
Herbert Y. Kressel
Publication date
01-08-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 8/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5980-3

Other articles of this Issue 8/2019

European Radiology 8/2019 Go to the issue