Skip to main content
Top
Published in: World Journal of Urology 5/2019

01-05-2019 | Original Article

The reporting quality of studies of diagnostic accuracy in the urologic literature

Authors: Daniel W. Smith, Shreyas Gandhi, Philipp Dahm

Published in: World Journal of Urology | Issue 5/2019

Login to get access

Abstract

Introduction

High-quality evidence regarding questions of diagnostic accuracy relies on transparent reporting of study results. The quality of reporting for such studies in the urologic literature is unknown.

Methods

In accordance with an a priori protocol, we systematically searched for all articles on diagnostic accuracy studies published in four major urologic journals in 2015. Using the 2015 STAndards for Reporting Diagnostic accuracy studies (STARD) checklist, two of us independently abstracted data. For each article, we calculated STARD summary scores (scale of 0–30, with higher scores reflecting higher-quality reporting). We compared scores by journal, topic, and sample size.

Results

We screened 819 references of which 61 met inclusion criteria. Nearly two-thirds of studies (39/61%; 63.9%) addressed prostate cancer diagnosis or staging; less than one in ten (6/61%; 9.8%) was conducted in non-oncological disease settings. The major focus for the investigation of new index tests lay in imaging modalities (33/61%; 54.1%); over half of these imaging studies addressed magnetic resonance imaging (18/61%; 29.5%). The average STARD score was 18.9 ± 2.4 (range 12–24). Six criteria had poor reporting compliance and were met by less than 20% of studies. We found no association between reporting quality and topic, journal or study size.

Conclusions

The reporting quality of studies of diagnostic accuracy appears modest and independent of topic, journal or study size. There is an urgent need for greater awareness for the reporting quality of these studies among readers, editors, and investigators to raise evidentiary standards on issues of diagnosis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Simera I, Altman DG (2009) ACP journal club. editorial: writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Ann Intern Med 151:JC2-2–JC2-3CrossRef Simera I, Altman DG (2009) ACP journal club. editorial: writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Ann Intern Med 151:JC2-2–JC2-3CrossRef
2.
go back to reference Schulz KF, Altman DG, Moher D et al (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med 7:e1000251CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D et al (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med 7:e1000251CrossRefPubMedPubMedCentral
3.
go back to reference Narayan VM, Cone EB, Smith D et al (2016) Improved reporting of randomized controlled trials in the urologic literature. Eur Urol 70:1044–1049CrossRefPubMed Narayan VM, Cone EB, Smith D et al (2016) Improved reporting of randomized controlled trials in the urologic literature. Eur Urol 70:1044–1049CrossRefPubMed
4.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–12CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–12CrossRefPubMed
5.
go back to reference Scales CD Jr, Dahm P, Sultan S et al (2008) How to use an article about a diagnostic test. J Urol 180:469–476CrossRefPubMed Scales CD Jr, Dahm P, Sultan S et al (2008) How to use an article about a diagnostic test. J Urol 180:469–476CrossRefPubMed
6.
7.
go back to reference Han JL, Gandhi S, Bockoven CG et al (2017) The landscape of systematic reviews in urology (1998–2015): an assessment of methodological quality. BJU Int 119:638–649CrossRefPubMed Han JL, Gandhi S, Bockoven CG et al (2017) The landscape of systematic reviews in urology (1998–2015): an assessment of methodological quality. BJU Int 119:638–649CrossRefPubMed
8.
go back to reference Tseng TY, Breau RH, Fesperman SF et al (2008) Evaluating the evidence: the methodological and reporting quality of comparative observational studies of surgical interventions in urological publications. BJU Int 103:1026–1031CrossRefPubMed Tseng TY, Breau RH, Fesperman SF et al (2008) Evaluating the evidence: the methodological and reporting quality of comparative observational studies of surgical interventions in urological publications. BJU Int 103:1026–1031CrossRefPubMed
9.
go back to reference Lokker C, Haynes RB, Wilczynski NL et al (2011) Retrieval of diagnostic and treatment studies for clinical use through PubMed and PubMed’s Clinical Queries filters. JAMIA 18:652–659PubMed Lokker C, Haynes RB, Wilczynski NL et al (2011) Retrieval of diagnostic and treatment studies for clinical use through PubMed and PubMed’s Clinical Queries filters. JAMIA 18:652–659PubMed
12.
go back to reference McGinn T, Wyer PC, Newman TB et al (2004) Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic). CMAJ 171:1369–1373CrossRefPubMedPubMedCentral McGinn T, Wyer PC, Newman TB et al (2004) Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic). CMAJ 171:1369–1373CrossRefPubMedPubMedCentral
13.
go back to reference Ahmed HU, El-Shater Bosaily A, Brown LC et al (2017) Diagnostic accuracy of multi-parametric MRI and TRUS biopsy in prostate cancer (PROMIS): a paired validating confirmatory study. Lancet 389:815–822CrossRef Ahmed HU, El-Shater Bosaily A, Brown LC et al (2017) Diagnostic accuracy of multi-parametric MRI and TRUS biopsy in prostate cancer (PROMIS): a paired validating confirmatory study. Lancet 389:815–822CrossRef
14.
go back to reference Korevaar DA, Wang J, van Enst WA et al (2015) Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 274:781–789CrossRefPubMed Korevaar DA, Wang J, van Enst WA et al (2015) Reporting diagnostic accuracy studies: some improvements after 10 years of STARD. Radiology 274:781–789CrossRefPubMed
15.
go back to reference Gallo L, Hua N, Mercuri M et al (2017) Adherence to standards for reporting diagnostic accuracy in emergency medicine research. Acad Emerg Med 24:914–919CrossRefPubMed Gallo L, Hua N, Mercuri M et al (2017) Adherence to standards for reporting diagnostic accuracy in emergency medicine research. Acad Emerg Med 24:914–919CrossRefPubMed
16.
go back to reference Toews I, Binder N, Wolff RF et al (2017) Guidance in author instructions of hematology and oncology journals: a cross sectional and longitudinal study. PLoS One 12:e0176489CrossRefPubMedPubMedCentral Toews I, Binder N, Wolff RF et al (2017) Guidance in author instructions of hematology and oncology journals: a cross sectional and longitudinal study. PLoS One 12:e0176489CrossRefPubMedPubMedCentral
17.
go back to reference Esserman LJ, Thompson IM, Reid B (2013) Overdiagnosis and overtreatment in cancer: an opportunity for improvement. JAMA 310:797–798CrossRefPubMed Esserman LJ, Thompson IM, Reid B (2013) Overdiagnosis and overtreatment in cancer: an opportunity for improvement. JAMA 310:797–798CrossRefPubMed
18.
go back to reference Macleod MR, Michie S, Roberts I et al (2014) Biomedical research: increasing value, reducing waste. Lancet 383:101–104CrossRef Macleod MR, Michie S, Roberts I et al (2014) Biomedical research: increasing value, reducing waste. Lancet 383:101–104CrossRef
19.
go back to reference Korevaar DA, Hooft L, Askie LM et al (2017) Facilitating prospective registration of diagnostic accuracy studies: a STARD initiative. Clin Chem 63:1331–1341CrossRefPubMed Korevaar DA, Hooft L, Askie LM et al (2017) Facilitating prospective registration of diagnostic accuracy studies: a STARD initiative. Clin Chem 63:1331–1341CrossRefPubMed
20.
go back to reference Kunath F, Grobe HR, Rucker G et al (2012) Do journals publishing in the field of urology endorse reporting guidelines? A survey of author instructions. Urol Int 88:54–59CrossRefPubMed Kunath F, Grobe HR, Rucker G et al (2012) Do journals publishing in the field of urology endorse reporting guidelines? A survey of author instructions. Urol Int 88:54–59CrossRefPubMed
Metadata
Title
The reporting quality of studies of diagnostic accuracy in the urologic literature
Authors
Daniel W. Smith
Shreyas Gandhi
Philipp Dahm
Publication date
01-05-2019
Publisher
Springer Berlin Heidelberg
Published in
World Journal of Urology / Issue 5/2019
Print ISSN: 0724-4983
Electronic ISSN: 1433-8726
DOI
https://doi.org/10.1007/s00345-018-2446-9

Other articles of this Issue 5/2019

World Journal of Urology 5/2019 Go to the issue