Skip to main content
Top
Published in:

Open Access 01-12-2024 | Original Article

Contrast-enhanced US Bosniak Classification: intra- and inter-rater agreement, confounding features, and diagnostic performance

Authors: Dong-dong Jin, Bo-wen Zhuang, Ke Lin, Nan Zhang, Bin Qiao, Xiao-yan Xie, Xiao-hua Xie, Yan Wang

Published in: Insights into Imaging | Issue 1/2024

Login to get access

Abstract

Background

The contrast-enhanced US (CEUS) Bosniak classification, proposed by the European Federation for Ultrasound in Medicine and Biology (EFSUMB) in 2020, predicts malignancy in cystic renal masses (CRMs). However, intra- and inter-rater reproducibility for CEUS features has not been well investigated.

Purpose

To explore intra- and inter-rater agreement for US features, identify confounding features, and assess the diagnostic performance of CEUS Bosniak classification.

Materials and methods

This retrospective study included patients with complex CRMs who underwent CEUS examination from January 2013 to August 2023. Radiologists (3 experts and 3 novices) evaluated calcification, echogenic content, wall, septa, and internal nodules of CRMs using CEUS Bosniak classification. Intra- and inter-rater agreements were assessed using the Gwet agreement coefficient (Gwet’s AC). Linear regression identified features associated with discrepancies in Bosniak category assignment. Diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC).

Results

A total of 103 complex CRMs were analyzed in 103 patients (mean age, 50 ± 15 years; 66 males). Intra-rater agreement for the Bosniak category was substantial to almost perfect (Gwet’s AC 0.73–0.87). Inter-rater agreement was substantial for the Bosniak category (Gwet’s AC 0.75) and moderate to almost perfect for US features (Gwet’s AC 0.44–0.94). Nodule variation (i.e., absence vs. obtuse margin vs. acute margin) explained 84% of the variability in the Bosniak category assignment. CEUS Bosniak classification showed good diagnostic performance, with AUCs ranging from 0.78 to 0.90 for each rater.

Conclusions

CEUS Bosniak classification demonstrated substantial intra- and inter-rater reproducibility and good diagnostic performance in predicting the malignancy potential of CRMs. Nodule variations significantly predicted differences in Bosniak category assignments.

Critical relevance statement

Contrast-enhanced US Bosniak classification reliably predicts malignancy in cystic renal masses, demonstrating substantial reproducibility and diagnostic accuracy. This improves clinical decision-making and patient management.

Key Points

  • Intra- and inter-rater reproducibility for contrast-enhance US features for Bosniak classification have not been well investigated.
  • Substantial inter-rater agreements for the Bosniak category and variable agreements for determining imaging features were found.
  • Contrast-enhanced US Bosniak classification is reproducible and has good diagnostic performance for predicting malignancy in cystic renal masses.

Graphical Abstract

Appendix
Available only for authorised users
Literature
14.
20.
go back to reference Münch F, Silivasan EIE, Spiesecke P et al (2023) Intra- and interobserver study investigating the adapted EFSUMB Bosniak Cyst Categorization Proposed for Contrast-Enhanced Ultrasound (CEUS) in 2020. Ultraschall Med. a-2048-a-6383. https://doi.org/10.1055/a-2048-6383 Münch F, Silivasan EIE, Spiesecke P et al (2023) Intra- and interobserver study investigating the adapted EFSUMB Bosniak Cyst Categorization Proposed for Contrast-Enhanced Ultrasound (CEUS) in 2020. Ultraschall Med. a-2048-a-6383. https://​doi.​org/​10.​1055/​a-2048-6383
24.
go back to reference Gwet K (2014) Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters. 4th edn. Advanced Analytics, Gaithersburg, MD Gwet K (2014) Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters. 4th edn. Advanced Analytics, Gaithersburg, MD
26.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed
Metadata
Title
Contrast-enhanced US Bosniak Classification: intra- and inter-rater agreement, confounding features, and diagnostic performance
Authors
Dong-dong Jin
Bo-wen Zhuang
Ke Lin
Nan Zhang
Bin Qiao
Xiao-yan Xie
Xiao-hua Xie
Yan Wang
Publication date
01-12-2024
Publisher
Springer Vienna
Published in
Insights into Imaging / Issue 1/2024
Electronic ISSN: 1869-4101
DOI
https://doi.org/10.1186/s13244-024-01858-7