Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 4/2024

23-12-2023 | Original Article

A semantic fidelity interpretable-assisted decision model for lung nodule classification

Authors: Xiangbing Zhan, Huiyun Long, Fangfang Gou, Jia Wu

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 4/2024

Login to get access

Abstract

Purpose

Early diagnosis of lung nodules is important for the treatment of lung cancer patients, existing capsule network-based assisted diagnostic models for lung nodule classification have shown promising prospects in terms of interpretability. However, these models lack the ability to draw features robustly at shallow networks, which in turn limits the performance of the models. Therefore, we propose a semantic fidelity capsule encoding and interpretable (SFCEI)-assisted decision model for lung nodule multi-class classification.

Methods

First, we propose multilevel receptive field feature encoding block to capture multi-scale features of lung nodules of different sizes. Second, we embed multilevel receptive field feature encoding blocks in the residual code-and-decode attention layer to extract fine-grained context features. Integrating multi-scale features and contextual features to form semantic fidelity lung nodule attribute capsule representations, which consequently enhances the performance of the model.

Results

We implemented comprehensive experiments on the dataset (LIDC-IDRI) to validate the superiority of the model. The stratified fivefold cross-validation results show that the accuracy (94.17%) of our method exceeds existing advanced approaches in the multi-class classification of malignancy scores for lung nodules.

Conclusion

The experiments confirm that the methodology proposed can effectively capture the multi-scale features and contextual features of lung nodules. It enhances the capability of shallow structure drawing features in capsule networks, which in turn improves the classification performance of malignancy scores. The interpretable model can support the physicians’ confidence in clinical decision-making.
Literature
15.
go back to reference Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: Proceedings of 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018, vol 2018-Janua, pp 839–847. https://doi.org/10.1109/WACV.2018.00097 Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: Proceedings of 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018, vol 2018-Janua, pp 839–847. https://​doi.​org/​10.​1109/​WACV.​2018.​00097
17.
go back to reference El-Shimy H, Zantout H, Lones M, El Gayar N (2023) A review of capsule networks in medical image analysis. In: El Gayar N, Trentin E, Ravanelli M, Abbas H (eds) Artificial neural networks in pattern recognition. Springer, Cham, pp 65–80CrossRef El-Shimy H, Zantout H, Lones M, El Gayar N (2023) A review of capsule networks in medical image analysis. In: El Gayar N, Trentin E, Ravanelli M, Abbas H (eds) Artificial neural networks in pattern recognition. Springer, Cham, pp 65–80CrossRef
18.
go back to reference Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. Adv Neural Inf Process Syst 30:3857–3867 Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. Adv Neural Inf Process Syst 30:3857–3867
20.
go back to reference Adu K, Yu Y, Cai J, Owusu-Agyemang K, Twumasi BA, Wang X (2021) DHS-CapsNet: Dual horizontal squash capsule networks for lung and colon cancer classification from whole slide histopathological images. Int J Imaging Syst Technol 31:2075–2092. https://doi.org/10.1002/ima.22569CrossRef Adu K, Yu Y, Cai J, Owusu-Agyemang K, Twumasi BA, Wang X (2021) DHS-CapsNet: Dual horizontal squash capsule networks for lung and colon cancer classification from whole slide histopathological images. Int J Imaging Syst Technol 31:2075–2092. https://​doi.​org/​10.​1002/​ima.​22569CrossRef
28.
go back to reference LaLonde R, Torigian D, Bagci U (2020) Encoding visual attributes in capsules for explainable medical diagnoses. Springer, BerlinCrossRef LaLonde R, Torigian D, Bagci U (2020) Encoding visual attributes in capsules for explainable medical diagnoses. Springer, BerlinCrossRef
29.
go back to reference Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hofman EA, Kazerooni EA, MacMahon H, Van Beek EJR, Yankelevitz D, Biancardi AM, Bland PH, Brown MS, Engelmann RM, Laderach GE, Max D, Pais RC, Qing DPY, Roberts RY, Smith AR, Starkey A, Batra P, Caligiuri P, Farooqi A, Gladish GW, Jude CM, Munden RF, Petkovska I, Quint LE, Schwartz LH, Sundaram B, Dodd LE, Fenimore C, Gur D, Petrick N, Freymann J, Kirby J, Hughes B, Vande Casteele A, Gupte S, Sallam M, Heath MD, Kuhn MH, Dharaiya E, Burns R, Fryd DS, Salganicof M, Anand V, Shreter U, Vastagh S, Croft BY, Clarke LP (2011) The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38:915–931. https://doi.org/10.1118/1.3528204CrossRefPubMedPubMedCentral Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hofman EA, Kazerooni EA, MacMahon H, Van Beek EJR, Yankelevitz D, Biancardi AM, Bland PH, Brown MS, Engelmann RM, Laderach GE, Max D, Pais RC, Qing DPY, Roberts RY, Smith AR, Starkey A, Batra P, Caligiuri P, Farooqi A, Gladish GW, Jude CM, Munden RF, Petkovska I, Quint LE, Schwartz LH, Sundaram B, Dodd LE, Fenimore C, Gur D, Petrick N, Freymann J, Kirby J, Hughes B, Vande Casteele A, Gupte S, Sallam M, Heath MD, Kuhn MH, Dharaiya E, Burns R, Fryd DS, Salganicof M, Anand V, Shreter U, Vastagh S, Croft BY, Clarke LP (2011) The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38:915–931. https://​doi.​org/​10.​1118/​1.​3528204CrossRefPubMedPubMedCentral
31.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1–9
Metadata
Title
A semantic fidelity interpretable-assisted decision model for lung nodule classification
Authors
Xiangbing Zhan
Huiyun Long
Fangfang Gou
Jia Wu
Publication date
23-12-2023
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 4/2024
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-03043-5

Other articles of this Issue 4/2024

International Journal of Computer Assisted Radiology and Surgery 4/2024 Go to the issue