Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 11/2020

01-11-2020 | Artificial Intelligence | Original Article

Artificial intelligence in detection and segmentation of internal auditory canal and its nerves using deep learning techniques

Authors: S. Jeevakala, C. Sreelakshmi, Keerthi Ram, Rajeswaram Rangasami, Mohanasankar Sivaprakasam

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 11/2020

Login to get access

Abstract

Purpose

Artificial intelligence (AI) in medical imaging is a burgeoning topic that involves the interpretation of complex image structures. The recent advancements in deep learning techniques increase the computational powers to extract vital features without human intervention. The automatic detection and segmentation of subtle tissue such as the internal auditory canal (IAC) and its nerves is a challenging task, and it can be improved using deep learning techniques.

Methods

The main scope of this research is to present an automatic method to detect and segment the IAC and its nerves like the facial nerve, cochlear nerve, inferior vestibular nerve, and superior vestibular nerve. To address this issue, we propose a Mask R-CNN approach driven with U-net to detect and segment the IAC and its nerves. The Mask R-CNN with its backbone network of the RESNET50 model learns a background-based localization policy to produce an actual bounding box of the IAC. Furthermore, the U-net segments the structure related information of IAC and its nerves by learning its features.

Results

The proposed method was experimented on clinical datasets of 50 different patients including adults and children. The localization of IAC using Mask R-CNN was evaluated using Intersection of Union (IoU), and segmentation of IAC and its nerves was evaluated using Dice similarity coefficient.

Conclusions

The localization result shows that mean IoU of RESNET50, RESNET101 are 0.79 and 0.74, respectively. The Dice similarity coefficient of IAC and its nerves using region growing, PSO and U-net method scored 92%, 94%, and 96%, respectively. The result shows that the proposed method outperform better in localization and segmentation of IAC and its nerves. Thus, AI aids the radiologists in making the right decisions as the localization and segmentation of IAC is accurate.
Literature
1.
go back to reference Jeevakala S, Therese AB, Rangasami R (2018) A novel segmentation of cochlear nerve using region growing algorithm. Biomed Signal Process Control 39:117–129CrossRef Jeevakala S, Therese AB, Rangasami R (2018) A novel segmentation of cochlear nerve using region growing algorithm. Biomed Signal Process Control 39:117–129CrossRef
2.
go back to reference Ergen B, Baykara M, Polat C (2014) An investigation on magnetic imaging findings of the inner ear: a relationship between the internal auditory canal, its nerves and benign paroxysmal positional vertigo. Biomed Signal Process Control 9:14–18 CrossRef Ergen B, Baykara M, Polat C (2014) An investigation on magnetic imaging findings of the inner ear: a relationship between the internal auditory canal, its nerves and benign paroxysmal positional vertigo. Biomed Signal Process Control 9:14–18 CrossRef
3.
go back to reference Jeevakala S, Therese AB (2018) Segmentation of cochlear nerve based on particle swarm optimization method. In: Nandi AK, Sujatha N, Menaka R, Alex JSR (eds) Computational signal processing and analysis. Springer, Singapore, pp 203–210CrossRef Jeevakala S, Therese AB (2018) Segmentation of cochlear nerve based on particle swarm optimization method. In: Nandi AK, Sujatha N, Menaka R, Alex JSR (eds) Computational signal processing and analysis. Springer, Singapore, pp 203–210CrossRef
4.
go back to reference Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448
5.
go back to reference Baumgartner CF, Kamnitsas K, Matthew J, Smith S, Kainz B, Rueckert D (2016) Real-time standard scan plane detection and localisation in fetal ultrasound using fully convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 203–211 Baumgartner CF, Kamnitsas K, Matthew J, Smith S, Kainz B, Rueckert D (2016) Real-time standard scan plane detection and localisation in fetal ultrasound using fully convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 203–211
6.
go back to reference Baumgartner CF, Kamnitsas K, Matthew J, Fletcher TP, Smith S, Koch LM, Rueckert D (2017) SonoNet: real-time detection and localisation of fetal standard scan planes in freehand ultrasound. IEEE Trans Med Imaging 36(11):2204–2215CrossRefPubMedCentral Baumgartner CF, Kamnitsas K, Matthew J, Fletcher TP, Smith S, Koch LM, Rueckert D (2017) SonoNet: real-time detection and localisation of fetal standard scan planes in freehand ultrasound. IEEE Trans Med Imaging 36(11):2204–2215CrossRefPubMedCentral
7.
go back to reference Chen H, Ni D, Yang X, Li S, Heng PA (2014) Fetal abdominal standard plane localization through representation learning with knowledge transfer. In: International workshop on machine learning in medical imaging. Springer, Cham, pp 125–132 Chen H, Ni D, Yang X, Li S, Heng PA (2014) Fetal abdominal standard plane localization through representation learning with knowledge transfer. In: International workshop on machine learning in medical imaging. Springer, Cham, pp 125–132
8.
go back to reference Chen H, Wu L, Dou Q, Qin J, Li S, Cheng JZ, Heng PA (2017) Ultrasound standard plane detection using a composite neural network framework. IEEE Trans Cybernet 47(6):1576–1586CrossRef Chen H, Wu L, Dou Q, Qin J, Li S, Cheng JZ, Heng PA (2017) Ultrasound standard plane detection using a composite neural network framework. IEEE Trans Cybernet 47(6):1576–1586CrossRef
9.
go back to reference Dezaki FT, Dhungel N, Abdi AH, Luong C, Tsang T, Jue J, Abolmaesumi P (2017) Deep residual recurrent neural networks for characterisation of cardiac cycle phase from echocardiograms. In: Cardoso J, Arbel T, Carneiro G, Syeda-Mahmood T, Tavares JMRS, Moradi M, Bradley A, Greenspan H, Papa JP, Madabushi A, Nascimento JC, Cardoso JS, Belagiannis V, Lu Z (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Cham, pp 100–108CrossRef Dezaki FT, Dhungel N, Abdi AH, Luong C, Tsang T, Jue J, Abolmaesumi P (2017) Deep residual recurrent neural networks for characterisation of cardiac cycle phase from echocardiograms. In: Cardoso J, Arbel T, Carneiro G, Syeda-Mahmood T, Tavares JMRS, Moradi M, Bradley A, Greenspan H, Papa JP, Madabushi A, Nascimento JC, Cardoso JS, Belagiannis V, Lu Z (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Cham, pp 100–108CrossRef
10.
go back to reference Sofka M, Milletari F, Jia J, Rothberg A (2017) Fully convolutional regression network for accurate detection of measurement points. In: Cardoso J, Arbel T, Carneiro G, Syeda-Mahmood T, Tavares JMRS, Moradi M, Bradley A, Greenspan H, Papa JP, Madabushi A, Nascimento JC, Cardoso JS, Belagiannis V, Lu Z (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Cham, pp 258–266CrossRef Sofka M, Milletari F, Jia J, Rothberg A (2017) Fully convolutional regression network for accurate detection of measurement points. In: Cardoso J, Arbel T, Carneiro G, Syeda-Mahmood T, Tavares JMRS, Moradi M, Bradley A, Greenspan H, Papa JP, Madabushi A, Nascimento JC, Cardoso JS, Belagiannis V, Lu Z (eds) Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Cham, pp 258–266CrossRef
11.
go back to reference Ghesu FC, Georgescu B, Mansi T, Neumann D, Hornegger J, Comaniciu D (2016) An artificial agent for anatomical landmark detection in medical images. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 229–237 Ghesu FC, Georgescu B, Mansi T, Neumann D, Hornegger J, Comaniciu D (2016) An artificial agent for anatomical landmark detection in medical images. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 229–237
12.
go back to reference Ngo TA, Lu Z, Carneiro G (2017) Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med Image Anal 35:159–171CrossRefPubMedCentral Ngo TA, Lu Z, Carneiro G (2017) Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med Image Anal 35:159–171CrossRefPubMedCentral
13.
go back to reference Ma Y, Wang L, Ma Y, Dong M, Du S, Sun X (2016) An SPCNN-GVF-based approach for the automatic segmentation of left ventricle in cardiac cine MR images. Int J Comput Assisted Radiol Surg 11(11):1951–1964CrossRef Ma Y, Wang L, Ma Y, Dong M, Du S, Sun X (2016) An SPCNN-GVF-based approach for the automatic segmentation of left ventricle in cardiac cine MR images. Int J Comput Assisted Radiol Surg 11(11):1951–1964CrossRef
14.
go back to reference Kompella G, Antico M, Sasazawa F, Jeevakala S, Ram K, Fontanarosa D, Sivaprakasam M (2019) Segmentation of femoral cartilage from knee ultrasound images using mask R-CNN. In: 2019 41st annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 966–969 Kompella G, Antico M, Sasazawa F, Jeevakala S, Ram K, Fontanarosa D, Sivaprakasam M (2019) Segmentation of femoral cartilage from knee ultrasound images using mask R-CNN. In: 2019 41st annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 966–969
15.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241
16.
go back to reference Lian S, Luo Z, Zhong Z, Lin X, Su S, Li S (2018) Attention guided U-Net for accurate iris segmentation. J Vis Commun Image Represent 56:296–304CrossRef Lian S, Luo Z, Zhong Z, Lin X, Su S, Li S (2018) Attention guided U-Net for accurate iris segmentation. J Vis Commun Image Represent 56:296–304CrossRef
17.
go back to reference Tong G, Li Y, Chen H, Zhang Q, Jiang H (2018) Improved U-NET network for pulmonary nodules segmentation. Optik 174:460–469CrossRef Tong G, Li Y, Chen H, Zhang Q, Jiang H (2018) Improved U-NET network for pulmonary nodules segmentation. Optik 174:460–469CrossRef
18.
go back to reference He K, Gkioxari G, Dollir P, Girshick R (2017) Mask R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 2961–2969 He K, Gkioxari G, Dollir P, Girshick R (2017) Mask R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 2961–2969
19.
go back to reference Meijering EH, Niessen WJ, Viergever MA (2001) Quantitative evaluation of convolution-based methods for medical image interpolation. Med Image Anal 5(2):111–126CrossRefPubMedCentral Meijering EH, Niessen WJ, Viergever MA (2001) Quantitative evaluation of convolution-based methods for medical image interpolation. Med Image Anal 5(2):111–126CrossRefPubMedCentral
Metadata
Title
Artificial intelligence in detection and segmentation of internal auditory canal and its nerves using deep learning techniques
Authors
S. Jeevakala
C. Sreelakshmi
Keerthi Ram
Rajeswaram Rangasami
Mohanasankar Sivaprakasam
Publication date
01-11-2020
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 11/2020
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02237-5

Other articles of this Issue 11/2020

International Journal of Computer Assisted Radiology and Surgery 11/2020 Go to the issue