Skip to main content
Top
Published in: International Ophthalmology 1/2024

01-12-2024 | Retinal Diseases | Original Paper

A new computer-aided diagnosis tool based on deep learning methods for automatic detection of retinal disorders from OCT images

Authors: Reza Alizadeh Eghtedar, Alireza Vard, Mohammad Malekahmadi, Alireza Peyman

Published in: International Ophthalmology | Issue 1/2024

Login to get access

Abstract

Purpose

Early detection of retinal disorders using optical coherence tomography (OCT) images can prevent vision loss. Since manual screening can be time-consuming, tedious, and fallible, we present a reliable computer-aided diagnosis (CAD) software based on deep learning. Also, we made efforts to increase the interpretability of the deep learning methods, overcome their vague and black box nature, and also understand their behavior in the diagnosis.

Methods

We propose a novel method to improve the interpretability of the used deep neural network by embedding the rich semantic information of abnormal areas based on the ophthalmologists’ interpretations and medical descriptions in the OCT images. Finally, we trained the classification network on a small subset of the online publicly available University of California San Diego (UCSD) dataset with an overall of 29,800 OCT images.

Results

The experimental results on the 1000 test OCT images show that the proposed method achieves the overall precision, accuracy, sensitivity, and f1-score of 97.6%, 97.6%, 97.6%, and 97.59%, respectively. Also, the heat map images provide a clear region of interest which indicates that the interpretability of the proposed method is increased dramatically.

Conclusion

The proposed software can help ophthalmologists in providing a second opinion to make a decision, and primitive automated diagnoses of retinal diseases and even it can be used as a screening tool, in eye clinics. Also, the improvement of the interpretability of the proposed method causes to increase in the model generalization, and therefore, it will work properly on a wide range of other OCT datasets.
Literature
1.
go back to reference Eghtedar RA, Esmaeili M, Peyman A, Akhlaghi M, Rasta SH (2022) An update on choroidal layer segmentation methods in optical coherence tomography images: a review. J Biomed Phys Eng 12(1):1 Eghtedar RA, Esmaeili M, Peyman A, Akhlaghi M, Rasta SH (2022) An update on choroidal layer segmentation methods in optical coherence tomography images: a review. J Biomed Phys Eng 12(1):1
2.
go back to reference Sunija A, Kar S, Gayathri S, Gopi VP, Palanisamy P (2021) Octnet: a lightweight CNN for retinal disease classification from optical coherence tomography images. Comput Methods Programs Biomed 200:105877CrossRef Sunija A, Kar S, Gayathri S, Gopi VP, Palanisamy P (2021) Octnet: a lightweight CNN for retinal disease classification from optical coherence tomography images. Comput Methods Programs Biomed 200:105877CrossRef
3.
go back to reference Das V, Dandapat S, Bora PK (2019) Multi-scale deep feature fusion for automated classification of macular pathologies from OCT images. Biomed Signal Process Control 54:101605CrossRef Das V, Dandapat S, Bora PK (2019) Multi-scale deep feature fusion for automated classification of macular pathologies from OCT images. Biomed Signal Process Control 54:101605CrossRef
4.
go back to reference Chauhan NK, Singh K (2018) A review on conventional machine learning vs deep learning. In: 2018 international conference on computing, power and communication technologies (GUCON): IEEE, pp 347–352 Chauhan NK, Singh K (2018) A review on conventional machine learning vs deep learning. In: 2018 international conference on computing, power and communication technologies (GUCON): IEEE, pp 347–352
5.
go back to reference Adel A, Soliman MM, Khalifa NEM, Mostafa K (2020) Automatic classification of retinal eye diseases from optical coherence tomography using transfer learning. In: 2020 16th international computer engineering conference (ICENCO): IEEE pp 37–42 Adel A, Soliman MM, Khalifa NEM, Mostafa K (2020) Automatic classification of retinal eye diseases from optical coherence tomography using transfer learning. In: 2020 16th international computer engineering conference (ICENCO): IEEE pp 37–42
6.
go back to reference Ai Z, Huang X, Feng J, Wang H, Tao Y, Zeng F et al. (2022) FN-OCT: disease detection algorithm for retinal optical coherence tomography based on a fusion network. Front Neuroinf 50 Ai Z, Huang X, Feng J, Wang H, Tao Y, Zeng F et al. (2022) FN-OCT: disease detection algorithm for retinal optical coherence tomography based on a fusion network. Front Neuroinf 50
7.
go back to reference Chen Y-M, Huang W-T, Ho W-H, Tsai J-T (2021) Classification of age-related macular degeneration using convolutional-neural-network-based transfer learning. BMC Bioinf 22(5):1–16 Chen Y-M, Huang W-T, Ho W-H, Tsai J-T (2021) Classification of age-related macular degeneration using convolutional-neural-network-based transfer learning. BMC Bioinf 22(5):1–16
8.
go back to reference He X, Fang L, Rabbani H, Chen X, Liu Z (2020) Retinal optical coherence tomography image classification with label smoothing generative adversarial network. Neurocomputing 405:37–47CrossRef He X, Fang L, Rabbani H, Chen X, Liu Z (2020) Retinal optical coherence tomography image classification with label smoothing generative adversarial network. Neurocomputing 405:37–47CrossRef
9.
go back to reference Kermany DS, Goldbaum M, Cai W, Valentim CC, Liang H, Baxter SL et al (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122–1131CrossRefPubMed Kermany DS, Goldbaum M, Cai W, Valentim CC, Liang H, Baxter SL et al (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122–1131CrossRefPubMed
10.
go back to reference Li F, Chen H, Liu Z, Zhang X-d, Jiang M-s, Wu Z-z et al (2019) Deep learning-based automated detection of retinal diseases using optical coherence tomography images. Biomed Opt Expr 10(12):6204–6226CrossRef Li F, Chen H, Liu Z, Zhang X-d, Jiang M-s, Wu Z-z et al (2019) Deep learning-based automated detection of retinal diseases using optical coherence tomography images. Biomed Opt Expr 10(12):6204–6226CrossRef
11.
go back to reference Mittal P (2021) Retinal disease classification using convolutional neural networks algorithm. Turkish J Comput Math Educ (TURCOMAT) 12(11):5681–5689 Mittal P (2021) Retinal disease classification using convolutional neural networks algorithm. Turkish J Comput Math Educ (TURCOMAT) 12(11):5681–5689
12.
go back to reference Tsuji T, Hirose Y, Fujimori K, Hirose T, Oyama A, Saikawa Y et al (2020) Classification of optical coherence tomography images using a capsule network. BMC Ophthalmol 20(1):1–9CrossRef Tsuji T, Hirose Y, Fujimori K, Hirose T, Oyama A, Saikawa Y et al (2020) Classification of optical coherence tomography images using a capsule network. BMC Ophthalmol 20(1):1–9CrossRef
14.
go back to reference Srinivasan PP, Kim LA, Mettu PS, Cousins SW, Comer GM, Izatt JA et al (2014) Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. Biomed Opt Expr 5(10):3568–3577CrossRef Srinivasan PP, Kim LA, Mettu PS, Cousins SW, Comer GM, Izatt JA et al (2014) Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. Biomed Opt Expr 5(10):3568–3577CrossRef
15.
go back to reference Kermany D, Zhang K, Goldbaum M (2018) Large dataset of labeled optical coherence tomography (oct) and chest x-ray images. Mendeley Data 3:10–17632 Kermany D, Zhang K, Goldbaum M (2018) Large dataset of labeled optical coherence tomography (oct) and chest x-ray images. Mendeley Data 3:10–17632
16.
go back to reference Luo Y, Xu Q, Jin R, Wu M, Liu L (2021) Automatic detection of retinopathy with optical coherence tomography images via a semi-supervised deep learning method. Biomed Opt Expr 12(5):2684–2702CrossRef Luo Y, Xu Q, Jin R, Wu M, Liu L (2021) Automatic detection of retinopathy with optical coherence tomography images via a semi-supervised deep learning method. Biomed Opt Expr 12(5):2684–2702CrossRef
17.
go back to reference Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV) pp 801–18 Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV) pp 801–18
18.
go back to reference Huang L, He X, Fang L, Rabbani H, Chen X (2019) Automatic classification of retinal optical coherence tomography images with layer guided convolutional neural network. IEEE Signal Process Lett 26(7):1026–1030ADSCrossRef Huang L, He X, Fang L, Rabbani H, Chen X (2019) Automatic classification of retinal optical coherence tomography images with layer guided convolutional neural network. IEEE Signal Process Lett 26(7):1026–1030ADSCrossRef
19.
go back to reference Li F, Chen H, Liu Z, Zhang X, Wu Z (2019) Fully automated detection of retinal disorders by image-based deep learning. Graefes Arch Clin Exp Ophthalmol 257(3):495–505CrossRefPubMed Li F, Chen H, Liu Z, Zhang X, Wu Z (2019) Fully automated detection of retinal disorders by image-based deep learning. Graefes Arch Clin Exp Ophthalmol 257(3):495–505CrossRefPubMed
20.
go back to reference Saraiva AA, Santos D, Pimentel P, Sousa JVM, Ferreira NMF, Neto JdEB et al. (2020) Classification of optical coherence tomography using convolutional neural networks. Bioinformatics pp 168–175 Saraiva AA, Santos D, Pimentel P, Sousa JVM, Ferreira NMF, Neto JdEB et al. (2020) Classification of optical coherence tomography using convolutional neural networks. Bioinformatics pp 168–175
21.
go back to reference Adiga S, Sivaswamy J (2018) Shared encoder based denoising of optical coherence tomography images. ICVGIP pp 35-1 Adiga S, Sivaswamy J (2018) Shared encoder based denoising of optical coherence tomography images. ICVGIP pp 35-1
22.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention: Springer, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention: Springer, pp 234–241
23.
go back to reference Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. pp 3431–3440
24.
go back to reference Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:14127062 Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:14127062
25.
go back to reference Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRefPubMed Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRefPubMed
26.
go back to reference Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:170605587 Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:170605587
27.
go back to reference Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
28.
go back to reference Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. International conference on machine learning: PMLR, pp 6105–6114 Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. International conference on machine learning: PMLR, pp 6105–6114
29.
go back to reference Xia X, Xu C, Nan B (2017) Inception-v3 for flower classification. In: 2017 2nd international conference on image, vision and computing (ICIVC): IEEE, pp 783–787 Xia X, Xu C, Nan B (2017) Inception-v3 for flower classification. In: 2017 2nd international conference on image, vision and computing (ICIVC): IEEE, pp 783–787
30.
go back to reference Mukti IZ, Biswas D (2019) Transfer learning based plant diseases detection using ResNet50. In: 2019 4th International conference on electrical information and communication technology (EICT): IEEE, pp 1–6 Mukti IZ, Biswas D (2019) Transfer learning based plant diseases detection using ResNet50. In: 2019 4th International conference on electrical information and communication technology (EICT): IEEE, pp 1–6
31.
go back to reference Tammina S (2019) Transfer learning using vgg-16 with deep convolutional neural network for classifying images. Int J Sci Res Publ (IJSRP) 9(10):143–150 Tammina S (2019) Transfer learning using vgg-16 with deep convolutional neural network for classifying images. Int J Sci Res Publ (IJSRP) 9(10):143–150
32.
go back to reference Rogachev A, Melikhova E (2020) Automation of the process of selecting hyperparameters for artificial neural networks for processing retrospective text information. In: IOP conference series: earth and environmental science: IOP Publishing, p 012012 Rogachev A, Melikhova E (2020) Automation of the process of selecting hyperparameters for artificial neural networks for processing retrospective text information. In: IOP conference series: earth and environmental science: IOP Publishing, p 012012
33.
go back to reference Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-cam++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE winter conference on applications of computer vision (WACV): IEEE, pp 839–847 Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-cam++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE winter conference on applications of computer vision (WACV): IEEE, pp 839–847
34.
go back to reference Harwani BM (2018) Qt5 python GUI programming cookbook: building responsive and powerful cross-platform applications with PyQt. Packt Publishing Ltd Harwani BM (2018) Qt5 python GUI programming cookbook: building responsive and powerful cross-platform applications with PyQt. Packt Publishing Ltd
35.
go back to reference Siahaan V, Sianipar RH (2019) LEARNING PyQt5: a step by step tutorial to develop MySQL-based applications. Sparta publishing Siahaan V, Sianipar RH (2019) LEARNING PyQt5: a step by step tutorial to develop MySQL-based applications. Sparta publishing
36.
go back to reference Hope T, Resheff YS, Lieder I (2017) Learning tensorflow: a guide to building deep learning systems. O'Reilly Media, Inc. Hope T, Resheff YS, Lieder I (2017) Learning tensorflow: a guide to building deep learning systems. O'Reilly Media, Inc.
37.
go back to reference Gulli A, Pal S (2017) Deep learning with Keras. Packt Publishing Ltd Gulli A, Pal S (2017) Deep learning with Keras. Packt Publishing Ltd
38.
go back to reference Mistry K, Saluja A (2016) An introduction to opencv using python with ubuntu. Int J Sci Res Comput Sci Eng Inf Technol 1(2):65–68 Mistry K, Saluja A (2016) An introduction to opencv using python with ubuntu. Int J Sci Res Comput Sci Eng Inf Technol 1(2):65–68
39.
go back to reference Tharwat A (2020) Classification assessment methods. Appl Comput Inf 17(1):168–192 Tharwat A (2020) Classification assessment methods. Appl Comput Inf 17(1):168–192
40.
go back to reference Saraiva A, Melo R, Filipe V, Sousa J, Ferreira NF, Valente A (2018) Mobile multirobot manipulation by image recognition. Int J Syst Appl Eng Devel Saraiva A, Melo R, Filipe V, Sousa J, Ferreira NF, Valente A (2018) Mobile multirobot manipulation by image recognition. Int J Syst Appl Eng Devel
Metadata
Title
A new computer-aided diagnosis tool based on deep learning methods for automatic detection of retinal disorders from OCT images
Authors
Reza Alizadeh Eghtedar
Alireza Vard
Mohammad Malekahmadi
Alireza Peyman
Publication date
01-12-2024
Publisher
Springer Netherlands
Published in
International Ophthalmology / Issue 1/2024
Print ISSN: 0165-5701
Electronic ISSN: 1573-2630
DOI
https://doi.org/10.1007/s10792-024-03033-9

Other articles of this Issue 1/2024

International Ophthalmology 1/2024 Go to the issue