Skip to main content
Top
Published in: Ophthalmology and Therapy 5/2024

Open Access 28-02-2024 | Angiography | ORIGINAL RESEARCH

Automatic Detection of 30 Fundus Diseases Using Ultra-Widefield Fluorescein Angiography with Deep Experts Aggregation

Authors: Xiaoling Wang, He Li, Hongmei Zheng, Gongpeng Sun, Wenyu Wang, Zuohuizi Yi, A’min Xu, Lu He, Haiyan Wang, Wei Jia, Zhiqing Li, Chang Li, Mang Ye, Bo Du, Changzheng Chen

Published in: Ophthalmology and Therapy | Issue 5/2024

Login to get access

Abstract

Introduction

Inaccurate, untimely diagnoses of fundus diseases leads to vision-threatening complications and even blindness. We built a deep learning platform (DLP) for automatic detection of 30 fundus diseases using ultra-widefield fluorescein angiography (UWFFA) with deep experts aggregation.

Methods

This retrospective and cross-sectional database study included a total of 61,609 UWFFA images dating from 2016 to 2021, involving more than 3364 subjects in multiple centers across China. All subjects were divided into 30 different groups. The state-of-the-art convolutional neural network architecture, ConvNeXt, was chosen as the backbone to train and test the receiver operating characteristic curve (ROC) of the proposed system on test data and external test date. We compared the classification performance of the proposed system with that of ophthalmologists, including two retinal specialists.

Results

We built a DLP to analyze UWFFA, which can detect up to 30 fundus diseases, with a frequency-weighted average area under the receiver operating characteristic curve (AUC) of 0.940 in the primary test dataset and 0.954 in the external multi-hospital test dataset. The tool shows comparable accuracy with retina specialists in diagnosis and evaluation.

Conclusions

This is the first study on a large-scale UWFFA dataset for multi-retina disease classification. We believe that our UWFFA DLP advances the diagnosis by artificial intelligence (AI) in various retinal diseases and would contribute to labor-saving and precision medicine especially in remote areas.
Literature
1.
go back to reference Ting DS, Cheung GC, Wong TY. Diabetic retinopathy: global prevalence, major risk factors, screening practices and public health challenges: a review. Clin Exp Ophthalmol. 2016;44:260–77.CrossRefPubMed Ting DS, Cheung GC, Wong TY. Diabetic retinopathy: global prevalence, major risk factors, screening practices and public health challenges: a review. Clin Exp Ophthalmol. 2016;44:260–77.CrossRefPubMed
2.
go back to reference Song P, Xu Y, Zha M, Zhang Y, Rudan I. Global epidemiology of retinal vein occlusion: a systematic review and meta-analysis of prevalence, incidence, and risk factors. J Glob Health. 2019;9: 010427.CrossRefPubMedPubMedCentral Song P, Xu Y, Zha M, Zhang Y, Rudan I. Global epidemiology of retinal vein occlusion: a systematic review and meta-analysis of prevalence, incidence, and risk factors. J Glob Health. 2019;9: 010427.CrossRefPubMedPubMedCentral
3.
go back to reference Chen YM, Huang WT, Ho WH, Tsai JT. Classification of age-related macular degeneration using convolutional-neural-network-based transfer learning. BMC Bioinformatics. 2021;22:99.CrossRefPubMedPubMedCentral Chen YM, Huang WT, Ho WH, Tsai JT. Classification of age-related macular degeneration using convolutional-neural-network-based transfer learning. BMC Bioinformatics. 2021;22:99.CrossRefPubMedPubMedCentral
5.
go back to reference Andreoli MT, Chau FY, Shapiro MJ, Leiderman YI. Epidemiological trends in 1452 cases of retinoblastoma from the Surveillance, Epidemiology, and End Results (SEER) registry. Can J Ophthalmol. 2017;52:592–8.CrossRefPubMedPubMedCentral Andreoli MT, Chau FY, Shapiro MJ, Leiderman YI. Epidemiological trends in 1452 cases of retinoblastoma from the Surveillance, Epidemiology, and End Results (SEER) registry. Can J Ophthalmol. 2017;52:592–8.CrossRefPubMedPubMedCentral
7.
go back to reference Patel M, Kiss S. Ultra-wide-field fluorescein angiography in retinal disease. Curr Opin Ophthalmol. 2014;25:213–20.CrossRefPubMed Patel M, Kiss S. Ultra-wide-field fluorescein angiography in retinal disease. Curr Opin Ophthalmol. 2014;25:213–20.CrossRefPubMed
9.
go back to reference Wong TY, Bressler NM. Artificial intelligence with deep learning technology looks into diabetic retinopathy screening. JAMA. 2016;316:2366–7.CrossRefPubMed Wong TY, Bressler NM. Artificial intelligence with deep learning technology looks into diabetic retinopathy screening. JAMA. 2016;316:2366–7.CrossRefPubMed
10.
go back to reference Li Z, Guo C, Nie D, et al. Automated detection of retinal exudates and drusen in ultra-widefield fundus images based on deep learning. Eye (Lond). 2022;36:1681–6.CrossRefPubMed Li Z, Guo C, Nie D, et al. Automated detection of retinal exudates and drusen in ultra-widefield fundus images based on deep learning. Eye (Lond). 2022;36:1681–6.CrossRefPubMed
11.
go back to reference Bi Q, Yu S, Ji W, et al. Local-global dual perception based deep multiple instance learning for retinal disease classification. Cham: Springer International Publishing; 2021. p. 55–64. Bi Q, Yu S, Ji W, et al. Local-global dual perception based deep multiple instance learning for retinal disease classification. Cham: Springer International Publishing; 2021. p. 55–64.
12.
go back to reference Karthikeyan SK, Sanjay P, Madhusudan RJ, Sundaramoorthy SK, Namboori PKK. Detection of multi-class retinal diseases using artificial intelligence: an expeditious learning using deep CNN with minimal data. Biomed Pharmacol J. 2019;12:1577–86.CrossRef Karthikeyan SK, Sanjay P, Madhusudan RJ, Sundaramoorthy SK, Namboori PKK. Detection of multi-class retinal diseases using artificial intelligence: an expeditious learning using deep CNN with minimal data. Biomed Pharmacol J. 2019;12:1577–86.CrossRef
13.
go back to reference Arunkumar R, Karthigaikumar P. Multi-retinal disease classification by reduced deep learning features. Neural Comput Appl. 2017;28:329–34.CrossRef Arunkumar R, Karthigaikumar P. Multi-retinal disease classification by reduced deep learning features. Neural Comput Appl. 2017;28:329–34.CrossRef
14.
go back to reference He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. pp 770–8. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. pp 770–8.
15.
go back to reference Simonyan K, Zisserman A. Very deep convolutional networks for large-scale Image recognition. arXiv:14091556 2015. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale Image recognition. arXiv:14091556 2015.
16.
go back to reference Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16 × 16 words: transformers for image recognition at scale. arXiv:201011929 2021. Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16 × 16 words: transformers for image recognition at scale. arXiv:201011929 2021.
17.
go back to reference Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, Jegou H. Training data-efficient image transformers & distillation through attention. In: Marina M, Tong Z (eds) Proceedings of the 38th International Conference on Machine Learning. Proceedings of Machine Learning Research: PMLR; 2021. p. 10347–57. Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, Jegou H. Training data-efficient image transformers & distillation through attention. In: Marina M, Tong Z (eds) Proceedings of the 38th International Conference on Machine Learning. Proceedings of Machine Learning Research: PMLR; 2021. p. 10347–57.
18.
go back to reference Khan S, Naseer M, Hayat M, Zamir SW, Khan FS, Shah M. Transformers in vision: a survey. arXiv:210101169. 2021. Khan S, Naseer M, Hayat M, Zamir SW, Khan FS, Shah M. Transformers in vision: a survey. arXiv:210101169. 2021.
19.
go back to reference Yosinski J, Clune J, Bengio Y, Lipson H. How transferable are features in deep neural networks? arXiv:14111792. 2014. Yosinski J, Clune J, Bengio Y, Lipson H. How transferable are features in deep neural networks? arXiv:14111792. 2014.
20.
go back to reference Wang XD, Lian L, Miao ZQ, Liu ZW, Yu SX. Long-tailed recognition by routing diverse distribution-aware experts. arXiv:201001809 2020. Wang XD, Lian L, Miao ZQ, Liu ZW, Yu SX. Long-tailed recognition by routing diverse distribution-aware experts. arXiv:201001809 2020.
21.
go back to reference Zheng Z, Zheng L, Yang Y. A discriminatively learned CNN embedding for person reidentification. ACM Trans Multimed Comput Commun Appl. 2017;14:13. Zheng Z, Zheng L, Yang Y. A discriminatively learned CNN embedding for person reidentification. ACM Trans Multimed Comput Commun Appl. 2017;14:13.
22.
go back to reference Cui Y, Jia M, Lin TY, Song Y, Belongie S. Class-balanced loss based on effective number of samples. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019. pp 9260–9. Cui Y, Jia M, Lin TY, Song Y, Belongie S. Class-balanced loss based on effective number of samples. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019. pp 9260–9.
23.
go back to reference Liang XB, Wu LJ, Li JT, et al. R-drop: regularized dropout for neural networks. arXiv:210614448 2021. Liang XB, Wu LJ, Li JT, et al. R-drop: regularized dropout for neural networks. arXiv:210614448 2021.
24.
go back to reference Kullback S, Leibler RA. On information and sufficiency. Ann Math Stat. 1951;22:79–86.CrossRef Kullback S, Leibler RA. On information and sufficiency. Ann Math Stat. 1951;22:79–86.CrossRef
25.
go back to reference Zhong Z, Zheng L, Kang GL, Li SZ, Yang Y. Random erasing data augmentation. Proc AAAI Conf Artif Intell. 2020;34:13001–8. Zhong Z, Zheng L, Kang GL, Li SZ, Yang Y. Random erasing data augmentation. Proc AAAI Conf Artif Intell. 2020;34:13001–8.
26.
go back to reference Ekin D, Cubuk BZ, Shlens J, Quoc V. Le. RandAugment: Practical automated data augmentation with a reduced search space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2020, pp 702–3. Ekin D, Cubuk BZ, Shlens J, Quoc V. Le. RandAugment: Practical automated data augmentation with a reduced search space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2020, pp 702–3.
27.
go back to reference Loshchilov L, Hutter F. Decoupled weight decay regularization. arXiv:171105101. 2019. Loshchilov L, Hutter F. Decoupled weight decay regularization. arXiv:171105101. 2019.
28.
go back to reference Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ. Deep networks with stochastic depth. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision—ECCV 2016. Cham: Springer International Publishing; 2016. p. 646–61.CrossRef Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ. Deep networks with stochastic depth. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision—ECCV 2016. Cham: Springer International Publishing; 2016. p. 646–61.CrossRef
29.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. pp 2818–26. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. pp 2818–26.
30.
go back to reference Deng J, Dong W, Socher R, Li L-J, Li K, Li F-F. ImageNet: a large-scale hierarchical image database 2009. Deng J, Dong W, Socher R, Li L-J, Li K, Li F-F. ImageNet: a large-scale hierarchical image database 2009.
31.
go back to reference Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25:44–56.CrossRefPubMed Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25:44–56.CrossRefPubMed
32.
go back to reference Duc NT, Ryu S, Qureshi MNI, Choi M, Lee KH, Lee B. 3D-deep learning based automatic diagnosis of Alzheimer’s disease with joint MMSE prediction using resting-state fMRI. Neuroinformatics. 2020;18:71–86.CrossRefPubMed Duc NT, Ryu S, Qureshi MNI, Choi M, Lee KH, Lee B. 3D-deep learning based automatic diagnosis of Alzheimer’s disease with joint MMSE prediction using resting-state fMRI. Neuroinformatics. 2020;18:71–86.CrossRefPubMed
33.
go back to reference Ardila D, Kiraly AP, Bharadwaj S, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25:954–61.CrossRefPubMed Ardila D, Kiraly AP, Bharadwaj S, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25:954–61.CrossRefPubMed
34.
go back to reference Jin K, Pan X, You K, et al. Automatic detection of non-perfusion areas in diabetic macular edema from fundus fluorescein angiography for decision making using deep learning. Sci Rep. 2020;10:15138.CrossRefPubMedPubMedCentral Jin K, Pan X, You K, et al. Automatic detection of non-perfusion areas in diabetic macular edema from fundus fluorescein angiography for decision making using deep learning. Sci Rep. 2020;10:15138.CrossRefPubMedPubMedCentral
35.
go back to reference Grassmann F, Mengelkamp J, Brandl C, et al. A deep learning algorithm for prediction of age-related eye disease study severity scale for age-related macular degeneration from color fundus photography. Ophthalmology. 2018;125:1410–20.CrossRefPubMed Grassmann F, Mengelkamp J, Brandl C, et al. A deep learning algorithm for prediction of age-related eye disease study severity scale for age-related macular degeneration from color fundus photography. Ophthalmology. 2018;125:1410–20.CrossRefPubMed
37.
go back to reference Chang J, Lee J, Ha A, et al. Explaining the rationale of deep learning glaucoma decisions with adversarial examples. Ophthalmology. 2021;128:78–88.CrossRefPubMed Chang J, Lee J, Ha A, et al. Explaining the rationale of deep learning glaucoma decisions with adversarial examples. Ophthalmology. 2021;128:78–88.CrossRefPubMed
38.
go back to reference Milea D, Najjar RP, Zhubo J, et al. Artificial intelligence to detect papilledema from ocular fundus photographs. N Engl J Med. 2020;382:1687–95.CrossRefPubMed Milea D, Najjar RP, Zhubo J, et al. Artificial intelligence to detect papilledema from ocular fundus photographs. N Engl J Med. 2020;382:1687–95.CrossRefPubMed
40.
go back to reference Pan X, Jin K, Cao J, et al. Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning. Graefes Arch Clin Exp Ophthalmol. 2020;258:779–85.CrossRefPubMed Pan X, Jin K, Cao J, et al. Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning. Graefes Arch Clin Exp Ophthalmol. 2020;258:779–85.CrossRefPubMed
41.
go back to reference Wang X, Ji Z, Ma X, et al. Automated grading of diabetic retinopathy with ultra-widefield fluorescein angiography and deep learning. J Diabetes Res. 2021;2021:2611250.CrossRefPubMedPubMedCentral Wang X, Ji Z, Ma X, et al. Automated grading of diabetic retinopathy with ultra-widefield fluorescein angiography and deep learning. J Diabetes Res. 2021;2021:2611250.CrossRefPubMedPubMedCentral
42.
go back to reference Cen L-P, Ji J, Lin J-W, et al. Automatic detection of 39 fundus diseases and conditions in retinal photographs using deep neural networks. Nat Commun. 2021;12:4828.CrossRefPubMedPubMedCentral Cen L-P, Ji J, Lin J-W, et al. Automatic detection of 39 fundus diseases and conditions in retinal photographs using deep neural networks. Nat Commun. 2021;12:4828.CrossRefPubMedPubMedCentral
43.
go back to reference Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV) 2017, pp 618–26. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV) 2017, pp 618–26.
Metadata
Title
Automatic Detection of 30 Fundus Diseases Using Ultra-Widefield Fluorescein Angiography with Deep Experts Aggregation
Authors
Xiaoling Wang
He Li
Hongmei Zheng
Gongpeng Sun
Wenyu Wang
Zuohuizi Yi
A’min Xu
Lu He
Haiyan Wang
Wei Jia
Zhiqing Li
Chang Li
Mang Ye
Bo Du
Changzheng Chen
Publication date
28-02-2024
Publisher
Springer Healthcare
Published in
Ophthalmology and Therapy / Issue 5/2024
Print ISSN: 2193-8245
Electronic ISSN: 2193-6528
DOI
https://doi.org/10.1007/s40123-024-00900-7

Other articles of this Issue 5/2024

Ophthalmology and Therapy 5/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.