Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2024

Open Access 01-12-2024 | Research

A reliable diabetic retinopathy grading via transfer learning and ensemble learning with quadratic weighted kappa metric

Authors: Sai Venkatesh Chilukoti, Liqun Shan, Vijay Srinivas Tida, Anthony S. Maida, Xiali Hei

Published in: BMC Medical Informatics and Decision Making | Issue 1/2024

Login to get access

Abstract

The most common eye infection in people with diabetes is diabetic retinopathy (DR). It might cause blurred vision or even total blindness. Therefore, it is essential to promote early detection to prevent or alleviate the impact of DR. However, due to the possibility that symptoms may not be noticeable in the early stages of DR, it is difficult for doctors to identify them. Therefore, numerous predictive models based on machine learning (ML) and deep learning (DL) have been developed to determine all stages of DR. However, existing DR classification models cannot classify every DR stage or use a computationally heavy approach. Common metrics such as accuracy, F1 score, precision, recall, and AUC-ROC score are not reliable for assessing DR grading. This is because they do not account for two key factors: the severity of the discrepancy between the assigned and predicted grades and the ordered nature of the DR grading scale. 
This research proposes computationally efficient ensemble methods for the classification of DR. These methods leverage pre-trained model weights, reducing training time and resource requirements. In addition, data augmentation techniques are used to address data limitations, improve features, and improve generalization. This combination offers a promising approach for accurate and robust DR grading. In particular, we take advantage of transfer learning using models trained on DR data and employ CLAHE for image enhancement and Gaussian blur for noise reduction. We propose a three-layer classifier that incorporates dropout and ReLU activation. This design aims to minimize overfitting while effectively extracting features and assigning DR grades. We prioritize the Quadratic Weighted Kappa (QWK) metric due to its sensitivity to label discrepancies, which is crucial for an accurate diagnosis of DR. This combined approach achieves state-of-the-art QWK scores (0.901, 0.967 and 0.944) in the Eyepacs, Aptos, and Messidor datasets.
Literature
2.
go back to reference Cheloni R, Gandolfi SA, Signorelli C, Odone A. Global prevalence of diabetic retinopathy: protocol for a systematic review and meta-analysis. BMJ Open. 2019;9(3):e022188.CrossRefPubMedPubMedCentral Cheloni R, Gandolfi SA, Signorelli C, Odone A. Global prevalence of diabetic retinopathy: protocol for a systematic review and meta-analysis. BMJ Open. 2019;9(3):e022188.CrossRefPubMedPubMedCentral
11.
go back to reference Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 2014. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 2014.
13.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. pp. 2818–2826. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. pp. 2818–2826.
14.
go back to reference Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018. pp. 7132–7141. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018. pp. 7132–7141.
15.
go back to reference Krizhevsky A, Sutskever I, Hinton GE. ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) ImageNet Classification with Deep Convolutional Neural Networks. Krizhevsky A, Sutskever I, Hinton GE. ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) ImageNet Classification with Deep Convolutional Neural Networks.
16.
go back to reference Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. pp. 4700–4708). Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. pp. 4700–4708).
18.
go back to reference Al-Smadi M, Hammad M, Baker QB, Sa’ad A. A transfer learning with deep neural network approach for diabetic retinopathy classification. Int J Electr Comput Eng. 2021;11(4):3492. Al-Smadi M, Hammad M, Baker QB, Sa’ad A. A transfer learning with deep neural network approach for diabetic retinopathy classification. Int J Electr Comput Eng. 2021;11(4):3492.
20.
go back to reference Zhu W, Qiu P, Li X, Lepore N, Dumitrascu OM, Wang Y. nnMobileNe: Rethinking CNN for Retinopathy Research. 2023. arXiv preprint arXiv:2306.01289. Zhu W, Qiu P, Li X, Lepore N, Dumitrascu OM, Wang Y. nnMobileNe: Rethinking CNN for Retinopathy Research. 2023. arXiv preprint arXiv:2306.01289.
21.
go back to reference Mateen M, Wen J, Hassan M, Nasrullah N, Sun S, Hayat S. Automatic detection of diabetic retinopathy: a review on datasets, methods and evaluation metrics. IEEE Access. 2020;8:48784–811.CrossRef Mateen M, Wen J, Hassan M, Nasrullah N, Sun S, Hayat S. Automatic detection of diabetic retinopathy: a review on datasets, methods and evaluation metrics. IEEE Access. 2020;8:48784–811.CrossRef
22.
go back to reference Mateen M, Wen J, Nasrullah N, Sun S, Hayat S. Exudate detection for diabetic retinopathy using pretrained convolutional neural networks. Complexity. 2020;2020:1–11.CrossRefADS Mateen M, Wen J, Nasrullah N, Sun S, Hayat S. Exudate detection for diabetic retinopathy using pretrained convolutional neural networks. Complexity. 2020;2020:1–11.CrossRefADS
23.
go back to reference Mateen M, Wen J, Song S, Huang Z. Fundus image classification using vgg-19 architecture with pca and svd. Symmetry. 2018;11(1):1.CrossRefADS Mateen M, Wen J, Song S, Huang Z. Fundus image classification using vgg-19 architecture with pca and svd. Symmetry. 2018;11(1):1.CrossRefADS
24.
go back to reference Mohan NJ, Murugan R, Goel T, Mirjalili S, Singh YK, Deb D, Roy P. Optimal hybrid feature selection technique for diabetic retinopathy grading using fundus images. Sādhanā. 2023;48(3):102. Mohan NJ, Murugan R, Goel T, Mirjalili S, Singh YK, Deb D, Roy P. Optimal hybrid feature selection technique for diabetic retinopathy grading using fundus images. Sādhanā. 2023;48(3):102.
25.
go back to reference Mohan NJ, Murugan R, Goel T, Roy P. DRFL: Federated Learning in Diabetic Retinopathy Grading Using Fundus Images. IEEE Trans Parallel Distrib Syst. 2023. Mohan NJ, Murugan R, Goel T, Roy P. DRFL: Federated Learning in Diabetic Retinopathy Grading Using Fundus Images. IEEE Trans Parallel Distrib Syst. 2023.
27.
go back to reference Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning 2019 May 24 (pp. 6105-6114). PMLR. Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning 2019 May 24 (pp. 6105-6114). PMLR.
28.
go back to reference Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. 2019. arXiv preprint arXiv:1801.04381. Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. 2019. arXiv preprint arXiv:1801.04381.
31.
go back to reference Huang Y, Lyu J, Cheng P, Tam R, Tang X. Ssit: Saliency-guided self-supervised image transformer for diabetic retinopathy grading. 2022. arXiv preprint arXiv:2210.10969. Huang Y, Lyu J, Cheng P, Tam R, Tang X. Ssit: Saliency-guided self-supervised image transformer for diabetic retinopathy grading. 2022. arXiv preprint arXiv:2210.10969.
32.
go back to reference Chollet F. Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. pp. 1251–1258. Chollet F. Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. pp. 1251–1258.
33.
go back to reference Dai Z, Liu H, Le QV, Tan M. Coatnet: Marrying convolution and attention for all data sizes. Adv Neural Inf Process Syst. 2021;34:3965–77. Dai Z, Liu H, Le QV, Tan M. Coatnet: Marrying convolution and attention for all data sizes. Adv Neural Inf Process Syst. 2021;34:3965–77.
34.
go back to reference Islam SMS, Hasan MM, Abdullah S. Deep learning based early detection and grading of diabetic retinopathy using retinal fundus images. 2018. arXiv preprint arXiv:1812.10595. Islam SMS, Hasan MM, Abdullah S. Deep learning based early detection and grading of diabetic retinopathy using retinal fundus images. 2018. arXiv preprint arXiv:1812.10595.
35.
go back to reference Yang T, Andrew G, Eichner H, Sun H, Li W, Kong N, Ramage D, Beaufays F. Applied federated learning: Improving google keyboard query suggestions. 2018. arXiv preprint arXiv:1812.02903. Yang T, Andrew G, Eichner H, Sun H, Li W, Kong N, Ramage D, Beaufays F. Applied federated learning: Improving google keyboard query suggestions. 2018. arXiv preprint arXiv:1812.02903.
Metadata
Title
A reliable diabetic retinopathy grading via transfer learning and ensemble learning with quadratic weighted kappa metric
Authors
Sai Venkatesh Chilukoti
Liqun Shan
Vijay Srinivas Tida
Anthony S. Maida
Xiali Hei
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2024
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-024-02446-x

Other articles of this Issue 1/2024

BMC Medical Informatics and Decision Making 1/2024 Go to the issue