Skip to main content
Top
Published in: Journal of Digital Imaging 6/2018

01-12-2018

Automated Quality Assessment of Colour Fundus Images for Diabetic Retinopathy Screening in Telemedicine

Authors: Sajib Kumar Saha, Basura Fernando, Jorge Cuadros, Di Xiao, Yogesan Kanagasingam

Published in: Journal of Imaging Informatics in Medicine | Issue 6/2018

Login to get access

Abstract

Fundus images obtained in a telemedicine program are acquired at different sites that are captured by people who have varying levels of experience. These result in a relatively high percentage of images which are later marked as unreadable by graders. Unreadable images require a recapture which is time and cost intensive. An automated method that determines the image quality during acquisition is an effective alternative. To determine the image quality during acquisition, we describe here an automated method for the assessment of image quality in the context of diabetic retinopathy. The method explicitly applies machine learning techniques to access the image and to determine ‘accept’ and ‘reject’ categories. ‘Reject’ category image requires a recapture. A deep convolution neural network is trained to grade the images automatically. A large representative set of 7000 colour fundus images was used for the experiment which was obtained from the EyePACS that were made available by the California Healthcare Foundation. Three retinal image analysis experts were employed to categorise these images into ‘accept’ and ‘reject’ classes based on the precise definition of image quality in the context of DR. The network was trained using 3428 images. The method shows an accuracy of 100% to successfully categorise ‘accept’ and ‘reject’ images, which is about 2% higher than the traditional machine learning method. On a clinical trial, the proposed method shows 97% agreement with human grader. The method can be easily incorporated with the fundus image capturing system in the acquisition centre and can guide the photographer whether a recapture is necessary or not.
Footnotes
1
Processor: Intel Core i7 2.90 GHz, RAM: 32 GB
 
Literature
1.
go back to reference Michelson G Ed: Teleophthalmology in preventive medicine. Berlin Heidelberg: Springer, 2015 Michelson G Ed: Teleophthalmology in preventive medicine. Berlin Heidelberg: Springer, 2015
2.
go back to reference Patton N, Aslam TM, MacGillivray T, Deary IJ, Dhillon B, Eikelboom RH, Yogesan K, Constable IJ: Retinal image analysis: concepts, applications and potential. Prog Retin Eye Res 25(1):99–127, 2011CrossRef Patton N, Aslam TM, MacGillivray T, Deary IJ, Dhillon B, Eikelboom RH, Yogesan K, Constable IJ: Retinal image analysis: concepts, applications and potential. Prog Retin Eye Res 25(1):99–127, 2011CrossRef
3.
go back to reference Luzio S, Hatcher S, Zahlmann G, Mazik L, Morgan M, Liesenfeld B, Bek T, Schuell H, Schneider S, Owens DR, Kohner E: Feasibility of using the TOSCA telescreening procedures for diabetic retinopathy. Diabet Med. 21(10):1121–1128, 2004CrossRef Luzio S, Hatcher S, Zahlmann G, Mazik L, Morgan M, Liesenfeld B, Bek T, Schuell H, Schneider S, Owens DR, Kohner E: Feasibility of using the TOSCA telescreening procedures for diabetic retinopathy. Diabet Med. 21(10):1121–1128, 2004CrossRef
4.
go back to reference Sim DA, Keane PA, Tufail A, Egan CA, Aiello LP, Silva PS: Automated retinal image analysis for diabetic retinopathy in telemedicine. Current Diabetes Reports 15:14, 2015CrossRef Sim DA, Keane PA, Tufail A, Egan CA, Aiello LP, Silva PS: Automated retinal image analysis for diabetic retinopathy in telemedicine. Current Diabetes Reports 15:14, 2015CrossRef
5.
go back to reference Vashist P, Singh S, Gupta N, Saxena R: Role of early screening for diabetic retinopathy in patients with diabetes mellitus: an overview. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine 36(4):247, 2011CrossRef Vashist P, Singh S, Gupta N, Saxena R: Role of early screening for diabetic retinopathy in patients with diabetes mellitus: an overview. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine 36(4):247, 2011CrossRef
6.
go back to reference ETDRS Research Group: ETDRS report number 9. Early treatment diabetic retinopathy study research group. Ophthalmology 98(5 Suppl):766–785, 1991 ETDRS Research Group: ETDRS report number 9. Early treatment diabetic retinopathy study research group. Ophthalmology 98(5 Suppl):766–785, 1991
7.
go back to reference Niemeijer M, Abramoff MD, van Ginneken B: Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening. Med Image Anal. 10(6):888–898, 2006CrossRef Niemeijer M, Abramoff MD, van Ginneken B: Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening. Med Image Anal. 10(6):888–898, 2006CrossRef
8.
go back to reference Abramoff MD, Suttorp-schulten MSA: Web-based screening for diabetic retinopathy in a primary care population: the EyeCheck project. J Telemed e-Health 11(6):668–675, 2005CrossRef Abramoff MD, Suttorp-schulten MSA: Web-based screening for diabetic retinopathy in a primary care population: the EyeCheck project. J Telemed e-Health 11(6):668–675, 2005CrossRef
10.
go back to reference Giancardo L, Meriaudeau F, Karnowski TP,Chaum E, Tobin K: New developments in biomedical engineering. Domenico Campolo, Online: IntechOpen, 2010 Giancardo L, Meriaudeau F, Karnowski TP,Chaum E, Tobin K: New developments in biomedical engineering. Domenico Campolo, Online: IntechOpen, 2010
12.
go back to reference Paulus J, Meier J, Bock R, Hornegger J, Michelson G: Automated quality assessment of retinal fundus photos. Int J Comput Assist Radiol Surg. 5(6):557–564, 2010CrossRef Paulus J, Meier J, Bock R, Hornegger J, Michelson G: Automated quality assessment of retinal fundus photos. Int J Comput Assist Radiol Surg. 5(6):557–564, 2010CrossRef
13.
go back to reference Imani E, Pourreza H, Banaee T: Retinal image quality assessment using Shearlet transform. In: Constanda C, Kirsch A Eds. Integral Methods in Science and Engineering. Cham: Birkhäuser, 2015, pp 329–339CrossRef Imani E, Pourreza H, Banaee T: Retinal image quality assessment using Shearlet transform. In: Constanda C, Kirsch A Eds. Integral Methods in Science and Engineering. Cham: Birkhäuser, 2015, pp 329–339CrossRef
14.
go back to reference Lee SC, Wang Y: Automatic retinal image quality assessment and enhancement. Proceedings of SPIE Image Processing, 1999, pp 1581–1591 Lee SC, Wang Y: Automatic retinal image quality assessment and enhancement. Proceedings of SPIE Image Processing, 1999, pp 1581–1591
15.
go back to reference Lalonde M, Gagnon L, Boucher M: Automatic visual quality assessment in optical fundus images. Ottawa Proceedings of Vision Interface, 2001, pp 259–264 Lalonde M, Gagnon L, Boucher M: Automatic visual quality assessment in optical fundus images. Ottawa Proceedings of Vision Interface, 2001, pp 259–264
16.
go back to reference Davis H, Russell S, Barriga E, Abramoff M, Soliz P: Vision-based, real-time retinal image quality assessment. 22nd IEEE International Symposium on Computer-Based Medical Systems, 2009, pp 1–6 Davis H, Russell S, Barriga E, Abramoff M, Soliz P: Vision-based, real-time retinal image quality assessment. 22nd IEEE International Symposium on Computer-Based Medical Systems, 2009, pp 1–6
17.
go back to reference Bartling H, Wanger P, Martin L: Automated quality evaluation of digital fundus photographs. Acta Ophthalmol 87(6):643–647, 2009CrossRef Bartling H, Wanger P, Martin L: Automated quality evaluation of digital fundus photographs. Acta Ophthalmol 87(6):643–647, 2009CrossRef
18.
go back to reference Dias J, Oliveira CM, Da Silva Cruz LA: Retinal image quality assessment using generic image quality indicators. Inf Fusion 19(1):73–90, 2014CrossRef Dias J, Oliveira CM, Da Silva Cruz LA: Retinal image quality assessment using generic image quality indicators. Inf Fusion 19(1):73–90, 2014CrossRef
19.
go back to reference Usher DB, Himaga M, Dumskyj MJ: Automated assessment of digital fundus image quality using detected vessel area. Proceedings of Medical Image Understanding and Analysis, 2003, pp 81–84 Usher DB, Himaga M, Dumskyj MJ: Automated assessment of digital fundus image quality using detected vessel area. Proceedings of Medical Image Understanding and Analysis, 2003, pp 81–84
20.
go back to reference Fleming AD, Philip S, Goatman KA, Olson JA, Sharp PF: Automated assessment of diabetic retinal image quality based on clarity and field definition. Investig Ophthalmol Vis Sci. 47(3):1120–1125, 2006CrossRef Fleming AD, Philip S, Goatman KA, Olson JA, Sharp PF: Automated assessment of diabetic retinal image quality based on clarity and field definition. Investig Ophthalmol Vis Sci. 47(3):1120–1125, 2006CrossRef
21.
go back to reference Hunter A, Lowell JA, Habib M, Ryder B, Basu A, Steel D: An automated retinal image quality grading algorithm. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2011, pp 5955–5958 Hunter A, Lowell JA, Habib M, Ryder B, Basu A, Steel D: An automated retinal image quality grading algorithm. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2011, pp 5955–5958
22.
go back to reference Lowell J, Hunter A, Habib M, Steel D: Automated quantification of fundus image quality. 3rd European Medical and Biological Engineering Conference: 1618, 2005 Lowell J, Hunter A, Habib M, Steel D: Automated quantification of fundus image quality. 3rd European Medical and Biological Engineering Conference: 1618, 2005
23.
go back to reference Giancardo L, Abramoff MD, Chaum E, Karnowski TP, Meriaudeau F, Tobin KW: Elliptical local vessel density: a fast and robust quality metric for retinal images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2008, pp 3534–3537 Giancardo L, Abramoff MD, Chaum E, Karnowski TP, Meriaudeau F, Tobin KW: Elliptical local vessel density: a fast and robust quality metric for retinal images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2008, pp 3534–3537
24.
go back to reference Bengio Y: Learning deep architectures for AI. Found Trends®. Mach Learn. 2(1):1–127, 2009CrossRef Bengio Y: Learning deep architectures for AI. Found Trends®. Mach Learn. 2(1):1–127, 2009CrossRef
25.
go back to reference Schmidhuber J: Deep learning in neural networks: an overview. Neural Networks 61:85–117, 2015CrossRef Schmidhuber J: Deep learning in neural networks: an overview. Neural Networks 61:85–117, 2015CrossRef
26.
go back to reference Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012, pp 1–9 Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012, pp 1–9
27.
go back to reference Saha S, Fletcher A, Xiao D, Kanagasingam Y: A novel method for automated correction of non-uniform/poor illumination of retinal images without creating false artifacts. J Vis Commun Image Represent 51:95–103, 2018CrossRef Saha S, Fletcher A, Xiao D, Kanagasingam Y: A novel method for automated correction of non-uniform/poor illumination of retinal images without creating false artifacts. J Vis Commun Image Represent 51:95–103, 2018CrossRef
28.
go back to reference Goatman KA, Whitwam AD, Manivannan A, Olson JA, Sharp PF: Colour normalisation of retinal images. Proceedings of medical image understanding and analysis: 49-52, 2003 Goatman KA, Whitwam AD, Manivannan A, Olson JA, Sharp PF: Colour normalisation of retinal images. Proceedings of medical image understanding and analysis: 49-52, 2003
30.
go back to reference Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE transactions on medical imaging. 35(5):1299–1312, 2016CrossRef Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE transactions on medical imaging. 35(5):1299–1312, 2016CrossRef
31.
go back to reference Saha SK, Xiao D, Fernando B, Tay-Kearney ML, An D, Kanagasingam Y: Deep learning based decision support system for automated diagnosis of age-related macular degeneration (AMD). Investigative Ophthalmology & Visual Science 58(8):25–25, 2017 Saha SK, Xiao D, Fernando B, Tay-Kearney ML, An D, Kanagasingam Y: Deep learning based decision support system for automated diagnosis of age-related macular degeneration (AMD). Investigative Ophthalmology & Visual Science 58(8):25–25, 2017
32.
go back to reference Saha SK, Fernando B, Xiao D, Tay-Kearney ML, Kanagasingam Y: Deep learning for automatic detection and classification of microaneurysms, hard and soft exudates, and hemorrhages for diabetic retinopathy diagnosis. Investigative Ophthalmology & Visual Science 57(12):5962–5962, 2016 Saha SK, Fernando B, Xiao D, Tay-Kearney ML, Kanagasingam Y: Deep learning for automatic detection and classification of microaneurysms, hard and soft exudates, and hemorrhages for diabetic retinopathy diagnosis. Investigative Ophthalmology & Visual Science 57(12):5962–5962, 2016
33.
go back to reference Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T: Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, 2014, pp 675–678 Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T: Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, 2014, pp 675–678
34.
go back to reference Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L: ImageNet: a large-scale hierarchical image database. IEEE Computer Vision and Pattern Recognition, 2009, pp 248–255 Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L: ImageNet: a large-scale hierarchical image database. IEEE Computer Vision and Pattern Recognition, 2009, pp 248–255
35.
go back to reference Vedaldi A, Fulkerson B: An open and portable library of computer vision algorithms. Proceedings of the 18th ACM international conference on Multimedia, 2010, pp 1469–1472 Vedaldi A, Fulkerson B: An open and portable library of computer vision algorithms. Proceedings of the 18th ACM international conference on Multimedia, 2010, pp 1469–1472
Metadata
Title
Automated Quality Assessment of Colour Fundus Images for Diabetic Retinopathy Screening in Telemedicine
Authors
Sajib Kumar Saha
Basura Fernando
Jorge Cuadros
Di Xiao
Yogesan Kanagasingam
Publication date
01-12-2018
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 6/2018
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-018-0084-9

Other articles of this Issue 6/2018

Journal of Digital Imaging 6/2018 Go to the issue