Skip to main content
Top
Published in: BMC Ophthalmology 1/2019

Open Access 01-12-2019 | Diabetic Retinopathy | Research article

The diagnostic accuracy of an intelligent and automated fundus disease image assessment system with lesion quantitative function (SmartEye) in diabetic patients

Authors: Yi Xu, Yongyi Wang, Bin Liu, Lin Tang, Liangqing Lv, Xin Ke, Saiguang Ling, Lina Lu, Haidong Zou

Published in: BMC Ophthalmology | Issue 1/2019

Login to get access

Abstract

Background

With the diabetes mellitus (DM) prevalence increasing annually, the human grading of retinal images to evaluate DR has posed a substantial burden worldwide. SmartEye is a recently developed fundus image processing and analysis system with lesion quantification function for DR screening. It is sensitive to the lesion area and can automatically identify the lesion position and size. We reported the diabetic retinopathy (DR) grading results of SmartEye versus ophthalmologists in analyzing images captured with non-mydriatic fundus cameras in community healthcare centers, as well as DR lesion quantitative analysis results on different disease stages.

Methods

This is a cross-sectional study. All the fundus images were collected from the Shanghai Diabetic Eye Study in Diabetics (SDES) program from Apr 2016 to Aug 2017. 19,904 fundus images were acquired from 6013 diabetic patients. The grading results of ophthalmologists and SmartEye are compared. Lesion quantification of several images at different DR stages is also presented.

Results

The sensitivity for diagnosing no DR, mild NPDR (non-proliferative diabetic retinopathy), moderate NPDR, severe NPDR, PDR (proliferative diabetic retinopathy) are 86.19, 83.18, 88.64, 89.59, and 85.02%. The specificity are 63.07, 70.96, 64.16, 70.38, and 74.79%, respectively. The AUC are PDR, 0.80 (0.79, 0.81); severe NPDR, 0.80 (0.79, 0.80); moderate NPDR, 0.77 (0.76, 0.77); and mild NPDR, 0.78 (0.77, 0.79). Lesion quantification results showed that the total hemorrhage area, maximum hemorrhage area, total exudation area, and maximum exudation area increase with DR severity.

Conclusions

SmartEye has a high diagnostic accuracy in DR screening program using non-mydriatic fundus cameras. SmartEye quantitative analysis may be an innovative and promising method of DR diagnosis and grading.
Literature
1.
go back to reference Bastawrous A, Mathenge W, Wing K, Bastawrous M, Rono H, Weiss HA, et al. The incidence of diabetes mellitus and diabetic retinopathy in a population-based cohort study of people age 50 years and over in Nakuru, Kenya. BMC Endocr Disord. 2017;17:19.CrossRef Bastawrous A, Mathenge W, Wing K, Bastawrous M, Rono H, Weiss HA, et al. The incidence of diabetes mellitus and diabetic retinopathy in a population-based cohort study of people age 50 years and over in Nakuru, Kenya. BMC Endocr Disord. 2017;17:19.CrossRef
2.
go back to reference Nentwich MM, Ulbig MW. Diabetic retinopathy - ocular complications of diabetes mellitus. World J Diabetes. 2015;6:489–99.CrossRef Nentwich MM, Ulbig MW. Diabetic retinopathy - ocular complications of diabetes mellitus. World J Diabetes. 2015;6:489–99.CrossRef
3.
go back to reference Acan D, Calan M, Er D, Arkan T, Kocak N, Bayraktar F, et al. The prevalence and systemic risk factors of diabetic macular edema: a cross-sectional study from Turkey. BMC Ophthalmol. 2018;18:91.CrossRef Acan D, Calan M, Er D, Arkan T, Kocak N, Bayraktar F, et al. The prevalence and systemic risk factors of diabetic macular edema: a cross-sectional study from Turkey. BMC Ophthalmol. 2018;18:91.CrossRef
4.
go back to reference Aiello LM. Perspectives on diabetic retinopathy. Am J Ophthalmol. 2003;136:122–35.CrossRef Aiello LM. Perspectives on diabetic retinopathy. Am J Ophthalmol. 2003;136:122–35.CrossRef
5.
go back to reference Sayin N, Kara N, Pekel G. Ocular complications of diabetes mellitus. World J Diabetes. 2015;6:92–108.CrossRef Sayin N, Kara N, Pekel G. Ocular complications of diabetes mellitus. World J Diabetes. 2015;6:92–108.CrossRef
6.
go back to reference Santiago AR, Boia R, Aires ID, Ambrósio AF, Fernandes R. Sweet stress: coping with vascular dysfunction in diabetic retinopathy. Front Physiol. 2018;9:820.CrossRef Santiago AR, Boia R, Aires ID, Ambrósio AF, Fernandes R. Sweet stress: coping with vascular dysfunction in diabetic retinopathy. Front Physiol. 2018;9:820.CrossRef
7.
go back to reference Schmidt-Erfurth U, Sadeghipour A, Gerendas BS, Waldstein SM, Bogunović H. Artificial intelligence in retina. Prog Retin Eye Res. 2018;S1350-9462(18):30011–9. Schmidt-Erfurth U, Sadeghipour A, Gerendas BS, Waldstein SM, Bogunović H. Artificial intelligence in retina. Prog Retin Eye Res. 2018;S1350-9462(18):30011–9.
8.
go back to reference Brazionis L, Jenkins A, Keech A, Ryan C, Brown A, Boffa J, et al. Diabetic retinopathy in a remote Indigenous primary healthcare population: a Central Australian diabetic retinopathy screening study in the Telehealth Eye and Associated Medical Services Network project. Diabet Med. 2018;35:630-39.CrossRef Brazionis L, Jenkins A, Keech A, Ryan C, Brown A, Boffa J, et al. Diabetic retinopathy in a remote Indigenous primary healthcare population: a Central Australian diabetic retinopathy screening study in the Telehealth Eye and Associated Medical Services Network project. Diabet Med. 2018;35:630-39.CrossRef
9.
go back to reference Scanlon PH. The English National Screening Programme for diabetic retinopathy 2003-2016. Acta Diabetol. 2017;54:515–25.CrossRef Scanlon PH. The English National Screening Programme for diabetic retinopathy 2003-2016. Acta Diabetol. 2017;54:515–25.CrossRef
10.
go back to reference Bursell SE, Fonda SJ, Lewis DG, Horton MB. Prevalence of diabetic retinopathy and diabetic macular edema in a primary care-based teleophthalmology program for American Indians and Alaskan natives. PLoS One. 2018;13:e0198551.CrossRef Bursell SE, Fonda SJ, Lewis DG, Horton MB. Prevalence of diabetic retinopathy and diabetic macular edema in a primary care-based teleophthalmology program for American Indians and Alaskan natives. PLoS One. 2018;13:e0198551.CrossRef
11.
go back to reference Alsaih K, Lemaitre G, Rastgoo M, Massich J, Sidibé D, Meriaudeau F. Machine learning techniques for diabetic macular edema (DME) classification on SD-OCT images. Biomed Eng Online. 2017;16:68.CrossRef Alsaih K, Lemaitre G, Rastgoo M, Massich J, Sidibé D, Meriaudeau F. Machine learning techniques for diabetic macular edema (DME) classification on SD-OCT images. Biomed Eng Online. 2017;16:68.CrossRef
12.
go back to reference Ataer-Cansizoglu E, Bolon-Canedo V, Campbell JP, Bozkurt A, Erdogmus D, Kalpathy-Cramer J, et al. Computer-based image analysis for plus disease diagnosis in retinopathy of prematurity: performance of the "i-ROP" system and image features associated with expert diagnosis. Transl Vis Sci Technol. 2015;4:5.CrossRef Ataer-Cansizoglu E, Bolon-Canedo V, Campbell JP, Bozkurt A, Erdogmus D, Kalpathy-Cramer J, et al. Computer-based image analysis for plus disease diagnosis in retinopathy of prematurity: performance of the "i-ROP" system and image features associated with expert diagnosis. Transl Vis Sci Technol. 2015;4:5.CrossRef
13.
go back to reference Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017;2:230–43.CrossRef Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017;2:230–43.CrossRef
14.
go back to reference Krause J, Gulshan V, Rahimy E, Karth P, Widner K, Corrado GS, et al. Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy. Ophthalmology. 2018;125:1264–72.CrossRef Krause J, Gulshan V, Rahimy E, Karth P, Widner K, Corrado GS, et al. Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy. Ophthalmology. 2018;125:1264–72.CrossRef
15.
go back to reference Wilkinson CP, Ferris FL 3rd, Klein RE, Lee PP, Agardh CD, Davis M, et al. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003;110:1677–82.CrossRef Wilkinson CP, Ferris FL 3rd, Klein RE, Lee PP, Agardh CD, Davis M, et al. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003;110:1677–82.CrossRef
16.
go back to reference Sengupta S, Sindal MD, Besirli CG, Upadhyaya S, Venkatesh R, Niziol LM, et al. Screening for vision-threatening diabetic retinopathy in South India: comparing portable non-mydriatic and standard fundus cameras and clinical exam. Eye (Lond). 2018;32:375–83.CrossRef Sengupta S, Sindal MD, Besirli CG, Upadhyaya S, Venkatesh R, Niziol LM, et al. Screening for vision-threatening diabetic retinopathy in South India: comparing portable non-mydriatic and standard fundus cameras and clinical exam. Eye (Lond). 2018;32:375–83.CrossRef
17.
go back to reference Neubauer AS, Rothschuh A, Ulbig MW, Blum M. Digital fundus image grading with the non-mydriatic Visucam (PRO NM) versus the FF450(plus) camera in diabetic retinopathy. Acta Ophthalmol. 2008;86:177–82.CrossRef Neubauer AS, Rothschuh A, Ulbig MW, Blum M. Digital fundus image grading with the non-mydriatic Visucam (PRO NM) versus the FF450(plus) camera in diabetic retinopathy. Acta Ophthalmol. 2008;86:177–82.CrossRef
18.
go back to reference Phiri R, Keeffe JE, Harper CA, Taylor HR. Comparative study of the polaroid and digital non-mydriatic cameras in the detection of referrable diabetic retinopathy in Australia. Diabet Med. 2006;23:867–72.CrossRef Phiri R, Keeffe JE, Harper CA, Taylor HR. Comparative study of the polaroid and digital non-mydriatic cameras in the detection of referrable diabetic retinopathy in Australia. Diabet Med. 2006;23:867–72.CrossRef
19.
go back to reference Tufail A, Rudisill C, Egan C, Kapetanakis VV, Salas-Vega S, Owen CG, et al. Automated diabetic retinopathy image assessment software: diagnostic accuracy and cost-effectiveness compared with human graders. Ophthalmology. 2017;124:343–51.CrossRef Tufail A, Rudisill C, Egan C, Kapetanakis VV, Salas-Vega S, Owen CG, et al. Automated diabetic retinopathy image assessment software: diagnostic accuracy and cost-effectiveness compared with human graders. Ophthalmology. 2017;124:343–51.CrossRef
20.
go back to reference Sánchez CI, Niemeijer M, Dumitrescu AV, Suttorp-Schulten MS, Abràmoff MD, van Ginneken B. Evaluation of a computer-aided diagnosis system for diabetic retinopathy screening on public data. Invest Ophthalmol Vis Sci. 2011;52:4866–71.CrossRef Sánchez CI, Niemeijer M, Dumitrescu AV, Suttorp-Schulten MS, Abràmoff MD, van Ginneken B. Evaluation of a computer-aided diagnosis system for diabetic retinopathy screening on public data. Invest Ophthalmol Vis Sci. 2011;52:4866–71.CrossRef
21.
go back to reference Abramoff MD, Suttorp-Schulten MS. Web-based screening for diabetic retinopathy in a primary care population: the EyeCheck project. Telemed J E Health. 2005;11:668–74.CrossRef Abramoff MD, Suttorp-Schulten MS. Web-based screening for diabetic retinopathy in a primary care population: the EyeCheck project. Telemed J E Health. 2005;11:668–74.CrossRef
22.
go back to reference Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402–10.CrossRef Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402–10.CrossRef
23.
go back to reference Raju M, Pagidimarri V, Barreto R, Kadam A, Kasivajjala V, Aswath A. Development of a deep learning algorithm for automatic diagnosis of diabetic retinopathy. Stud Health Technol Inform. 2017;245:559–63.PubMed Raju M, Pagidimarri V, Barreto R, Kadam A, Kasivajjala V, Aswath A. Development of a deep learning algorithm for automatic diagnosis of diabetic retinopathy. Stud Health Technol Inform. 2017;245:559–63.PubMed
Metadata
Title
The diagnostic accuracy of an intelligent and automated fundus disease image assessment system with lesion quantitative function (SmartEye) in diabetic patients
Authors
Yi Xu
Yongyi Wang
Bin Liu
Lin Tang
Liangqing Lv
Xin Ke
Saiguang Ling
Lina Lu
Haidong Zou
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Ophthalmology / Issue 1/2019
Electronic ISSN: 1471-2415
DOI
https://doi.org/10.1186/s12886-019-1196-9

Other articles of this Issue 1/2019

BMC Ophthalmology 1/2019 Go to the issue