Skip to main content
Top
Published in: Journal of Medical Systems 5/2020

01-05-2020 | Glaucoma | Image & Signal Processing

Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks

Authors: Zhe Xie, Tonghui Ling, Yuanyuan Yang, Rong Shu, Brent J. Liu

Published in: Journal of Medical Systems | Issue 5/2020

Login to get access

Abstract

Optic disc (OD) and optic cup (OC) segmentation are important steps for automatic screening and diagnosing of optic nerve head abnormalities such as glaucoma. Many recent works formulated the OD and OC segmentation as a pixel classification task. However, it is hard for these methods to explicitly model the spatial relations between the labels in the output mask. Furthermore, the proportion of the background, OD and OC are unbalanced which also may result in a biased model as well as introduce more noise. To address these problems, we developed an approach that follows a coarse-to-fine segmentation process. We start with a U-Net to obtain a rough segmenting boundary and then crop the area around the boundary to form a boundary contour centered image. Second, inspired by sequence labeling tasks in natural language processing, we regard the OD and OC segmentation as a sequence labeling task and propose a novel fully convolutional network called SU-Net and combine it with the Viterbi algorithm to jointly decode the segmentation boundary. We also introduced a geometric parameter-based data augmentation method to generate more training samples in order to minimize the differences between training and test sets and reduce overfitting. Experimental results show that our method achieved state-of-the-art results on 2 datasets for both OD and OC segmentation and our method outperforms most of the ophthalmologists in terms of achieving agreement out of 6 ophthalmologists on the MESSIDOR dataset for both OD and OC segmentation. In terms of glaucoma screening, we achieved the best cup-to-disc ratio (CDR) error and area under the ROC curve (AUC) for glaucoma classification on the Drishti-GS dataset.
Literature
1.
go back to reference Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc
2.
go back to reference Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225 Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225
4.
go back to reference Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications
8.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
9.
go back to reference Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017 Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017
10.
go back to reference Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings
13.
14.
go back to reference Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology” Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology”
18.
go back to reference Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc
20.
go back to reference Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation
22.
go back to reference Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf
23.
go back to reference Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
24.
go back to reference Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014 Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014
29.
go back to reference Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
30.
go back to reference Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016 Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016
31.
go back to reference Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science
32.
go back to reference Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.CrossRef Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.CrossRef
35.
go back to reference Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
38.
go back to reference Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings
39.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
40.
go back to reference Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
43.
go back to reference Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017 Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017
44.
go back to reference Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis
46.
go back to reference Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems
47.
go back to reference Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
48.
go back to reference Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications
51.
go back to reference Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017 Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017
52.
go back to reference Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://doi.org/10.5566/ias.1155 Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://​doi.​org/​10.​5566/​ias.​1155
53.
go back to reference Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014 Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014
54.
go back to reference Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset
55.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Metadata
Title
Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks
Authors
Zhe Xie
Tonghui Ling
Yuanyuan Yang
Rong Shu
Brent J. Liu
Publication date
01-05-2020
Publisher
Springer US
Keyword
Glaucoma
Published in
Journal of Medical Systems / Issue 5/2020
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-020-01561-2

Other articles of this Issue 5/2020

Journal of Medical Systems 5/2020 Go to the issue