Skip to main content
Top
Published in: Journal of Digital Imaging 3/2019

01-06-2019 | Computed Tomography

Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images

Authors: Lijun Zhao, Zixiao Lu, Jun Jiang, Yujia Zhou, Yi Wu, Qianjin Feng

Published in: Journal of Imaging Informatics in Medicine | Issue 3/2019

Login to get access

Abstract

Nasopharyngeal carcinoma (NPC) is prevalent in certain areas, such as South China, Southeast Asia, and the Middle East. Radiation therapy is the most efficient means to treat this malignant tumor. Positron emission tomography–computed tomography (PET-CT) is a suitable imaging technique to assess this disease. However, the large amount of data produced by numerous patients causes traditional manual delineation of tumor contour, a basic step for radiotherapy, to become time-consuming and labor-intensive. Thus, the demand for automatic and credible segmentation methods to alleviate the workload of radiologists is increasing. This paper presents a method that uses fully convolutional networks with auxiliary paths to achieve automatic segmentation of NPC on PET-CT images. This work is the first to segment NPC using dual-modality PET-CT images. This technique is identical to what is used in clinical practice and offers considerable convenience for subsequent radiotherapy. The deep supervision introduced by auxiliary paths can explicitly guide the training of lower layers, thus enabling these layers to learn more representative features and improve the discriminative capability of the model. Results of threefold cross-validation with a mean dice score of 87.47% demonstrate the efficiency and robustness of the proposed method. The method remarkably outperforms state-of-the-art methods in NPC segmentation. We also validated by experiments that the registration process among different subjects and the auxiliary paths strategy are considerably useful techniques for learning discriminative features and improving segmentation performance.
Literature
1.
go back to reference Tang LL, Chen WQ, Xue WQ: Global trends in incidence and mortality of nasopharyngeal carcinoma. Cancer Lett 374(1):22–30, 2016CrossRef Tang LL, Chen WQ, Xue WQ: Global trends in incidence and mortality of nasopharyngeal carcinoma. Cancer Lett 374(1):22–30, 2016CrossRef
2.
go back to reference Wu HB, Wang QS, Wang MF: Preliminary study of 11C-choline PET/CT for T staging of locally advanced nasopharyngeal carcinoma: comparison with 18F-FDG PET/CT. J Nucl Med 52(3):341–346, 2011CrossRef Wu HB, Wang QS, Wang MF: Preliminary study of 11C-choline PET/CT for T staging of locally advanced nasopharyngeal carcinoma: comparison with 18F-FDG PET/CT. J Nucl Med 52(3):341–346, 2011CrossRef
3.
go back to reference Huang W, Chan KL, Zhou JY: Region-Based Nasopharyngeal Carcinoma Lesion Segmentation from MRI Using Clustering- and Classification-Based Methods with Learning. J Digit Imaging 26(3):472–482, 2013CrossRefPubMed Huang W, Chan KL, Zhou JY: Region-Based Nasopharyngeal Carcinoma Lesion Segmentation from MRI Using Clustering- and Classification-Based Methods with Learning. J Digit Imaging 26(3):472–482, 2013CrossRefPubMed
4.
go back to reference Han DF, Bayouth J, Song Q: Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-Segmentation Method. International Conference on Information Processing in Medical Imaging, 2011, pp 245–256 Han DF, Bayouth J, Song Q: Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-Segmentation Method. International Conference on Information Processing in Medical Imaging, 2011, pp 245–256
5.
6.
go back to reference Ju W, Xiang D, Zhang B: Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images. IEEE Trans Image Process 24(12):5854–5867, 2015CrossRefPubMed Ju W, Xiang D, Zhang B: Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images. IEEE Trans Image Process 24(12):5854–5867, 2015CrossRefPubMed
7.
go back to reference Éloïse C, Talbot H, Passat N: Automated 3D lymphoma lesion segmentation from PET/CT characteristic. IEEE International Symposium on Biomedical Imaging, 2017, pp 174–178 Éloïse C, Talbot H, Passat N: Automated 3D lymphoma lesion segmentation from PET/CT characteristic. IEEE International Symposium on Biomedical Imaging, 2017, pp 174–178
8.
go back to reference Wang Y, Zu C, Hu GL: Automatic Tumor Segmentation with Deep Convolutional Neural Networks for Radiotherapy Applications. Neural Process Lett 10:1–12, 2018 Wang Y, Zu C, Hu GL: Automatic Tumor Segmentation with Deep Convolutional Neural Networks for Radiotherapy Applications. Neural Process Lett 10:1–12, 2018
9.
go back to reference Tatanun C, Ritthipravat P, Bhongmakapat T: Automatic segmentation of nasopharyngeal carcinoma from CT images: Region growing based technique. 2010 2nd International Conference on Signal Processing System, 2010, pp 18–22 Tatanun C, Ritthipravat P, Bhongmakapat T: Automatic segmentation of nasopharyngeal carcinoma from CT images: Region growing based technique. 2010 2nd International Conference on Signal Processing System, 2010, pp 18–22
10.
go back to reference Chanapai W, Bhongmakapat T, Tuntiyatorn L: Nasopharyngeal carcinoma segmentation using a region growing technique. Int J Comput Assist Radiol Surg 7(3):413–422, 2012CrossRefPubMed Chanapai W, Bhongmakapat T, Tuntiyatorn L: Nasopharyngeal carcinoma segmentation using a region growing technique. Int J Comput Assist Radiol Surg 7(3):413–422, 2012CrossRefPubMed
11.
go back to reference Huang KW, Zhao ZY, Gong Q: Nasopharyngeal carcinoma segmentation via HMRF-EM with maximum entropy. Eng Med Biol Soc:2968–2972, 2015 Huang KW, Zhao ZY, Gong Q: Nasopharyngeal carcinoma segmentation via HMRF-EM with maximum entropy. Eng Med Biol Soc:2968–2972, 2015
12.
go back to reference Fitton I, Cornelissen SA, Duppen JC: Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. Med Phys 38(8):4662–4666, 2011CrossRefPubMed Fitton I, Cornelissen SA, Duppen JC: Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. Med Phys 38(8):4662–4666, 2011CrossRefPubMed
13.
go back to reference Wu PX, Khong PL, Chan T: Automatic detection and classification of nasopharyngeal carcinoma on PET/CT with support vector machine. Int J Comput Assist Radiol Surg 7(4):635–646, 2012CrossRefPubMed Wu PX, Khong PL, Chan T: Automatic detection and classification of nasopharyngeal carcinoma on PET/CT with support vector machine. Int J Comput Assist Radiol Surg 7(4):635–646, 2012CrossRefPubMed
14.
go back to reference Mohammed MA, Ghani MKA, Hamed RI: Artificial neural networks for automatic segmentation and identification of nasopharyngeal carcinoma. J Comput Sci 21:263–274, 2017CrossRef Mohammed MA, Ghani MKA, Hamed RI: Artificial neural networks for automatic segmentation and identification of nasopharyngeal carcinoma. J Comput Sci 21:263–274, 2017CrossRef
15.
go back to reference Men K, Chen X, Zhang Y: Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images. Front Oncol 7:315–323, 2017CrossRefPubMedPubMedCentral Men K, Chen X, Zhang Y: Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images. Front Oncol 7:315–323, 2017CrossRefPubMedPubMedCentral
16.
go back to reference Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, pp 234–241 Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, pp 234–241
17.
go back to reference Brosch T, Tang L, Yoo YJ: Deep 3D Convolutional Encoder Networks with Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation. IEEE Trans Med Imaging 35(5):1229–1239, 2016CrossRefPubMed Brosch T, Tang L, Yoo YJ: Deep 3D Convolutional Encoder Networks with Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation. IEEE Trans Med Imaging 35(5):1229–1239, 2016CrossRefPubMed
18.
go back to reference Milletari F, Navab N, Ahmadi S: V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. Fourth International Conference on 3d Vision, 2016, pp 565–571 Milletari F, Navab N, Ahmadi S: V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. Fourth International Conference on 3d Vision, 2016, pp 565–571
19.
go back to reference Dong H, Yang G, Liu F D: Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks. Conference on Medical Image Understanding and Analysis, 2017, pp 506–517 Dong H, Yang G, Liu F D: Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks. Conference on Medical Image Understanding and Analysis, 2017, pp 506–517
20.
go back to reference Christ PF, Ettlinger F, Grün F: Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. arXiv preprint (arXiv:1702.05970v2), 2017 Christ PF, Ettlinger F, Grün F: Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. arXiv preprint (arXiv:1702.05970v2), 2017
21.
go back to reference Kamnitsas K, Ledig C, Newcombe VFJ: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78, 2017CrossRefPubMed Kamnitsas K, Ledig C, Newcombe VFJ: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78, 2017CrossRefPubMed
22.
go back to reference Ioffe S, Szegedy C: Batch normalization: Accelerating deep network training by reducing internal covariate shift. International Conference on International Conference on Mach Learn, 2015, pp 448–456 Ioffe S, Szegedy C: Batch normalization: Accelerating deep network training by reducing internal covariate shift. International Conference on International Conference on Mach Learn, 2015, pp 448–456
23.
go back to reference Dou Q, Yu L, Chen H: 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41:40–54, 2017CrossRefPubMed Dou Q, Yu L, Chen H: 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41:40–54, 2017CrossRefPubMed
24.
go back to reference Tseng K L, Lin Y L, Hus W: Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation. arXiv preprint (arXiv:1704.07754), 2017 Tseng K L, Lin Y L, Hus W: Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation. arXiv preprint (arXiv:1704.07754), 2017
25.
go back to reference Pereira S, Pinto A, Alves V: Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. IEEE Trans Med Imaging 35(5):1240–1251, 2016CrossRefPubMed Pereira S, Pinto A, Alves V: Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. IEEE Trans Med Imaging 35(5):1240–1251, 2016CrossRefPubMed
26.
go back to reference He KM, Zhang XY, Ren SQ: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE international conference on computer vision, 2015, pp 1026–1034 He KM, Zhang XY, Ren SQ: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE international conference on computer vision, 2015, pp 1026–1034
27.
go back to reference Dice LR: Measures of the Amount of Ecologic Association Between Species. Ecology 26(3):297–302, 1945CrossRef Dice LR: Measures of the Amount of Ecologic Association Between Species. Ecology 26(3):297–302, 1945CrossRef
Metadata
Title
Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images
Authors
Lijun Zhao
Zixiao Lu
Jun Jiang
Yujia Zhou
Yi Wu
Qianjin Feng
Publication date
01-06-2019
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 3/2019
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-018-00173-0

Other articles of this Issue 3/2019

Journal of Digital Imaging 3/2019 Go to the issue