Skip to main content
Top
Published in: Journal of Digital Imaging 4/2019

Open Access 01-08-2019 | Computed Tomography

The Classification of Renal Cancer in 3-Phase CT Images Using a Deep Learning Method

Authors: Seokmin Han, Sung Il Hwang, Hak Jong Lee

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2019

Login to get access

Abstract

In this research, we exploit an image-based deep learning framework to distinguish three major subtypes of renal cell carcinoma (clear cell, papillary, and chromophobe) using images acquired with computed tomography (CT). A biopsy-proven benchmarking dataset was built from 169 renal cancer cases. In each case, images were acquired at three phases(phase 1, before injection of the contrast agent; phase 2, 1 min after the injection; phase 3, 5 min after the injection). After image acquisition, rectangular ROI (region of interest) in each phase image was marked by radiologists. After cropping the ROIs, a combination weight was multiplied to the three-phase ROI images and the linearly combined images were fed into a deep learning neural network after concatenation. A deep learning neural network was trained to classify the subtypes of renal cell carcinoma, using the drawn ROIs as inputs and the biopsy results as labels. The network showed about 0.85 accuracy, 0.64–0.98 sensitivity, 0.83–0.93 specificity, and 0.9 AUC. The proposed framework which is based on deep learning method and ROIs provided by radiologists showed promising results in renal cell subtype classification. We hope it will help future research on this subject and it can cooperate with radiologists in classifying the subtype of lesion in real clinical situation.
Literature
1.
go back to reference Viktor H et al.: Systemic inflammation in a melanoma patient treated with immune checkpoint inhibitors-an autopsy study. J Immunother Cancer 4, 2016 Viktor H et al.: Systemic inflammation in a melanoma patient treated with immune checkpoint inhibitors-an autopsy study. J Immunother Cancer 4, 2016
3.
go back to reference Cheville JC et al.: Comparisons of outcome and prognostic features among histologic subtypes of renal cell carcinoma. Am J Surg Pathol 27:612–624, 2003CrossRefPubMed Cheville JC et al.: Comparisons of outcome and prognostic features among histologic subtypes of renal cell carcinoma. Am J Surg Pathol 27:612–624, 2003CrossRefPubMed
5.
go back to reference Cheng JZ, Chou YH, Huang CS, Chang YC, Tiu CM, Chen KW, Chen CM: Computer-aided US diagnosis of breast lesions by using cell-based contour grouping. Radiology 255:746–754, 2010CrossRefPubMed Cheng JZ, Chou YH, Huang CS, Chang YC, Tiu CM, Chen KW, Chen CM: Computer-aided US diagnosis of breast lesions by using cell-based contour grouping. Radiology 255:746–754, 2010CrossRefPubMed
6.
go back to reference Giger ML, Karssemeijer N, Schnabel JA: Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. Annu Rev Biomed Eng 15:327–357, 2013CrossRefPubMed Giger ML, Karssemeijer N, Schnabel JA: Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. Annu Rev Biomed Eng 15:327–357, 2013CrossRefPubMed
7.
go back to reference Sun T, Zhang R, Wang J, Li X, Guo X: Computer-aided diagnosis for early-stage lung cancer based on longitudinal and balanced data. PLoS One 8:e63559, 2013CrossRefPubMedPubMedCentral Sun T, Zhang R, Wang J, Li X, Guo X: Computer-aided diagnosis for early-stage lung cancer based on longitudinal and balanced data. PLoS One 8:e63559, 2013CrossRefPubMedPubMedCentral
8.
go back to reference Wang J et al.: Discrimination of breast Cancer with microcalcifications on mammography by deep learning. Sci Rep 6, 2016 Wang J et al.: Discrimination of breast Cancer with microcalcifications on mammography by deep learning. Sci Rep 6, 2016
9.
go back to reference Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, Seong YK: A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol 62:7714–7728, 2017CrossRefPubMed Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, Seong YK: A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol 62:7714–7728, 2017CrossRefPubMed
10.
go back to reference Fenget Z et al.: Machine learning-based quantitative texture analysis of CT images of small renal masses: Differentiation of angiomyolipoma without visible fat from renal cell carcinoma. Eur Radiol 28(4):1625–1633, 2018CrossRef Fenget Z et al.: Machine learning-based quantitative texture analysis of CT images of small renal masses: Differentiation of angiomyolipoma without visible fat from renal cell carcinoma. Eur Radiol 28(4):1625–1633, 2018CrossRef
12.
go back to reference Hussain MA et al.: Collage CNN for renal cell carcinoma detection from CT Machine Learning in Medical Imaging. MLMI 2017. Lect Notes Comput Sci 10541:229–237, 2017CrossRef Hussain MA et al.: Collage CNN for renal cell carcinoma detection from CT Machine Learning in Medical Imaging. MLMI 2017. Lect Notes Comput Sci 10541:229–237, 2017CrossRef
13.
go back to reference Kocaka B et al.: Textural differences between renal cell carcinoma subtypes: Machine learning-based quantitative computed tomography texture analysis with independent external validation. Eur J Radiol 107:149–157, 2018CrossRef Kocaka B et al.: Textural differences between renal cell carcinoma subtypes: Machine learning-based quantitative computed tomography texture analysis with independent external validation. Eur J Radiol 107:149–157, 2018CrossRef
14.
go back to reference Mileto A et al.: Iodine Quantification to Distinguish Clear Cell from Papillary Renal Cell Carcinoma at Dual-Energy Multidetector CT: A Multireader Diagnostic Performance Study. Radiology 273(3):1610–1616, 2014CrossRef Mileto A et al.: Iodine Quantification to Distinguish Clear Cell from Papillary Renal Cell Carcinoma at Dual-Energy Multidetector CT: A Multireader Diagnostic Performance Study. Radiology 273(3):1610–1616, 2014CrossRef
15.
16.
go back to reference Jia Y, et al.: Caffe: Convolutional architecture for fast feature embedding ACM Multimedia 2, 2014 Jia Y, et al.: Caffe: Convolutional architecture for fast feature embedding ACM Multimedia 2, 2014
17.
go back to reference Szegedy C, et al.: Going deeper with convolutions IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015 Szegedy C, et al.: Going deeper with convolutions IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
18.
go back to reference Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35:1285–1298, 2016CrossRefPubMed Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35:1285–1298, 2016CrossRefPubMed
19.
go back to reference Deng J, et al.: Imagenet: A large-scale hierarchical image database. Computer vision and pattern recognition, IEEE Conference on CVPR 2009, 2009 Deng J, et al.: Imagenet: A large-scale hierarchical image database. Computer vision and pattern recognition, IEEE Conference on CVPR 2009, 2009
20.
go back to reference Lévy D, Jain A: Breast Mass Classification from Mammograms using Deep Convolutional Neural Networks arXiv preprint arXiv:1612.00542, 2016 Lévy D, Jain A: Breast Mass Classification from Mammograms using Deep Convolutional Neural Networks arXiv preprint arXiv:1612.00542, 2016
21.
go back to reference Choi S: X-ray image body part clustering using deep convolutional neural network: SNUMedinfo at ImageCLEF 2015 medical clustering task CLEF (Working Notes), 2015 Choi S: X-ray image body part clustering using deep convolutional neural network: SNUMedinfo at ImageCLEF 2015 medical clustering task CLEF (Working Notes), 2015
22.
go back to reference Xu Y, et al.: Gland instance segmentation by deep multichannel side supervision Med Image Comput Comput Assist Interv (MICCAI) 9901:496–504, 2016 Xu Y, et al.: Gland instance segmentation by deep multichannel side supervision Med Image Comput Comput Assist Interv (MICCAI) 9901:496–504, 2016
23.
go back to reference Chen H et al.: Mitosis detection in breast cancer histology images via deep cascaded network Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2016 Chen H et al.: Mitosis detection in breast cancer histology images via deep cascaded network Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. Menlo Park: AAAI Press, 2016
24.
go back to reference Maninis KK, et al.: Deep retinal image understanding. Med Image Comput. Comput. Assist. Interv. (MICCAI), 2016 Maninis KK, et al.: Deep retinal image understanding. Med Image Comput. Comput. Assist. Interv. (MICCAI), 2016
25.
go back to reference Worrall DE, Wilson CM, Brostow GJ: Automated retinopathy of prematurity case detection with convolutional neural networks. International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis (LABELS), 2016, pp 68–76 Worrall DE, Wilson CM, Brostow GJ: Automated retinopathy of prematurity case detection with convolutional neural networks. International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis (LABELS), 2016, pp 68–76
Metadata
Title
The Classification of Renal Cancer in 3-Phase CT Images Using a Deep Learning Method
Authors
Seokmin Han
Sung Il Hwang
Hak Jong Lee
Publication date
01-08-2019
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2019
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00230-2

Other articles of this Issue 4/2019

Journal of Digital Imaging 4/2019 Go to the issue