Skip to main content
Top
Published in: Journal of Digital Imaging 6/2019

01-12-2019 | Computed Tomography

Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network

Authors: Qin Wang, Fengyi Shen, Linyao Shen, Jia Huang, Weiguang Sheng

Published in: Journal of Imaging Informatics in Medicine | Issue 6/2019

Login to get access

Abstract

Remarkable progress has been made in image classification and segmentation, due to the recent study of deep convolutional neural networks (CNNs). To solve the similar problem of diagnostic lung nodule detection in low-dose computed tomography (CT) scans, we propose a new Computer-Aided Detection (CAD) system using CNNs and CT image segmentation techniques. Unlike former studies focusing on the classification of malignant nodule types or relying on prior image processing, in this work, we put raw CT image patches directly in CNNs to reduce the complexity of the system. Specifically, we split each CT image into several patches, which are divided into 6 types consisting of 3 nodule types and 3 non-nodule types. We compare the performance of ResNet with different CNNs architectures on CT images from a publicly available dataset named the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI). Results show that our best model reaches a high detection sensitivity of 92.8% with 8 false positives per scan (FPs/scan). Compared with related work, our work obtains a state-of-the-art effect.
Appendix
Available only for authorised users
Literature
1.
go back to reference Siegel RL, Miller KD, Jemal A: Cancer statistics, 2015. CA Cancer J Clin 65(1):5–29, 2015CrossRef Siegel RL, Miller KD, Jemal A: Cancer statistics, 2015. CA Cancer J Clin 65(1):5–29, 2015CrossRef
2.
go back to reference Ma L, Wang DD, Zou B, Yan H: An eigen-binding site based method for the analysis of anti-EGFR drug resistance in lung cancer treatment. IEEE/ACM Trans Comput Biol Bioinform 14(5):1187–1194, 2017CrossRef Ma L, Wang DD, Zou B, Yan H: An eigen-binding site based method for the analysis of anti-EGFR drug resistance in lung cancer treatment. IEEE/ACM Trans Comput Biol Bioinform 14(5):1187–1194, 2017CrossRef
3.
go back to reference Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, Moriyama N: Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology 201(3):798–802, 1996CrossRef Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, Moriyama N: Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology 201(3):798–802, 1996CrossRef
4.
go back to reference Jiang H, Ma H, Qian W et al.: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform 22:1227–1237, 2017CrossRef Jiang H, Ma H, Qian W et al.: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform 22:1227–1237, 2017CrossRef
5.
go back to reference Messay T, Hardie RC, Rogers SK: A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Med Image Anal 14(3):390–406, 2010CrossRef Messay T, Hardie RC, Rogers SK: A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Med Image Anal 14(3):390–406, 2010CrossRef
6.
go back to reference Gurcan MN, Sahiner B, Petrick N, Chan HP, Kazerooni EA, Cascade PN, Hadjiiski L: Lung nodule detection on thoracic computed tomography images: Preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002CrossRef Gurcan MN, Sahiner B, Petrick N, Chan HP, Kazerooni EA, Cascade PN, Hadjiiski L: Lung nodule detection on thoracic computed tomography images: Preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002CrossRef
7.
go back to reference Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006, 2014CrossRef Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006, 2014CrossRef
8.
go back to reference Balagurunathan Y, Gu Y, Wang H, Kumar V, Grove O, Hawkins S, Kim J, Goldgof DB, Hall LO, Gatenby RA, Gillies RJ: Reproducibility and prognosis of quantitative features extracted from CT images. Transl Oncol 7(1):72–87, 2014CrossRef Balagurunathan Y, Gu Y, Wang H, Kumar V, Grove O, Hawkins S, Kim J, Goldgof DB, Hall LO, Gatenby RA, Gillies RJ: Reproducibility and prognosis of quantitative features extracted from CT images. Transl Oncol 7(1):72–87, 2014CrossRef
9.
go back to reference Rendon-Gonzalez E, Ponomaryov V: Automatic lung nodule segmentation and classification in CT images based on SVM. International Kharkiv Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves. IEEE 1–4, 2016 Rendon-Gonzalez E, Ponomaryov V: Automatic lung nodule segmentation and classification in CT images based on SVM. International Kharkiv Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves. IEEE 1–4, 2016
10.
go back to reference Lee S L A, Kouzani A Z, Hu E J: A random forest for lung nodule identification. TENCON 2008 - 2008 IEEE Region 10 Conference. IEEE:1–5, 2008 Lee S L A, Kouzani A Z, Hu E J: A random forest for lung nodule identification. TENCON 2008 - 2008 IEEE Region 10 Conference. IEEE:1–5, 2008
12.
go back to reference Shan C: Learning local binary patterns for gender classification on real-world face images. Pattern Recognit Lett 33(4):431–437, 2012CrossRef Shan C: Learning local binary patterns for gender classification on real-world face images. Pattern Recognit Lett 33(4):431–437, 2012CrossRef
13.
go back to reference Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HJO, Alfaro MJN: Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14(1):9, 2015CrossRef Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HJO, Alfaro MJN: Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14(1):9, 2015CrossRef
14.
go back to reference Tartar A, Akan A, Kilic N: A novel approach to malignant-benign classification of pulmonary nodules by using ensemble learning classifiers. Conf Proc IEEE Eng Med Biol Soc: 4651–4654, 2014 Tartar A, Akan A, Kilic N: A novel approach to malignant-benign classification of pulmonary nodules by using ensemble learning classifiers. Conf Proc IEEE Eng Med Biol Soc: 4651–4654, 2014
16.
go back to reference Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z: Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 28(1):99–115, 2015CrossRef Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z: Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 28(1):99–115, 2015CrossRef
18.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A: Going deeper with convolutions. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, 2015. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A: Going deeper with convolutions. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, 2015.
19.
go back to reference Ren S, He K, Girshick R, Sun J: Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst: 91–99, 2015 Ren S, He K, Girshick R, Sun J: Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst: 91–99, 2015
20.
go back to reference Liang-Chieh C, Papandreou G, Kokkinos I, Murphy K, Yuille A: Semantic image segmentation with deep convolutional nets and fully connected crfs. International Conference on Learning Representations, 2015 Liang-Chieh C, Papandreou G, Kokkinos I, Murphy K, Yuille A: Semantic image segmentation with deep convolutional nets and fully connected crfs. International Conference on Learning Representations, 2015
21.
go back to reference Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst:1097–1105, 2012 Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst:1097–1105, 2012
22.
go back to reference Simonyan K, Zisserman A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014 Simonyan K, Zisserman A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014
23.
go back to reference He K, Zhang X, Ren S, Sun J: Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 770–778, 2016 He K, Zhang X, Ren S, Sun J: Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 770–778, 2016
24.
go back to reference Golan R, Jacob C, Denzinger J: Lung nodule detection in CT images using deep convolutional neural networks. International Joint Conference on Neural Networks: 243–250. 2016 Golan R, Jacob C, Denzinger J: Lung nodule detection in CT images using deep convolutional neural networks. International Joint Conference on Neural Networks: 243–250. 2016
25.
go back to reference Wang S, Zhou M, Gevaert O, Tang Z, Dong D, Liu Z, Tian J: A multi-view deep convolutional neural networks for lung nodule segmentation. Conf Proc IEEE Eng Med Biol Soc 2017, 1752–1755 Wang S, Zhou M, Gevaert O, Tang Z, Dong D, Liu Z, Tian J: A multi-view deep convolutional neural networks for lung nodule segmentation. Conf Proc IEEE Eng Med Biol Soc 2017, 1752–1755
27.
go back to reference Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks. 2017 IEEE 14th International Symposium on Biomedical Imaging 379–383, 2017 Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks. 2017 IEEE 14th International Symposium on Biomedical Imaging 379–383, 2017
28.
go back to reference Gu Y, Lu X, Yang L, Zhang B, Yu D, Zhao Y, Gao L, Wu L, Zhou T: Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs. Comput. Biol. Med. 103:220–231, 2018CrossRef Gu Y, Lu X, Yang L, Zhang B, Yu D, Zhao Y, Gao L, Wu L, Zhou T: Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs. Comput. Biol. Med. 103:220–231, 2018CrossRef
29.
go back to reference Zhu W, Liu C, Fan W, Xie X: Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. 2018 IEEE Winter Conf. Appl. Comput. Vision, WACV: 673-681, 2018 Zhu W, Liu C, Fan W, Xie X: Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. 2018 IEEE Winter Conf. Appl. Comput. Vision, WACV: 673-681, 2018
30.
go back to reference Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38(2):915–931, 2011CrossRef Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38(2):915–931, 2011CrossRef
31.
go back to reference Van Ginneken B, Setio AA, Jacobs C, Ciompi F: Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. IEEE Int. Symp. Biomed. Imaging:286–289, 2015 Van Ginneken B, Setio AA, Jacobs C, Ciompi F: Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. IEEE Int. Symp. Biomed. Imaging:286–289, 2015
32.
go back to reference Han F, Zhang G, Wang H, et al: A texture feature analysis for diagnosis of pulmonary nodules using LIDC-IDRI database. IEEE International Conference on Medical Imaging Physics and Engineering, 2014, 14–18. Han F, Zhang G, Wang H, et al: A texture feature analysis for diagnosis of pulmonary nodules using LIDC-IDRI database. IEEE International Conference on Medical Imaging Physics and Engineering, 2014, 14–18.
33.
go back to reference Htwe K Z, Yamamori K, Katayama T, Kyi T M: Automated lung nodule classification by artificial neural network and fuzzy inference system. Consumer Electronics, 2016 IEEE, Global Conference on IEEE, 2016 1–2. Htwe K Z, Yamamori K, Katayama T, Kyi T M: Automated lung nodule classification by artificial neural network and fuzzy inference system. Consumer Electronics, 2016 IEEE, Global Conference on IEEE, 2016 1–2.
34.
go back to reference Van Ginneken B, Armato SG, de Hoop B, van Amelsvoort-van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham A, Retico A, Fantacci ME, Camarlinghi N: Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image Anal 14(6):707–722, 2011CrossRef Van Ginneken B, Armato SG, de Hoop B, van Amelsvoort-van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham A, Retico A, Fantacci ME, Camarlinghi N: Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image Anal 14(6):707–722, 2011CrossRef
35.
go back to reference Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874, 2006CrossRef Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874, 2006CrossRef
36.
go back to reference Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, Wille MMW, Naqibullah M, Sanchez CI, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169, 2016CrossRef Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, Wille MMW, Naqibullah M, Sanchez CI, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169, 2016CrossRef
37.
go back to reference Jiang H, Ma H, Qian W, Gao M, Li Y: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform (99):1–1, 2017 Jiang H, Ma H, Qian W, Gao M, Li Y: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform (99):1–1, 2017
38.
go back to reference Khosravan N, Bagci U: S4ND: Single-shot single-scale lung nodule detection. Med Image Comput Comput Assist Interv:794–802, 2018 Khosravan N, Bagci U: S4ND: Single-shot single-scale lung nodule detection. Med Image Comput Comput Assist Interv:794–802, 2018
39.
go back to reference Broyelle A: Automated Pulmonary Nodule Detection on Computed Tomography Images with 3D Deep Convolutional Neural Network, School of Computer Science and Communication KTHRoyal Institute of Technology, Stockholm 2018. Broyelle A: Automated Pulmonary Nodule Detection on Computed Tomography Images with 3D Deep Convolutional Neural Network, School of Computer Science and Communication KTHRoyal Institute of Technology, Stockholm 2018.
40.
go back to reference Dou Q, Chen H, Jin Y, Lin H, Qin J, Heng PA: Automated pulmonary nodule detection via 3d convnets with online sample filtering and hybrid-loss residual learning. Med Image Comput Comput Assist Interv:630–638, 2017 Dou Q, Chen H, Jin Y, Lin H, Qin J, Heng PA: Automated pulmonary nodule detection via 3d convnets with online sample filtering and hybrid-loss residual learning. Med Image Comput Comput Assist Interv:630–638, 2017
Metadata
Title
Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network
Authors
Qin Wang
Fengyi Shen
Linyao Shen
Jia Huang
Weiguang Sheng
Publication date
01-12-2019
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 6/2019
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00221-3

Other articles of this Issue 6/2019

Journal of Digital Imaging 6/2019 Go to the issue