Skip to main content
Top
Published in: Journal of Digital Imaging 4/2020

01-08-2020 | Original Paper

An Embedded Multi-branch 3D Convolution Neural Network for False Positive Reduction in Lung Nodule Detection

Authors: Wangxia Zuo, Fuqiang Zhou, Yuzhu He

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2020

Login to get access

Abstract

Numerous lung nodule candidates can be produced through an automated lung nodule detection system. Classifying these candidates to reduce false positives is an important step in the detection process. The objective during this paper is to predict real nodules from a large number of pulmonary nodule candidates. Facing the challenge of the classification task, we propose a novel 3D convolution neural network (CNN) to reduce false positives in lung nodule detection. The novel 3D CNN includes embedded multiple branches in its structure. Each branch processes a feature map from a layer with different depths. All of these branches are cascaded at their ends; thus, features from different depth layers are combined to predict the categories of candidates. The proposed method obtains a competitive score in lung nodule candidate classification on LUNA16 dataset with an accuracy of 0.9783, a sensitivity of 0.8771, a precision of 0.9426, and a specificity of 0.9925. Moreover, a good performance on the competition performance metric (CPM) is also obtained with a score of 0.830. As a 3D CNN, the proposed model can learn complete and three-dimensional discriminative information about nodules and non-nodules to avoid some misidentification problems caused due to lack of spatial correlation information extracted from traditional methods or 2D networks. As an embedded multi-branch structure, the model is also more effective in recognizing the nodules of various shapes and sizes. As a result, the proposed method gains a competitive score on the false positive reduction in lung nodule detection and can be used as a reference for classifying nodule candidates.
Literature
1.
go back to reference Demir Ö, Yılmaz ÇA: Computer-aided detection of lung nodules using outer surface features. Biomed Mater Eng 26(s1):S1213–S1222, 2015PubMed Demir Ö, Yılmaz ÇA: Computer-aided detection of lung nodules using outer surface features. Biomed Mater Eng 26(s1):S1213–S1222, 2015PubMed
2.
go back to reference Teramoto A, Fujita H, Yamamuro O, Tamaki T: Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. Med Phys 43(6):2821–2827, 2016CrossRef Teramoto A, Fujita H, Yamamuro O, Tamaki T: Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. Med Phys 43(6):2821–2827, 2016CrossRef
3.
go back to reference Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel S, Wille MW, Naqibullah M, Sanchez C, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging,2016. https://doi.org/10.1109/TMI.2016.2536809 Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel S, Wille MW, Naqibullah M, Sanchez C, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging,2016. https://​doi.​org/​10.​1109/​TMI.​2016.​2536809
4.
go back to reference Setio AAA et al.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med Image Anal 42:1–13, 2017CrossRef Setio AAA et al.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med Image Anal 42:1–13, 2017CrossRef
5.
go back to reference Le L, Devarakota P, Vikal S et al.: Computer Aided Diagnosis Using Multilevel Image Features on Large-Scale Evaluation. Lect Notes Comput Sci:161–174, 2013 Le L, Devarakota P, Vikal S et al.: Computer Aided Diagnosis Using Multilevel Image Features on Large-Scale Evaluation. Lect Notes Comput Sci:161–174, 2013
6.
go back to reference Aggarwal P, Vig R, Sardana HK: Patient-Wise Versus Nodule-Wise Classification of Annotated Pulmonary Nodules using Pathologically Confirmed Cases. J Comput 8(9), 2013 Aggarwal P, Vig R, Sardana HK: Patient-Wise Versus Nodule-Wise Classification of Annotated Pulmonary Nodules using Pathologically Confirmed Cases. J Comput 8(9), 2013
7.
go back to reference Jacobs C, van Rikxoort EM, Twellmann T, Scholten ET, de Jong PA, Kuhnigk JM, Oudkerk M, de Koning HJ, Prokop M, Schaefer-Prokop C, van Ginneken B: Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images. Med Image Anal 18:374–384, 2014CrossRef Jacobs C, van Rikxoort EM, Twellmann T, Scholten ET, de Jong PA, Kuhnigk JM, Oudkerk M, de Koning HJ, Prokop M, Schaefer-Prokop C, van Ginneken B: Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images. Med Image Anal 18:374–384, 2014CrossRef
9.
go back to reference Zagoruyko S, Komodakis N: Wide residual networks. arXiv preprint arXiv:arXiv:1605.07146, 2016 Zagoruyko S, Komodakis N: Wide residual networks. arXiv preprint arXiv:arXiv:1605.07146, 2016
10.
go back to reference Anirudh R: Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data[C]//. SPIE Medical Imaging:978532, 2016 Anirudh R: Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data[C]//. SPIE Medical Imaging:978532, 2016
11.
go back to reference Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks[C]// IEEE, International Symposium on Biomedical Imaging. IEEE, 2017 Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks[C]// IEEE, International Symposium on Biomedical Imaging. IEEE, 2017
12.
go back to reference Dou Q, Chen H, Yu L et al.: Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection. IEEE Trans Biomed Eng 64(7):1558–1567, 2016CrossRef Dou Q, Chen H, Yu L et al.: Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection. IEEE Trans Biomed Eng 64(7):1558–1567, 2016CrossRef
13.
go back to reference Ioffe S, Szegedy C: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. 2015 Ioffe S, Szegedy C: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. 2015
14.
go back to reference Santurkar S, Tsipras D, Ilyas A, et al: How Does Batch Normalization Help Optimization?. 2018 Santurkar S, Tsipras D, Ilyas A, et al: How Does Batch Normalization Help Optimization?. 2018
16.
go back to reference Armato, III SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA, MacMahon H, van Beek EJR, Yankelevitz D et al.: The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A completed reference database of lung nodules on CT scans. Med Phys 38:915–931, 2011CrossRef Armato, III SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA, MacMahon H, van Beek EJR, Yankelevitz D et al.: The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A completed reference database of lung nodules on CT scans. Med Phys 38:915–931, 2011CrossRef
17.
go back to reference Eman M, Nourhan Z, Mahmoud F: Automatic Classification of Normal and Cancer Lung CT Images Using Multiscale AM-FM Features. Int J Biomed Imaging 2015:1–7, 2015 Eman M, Nourhan Z, Mahmoud F: Automatic Classification of Normal and Cancer Lung CT Images Using Multiscale AM-FM Features. Int J Biomed Imaging 2015:1–7, 2015
18.
go back to reference Murphy K, van Ginneken B, Schilham AMR, de Hoop BJ, Gietema HA, Prokop M: A large scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification. Med Image Anal 13:757–770, 2009CrossRef Murphy K, van Ginneken B, Schilham AMR, de Hoop BJ, Gietema HA, Prokop M: A large scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification. Med Image Anal 13:757–770, 2009CrossRef
19.
go back to reference Shen W, Zhou M, Yang F, Yu D, Dong D, Yang C et al.: Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification. Pattern Recogn 61:663–673, 2017CrossRef Shen W, Zhou M, Yang F, Yu D, Dong D, Yang C et al.: Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification. Pattern Recogn 61:663–673, 2017CrossRef
20.
go back to reference Zhu W, et al: Deep lung: 3D deep convolutional nets for automated pulmonary nodule detection and classification, Arxiv 2017 [online]. Avaiable: arXiv: 1709.5538 Zhu W, et al: Deep lung: 3D deep convolutional nets for automated pulmonary nodule detection and classification, Arxiv 2017 [online]. Avaiable: arXiv: 1709.5538
21.
go back to reference Shen W, Zhou M, Yang F, Yang C, Tian J: Multi-scale Convolutional Neural Networks for Lung Nodule Classification. Inf Process Med Imaging 24:588–599, 2015PubMed Shen W, Zhou M, Yang F, Yang C, Tian J: Multi-scale Convolutional Neural Networks for Lung Nodule Classification. Inf Process Med Imaging 24:588–599, 2015PubMed
22.
go back to reference Yan X, Pang J, Qi H, Zhu Y, Bai C, Geng X, Liu M, Terzopoulos D, Ding X: Classification of lung nodule malignancy risk on computed tomography images using convolutional neural network: A comparison between 2d and 3d strategies. In ACCV, 2016 Yan X, Pang J, Qi H, Zhu Y, Bai C, Geng X, Liu M, Terzopoulos D, Ding X: Classification of lung nodule malignancy risk on computed tomography images using convolutional neural network: A comparison between 2d and 3d strategies. In ACCV, 2016
23.
go back to reference Farahani FV, Ahmadi A, Zarandi MHF: Lung nodule diagnosis from CT images based on ensemble learning[C]// Computational Intelligence in Bioinformatics & Computational Biology. IEEE, 2015 Farahani FV, Ahmadi A, Zarandi MHF: Lung nodule diagnosis from CT images based on ensemble learning[C]// Computational Intelligence in Bioinformatics & Computational Biology. IEEE, 2015
24.
go back to reference van Ginneken B, Armato SG, de Hoop B, van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham AMR, Retico A, Fantacci ME, Camarlinghi N, Bagagli F, Gori I, Hara T, Fujita H, Gargano G, Belloti R, Carlo FD, Megna R, Tangaro S, Bolanos L, Cerello P, Cheran SC, Torres EL, Prokop M: Comparing and combining algorithms for computeraided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image, 2010 van Ginneken B, Armato SG, de Hoop B, van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham AMR, Retico A, Fantacci ME, Camarlinghi N, Bagagli F, Gori I, Hara T, Fujita H, Gargano G, Belloti R, Carlo FD, Megna R, Tangaro S, Bolanos L, Cerello P, Cheran SC, Torres EL, Prokop M: Comparing and combining algorithms for computeraided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image, 2010
Metadata
Title
An Embedded Multi-branch 3D Convolution Neural Network for False Positive Reduction in Lung Nodule Detection
Authors
Wangxia Zuo
Fuqiang Zhou
Yuzhu He
Publication date
01-08-2020
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2020
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-020-00326-0

Other articles of this Issue 4/2020

Journal of Digital Imaging 4/2020 Go to the issue