Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 10/2017

01-10-2017 | Original Article

Pulmonary nodule classification with deep residual networks

Authors: Aiden Nibali, Zhen He, Dennis Wollersheim

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2017

Login to get access

Abstract

Purpose 

Lung cancer has the highest death rate among all cancers in the USA. In this work we focus on improving the ability of computer-aided diagnosis (CAD) systems to predict the malignancy of nodules from cropped CT images of lung nodules.

Methods

We evaluate the effectiveness of very deep convolutional neural networks at the task of expert-level lung nodule malignancy classification. Using the state-of-the-art ResNet architecture as our basis, we explore the effect of curriculum learning, transfer learning, and varying network depth on the accuracy of malignancy classification.

Results

Due to a lack of public datasets with standardized problem definitions and train/test splits, studies in this area tend to not compare directly against other existing work. This makes it hard to know the relative improvement in the new solution. In contrast, we directly compare our system against two state-of-the-art deep learning systems for nodule classification on the LIDC/IDRI dataset using the same experimental setup and data set. The results show that our system achieves the highest performance in terms of all metrics measured including sensitivity, specificity, precision, AUROC, and accuracy.

Conclusions

The proposed method of combining deep residual learning, curriculum learning, and transfer learning translates to high nodule classification accuracy. This reveals a promising new direction for effective pulmonary nodule CAD systems that mirrors the success of recent deep learning advances in other image-based application domains.
Literature
2.
go back to reference Bengio Y, Louradour J, Collobert R, Weston J (2009) Curriculum learning. In: Proceedings of 26th ICML, pp 41–48 Bengio Y, Louradour J, Collobert R, Weston J (2009) Curriculum learning. In: Proceedings of 26th ICML, pp 41–48
3.
go back to reference Ciompi F, de Hoop B, van Riel SJ, Chung K, Scholten ET, Oudkerk M, de Jong PA, Prokop M, van Ginneken B (2015) Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box. Med Image Anal 26(1):195–202CrossRefPubMed Ciompi F, de Hoop B, van Riel SJ, Chung K, Scholten ET, Oudkerk M, de Jong PA, Prokop M, van Ginneken B (2015) Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box. Med Image Anal 26(1):195–202CrossRefPubMed
4.
go back to reference Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36CrossRefPubMed Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36CrossRefPubMed
5.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 29th IEEE CVPR He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 29th IEEE CVPR
7.
go back to reference Hua KL, Hsu CH, Hidayati SC, Cheng WH, Chen YJ (2015) Computer-aided classification of lung nodules on computed tomography images via deep learning technique. OncoTargets Ther 8:2015–2022 Hua KL, Hsu CH, Hidayati SC, Cheng WH, Chen YJ (2015) Computer-aided classification of lung nodules on computed tomography images via deep learning technique. OncoTargets Ther 8:2015–2022
9.
go back to reference Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of 32nd ICML, pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of 32nd ICML, pp 448–456
10.
go back to reference Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of EMNLP 2014 Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of EMNLP 2014
11.
go back to reference Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105
12.
go back to reference Kumar D, Wong A, Clausi DA (2015) Lung nodule classification using deep features in CT images. In: 12th Conference on Computer and Robot Vision, pp. 133–138 Kumar D, Wong A, Clausi DA (2015) Lung nodule classification using deep features in CT images. In: 12th Conference on Computer and Robot Vision, pp. 133–138
13.
go back to reference Kuruvilla J, Gunavathi K (2014) Lung cancer classification using neural networks for CT images. Comput Methods Programs Biomed 113(1):202–209CrossRefPubMed Kuruvilla J, Gunavathi K (2014) Lung cancer classification using neural networks for CT images. Comput Methods Programs Biomed 113(1):202–209CrossRefPubMed
14.
go back to reference LeCun Y, Boser B, Denker JS, Howard RE, Habbard W, Jackel LD, Henderson D (1990) Handwritten digit recognition with a back-propagation network. Adv Neural Inf Process Syst 2:396–404 LeCun Y, Boser B, Denker JS, Howard RE, Habbard W, Jackel LD, Henderson D (1990) Handwritten digit recognition with a back-propagation network. Adv Neural Inf Process Syst 2:396–404
15.
go back to reference Lee MC, Boroczky L, Sungur-Stasik K, Cann AD, Borczuk AC, Kawut SM, Powell CA (2010) Computer-aided diagnosis of pulmonary nodules using a two-step approach for feature selection and classifier ensemble construction. Artif Intell Med 50(1):43–53CrossRefPubMed Lee MC, Boroczky L, Sungur-Stasik K, Cann AD, Borczuk AC, Kawut SM, Powell CA (2010) Computer-aided diagnosis of pulmonary nodules using a two-step approach for feature selection and classifier ensemble construction. Artif Intell Med 50(1):43–53CrossRefPubMed
16.
go back to reference Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HDJO, Alfaro MdJN (2015) Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14:9CrossRef Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HDJO, Alfaro MdJN (2015) Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14:9CrossRef
18.
go back to reference Sermanet P, Eigen D, Zhang X, Mathieu M, Fergus R, LeCun Y (2014) OverFeat: integrated recognition, localization and detection using convolutional networks. In: Proceedings of ICLR 2014 Sermanet P, Eigen D, Zhang X, Mathieu M, Fergus R, LeCun Y (2014) OverFeat: integrated recognition, localization and detection using convolutional networks. In: Proceedings of ICLR 2014
19.
go back to reference Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, Sv Riel, Wille MW, Naqibullah M, Sanchez C, Bv Ginneken (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169 Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, Sv Riel, Wille MW, Naqibullah M, Sanchez C, Bv Ginneken (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169
20.
go back to reference Shen W, Zhou M, Yang F, Yang C, Tian J (2015) Multi-scale convolutional neural networks for lung nodule classification. Inf Process Med Imaging 9123:588–599 Shen W, Zhou M, Yang F, Yang C, Tian J (2015) Multi-scale convolutional neural networks for lung nodule classification. Inf Process Med Imaging 9123:588–599
21.
go back to reference Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap T, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484–489CrossRefPubMed Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap T, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484–489CrossRefPubMed
22.
go back to reference Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: Proceedings of ICLR 2015 Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: Proceedings of ICLR 2015
24.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2014) Going deeper with convolutions. ArXiv Preprint arXiv:1409.4842 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2014) Going deeper with convolutions. ArXiv Preprint arXiv:​1409.​4842
26.
go back to reference Tieleman T, Hinton G (2012) Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude Tieleman T, Hinton G (2012) Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude
27.
go back to reference Toshev A, Szegedy C (2014) DeepPose: human pose estimation via deep neural networks. In: Proceedings of CVPR 2014 Toshev A, Szegedy C (2014) DeepPose: human pose estimation via deep neural networks. In: Proceedings of CVPR 2014
29.
go back to reference Zinovev D, Feigenbaum J, Raicu D, Furst J (2010) Predicting panel ratings for semantic characteristics of lung nodules. Technical Report (2010). http://via.library.depaul.edu/tr/18 Zinovev D, Feigenbaum J, Raicu D, Furst J (2010) Predicting panel ratings for semantic characteristics of lung nodules. Technical Report (2010). http://​via.​library.​depaul.​edu/​tr/​18
Metadata
Title
Pulmonary nodule classification with deep residual networks
Authors
Aiden Nibali
Zhen He
Dennis Wollersheim
Publication date
01-10-2017
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 10/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1605-6

Other articles of this Issue 10/2017

International Journal of Computer Assisted Radiology and Surgery 10/2017 Go to the issue