Skip to main content
Top
Published in: Journal of Digital Imaging 1/2020

01-02-2020 | Computed Tomography

Fully Automated Lung Lobe Segmentation in Volumetric Chest CT with 3D U-Net: Validation with Intra- and Extra-Datasets

Authors: Jongha Park, Jihye Yun, Namkug Kim, Beomhee Park, Yongwon Cho, Hee Jun Park, Mijeong Song, Minho Lee, Joon Beom Seo

Published in: Journal of Imaging Informatics in Medicine | Issue 1/2020

Login to get access

Abstract

Lung lobe segmentation in chest CT has been used for the analysis of lung functions and surgical planning. However, accurate lobe segmentation is difficult as 80% of patients have incomplete and/or fake fissures. Furthermore, lung diseases such as chronic obstructive pulmonary disease (COPD) can increase the difficulty of differentiating the lobar fissures. Lobar fissures have similar intensities to those of the vessels and airway wall, which could lead to segmentation error in automated segmentation. In this study, a fully automated lung lobe segmentation method with 3D U-Net was developed and validated with internal and external datasets. The volumetric chest CT scans of 196 normal and mild-to-moderate COPD patients from three centers were obtained. Each scan was segmented using a conventional image processing method and manually corrected by an expert thoracic radiologist to create gold standards. The lobe regions in the CT images were then segmented using a 3D U-Net architecture with a deep convolutional neural network (CNN) using separate training, validation, and test datasets. In addition, 40 independent external CT images were used to evaluate the model. The segmentation results for both the conventional and deep learning methods were compared quantitatively to the gold standards using four accuracy metrics including the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD). In internal validation, the segmentation method achieved high accuracy for the DSC, JSC, MSD, and HSD (0.97 ± 0.02, 0.94 ± 0.03, 0.69 ± 0.36, and 17.12 ± 11.07, respectively). In external validation, high accuracy was also obtained for the DSC, JSC, MSD, and HSD (0.96 ± 0.02, 0.92 ± 0.04, 1.31 ± 0.56, and 27.89 ± 7.50, respectively). This method took 6.49 ± 1.19 s and 8.61 ± 1.08 s for lobe segmentation of the left and right lungs, respectively. Although various automatic lung lobe segmentation methods have been developed, it is difficult to develop a robust segmentation method. However, the deep learning–based 3D U-Net method showed reasonable segmentation accuracy and computational time. In addition, this method could be adapted and applied to severe lung diseases in a clinical workflow.
Literature
1.
go back to reference Doel T, Gavaghan DJ, Grau V: Review of automatic pulmonary lobe segmentation methods from CT. Comput Med Imaging Graph 40:13–29, 2015CrossRef Doel T, Gavaghan DJ, Grau V: Review of automatic pulmonary lobe segmentation methods from CT. Comput Med Imaging Graph 40:13–29, 2015CrossRef
2.
go back to reference Jeffery PK: Structural and inflammatory changes in COPD: a comparison with asthma. Thorax 53(2):129–136, 1998CrossRef Jeffery PK: Structural and inflammatory changes in COPD: a comparison with asthma. Thorax 53(2):129–136, 1998CrossRef
3.
go back to reference Leung AN: Pulmonary tuberculosis: The essentials. Radiology 210(2):307–322, 1999CrossRef Leung AN: Pulmonary tuberculosis: The essentials. Radiology 210(2):307–322, 1999CrossRef
4.
5.
go back to reference European, R. S., & American Thoracic Society: American Thoracic Society/European Respiratory Society international multidisciplinary consensus classification of the idiopathic interstitial pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors, June 2001 and by the ERS executive committee, June 2001. Am J Respir Crit Care Med 165(2):277, 2002CrossRef European, R. S., & American Thoracic Society: American Thoracic Society/European Respiratory Society international multidisciplinary consensus classification of the idiopathic interstitial pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors, June 2001 and by the ERS executive committee, June 2001. Am J Respir Crit Care Med 165(2):277, 2002CrossRef
6.
go back to reference Lassen B, Kuhnigk JM, Friman O, Krass S, Peitgen HO: Automatic segmentation of lung lobes in CT images based on fissures, vessels, and bronchi. In Biomedical imaging: From Nano to macro, 2010 IEEE international symposium on. IEEE, 2010, pp 560–563. Lassen B, Kuhnigk JM, Friman O, Krass S, Peitgen HO: Automatic segmentation of lung lobes in CT images based on fissures, vessels, and bronchi. In Biomedical imaging: From Nano to macro, 2010 IEEE international symposium on. IEEE, 2010, pp 560–563.
7.
go back to reference Lassen B, Kuhnigk JM, Schmidt M, Krass S, Peitgen HO: Lung and lung lobe segmentation methods at Fraunhofer MEVIS. In: Fourth international workshop on pulmonary image analysis, vol. 18. 2011, pp 185–99 Lassen B, Kuhnigk JM, Schmidt M, Krass S, Peitgen HO: Lung and lung lobe segmentation methods at Fraunhofer MEVIS. In: Fourth international workshop on pulmonary image analysis, vol. 18. 2011, pp 185–99
8.
go back to reference Zhang L, Hoffman EA, Reinhardt JM: Atlas-driven lung lobe segmentation in volumetric X-ray CT images. IEEE Trans Med Imaging 25(1):1–16, 2006CrossRef Zhang L, Hoffman EA, Reinhardt JM: Atlas-driven lung lobe segmentation in volumetric X-ray CT images. IEEE Trans Med Imaging 25(1):1–16, 2006CrossRef
9.
go back to reference Pu J, Zheng B, Leader JK, Fuhrman C, Knollmann F, Klym A, Gur D: Pulmonary lobe segmentation in CT examinations using implicit surface fitting. IEEE Trans Med Imaging 28(12):1986–1996, 2009CrossRef Pu J, Zheng B, Leader JK, Fuhrman C, Knollmann F, Klym A, Gur D: Pulmonary lobe segmentation in CT examinations using implicit surface fitting. IEEE Trans Med Imaging 28(12):1986–1996, 2009CrossRef
10.
go back to reference Kuhnigk JM, Hahn H, Hindennach M, Dicken V, Krass S, Peitgen HO: Lung lobe segmentation by anatomy-guided 3D watershed transform. In: Medical Imaging 2003: Image Processing, vol. 5032. International Society for Optics and Photonics, 2003, pp 1482–1491 Kuhnigk JM, Hahn H, Hindennach M, Dicken V, Krass S, Peitgen HO: Lung lobe segmentation by anatomy-guided 3D watershed transform. In: Medical Imaging 2003: Image Processing, vol. 5032. International Society for Optics and Photonics, 2003, pp 1482–1491
11.
go back to reference Zhang L, Hoffman EA, Reinhardt JM: Lung lobe segmentation by graph search with 3D shape constraints. In: Medical Imaging 2001: Physiology and Function from Multidimensional Images, vol. 4321. International Society for Optics and Photonics, 2001, pp 204–216 Zhang L, Hoffman EA, Reinhardt JM: Lung lobe segmentation by graph search with 3D shape constraints. In: Medical Imaging 2001: Physiology and Function from Multidimensional Images, vol. 4321. International Society for Optics and Photonics, 2001, pp 204–216
12.
go back to reference Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ:. Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2017, pp 621–629 Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ:. Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2017, pp 621–629
13.
go back to reference George K, Harrison AP, Jin D, Xu Z, Mollura DJ: Pathological pulmonary lobe segmentation from CT images using progressive holistically nested neural networks and random Walker. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Cham: Springer, 2017, pp. 195–203CrossRef George K, Harrison AP, Jin D, Xu Z, Mollura DJ: Pathological pulmonary lobe segmentation from CT images using progressive holistically nested neural networks and random Walker. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Cham: Springer, 2017, pp. 195–203CrossRef
14.
go back to reference Meenakshi S, Manjunath KY, Balasubramanyam V: Morphological variations of the lung fissures and lobes. Indian J Chest Dis Allied Sci 46:179–182, 2004PubMed Meenakshi S, Manjunath KY, Balasubramanyam V: Morphological variations of the lung fissures and lobes. Indian J Chest Dis Allied Sci 46:179–182, 2004PubMed
15.
go back to reference Leader JK, Zheng B, Rogers RM, Sciurba FC, Perez A, Chapman BE, … Gur D: Automated lung segmentation in X-ray computed tomography: Development and evaluation of a heuristic threshold-based scheme 1. Acad Radiol 10(11):1224–1236,2003 Leader JK, Zheng B, Rogers RM, Sciurba FC, Perez A, Chapman BE, … Gur D: Automated lung segmentation in X-ray computed tomography: Development and evaluation of a heuristic threshold-based scheme 1. Acad Radiol 10(11):1224–1236,2003
16.
go back to reference Duda RO, Hart PE: Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15, 1972CrossRef Duda RO, Hart PE: Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15, 1972CrossRef
17.
go back to reference Lee YJ, Lee M, Kim N, Seo JB, Park JY: Automatic left and right lung separation using free-formed surface fitting on volumetric CT. J Digit Imaging 27(4):538–547, 2014CrossRef Lee YJ, Lee M, Kim N, Seo JB, Park JY: Automatic left and right lung separation using free-formed surface fitting on volumetric CT. J Digit Imaging 27(4):538–547, 2014CrossRef
18.
go back to reference D’Errico J: Surface fitting using Gridfit. In: Matlab Central File Exchange. 2006 D’Errico J: Surface fitting using Gridfit. In: Matlab Central File Exchange. 2006
19.
go back to reference Dillencourt MB, Samet H, Tamminen M: A general approach to connected-component labeling for arbitrary image representations. J ACM (JACM) 39(2):253–280, 1992CrossRef Dillencourt MB, Samet H, Tamminen M: A general approach to connected-component labeling for arbitrary image representations. J ACM (JACM) 39(2):253–280, 1992CrossRef
20.
go back to reference Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3D U-net: Learning dense volumetric segmentation from sparse annotation. In International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2016, pp 424–432 Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3D U-net: Learning dense volumetric segmentation from sparse annotation. In International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2016, pp 424–432
21.
go back to reference Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2015, pp 234–241 Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer, 2015, pp 234–241
22.
go back to reference Long J, Shelhamer E, Darrell T: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015, pp 3431–3440 Long J, Shelhamer E, Darrell T: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015, pp 3431–3440
23.
go back to reference Sørensen T: A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons. Biol Skr 5:1–34, 1948 Sørensen T: A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons. Biol Skr 5:1–34, 1948
24.
go back to reference Bae J, Kim N, Lee SM, Seo JB, Kim HC: Thoracic cavity segmentation algorithm using multiorgan extraction and surface fitting in volumetric CT. Med Phys 41(4), 2014 Bae J, Kim N, Lee SM, Seo JB, Kim HC: Thoracic cavity segmentation algorithm using multiorgan extraction and surface fitting in volumetric CT. Med Phys 41(4), 2014
26.
go back to reference Rockafellar RT, Wets RJB: Variational analysis. Springer-Verlag, 2005, p 117. ISBN 3-540-62772-3 Rockafellar RT, Wets RJB: Variational analysis. Springer-Verlag, 2005, p 117. ISBN 3-540-62772-3
27.
go back to reference Pauwels RA, Buist AS, Calverley PM, Jenkins CR, Hurd SS: Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: NHLBI/WHO global initiative for chronic obstructive lung disease (GOLD) workshop summary. Am J Respir Crit Care Med 163(5):1256–1276, 2001CrossRef Pauwels RA, Buist AS, Calverley PM, Jenkins CR, Hurd SS: Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: NHLBI/WHO global initiative for chronic obstructive lung disease (GOLD) workshop summary. Am J Respir Crit Care Med 163(5):1256–1276, 2001CrossRef
Metadata
Title
Fully Automated Lung Lobe Segmentation in Volumetric Chest CT with 3D U-Net: Validation with Intra- and Extra-Datasets
Authors
Jongha Park
Jihye Yun
Namkug Kim
Beomhee Park
Yongwon Cho
Hee Jun Park
Mijeong Song
Minho Lee
Joon Beom Seo
Publication date
01-02-2020
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 1/2020
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00223-1

Other articles of this Issue 1/2020

Journal of Digital Imaging 1/2020 Go to the issue

Editorial

Editorial

Editorial

Editorial