Skip to main content
Top
Published in: European Journal of Nuclear Medicine and Molecular Imaging 3/2022

01-02-2022 | Lung Cancer | Original Article

An [18F]FDG-PET/CT deep learning method for fully automated detection of pathological mediastinal lymph nodes in lung cancer patients

Authors: David Wallis, Michaël Soussan, Maxime Lacroix, Pia Akl, Clément Duboucher, Irène Buvat

Published in: European Journal of Nuclear Medicine and Molecular Imaging | Issue 3/2022

Login to get access

Abstract

Purpose

The identification of pathological mediastinal lymph nodes is an important step in the staging of lung cancer, with the presence of metastases significantly affecting survival rates. Nodes are currently identified by a physician, but this process is time-consuming and prone to errors. In this paper, we investigate the use of artificial intelligence–based methods to increase the accuracy and consistency of this process.

Methods

Whole-body 18F-labelled fluoro-2-deoxyglucose ([18F]FDG) positron emission tomography/computed tomography ([18F]FDG-PET/CT) scans (Philips Gemini TF) from 134 patients were retrospectively analysed. The thorax was automatically located, and then slices were fed into a U-Net to identify candidate regions. These regions were split into overlapping 3D cubes, which were individually predicted as positive or negative using a 3D CNN. From these predictions, pathological mediastinal nodes could be identified. A second cohort of 71 patients was then acquired from a different, newer scanner (GE Discovery MI), and the performance of the model on this dataset was tested with and without transfer learning.

Results

On the test set from the first scanner, our model achieved a sensitivity of 0.87 (95% confidence intervals [0.74, 0.94]) with 0.41 [0.22, 0.71] false positives/patient. This was comparable to the performance of an expert. Without transfer learning, on the test set from the second scanner, the corresponding results were 0.53 [0.35, 0.70] and 0.24 [0.10, 0.49], respectively. With transfer learning, these metrics were 0.88 [0.73, 0.97] and 0.69 [0.43, 1.04], respectively.

Conclusion

Model performance was comparable to that of an expert on data from the same scanner. With transfer learning, the model can be applied to data from a different scanner. To our knowledge it is the first study of its kind to go directly from whole-body [18F]FDG-PET/CT scans to pathological mediastinal lymph node localisation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel R, Torre L, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef Bray F, Ferlay J, Soerjomataram I, Siegel R, Torre L, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef
2.
go back to reference Ettinger D, Akerley W, Bepler G, et al. Non-small cell lung cancer: clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2006;4:548–82.CrossRef Ettinger D, Akerley W, Bepler G, et al. Non-small cell lung cancer: clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2006;4:548–82.CrossRef
3.
go back to reference Pak K, Park S, Cheon G, et al. Update on nodal staging in non-small cell lung cancer with integrated positron emission tomography/computed tomography: a meta-analysis. Ann Nucl Med. 2015;29:409–19.CrossRef Pak K, Park S, Cheon G, et al. Update on nodal staging in non-small cell lung cancer with integrated positron emission tomography/computed tomography: a meta-analysis. Ann Nucl Med. 2015;29:409–19.CrossRef
4.
go back to reference Liao C-Y, Chen J-H, Liang J-A, Yeh J-J, Kao C-H. Meta-analysis study of lymph node staging by 18 F-FDG PET/CT scan in non-small cell lung cancer: comparison of TB and non-TB endemic regions. Eur J Radiol. 2012;81:3518–23.CrossRef Liao C-Y, Chen J-H, Liang J-A, Yeh J-J, Kao C-H. Meta-analysis study of lymph node staging by 18 F-FDG PET/CT scan in non-small cell lung cancer: comparison of TB and non-TB endemic regions. Eur J Radiol. 2012;81:3518–23.CrossRef
5.
go back to reference Hofman M, Smeeton N, Rankin S, Nuna T, O’Doherty M. Observer variation in FDG PET-CT for staging of non-small-cell lung carcinoma. Eur J Nucl Med Mol Imaging. 2009;36:194–9.CrossRef Hofman M, Smeeton N, Rankin S, Nuna T, O’Doherty M. Observer variation in FDG PET-CT for staging of non-small-cell lung carcinoma. Eur J Nucl Med Mol Imaging. 2009;36:194–9.CrossRef
6.
go back to reference Skourt B, El Hassani A, Majda A. Lung CT image segmentation using deep neural networks. Procedia Comput Sci. 2018;127:109–13.CrossRef Skourt B, El Hassani A, Majda A. Lung CT image segmentation using deep neural networks. Procedia Comput Sci. 2018;127:109–13.CrossRef
7.
go back to reference Giger M. Machine learning in medical imaging. J Am Coll Radiol. 2018;15(3 Pt B):512–20.CrossRef Giger M. Machine learning in medical imaging. J Am Coll Radiol. 2018;15(3 Pt B):512–20.CrossRef
8.
go back to reference Esteva A, Kuprel B, Novoa R, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115–8.CrossRef Esteva A, Kuprel B, Novoa R, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115–8.CrossRef
9.
go back to reference Hosny A, Parmar C, Quackenbush J, Schwartz L. Artificial intelligence in radiology. Nat Rev Cancer. 2018;18:500–10.CrossRef Hosny A, Parmar C, Quackenbush J, Schwartz L. Artificial intelligence in radiology. Nat Rev Cancer. 2018;18:500–10.CrossRef
10.
go back to reference Krizhevsky A, Sutskever I, Hinton G. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017;60:84–90.CrossRef Krizhevsky A, Sutskever I, Hinton G. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017;60:84–90.CrossRef
11.
go back to reference Litjens G, Kooi T, Bejnordi B, et al. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60–88.CrossRef Litjens G, Kooi T, Bejnordi B, et al. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60–88.CrossRef
12.
go back to reference Shen D, Wu G, Suk H-I. Deep learning in medical image analysis. Annu Rev Biomed Eng. 2017;21:221–48.CrossRef Shen D, Wu G, Suk H-I. Deep learning in medical image analysis. Annu Rev Biomed Eng. 2017;21:221–48.CrossRef
13.
go back to reference Ghafoorian M, Karssemeijer N, Heskes T, et al. Location sensitive deep convolutional neural networks for segmentation of white matter hyperintensities. Sci Rep. 2017;7:5110.CrossRef Ghafoorian M, Karssemeijer N, Heskes T, et al. Location sensitive deep convolutional neural networks for segmentation of white matter hyperintensities. Sci Rep. 2017;7:5110.CrossRef
14.
go back to reference Mårtensson G, Ferreira D, Granberg T, et al. The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study. Med Image Anal. 2020;66:101714.CrossRef Mårtensson G, Ferreira D, Granberg T, et al. The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study. Med Image Anal. 2020;66:101714.CrossRef
15.
go back to reference AlBadawy EA, Saha A, Mazurowski MA. Deep learning for segmentation of brain tumors: impact of cross-institutional training and testing. Med Phys. 2018;45:1150–8.CrossRef AlBadawy EA, Saha A, Mazurowski MA. Deep learning for segmentation of brain tumors: impact of cross-institutional training and testing. Med Phys. 2018;45:1150–8.CrossRef
16.
go back to reference Chen KT, Schürer M, Ouyang J, et al. Generalization of deep learning models for ultra-low-count amyloid PET/MRI using transfer learning. EJNMMI. 2020;47:2998–3007. Chen KT, Schürer M, Ouyang J, et al. Generalization of deep learning models for ultra-low-count amyloid PET/MRI using transfer learning. EJNMMI. 2020;47:2998–3007.
17.
go back to reference Ghafoorian M, Mehrtash A, Kapur T, et al. Transfer learning for domain adaptation in MRI: application in brain lesion segmentation. MICCAI 2017. Lecture Notes in Computer Science. 2017;10435 Ghafoorian M, Mehrtash A, Kapur T, et al. Transfer learning for domain adaptation in MRI: application in brain lesion segmentation. MICCAI 2017. Lecture Notes in Computer Science. 2017;10435
18.
go back to reference Setio A, Ciompi F, Litjens G, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging. 2016;35:1160–9.CrossRef Setio A, Ciompi F, Litjens G, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging. 2016;35:1160–9.CrossRef
19.
go back to reference Zhang Z, Li X, You Q, Luo X. Multicontext 3D residual CNN for false positive reduction of pulmonary nodule detection. Int J Imaging Sys Technol. 2018;29:42–9.CrossRef Zhang Z, Li X, You Q, Luo X. Multicontext 3D residual CNN for false positive reduction of pulmonary nodule detection. Int J Imaging Sys Technol. 2018;29:42–9.CrossRef
20.
go back to reference Ardila D, Kiraly A, Bharadwaj S, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25:954–61.CrossRef Ardila D, Kiraly A, Bharadwaj S, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25:954–61.CrossRef
21.
go back to reference Roth H, Lu L, Seff A, et al. A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. Med Image Comput Comput Assist Interv. 2014;17:520–7.PubMedPubMedCentral Roth H, Lu L, Seff A, et al. A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. Med Image Comput Comput Assist Interv. 2014;17:520–7.PubMedPubMedCentral
22.
go back to reference Schmidt-Hansen M, Baldwin D, Hasler E, Zamora J, Abraira V, Figuls M. PET-CT for assessing mediastinal lymph node involvement in patients with suspected resectable non-small cell lung cancer. Chochrane Database Syst Rev. 2014;2014:CD009519. Schmidt-Hansen M, Baldwin D, Hasler E, Zamora J, Abraira V, Figuls M. PET-CT for assessing mediastinal lymph node involvement in patients with suspected resectable non-small cell lung cancer. Chochrane Database Syst Rev. 2014;2014:CD009519.
23.
go back to reference Wu Y, Li P, Zhang H, et al. Diagnostic value of fluorine 18 fluorodeoxyglucose positron emission tomography/computed tomography for the detection of metastases in non-small-cell lung cancer patients. Int J Cancer. 2013;132:E37–47.CrossRef Wu Y, Li P, Zhang H, et al. Diagnostic value of fluorine 18 fluorodeoxyglucose positron emission tomography/computed tomography for the detection of metastases in non-small-cell lung cancer patients. Int J Cancer. 2013;132:E37–47.CrossRef
24.
go back to reference Wang H, Zhou Z, Li Y, et al. Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18 F-FDG PET/CT images. EJNMMI Res. 2017;7:11.CrossRef Wang H, Zhou Z, Li Y, et al. Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18 F-FDG PET/CT images. EJNMMI Res. 2017;7:11.CrossRef
25.
go back to reference Weisman A, Kieler M, Perlman S, et al. Convolutional neural networks for automated PET/CT detection of diseased lymph node burden in patients with lymphoma. Radiol Artif Intel. 2020;2:e200016.CrossRef Weisman A, Kieler M, Perlman S, et al. Convolutional neural networks for automated PET/CT detection of diseased lymph node burden in patients with lymphoma. Radiol Artif Intel. 2020;2:e200016.CrossRef
26.
go back to reference Sibille L, Seifart R, Avramovic N, et al. 18F-FDG PET/CT uptake classification in lymphoma and lung cancer by using deep convolutional neural networks. Radiology. 2020;294:445–52.CrossRef Sibille L, Seifart R, Avramovic N, et al. 18F-FDG PET/CT uptake classification in lymphoma and lung cancer by using deep convolutional neural networks. Radiology. 2020;294:445–52.CrossRef
27.
go back to reference Christophe NF, Orlhac S, Boughdad S, Reuzé J, Goya-Outi C, Robert C, Pellot-Barakat M, Soussan F, Buvat FI. (2018) LIFEx: A Freeware for Radiomic Feature Calculation in Multimodality Imaging to Accelerate Advances in the Characterization of Tumor Heterogeneity. Cancer Research. 2018;78(16):4786–9. https://doi.org/10.1158/0008-5472.CAN-18-0125.CrossRef Christophe NF, Orlhac S, Boughdad S, Reuzé J, Goya-Outi C, Robert C, Pellot-Barakat M, Soussan F, Buvat FI. (2018) LIFEx: A Freeware for Radiomic Feature Calculation in Multimodality Imaging to Accelerate Advances in the Characterization of Tumor Heterogeneity. Cancer Research. 2018;78(16):4786–9. https://​doi.​org/​10.​1158/​0008-5472.​CAN-18-0125.CrossRef
29.
go back to reference Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation. MICCAI 2015. Lecture Notes in Computer Science. 2015;9351 Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation. MICCAI 2015. Lecture Notes in Computer Science. 2015;9351
30.
go back to reference Libshitz HI, McKenna RJ Jr. Mediastinal lymph node size in lung cancer. AJR Am J Roentgenol. 1984;143:715–8.CrossRef Libshitz HI, McKenna RJ Jr. Mediastinal lymph node size in lung cancer. AJR Am J Roentgenol. 1984;143:715–8.CrossRef
31.
go back to reference He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. IEEE CVPR. 2016:770–778. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. IEEE CVPR. 2016:770–778.
33.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960;20. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960;20.
34.
go back to reference Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRef Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRef
35.
go back to reference Clopper C, Pearson E. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26:404–13.CrossRef Clopper C, Pearson E. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26:404–13.CrossRef
Metadata
Title
An [18F]FDG-PET/CT deep learning method for fully automated detection of pathological mediastinal lymph nodes in lung cancer patients
Authors
David Wallis
Michaël Soussan
Maxime Lacroix
Pia Akl
Clément Duboucher
Irène Buvat
Publication date
01-02-2022
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging / Issue 3/2022
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-021-05513-x

Other articles of this Issue 3/2022

European Journal of Nuclear Medicine and Molecular Imaging 3/2022 Go to the issue