Skip to main content
Top
Published in: European Radiology 11/2019

01-11-2019 | Computed Tomography | Chest

Comparison of prediction models with radiological semantic features and radiomics in lung cancer diagnosis of the pulmonary nodules: a case-control study

Authors: Wei Wu, Larry A. Pierce, Yuzheng Zhang, Sudhakar N. J. Pipavath, Timothy W. Randolph, Kristin J. Lastwika, Paul D. Lampe, A. McGarry Houghton, Haining Liu, Liming Xia, Paul E. Kinahan

Published in: European Radiology | Issue 11/2019

Login to get access

Abstract

Purpose

To compare the ability of radiological semantic and quantitative texture features in lung cancer diagnosis of pulmonary nodules.

Materials and methods

A total of N = 121 subjects with confirmed non-small-cell lung cancer were matched with 117 controls based on age and gender. Radiological semantic and quantitative texture features were extracted from CT images with or without contrast enhancement. Three different models were compared using LASSO logistic regression: “CS” using clinical and semantic variables, “T” using texture features, and “CST” using clinical, semantic, and texture variables. For each model, we performed 100 trials of fivefold cross-validation and the average receiver operating curve was accessed. The AUC of the cross-validation study (AUCCV) was calculated together with its 95% confidence interval.

Results

The AUCCV (and 95% confidence interval) for models T, CS, and CST was 0.85 (0.71–0.96), 0.88 (0.77–0.96), and 0.88 (0.77–0.97), respectively. After separating the data into two groups with or without contrast enhancement, the AUC (without cross-validation) of the model T was 0.86 both for images with and without contrast enhancement, suggesting that contrast enhancement did not impact the utility of texture analysis.

Conclusions

The models with semantic and texture features provided cross-validated AUCs of 0.85–0.88 for classification of benign versus cancerous nodules, showing potential in aiding the management of patients.

Key Points

• Pretest probability of cancer can aid and direct the physician in the diagnosis and management of pulmonary nodules in a cost-effective way.
• Semantic features (qualitative features reported by radiologists to characterize lung lesions) and radiomic (e.g., texture) features can be extracted from CT images.
• Input of these variables into a model can generate a pretest likelihood of cancer to aid clinical decision and management of pulmonary nodules.
Appendix
Available only for authorised users
Literature
1.
go back to reference MacMahon H, Naidich DP, Goo JM et al (2017) Guidelines for management of incidental pulmonary nodules detected on CT images: from the Fleischner Society 2017. Radiology 284:228–243CrossRef MacMahon H, Naidich DP, Goo JM et al (2017) Guidelines for management of incidental pulmonary nodules detected on CT images: from the Fleischner Society 2017. Radiology 284:228–243CrossRef
2.
go back to reference Carter SM, Barratt A (2017) What is overdiagnosis and why should we take it seriously in cancer screening? Public Health Res Pract 27:e2731722CrossRef Carter SM, Barratt A (2017) What is overdiagnosis and why should we take it seriously in cancer screening? Public Health Res Pract 27:e2731722CrossRef
3.
go back to reference Edey AJ, Hansell DM (2009) Incidentally detected small pulmonary nodules on CT. Clin Radiol 64:872–884CrossRef Edey AJ, Hansell DM (2009) Incidentally detected small pulmonary nodules on CT. Clin Radiol 64:872–884CrossRef
4.
go back to reference Dziedzic R, Rzyman W (2014) Incidentally diagnosed pulmonary nodules: a diagnostic algorithm. Kardiochir Torakochirurgia Pol 11:397–403PubMedPubMedCentral Dziedzic R, Rzyman W (2014) Incidentally diagnosed pulmonary nodules: a diagnostic algorithm. Kardiochir Torakochirurgia Pol 11:397–403PubMedPubMedCentral
5.
go back to reference Gould MK, Ananth L, Barnett PG (2007) A clinical model to estimate the pretest probability of lung cancer in patients with solitary pulmonary nodules. Chest 131:383–388CrossRef Gould MK, Ananth L, Barnett PG (2007) A clinical model to estimate the pretest probability of lung cancer in patients with solitary pulmonary nodules. Chest 131:383–388CrossRef
6.
go back to reference Swensen SJ, Silverstein MD, Ilstrup DM, Schleck CD, Edell ES (2008) The probability of malignancy in solitary pulmonary nodules. Arch Intern Med 157:849–855 Swensen SJ, Silverstein MD, Ilstrup DM, Schleck CD, Edell ES (2008) The probability of malignancy in solitary pulmonary nodules. Arch Intern Med 157:849–855
7.
go back to reference McWilliams A, Tammemagi MC, Mayo JR et al (2013) Probability of cancer in pulmonary nodules detected on first screening CT. N Engl J Med 369:910–919CrossRef McWilliams A, Tammemagi MC, Mayo JR et al (2013) Probability of cancer in pulmonary nodules detected on first screening CT. N Engl J Med 369:910–919CrossRef
8.
go back to reference Schultz EM, Sanders GD, Trotter PR et al (2008) Validation of two models to estimate the probability of malignancy in patients with solitary pulmonary nodules. Thorax 63:335–341CrossRef Schultz EM, Sanders GD, Trotter PR et al (2008) Validation of two models to estimate the probability of malignancy in patients with solitary pulmonary nodules. Thorax 63:335–341CrossRef
9.
go back to reference Al-Ameri A, Malhotra P, Thygesen H et al (2015) Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 89:27–30CrossRef Al-Ameri A, Malhotra P, Thygesen H et al (2015) Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 89:27–30CrossRef
10.
go back to reference Talwar A, Rahman NM, Kadir T, Pickup LC, Gleeson F (2017) A retrospective validation study of three models to estimate the probability of malignancy in patients with small pulmonary nodules from a tertiary oncology follow-up center. Clin Radiol 72:177.e1–177.e8CrossRef Talwar A, Rahman NM, Kadir T, Pickup LC, Gleeson F (2017) A retrospective validation study of three models to estimate the probability of malignancy in patients with small pulmonary nodules from a tertiary oncology follow-up center. Clin Radiol 72:177.e1–177.e8CrossRef
11.
go back to reference Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef
12.
go back to reference van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107CrossRef van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107CrossRef
13.
go back to reference Huang Y, Liu Z, He L et al (2016) Radiomics signature: a potential biomarker for the prediction of disease-free survival in early-stage (I or II) non—small cell lung cancer. Radiology 281:947–957CrossRef Huang Y, Liu Z, He L et al (2016) Radiomics signature: a potential biomarker for the prediction of disease-free survival in early-stage (I or II) non—small cell lung cancer. Radiology 281:947–957CrossRef
14.
go back to reference Coroller TP, Agrawal V, Huynh E et al (2017) Radiomic-based pathological response prediction from primary tumors and lymph nodes in NSCLC. J Thorac Oncol 12:467–476CrossRef Coroller TP, Agrawal V, Huynh E et al (2017) Radiomic-based pathological response prediction from primary tumors and lymph nodes in NSCLC. J Thorac Oncol 12:467–476CrossRef
15.
go back to reference Coroller TP, Grossmann P, Hou Y et al (2015) CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother Oncol 114:345–350CrossRef Coroller TP, Grossmann P, Hou Y et al (2015) CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother Oncol 114:345–350CrossRef
16.
go back to reference Huang YQ, Liang CH, He L et al (2016) Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol 34:2157–2164 Huang YQ, Liang CH, He L et al (2016) Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol 34:2157–2164
17.
go back to reference Song SH, Park H, Lee G et al (2017) Imaging phenotyping using radiomics to predict micropapillary pattern within lung adenocarcinoma. J Thorac Oncol 12:624–632CrossRef Song SH, Park H, Lee G et al (2017) Imaging phenotyping using radiomics to predict micropapillary pattern within lung adenocarcinoma. J Thorac Oncol 12:624–632CrossRef
18.
go back to reference Wilson R, Devaraj A (2017) Radiomics of pulmonary nodules and lung cancer. Transl Lung Cancer Res 6:86–91CrossRef Wilson R, Devaraj A (2017) Radiomics of pulmonary nodules and lung cancer. Transl Lung Cancer Res 6:86–91CrossRef
19.
go back to reference Hawkins S, Wang H, Liu Y et al (2016) Predicting malignant nodules from screening CT scans. J Thorac Oncol 11:2120–2128CrossRef Hawkins S, Wang H, Liu Y et al (2016) Predicting malignant nodules from screening CT scans. J Thorac Oncol 11:2120–2128CrossRef
20.
go back to reference Chen CH, Chang CK, Tu CY et al (2018) Radiomic features analysis in computed tomography images of lung nodule classification. PLoS One 13:e0192002CrossRef Chen CH, Chang CK, Tu CY et al (2018) Radiomic features analysis in computed tomography images of lung nodule classification. PLoS One 13:e0192002CrossRef
21.
go back to reference Hatt M, Tixier F, Pierce L, Kinahan PE, Le Rest CC, Visvikis D (2016) Characterization of PET/CT images using texture analysis: the past, the present… any future? Eur J Nucl Med Mol Imaging 44:151–165CrossRef Hatt M, Tixier F, Pierce L, Kinahan PE, Le Rest CC, Visvikis D (2016) Characterization of PET/CT images using texture analysis: the past, the present… any future? Eur J Nucl Med Mol Imaging 44:151–165CrossRef
22.
go back to reference Soh LK, Tsatsoulis C (1999) Texture analysis of SAR sea ice imagery using gray level co- occurrence matrices. IEEE Trans Geosci Remote Sens 37:780–795CrossRef Soh LK, Tsatsoulis C (1999) Texture analysis of SAR sea ice imagery using gray level co- occurrence matrices. IEEE Trans Geosci Remote Sens 37:780–795CrossRef
23.
go back to reference Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Series B Stat Methodol 58:267–288 Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Series B Stat Methodol 58:267–288
24.
go back to reference Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33:1–22CrossRef Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33:1–22CrossRef
25.
go back to reference Liu Y, Wang H, Li Q et al (2018) Radiologic features of small pulmonary nodules and lung cancer risk in the National Lung Screening Trial: a nested case-control study. Radiology 286:298–306CrossRef Liu Y, Wang H, Li Q et al (2018) Radiologic features of small pulmonary nodules and lung cancer risk in the National Lung Screening Trial: a nested case-control study. Radiology 286:298–306CrossRef
26.
go back to reference Armato SG 3rd, McNitt-Gray MF, Reeves AP et al (2007) The Lung Image Database Consortium (LIDC): an evaluation of radiologist variability in the identification of lung nodules on CT scans. Acad Radiol 14:1409–1421 Armato SG 3rd, McNitt-Gray MF, Reeves AP et al (2007) The Lung Image Database Consortium (LIDC): an evaluation of radiologist variability in the identification of lung nodules on CT scans. Acad Radiol 14:1409–1421
27.
go back to reference Kalpathy-Cramer J, Zhao B, Goldgof D et al (2016) A comparison of lung nodule segmentation algorithms: methods and results from a multi-institutional study. J Digit Imaging 29:476–487CrossRef Kalpathy-Cramer J, Zhao B, Goldgof D et al (2016) A comparison of lung nodule segmentation algorithms: methods and results from a multi-institutional study. J Digit Imaging 29:476–487CrossRef
28.
go back to reference Herder GJ, van Tinteren H, Golding RP et al (2005) Clinical prediction model to characterize pulmonary nodules: validation and added value of 18F-fluorodeoxyglucose positron emission tomography. Chest 128:2490–2496CrossRef Herder GJ, van Tinteren H, Golding RP et al (2005) Clinical prediction model to characterize pulmonary nodules: validation and added value of 18F-fluorodeoxyglucose positron emission tomography. Chest 128:2490–2496CrossRef
29.
go back to reference He L, Huang Y, Ma Z, Liang C, Liang C, Liu Z (2016) Effects of contrast-enhancement, reconstruction slice thickness and convolution kernel on the diagnostic performance of radiomics signature in solitary pulmonary nodule. Sci Rep 6:34921CrossRef He L, Huang Y, Ma Z, Liang C, Liang C, Liu Z (2016) Effects of contrast-enhancement, reconstruction slice thickness and convolution kernel on the diagnostic performance of radiomics signature in solitary pulmonary nodule. Sci Rep 6:34921CrossRef
30.
go back to reference Fan L, Fang M, Li Z et al (2019) Radiomics signature: a biomarker for the preoperative discrimination of lung invasive adenocarcinoma manifesting as a ground-glass nodule. Eur Radiol 29:889–897CrossRef Fan L, Fang M, Li Z et al (2019) Radiomics signature: a biomarker for the preoperative discrimination of lung invasive adenocarcinoma manifesting as a ground-glass nodule. Eur Radiol 29:889–897CrossRef
31.
go back to reference Larue RT, Defraene G, De Ruysscher D, Lambin P, Van Elmpt W (2017) Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. Br J Radiol 90:20160665CrossRef Larue RT, Defraene G, De Ruysscher D, Lambin P, Van Elmpt W (2017) Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. Br J Radiol 90:20160665CrossRef
32.
go back to reference Zhao B, Tan Y, Tsai WY, Schwartz LH, Lu L (2014) Exploring variability in CT characterization of tumors: a preliminary phantom study. Transl Oncol 7:88–93CrossRef Zhao B, Tan Y, Tsai WY, Schwartz LH, Lu L (2014) Exploring variability in CT characterization of tumors: a preliminary phantom study. Transl Oncol 7:88–93CrossRef
33.
go back to reference Zhao B, Tan Y, Tsai WY et al (2016) Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep 6:23428CrossRef Zhao B, Tan Y, Tsai WY et al (2016) Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep 6:23428CrossRef
34.
go back to reference Lo P, Young S, Kim HJ, Brown MS, McNitt-Gray MF (2016) Variability in CT lung-nodule quantification: effects of dose reduction and reconstruction methods on density and texture based features. Med Phys 43:4854–4865CrossRef Lo P, Young S, Kim HJ, Brown MS, McNitt-Gray MF (2016) Variability in CT lung-nodule quantification: effects of dose reduction and reconstruction methods on density and texture based features. Med Phys 43:4854–4865CrossRef
35.
go back to reference Lu L, Ehmke RC, Schwartz LH, Zhao B (2016) Assessing agreement between radiomic features computed for multiple CT imaging settings. PLoS One 11:e0166550CrossRef Lu L, Ehmke RC, Schwartz LH, Zhao B (2016) Assessing agreement between radiomic features computed for multiple CT imaging settings. PLoS One 11:e0166550CrossRef
36.
go back to reference Shafiq-ul-Hassan M, Zhang GG, Latifi K et al (2017) Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels. Med Phys 44:1050–1062CrossRef Shafiq-ul-Hassan M, Zhang GG, Latifi K et al (2017) Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels. Med Phys 44:1050–1062CrossRef
37.
go back to reference Mazzone PJ, Silvestri GA, Patel S et al (2018) Screening for lung cancer: CHEST guideline and expert panel report. Chest 153:954–985CrossRef Mazzone PJ, Silvestri GA, Patel S et al (2018) Screening for lung cancer: CHEST guideline and expert panel report. Chest 153:954–985CrossRef
Metadata
Title
Comparison of prediction models with radiological semantic features and radiomics in lung cancer diagnosis of the pulmonary nodules: a case-control study
Authors
Wei Wu
Larry A. Pierce
Yuzheng Zhang
Sudhakar N. J. Pipavath
Timothy W. Randolph
Kristin J. Lastwika
Paul D. Lampe
A. McGarry Houghton
Haining Liu
Liming Xia
Paul E. Kinahan
Publication date
01-11-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 11/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-019-06213-9

Other articles of this Issue 11/2019

European Radiology 11/2019 Go to the issue