Skip to main content
Top
Published in: European Radiology 12/2020

01-12-2020 | Computed Tomography | Imaging Informatics and Artificial Intelligence

Machine learning–based CT texture analysis to predict HPV status in oropharyngeal squamous cell carcinoma: comparison of 2D and 3D segmentation

Authors: Jiliang Ren, Ying Yuan, Meng Qi, Xiaofeng Tao

Published in: European Radiology | Issue 12/2020

Login to get access

Abstract

Objective

To compare the CT texture feature reproducibility of 2D and 3D segmentations and their machine learning (ML)–based classifications for predicting human papilloma virus (HPV) status in oropharyngeal squamous cell carcinoma (OPSCC).

Materials and methods

Data about 47 patients with pathological OPSCC (15 HPV positive and 32 HPV negative) were collected from a public database. Using 2D and 3D manual segmentations, 1032 texture features were extracted from contrast-enhanced CT images. Intraclass correlation coefficients (ICCs) were calculated to evaluate intraobserver and interobserver reproducibility. Collinearity analysis and a wrapper-based subset search algorithm were used for feature selection. Models were created using k-nearest neighbors (k-NN), logistic regression (LR), and random forest (RF) alone and with a synthetic minority oversampling technique (SMOTE). Classifier performance was assessed using 10-fold cross-validation.

Results

Compared with 2D segmentation (468 of 1032, 45.3%), 3D segmentation (576 of 1032, 55.8%) yielded more texture features with reliable reproducibility (good to excellent in both intraobserver and interobserver analyses) (p < 0.001). RF and k-NN classifiers failed to achieve better classification performance using 3D features than using 2D features either alone or with SMOTE. The best models for 2D and 3D segmentations were both created using RF, which alone achieved areas under the curve (AUCs) of 0.880 and 0.847, respectively, and with SMOTE, AUCs of 0.953 and 0.920, respectively, were achieved.

Conclusions

Three-dimensional segmentation had better CT texture feature reproducibility, but 2D segmentation showed better performance. Considering the cost, 2D segmentation is more recommended for ML-based classification of HPV status of OPSCC.

Key Points

• Three-dimensional segmentation had better CT texture feature reproducibility than 2D segmentation.
• Despite yielding more features with reliable reproducibility, 3D segmentation failed to provide better classification performance as compared to 2D for predicting HPV status of oropharyngeal squamous cell carcinoma.
• The best models for 2D and 3D segmentations were both created using random forest classifier.
Appendix
Available only for authorised users
Literature
1.
go back to reference Panwar A, Batra R, Lydiatt WM, Ganti AK (2014) Human papilloma virus positive oropharyngeal squamous cell carcinoma: a growing epidemic. Cancer Treat Rev 40:215–219CrossRef Panwar A, Batra R, Lydiatt WM, Ganti AK (2014) Human papilloma virus positive oropharyngeal squamous cell carcinoma: a growing epidemic. Cancer Treat Rev 40:215–219CrossRef
2.
go back to reference Ragin CC, Taioli E (2007) Survival of squamous cell carcinoma of the head and neck in relation to human papillomavirus infection: review and meta-analysis. Int J Cancer 121:1813–1820CrossRef Ragin CC, Taioli E (2007) Survival of squamous cell carcinoma of the head and neck in relation to human papillomavirus infection: review and meta-analysis. Int J Cancer 121:1813–1820CrossRef
3.
go back to reference Mungai F, Verrone GB, Pietragalla M et al (2019) CT assessment of tumor heterogeneity and the potential for the prediction of human papillomavirus status in oropharyngeal squamous cell carcinoma. Radiol Med 124:804–811CrossRef Mungai F, Verrone GB, Pietragalla M et al (2019) CT assessment of tumor heterogeneity and the potential for the prediction of human papillomavirus status in oropharyngeal squamous cell carcinoma. Radiol Med 124:804–811CrossRef
4.
go back to reference Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef
5.
go back to reference Ranjbar S, Ning S, Zwart CM et al (2018) Computed tomography-based texture analysis to determine human papillomavirus status of oropharyngeal squamous cell carcinoma. J Comput Assist Tomogr 42:299–305CrossRef Ranjbar S, Ning S, Zwart CM et al (2018) Computed tomography-based texture analysis to determine human papillomavirus status of oropharyngeal squamous cell carcinoma. J Comput Assist Tomogr 42:299–305CrossRef
6.
go back to reference Fujita A, Buch K, Li B, Kawashima Y, Qureshi MM, Sakai O (2016) Difference between HPV-positive and HPV-negative non-oropharyngeal head and neck cancer: texture analysis features on CT. J Comput Assist Tomogr 40:43–47CrossRef Fujita A, Buch K, Li B, Kawashima Y, Qureshi MM, Sakai O (2016) Difference between HPV-positive and HPV-negative non-oropharyngeal head and neck cancer: texture analysis features on CT. J Comput Assist Tomogr 40:43–47CrossRef
7.
go back to reference Bogowicz M, Riesterer O, Ikenberg K et al (2017) Computed tomography radiomics predicts HPV status and local tumor control after definitive radiochemotherapy in head and neck squamous cell carcinoma. Int J Radiat Oncol Biol Phys 99:921–928CrossRef Bogowicz M, Riesterer O, Ikenberg K et al (2017) Computed tomography radiomics predicts HPV status and local tumor control after definitive radiochemotherapy in head and neck squamous cell carcinoma. Int J Radiat Oncol Biol Phys 99:921–928CrossRef
8.
go back to reference Kocak B, Durmaz ES, Kaya OK, Ates E, Kilickesmez O (2019) Reliability of single-slice-based 2D CT texture analysis of renal masses: influence of intra- and interobserver manual segmentation variability on radiomic feature reproducibility. AJR Am J Roentgenol 213:377–383CrossRef Kocak B, Durmaz ES, Kaya OK, Ates E, Kilickesmez O (2019) Reliability of single-slice-based 2D CT texture analysis of renal masses: influence of intra- and interobserver manual segmentation variability on radiomic feature reproducibility. AJR Am J Roentgenol 213:377–383CrossRef
9.
go back to reference Pavic M, Bogowicz M, Würms X, Glatz S, Tanadini-Lang S (2018) Influence of inter-observer delineation variability on radiomics stability in different tumor sites. Acta Oncol 57:1–5CrossRef Pavic M, Bogowicz M, Würms X, Glatz S, Tanadini-Lang S (2018) Influence of inter-observer delineation variability on radiomics stability in different tumor sites. Acta Oncol 57:1–5CrossRef
10.
go back to reference Aerts HJWL, Velazquez ER, Leijenaar RTH et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef Aerts HJWL, Velazquez ER, Leijenaar RTH et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef
11.
go back to reference Kocak B, Durmaz ES, Ates E, Kaya OK, Kilickesmez O (2019) Unenhanced CT texture analysis of clear cell renal cell carcinomas: a machine learning-based study for predicting histopathologic nuclear grade. AJR Am J Roentgenol 212:W1–W8CrossRef Kocak B, Durmaz ES, Ates E, Kaya OK, Kilickesmez O (2019) Unenhanced CT texture analysis of clear cell renal cell carcinomas: a machine learning-based study for predicting histopathologic nuclear grade. AJR Am J Roentgenol 212:W1–W8CrossRef
12.
go back to reference Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163CrossRef Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163CrossRef
13.
go back to reference Kohavi R, John GH (1997) Wrappers for feature subset selection. Artif Intell 97:273–324CrossRef Kohavi R, John GH (1997) Wrappers for feature subset selection. Artif Intell 97:273–324CrossRef
14.
go back to reference Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357CrossRef Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357CrossRef
15.
go back to reference Lee JY, Han M, Kim KS, Shin SJ, Choi JW, Ha EJ (2019) Discrimination of HPV status using CT texture analysis: tumour heterogeneity in oropharyngeal squamous cell carcinomas. Neuroradiology 61:1415–1424CrossRef Lee JY, Han M, Kim KS, Shin SJ, Choi JW, Ha EJ (2019) Discrimination of HPV status using CT texture analysis: tumour heterogeneity in oropharyngeal squamous cell carcinomas. Neuroradiology 61:1415–1424CrossRef
16.
go back to reference Ren J, Yuan Y, Shi Y, Tao X (2019) Tumor heterogeneity in oral and oropharyngeal squamous cell carcinoma assessed by texture analysis of CT and conventional MRI: a potential marker of overall survival. Acta Radiol 60:1273–1280CrossRef Ren J, Yuan Y, Shi Y, Tao X (2019) Tumor heterogeneity in oral and oropharyngeal squamous cell carcinoma assessed by texture analysis of CT and conventional MRI: a potential marker of overall survival. Acta Radiol 60:1273–1280CrossRef
17.
go back to reference Kocak B, Ates E, Durmaz ES, Ulusan MB, Kilickesmez O (2019) Influence of segmentation margin on machine learning-based high-dimensional quantitative CT texture analysis: a reproducibility study on renal clear cell carcinomas. Eur Radiol 29:4765–4775CrossRef Kocak B, Ates E, Durmaz ES, Ulusan MB, Kilickesmez O (2019) Influence of segmentation margin on machine learning-based high-dimensional quantitative CT texture analysis: a reproducibility study on renal clear cell carcinomas. Eur Radiol 29:4765–4775CrossRef
18.
go back to reference Shen C, Liu Z, Guan M et al (2017) 2D and 3D CT radiomics features prognostic performance comparison in non-small cell lung cancer. Transl Oncol 10:886–894CrossRef Shen C, Liu Z, Guan M et al (2017) 2D and 3D CT radiomics features prognostic performance comparison in non-small cell lung cancer. Transl Oncol 10:886–894CrossRef
19.
go back to reference Breiman L, Breiman L, Cutler RA (2001) Random forests. Mach Learn 2:199–228 Breiman L, Breiman L, Cutler RA (2001) Random forests. Mach Learn 2:199–228
20.
go back to reference Chu L, Park S, Kawamoto S et al (2019) Utility of CT radiomics features in differentiation of pancreatic ductal adenocarcinoma from normal pancreatic tissue. AJR Am J Roentgenol 213:1–9CrossRef Chu L, Park S, Kawamoto S et al (2019) Utility of CT radiomics features in differentiation of pancreatic ductal adenocarcinoma from normal pancreatic tissue. AJR Am J Roentgenol 213:1–9CrossRef
21.
go back to reference Wu S, Meng J, Yu Q, Li P, Fu S (2019) Radiomics-based machine learning methods for isocitrate dehydrogenase genotype prediction of diffuse gliomas. J Cancer Res Clin Oncol 145:543–550CrossRef Wu S, Meng J, Yu Q, Li P, Fu S (2019) Radiomics-based machine learning methods for isocitrate dehydrogenase genotype prediction of diffuse gliomas. J Cancer Res Clin Oncol 145:543–550CrossRef
22.
go back to reference Eun NL, Kang D, Son EJ et al (2020) Texture analysis with 3.0-T MRI for association of response to neoadjuvant chemotherapy in breast cancer. Radiology 294:31–41CrossRef Eun NL, Kang D, Son EJ et al (2020) Texture analysis with 3.0-T MRI for association of response to neoadjuvant chemotherapy in breast cancer. Radiology 294:31–41CrossRef
23.
go back to reference Liang S, Tang F, Huang X et al (2019) Deep-learning-based detection and segmentation of organs at risk in nasopharyngeal carcinoma computed tomographic images for radiotherapy planning. Eur Radiol 29:1961–1967CrossRef Liang S, Tang F, Huang X et al (2019) Deep-learning-based detection and segmentation of organs at risk in nasopharyngeal carcinoma computed tomographic images for radiotherapy planning. Eur Radiol 29:1961–1967CrossRef
Metadata
Title
Machine learning–based CT texture analysis to predict HPV status in oropharyngeal squamous cell carcinoma: comparison of 2D and 3D segmentation
Authors
Jiliang Ren
Ying Yuan
Meng Qi
Xiaofeng Tao
Publication date
01-12-2020
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 12/2020
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-020-07011-4

Other articles of this Issue 12/2020

European Radiology 12/2020 Go to the issue