Skip to main content
Top
Published in: Insights into Imaging 1/2021

Open Access 01-12-2021 | Computed Tomography | Original Article

Machine learning-based CT radiomics approach for predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma: an exploratory and comparative study

Authors: Yingjie Xv, Fajin Lv, Haoming Guo, Xiang Zhou, Hao Tan, Mingzhao Xiao, Yineng Zheng

Published in: Insights into Imaging | Issue 1/2021

Login to get access

Abstract

Purpose

To investigate the predictive performance of machine learning-based CT radiomics for differentiating between low- and high-nuclear grade of clear cell renal cell carcinomas (CCRCCs).

Methods

This retrospective study enrolled 406 patients with pathologically confirmed low- and high-nuclear grade of CCRCCs according to the WHO/ISUP grading system, which were divided into the training and testing cohorts. Radiomics features were extracted from nephrographic-phase CT images using PyRadiomics. A support vector machine (SVM) combined with three feature selection algorithms such as least absolute shrinkage and selection operator (LASSO), recursive feature elimination (RFE), and ReliefF was performed to determine the most suitable classification model, respectively. Clinicoradiological, radiomics, and combined models were constructed using the radiological and clinical characteristics with significant differences between the groups, selected radiomics features, and a combination of both, respectively. Model performance was evaluated by receiver operating characteristic (ROC) curve, calibration curve, and decision curve analyses.

Results

SVM-ReliefF algorithm outperformed SVM-LASSO and SVM-RFE in distinguishing low- from high-grade CCRCCs. The combined model showed better prediction performance than the clinicoradiological and radiomics models (p < 0.05, DeLong test), which achieved the highest efficacy, with an area under the ROC curve (AUC) value of 0.887 (95% confidence interval [CI] 0.798–0.952), 0.859 (95% CI 0.748–0.935), and 0.828 (95% CI 0.731–0.929) in the training, validation, and testing cohorts, respectively. The calibration and decision curves also indicated the favorable performance of the combined model.

Conclusion

A combined model incorporating the radiomics features and clinicoradiological characteristics can better predict the WHO/ISUP nuclear grade of CCRCC preoperatively, thus providing effective and noninvasive assessment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Escudier B, Porta C, Schmidinger M et al (2019) Renal cell carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 30:706–720PubMed Escudier B, Porta C, Schmidinger M et al (2019) Renal cell carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 30:706–720PubMed
2.
go back to reference Capitanio U, Bensalah K, Bex A et al (2019) Epidemiology of renal cell carcinoma. Eur Urol 75:74–84PubMed Capitanio U, Bensalah K, Bex A et al (2019) Epidemiology of renal cell carcinoma. Eur Urol 75:74–84PubMed
5.
go back to reference Minardi D, Lucarini G, Mazzucchelli R et al (2005) Prognostic role of Fuhrman grade and vascular endothelial growth factor in pT1a clear cell carcinoma in partial nephrectomy specimens. J Urol 174:1208–1212PubMed Minardi D, Lucarini G, Mazzucchelli R et al (2005) Prognostic role of Fuhrman grade and vascular endothelial growth factor in pT1a clear cell carcinoma in partial nephrectomy specimens. J Urol 174:1208–1212PubMed
6.
go back to reference Ljungberg B, Bensalah K, Canfield S et al (2015) EAU guidelines on renal cell carcinoma: 2014 update. Eur Urol 67:913–924PubMed Ljungberg B, Bensalah K, Canfield S et al (2015) EAU guidelines on renal cell carcinoma: 2014 update. Eur Urol 67:913–924PubMed
7.
go back to reference Ljungberg B, Albiges L, Abu-Ghanem Y et al (2019) European association of urology guidelines on renal cell carcinoma: the 2019 update. Eur Urol 75:799–810PubMed Ljungberg B, Albiges L, Abu-Ghanem Y et al (2019) European association of urology guidelines on renal cell carcinoma: the 2019 update. Eur Urol 75:799–810PubMed
8.
go back to reference Moch H, Cubilla A, Humphrey P, Reuter V, Ulbright T (2016) The 2016 WHO classification of tumours of the urinary system and male genital organs-part A: renal, penile, and testicular tumours. Eur Urol 70:93–105PubMed Moch H, Cubilla A, Humphrey P, Reuter V, Ulbright T (2016) The 2016 WHO classification of tumours of the urinary system and male genital organs-part A: renal, penile, and testicular tumours. Eur Urol 70:93–105PubMed
9.
go back to reference Delahunt B, Cheville J, Martignoni G et al (2013) The International Society of Urological Pathology (ISUP) grading system for renal cell carcinoma and other prognostic parameters. Am J Surg Pathol 37:1490–1504PubMed Delahunt B, Cheville J, Martignoni G et al (2013) The International Society of Urological Pathology (ISUP) grading system for renal cell carcinoma and other prognostic parameters. Am J Surg Pathol 37:1490–1504PubMed
10.
go back to reference Kuthi L, Jenei A, Hajdu A et al (2017) Prognostic factors for renal cell carcinoma subtypes diagnosed according to the 2016 WHO renal tumor classification: a study involving 928 patients. Pathol Oncol Res POR 23:689–698PubMed Kuthi L, Jenei A, Hajdu A et al (2017) Prognostic factors for renal cell carcinoma subtypes diagnosed according to the 2016 WHO renal tumor classification: a study involving 928 patients. Pathol Oncol Res POR 23:689–698PubMed
11.
go back to reference Bhatt J, Finelli A (2014) Landmarks in the diagnosis and treatment of renal cell carcinoma. Nat Rev Urol 11:517–525PubMed Bhatt J, Finelli A (2014) Landmarks in the diagnosis and treatment of renal cell carcinoma. Nat Rev Urol 11:517–525PubMed
12.
go back to reference Ficarra V, Martignoni G, Maffei N et al (2005) Original and reviewed nuclear grading according to the Fuhrman system: a multivariate analysis of 388 patients with conventional renal cell carcinoma. Cancer 103:68–75PubMed Ficarra V, Martignoni G, Maffei N et al (2005) Original and reviewed nuclear grading according to the Fuhrman system: a multivariate analysis of 388 patients with conventional renal cell carcinoma. Cancer 103:68–75PubMed
13.
go back to reference Marconi L, Dabestani S, Lam T et al (2016) Systematic review and meta-analysis of diagnostic accuracy of percutaneous renal tumour biopsy. Eur Urol 69:660–673PubMed Marconi L, Dabestani S, Lam T et al (2016) Systematic review and meta-analysis of diagnostic accuracy of percutaneous renal tumour biopsy. Eur Urol 69:660–673PubMed
14.
go back to reference Kutikov A, Smaldone M, Uzzo R, Haifler M, Bratslavsky G, Leibovich B (2016) Renal mass biopsy: always, sometimes, or never? Eur Urol 70:403–406PubMed Kutikov A, Smaldone M, Uzzo R, Haifler M, Bratslavsky G, Leibovich B (2016) Renal mass biopsy: always, sometimes, or never? Eur Urol 70:403–406PubMed
15.
go back to reference Kang S, Huang W, Pandharipande P, Chandarana H (2014) Solid renal masses: what the numbers tell us. AJR Am J Roentgenol 202:1196–1206PubMedPubMedCentral Kang S, Huang W, Pandharipande P, Chandarana H (2014) Solid renal masses: what the numbers tell us. AJR Am J Roentgenol 202:1196–1206PubMedPubMedCentral
16.
go back to reference Campbell S, Novick A, Belldegrun A et al (2009) Guideline for management of the clinical T1 renal mass. J Urol 182:1271–1279PubMed Campbell S, Novick A, Belldegrun A et al (2009) Guideline for management of the clinical T1 renal mass. J Urol 182:1271–1279PubMed
17.
go back to reference Ljungberg B, Cowan N, Hanbury D et al (2010) EAU guidelines on renal cell carcinoma: the 2010 update. Eur Urol 58:398–406PubMed Ljungberg B, Cowan N, Hanbury D et al (2010) EAU guidelines on renal cell carcinoma: the 2010 update. Eur Urol 58:398–406PubMed
18.
go back to reference Erickson B, Korfiatis P, Akkus Z, Kline T (2017) Machine learning for medical imaging. Radiographics 37:505–515PubMed Erickson B, Korfiatis P, Akkus Z, Kline T (2017) Machine learning for medical imaging. Radiographics 37:505–515PubMed
19.
go back to reference Lubner M, Smith A, Sandrasegaran K, Sahani D, Pickhardt P (2017) CT texture analysis: definitions, applications, biologic correlates, and challenges. Radiographics 37:1483–1503PubMed Lubner M, Smith A, Sandrasegaran K, Sahani D, Pickhardt P (2017) CT texture analysis: definitions, applications, biologic correlates, and challenges. Radiographics 37:1483–1503PubMed
20.
go back to reference van Timmeren J, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B (2020) Radiomics in medical imaging-"how-to" guide and critical reflection. Insights Imaging 11:91PubMedPubMedCentral van Timmeren J, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B (2020) Radiomics in medical imaging-"how-to" guide and critical reflection. Insights Imaging 11:91PubMedPubMedCentral
21.
go back to reference Cui E, Li Z, Ma C et al (2020) Predicting the ISUP grade of clear cell renal cell carcinoma with multiparametric MR and multiphase CT radiomics. Eur Radiol 30:2912–2921PubMed Cui E, Li Z, Ma C et al (2020) Predicting the ISUP grade of clear cell renal cell carcinoma with multiparametric MR and multiphase CT radiomics. Eur Radiol 30:2912–2921PubMed
22.
go back to reference Zhou H, Mao H, Dong D et al (2020) Development and external validation of radiomics approach for nuclear grading in clear cell renal cell carcinoma. Ann Surg Oncol 27:4057–4065PubMed Zhou H, Mao H, Dong D et al (2020) Development and external validation of radiomics approach for nuclear grading in clear cell renal cell carcinoma. Ann Surg Oncol 27:4057–4065PubMed
24.
go back to reference Shu J, Tang Y, Cui J et al (2018) Clear cell renal cell carcinoma: CT-based radiomics features for the prediction of Fuhrman grade. Eur J Radiol 109:8–12PubMed Shu J, Tang Y, Cui J et al (2018) Clear cell renal cell carcinoma: CT-based radiomics features for the prediction of Fuhrman grade. Eur J Radiol 109:8–12PubMed
25.
go back to reference Blagus R, Lusa L (2013) SMOTE for high-dimensional class-imbalanced data. BMC Bioinform 14:106 Blagus R, Lusa L (2013) SMOTE for high-dimensional class-imbalanced data. BMC Bioinform 14:106
26.
go back to reference Lai S, Sun L, Wu J et al (2021) Multiphase contrast-enhanced CT-based machine learning models to predict the Fuhrman nuclear grade of clear cell renal cell carcinoma. Cancer Manag Res 13:999–1008PubMedPubMedCentral Lai S, Sun L, Wu J et al (2021) Multiphase contrast-enhanced CT-based machine learning models to predict the Fuhrman nuclear grade of clear cell renal cell carcinoma. Cancer Manag Res 13:999–1008PubMedPubMedCentral
27.
go back to reference Jiang Y, Li W, Huang C et al (2020) A computed tomography-based radiomics nomogram to preoperatively predict tumor necrosis in patients with clear cell renal cell carcinoma. Front Oncol 10:592PubMedPubMedCentral Jiang Y, Li W, Huang C et al (2020) A computed tomography-based radiomics nomogram to preoperatively predict tumor necrosis in patients with clear cell renal cell carcinoma. Front Oncol 10:592PubMedPubMedCentral
29.
go back to reference Meng X, Shu J, Xia Y, Yang R (2020) A CT-based radiomics approach for the differential diagnosis of sarcomatoid and clear cell renal cell carcinoma. Biomed Res Int 2020:7103647PubMedPubMedCentral Meng X, Shu J, Xia Y, Yang R (2020) A CT-based radiomics approach for the differential diagnosis of sarcomatoid and clear cell renal cell carcinoma. Biomed Res Int 2020:7103647PubMedPubMedCentral
30.
go back to reference Yushkevich P, Piven J, Hazlett H et al (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMed Yushkevich P, Piven J, Hazlett H et al (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMed
31.
go back to reference van Griethuysen J, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Can Res 77:e104–e107 van Griethuysen J, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Can Res 77:e104–e107
32.
go back to reference Kocak B, Kus E, Kilickesmez O (2021) How to read and review papers on machine learning and artificial intelligence in radiology: a survival guide to key methodological concepts. Eur Radiol 31:1819–1830PubMed Kocak B, Kus E, Kilickesmez O (2021) How to read and review papers on machine learning and artificial intelligence in radiology: a survival guide to key methodological concepts. Eur Radiol 31:1819–1830PubMed
33.
go back to reference Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol) 57:289–300 Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol) 57:289–300
34.
go back to reference Marcon J, Graser A, Horst D et al (2020) Papillary vs clear cell renal cell carcinoma. Differentiation and grading by iodine concentration using DECT-correlation with microvascular density. Eur Radiol 30:1–10PubMed Marcon J, Graser A, Horst D et al (2020) Papillary vs clear cell renal cell carcinoma. Differentiation and grading by iodine concentration using DECT-correlation with microvascular density. Eur Radiol 30:1–10PubMed
35.
go back to reference Ye J, Xu Q, Wang S, Zheng J, Dou W (2020) Quantitative evaluation of intravoxel incoherent motion and diffusion kurtosis imaging in assessment of pathological grade of clear cell renal cell carcinoma. Acad Radiol 27:e176–e182PubMed Ye J, Xu Q, Wang S, Zheng J, Dou W (2020) Quantitative evaluation of intravoxel incoherent motion and diffusion kurtosis imaging in assessment of pathological grade of clear cell renal cell carcinoma. Acad Radiol 27:e176–e182PubMed
36.
go back to reference Bi W, Hosny A, Schabath M et al (2019) Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin 69:127–157PubMedPubMedCentral Bi W, Hosny A, Schabath M et al (2019) Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin 69:127–157PubMedPubMedCentral
37.
go back to reference Lambin P, Leijenaar R, Deist T et al (2017) Radiomics: the bridge between medical imaging and personalized Medicine (Baltimore). Nat Rev Clin Oncol 14:749–762PubMed Lambin P, Leijenaar R, Deist T et al (2017) Radiomics: the bridge between medical imaging and personalized Medicine (Baltimore). Nat Rev Clin Oncol 14:749–762PubMed
38.
go back to reference Liu Z, Wang S, Dong D et al (2019) The applications of radiomics in precision diagnosis and treatment of oncology: opportunities and challenges. Theranostics 9:1303–1322PubMedPubMedCentral Liu Z, Wang S, Dong D et al (2019) The applications of radiomics in precision diagnosis and treatment of oncology: opportunities and challenges. Theranostics 9:1303–1322PubMedPubMedCentral
39.
go back to reference Warren A, Harrison D (2018) WHO/ISUP classification, grading and pathological staging of renal cell carcinoma: standards and controversies. World J Urol 36:1913–1926PubMedPubMedCentral Warren A, Harrison D (2018) WHO/ISUP classification, grading and pathological staging of renal cell carcinoma: standards and controversies. World J Urol 36:1913–1926PubMedPubMedCentral
40.
go back to reference Zheng Z, Chen Z, Xie Y, Zhong Q, Xie W (2021) Development and validation of a CT-based nomogram for preoperative prediction of clear cell renal cell carcinoma grades. Eur Radiol 31:6078–6086PubMed Zheng Z, Chen Z, Xie Y, Zhong Q, Xie W (2021) Development and validation of a CT-based nomogram for preoperative prediction of clear cell renal cell carcinoma grades. Eur Radiol 31:6078–6086PubMed
41.
go back to reference Wang R, Hu Z, Shen X et al (2021) Computed tomography-based radiomics model for predicting the WHO/ISUP grade of clear cell renal cell carcinoma preoperatively: a multicenter study. Front Oncol 11:543854PubMedPubMedCentral Wang R, Hu Z, Shen X et al (2021) Computed tomography-based radiomics model for predicting the WHO/ISUP grade of clear cell renal cell carcinoma preoperatively: a multicenter study. Front Oncol 11:543854PubMedPubMedCentral
42.
go back to reference Yi X, Xiao Q, Zeng F et al (2020) Computed tomography radiomics for predicting pathological grade of renal cell carcinoma. Front Oncol 10:570396PubMed Yi X, Xiao Q, Zeng F et al (2020) Computed tomography radiomics for predicting pathological grade of renal cell carcinoma. Front Oncol 10:570396PubMed
43.
go back to reference Ding J, Xing Z, Jiang Z et al (2018) CT-based radiomic model predicts high grade of clear cell renal cell carcinoma. Eur J Radiol 103:51–56PubMed Ding J, Xing Z, Jiang Z et al (2018) CT-based radiomic model predicts high grade of clear cell renal cell carcinoma. Eur J Radiol 103:51–56PubMed
44.
go back to reference Moldovanu C, Boca B, Lebovici A et al (2020) Preoperative predicting the WHO/ISUP nuclear grade of clear cell renal cell carcinoma by computed tomography-based radiomics features. J Pers Med 11:613668 Moldovanu C, Boca B, Lebovici A et al (2020) Preoperative predicting the WHO/ISUP nuclear grade of clear cell renal cell carcinoma by computed tomography-based radiomics features. J Pers Med 11:613668
45.
go back to reference Han D, Yu Y, Yu N et al (2020) Prediction models for clear cell renal cell carcinoma ISUP/WHO grade: comparison between CT radiomics and conventional contrast-enhanced CT. Br J Radiol 93:20200131PubMedPubMedCentral Han D, Yu Y, Yu N et al (2020) Prediction models for clear cell renal cell carcinoma ISUP/WHO grade: comparison between CT radiomics and conventional contrast-enhanced CT. Br J Radiol 93:20200131PubMedPubMedCentral
46.
go back to reference He X, Zhang H, Zhang T, Han F, Song B (2019) Predictive models composed by radiomic features extracted from multi-detector computed tomography images for predicting low- and high- grade clear cell renal cell carcinoma: a STARD-compliant article. Medicine 98:e13957PubMedPubMedCentral He X, Zhang H, Zhang T, Han F, Song B (2019) Predictive models composed by radiomic features extracted from multi-detector computed tomography images for predicting low- and high- grade clear cell renal cell carcinoma: a STARD-compliant article. Medicine 98:e13957PubMedPubMedCentral
47.
go back to reference Yan L, Chai N, Bao Y, Ge Y, Cheng Q (2020) Enhanced computed tomography-based radiomics signature combined with clinical features in evaluating nuclear grading of renal clear cell carcinoma. J Comput Assist Tomogr 44:730–736PubMed Yan L, Chai N, Bao Y, Ge Y, Cheng Q (2020) Enhanced computed tomography-based radiomics signature combined with clinical features in evaluating nuclear grading of renal clear cell carcinoma. J Comput Assist Tomogr 44:730–736PubMed
48.
go back to reference Li Q, Liu Y, Dong D et al (2020) Multiparametric MRI radiomic model for preoperative predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma. J Magn Reson Imaging 52:1557–1566PubMed Li Q, Liu Y, Dong D et al (2020) Multiparametric MRI radiomic model for preoperative predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma. J Magn Reson Imaging 52:1557–1566PubMed
49.
go back to reference Xu K, Liu L, Li W et al (2020) CT-based radiomics signature for preoperative prediction of coagulative necrosis in clear cell renal cell carcinoma. Korean J Radiol 21:670–683PubMedPubMedCentral Xu K, Liu L, Li W et al (2020) CT-based radiomics signature for preoperative prediction of coagulative necrosis in clear cell renal cell carcinoma. Korean J Radiol 21:670–683PubMedPubMedCentral
50.
go back to reference Frank I, Blute M, Cheville J, Lohse C, Weaver A, Zincke H (2002) An outcome prediction model for patients with clear cell renal cell carcinoma treated with radical nephrectomy based on tumor stage, size, grade and necrosis: the SSIGN score. J Urol 168:2395–2400PubMed Frank I, Blute M, Cheville J, Lohse C, Weaver A, Zincke H (2002) An outcome prediction model for patients with clear cell renal cell carcinoma treated with radical nephrectomy based on tumor stage, size, grade and necrosis: the SSIGN score. J Urol 168:2395–2400PubMed
51.
go back to reference Motzer R, Jonasch E, Agarwal N et al (2017) Kidney cancer, version 2.2017, NCCN clinical practice guidelines in oncology. J Natl Compr Cancer Netw 15:804–834 Motzer R, Jonasch E, Agarwal N et al (2017) Kidney cancer, version 2.2017, NCCN clinical practice guidelines in oncology. J Natl Compr Cancer Netw 15:804–834
52.
go back to reference Kocak B, Kaya O, Erdim C, Kus E, Kilickesmez O (2020) Artificial intelligence in renal mass characterization: a systematic review of methodologic items related to modeling, performance evaluation, clinical utility, and transparency. AJR Am J Roentgenol 215:1113–1122PubMed Kocak B, Kaya O, Erdim C, Kus E, Kilickesmez O (2020) Artificial intelligence in renal mass characterization: a systematic review of methodologic items related to modeling, performance evaluation, clinical utility, and transparency. AJR Am J Roentgenol 215:1113–1122PubMed
Metadata
Title
Machine learning-based CT radiomics approach for predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma: an exploratory and comparative study
Authors
Yingjie Xv
Fajin Lv
Haoming Guo
Xiang Zhou
Hao Tan
Mingzhao Xiao
Yineng Zheng
Publication date
01-12-2021
Publisher
Springer International Publishing
Published in
Insights into Imaging / Issue 1/2021
Electronic ISSN: 1869-4101
DOI
https://doi.org/10.1186/s13244-021-01107-1

Other articles of this Issue 1/2021

Insights into Imaging 1/2021 Go to the issue