Skip to main content
Top
Published in: European Radiology 11/2021

01-11-2021 | Computed Tomography | Imaging Informatics and Artificial Intelligence

Radiomics analysis of contrast-enhanced CT for classification of hepatic focal lesions in colorectal cancer patients: its limitations compared to radiologists

Authors: Heejin Bae, Hansang Lee, Sungwon Kim, Kyunghwa Han, Hyungjin Rhee, Dong-kyu Kim, Hyuk Kwon, Helen Hong, Joon Seok Lim

Published in: European Radiology | Issue 11/2021

Login to get access

Abstract

Objective

To evaluate diagnostic performance of a radiomics model for classifying hepatic cyst, hemangioma, and metastasis in patients with colorectal cancer (CRC) from portal-phase abdominopelvic CT images.

Methods

This retrospective study included 502 CRC patients who underwent contrast-enhanced CT and contrast-enhanced liver MRI between January 2005 and December 2010. Portal-phase CT images of training (n = 386) and validation (n = 116) cohorts were used to develop a radiomics model for differentiating three classes of liver lesions. Among multiple handcrafted features, the feature selection was performed using ReliefF method, and random forest classifiers were used to train the selected features. Diagnostic performance of the developed model was compared with that of four radiologists. A subgroup analysis was conducted based on lesion size.

Results

The radiomics model demonstrated significantly lower overall and hemangioma- and metastasis-specific polytomous discrimination index (PDI) (overall, 0.8037; hemangioma-specific, 0.6653; metastasis-specific, 0.8027) than the radiologists (overall, 0.9622–0.9680; hemangioma-specific, 0.9452–0.9630; metastasis-specific, 0.9511–0.9869). For subgroup analysis, the PDI of the radiomics model was different according to the lesion size (< 10 mm, 0.6486; ≥ 10 mm, 0.8264) while that of the radiologists was relatively maintained. For classifying metastasis from benign lesions, the radiomics model showed excellent diagnostic performance, with an accuracy of 84.36% and an AUC of 0.9426.

Conclusion

Albeit inferior to the radiologists, the radiomics model achieved substantial diagnostic performance when differentiating hepatic lesions from portal-phase CT images of CRC patients. This model was limited particularly to classifying hemangiomas and subcentimeter lesions.

Key Points

• Albeit inferior to the radiologists, the radiomics model could differentiate cyst, hemangioma, and metastasis with substantial diagnostic performance using portal-phase CT images of colorectal cancer patients.
• The radiomics model demonstrated limitations especially in classifying hemangiomas and subcentimeter liver lesions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Manfredi S, Lepage C, Hatem C, Coatmeur O, Faivre J, Bouvier A-M (2006) Epidemiology and management of liver metastases from colorectal cancer. Ann Surg 244:254–259CrossRef Manfredi S, Lepage C, Hatem C, Coatmeur O, Faivre J, Bouvier A-M (2006) Epidemiology and management of liver metastases from colorectal cancer. Ann Surg 244:254–259CrossRef
2.
go back to reference Zarour LR, Anand S, Billingsley KG et al (2017) Colorectal cancer liver metastasis: evolving paradigms and future directions. Cell Mol Gastroenterol Hepatol 3:163–173CrossRef Zarour LR, Anand S, Billingsley KG et al (2017) Colorectal cancer liver metastasis: evolving paradigms and future directions. Cell Mol Gastroenterol Hepatol 3:163–173CrossRef
3.
go back to reference Bengtsson G, Carlsson G, Hafstrom L, Jonsson PE (1981) Natural history of patients with untreated liver metastases from colorectal cancer. Am J Surg 141:586–589CrossRef Bengtsson G, Carlsson G, Hafstrom L, Jonsson PE (1981) Natural history of patients with untreated liver metastases from colorectal cancer. Am J Surg 141:586–589CrossRef
4.
go back to reference Abdalla EK, Vauthey J-N, Ellis LM et al (2004) Recurrence and outcomes following hepatic resection, radiofrequency ablation, and combined resection/ablation for colorectal liver metastases. Ann Surg 239:818–827CrossRef Abdalla EK, Vauthey J-N, Ellis LM et al (2004) Recurrence and outcomes following hepatic resection, radiofrequency ablation, and combined resection/ablation for colorectal liver metastases. Ann Surg 239:818–827CrossRef
5.
go back to reference Jones RP, Kokudo N, Folprecht G et al (2016) Colorectal liver metastases: a critical review of state of the art. Liver Cancer 6:66–71CrossRef Jones RP, Kokudo N, Folprecht G et al (2016) Colorectal liver metastases: a critical review of state of the art. Liver Cancer 6:66–71CrossRef
6.
go back to reference Limkin EJ, Sun R, Dercle L et al (2017) Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Ann Oncol 28:1191–1206CrossRef Limkin EJ, Sun R, Dercle L et al (2017) Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Ann Oncol 28:1191–1206CrossRef
7.
go back to reference Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef
8.
go back to reference Alahmer H, Ahmed A (2016) Computer-aided classification of liver lesions from CT images based on multiple ROI. Procedia Comput Sci 90:80–86CrossRef Alahmer H, Ahmed A (2016) Computer-aided classification of liver lesions from CT images based on multiple ROI. Procedia Comput Sci 90:80–86CrossRef
9.
go back to reference Gletsos M, Mougiakakou SG, Matsopoulos GK, Nikita KS, Nikita AS, Kelekis D (2003) A computer-aided diagnostic system to characterize CT focal liver lesions: design and optimization of a neural network classifier. IEEE Trans Inf Technol Biomed 7:153–162CrossRef Gletsos M, Mougiakakou SG, Matsopoulos GK, Nikita KS, Nikita AS, Kelekis D (2003) A computer-aided diagnostic system to characterize CT focal liver lesions: design and optimization of a neural network classifier. IEEE Trans Inf Technol Biomed 7:153–162CrossRef
10.
go back to reference Chang CC, Chen HH, Chang YC et al (2017) Computer-aided diagnosis of liver tumors on computed tomography images. Comput Methods Prog Biomed 145:45–51CrossRef Chang CC, Chen HH, Chang YC et al (2017) Computer-aided diagnosis of liver tumors on computed tomography images. Comput Methods Prog Biomed 145:45–51CrossRef
11.
go back to reference Song S, Li Z, Niu L et al (2019) Hypervascular hepatic focal lesions on dynamic contrast-enhanced CT: preliminary data from arterial phase scans texture analysis for classification. Clin Radiol 74:653.e11–653.e18CrossRef Song S, Li Z, Niu L et al (2019) Hypervascular hepatic focal lesions on dynamic contrast-enhanced CT: preliminary data from arterial phase scans texture analysis for classification. Clin Radiol 74:653.e11–653.e18CrossRef
12.
go back to reference Park SH, Han K (2018) Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286:800–809CrossRef Park SH, Han K (2018) Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286:800–809CrossRef
13.
go back to reference Park JE, Park SY, Kim HJ, Kim HS (2019) Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol 20:1124–1137CrossRef Park JE, Park SY, Kim HJ, Kim HS (2019) Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol 20:1124–1137CrossRef
14.
go back to reference Tirumani SH, Kim KW, Nishino M et al (2014) Update on the role of imaging in management of metastatic colorectal cancer. Radiographics 34:1908–1928CrossRef Tirumani SH, Kim KW, Nishino M et al (2014) Update on the role of imaging in management of metastatic colorectal cancer. Radiographics 34:1908–1928CrossRef
15.
go back to reference Floriani I, Torri V, Rulli E et al (2010) Performance of imaging modalities in diagnosis of liver metastases from colorectal cancer: a systematic review and meta-analysis. J Magn Reson Imaging 31:19–31CrossRef Floriani I, Torri V, Rulli E et al (2010) Performance of imaging modalities in diagnosis of liver metastases from colorectal cancer: a systematic review and meta-analysis. J Magn Reson Imaging 31:19–31CrossRef
16.
go back to reference Rojas Llimpe FL, Di Fabio F, Ercolani G et al (2014) Imaging in resectable colorectal liver metastasis patients with or without preoperative chemotherapy: results of the PROMETEO-01 study. Br J Cancer 111:667–673CrossRef Rojas Llimpe FL, Di Fabio F, Ercolani G et al (2014) Imaging in resectable colorectal liver metastasis patients with or without preoperative chemotherapy: results of the PROMETEO-01 study. Br J Cancer 111:667–673CrossRef
17.
go back to reference Sivesgaard K, Larsen LP, Sorensen M et al (2018) Diagnostic accuracy of CE-CT, MRI and FDG PET/CT for detecting colorectal cancer liver metastases in patients considered eligible for hepatic resection and/or local ablation. Eur Radiol 28:4735–4747CrossRef Sivesgaard K, Larsen LP, Sorensen M et al (2018) Diagnostic accuracy of CE-CT, MRI and FDG PET/CT for detecting colorectal cancer liver metastases in patients considered eligible for hepatic resection and/or local ablation. Eur Radiol 28:4735–4747CrossRef
18.
go back to reference Kim HJ, Lee SS, Byun JH et al (2015) Incremental value of liver MR imaging in patients with potentially curable colorectal hepatic metastasis detected at CT: a prospective comparison of diffusion-weighted imaging, gadoxetic acid-enhanced MR imaging, and a combination of both MR techniques. Radiology 274:712–722CrossRef Kim HJ, Lee SS, Byun JH et al (2015) Incremental value of liver MR imaging in patients with potentially curable colorectal hepatic metastasis detected at CT: a prospective comparison of diffusion-weighted imaging, gadoxetic acid-enhanced MR imaging, and a combination of both MR techniques. Radiology 274:712–722CrossRef
19.
go back to reference Niekel MC, Bipat S, Stoker J (2010) Diagnostic imaging of colorectal liver metastases with CT, MR imaging, FDG PET, and/or FDG PET/CT: a meta-analysis of prospective studies including patients who have not previously undergone treatment. Radiology 257:674–684CrossRef Niekel MC, Bipat S, Stoker J (2010) Diagnostic imaging of colorectal liver metastases with CT, MR imaging, FDG PET, and/or FDG PET/CT: a meta-analysis of prospective studies including patients who have not previously undergone treatment. Radiology 257:674–684CrossRef
20.
go back to reference Zech CJ, Korpraphong P, Huppertz A et al (2014) Randomized multicentre trial of gadoxetic acid-enhanced MRI versus conventional MRI or CT in the staging of colorectal cancer liver metastases. Br J Surg 101:613–621CrossRef Zech CJ, Korpraphong P, Huppertz A et al (2014) Randomized multicentre trial of gadoxetic acid-enhanced MRI versus conventional MRI or CT in the staging of colorectal cancer liver metastases. Br J Surg 101:613–621CrossRef
21.
go back to reference Jhaveri KS, Fischer SE, Hosseini-Nik H et al (2017) Prospective comparison of gadoxetic acid-enhanced liver MRI and contrast-enhanced CT with histopathological correlation for preoperative detection of colorectal liver metastases following chemotherapy and potential impact on surgical plan. HPB (Oxford) 19:992–1000CrossRef Jhaveri KS, Fischer SE, Hosseini-Nik H et al (2017) Prospective comparison of gadoxetic acid-enhanced liver MRI and contrast-enhanced CT with histopathological correlation for preoperative detection of colorectal liver metastases following chemotherapy and potential impact on surgical plan. HPB (Oxford) 19:992–1000CrossRef
23.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef
24.
go back to reference Lee HS, Hong H, Jung DC, Park S, Kim J (2017) Differentiation of fat-poor angiomyolipoma from clear cell renal cell carcinoma in contrast-enhanced MDCT images using quantitative feature classification. Med Phys 44:3604–3614CrossRef Lee HS, Hong H, Jung DC, Park S, Kim J (2017) Differentiation of fat-poor angiomyolipoma from clear cell renal cell carcinoma in contrast-enhanced MDCT images using quantitative feature classification. Med Phys 44:3604–3614CrossRef
25.
go back to reference Lee H, Hong H, Kim J, Jung DC (2018) Deep feature classification of angiomyolipoma without visible fat and renal cell carcinoma in abdominal contrast-enhanced CT images with texture image patches and hand-crafted feature concatenation. Med Phys 45:1550–1561CrossRef Lee H, Hong H, Kim J, Jung DC (2018) Deep feature classification of angiomyolipoma without visible fat and renal cell carcinoma in abdominal contrast-enhanced CT images with texture image patches and hand-crafted feature concatenation. Med Phys 45:1550–1561CrossRef
26.
go back to reference Robnik-Sikonja M, Kononenko I (1997) An adaptation of Relief for attribute estimation in regression. Proceedings of the Fourteenth International Conference on Machine Learning (ICML’97). Morgan Kaufmann Publishers Inc., San Francisco, CA Robnik-Sikonja M, Kononenko I (1997) An adaptation of Relief for attribute estimation in regression. Proceedings of the Fourteenth International Conference on Machine Learning (ICML’97). Morgan Kaufmann Publishers Inc., San Francisco, CA
28.
go back to reference Van Calster B, Van Belle V, Vergouwe Y, Timmerman D, Van Huffel S, Steyerberg EW (2012) Extending the c-statistic to nominal polytomous outcomes: the Polytomous Discrimination Index. Stat Med 31:2610–2626CrossRef Van Calster B, Van Belle V, Vergouwe Y, Timmerman D, Van Huffel S, Steyerberg EW (2012) Extending the c-statistic to nominal polytomous outcomes: the Polytomous Discrimination Index. Stat Med 31:2610–2626CrossRef
29.
go back to reference Dreižienė L, Dučinskas K, Paulionienė L (2015) Correct classification rates in multi-category discriminant analysis of spatial Gaussian data. Open J Stat 5:21–26CrossRef Dreižienė L, Dučinskas K, Paulionienė L (2015) Correct classification rates in multi-category discriminant analysis of spatial Gaussian data. Open J Stat 5:21–26CrossRef
30.
go back to reference Huang YL, Chen JH, Shen WC (2006) Diagnosis of hepatic tumors with texture analysis in nonenhanced computed tomography images. Acad Radiol 13:713–720CrossRef Huang YL, Chen JH, Shen WC (2006) Diagnosis of hepatic tumors with texture analysis in nonenhanced computed tomography images. Acad Radiol 13:713–720CrossRef
31.
go back to reference Mougiakakou SG, Valavanis IK, Nikita A, Nikita KS (2007) Differential diagnosis of CT focal liver lesions using texture features, feature selection and ensemble driven classifiers. Artif Intell Med 41:25–37CrossRef Mougiakakou SG, Valavanis IK, Nikita A, Nikita KS (2007) Differential diagnosis of CT focal liver lesions using texture features, feature selection and ensemble driven classifiers. Artif Intell Med 41:25–37CrossRef
32.
go back to reference Acharya UR, Koh JEW, Hagiwara Y et al (2018) Automated diagnosis of focal liver lesions using bidirectional empirical mode decomposition features. Comput Biol Med 94:11–18CrossRef Acharya UR, Koh JEW, Hagiwara Y et al (2018) Automated diagnosis of focal liver lesions using bidirectional empirical mode decomposition features. Comput Biol Med 94:11–18CrossRef
33.
go back to reference Yasaka K, Akai H, Abe O, Kiryu S (2018) Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: a preliminary study. Radiology 286:887–896CrossRef Yasaka K, Akai H, Abe O, Kiryu S (2018) Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: a preliminary study. Radiology 286:887–896CrossRef
35.
go back to reference Klotz T, Montoriol PF, Da Ines D, Petitcolin V, Joubert-Zakeyh J, Garcier JM (2013) Hepatic haemangioma: common and uncommon imaging features. Diagn Interv Imaging 94:849–859CrossRef Klotz T, Montoriol PF, Da Ines D, Petitcolin V, Joubert-Zakeyh J, Garcier JM (2013) Hepatic haemangioma: common and uncommon imaging features. Diagn Interv Imaging 94:849–859CrossRef
36.
go back to reference Caseiro-Alves F, Brito J, Araujo AE et al (2007) Liver haemangioma: common and uncommon findings and how to improve the differential diagnosis. Eur Radiol 17:1544–1554CrossRef Caseiro-Alves F, Brito J, Araujo AE et al (2007) Liver haemangioma: common and uncommon findings and how to improve the differential diagnosis. Eur Radiol 17:1544–1554CrossRef
37.
go back to reference Khalil HI, Patterson SA, Panicek DM (2005) Hepatic lesions deemed too small to characterize at CT: prevalence and importance in women with breast cancer. Radiology 235:872–878CrossRef Khalil HI, Patterson SA, Panicek DM (2005) Hepatic lesions deemed too small to characterize at CT: prevalence and importance in women with breast cancer. Radiology 235:872–878CrossRef
38.
go back to reference Jones EC, Chezmar JL, Nelson RC, Bernardino ME (1992) The frequency and significance of small (less than or equal to 15 mm) hepatic lesions detected by CT. AJR Am J Roentgenol 158:535–539CrossRef Jones EC, Chezmar JL, Nelson RC, Bernardino ME (1992) The frequency and significance of small (less than or equal to 15 mm) hepatic lesions detected by CT. AJR Am J Roentgenol 158:535–539CrossRef
39.
go back to reference Schwartz LH, Gandras EJ, Colangelo SM, Ercolani MC, Panicek DM (1999) Prevalence and importance of small hepatic lesions found at CT in patients with cancer. Radiology 210:71–74CrossRef Schwartz LH, Gandras EJ, Colangelo SM, Ercolani MC, Panicek DM (1999) Prevalence and importance of small hepatic lesions found at CT in patients with cancer. Radiology 210:71–74CrossRef
40.
go back to reference Lim GH, Koh DC, Cheong WK, Wong KS, Tsang CB (2009) Natural history of small, “indeterminate” hepatic lesions in patients with colorectal cancer. Dis Colon Rectum 52:1487–1491CrossRef Lim GH, Koh DC, Cheong WK, Wong KS, Tsang CB (2009) Natural history of small, “indeterminate” hepatic lesions in patients with colorectal cancer. Dis Colon Rectum 52:1487–1491CrossRef
41.
go back to reference Jang HJ, Lim HK, Lee WJ, Lee SJ, Yun JY, Choi D (2002) Small hypoattenuating lesions in the liver on single-phase helical CT in preoperative patients with gastric and colorectal cancer: prevalence, significance, and differentiating features. J Comput Assist Tomogr 26:718–724CrossRef Jang HJ, Lim HK, Lee WJ, Lee SJ, Yun JY, Choi D (2002) Small hypoattenuating lesions in the liver on single-phase helical CT in preoperative patients with gastric and colorectal cancer: prevalence, significance, and differentiating features. J Comput Assist Tomogr 26:718–724CrossRef
42.
go back to reference Dankerl P, Cavallaro A, Tsymbal A et al (2013) A retrieval-based computer-aided diagnosis system for the characterization of liver lesions in CT scans. Acad Radiol 20:1526–1534CrossRef Dankerl P, Cavallaro A, Tsymbal A et al (2013) A retrieval-based computer-aided diagnosis system for the characterization of liver lesions in CT scans. Acad Radiol 20:1526–1534CrossRef
43.
go back to reference Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. Eur Radiol 29:3338–3347CrossRef Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. Eur Radiol 29:3338–3347CrossRef
Metadata
Title
Radiomics analysis of contrast-enhanced CT for classification of hepatic focal lesions in colorectal cancer patients: its limitations compared to radiologists
Authors
Heejin Bae
Hansang Lee
Sungwon Kim
Kyunghwa Han
Hyungjin Rhee
Dong-kyu Kim
Hyuk Kwon
Helen Hong
Joon Seok Lim
Publication date
01-11-2021
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 11/2021
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-021-07877-y

Other articles of this Issue 11/2021

European Radiology 11/2021 Go to the issue