Skip to main content
Top
Published in: Abdominal Radiology 1/2021

01-01-2021 | Magnetic Resonance Imaging | Technical

Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning

Authors: Khaled Bousabarah, Brian Letzen, Jonathan Tefera, Lynn Savic, Isabel Schobert, Todd Schlachter, Lawrence H. Staib, Martin Kocher, Julius Chapiro, MingDe Lin

Published in: Abdominal Radiology | Issue 1/2021

Login to get access

Abstract

Purpose

Liver Imaging Reporting and Data System (LI-RADS) uses multiphasic contrast-enhanced imaging for hepatocellular carcinoma (HCC) diagnosis. The goal of this feasibility study was to establish a proof-of-principle concept towards automating the application of LI-RADS, using a deep learning algorithm trained to segment the liver and delineate HCCs on MRI automatically.

Methods

In this retrospective single-center study, multiphasic contrast-enhanced MRIs using T1-weighted breath-hold sequences acquired from 2010 to 2018 were used to train a deep convolutional neural network (DCNN) with a U-Net architecture. The U-Net was trained (using 70% of all data), validated (15%) and tested (15%) on 174 patients with 231 lesions. Manual 3D segmentations of the liver and HCC were ground truth. The dice similarity coefficient (DSC) was measured between manual and DCNN methods. Postprocessing using a random forest (RF) classifier employing radiomic features and thresholding (TR) of the mean neural activation was used to reduce the average false positive rate (AFPR).

Results

73 and 75% of HCCs were detected on validation and test sets, respectively, using > 0.2 DSC criterion between individual lesions and their corresponding segmentations. Validation set AFPRs were 2.81, 0.77, 0.85 for U-Net, U-Net + RF, and U-Net + TR, respectively. Combining both RF and TR with the U-Net improved the AFPR to 0.62 and 0.75 for the validation and test sets, respectively. Mean DSC between automatically detected lesions using the DCNN + RF + TR and corresponding manual segmentations was 0.64/0.68 (validation/test), and 0.91/0.91 for liver segmentations.

Conclusion

Our DCNN approach can segment the liver and HCCs automatically. This could enable a more workflow efficient and clinically realistic implementation of LI-RADS.
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal AJCacjfc (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. 68:394-424 Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal AJCacjfc (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. 68:394-424
2.
go back to reference El-Serag HB, Rudolph KL (2007) Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology 132:2557-2576CrossRef El-Serag HB, Rudolph KL (2007) Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology 132:2557-2576CrossRef
3.
go back to reference White DL, Thrift AP, Kanwal F, Davila J, El-Serag HB (2017) Incidence of Hepatocellular Carcinoma in All 50 United States, From 2000 Through 2012. Gastroenterology 152:812-820 e815 White DL, Thrift AP, Kanwal F, Davila J, El-Serag HB (2017) Incidence of Hepatocellular Carcinoma in All 50 United States, From 2000 Through 2012. Gastroenterology 152:812-820 e815
4.
go back to reference Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer 45:228-247CrossRef Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer 45:228-247CrossRef
5.
go back to reference Ding Y, Rao S-x, Wang W-t, Chen C-z, Li R-c, Zeng M (2018) Comparison of gadoxetic acid versus gadopentetate dimeglumine for the detection of hepatocellular carcinoma at 1.5 T using the liver imaging reporting and data system (LI-RADS v.2017). Cancer Imaging 18:48 Ding Y, Rao S-x, Wang W-t, Chen C-z, Li R-c, Zeng M (2018) Comparison of gadoxetic acid versus gadopentetate dimeglumine for the detection of hepatocellular carcinoma at 1.5 T using the liver imaging reporting and data system (LI-RADS v.2017). Cancer Imaging 18:48
6.
go back to reference Chernyak V, Fowler KJ, Kamaya A et al (2018) Liver Imaging Reporting and Data System (LI-RADS) Version 2018: Imaging of Hepatocellular Carcinoma in At-Risk Patients. Radiology. 10.1148/radiol.2018181494:181494CrossRefPubMedPubMedCentral Chernyak V, Fowler KJ, Kamaya A et al (2018) Liver Imaging Reporting and Data System (LI-RADS) Version 2018: Imaging of Hepatocellular Carcinoma in At-Risk Patients. Radiology. 10.1148/radiol.2018181494:181494CrossRefPubMedPubMedCentral
7.
go back to reference Han X (2017) Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method. CoRR abs/1704.07239 Han X (2017) Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method. CoRR abs/1704.07239
9.
go back to reference Sun C, Guo S, Zhang H et al (2017) Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs. Artif Intell Med 83:58-66CrossRef Sun C, Guo S, Zhang H et al (2017) Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs. Artif Intell Med 83:58-66CrossRef
10.
go back to reference Nayak A, Kayal EB, Arya M et al (2019) Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT. International journal of computer assisted radiology and surgery 14:1341-1352CrossRef Nayak A, Kayal EB, Arya M et al (2019) Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT. International journal of computer assisted radiology and surgery 14:1341-1352CrossRef
11.
go back to reference Roberts LR, Sirlin CB, Zaiem F et al (2018) Imaging for the diagnosis of hepatocellular carcinoma: A systematic review and meta-analysis. Hepatology 67:401-421CrossRef Roberts LR, Sirlin CB, Zaiem F et al (2018) Imaging for the diagnosis of hepatocellular carcinoma: A systematic review and meta-analysis. Hepatology 67:401-421CrossRef
12.
go back to reference Hanna RF, Miloushev VZ, Tang A et al (2016) Comparative 13-year meta-analysis of the sensitivity and positive predictive value of ultrasound, CT, and MRI for detecting hepatocellular carcinoma. Abdom Radiol (NY) 41:71-90CrossRef Hanna RF, Miloushev VZ, Tang A et al (2016) Comparative 13-year meta-analysis of the sensitivity and positive predictive value of ultrasound, CT, and MRI for detecting hepatocellular carcinoma. Abdom Radiol (NY) 41:71-90CrossRef
13.
go back to reference Zhang YD, Zhu FP, Xu X et al (2016) Liver Imaging Reporting and Data System:: Substantial Discordance Between CT and MR for Imaging Classification of Hepatic Nodules. Acad Radiol 23:344-352CrossRef Zhang YD, Zhu FP, Xu X et al (2016) Liver Imaging Reporting and Data System:: Substantial Discordance Between CT and MR for Imaging Classification of Hepatic Nodules. Acad Radiol 23:344-352CrossRef
14.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation, pp 234-241 Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation, pp 234-241
15.
go back to reference Christ PF, Ettlinger F, Grün F et al (2017) Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. CoRR abs/1702.05970 Christ PF, Ettlinger F, Grün F et al (2017) Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. CoRR abs/1702.05970
16.
go back to reference Sahiner B, Pezeshk A, Hadjiiski LM et al (2019) Deep learning in medical imaging and radiation therapy. 46:e1-e36 Sahiner B, Pezeshk A, Hadjiiski LM et al (2019) Deep learning in medical imaging and radiation therapy. 46:e1-e36
17.
go back to reference Milletari F, Navab N, Ahmadi S-A (2016) V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. CoRR abs/1606.04797 Milletari F, Navab N, Ahmadi S-A (2016) V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. CoRR abs/1606.04797
18.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Identity Mappings in Deep Residual Networks. CoRR abs/1603.05027 He K, Zhang X, Ren S, Sun J (2016) Identity Mappings in Deep Residual Networks. CoRR abs/1603.05027
19.
go back to reference Bilic P, Christ PF, Vorontsov E et al (2019) The Liver Tumor Segmentation Benchmark (LiTS). Bilic P, Christ PF, Vorontsov E et al (2019) The Liver Tumor Segmentation Benchmark (LiTS).
20.
go back to reference Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2018) No New-Net. CoRR abs/1809.10483 Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2018) No New-Net. CoRR abs/1809.10483
21.
go back to reference Ulyanov D, Vedaldi A, Lempitsky V Instance normalization: the missing ingredient for fast stylization. CoRR abs/1607.0 (2016), Ulyanov D, Vedaldi A, Lempitsky V Instance normalization: the missing ingredient for fast stylization. CoRR abs/1607.0 (2016),
22.
go back to reference Abadi M, Barham P, Chen J et al (2016) Tensorflow: a system for large-scale machine learningOSDI, pp 265-283 Abadi M, Barham P, Chen J et al (2016) Tensorflow: a system for large-scale machine learningOSDI, pp 265-283
23.
go back to reference Avants BB, Tustison N, Song G (2009) Advanced normalization tools (ANTS). Insight j 2:1-35 Avants BB, Tustison N, Song G (2009) Advanced normalization tools (ANTS). Insight j 2:1-35
24.
go back to reference Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysisSeventh International Conference on Document Analysis and Recognition, 2003 Proceedings, pp 958-963 Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysisSeventh International Conference on Document Analysis and Recognition, 2003 Proceedings, pp 958-963
25.
go back to reference Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297-302CrossRef Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297-302CrossRef
26.
go back to reference Janowczyk A, Madabhushi A (2016) Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of pathology informatics 7 Janowczyk A, Madabhushi A (2016) Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of pathology informatics 7
27.
go back to reference van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational Radiomics System to Decode the Radiographic Phenotype. 77:e104-e107 van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational Radiomics System to Decode the Radiographic Phenotype. 77:e104-e107
28.
go back to reference Bandos AI, Rockette HE, Song T, Gur D (2009) Area under the free-response ROC curve (FROC) and a related summary index. Biometrics 65:247-256CrossRef Bandos AI, Rockette HE, Song T, Gur D (2009) Area under the free-response ROC curve (FROC) and a related summary index. Biometrics 65:247-256CrossRef
29.
go back to reference Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45:255-268CrossRef Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45:255-268CrossRef
30.
go back to reference Vorontsov E, Tang A, Pal C, Kadoury S (2018) Liver lesion segmentation informed by joint liver segmentation2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp 1332-1335 Vorontsov E, Tang A, Pal C, Kadoury S (2018) Liver lesion segmentation informed by joint liver segmentation2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp 1332-1335
31.
go back to reference Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H (2018) Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep 8:15497CrossRef Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H (2018) Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep 8:15497CrossRef
32.
go back to reference Bousabarah K, Ruge M, Brand J-S et al (2020) Deep convolutional neural networks for automated segmentation of brain metastases trained on clinical data. Radiation Oncology 15:1-9CrossRef Bousabarah K, Ruge M, Brand J-S et al (2020) Deep convolutional neural networks for automated segmentation of brain metastases trained on clinical data. Radiation Oncology 15:1-9CrossRef
33.
go back to reference Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. The Lancet Oncology 20:728-740CrossRef Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. The Lancet Oncology 20:728-740CrossRef
34.
go back to reference Azer SA (2019) Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World Journal of Gastrointestinal Oncology 11:1218CrossRef Azer SA (2019) Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World Journal of Gastrointestinal Oncology 11:1218CrossRef
35.
go back to reference Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. European Radiology. 10.1007/s00330-019-06205-9CrossRefPubMedPubMedCentral Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. European Radiology. 10.1007/s00330-019-06205-9CrossRefPubMedPubMedCentral
36.
go back to reference Wang CJ, Hamm CA, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part II: convolutional neural network interpretation using radiologic imaging features. European Radiology. 10.1007/s00330-019-06214-8CrossRefPubMedPubMedCentral Wang CJ, Hamm CA, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part II: convolutional neural network interpretation using radiologic imaging features. European Radiology. 10.1007/s00330-019-06214-8CrossRefPubMedPubMedCentral
37.
go back to reference Shi W, Kuang S, Cao S et al (2020) Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol. Abdominal Radiology (New York) Shi W, Kuang S, Cao S et al (2020) Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol. Abdominal Radiology (New York)
Metadata
Title
Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning
Authors
Khaled Bousabarah
Brian Letzen
Jonathan Tefera
Lynn Savic
Isabel Schobert
Todd Schlachter
Lawrence H. Staib
Martin Kocher
Julius Chapiro
MingDe Lin
Publication date
01-01-2021
Publisher
Springer US
Published in
Abdominal Radiology / Issue 1/2021
Print ISSN: 2366-004X
Electronic ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-020-02604-5

Other articles of this Issue 1/2021

Abdominal Radiology 1/2021 Go to the issue

Special Section: Liver Transplantation

Elastography in the evaluation of liver allograft

Special Section: Liver transplantation

CT and MR imaging evaluation of living liver donors

Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.