Skip to main content
Top
Published in: Cancer Imaging 1/2024

Open Access 01-12-2024 | Hepatocellular Carcinoma | Research article

A hierarchical fusion strategy of deep learning networks for detection and segmentation of hepatocellular carcinoma from computed tomography images

Authors: I-Cheng Lee, Yung-Ping Tsai, Yen-Cheng Lin, Ting-Chun Chen, Chia-Heng Yen, Nai-Chi Chiu, Hsuen-En Hwang, Chien-An Liu, Jia-Guan Huang, Rheun-Chuan Lee, Yee Chao, Shinn-Ying Ho, Yi-Hsiang Huang

Published in: Cancer Imaging | Issue 1/2024

Login to get access

Abstract

Background

Automatic segmentation of hepatocellular carcinoma (HCC) on computed tomography (CT) scans is in urgent need to assist diagnosis and radiomics analysis. The aim of this study is to develop a deep learning based network to detect HCC from dynamic CT images.

Methods

Dynamic CT images of 595 patients with HCC were used. Tumors in dynamic CT images were labeled by radiologists. Patients were randomly divided into training, validation and test sets in a ratio of 5:2:3, respectively. We developed a hierarchical fusion strategy of deep learning networks (HFS-Net). Global dice, sensitivity, precision and F1-score were used to measure performance of the HFS-Net model.

Results

The 2D DenseU-Net using dynamic CT images was more effective for segmenting small tumors, whereas the 2D U-Net using portal venous phase images was more effective for segmenting large tumors. The HFS-Net model performed better, compared with the single-strategy deep learning models in segmenting small and large tumors. In the test set, the HFS-Net model achieved good performance in identifying HCC on dynamic CT images with global dice of 82.8%. The overall sensitivity, precision and F1-score were 84.3%, 75.5% and 79.6% per slice, respectively, and 92.2%, 93.2% and 92.7% per patient, respectively. The sensitivity in tumors < 2 cm, 2–3, 3–5 cm and > 5 cm were 72.7%, 92.9%, 94.2% and 100% per patient, respectively.

Conclusions

The HFS-Net model achieved good performance in the detection and segmentation of HCC from dynamic CT images, which may support radiologic diagnosis and facilitate automatic radiomics analysis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Llovet JM, Kelley RK, Villanueva A, Singal AG, Pikarsky E, Roayaie S, et al. Hepatocellular carcinoma. Nat Rev Dis Primers. 2021;7(1):6.CrossRefPubMed Llovet JM, Kelley RK, Villanueva A, Singal AG, Pikarsky E, Roayaie S, et al. Hepatocellular carcinoma. Nat Rev Dis Primers. 2021;7(1):6.CrossRefPubMed
2.
go back to reference Moura Cunha G, Chernyak V, Fowler KJ, Sirlin CB. Up-to-date role of CT/MRI LI-RADS in Hepatocellular Carcinoma. J Hepatocell Carcinoma. 2021;8:513–27.CrossRefPubMedPubMedCentral Moura Cunha G, Chernyak V, Fowler KJ, Sirlin CB. Up-to-date role of CT/MRI LI-RADS in Hepatocellular Carcinoma. J Hepatocell Carcinoma. 2021;8:513–27.CrossRefPubMedPubMedCentral
3.
go back to reference Waite S, Kolla S, Jeudy J, Legasto A, Macknik SL, Martinez-Conde S, et al. Tired in the reading room: the influence of fatigue in radiology. J Am Coll Radiol. 2017;14(2):191–7.CrossRefPubMed Waite S, Kolla S, Jeudy J, Legasto A, Macknik SL, Martinez-Conde S, et al. Tired in the reading room: the influence of fatigue in radiology. J Am Coll Radiol. 2017;14(2):191–7.CrossRefPubMed
4.
go back to reference Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A. Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Oncol. 2022;19(2):132–46.CrossRefPubMed Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A. Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Oncol. 2022;19(2):132–46.CrossRefPubMed
5.
go back to reference Lee IC, Huang JY, Chen TC, Yen CH, Chiu NC, Hwang HE, et al. Evolutionary learning-derived clinical-Radiomic models for Predicting Early recurrence of Hepatocellular Carcinoma after Resection. Liver Cancer. 2021;10(6):572–82.CrossRefPubMedPubMedCentral Lee IC, Huang JY, Chen TC, Yen CH, Chiu NC, Hwang HE, et al. Evolutionary learning-derived clinical-Radiomic models for Predicting Early recurrence of Hepatocellular Carcinoma after Resection. Liver Cancer. 2021;10(6):572–82.CrossRefPubMedPubMedCentral
6.
go back to reference Li X, Chen H, Qi X, Dou Q, Fu C-W, Heng P-A. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018:2663–74. Li X, Chen H, Qi X, Dou Q, Fu C-W, Heng P-A. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018:2663–74.
7.
go back to reference Wardhana G, Naghibi H, Sirmacek B, Abayazid M. Toward reliable automatic liver and tumor segmentation using convolutional neural network based on 2.5 D models. Int J Comput Assist Radiol Surg. 2021:41–51. Wardhana G, Naghibi H, Sirmacek B, Abayazid M. Toward reliable automatic liver and tumor segmentation using convolutional neural network based on 2.5 D models. Int J Comput Assist Radiol Surg. 2021:41–51.
8.
go back to reference Chen L, Song H, Wang C, Cui Y, Yang J, Hu X et al. Liver tumor segmentation in CT volumes using an adversarial densely connected network. BMC Bioinformatics. 2019:1–13. Chen L, Song H, Wang C, Cui Y, Yang J, Hu X et al. Liver tumor segmentation in CT volumes using an adversarial densely connected network. BMC Bioinformatics. 2019:1–13.
9.
go back to reference Chlebus G, Schenk A, Moltz JH, van Hahn GB, Meine HK. H. Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep. 2018:1–7. Chlebus G, Schenk A, Moltz JH, van Hahn GB, Meine HK. H. Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep. 2018:1–7.
10.
go back to reference Budak Ü, Guo Y, Tanyildizi E, Şengür A. Cascaded deep convolutional encoder-decoder neural networks for efficient liver tumor segmentation. Med Hypotheses. 2020:109431. Budak Ü, Guo Y, Tanyildizi E, Şengür A. Cascaded deep convolutional encoder-decoder neural networks for efficient liver tumor segmentation. Med Hypotheses. 2020:109431.
11.
go back to reference Meng L, Tian Y, Bu S. Liver tumor segmentation based on 3D convolutional neural network with dual scale. J Appl Clin Med Phys. 2020;144:57. Meng L, Tian Y, Bu S. Liver tumor segmentation based on 3D convolutional neural network with dual scale. J Appl Clin Med Phys. 2020;144:57.
12.
go back to reference Jiang H, Li S, Li S. Registration-based organ positioning and joint segmentation method for liver and tumor segmentation. BioMed research international. 2018. Jiang H, Li S, Li S. Registration-based organ positioning and joint segmentation method for liver and tumor segmentation. BioMed research international. 2018.
13.
go back to reference Anter AM, Hassenian AE. CT liver tumor segmentation hybrid approach using neutrosophic sets, fast fuzzy c-means and adaptive watershed algorithm. Artif Intell Med. 2019:105–17. Anter AM, Hassenian AE. CT liver tumor segmentation hybrid approach using neutrosophic sets, fast fuzzy c-means and adaptive watershed algorithm. Artif Intell Med. 2019:105–17.
14.
go back to reference Heimbach JK, Kulik LM, Finn RS, Sirlin CB, Abecassis MM, Roberts LR, et al. AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology. 2018;67(1):358–80.CrossRefPubMed Heimbach JK, Kulik LM, Finn RS, Sirlin CB, Abecassis MM, Roberts LR, et al. AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology. 2018;67(1):358–80.CrossRefPubMed
15.
go back to reference Spieler B, Sabottke C, Moawad AW, Gabr AM, Bashir MR, Do RKG et al. Artificial intelligence in assessment of hepatocellular carcinoma treatment response. Abdom Radiol (NY). 2021. Spieler B, Sabottke C, Moawad AW, Gabr AM, Bashir MR, Do RKG et al. Artificial intelligence in assessment of hepatocellular carcinoma treatment response. Abdom Radiol (NY). 2021.
16.
go back to reference Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H. Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep. 2018;8(1):1–7.CrossRef Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H. Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep. 2018;8(1):1–7.CrossRef
17.
go back to reference Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, et al. Pytorch: an imperative style, high-performance deep learning library. Adv Neural Inf Process Syst. 2019;32:8026–37. Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, et al. Pytorch: an imperative style, high-performance deep learning library. Adv Neural Inf Process Syst. 2019;32:8026–37.
18.
go back to reference Alom MZ, Yakopcic C, Taha TM, Asari VK, editors. Nuclei segmentation with recurrent residual convolutional neural networks based U-Net (R2U-Net). NAECON 2018-IEEE National Aerospace and Electronics Conference; 2018: IEEE. Alom MZ, Yakopcic C, Taha TM, Asari VK, editors. Nuclei segmentation with recurrent residual convolutional neural networks based U-Net (R2U-Net). NAECON 2018-IEEE National Aerospace and Electronics Conference; 2018: IEEE.
19.
go back to reference Dolz J, Gopinath K, Yuan J, Lombaert H, Desrosiers C, Ayed IB. HyperDense-Net: a hyper-densely connected CNN for multi-modal image segmentation. IEEE Trans Med Imaging. 2018;38(5):1116–26.CrossRefPubMed Dolz J, Gopinath K, Yuan J, Lombaert H, Desrosiers C, Ayed IB. HyperDense-Net: a hyper-densely connected CNN for multi-modal image segmentation. IEEE Trans Med Imaging. 2018;38(5):1116–26.CrossRefPubMed
20.
go back to reference Dong R, Pan X, Li F. DenseU-net-based semantic segmentation of small objects in urban remote sensing images. IEEE Access. 2019;7:65347–56.CrossRef Dong R, Pan X, Li F. DenseU-net-based semantic segmentation of small objects in urban remote sensing images. IEEE Access. 2019;7:65347–56.CrossRef
21.
go back to reference Falk T, Mai D, Bensch R, Çiçek Ö, Abdulkadir A, Marrakchi Y, et al. U-Net: deep learning for cell counting, detection, and morphometry. Nat Methods. 2019;16(1):67–70.CrossRefPubMed Falk T, Mai D, Bensch R, Çiçek Ö, Abdulkadir A, Marrakchi Y, et al. U-Net: deep learning for cell counting, detection, and morphometry. Nat Methods. 2019;16(1):67–70.CrossRefPubMed
22.
go back to reference Ronneberger O, Fischer P, Brox T, editors. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention; 2015: Springer. Ronneberger O, Fischer P, Brox T, editors. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention; 2015: Springer.
23.
go back to reference Sousa JA, Paiva A, Silva A, Almeida JD, Braz Junior G, Diniz JO, et al. Automatic segmentation of retinal layers in OCT images with intermediate age-related macular degeneration using U-Net and DexiNed. PLoS ONE. 2021;16(5):e0251591.CrossRefPubMedPubMedCentral Sousa JA, Paiva A, Silva A, Almeida JD, Braz Junior G, Diniz JO, et al. Automatic segmentation of retinal layers in OCT images with intermediate age-related macular degeneration using U-Net and DexiNed. PLoS ONE. 2021;16(5):e0251591.CrossRefPubMedPubMedCentral
24.
go back to reference Roberts LR, Sirlin CB, Zaiem F, Almasri J, Prokop LJ, Heimbach JK, et al. Imaging for the diagnosis of hepatocellular carcinoma: a systematic review and meta-analysis. Hepatology. 2018;67(1):401–21.CrossRefPubMed Roberts LR, Sirlin CB, Zaiem F, Almasri J, Prokop LJ, Heimbach JK, et al. Imaging for the diagnosis of hepatocellular carcinoma: a systematic review and meta-analysis. Hepatology. 2018;67(1):401–21.CrossRefPubMed
25.
go back to reference Vilgrain V, Van Beers BE, Pastor CM. Insights into the diagnosis of hepatocellular carcinomas with hepatobiliary MRI. J Hepatol. 2016;64(3):708–16.CrossRefPubMed Vilgrain V, Van Beers BE, Pastor CM. Insights into the diagnosis of hepatocellular carcinomas with hepatobiliary MRI. J Hepatol. 2016;64(3):708–16.CrossRefPubMed
26.
go back to reference Lee IC, Lei HJ, Chau GY, Yeh YC, Wu CJ, Su CW, et al. Predictors of long-term recurrence and survival after resection of HBV-related hepatocellular carcinoma: the role of HBsAg. Am J Cancer Res. 2021;11(7):3711–25.PubMedPubMedCentral Lee IC, Lei HJ, Chau GY, Yeh YC, Wu CJ, Su CW, et al. Predictors of long-term recurrence and survival after resection of HBV-related hepatocellular carcinoma: the role of HBsAg. Am J Cancer Res. 2021;11(7):3711–25.PubMedPubMedCentral
27.
go back to reference Hung YW, Lee IC, Chi CT, Lee RC, Liu CA, Chiu NC, et al. Redefining Tumor Burden in patients with Intermediate-Stage Hepatocellular Carcinoma: the Seven-Eleven Criteria. Liver Cancer. 2021;10(6):629–40.CrossRefPubMedPubMedCentral Hung YW, Lee IC, Chi CT, Lee RC, Liu CA, Chiu NC, et al. Redefining Tumor Burden in patients with Intermediate-Stage Hepatocellular Carcinoma: the Seven-Eleven Criteria. Liver Cancer. 2021;10(6):629–40.CrossRefPubMedPubMedCentral
Metadata
Title
A hierarchical fusion strategy of deep learning networks for detection and segmentation of hepatocellular carcinoma from computed tomography images
Authors
I-Cheng Lee
Yung-Ping Tsai
Yen-Cheng Lin
Ting-Chun Chen
Chia-Heng Yen
Nai-Chi Chiu
Hsuen-En Hwang
Chien-An Liu
Jia-Guan Huang
Rheun-Chuan Lee
Yee Chao
Shinn-Ying Ho
Yi-Hsiang Huang
Publication date
01-12-2024
Publisher
BioMed Central
Published in
Cancer Imaging / Issue 1/2024
Electronic ISSN: 1470-7330
DOI
https://doi.org/10.1186/s40644-024-00686-8

Other articles of this Issue 1/2024

Cancer Imaging 1/2024 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine