Skip to main content
Top
Published in: Hepatology International 1/2024

Open Access 09-09-2023 | Hepatocellular Carcinoma | Original Article

Development of a transformer model for predicting the prognosis of patients with hepatocellular carcinoma after radiofrequency ablation

Authors: Masaya Sato, Makoto Moriyama, Tsuyoshi Fukumoto, Tomoharu Yamada, Taijiro Wake, Ryo Nakagomi, Takuma Nakatsuka, Tatsuya Minami, Koji Uchino, Kenichiro Enooku, Hayato Nakagawa, Shuichiro Shiina, Kazuhiko Koike, Mitsuhiro Fujishiro, Ryosuke Tateishi

Published in: Hepatology International | Issue 1/2024

Login to get access

Abstract

Introduction

Radiofrequency ablation (RFA) is a widely accepted, minimally invasive treatment modality for patients with hepatocellular carcinoma (HCC). Accurate prognosis prediction is important to identify patients at high risk for cancer progression/recurrence after RFA. Recently, state-of-the-art transformer models showing improved performance over existing deep learning-based models have been developed in several fields. This study was aimed at developing and validating a transformer model to predict the overall survival in HCC patients with treated by RFA.

Methods

We enrolled a total of 1778 treatment-naïve HCC patients treated by RFA as the first-line treatment. We developed a transformer-based machine learning model to predict the overall survival in the HCC patients treated by RFA and compared its predictive performance with that of a deep learning-based model. Model performance was evaluated by determining the Harrel’s c-index and validated externally by the split-sample method.

Results

The Harrel’s c-index of the transformer-based model was 0.69, indicating its better discrimination performance than that of the deep learning model (Harrel’s c-index, 0.60) in the external validation cohort. The transformer model showed a high discriminative ability for stratifying the external validation cohort into two or three different risk groups (p < 0.001 for both risk groupings). The model also enabled output of a personalized cumulative recurrence prediction curve for each patient.

Conclusions

We developed a novel transformer model for personalized prediction of the overall survival in HCC patients after RFA treatment. The current model may offer a personalized survival prediction schema for patients with HCC undergoing RFA treatment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Singal AG, El-Serag HB. Hepatocellular carcinoma from epidemiology to prevention: translating knowledge into practice. Clin Gastroenterol Hepatol 2015;13:2140–2151CrossRefPubMedPubMedCentral Singal AG, El-Serag HB. Hepatocellular carcinoma from epidemiology to prevention: translating knowledge into practice. Clin Gastroenterol Hepatol 2015;13:2140–2151CrossRefPubMedPubMedCentral
2.
3.
go back to reference Shiina S, Tateishi R, Arano T, Uchino K, Enooku K, Nakagawa H, et al. Radiofrequency ablation for hepatocellular carcinoma: 10-year outcome and prognostic factors. Am J Gastroenterol 2012;107:569–577 (quiz 578)CrossRefPubMed Shiina S, Tateishi R, Arano T, Uchino K, Enooku K, Nakagawa H, et al. Radiofrequency ablation for hepatocellular carcinoma: 10-year outcome and prognostic factors. Am J Gastroenterol 2012;107:569–577 (quiz 578)CrossRefPubMed
4.
go back to reference Livraghi T, Goldberg SN, Lazzaroni S, Meloni F, Solbiati L, Gazelle GS. Small hepatocellular carcinoma: treatment with radio-frequency ablation versus ethanol injection. Radiology 1999;210:655–661CrossRefPubMed Livraghi T, Goldberg SN, Lazzaroni S, Meloni F, Solbiati L, Gazelle GS. Small hepatocellular carcinoma: treatment with radio-frequency ablation versus ethanol injection. Radiology 1999;210:655–661CrossRefPubMed
5.
go back to reference Tateishi R, Shiina S, Teratani T, Obi S, Sato S, Koike Y, et al. Percutaneous radiofrequency ablation for hepatocellular carcinoma. An analysis of 1000 cases. Cancer 2005;103:1201–1209CrossRefPubMed Tateishi R, Shiina S, Teratani T, Obi S, Sato S, Koike Y, et al. Percutaneous radiofrequency ablation for hepatocellular carcinoma. An analysis of 1000 cases. Cancer 2005;103:1201–1209CrossRefPubMed
6.
go back to reference Künzli BM, Abitabile P, Maurer CA. Radiofrequency ablation of liver tumors: actual limitations and potential solutions in the future. World J Hepatol 2011;3:8–14CrossRefPubMedPubMedCentral Künzli BM, Abitabile P, Maurer CA. Radiofrequency ablation of liver tumors: actual limitations and potential solutions in the future. World J Hepatol 2011;3:8–14CrossRefPubMedPubMedCentral
7.
go back to reference Sato M, Morimoto K, Kajihara S, Tateishi R, Shiina S, Koike K, et al. Machine-learning approach for the development of a novel predictive model for the diagnosis of hepatocellular carcinoma. Sci Rep 2019;9:7704CrossRefPubMedPubMedCentral Sato M, Morimoto K, Kajihara S, Tateishi R, Shiina S, Koike K, et al. Machine-learning approach for the development of a novel predictive model for the diagnosis of hepatocellular carcinoma. Sci Rep 2019;9:7704CrossRefPubMedPubMedCentral
8.
go back to reference Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Advances in neural information processing systems. 2017;30 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Advances in neural information processing systems. 2017;30
9.
go back to reference Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:201011929 2020 Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:201011929 2020
10.
go back to reference Devlin J, Chang M-W, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:181004805 2018 Devlin J, Chang M-W, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:181004805 2018
11.
go back to reference Liu Z, Ning J, Cao Y, Wei Y, Zhang Z, Lin S, et al. Video swin transformer. Proc IEEE CVF Conf Comput Vis Pattern Recogn 2022;2022:3202–3211 Liu Z, Ning J, Cao Y, Wei Y, Zhang Z, Lin S, et al. Video swin transformer. Proc IEEE CVF Conf Comput Vis Pattern Recogn 2022;2022:3202–3211
12.
go back to reference Wang Z, Sun J. SurvTRACE: transformers for survival analysis with competing events. arXiv preprint arXiv:211000855 2021 Wang Z, Sun J. SurvTRACE: transformers for survival analysis with competing events. arXiv preprint arXiv:211000855 2021
13.
go back to reference Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T, Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol 2018;18:1–12CrossRef Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T, Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol 2018;18:1–12CrossRef
14.
go back to reference Lee C, Zame W, Yoon J, Van Der Schaar M. Deephit: A deep learning approach to survival analysis with competing risks. Proceedings of the AAAI conference on artificial intelligence; 2018; 2018 Lee C, Zame W, Yoon J, Van Der Schaar M. Deephit: A deep learning approach to survival analysis with competing risks. Proceedings of the AAAI conference on artificial intelligence; 2018; 2018
15.
go back to reference Torzilli G, Minagawa M, Takayama T, Inoue K, Hui AM, Kubota K, et al. Accurate preoperative evaluation of liver mass lesions without fine-needle biopsy. Hepatology (Baltimore, MD) 1999;30:889–893CrossRefPubMed Torzilli G, Minagawa M, Takayama T, Inoue K, Hui AM, Kubota K, et al. Accurate preoperative evaluation of liver mass lesions without fine-needle biopsy. Hepatology (Baltimore, MD) 1999;30:889–893CrossRefPubMed
16.
go back to reference Edmondson HA, Steiner PE. Primary carcinoma of the liver: a study of 100 cases among 48,900 necropsies. Cancer 1954;7:462–503CrossRefPubMed Edmondson HA, Steiner PE. Primary carcinoma of the liver: a study of 100 cases among 48,900 necropsies. Cancer 1954;7:462–503CrossRefPubMed
17.
go back to reference Shiina S, Teratani T, Obi S, Sato S, Tateishi R, Fujishima T, et al. A randomized controlled trial of radiofrequency ablation with ethanol injection for small hepatocellular carcinoma. Gastroenterology. 2005;129:122–130CrossRefPubMed Shiina S, Teratani T, Obi S, Sato S, Tateishi R, Fujishima T, et al. A randomized controlled trial of radiofrequency ablation with ethanol injection for small hepatocellular carcinoma. Gastroenterology. 2005;129:122–130CrossRefPubMed
18.
go back to reference Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361–387CrossRefPubMed Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361–387CrossRefPubMed
19.
go back to reference Royston P, Altman DG. External validation of a Cox prognostic model: principles and methods. BMC Med Res Methodol 2013;13:1–15CrossRef Royston P, Altman DG. External validation of a Cox prognostic model: principles and methods. BMC Med Res Methodol 2013;13:1–15CrossRef
20.
go back to reference Garuti F, Neri A, Avanzato F, Gramenzi A, Rampoldi D, Rucci P, et al. The changing scenario of hepatocellular carcinoma in Italy: an update. Liver Int 2021;41:585–597CrossRefPubMed Garuti F, Neri A, Avanzato F, Gramenzi A, Rampoldi D, Rucci P, et al. The changing scenario of hepatocellular carcinoma in Italy: an update. Liver Int 2021;41:585–597CrossRefPubMed
21.
go back to reference Lee S, Rhim H, Kim YS, Kang TW, Song KD. Post-ablation des-gamma-carboxy prothrombin level predicts prognosis in hepatitis B-related hepatocellular carcinoma. Liver Int 2016;36:580–587CrossRefPubMed Lee S, Rhim H, Kim YS, Kang TW, Song KD. Post-ablation des-gamma-carboxy prothrombin level predicts prognosis in hepatitis B-related hepatocellular carcinoma. Liver Int 2016;36:580–587CrossRefPubMed
22.
go back to reference Aydın Ö, Karaarslan E. OpenAI ChatGPT generated literature review: Digital twin in healthcare. Available at SSRN 4308687 2022. Aydın Ö, Karaarslan E. OpenAI ChatGPT generated literature review: Digital twin in healthcare. Available at SSRN 4308687 2022.
23.
go back to reference Blaha MJ, Blumenthal RS. Risk factors: New risk-assessment guidelines—More or less personalized? Nat Rev Cardiol 2014;11:136CrossRefPubMed Blaha MJ, Blumenthal RS. Risk factors: New risk-assessment guidelines—More or less personalized? Nat Rev Cardiol 2014;11:136CrossRefPubMed
24.
go back to reference Fischer JE, Bachmann LM, Jaeschke R. A readers’ guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intensive Care Med 2003;29:1043–1051CrossRefPubMed Fischer JE, Bachmann LM, Jaeschke R. A readers’ guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intensive Care Med 2003;29:1043–1051CrossRefPubMed
25.
go back to reference Lu Z, Sun Z, Liu C, Shi X, Li R, Shao W, et al. Prognostic nomogram for hepatocellular carcinoma with radiofrequency ablation: a retrospective cohort study. BMC Cancer 2021;21:751CrossRefPubMedPubMedCentral Lu Z, Sun Z, Liu C, Shi X, Li R, Shao W, et al. Prognostic nomogram for hepatocellular carcinoma with radiofrequency ablation: a retrospective cohort study. BMC Cancer 2021;21:751CrossRefPubMedPubMedCentral
26.
go back to reference Zacksenhouse M, Braun S, Feldman M, Sidahmed M. Toward helicopter gearbox diagnostics from a small number of examples. Mech Syst Signal Process 2000;14:523–543CrossRef Zacksenhouse M, Braun S, Feldman M, Sidahmed M. Toward helicopter gearbox diagnostics from a small number of examples. Mech Syst Signal Process 2000;14:523–543CrossRef
27.
go back to reference Pandey G, Dukkipati A. Variational methods for conditional multimodal deep learning. 2017 International Joint Conference on Neural Networks (IJCNN); 2017. IEEE; 2017. 308–315 Pandey G, Dukkipati A. Variational methods for conditional multimodal deep learning. 2017 International Joint Conference on Neural Networks (IJCNN); 2017. IEEE; 2017. 308–315
28.
go back to reference Lu LC, Shao YY, Kuo RN, Lin ZZ, Yeh YC, Shau WY, et al. Hospital volume of percutaneous radiofrequency ablation is closely associated with treatment outcomes for patients with hepatocellular carcinoma. Cancer 2013;119:1210–1216CrossRefPubMed Lu LC, Shao YY, Kuo RN, Lin ZZ, Yeh YC, Shau WY, et al. Hospital volume of percutaneous radiofrequency ablation is closely associated with treatment outcomes for patients with hepatocellular carcinoma. Cancer 2013;119:1210–1216CrossRefPubMed
29.
go back to reference Chen J, Peng K, Hu D, Shen J, Zhou Z, Xu L, et al. Tumor location influences oncologic outcomes of hepatocellular carcinoma patients undergoing radiofrequency ablation. Cancers 2018;10:378CrossRefPubMedPubMedCentral Chen J, Peng K, Hu D, Shen J, Zhou Z, Xu L, et al. Tumor location influences oncologic outcomes of hepatocellular carcinoma patients undergoing radiofrequency ablation. Cancers 2018;10:378CrossRefPubMedPubMedCentral
30.
go back to reference Tateishi R, Uchino K, Fujiwara N, Takehara T, Okanoue T, Seike M, et al. A nationwide survey on non-B, non-C hepatocellular carcinoma in Japan: 2011–2015 update. J Gastroenterol 2019;54:367–376CrossRefPubMed Tateishi R, Uchino K, Fujiwara N, Takehara T, Okanoue T, Seike M, et al. A nationwide survey on non-B, non-C hepatocellular carcinoma in Japan: 2011–2015 update. J Gastroenterol 2019;54:367–376CrossRefPubMed
Metadata
Title
Development of a transformer model for predicting the prognosis of patients with hepatocellular carcinoma after radiofrequency ablation
Authors
Masaya Sato
Makoto Moriyama
Tsuyoshi Fukumoto
Tomoharu Yamada
Taijiro Wake
Ryo Nakagomi
Takuma Nakatsuka
Tatsuya Minami
Koji Uchino
Kenichiro Enooku
Hayato Nakagawa
Shuichiro Shiina
Kazuhiko Koike
Mitsuhiro Fujishiro
Ryosuke Tateishi
Publication date
09-09-2023
Publisher
Springer India
Published in
Hepatology International / Issue 1/2024
Print ISSN: 1936-0533
Electronic ISSN: 1936-0541
DOI
https://doi.org/10.1007/s12072-023-10585-y

Other articles of this Issue 1/2024

Hepatology International 1/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.