Skip to main content
Top
Published in:

Open Access 01-12-2024 | Original Article

Multimodality deep learning radiomics predicts pathological response after neoadjuvant chemoradiotherapy for esophageal squamous cell carcinoma

Authors: Yunsong Liu, Yi Wang, Xinyang Hu, Xin Wang, Liyan Xue, Qingsong Pang, Huan Zhang, Zeliang Ma, Heping Deng, Zhaoyang Yang, Xujie Sun, Yu Men, Feng Ye, Kuo Men, Jianjun Qin, Nan Bi, Jing Zhang, Qifeng Wang, Zhouguang Hui

Published in: Insights into Imaging | Issue 1/2024

Login to get access

Abstract

Objectives

This study aimed to develop and validate a deep-learning radiomics model using CT, T2, and DWI images for predicting pathological complete response (pCR) in patients with esophageal squamous cell carcinoma (ESCC) undergoing neoadjuvant chemoradiotherapy (nCRT).

Materials and methods

Patients with ESCC undergoing nCRT followed by surgery were retrospectively enrolled from three institutions and divided into training and testing cohorts. Both traditional and deep-learning radiomics features were extracted from pre-treatment CT, T2, and DWI. Multiple radiomics models were developed, both single modality and integrated, using machine learning algorithms. The models’ performance was assessed using receiver operating characteristic curve analysis, with the area under the curve (AUC) as a primary metric, alongside sensitivity and specificity from the cut-off analysis.

Results

The study involved 151 patients, among whom 63 achieved pCR. The training cohort consisted of 89 patients from Institution 1 (median age 62, 73 males) and the testing cohort included 52 patients from Institution 2 (median age 62, 41 males), and 10 in a clinical trial from Institution 3 (median age 69, 9 males). The integrated model, combining traditional and deep learning radiomics features from CT, T2, and DWI, demonstrated the best performance with an AUC of 0.868 (95% CI: 0.766–0.959), sensitivity of 88% (95% CI: 73.9–100), and specificity of 78.4% (95% CI: 63.6–90.2) in the testing cohort. This model outperformed single-modality models and the clinical model.

Conclusion

A multimodality deep learning radiomics model, utilizing CT, T2, and DWI images, was developed and validated for accurately predicting pCR of ESCC following nCRT.

Critical relevance statement

Our research demonstrates the satisfactory predictive value of multimodality deep learning radiomics for the response of nCRT in ESCC and provides a potentially helpful tool for personalized treatment including organ preservation strategy.

Key Points

  • After neoadjuvant chemoradiotherapy, patients with ESCC have pCR rates of about 40%.
  • The multimodality deep learning radiomics model, could predict pCR after nCRT with high accuracy.
  • The multimodality radiomics can be helpful in personalized treatment of esophageal cancer.

Graphical Abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Deboever N, Jones CM, Yamashita K, Ajani JA, Hofstetter WL (2024) Advances in diagnosis and management of cancer of the esophagus. BMJ 385:e074962CrossRefPubMed Deboever N, Jones CM, Yamashita K, Ajani JA, Hofstetter WL (2024) Advances in diagnosis and management of cancer of the esophagus. BMJ 385:e074962CrossRefPubMed
2.
go back to reference Yang H, Liu H, Chen Y et al (2018) Neoadjuvant chemoradiotherapy followed by surgery versus surgery alone for locally advanced squamous cell carcinoma of the esophagus (NEOCRTEC5010): a phase III multicenter, randomized, open-label clinical trial. J Clin Oncol 36:2796–2803CrossRefPubMedPubMedCentral Yang H, Liu H, Chen Y et al (2018) Neoadjuvant chemoradiotherapy followed by surgery versus surgery alone for locally advanced squamous cell carcinoma of the esophagus (NEOCRTEC5010): a phase III multicenter, randomized, open-label clinical trial. J Clin Oncol 36:2796–2803CrossRefPubMedPubMedCentral
3.
go back to reference Eyck BM, van Lanschot JJB, Hulshof M et al (2021) Ten-year outcome of neoadjuvant chemoradiotherapy plus surgery for esophageal cancer: the randomized controlled CROSS trial. J Clin Oncol 39:1995–2004CrossRefPubMed Eyck BM, van Lanschot JJB, Hulshof M et al (2021) Ten-year outcome of neoadjuvant chemoradiotherapy plus surgery for esophageal cancer: the randomized controlled CROSS trial. J Clin Oncol 39:1995–2004CrossRefPubMed
4.
go back to reference van Hagen P, Hulshof MC, van Lanschot JJ et al (2012) Preoperative chemoradiotherapy for esophageal or junctional cancer. N Engl J Med 366:2074–2084CrossRefPubMed van Hagen P, Hulshof MC, van Lanschot JJ et al (2012) Preoperative chemoradiotherapy for esophageal or junctional cancer. N Engl J Med 366:2074–2084CrossRefPubMed
5.
go back to reference Yang H, Liu H, Chen Y et al (2021) Long-term efficacy of neoadjuvant chemoradiotherapy plus surgery for the treatment of locally advanced esophageal squamous cell carcinoma: the NEOCRTEC5010 randomized clinical trial. JAMA Surg 156:721–729CrossRefPubMedPubMedCentral Yang H, Liu H, Chen Y et al (2021) Long-term efficacy of neoadjuvant chemoradiotherapy plus surgery for the treatment of locally advanced esophageal squamous cell carcinoma: the NEOCRTEC5010 randomized clinical trial. JAMA Surg 156:721–729CrossRefPubMedPubMedCentral
6.
go back to reference Berger AC, Farma J, Scott WJ et al (2005) Complete response to neoadjuvant chemoradiotherapy in esophageal carcinoma is associated with significantly improved survival. J Clin Oncol 23:4330–4337CrossRefPubMed Berger AC, Farma J, Scott WJ et al (2005) Complete response to neoadjuvant chemoradiotherapy in esophageal carcinoma is associated with significantly improved survival. J Clin Oncol 23:4330–4337CrossRefPubMed
7.
go back to reference Kelly RJ, Ajani JA, Kuzdzal J et al (2021) Adjuvant nivolumab in resected esophageal or gastroesophageal junction cancer. N Engl J Med 384:1191–1203CrossRefPubMed Kelly RJ, Ajani JA, Kuzdzal J et al (2021) Adjuvant nivolumab in resected esophageal or gastroesophageal junction cancer. N Engl J Med 384:1191–1203CrossRefPubMed
8.
go back to reference van der Wilk BJ, Eyck BM, Hofstetter WL et al (2022) Chemoradiotherapy followed by active surveillance versus standard esophagectomy for esophageal cancer: a systematic review and individual patient data meta-analysis. Ann Surg 275:467–476CrossRefPubMed van der Wilk BJ, Eyck BM, Hofstetter WL et al (2022) Chemoradiotherapy followed by active surveillance versus standard esophagectomy for esophageal cancer: a systematic review and individual patient data meta-analysis. Ann Surg 275:467–476CrossRefPubMed
9.
go back to reference de Gouw DJJM, Klarenbeek BR, Driessen M et al (2019) Detecting pathological complete response in esophageal cancer after neoadjuvant therapy based on imaging techniques: a diagnostic systematic review and meta-analysis. J Thorac Oncol 14:1156–1171CrossRefPubMed de Gouw DJJM, Klarenbeek BR, Driessen M et al (2019) Detecting pathological complete response in esophageal cancer after neoadjuvant therapy based on imaging techniques: a diagnostic systematic review and meta-analysis. J Thorac Oncol 14:1156–1171CrossRefPubMed
10.
go back to reference Fiorino C, Palumbo D, Mori M et al (2024) Early regression index (ERI) on MR images as response predictor in esophageal cancer treated with neoadjuvant chemo-radiotherapy: Interim analysis of the prospective ESCAPE trial. Radiother Oncol 194:110160CrossRefPubMed Fiorino C, Palumbo D, Mori M et al (2024) Early regression index (ERI) on MR images as response predictor in esophageal cancer treated with neoadjuvant chemo-radiotherapy: Interim analysis of the prospective ESCAPE trial. Radiother Oncol 194:110160CrossRefPubMed
11.
go back to reference Yang Z, He B, Zhuang X et al (2019) CT-based radiomic signatures for prediction of pathologic complete response in esophageal squamous cell carcinoma after neoadjuvant chemoradiotherapy. J Radiat Res 60:538–545CrossRefPubMedPubMedCentral Yang Z, He B, Zhuang X et al (2019) CT-based radiomic signatures for prediction of pathologic complete response in esophageal squamous cell carcinoma after neoadjuvant chemoradiotherapy. J Radiat Res 60:538–545CrossRefPubMedPubMedCentral
12.
go back to reference Li QW, Qiu B, Wang B et al (2018) Prediction of pathologic responders to neoadjuvant chemoradiotherapy by diffusion-weighted magnetic resonance imaging in locally advanced esophageal squamous cell carcinoma: a prospective study. Dis Esophagus. https://doi.org/10.1093/dote/dox121 Li QW, Qiu B, Wang B et al (2018) Prediction of pathologic responders to neoadjuvant chemoradiotherapy by diffusion-weighted magnetic resonance imaging in locally advanced esophageal squamous cell carcinoma: a prospective study. Dis Esophagus. https://​doi.​org/​10.​1093/​dote/​dox121
13.
go back to reference Vollenbrock SE, Voncken FEM, van Dieren JM et al (2019) Diagnostic performance of MRI for assessment of response to neoadjuvant chemoradiotherapy in oesophageal cancer. Br J Surg 106:596–605CrossRefPubMed Vollenbrock SE, Voncken FEM, van Dieren JM et al (2019) Diagnostic performance of MRI for assessment of response to neoadjuvant chemoradiotherapy in oesophageal cancer. Br J Surg 106:596–605CrossRefPubMed
14.
go back to reference Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762CrossRefPubMed Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762CrossRefPubMed
15.
go back to reference Shi Z, Zhang Z, Liu Z et al (2022) Methodological quality of machine learning-based quantitative imaging analysis studies in esophageal cancer: a systematic review of clinical outcome prediction after concurrent chemoradiotherapy. Eur J Nucl Med Mol Imaging 49:2462–2481CrossRefPubMed Shi Z, Zhang Z, Liu Z et al (2022) Methodological quality of machine learning-based quantitative imaging analysis studies in esophageal cancer: a systematic review of clinical outcome prediction after concurrent chemoradiotherapy. Eur J Nucl Med Mol Imaging 49:2462–2481CrossRefPubMed
16.
go back to reference Baptista D, Ferreira PG, Rocha M (2021) Deep learning for drug response prediction in cancer. Brief Bioinform 22:360–379CrossRefPubMed Baptista D, Ferreira PG, Rocha M (2021) Deep learning for drug response prediction in cancer. Brief Bioinform 22:360–379CrossRefPubMed
17.
go back to reference Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A (2022) Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Oncol 19:132–146CrossRefPubMed Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A (2022) Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Oncol 19:132–146CrossRefPubMed
18.
go back to reference Wang W, Liang H, Zhang Z et al (2024) Comparing three-dimensional and two-dimensional deep-learning, radiomics, and fusion models for predicting occult lymph node metastasis in laryngeal squamous cell carcinoma based on CT imaging: a multicentre, retrospective, diagnostic study. EClinicalMedicine 67:102385CrossRefPubMedPubMedCentral Wang W, Liang H, Zhang Z et al (2024) Comparing three-dimensional and two-dimensional deep-learning, radiomics, and fusion models for predicting occult lymph node metastasis in laryngeal squamous cell carcinoma based on CT imaging: a multicentre, retrospective, diagnostic study. EClinicalMedicine 67:102385CrossRefPubMedPubMedCentral
19.
go back to reference Kocak B, Baessler B, Bakas S et al (2023) CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII. Insights Imaging 14:75CrossRefPubMedPubMedCentral Kocak B, Baessler B, Bakas S et al (2023) CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII. Insights Imaging 14:75CrossRefPubMedPubMedCentral
20.
go back to reference Mandard AM, Dalibard F, Mandard JC et al (1994) Pathologic assessment of tumor regression after preoperative chemoradiotherapy of esophageal carcinoma. Clinicopathologic correlations. Cancer 73:2680–2686CrossRefPubMed Mandard AM, Dalibard F, Mandard JC et al (1994) Pathologic assessment of tumor regression after preoperative chemoradiotherapy of esophageal carcinoma. Clinicopathologic correlations. Cancer 73:2680–2686CrossRefPubMed
22.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Las Vegas, pp 2818–2826 Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Las Vegas, pp 2818–2826
23.
go back to reference Kao YS, Hsu Y (2021) A meta-analysis for using radiomics to predict complete pathological response in esophageal cancer patients receiving neoadjuvant chemoradiation. In Vivo 35:1857–1863CrossRefPubMedPubMedCentral Kao YS, Hsu Y (2021) A meta-analysis for using radiomics to predict complete pathological response in esophageal cancer patients receiving neoadjuvant chemoradiation. In Vivo 35:1857–1863CrossRefPubMedPubMedCentral
24.
go back to reference Hu Y, Xie C, Yang H et al (2020) Assessment of intratumoral and peritumoral computed tomography radiomics for predicting pathological complete response to neoadjuvant chemoradiation in patients with esophageal squamous cell carcinoma. JAMA Netw Open 3:e2015927CrossRefPubMedPubMedCentral Hu Y, Xie C, Yang H et al (2020) Assessment of intratumoral and peritumoral computed tomography radiomics for predicting pathological complete response to neoadjuvant chemoradiation in patients with esophageal squamous cell carcinoma. JAMA Netw Open 3:e2015927CrossRefPubMedPubMedCentral
25.
go back to reference Hu Y, Xie C, Yang H et al (2021) Computed tomography-based deep-learning prediction of neoadjuvant chemoradiotherapy treatment response in esophageal squamous cell carcinoma. Radiother Oncol 154:6–13 Hu Y, Xie C, Yang H et al (2021) Computed tomography-based deep-learning prediction of neoadjuvant chemoradiotherapy treatment response in esophageal squamous cell carcinoma. Radiother Oncol 154:6–13
26.
go back to reference Breen WG, Aryal MP, Cao Y, Kim MM (2024) Integrating multi-modal imaging in radiation treatments for glioblastoma. Neuro Oncol 26:S17–s25CrossRefPubMed Breen WG, Aryal MP, Cao Y, Kim MM (2024) Integrating multi-modal imaging in radiation treatments for glioblastoma. Neuro Oncol 26:S17–s25CrossRefPubMed
27.
go back to reference Li J, Zhang HL, Yin HK et al (2023) Comparison of MRI and CT-based radiomics and their combination for early identification of pathological response to neoadjuvant chemotherapy in locally advanced gastric cancer. J Magn Reson Imaging 58:907–923CrossRefPubMed Li J, Zhang HL, Yin HK et al (2023) Comparison of MRI and CT-based radiomics and their combination for early identification of pathological response to neoadjuvant chemotherapy in locally advanced gastric cancer. J Magn Reson Imaging 58:907–923CrossRefPubMed
28.
go back to reference Rizzo S, Botta F, Raimondi S et al (2018) Radiomics: the facts and the challenges of image analysis. Eur Radio Exp 2:36CrossRef Rizzo S, Botta F, Raimondi S et al (2018) Radiomics: the facts and the challenges of image analysis. Eur Radio Exp 2:36CrossRef
29.
go back to reference Hamerla G, Meyer HJ, Hambsch P et al (2019) Radiomics model based on non-contrast CT shows no predictive power for complete pathological response in locally advanced rectal cancer. Cancers (Basel) 11:1680CrossRefPubMed Hamerla G, Meyer HJ, Hambsch P et al (2019) Radiomics model based on non-contrast CT shows no predictive power for complete pathological response in locally advanced rectal cancer. Cancers (Basel) 11:1680CrossRefPubMed
30.
go back to reference Demircioğlu A (2023) Are deep models in radiomics performing better than generic models? A systematic review. Eur Radio Exp 7:11CrossRef Demircioğlu A (2023) Are deep models in radiomics performing better than generic models? A systematic review. Eur Radio Exp 7:11CrossRef
31.
go back to reference Hirata A, Hayano K, Ohira G et al (2020) Volumetric histogram analysis of apparent diffusion coefficient for predicting pathological complete response and survival in esophageal cancer patients treated with chemoradiotherapy. Am J Surg 219:1024–1029CrossRefPubMed Hirata A, Hayano K, Ohira G et al (2020) Volumetric histogram analysis of apparent diffusion coefficient for predicting pathological complete response and survival in esophageal cancer patients treated with chemoradiotherapy. Am J Surg 219:1024–1029CrossRefPubMed
32.
go back to reference Lu S, Wang C, Liu Y et al (2024) The MRI radiomics signature can predict the pathologic response to neoadjuvant chemotherapy in locally advanced esophageal squamous cell carcinoma. Eur Radiol 34:485–494CrossRefPubMed Lu S, Wang C, Liu Y et al (2024) The MRI radiomics signature can predict the pathologic response to neoadjuvant chemotherapy in locally advanced esophageal squamous cell carcinoma. Eur Radiol 34:485–494CrossRefPubMed
33.
go back to reference Obermannová R, Alsina M, Cervantes A et al (2022) Oesophageal cancer: ESMO clinical practice guideline for diagnosis, treatment and follow-up. Ann Oncol 33:992–1004CrossRefPubMed Obermannová R, Alsina M, Cervantes A et al (2022) Oesophageal cancer: ESMO clinical practice guideline for diagnosis, treatment and follow-up. Ann Oncol 33:992–1004CrossRefPubMed
Metadata
Title
Multimodality deep learning radiomics predicts pathological response after neoadjuvant chemoradiotherapy for esophageal squamous cell carcinoma
Authors
Yunsong Liu
Yi Wang
Xinyang Hu
Xin Wang
Liyan Xue
Qingsong Pang
Huan Zhang
Zeliang Ma
Heping Deng
Zhaoyang Yang
Xujie Sun
Yu Men
Feng Ye
Kuo Men
Jianjun Qin
Nan Bi
Jing Zhang
Qifeng Wang
Zhouguang Hui
Publication date
01-12-2024
Publisher
Springer Vienna
Published in
Insights into Imaging / Issue 1/2024
Electronic ISSN: 1869-4101
DOI
https://doi.org/10.1186/s13244-024-01851-0