Skip to main content
Top
Published in: European Journal of Nuclear Medicine and Molecular Imaging 8/2022

Open Access 23-12-2021 | Computed Tomography | Review Article

Methodological quality of machine learning-based quantitative imaging analysis studies in esophageal cancer: a systematic review of clinical outcome prediction after concurrent chemoradiotherapy

Authors: Zhenwei Shi, Zhen Zhang, Zaiyi Liu, Lujun Zhao, Zhaoxiang Ye, Andre Dekker, Leonard Wee

Published in: European Journal of Nuclear Medicine and Molecular Imaging | Issue 8/2022

Login to get access

Abstract

Purpose

Studies based on machine learning-based quantitative imaging techniques have gained much interest in cancer research. The aim of this review is to critically appraise the existing machine learning-based quantitative imaging analysis studies predicting outcomes of esophageal cancer after concurrent chemoradiotherapy in accordance with PRISMA guidelines.

Methods

A systematic review was conducted in accordance with PRISMA guidelines. The citation search was performed via PubMed and Embase Ovid databases for literature published before April 2021. From each full-text article, study characteristics and model information were summarized. We proposed an appraisal matrix with 13 items to assess the methodological quality of each study based on recommended best-practices pertaining to quality.

Results

Out of 244 identified records, 37 studies met the inclusion criteria. Study endpoints included prognosis, treatment response, and toxicity after concurrent chemoradiotherapy with reported discrimination metrics in validation datasets between 0.6 and 0.9, with wide variation in quality. A total of 30 studies published within the last 5 years were evaluated for methodological quality and we found 11 studies with at least 6 “good” item ratings.

Conclusion

A substantial number of studies lacked prospective registration, external validation, model calibration, and support for use in clinic. To further improve the predictive power of machine learning-based models and translate into real clinical applications in cancer research, appropriate methodologies, prospective registration, and multi-institution validation are recommended.
Appendix
Available only for authorised users
Literature
13.
go back to reference Xie C-Y, Pang C-L, Chan B, Wong EY-Y, Dou Q, Vardhanabhuti V. Machine learning and radiomics applications in esophageal cancers using non-invasive imaging methods-a critical review of literature. Cancers (Basel). 2021;13:2469. https://doi.org/10.3390/cancers13102469. Xie C-Y, Pang C-L, Chan B, Wong EY-Y, Dou Q, Vardhanabhuti V. Machine learning and radiomics applications in esophageal cancers using non-invasive imaging methods-a critical review of literature. Cancers (Basel). 2021;13:2469. https://​doi.​org/​10.​3390/​cancers13102469.​
27.
go back to reference Traverso A, Wee L, Dekker A, Gillies R. Repeatability and Reproducibility of Radiomic Features: A Systematic Review. Int J Radiat Oncol Biol Phys. 2018;102:1143-58. https://doi.org/10.1016/j.ijrobp.2018.05.053. Traverso A, Wee L, Dekker A, Gillies R. Repeatability and Reproducibility of Radiomic Features: A Systematic Review. Int J Radiat Oncol Biol Phys. 2018;102:1143-58. https://​doi.​org/​10.​1016/​j.​ijrobp.​2018.​05.​053.​
30.
go back to reference Chen Y-H, Lue K-H, Chu S-C, Chang B-S, Wang L-Y, Liu D-W, et al. Combining the radiomic features and traditional parameters of 18F-FDG PET with clinical profiles to improve prognostic stratification in patients with esophageal squamous cell carcinoma treated with neoadjuvant chemoradiotherapy and surgery. Ann Nucl Med. 2019;33:657–70. https://doi.org/10.1007/s12149-019-01380-7.CrossRefPubMed Chen Y-H, Lue K-H, Chu S-C, Chang B-S, Wang L-Y, Liu D-W, et al. Combining the radiomic features and traditional parameters of 18F-FDG PET with clinical profiles to improve prognostic stratification in patients with esophageal squamous cell carcinoma treated with neoadjuvant chemoradiotherapy and surgery. Ann Nucl Med. 2019;33:657–70. https://​doi.​org/​10.​1007/​s12149-019-01380-7.CrossRefPubMed
31.
go back to reference Wang L, Gao Z, Li C, Sun L, Li J, Yu J, et al. Computed tomography-based delta-radiomics analysis for discriminating radiation pneumonitis in patients with esophageal cancer after radiation therapy. Int J Radiat Oncol Biol Phys. 2021;111:443-55.https://doi.org/10.1016/j.ijrobp.2021.04.047. Wang L, Gao Z, Li C, Sun L, Li J, Yu J, et al. Computed tomography-based delta-radiomics analysis for discriminating radiation pneumonitis in patients with esophageal cancer after radiation therapy. Int J Radiat Oncol Biol Phys. 2021;111:443-55.https://​doi.​org/​10.​1016/​j.​ijrobp.​2021.​04.​047.​
38.
go back to reference van Rossum PSN, Fried DV, Zhang L, Hofstetter WL, van Vulpen M, Meijer GJ, et al. The incremental value of subjective and quantitative assessment of 18F-FDG PET for the prediction of pathologic complete response to preoperative chemoradiotherapy in esophageal cancer. J Nucl Med. 2016;57:691–700. https://doi.org/10.2967/jnumed.115.163766.CrossRef van Rossum PSN, Fried DV, Zhang L, Hofstetter WL, van Vulpen M, Meijer GJ, et al. The incremental value of subjective and quantitative assessment of 18F-FDG PET for the prediction of pathologic complete response to preoperative chemoradiotherapy in esophageal cancer. J Nucl Med. 2016;57:691–700. https://​doi.​org/​10.​2967/​jnumed.​115.​163766.CrossRef
44.
go back to reference Tan S, Zhang H, Zhang Y, Chen W, D’Souza WD, Lu W. Predicting pathologic tumor response to chemoradiotherapy with histogram distances characterizing longitudinal changes in <sup>18</sup> F-FDG uptake patterns: predicting pathologic tumor response with <sup>18</sup> F-FDG histogram distances. Med Phys. 2013;40:101707. https://doi.org/10.1118/1.4820445.CrossRefPubMedPubMedCentral Tan S, Zhang H, Zhang Y, Chen W, D’Souza WD, Lu W. Predicting pathologic tumor response to chemoradiotherapy with histogram distances characterizing longitudinal changes in <sup>18</sup> F-FDG uptake patterns: predicting pathologic tumor response with <sup>18</sup> F-FDG histogram distances. Med Phys. 2013;40:101707. https://​doi.​org/​10.​1118/​1.​4820445.CrossRefPubMedPubMedCentral
47.
go back to reference Zhang C, Shi Z, Kalendralis P, Whybra P, Parkinson C, Berbee M, et al. Prediction of lymph node metastases using pre-treatment PET radiomics of the primary tumour in esophageal adenocarcinoma: an external validation study. Br J Radiol Suppl. 2020;94:20201042. https://doi.org/10.1259/bjr.20201042.CrossRef Zhang C, Shi Z, Kalendralis P, Whybra P, Parkinson C, Berbee M, et al. Prediction of lymph node metastases using pre-treatment PET radiomics of the primary tumour in esophageal adenocarcinoma: an external validation study. Br J Radiol Suppl. 2020;94:20201042. https://​doi.​org/​10.​1259/​bjr.​20201042.CrossRef
49.
63.
68.
69.
go back to reference Faehling M, Schulz C, Laack H, Wolff T, Rückert A, Reck M, et al. PACIFIC subgroup analysis: pneumonitis in stage III, unresectable NSCLC patients treated with durvalumab vs. placebo after CRT. Pneumologie. 2019;73:P272. Faehling M, Schulz C, Laack H, Wolff T, Rückert A, Reck M, et al. PACIFIC subgroup analysis: pneumonitis in stage III, unresectable NSCLC patients treated with durvalumab vs. placebo after CRT. Pneumologie. 2019;73:P272.
76.
go back to reference Balaji Yogesh, Sankaranarayanan Swami, Chellappa Rama. Metareg: Towards domain generalization using meta-regularization. Adv Neural Inf Process Syst. 2018;31:998–1008. Balaji Yogesh, Sankaranarayanan Swami, Chellappa Rama. Metareg: Towards domain generalization using meta-regularization. Adv Neural Inf Process Syst. 2018;31:998–1008.
77.
go back to reference Dou Q, Castro DC, Kamnitsas K, Glocker B. Domain generalization via model-agnostic learning of semantic features. arXiv:191013580 [cs]. 2019. Dou Q, Castro DC, Kamnitsas K, Glocker B. Domain generalization via model-agnostic learning of semantic features. arXiv:191013580 [cs]. 2019.
78.
go back to reference Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, Blaise Aguera y Arcas. Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLR. 2017;54:1273–82. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, Blaise Aguera y Arcas. Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLR. 2017;54:1273–82.
82.
go back to reference Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision(ICCV). 2017; 618–26. https://doi.org/10.1109/ICCV.2017.74. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision(ICCV). 2017; 618–26. https://​doi.​org/​10.​1109/​ICCV.​2017.​74.
Metadata
Title
Methodological quality of machine learning-based quantitative imaging analysis studies in esophageal cancer: a systematic review of clinical outcome prediction after concurrent chemoradiotherapy
Authors
Zhenwei Shi
Zhen Zhang
Zaiyi Liu
Lujun Zhao
Zhaoxiang Ye
Andre Dekker
Leonard Wee
Publication date
23-12-2021
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging / Issue 8/2022
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-021-05658-9

Other articles of this Issue 8/2022

European Journal of Nuclear Medicine and Molecular Imaging 8/2022 Go to the issue