Skip to main content
Top
Published in: Gastric Cancer 3/2024

19-01-2024 | Endoscopy | Original Article

Diagnostic performance of deep-learning-based virtual chromoendoscopy in gastric neoplasms

Authors: Sho Suzuki, Yusuke Monno, Ryo Arai, Masaki Miyaoka, Yosuke Toya, Mitsuru Esaki, Takuya Wada, Waku Hatta, Ayaka Takasu, Shigeaki Nagao, Fumiaki Ishibashi, Yohei Minato, Kenichi Konda, Takahiro Dohmen, Kenji Miki, Masatoshi Okutomi

Published in: Gastric Cancer | Issue 3/2024

Login to get access

Abstract

Backgrounds

Cycle-consistent generative adversarial network (CycleGAN) is a deep neural network model that performs image-to-image translations. We generated virtual indigo carmine (IC) chromoendoscopy images of gastric neoplasms using CycleGAN and compared their diagnostic performance with that of white light endoscopy (WLE).

Methods

WLE and IC images of 176 patients with gastric neoplasms who underwent endoscopic resection were obtained. We used 1,633 images (911 WLE and 722 IC) of 146 cases in the training dataset to develop virtual IC images using CycleGAN. The remaining 30 WLE images were translated into 30 virtual IC images using the trained CycleGAN and used for validation. The lesion borders were evaluated by 118 endoscopists from 22 institutions using the 60 paired virtual IC and WLE images. The lesion area concordance rate and successful whole-lesion diagnosis were compared.

Results

The lesion area concordance rate based on the pathological diagnosis in virtual IC was lower than in WLE (44.1% vs. 48.5%, p < 0.01). The successful whole-lesion diagnosis was higher in the virtual IC than in WLE images; however, the difference was insignificant (28.2% vs. 26.4%, p = 0.11). Conversely, subgroup analyses revealed a significantly higher diagnosis in virtual IC than in WLE for depressed morphology (41.9% vs. 36.9%, p = 0.02), differentiated histology (27.6% vs. 24.8%, p = 0.02), smaller lesion size (42.3% vs. 38.3%, p = 0.01), and assessed by expert endoscopists (27.3% vs. 23.6%, p = 0.03).

Conclusions

The diagnostic ability of virtual IC was higher for some lesions, but not completely superior to that of WLE. Adjustments are required to improve the imaging system’s performance.
Literature
1.
go back to reference Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209–49.CrossRefPubMed Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209–49.CrossRefPubMed
2.
go back to reference Suh YS, Lee J, Woo H, Shin D, Kong SH, Lee HJ, et al. National cancer screening program for gastric cancer in Korea: Nationwide treatment benefit and cost. Cancer. 2020;126(9):1929–39.CrossRefPubMed Suh YS, Lee J, Woo H, Shin D, Kong SH, Lee HJ, et al. National cancer screening program for gastric cancer in Korea: Nationwide treatment benefit and cost. Cancer. 2020;126(9):1929–39.CrossRefPubMed
3.
go back to reference Mabe K, Inoue K, Kamada T, Kato K, Kato M, Haruma K. Endoscopic screening for gastric cancer in Japan: current status and future perspectives. Dig Endosc. 2022;34(3):412–9.CrossRefPubMed Mabe K, Inoue K, Kamada T, Kato K, Kato M, Haruma K. Endoscopic screening for gastric cancer in Japan: current status and future perspectives. Dig Endosc. 2022;34(3):412–9.CrossRefPubMed
4.
go back to reference Jun JK, Choi KS, Lee H-Y, Suh M, Park B, Song SH, et al. Effectiveness of the Korean National Cancer Screening Program in Reducing Gastric Cancer Mortality. Gastroenterology. 2017;152(6):1319-28.e7.CrossRefPubMed Jun JK, Choi KS, Lee H-Y, Suh M, Park B, Song SH, et al. Effectiveness of the Korean National Cancer Screening Program in Reducing Gastric Cancer Mortality. Gastroenterology. 2017;152(6):1319-28.e7.CrossRefPubMed
5.
go back to reference Suzuki H, Takizawa K, Hirasawa T, Takeuchi Y, Ishido K, Hoteya S, et al. Short-term outcomes of multicenter prospective cohort study of gastric endoscopic resection: ‘Real-world evidence’ in Japan. Dig Endosc. 2019;31(1):30–9.CrossRefPubMed Suzuki H, Takizawa K, Hirasawa T, Takeuchi Y, Ishido K, Hoteya S, et al. Short-term outcomes of multicenter prospective cohort study of gastric endoscopic resection: ‘Real-world evidence’ in Japan. Dig Endosc. 2019;31(1):30–9.CrossRefPubMed
6.
go back to reference Shichijo S, Uedo N, Kanesaka T, Ohta T, Nakagawa K, Shimamoto Y, et al. Long-term outcomes after endoscopic submucosal dissection for differentiated-type early gastric cancer that fulfilled expanded indication criteria: a prospective cohort study. J Gastroenterol Hepatol. 2021;36(3):664–70.CrossRefPubMed Shichijo S, Uedo N, Kanesaka T, Ohta T, Nakagawa K, Shimamoto Y, et al. Long-term outcomes after endoscopic submucosal dissection for differentiated-type early gastric cancer that fulfilled expanded indication criteria: a prospective cohort study. J Gastroenterol Hepatol. 2021;36(3):664–70.CrossRefPubMed
7.
go back to reference Chiu PWY, Uedo N, Singh R, Gotoda T, Ng EKW, Yao K, et al. An Asian consensus on standards of diagnostic upper endoscopy for neoplasia. Gut. 2019;68(2):186–97.CrossRefPubMed Chiu PWY, Uedo N, Singh R, Gotoda T, Ng EKW, Yao K, et al. An Asian consensus on standards of diagnostic upper endoscopy for neoplasia. Gut. 2019;68(2):186–97.CrossRefPubMed
8.
go back to reference Sugita T, Suzuki S, Ichijima R, Ogura K, Kusano C, Ikehara H, et al. Diagnostic ability of high-definition imaging using ultraslim endoscopes in early gastric cancer. J Gastric Cancer. 2021;21(3):246.CrossRefPubMedPubMedCentral Sugita T, Suzuki S, Ichijima R, Ogura K, Kusano C, Ikehara H, et al. Diagnostic ability of high-definition imaging using ultraslim endoscopes in early gastric cancer. J Gastric Cancer. 2021;21(3):246.CrossRefPubMedPubMedCentral
10.
go back to reference Okabayashi T, Gotoda T, Kondo H, Ono H, Oda I, Fujishiro M, et al. Usefulness of indigo carmine chromoendoscopy and endoscopic clipping for accurate preoperative assessment of proximal gastric cancer. Endoscopy. 2000;32(10):Suppl 62. Okabayashi T, Gotoda T, Kondo H, Ono H, Oda I, Fujishiro M, et al. Usefulness of indigo carmine chromoendoscopy and endoscopic clipping for accurate preoperative assessment of proximal gastric cancer. Endoscopy. 2000;32(10):Suppl 62.
11.
go back to reference Yasuda T, Yagi N, Omatsu T, Hayashi S, Nakahata Y, Yasuda Y, et al. Benefits of linked color imaging for recognition of early differentiated-type gastric cancer: in comparison with indigo carmine contrast method and blue laser imaging. Surg Endosc. 2021;35(6):2750–8.CrossRefPubMed Yasuda T, Yagi N, Omatsu T, Hayashi S, Nakahata Y, Yasuda Y, et al. Benefits of linked color imaging for recognition of early differentiated-type gastric cancer: in comparison with indigo carmine contrast method and blue laser imaging. Surg Endosc. 2021;35(6):2750–8.CrossRefPubMed
12.
go back to reference Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31(9):1539–45.CrossRefPubMed Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31(9):1539–45.CrossRefPubMed
13.
go back to reference Strassburg CP, Nattermann J, Hüneburg R, Heling D, Kaczmarek DJ, Van Heteren P, et al. Dye chromoendoscopy leads to a higher adenoma detection in the duodenum and stomach in patients with familial adenomatous polyposis. Endosc Int Open. 2020;08(10):E1308–14.CrossRef Strassburg CP, Nattermann J, Hüneburg R, Heling D, Kaczmarek DJ, Van Heteren P, et al. Dye chromoendoscopy leads to a higher adenoma detection in the duodenum and stomach in patients with familial adenomatous polyposis. Endosc Int Open. 2020;08(10):E1308–14.CrossRef
16.
go back to reference Yuan X, Gong W, Hu B. Virtual indigo carmine dyeing: new artificial intelligence-based chromoendoscopy technique. Dig Endosc. 2023;35(1):e8–10.CrossRefPubMed Yuan X, Gong W, Hu B. Virtual indigo carmine dyeing: new artificial intelligence-based chromoendoscopy technique. Dig Endosc. 2023;35(1):e8–10.CrossRefPubMed
17.
go back to reference Japanese classification of gastric carcinoma: 3rd English edition. Gastric Cancer. 2011;14(2):101–12. Japanese classification of gastric carcinoma: 3rd English edition. Gastric Cancer. 2011;14(2):101–12.
18.
go back to reference Dixon MF, Genta RM, Yardley JH, Correa P. Classification and grading of gastritis: the updated Sydney system. Am J Surg Pathol. 1996;20(10):1161–81.CrossRefPubMed Dixon MF, Genta RM, Yardley JH, Correa P. Classification and grading of gastritis: the updated Sydney system. Am J Surg Pathol. 1996;20(10):1161–81.CrossRefPubMed
19.
go back to reference Widya AR, Monno Y, Okutomi M, Suzuki S, Gotoda T, Miki K. Stomach 3D reconstruction using virtual chromoendoscopic images. IEEE J Transl Eng Health Med. 2021;9:1700211.CrossRefPubMed Widya AR, Monno Y, Okutomi M, Suzuki S, Gotoda T, Miki K. Stomach 3D reconstruction using virtual chromoendoscopic images. IEEE J Transl Eng Health Med. 2021;9:1700211.CrossRefPubMed
22.
go back to reference Kojima T, Yao K, Ohtsu K, Kuan C, Tanabe H, Imamura K, et al. A comparative study of demarcation line diagnostic performance between non-magnifying observation with white light and non-magnifying observation with narrow-band light for early gastric cancer. Gastric Cancer. 2022;25(4):761–9.CrossRefPubMed Kojima T, Yao K, Ohtsu K, Kuan C, Tanabe H, Imamura K, et al. A comparative study of demarcation line diagnostic performance between non-magnifying observation with white light and non-magnifying observation with narrow-band light for early gastric cancer. Gastric Cancer. 2022;25(4):761–9.CrossRefPubMed
24.
go back to reference Xu Z, Li X, Zhu X, Chen L, He Y, Chen Y. Effective immunohistochemistry pathology microscopy image generation using CycleGAN. Front Mol Biosci. 2020;7: 571180.CrossRefPubMedPubMedCentral Xu Z, Li X, Zhu X, Chen L, He Y, Chen Y. Effective immunohistochemistry pathology microscopy image generation using CycleGAN. Front Mol Biosci. 2020;7: 571180.CrossRefPubMedPubMedCentral
25.
go back to reference Zhou L, Schaefferkoetter JD, Tham IWK, Huang G, Yan J. Supervised learning with cyclegan for low-dose FDG PET image denoising. Med Image Anal. 2020;65: 101770.CrossRefPubMed Zhou L, Schaefferkoetter JD, Tham IWK, Huang G, Yan J. Supervised learning with cyclegan for low-dose FDG PET image denoising. Med Image Anal. 2020;65: 101770.CrossRefPubMed
26.
go back to reference Liu Y, Lei Y, Wang Y, Wang T, Ren L, Lin L, et al. MRI-based treatment planning for proton radiotherapy: dosimetric validation of a deep learning-based liver synthetic CT generation method. Phys Med Biol. 2019;64(14): 145015.CrossRefPubMedPubMedCentral Liu Y, Lei Y, Wang Y, Wang T, Ren L, Lin L, et al. MRI-based treatment planning for proton radiotherapy: dosimetric validation of a deep learning-based liver synthetic CT generation method. Phys Med Biol. 2019;64(14): 145015.CrossRefPubMedPubMedCentral
27.
go back to reference Connell M, Xin Y, Gerard SE, Herrmann J, Shah PK, Martin KT, et al. Unsupervised segmentation and quantification of COVID-19 lesions on computed tomography scans using CycleGAN. Methods. 2022;205:200–9.CrossRefPubMedPubMedCentral Connell M, Xin Y, Gerard SE, Herrmann J, Shah PK, Martin KT, et al. Unsupervised segmentation and quantification of COVID-19 lesions on computed tomography scans using CycleGAN. Methods. 2022;205:200–9.CrossRefPubMedPubMedCentral
28.
go back to reference Yoo TK, Choi JY, Kim HK. CycleGAN-based deep learning technique for artifact reduction in fundus photography. Graefes Arch Clin Exp Ophthalmol. 2020;258(8):1631–7.CrossRefPubMed Yoo TK, Choi JY, Kim HK. CycleGAN-based deep learning technique for artifact reduction in fundus photography. Graefes Arch Clin Exp Ophthalmol. 2020;258(8):1631–7.CrossRefPubMed
29.
go back to reference Fukuda A, Miyamoto T, Kamba S, Sumiyama K. Generating virtual chromoendoscopic images and improving detectability and classification performance of endoscopic lesions. Domain adaptation and representation transfer and medical image learning with less labels and imperfect data. Cham: Springer International Publishing; 2019. Fukuda A, Miyamoto T, Kamba S, Sumiyama K. Generating virtual chromoendoscopic images and improving detectability and classification performance of endoscopic lesions. Domain adaptation and representation transfer and medical image learning with less labels and imperfect data. Cham: Springer International Publishing; 2019.
30.
go back to reference Chiba H, Ohata K, Tachikawa J, Yamada K, Kobayashi M, Okada N, et al. The feasibility and safety of endoscopic submucosal dissection of gastric lesions larger than 5 cm. Gastric Cancer. 2022;25(6):1031–8.CrossRefPubMed Chiba H, Ohata K, Tachikawa J, Yamada K, Kobayashi M, Okada N, et al. The feasibility and safety of endoscopic submucosal dissection of gastric lesions larger than 5 cm. Gastric Cancer. 2022;25(6):1031–8.CrossRefPubMed
Metadata
Title
Diagnostic performance of deep-learning-based virtual chromoendoscopy in gastric neoplasms
Authors
Sho Suzuki
Yusuke Monno
Ryo Arai
Masaki Miyaoka
Yosuke Toya
Mitsuru Esaki
Takuya Wada
Waku Hatta
Ayaka Takasu
Shigeaki Nagao
Fumiaki Ishibashi
Yohei Minato
Kenichi Konda
Takahiro Dohmen
Kenji Miki
Masatoshi Okutomi
Publication date
19-01-2024
Publisher
Springer Nature Singapore
Published in
Gastric Cancer / Issue 3/2024
Print ISSN: 1436-3291
Electronic ISSN: 1436-3305
DOI
https://doi.org/10.1007/s10120-024-01469-7

Other articles of this Issue 3/2024

Gastric Cancer 3/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.