Skip to main content
Top
Published in: Gastric Cancer 5/2020

01-09-2020 | Endoscopy | Original Article

A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy

Authors: Ping An, Dongmei Yang, Jing Wang, Lianlian Wu, Jie Zhou, Zhi Zeng, Xu Huang, Yong Xiao, Shan Hu, Yiyun Chen, Fang Yao, Mingwen Guo, Qi Wu, Yanning Yang, Honggang Yu

Published in: Gastric Cancer | Issue 5/2020

Login to get access

Abstract

Background

Accurate delineation of cancer margins is critical for endoscopic curative resection. This study aimed to train and validate real-time fully convolutional networks for delineating the resection margin of early gastric cancer (EGC) under indigo carmine chromoendoscopy (CE) or white light endoscopy (WLE), and evaluated its performance and that of magnifying endoscopy with narrow-band imaging (ME-NBI).

Methods

We collected CE and WLE images of EGC lesions to train fully convolutional networks ENDOANGEL. ENDOANGEL was tested both on stationary images and endoscopic submucosal dissection (ESD) videos. The accuracy and reliability of ENDOANGEL and NBI-dependent delineation were further evaluated by a novel endoscopy–pathology point-to-point marking.

Results

ENDOANGEL had an accuracy of 85.7% in the CE images and 88.9% in the WLE images under an overlap ratio threshold of 0.60 in comparison with the manual markers labeled by the experts. In the ESD videos, the resection margins predicted by ENDOANGEL covered all areas of high-grade intraepithelial neoplasia and cancers. The minimum distance between the margins predicted by ENDOANGEL and the histological cancer boundary was 3.44 ± 1.45 mm which outperformed the resection margin based on ME-NBI.

Conclusions

ENDOANGEL has the potential to assist endoscopists in delineating the resection extent of EGC under CE or WLE during ESD.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef
2.
go back to reference Isomoto H, Shikuwa S, Yamaguchi N, Fukuda E, Ikeda K, Nishiyama H, et al. Endoscopic submucosal dissection for early gastric cancer: a large-scale feasibility study. Gut. 2009;58:331–6.CrossRef Isomoto H, Shikuwa S, Yamaguchi N, Fukuda E, Ikeda K, Nishiyama H, et al. Endoscopic submucosal dissection for early gastric cancer: a large-scale feasibility study. Gut. 2009;58:331–6.CrossRef
3.
go back to reference Lee S, Choi KD, Han M, Na HK, Ahn JY, Jung KW, et al. Long-term outcomes of endoscopic submucosal dissection versus surgery in early gastric cancer meeting expanded indication including undifferentiated-type tumors: a criteria-based analysis. Gastric Cancer. 2018;21:490–9.CrossRef Lee S, Choi KD, Han M, Na HK, Ahn JY, Jung KW, et al. Long-term outcomes of endoscopic submucosal dissection versus surgery in early gastric cancer meeting expanded indication including undifferentiated-type tumors: a criteria-based analysis. Gastric Cancer. 2018;21:490–9.CrossRef
4.
go back to reference Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, Repici A, Vieth M, De CA, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy. 2015;47:829–54.CrossRef Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, Repici A, Vieth M, De CA, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy. 2015;47:829–54.CrossRef
5.
go back to reference Bourke MJ, Neuhaus H, Bergman JJ. Endoscopic submucosal dissection: indications and application in western endoscopy practice. Gastroenterology. 2018;154:1887–900.CrossRef Bourke MJ, Neuhaus H, Bergman JJ. Endoscopic submucosal dissection: indications and application in western endoscopy practice. Gastroenterology. 2018;154:1887–900.CrossRef
6.
go back to reference Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31:1539–45.CrossRef Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31:1539–45.CrossRef
7.
go back to reference Yamashita H, Kitayama J, Ishigami H, Yamada J, Miyato H, Kaisaki S, et al. Endoscopic instillation of indigo carmine dye with acetic acid enables the visualization of distinct margin of superficial gastric lesion; usefulness in endoscopic treatment and diagnosis of gastric cancer. Dig Liver Dis. 2007;39:389–91.CrossRef Yamashita H, Kitayama J, Ishigami H, Yamada J, Miyato H, Kaisaki S, et al. Endoscopic instillation of indigo carmine dye with acetic acid enables the visualization of distinct margin of superficial gastric lesion; usefulness in endoscopic treatment and diagnosis of gastric cancer. Dig Liver Dis. 2007;39:389–91.CrossRef
8.
go back to reference Nagahama T, Yao K, Uedo N, Doyama H, Ueo T, Uchita K, et al. Delineation of the extent of early gastric cancer by magnifying narrow-band imaging and chromoendoscopy: a multicenter randomized controlled trial. Endoscopy. 2018;50:566–76.CrossRef Nagahama T, Yao K, Uedo N, Doyama H, Ueo T, Uchita K, et al. Delineation of the extent of early gastric cancer by magnifying narrow-band imaging and chromoendoscopy: a multicenter randomized controlled trial. Endoscopy. 2018;50:566–76.CrossRef
9.
go back to reference Nagahama T, Yao K, Maki S, Yasaka M, Takaki Y, Matsui T, et al. Usefulness of magnifying endoscopy with narrow-band imaging for determining the horizontal extent of early gastric cancer when there is an unclear margin by chromoendoscopy (with video). Gastrointest Endosc. 2011;74:1259–67.CrossRef Nagahama T, Yao K, Maki S, Yasaka M, Takaki Y, Matsui T, et al. Usefulness of magnifying endoscopy with narrow-band imaging for determining the horizontal extent of early gastric cancer when there is an unclear margin by chromoendoscopy (with video). Gastrointest Endosc. 2011;74:1259–67.CrossRef
10.
go back to reference Nonaka K, Namoto M, Kitada H, Shimizu M, Ochiai Y, Togawa O, et al. Usefulness of the DL in ME with NBI for determining the expanded area of early-stage differentiated gastric carcinoma. World J Gastrointest Endosc. 2012;4:362–7.CrossRef Nonaka K, Namoto M, Kitada H, Shimizu M, Ochiai Y, Togawa O, et al. Usefulness of the DL in ME with NBI for determining the expanded area of early-stage differentiated gastric carcinoma. World J Gastrointest Endosc. 2012;4:362–7.CrossRef
11.
go back to reference Asada-Hirayama I, Kodashima S, Sakaguchi Y, Ono S, Niimi K, Mochizuki S, et al. Magnifying endoscopy with narrow-band imaging is more accurate for determination of horizontal extent of early gastric cancers than chromoendoscopy. Endosc Int Open. 2016;4:E690–E698698.CrossRef Asada-Hirayama I, Kodashima S, Sakaguchi Y, Ono S, Niimi K, Mochizuki S, et al. Magnifying endoscopy with narrow-band imaging is more accurate for determination of horizontal extent of early gastric cancers than chromoendoscopy. Endosc Int Open. 2016;4:E690–E698698.CrossRef
12.
go back to reference Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 2014. pp. 1409–556. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 2014. pp. 1409–556.
13.
go back to reference Krizhevsky A, Sutskever I, Hinton G. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012. pp. 1097–105. Krizhevsky A, Sutskever I, Hinton G. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012. pp. 1097–105.
14.
go back to reference Byrne MF, Chapados N, Soudan F, Oertel C, Linares MP, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut. 2019;68:94–100.CrossRef Byrne MF, Chapados N, Soudan F, Oertel C, Linares MP, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut. 2019;68:94–100.CrossRef
15.
go back to reference Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115.CrossRef Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115.CrossRef
16.
go back to reference Wu LL, Zhou W, Wan XY, Zhang J, Shen L, Hu S, et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy. 2019;51:522–31.CrossRef Wu LL, Zhou W, Wan XY, Zhang J, Shen L, Hu S, et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy. 2019;51:522–31.CrossRef
18.
go back to reference Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell. 2015;2015:645–51. Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell. 2015;2015:645–51.
19.
go back to reference Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. In: Stoyanov D. et al. (eds.) Deep learning in medical image analysis and multimodal learning for clinical decision support. DLMIA 2018, ML-CDS 2018. Lecture notes in computer science, vol 11045. Cham: Springer. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. In: Stoyanov D. et al. (eds.) Deep learning in medical image analysis and multimodal learning for clinical decision support. DLMIA 2018, ML-CDS 2018. Lecture notes in computer science, vol 11045. Cham: Springer.
20.
go back to reference Kikuchi D, Iizuka T, Hoteya S, Nomura K, Kuribayashi Y, Toba T, et al. Vascular density of superficial esophageal squamous cell carcinoma determined by direct observation of resected specimen using narrow band imaging with magnifying endoscopy. Dis Esophagus. 2017;30:1–5.CrossRef Kikuchi D, Iizuka T, Hoteya S, Nomura K, Kuribayashi Y, Toba T, et al. Vascular density of superficial esophageal squamous cell carcinoma determined by direct observation of resected specimen using narrow band imaging with magnifying endoscopy. Dis Esophagus. 2017;30:1–5.CrossRef
21.
go back to reference Schlemper RJ, Riddell RH, Kato Y, Borchard F, Cooper HS, Dawsey SM, et al. The Vienna classification of gastrointestinal epithelial neoplasia. Gut. 2000;47:251–5.CrossRef Schlemper RJ, Riddell RH, Kato Y, Borchard F, Cooper HS, Dawsey SM, et al. The Vienna classification of gastrointestinal epithelial neoplasia. Gut. 2000;47:251–5.CrossRef
22.
23.
go back to reference Geosystems L. ERDAS imagine. Atlanta, 2004. Geosystems L. ERDAS imagine. Atlanta, 2004.
24.
go back to reference Huaizu J, Erik LM. Face Detection with the faster R-CNN. In: 2017 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017); 2017. pp. 650–657. Huaizu J, Erik LM. Face Detection with the faster R-CNN. In: 2017 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017); 2017. pp. 650–657.
25.
go back to reference Sakai Y, Eto R, Kasanuki J, Kondo F, Kato K, Arai M, et al. Chromoendoscopy with indigo carmine dye added to acetic acid in the diagnosis of gastric neoplasia: a prospective comparative study. Gastrointest Endosc. 2008;68:635–41.CrossRef Sakai Y, Eto R, Kasanuki J, Kondo F, Kato K, Arai M, et al. Chromoendoscopy with indigo carmine dye added to acetic acid in the diagnosis of gastric neoplasia: a prospective comparative study. Gastrointest Endosc. 2008;68:635–41.CrossRef
26.
go back to reference Numata N, Oka S, Tanaka S, Yoshifuku Y, Miwat T, Sanomura Y, et al. Useful condition of chromoendoscopy with indigo carmine and acetic acid for identifying a demarcation line prior to endoscopic submucosal dissection for early gastric cancer. BMC Gastroenterol. 2016;16:72.CrossRef Numata N, Oka S, Tanaka S, Yoshifuku Y, Miwat T, Sanomura Y, et al. Useful condition of chromoendoscopy with indigo carmine and acetic acid for identifying a demarcation line prior to endoscopic submucosal dissection for early gastric cancer. BMC Gastroenterol. 2016;16:72.CrossRef
27.
go back to reference Makazu M, Hirasawa K, Sato C, Ikeda R, Fukuchi T, Ishii Y, et al. Histological verification of the usefulness of magnifying endoscopy with narrow-band imaging for horizontal margin diagnosis of differentiated-type early gastric cancers. Gastric Cancer. 2018;21:258–66.CrossRef Makazu M, Hirasawa K, Sato C, Ikeda R, Fukuchi T, Ishii Y, et al. Histological verification of the usefulness of magnifying endoscopy with narrow-band imaging for horizontal margin diagnosis of differentiated-type early gastric cancers. Gastric Cancer. 2018;21:258–66.CrossRef
28.
go back to reference Yao K, Anagnostopoulos G, Ragunath K. Magnifying endoscopy for diagnosing and delineating early gastric cancer. Endoscopy. 2009;41:462–7.CrossRef Yao K, Anagnostopoulos G, Ragunath K. Magnifying endoscopy for diagnosing and delineating early gastric cancer. Endoscopy. 2009;41:462–7.CrossRef
29.
go back to reference Kanesaka T, Lee TC, Uedo N, Lin KP, Chen HZ, Lee JY, et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc. 2018;87:1339–444.CrossRef Kanesaka T, Lee TC, Uedo N, Lin KP, Chen HZ, Lee JY, et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc. 2018;87:1339–444.CrossRef
30.
go back to reference Sumiyama K. Past and current trends in endoscopic diagnosis for early stage gastric cancer in Japan. Gastric Cancer. 2017;20:20–7.CrossRef Sumiyama K. Past and current trends in endoscopic diagnosis for early stage gastric cancer in Japan. Gastric Cancer. 2017;20:20–7.CrossRef
Metadata
Title
A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy
Authors
Ping An
Dongmei Yang
Jing Wang
Lianlian Wu
Jie Zhou
Zhi Zeng
Xu Huang
Yong Xiao
Shan Hu
Yiyun Chen
Fang Yao
Mingwen Guo
Qi Wu
Yanning Yang
Honggang Yu
Publication date
01-09-2020
Publisher
Springer Singapore
Published in
Gastric Cancer / Issue 5/2020
Print ISSN: 1436-3291
Electronic ISSN: 1436-3305
DOI
https://doi.org/10.1007/s10120-020-01071-7

Other articles of this Issue 5/2020

Gastric Cancer 5/2020 Go to the issue