Skip to main content
Top
Published in: Esophagus 2/2019

01-04-2019 | Original Article

Diagnosis using deep-learning artificial intelligence based on the endocytoscopic observation of the esophagus

Authors: Youichi Kumagai, Kaiyo Takubo, Kenro Kawada, Kazuharu Aoyama, Yuma Endo, Tsuyoshi Ozawa, Toshiaki Hirasawa, Toshiyuki Yoshio, Soichiro Ishihara, Mitsuhiro Fujishiro, Jun-ichi Tamaru, Erito Mochiki, Hideyuki Ishida, Tomohiro Tada

Published in: Esophagus | Issue 2/2019

Login to get access

Abstract

Background and aims

The endocytoscopic system (ECS) helps in virtual realization of histology and can aid in confirming histological diagnosis in vivo. We propose replacing biopsy-based histology for esophageal squamous cell carcinoma (ESCC) by using the ECS. We applied deep-learning artificial intelligence (AI) to analyse ECS images of the esophagus to determine whether AI can support endoscopists for the replacement of biopsy-based histology.

Methods

A convolutional neural network-based AI was constructed based on GoogLeNet and trained using 4715 ECS images of the esophagus (1141 malignant and 3574 non-malignant images). To evaluate the diagnostic accuracy of the AI, an independent test set of 1520 ECS images, collected from 55 consecutive patients (27 ESCCs and 28 benign esophageal lesions) were examined.

Results

On the basis of the receiver-operating characteristic curve analysis, the areas under the curve of the total images, higher magnification pictures, and lower magnification pictures were 0.85, 0.90, and 0.72, respectively. The AI correctly diagnosed 25 of the 27 ESCC cases, with an overall sensitivity of 92.6%. Twenty-five of the 28 non-cancerous lesions were diagnosed as non-malignant, with a specificity of 89.3% and an overall accuracy of 90.9%. Two cases of malignant lesions, misdiagnosed as non-malignant by the AI, were correctly diagnosed as malignant by the endoscopist. Among the 3 cases of non-cancerous lesions diagnosed as malignant by the AI, 2 were of radiation-related esophagitis and one was of gastroesophageal reflux disease.

Conclusion

AI is expected to support endoscopists in diagnosing ESCC based on ECS images without biopsy-based histological reference.
Literature
1.
go back to reference Kumagai Y, Monma K, Kawada K. Magnifying chromoendoscopy of the esophagus: in vivo pathological diagnosis using an endocytoscopy system. Endoscopy. 2004;36:590–4.CrossRefPubMed Kumagai Y, Monma K, Kawada K. Magnifying chromoendoscopy of the esophagus: in vivo pathological diagnosis using an endocytoscopy system. Endoscopy. 2004;36:590–4.CrossRefPubMed
2.
go back to reference Kumagai Y, Kawada K, Yamazaki S, et al. Endocytoscopic observation for esophageal squamous cell carcinoma: can biopsy histology be omitted? Dis Esophagus. 2009;22:505–12.CrossRefPubMed Kumagai Y, Kawada K, Yamazaki S, et al. Endocytoscopic observation for esophageal squamous cell carcinoma: can biopsy histology be omitted? Dis Esophagus. 2009;22:505–12.CrossRefPubMed
3.
go back to reference Kumagai Y, Kawada K, Yamazaki S, et al. Prospective replacement of magnifying endoscopy by a newly developed endocytoscope, the ‘GIF-Y0002’. Dis Esophagus. 2010;23:627–32.CrossRefPubMed Kumagai Y, Kawada K, Yamazaki S, et al. Prospective replacement of magnifying endoscopy by a newly developed endocytoscope, the ‘GIF-Y0002’. Dis Esophagus. 2010;23:627–32.CrossRefPubMed
4.
go back to reference Kumagai Y, Kawada K, Yamazaki S, et al. Current status and limitations of the newly developed endocytoscope GIF-Y0002 with reference to its diagnostic performance for common esophageal lesions. J Dig Dis. 2012;13:393–400.CrossRefPubMed Kumagai Y, Kawada K, Yamazaki S, et al. Current status and limitations of the newly developed endocytoscope GIF-Y0002 with reference to its diagnostic performance for common esophageal lesions. J Dig Dis. 2012;13:393–400.CrossRefPubMed
5.
go back to reference Kumagai Y, Kawada K, Yamazaki S, et al. Endocytoscopic observation of esophageal squamous cell carcinoma. Dig Endosc. 2010;22:10–6.CrossRefPubMed Kumagai Y, Kawada K, Yamazaki S, et al. Endocytoscopic observation of esophageal squamous cell carcinoma. Dig Endosc. 2010;22:10–6.CrossRefPubMed
6.
go back to reference Kumagai Y, Kawada K, Higashi M, et al. Endocytoscopic observation of various esophageal lesions at ×600: can nuclear abnormality be recognized? Dis Esophagus. 2015;28:269–75.CrossRefPubMed Kumagai Y, Kawada K, Higashi M, et al. Endocytoscopic observation of various esophageal lesions at ×600: can nuclear abnormality be recognized? Dis Esophagus. 2015;28:269–75.CrossRefPubMed
8.
go back to reference Kumagai Y, Takubo K, Kawada K, et al. A newly developed continuous zoom-focus endocytoscope. Endoscopy. 2017;49(2):176–80.PubMed Kumagai Y, Takubo K, Kawada K, et al. A newly developed continuous zoom-focus endocytoscope. Endoscopy. 2017;49(2):176–80.PubMed
9.
go back to reference Inoue H, Kazawa T, Sato Y, et al. In vivo observation of living cancer cells in the esophagus, stomach, and colon using catheter-type contact endoscope, “Endo-Cytoscopy system”. Gastrointest Endosc Clin N Am. 2004;14:589–94.CrossRefPubMed Inoue H, Kazawa T, Sato Y, et al. In vivo observation of living cancer cells in the esophagus, stomach, and colon using catheter-type contact endoscope, “Endo-Cytoscopy system”. Gastrointest Endosc Clin N Am. 2004;14:589–94.CrossRefPubMed
10.
go back to reference Sasajima K, Kudo SE, Inoue H, et al. Real-time in vivo virtual histology of colorectal lesions when using the endocytoscopy system. Gastrointest Endosc. 2006;63(7):1010–7.CrossRefPubMed Sasajima K, Kudo SE, Inoue H, et al. Real-time in vivo virtual histology of colorectal lesions when using the endocytoscopy system. Gastrointest Endosc. 2006;63(7):1010–7.CrossRefPubMed
11.
go back to reference Bibault JE, Giraud P, Burgun A. Big Data and machine learning in radiation oncology: state of the art and future prospects. Cancer Lett. 2016;382:110–7.CrossRefPubMed Bibault JE, Giraud P, Burgun A. Big Data and machine learning in radiation oncology: state of the art and future prospects. Cancer Lett. 2016;382:110–7.CrossRefPubMed
12.
13.
go back to reference Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402–10.CrossRefPubMed Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402–10.CrossRefPubMed
15.
go back to reference Misawa M, Kudo S, Mori Y, et al. Accuracy of computer-aided diagnosis based on narrow-band imaging endocytoscopy for diagnosing colorectal lesions: comparison with experts. Int J Comput Assist Radiol Surg. 2017;12:757–66.CrossRefPubMed Misawa M, Kudo S, Mori Y, et al. Accuracy of computer-aided diagnosis based on narrow-band imaging endocytoscopy for diagnosing colorectal lesions: comparison with experts. Int J Comput Assist Radiol Surg. 2017;12:757–66.CrossRefPubMed
16.
go back to reference Shichijo S, Nomura S, Aoyama K, et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine. 2017;25:106–11.CrossRefPubMedPubMedCentral Shichijo S, Nomura S, Aoyama K, et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine. 2017;25:106–11.CrossRefPubMedPubMedCentral
18.
go back to reference Inoue H, Kazawa T, Sato Y, et al. In vivo observation of living cancer cells in the esophagus, stomach, and colon using catheter-type contact endoscope, “Endo-Cytoscopy system”. Gastrointest Endosc Clin N Am. 2004;14:589–94.CrossRefPubMed Inoue H, Kazawa T, Sato Y, et al. In vivo observation of living cancer cells in the esophagus, stomach, and colon using catheter-type contact endoscope, “Endo-Cytoscopy system”. Gastrointest Endosc Clin N Am. 2004;14:589–94.CrossRefPubMed
20.
go back to reference Takubo K. Pathology of the esophagus. 3rd ed. Tokyo: Wiley Publishing Japan; 2017. p. 88–102 (131–134 ). Takubo K. Pathology of the esophagus. 3rd ed. Tokyo: Wiley Publishing Japan; 2017. p. 88–102 (131–134 ).
Metadata
Title
Diagnosis using deep-learning artificial intelligence based on the endocytoscopic observation of the esophagus
Authors
Youichi Kumagai
Kaiyo Takubo
Kenro Kawada
Kazuharu Aoyama
Yuma Endo
Tsuyoshi Ozawa
Toshiaki Hirasawa
Toshiyuki Yoshio
Soichiro Ishihara
Mitsuhiro Fujishiro
Jun-ichi Tamaru
Erito Mochiki
Hideyuki Ishida
Tomohiro Tada
Publication date
01-04-2019
Publisher
Springer Singapore
Published in
Esophagus / Issue 2/2019
Print ISSN: 1612-9059
Electronic ISSN: 1612-9067
DOI
https://doi.org/10.1007/s10388-018-0651-7

Other articles of this Issue 2/2019

Esophagus 2/2019 Go to the issue