Skip to main content
Top
Published in: BMC Gastroenterology 1/2023

Open Access 01-12-2023 | Endoscopy | Research

A single-center prospective study evaluating the usefulness of artificial intelligence for the diagnosis of esophageal squamous cell carcinoma in a real-time setting

Authors: Yasuhiro Tani, Ryu Ishihara, Takahiro Inoue, Yuki Okubo, Yushi Kawakami, Katsunori Matsueda, Muneaki Miyake, Shunsuke Yoshii, Satoki Shichijo, Takashi Kanesaka, Sachiko Yamamoto, Yoji Takeuchi, Koji Higashino, Noriya Uedo, Tomoki Michida, Yusuke Kato, Tomohiro Tada

Published in: BMC Gastroenterology | Issue 1/2023

Login to get access

Abstract

Background

Several pre-clinical studies have reported the usefulness of artificial intelligence (AI) systems in the diagnosis of esophageal squamous cell carcinoma (ESCC). We conducted this study to evaluate the usefulness of an AI system for real-time diagnosis of ESCC in a clinical setting.

Methods

This study followed a single-center prospective single-arm non-inferiority design. Patients at high risk for ESCC were recruited and real-time diagnosis by the AI system was compared with that of endoscopists for lesions suspected to be ESCC. The primary outcomes were the diagnostic accuracy of the AI system and endoscopists. The secondary outcomes were sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and adverse events.

Results

A total of 237 lesions were evaluated. The accuracy, sensitivity, and specificity of the AI system were 80.6%, 68.2%, and 83.4%, respectively. The accuracy, sensitivity, and specificity of endoscopists were 85.7%, 61.4%, and 91.2%, respectively. The difference between the accuracy of the AI system and that of the endoscopists was − 5.1%, and the lower limit of the 90% confidence interval was less than the non-inferiority margin.

Conclusions

The non-inferiority of the AI system in comparison with endoscopists in the real-time diagnosis of ESCC in a clinical setting was not proven.

Trial registration

Japan Registry of Clinical Trials (jRCTs052200015, 18/05/2020).
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRefPubMed Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRefPubMed
3.
go back to reference Igaki H, Kato H, Tachimori Y, et al. Clinicopathologic characteristics and survival of patients with clinical stage I squamous cell carcinomas of the thoracic esophagus treated with three-field lymph node dissection. Eur J Cardiothorac Surg. 2001;20:1089–94.CrossRefPubMed Igaki H, Kato H, Tachimori Y, et al. Clinicopathologic characteristics and survival of patients with clinical stage I squamous cell carcinomas of the thoracic esophagus treated with three-field lymph node dissection. Eur J Cardiothorac Surg. 2001;20:1089–94.CrossRefPubMed
4.
go back to reference Yamashina T, Ishihara R, Nagai K, et al. Long-term outcome and metastatic risk after endoscopic resection of superficial esophageal squamous cell carcinoma. Am J Gastroenterol. 2013;108:544–51.CrossRefPubMed Yamashina T, Ishihara R, Nagai K, et al. Long-term outcome and metastatic risk after endoscopic resection of superficial esophageal squamous cell carcinoma. Am J Gastroenterol. 2013;108:544–51.CrossRefPubMed
5.
go back to reference Minashi K, Nihei K, Mizusawa J et al. Efficacy of endoscopic resection and selective chemoradiotherapy for stage I esophageal squamous cell carcinoma. Gastroenterology. 2019; 157: 382 – 90.e3. Minashi K, Nihei K, Mizusawa J et al. Efficacy of endoscopic resection and selective chemoradiotherapy for stage I esophageal squamous cell carcinoma. Gastroenterology. 2019; 157: 382 – 90.e3.
6.
go back to reference Kato K, Ito Y, Nozaki I, et al. Parallel-group controlled trial of surgery Versus Chemoradiotherapy in patients with stage I esophageal squamous cell carcinoma. Gastroenterology. 2021;161:1878–86. e2.CrossRefPubMed Kato K, Ito Y, Nozaki I, et al. Parallel-group controlled trial of surgery Versus Chemoradiotherapy in patients with stage I esophageal squamous cell carcinoma. Gastroenterology. 2021;161:1878–86. e2.CrossRefPubMed
7.
go back to reference Ishihara R, Inoue T, Uedo N, et al. Significance of each narrow-band imaging finding in diagnosing squamous mucosal high-grade neoplasia of the esophagus. J Gastroenterol Hepatol. 2010;25:1410–5.CrossRefPubMed Ishihara R, Inoue T, Uedo N, et al. Significance of each narrow-band imaging finding in diagnosing squamous mucosal high-grade neoplasia of the esophagus. J Gastroenterol Hepatol. 2010;25:1410–5.CrossRefPubMed
8.
go back to reference Muto M, Minashi K, Yano T, et al. Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: a multicenter randomized controlled trial. J Clin Oncol. 2010;28:1566–72.CrossRefPubMedPubMedCentral Muto M, Minashi K, Yano T, et al. Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: a multicenter randomized controlled trial. J Clin Oncol. 2010;28:1566–72.CrossRefPubMedPubMedCentral
9.
go back to reference Oyama T, Inoue H, Arima M, et al. Prediction of the invasion depth of superficial squamous cell carcinoma based on microvessel morphology: magnifying endoscopic classification of the Japan Esophageal Society. Esophagus. 2017;14:105–12.CrossRefPubMed Oyama T, Inoue H, Arima M, et al. Prediction of the invasion depth of superficial squamous cell carcinoma based on microvessel morphology: magnifying endoscopic classification of the Japan Esophageal Society. Esophagus. 2017;14:105–12.CrossRefPubMed
10.
go back to reference Nagai K, Ishihara R, Ishiguro S, et al. Endoscopic optical diagnosis provides high diagnostic accuracy of esophageal squamous cell carcinoma. BMC Gastroenterol. 2014;14:141.CrossRefPubMedPubMedCentral Nagai K, Ishihara R, Ishiguro S, et al. Endoscopic optical diagnosis provides high diagnostic accuracy of esophageal squamous cell carcinoma. BMC Gastroenterol. 2014;14:141.CrossRefPubMedPubMedCentral
11.
go back to reference Fukuda H, Ishihara R, Kato Y, et al. Comparison of performances of artificial intelligence versus expert endoscopists for real-time assisted diagnosis of esophageal squamous cell carcinoma (with video). Gastrointest Endosc. 2020;92:848–55.CrossRefPubMed Fukuda H, Ishihara R, Kato Y, et al. Comparison of performances of artificial intelligence versus expert endoscopists for real-time assisted diagnosis of esophageal squamous cell carcinoma (with video). Gastrointest Endosc. 2020;92:848–55.CrossRefPubMed
12.
go back to reference Tajiri A, Ishihara R, Kato Y, et al. Utility of an artificial intelligence system for classification of esophageal lesions when simulating its clinical use. Sci Rep. 2022;12:6677.CrossRefPubMedPubMedCentral Tajiri A, Ishihara R, Kato Y, et al. Utility of an artificial intelligence system for classification of esophageal lesions when simulating its clinical use. Sci Rep. 2022;12:6677.CrossRefPubMedPubMedCentral
13.
go back to reference Nakagawa K, Ishihara R, Aoyama K, et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc. 2019;90:407–14.CrossRefPubMed Nakagawa K, Ishihara R, Aoyama K, et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc. 2019;90:407–14.CrossRefPubMed
14.
go back to reference Ohmori M, Ishihara R, Aoyama K, et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest Endosc. 2020;91:301–9e1.CrossRefPubMed Ohmori M, Ishihara R, Aoyama K, et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest Endosc. 2020;91:301–9e1.CrossRefPubMed
15.
go back to reference Shimamoto Y, Ishihara R, Kato Y, et al. Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence. J Gastroenterol. 2020;55:1037–45.CrossRefPubMed Shimamoto Y, Ishihara R, Kato Y, et al. Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence. J Gastroenterol. 2020;55:1037–45.CrossRefPubMed
16.
go back to reference Waki K, Ishihara R, Kato Y, et al. Usefulness of an artificial intelligence system for the detection of esophageal squamous cell carcinoma evaluated with videos simulating overlooking situation. Dig Endosc. 2021;33:1101–9.CrossRefPubMed Waki K, Ishihara R, Kato Y, et al. Usefulness of an artificial intelligence system for the detection of esophageal squamous cell carcinoma evaluated with videos simulating overlooking situation. Dig Endosc. 2021;33:1101–9.CrossRefPubMed
17.
go back to reference Urabe Y, Hiyama T, Tanaka S, et al. Metachronous multiple esophageal squamous cell carcinomas and lugol-voiding lesions after endoscopic mucosal resection. Endoscopy. 2009;41:304–9.CrossRefPubMed Urabe Y, Hiyama T, Tanaka S, et al. Metachronous multiple esophageal squamous cell carcinomas and lugol-voiding lesions after endoscopic mucosal resection. Endoscopy. 2009;41:304–9.CrossRefPubMed
18.
go back to reference Yokoyama A, Omori T, Yokoyama T, Sato Y, Kawakubo H, Maruyama K. Risk of metachronous squamous cell carcinoma in the upper aerodigestive tract of japanese alcoholic men with esophageal squamous cell carcinoma: a long-term endoscopic follow-up study. Cancer Sci. 2008;99:1164–71.CrossRefPubMed Yokoyama A, Omori T, Yokoyama T, Sato Y, Kawakubo H, Maruyama K. Risk of metachronous squamous cell carcinoma in the upper aerodigestive tract of japanese alcoholic men with esophageal squamous cell carcinoma: a long-term endoscopic follow-up study. Cancer Sci. 2008;99:1164–71.CrossRefPubMed
19.
go back to reference Nobre Moura R, Kuboki Y, Baba ER, et al. Long-term results of an endoscopic screening program for superficial esophageal cancer in patients with head and neck squamous cell carcinoma. Endosc Int Open. 2022;10:E200–8.CrossRefPubMedPubMedCentral Nobre Moura R, Kuboki Y, Baba ER, et al. Long-term results of an endoscopic screening program for superficial esophageal cancer in patients with head and neck squamous cell carcinoma. Endosc Int Open. 2022;10:E200–8.CrossRefPubMedPubMedCentral
20.
go back to reference Fujimoto K, Fujishiro M, Kato M, et al. Guidelines for gastroenterological endoscopy in patients undergoing antithrombotic treatment. Dig Endosc. 2014;26:1–14.CrossRefPubMed Fujimoto K, Fujishiro M, Kato M, et al. Guidelines for gastroenterological endoscopy in patients undergoing antithrombotic treatment. Dig Endosc. 2014;26:1–14.CrossRefPubMed
21.
go back to reference Kato M, Uedo N, Hokimoto S, et al. Guidelines for gastroenterological endoscopy in patients undergoing antithrombotic treatment: 2017 appendix on anticoagulants including direct oral anticoagulants. Dig Endosc. 2018;30:433–40.CrossRefPubMed Kato M, Uedo N, Hokimoto S, et al. Guidelines for gastroenterological endoscopy in patients undergoing antithrombotic treatment: 2017 appendix on anticoagulants including direct oral anticoagulants. Dig Endosc. 2018;30:433–40.CrossRefPubMed
22.
go back to reference Ketkar N. Introduction to PyTorch. In: Ketkar N, editor. Deep learning with Python: a Hands-on introduction. Berkeley, CA: Apress; 2017. pp. 195–208.CrossRef Ketkar N. Introduction to PyTorch. In: Ketkar N, editor. Deep learning with Python: a Hands-on introduction. Berkeley, CA: Apress; 2017. pp. 195–208.CrossRef
23.
go back to reference Japan Esophageal Socety. Japanese classification of esophageal cancer, 11th Edition: part I. Esophagus. 2017;14:1–36.CrossRef Japan Esophageal Socety. Japanese classification of esophageal cancer, 11th Edition: part I. Esophagus. 2017;14:1–36.CrossRef
24.
go back to reference Ishihara R, Takeuchi Y, Chatani R, et al. Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists. Dis Esophagus. 2010;23:480–6.CrossRefPubMed Ishihara R, Takeuchi Y, Chatani R, et al. Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists. Dis Esophagus. 2010;23:480–6.CrossRefPubMed
25.
go back to reference Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’ for medical statistics. Bone Marrow Transplant. 2013;48:452–8.CrossRefPubMed Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’ for medical statistics. Bone Marrow Transplant. 2013;48:452–8.CrossRefPubMed
26.
go back to reference Iwatsubo T, Ishihara R, Yamasaki Y, et al. Narrow band imaging under less-air condition improves the visibility of superficial esophageal squamous cell carcinoma. BMC Gastroenterol. 2020;20:389.CrossRefPubMedPubMedCentral Iwatsubo T, Ishihara R, Yamasaki Y, et al. Narrow band imaging under less-air condition improves the visibility of superficial esophageal squamous cell carcinoma. BMC Gastroenterol. 2020;20:389.CrossRefPubMedPubMedCentral
27.
go back to reference Minami H, Inoue H, Ikeda H, et al. Usefulness of background coloration in detection of Esophago-Pharyngeal Lesions using NBI magnification. Gastroenterol Res Pract. 2012;2012:529782.CrossRefPubMedPubMedCentral Minami H, Inoue H, Ikeda H, et al. Usefulness of background coloration in detection of Esophago-Pharyngeal Lesions using NBI magnification. Gastroenterol Res Pract. 2012;2012:529782.CrossRefPubMedPubMedCentral
Metadata
Title
A single-center prospective study evaluating the usefulness of artificial intelligence for the diagnosis of esophageal squamous cell carcinoma in a real-time setting
Authors
Yasuhiro Tani
Ryu Ishihara
Takahiro Inoue
Yuki Okubo
Yushi Kawakami
Katsunori Matsueda
Muneaki Miyake
Shunsuke Yoshii
Satoki Shichijo
Takashi Kanesaka
Sachiko Yamamoto
Yoji Takeuchi
Koji Higashino
Noriya Uedo
Tomoki Michida
Yusuke Kato
Tomohiro Tada
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Gastroenterology / Issue 1/2023
Electronic ISSN: 1471-230X
DOI
https://doi.org/10.1186/s12876-023-02788-2

Other articles of this Issue 1/2023

BMC Gastroenterology 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.