Skip to main content
Key Specialties
Anesthesiology Cardiology Dermatology Diabetology Endocrinology Gastroenterology and Hepatology General Medicine Geriatrics Hematology Infectious Diseases Internal Medicine Nephrology Neurology Obstetrics and Gynecology Oncology Ophthalmology Pediatrics Psychiatry Radiology Respiratory Medicine Rheumatology Surgery Urology
Congress Coverage
ASH 2024 Annual Meeting 2024 ESMO Congress 2024 ERS Congress 2024 EASD Congress 2024 ESC Congress 2024 EAN Congress 2024 ASCO Annual Meeting 2024 ACC Congress
Clinical Collections
Advances in Alzheimer’s

Podcast | Sexual health in older age

Dr Holly Thomas helps us unpack the needlessly taboo subject of sex and sexual health in women of older age.

Listen now
ADVANCED SEARCH
Log in
Top
Surgical Endoscopy

12-03-2025 | Artificial Intelligence

Artificial intelligence-based automated surgical workflow recognition in esophageal endoscopic submucosal dissection: an international multicenter study (with video)

Authors: Ruide Liu, Xianglei Yuan, Kaide Huang, Tingfa Peng, Pavel V. Pavlov, Wanhong Zhang, Chuncheng Wu, Kseniia V. Feoktistova, Xiaogang Bi, Yan Zhang, Xin Chen, Jeffey George, Shuang Liu, Wei Liu, Yuhang Zhang, Juliana Yang, Maoyin Pang, Bing Hu, Zhang Yi, Liansong Ye

Published in: Surgical Endoscopy

Login to get access

Abstract

Background

Endoscopic submucosal dissection (ESD) is a crucial yet challenging multi-phase procedure for treating early gastrointestinal cancers. This study developed an artificial intelligence (AI)-based automated surgical workflow recognition model for esophageal ESD and proposed an innovative training program based on esophageal ESD videos with or without AI labels to evaluate its effectiveness for trainees.

Methods

We retrospectively analyzed complete ESD videos collected from seven hospitals worldwide between 2016 and 2024. The ESD surgical workflow was divided into 6 phases and these videos were divided into five datasets for AI model. Trainees were invited to participate in this multimedia training program and were assigned to the AI or control group randomly. The performance of the AI model and label testing were evaluated using the accuracy.

Results

A total of 195 ESD videos (782,488 s, 9268 phases) were included. The AI model achieved accuracy of 92.08% (95% confidence interval (CI), 91.40–92.76%), 91.71% (95% CI 90.11–93.31%), and 89.84% (95% CI 87.42–92.25%) in the training, internal, and external test dataset (esophagus), respectively. It also achieved acceptable results in the external test dataset (stomach, colorectum). For the training program, the overall label testing accuracy of the AI group learning ESD videos with AI labels was 88.73 ± 2.97%, significantly higher than the control group without AI labels (81.51 ± 4.63%, P < 0.001).

Conclusion

The AI model achieved high accuracy in the large ESD video datasets. The training program improves understanding of the complexity of ESD workflow and demonstrates the program’s effectiveness for trainees.

Graphical Abstract

Appendix
Available only for authorised users
Literature
1.
Oyama T, Tomori A, Hotta K et al (2005) Endoscopic submucosal dissection of early esophageal cancer. Clin Gastroenterol Hepatol 3(7 Suppl 1):S67–S70CrossRefPubMed
2.
Beaufort IN, Frederiks CN, Overwater A et al (2024) Endoscopic submucosal dissection for early esophageal squamous cell carcinoma: long-term results from a Western cohort. Endoscopy 56(5):325–333CrossRefPubMedPubMedCentral
3.
Libânio D, Pimentel-Nunes P, Bastiaansen B et al (2023) Endoscopic submucosal dissection techniques and technology: European Society of Gastrointestinal Endoscopy (ESGE) technical review. Endoscopy 55(4):361–389CrossRefPubMed
4.
Forbes N, Elhanafi SE, Al-Haddad MA et al (2023) American Society for Gastrointestinal Endoscopy guideline on endoscopic submucosal dissection for the management of early esophageal and gastric cancers: summary and recommendations. Gastrointest Endosc 98(3):271–284CrossRefPubMed
5.
di Pietro M, Canto MI, Fitzgerald RC (2018) Endoscopic management of early adenocarcinoma and squamous cell carcinoma of the esophagus: screening, diagnosis, and therapy. Gastroenterology 154(2):421–436CrossRefPubMed
6.
Saito Y, Bhatt A, Matsuda T (2017) Colorectal endoscopic submucosal dissection and its journey to the West. Gastrointest Endosc 86(1):90–92CrossRefPubMed
7.
Aihara H, Dacha S, Anand GS et al (2021) Core curriculum for endoscopic submucosal dissection (ESD). Gastrointest Endosc 93(6):1215–1221CrossRefPubMed
8.
Pioche M, Rivory J, Nishizawa T et al (2016) Randomized comparative evaluation of endoscopic submucosal dissection self-learning software in France and Japan. Endoscopy 48(12):1076–1083CrossRefPubMed
9.
Uedo N, Jung HY, Fujishiro M et al (2012) Current situation of endoscopic submucosal dissection for superficial neoplasms in the upper digestive tract in East Asian countries: a questionnaire survey. Dig Endosc 24(Suppl 1):124–128CrossRefPubMed
10.
Pimentel-Nunes P, Pioche M, Albéniz E et al (2019) Curriculum for endoscopic submucosal dissection training in Europe: European Society of Gastrointestinal Endoscopy (ESGE) position statement. Endoscopy 51(10):980–992CrossRefPubMed
11.
Zhang X, Ly EK, Nithyanand S et al (2020) Learning curve for endoscopic submucosal dissection with an untutored, prevalence-based approach in the United States. Clin Gastroenterol Hepatol 18(3):580-588.e581CrossRefPubMed
12.
Hadjinicolaou AV, Pappas A, Sujendran V et al (2024) Untutored training pathway to achieve competence in esophagogastric endoscopic submucosal dissection in a Western center. Gastrointest Endosc 99(3):439-443.e436CrossRefPubMed
13.
Berr F, Ponchon T, Neureiter D et al (2011) Experimental endoscopic submucosal dissection training in a porcine model: learning experience of skilled Western endoscopists. Dig Endosc 23(4):281–289CrossRefPubMed
14.
Cao J, Yip HC, Chen Y et al (2023) Intelligent surgical workflow recognition for endoscopic submucosal dissection with real-time animal study. Nat Commun 14(1):6676CrossRefPubMedPubMedCentral
15.
Furube T, Takeuchi M, Kawakubo H et al (2024) Automated artificial intelligence-based phase-recognition system for esophageal endoscopic submucosal dissection (with video). Gastrointest Endosc 99(5):830–838CrossRefPubMed
16.
Igaki T, Kitaguchi D, Matsuzaki H et al (2023) Automatic surgical skill assessment system based on concordance of standardized surgical field development using artificial intelligence. JAMA Surg 158(8):e231131CrossRefPubMedPubMedCentral
17.
Garrow CR, Kowalewski KF, Li L et al (2021) Machine learning for surgical phase recognition: a systematic review. Ann Surg 273(4):684–693CrossRefPubMed
18.
Cheng K, You J, Wu S et al (2022) Artificial intelligence-based automated laparoscopic cholecystectomy surgical phase recognition and analysis. Surg Endosc 36(5):3160–3168CrossRefPubMed
19.
Kitaguchi D, Takeshita N, Matsuzaki H et al (2020) Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: experimental research. Int J Surg 79:88–94CrossRefPubMed
20.
Kitaguchi D, Takeshita N, Matsuzaki H et al (2020) Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach. Surg Endosc 34(11):4924–4931CrossRefPubMed
21.
He J, Chen WQ, Li ZS et al (2022) China guideline for the screening, early detection and early treatment of esophageal cancer (2022, Beijing). Zhonghua Zhong Liu Za Zhi 44(6):491–522PubMed
22.
Wagh MS, Wani SB. (2020) Gastrointestinal interventional endoscopy advanced techniques: advanced techniques. Springer Nature Switzerland AG, Cham.
23.
Fujishiro M, Kodashima S, Goto O et al (2009) Endoscopic submucosal dissection for esophageal squamous cell neoplasms. Dig Endosc 21(2):109–115CrossRefPubMed
24.
Tsou YK, Chuang WY, Liu CY et al (2016) Learning curve for endoscopic submucosal dissection of esophageal neoplasms. Dis Esophagus 29(6):544–550CrossRefPubMed
25.
Oda I, Odagaki T, Suzuki H et al (2012) Learning curve for endoscopic submucosal dissection of early gastric cancer based on trainee experience. Dig Endosc 24(Suppl 1):129–132CrossRefPubMed
26.
Hotta K, Oyama T, Shinohara T et al (2010) Learning curve for endoscopic submucosal dissection of large colorectal tumors. Dig Endosc 22(4):302–306CrossRefPubMed
27.
Ward TM, Hashimoto DA, Ban Y et al (2021) Automated operative phase identification in peroral endoscopic myotomy. Surg Endosc 35(7):4008–4015CrossRefPubMed
28.
Chadebecq F, Lovat LB, Stoyanov D (2023) Artificial intelligence and automation in endoscopy and surgery. Nat Rev Gastroenterol Hepatol 20(3):171–182CrossRefPubMed
Metadata
Title
Artificial intelligence-based automated surgical workflow recognition in esophageal endoscopic submucosal dissection: an international multicenter study (with video)
Authors
Ruide Liu
Xianglei Yuan
Kaide Huang
Tingfa Peng
Pavel V. Pavlov
Wanhong Zhang
Chuncheng Wu
Kseniia V. Feoktistova
Xiaogang Bi
Yan Zhang
Xin Chen
Jeffey George
Shuang Liu
Wei Liu
Yuhang Zhang
Juliana Yang
Maoyin Pang
Bing Hu
Zhang Yi
Liansong Ye
Publication date
12-03-2025
Publisher
Springer US
Published in
Surgical Endoscopy
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-025-11644-1
SPONSORED

Mastering chronic pancreatitis pain: A multidisciplinary approach and practical solutions

Severe pain is the most common symptom of chronic pancreatitis. In this webinar, experts share the latest insights in pain management for chronic pancreatitis patients. Experts from a range of disciplines discuss pertinent cases and provide practical suggestions for use within clinical practice.

Sponsored by:
  • Viatris
Developed by: Springer Healthcare
Watch now
Video
Image Credits