Skip to main content
Top
Published in: Digestive Diseases and Sciences 3/2024

Open Access 20-01-2024 | Colonoscopy | Original Article

Spatio-Temporal Feature Transformation Based Polyp Recognition for Automatic Detection: Higher Accuracy than Novice Endoscopists in Colorectal Polyp Detection and Diagnosis

Authors: Jianhua Xu, Yaxian Kuai, Qianqian Chen, Xu Wang, Yihang Zhao, Bin Sun

Published in: Digestive Diseases and Sciences | Issue 3/2024

Login to get access

Abstract

Background

Artificial intelligence represents an emerging area with promising potential for improving colonoscopy quality.

Aims

To develop a colon polyp detection model using STFT and evaluate its performance through a randomized sample experiment.

Methods

Colonoscopy videos from the Digestive Endoscopy Center of the First Affiliated Hospital of Anhui Medical University, recorded between January 2018 and November 2022, were selected and divided into two datasets. To verify the model’s practical application in clinical settings, 1500 colonoscopy images and 1200 polyp images of various sizes were randomly selected from the test set and compared with the STFT model’s and endoscopists’ recognition results with different years of experience.

Results

In the randomized sample trial involving 1500 colonoscopy images, the STFT model demonstrated significantly higher accuracy and specificity compared to endoscopists with low years of experience (0.902 vs. 0.809, 0.898 vs. 0.826, respectively). Moreover, the model’s sensitivity was 0.904, which was higher than that of endoscopists with low, medium, or high years of experience (0.80, 0.896, 0.895, respectively), with statistical significance (P < 0.05). In the randomized sample experiment of 1200 polyp images of different sizes, the accuracy of the STFT model was significantly higher than that of endoscopists with low years of experience when the polyp size was ≤ 0.5 cm and 0.6-1.0 cm (0.902 vs. 0.70, 0.953 vs. 0.865, respectively).

Conclusions

The STFT-based colon polyp detection model exhibits high accuracy in detecting polyps in colonoscopy videos, with a particular efficiency in detecting small polyps (≤ 0.5 cm)(0.902 vs. 0.70, P < 0.001).
Appendix
Available only for authorised users
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRefPubMed Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRefPubMed
2.
go back to reference Feng RM, Zong YN, Cao SM, Xu RH. Current cancer situation in China: good or bad news from the 2018 Global Cancer Statistics? Cancer Commun (Lond). 2019;39:22.PubMed Feng RM, Zong YN, Cao SM, Xu RH. Current cancer situation in China: good or bad news from the 2018 Global Cancer Statistics? Cancer Commun (Lond). 2019;39:22.PubMed
3.
go back to reference Kaminski MF, Wieszczy P, Rupinski M, et al. Increased rate of adenoma detection associates with reduced risk of colorectal cancer and death. Gastroenterology. 2017;153:98–105.CrossRefPubMed Kaminski MF, Wieszczy P, Rupinski M, et al. Increased rate of adenoma detection associates with reduced risk of colorectal cancer and death. Gastroenterology. 2017;153:98–105.CrossRefPubMed
4.
go back to reference Kaminski MF, Regula J, Kraszewska E, et al. Quality indicators for colonoscopy and the risk of interval cancer. The NEW ENGLAND JOURNAL of MEDICINE. 2010;362:1795 – 17911803.CrossRefPubMed Kaminski MF, Regula J, Kraszewska E, et al. Quality indicators for colonoscopy and the risk of interval cancer. The NEW ENGLAND JOURNAL of MEDICINE. 2010;362:1795 – 1791­1803.CrossRefPubMed
5.
go back to reference Leufkens AM, van Oijen MG, Vleggaar FP, Siersema PD. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy. 2012;44:470–475.CrossRefPubMed Leufkens AM, van Oijen MG, Vleggaar FP, Siersema PD. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy. 2012;44:470–475.CrossRefPubMed
6.
go back to reference Mahmud N, Cohen J, Tsourides K, Berzin TM. Computer vision and augmented reality in gastrointestinal endoscopy. Gastroenterol Rep (Oxf). 2015;3:179–184.CrossRefPubMed Mahmud N, Cohen J, Tsourides K, Berzin TM. Computer vision and augmented reality in gastrointestinal endoscopy. Gastroenterol Rep (Oxf). 2015;3:179–184.CrossRefPubMed
7.
go back to reference El Hajjar A, Rey JF. Artificial intelligence in gastrointestinal endoscopy: general overview. Chin Med J (Engl). 2020;133:326–334.CrossRefPubMed El Hajjar A, Rey JF. Artificial intelligence in gastrointestinal endoscopy: general overview. Chin Med J (Engl). 2020;133:326–334.CrossRefPubMed
8.
go back to reference Wolfe JM, Reinecke A, Brawn P. Why don’t we see changes?: The role of attentional bottlenecks and limited visual memory. Vis cogn. 2006;14:749–780.CrossRefPubMedPubMedCentral Wolfe JM, Reinecke A, Brawn P. Why don’t we see changes?: The role of attentional bottlenecks and limited visual memory. Vis cogn. 2006;14:749–780.CrossRefPubMedPubMedCentral
9.
go back to reference Peters SL, Hasan AG, Jacobson NB, Austin GL. Level of fellowship training increases adenoma detection rates. Clin Gastroenterol Hepatol. 2010;8:439–442.CrossRefPubMed Peters SL, Hasan AG, Jacobson NB, Austin GL. Level of fellowship training increases adenoma detection rates. Clin Gastroenterol Hepatol. 2010;8:439–442.CrossRefPubMed
10.
go back to reference Lee CK, Cha JM, Kim WJ. Endoscopist fatigue may contribute to a decline in the effectiveness of screening colonoscopy. J Clin Gastroenterol. 2015;49:e51-e56.CrossRef Lee CK, Cha JM, Kim WJ. Endoscopist fatigue may contribute to a decline in the effectiveness of screening colonoscopy. J Clin Gastroenterol. 2015;49:e51-e56.CrossRef
11.
go back to reference Buchner AM, Shahid MW, Heckman MG, et al. Trainee participation is associated with increased small adenoma detection. Gastrointest Endosc. 2011;73:1223–1231.CrossRefPubMed Buchner AM, Shahid MW, Heckman MG, et al. Trainee participation is associated with increased small adenoma detection. Gastrointest Endosc. 2011;73:1223–1231.CrossRefPubMed
12.
go back to reference Lee CK, Park DI, Lee SH, et al. Participation by experienced endoscopy nurses increases the detection rate of colon polyps during a screening colonoscopy: a multicenter, prospective, randomized study. Gastrointest Endosc. 2011;74:1094–1102.CrossRefPubMed Lee CK, Park DI, Lee SH, et al. Participation by experienced endoscopy nurses increases the detection rate of colon polyps during a screening colonoscopy: a multicenter, prospective, randomized study. Gastrointest Endosc. 2011;74:1094–1102.CrossRefPubMed
13.
go back to reference Kim TS, Park DI, Lee DY, et al. Endoscopy nurse participation may increase the polyp detection rate by second-year fellows during screening colonoscopies. Gut Liver. 2012;6:344–348.CrossRefPubMedPubMedCentral Kim TS, Park DI, Lee DY, et al. Endoscopy nurse participation may increase the polyp detection rate by second-year fellows during screening colonoscopies. Gut Liver. 2012;6:344–348.CrossRefPubMedPubMedCentral
14.
go back to reference Wang P, Berzin TM, Glissen Brown JR, et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study. Gut. 2019;68:1813–1819.CrossRefPubMed Wang P, Berzin TM, Glissen Brown JR, et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study. Gut. 2019;68:1813–1819.CrossRefPubMed
15.
go back to reference Tischendorf JJ, Wasmuth HE, Koch A, Hecker H, Trautwein C, Winograd R. Value of magnifying chromoendoscopy and narrow band imaging (NBI) in classifying colorectal polyps: a prospective controlled study. Endoscopy. 2007;39:1092–1096.CrossRefPubMed Tischendorf JJ, Wasmuth HE, Koch A, Hecker H, Trautwein C, Winograd R. Value of magnifying chromoendoscopy and narrow band imaging (NBI) in classifying colorectal polyps: a prospective controlled study. Endoscopy. 2007;39:1092–1096.CrossRefPubMed
16.
go back to reference Pamudurthy V, Lodhia N, Konda VJA. Advances in endoscopy for colorectal polyp detection and classification. Proc (Bayl Univ Med Cent). 2020;33:28–35.PubMed Pamudurthy V, Lodhia N, Konda VJA. Advances in endoscopy for colorectal polyp detection and classification. Proc (Bayl Univ Med Cent). 2020;33:28–35.PubMed
17.
go back to reference Kim YS, Kim D, Chung SJ, et al. Differentiating small polyp histologies using real-time screening colonoscopy with Fuji intelligent color enhancement. Clin Gastroenterol Hepatol. 2011;9:744–749 e741.CrossRefPubMed Kim YS, Kim D, Chung SJ, et al. Differentiating small polyp histologies using real-time screening colonoscopy with Fuji intelligent color enhancement. Clin Gastroenterol Hepatol. 2011;9:744–749 e741.CrossRefPubMed
18.
go back to reference Buchner AM, Shahid MW, Heckman MG, et al. Comparison of probe-based confocal laser endomicroscopy with virtual chromoendoscopy for classification of colon polyps. Gastroenterology. 2010;138:834–842.CrossRefPubMed Buchner AM, Shahid MW, Heckman MG, et al. Comparison of probe-based confocal laser endomicroscopy with virtual chromoendoscopy for classification of colon polyps. Gastroenterology. 2010;138:834–842.CrossRefPubMed
19.
go back to reference Chen PJ, Lin MC, Lai MJ, Lin JC, Lu HH, Tseng VS. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology. 2018;154:568–575.CrossRefPubMed Chen PJ, Lin MC, Lai MJ, Lin JC, Lu HH, Tseng VS. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology. 2018;154:568–575.CrossRefPubMed
21.
go back to reference Haj-Manouchehri A, Mohammadi HM. Polyp detection using CNNs in colonoscopy video. IET Computer Vision. 2020;14:241–247.CrossRef Haj-Manouchehri A, Mohammadi HM. Polyp detection using CNNs in colonoscopy video. IET Computer Vision. 2020;14:241–247.CrossRef
22.
go back to reference Tang CP, Chen KH, Lin TL. Computer-aided colon polyp detection on high resolution colonoscopy using transfer learning techniques. Sensors (Basel). 2021;21. Tang CP, Chen KH, Lin TL. Computer-aided colon polyp detection on high resolution colonoscopy using transfer learning techniques. Sensors (Basel). 2021;21.
23.
go back to reference Jiang J, Xie Q, Cheng Z, et al. AI based colorectal disease detection using real-time screening colonoscopy. Precision Clinical Medicine. 2021;4:109–118.CrossRefPubMedPubMedCentral Jiang J, Xie Q, Cheng Z, et al. AI based colorectal disease detection using real-time screening colonoscopy. Precision Clinical Medicine. 2021;4:109–118.CrossRefPubMedPubMedCentral
24.
go back to reference Guo Z, Zhang R, Li Q, et al. Reduce false-positive rate by active learning for automatic polyp detection in colonoscopy videos. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI). 2020:1655–1658. Guo Z, Zhang R, Li Q, et al. Reduce false-positive rate by active learning for automatic polyp detection in colonoscopy videos. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI). 2020:1655–1658.
25.
go back to reference Wan J, Chen B, Yu Y. Polyp detection from colorectum images by using attentive YOLOv5. Diagnostics (Basel). 2021;11. Wan J, Chen B, Yu Y. Polyp detection from colorectum images by using attentive YOLOv5. Diagnostics (Basel). 2021;11.
26.
go back to reference Wang P, Xiao X, Glissen Brown JR, et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat Biomed Eng. 2018;2:741–748.CrossRefPubMed Wang P, Xiao X, Glissen Brown JR, et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat Biomed Eng. 2018;2:741–748.CrossRefPubMed
27.
go back to reference Borgli H, Thambawita V, Smedsrud PH, et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci Data. 2020;7:283.CrossRefPubMedPubMedCentral Borgli H, Thambawita V, Smedsrud PH, et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci Data. 2020;7:283.CrossRefPubMedPubMedCentral
29.
go back to reference Ting DSW, Cheung CY, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318:2211–2223.CrossRefPubMedPubMedCentral Ting DSW, Cheung CY, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318:2211–2223.CrossRefPubMedPubMedCentral
30.
go back to reference Calderaro J, Kather JN. Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers. Gut. 2021;70:1183–1193.CrossRefPubMed Calderaro J, Kather JN. Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers. Gut. 2021;70:1183–1193.CrossRefPubMed
31.
go back to reference Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S. Liver fibrosis: deep convolutional neural network for staging by using gadoxetic acid-enhanced hepatobiliary phase MR images. Radiology. 2018;287:146–155.CrossRefPubMed Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S. Liver fibrosis: deep convolutional neural network for staging by using gadoxetic acid-enhanced hepatobiliary phase MR images. Radiology. 2018;287:146–155.CrossRefPubMed
32.
33.
go back to reference Jin J, Zhang Q, Dong B, et al. Automatic detection of early gastric cancer in endoscopy based on Mask region-based convolutional neural networks (Mask R-CNN)(with video). Front Oncol. 2022;12:927868.CrossRefPubMedPubMedCentral Jin J, Zhang Q, Dong B, et al. Automatic detection of early gastric cancer in endoscopy based on Mask region-based convolutional neural networks (Mask R-CNN)(with video). Front Oncol. 2022;12:927868.CrossRefPubMedPubMedCentral
Metadata
Title
Spatio-Temporal Feature Transformation Based Polyp Recognition for Automatic Detection: Higher Accuracy than Novice Endoscopists in Colorectal Polyp Detection and Diagnosis
Authors
Jianhua Xu
Yaxian Kuai
Qianqian Chen
Xu Wang
Yihang Zhao
Bin Sun
Publication date
20-01-2024
Publisher
Springer US
Published in
Digestive Diseases and Sciences / Issue 3/2024
Print ISSN: 0163-2116
Electronic ISSN: 1573-2568
DOI
https://doi.org/10.1007/s10620-024-08277-0

Other articles of this Issue 3/2024

Digestive Diseases and Sciences 3/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine