Skip to main content
Top
Published in: Digestive Diseases and Sciences 2/2023

10-08-2022 | Endoscopy | Original Article

Accuracy and Inter-observer Agreement Among Endoscopists for Visual Identification of Colorectal Polyps Using Endoscopy Images

Authors: Thi Khuc, Amol Agarwal, Feng Li, Sergey Kantsevoy, Bryan Curtin, Matilda Hagan, Mary Harris, Anurag Maheshwari, Amit Raina, Elinor Zhou, Paul Thuluvath

Published in: Digestive Diseases and Sciences | Issue 2/2023

Login to get access

Abstract

Background

It is essential to accurately distinguish small benign hyperplastic colon polyps (HP) from sessile serrated lesions (SSL) or adenomatous polyps (TA) based on endoscopic appearances. Our objective was to determine the accuracy and inter-observer agreements for the endoscopic diagnosis of small polyps.

Methods

High-quality endoscopic images of 30 small HPs, SSLs, and TAs were used randomly to create two-timed PowerPoint slide sets—one with and another one without information on polyp size and location. Seven endoscopists viewed the slides on two separate occasions 90 days apart, identified the polyp type, and graded their confidence level. Overall and polyp-specific accuracies were assessed for the group and individual endoscopists. Chi-square tests and Kappa (κ) statistics were used to compare differences as appropriate.

Results

When polyp size and location were provided, overall accuracy was 67.1% for TAs, 50.0% for SSLs, and 41.4% for HPs; the corresponding accuracies were 60%, 44.3%, and 34.3% when polyp size and location were withheld (p < .001). Inter-observer agreement was moderate for TAs (κ = 0.50) and fair for SSLs (κ = 0.26) and HPs (κ = 0.29); the corresponding inter-observer agreements were 0.44, 0.31, and 0.17 with polyp size and location withheld. Accuracy was not affected by knowledge of polyp size, location, or confidence level. Endoscopists with ≥ 10 years (vs. < 10 years) of colonoscopy experience had marginally higher (56% vs. 40%, p = 0.05) accuracy for SSL diagnosis.

Conclusions

The ability to distinguish between small TAs, SSLs, and HPs on their endoscopic appearance is poor regardless of the endoscopists' knowledge of polyp size and location.
Appendix
Available only for authorised users
Literature
1.
go back to reference Zauber AG, Winawer SJ, O’Brien MJ et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med. 2012;366:687–696.CrossRef Zauber AG, Winawer SJ, O’Brien MJ et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med. 2012;366:687–696.CrossRef
2.
go back to reference Kaltenbach T, Anderson JC, Burke CA et al. Endoscopic Removal of Colorectal Lesions: Recommendations by the US Multi-Society Task Force on Colorectal Cancer. Am J Gastroenterol. 2020;115:435–464.CrossRef Kaltenbach T, Anderson JC, Burke CA et al. Endoscopic Removal of Colorectal Lesions: Recommendations by the US Multi-Society Task Force on Colorectal Cancer. Am J Gastroenterol. 2020;115:435–464.CrossRef
3.
go back to reference Wang FW, Hsu PI, Chuang HY et al. Prevalence and risk factors of asymptomatic colorectal polyps in Taiwan. Gastroenterol Res Pract. 2014;2014:985205.CrossRef Wang FW, Hsu PI, Chuang HY et al. Prevalence and risk factors of asymptomatic colorectal polyps in Taiwan. Gastroenterol Res Pract. 2014;2014:985205.CrossRef
4.
go back to reference Spring KJ, Zhao ZZ, Karamatic R et al. High prevalence of sessile serrated adenomas with BRAF mutations: a prospective study of patients undergoing colonoscopy. Gastroenterology. 2006;131:1400–1407.CrossRef Spring KJ, Zhao ZZ, Karamatic R et al. High prevalence of sessile serrated adenomas with BRAF mutations: a prospective study of patients undergoing colonoscopy. Gastroenterology. 2006;131:1400–1407.CrossRef
5.
go back to reference Crockett SD, Nagtegaal ID. Terminology, Molecular Features, Epidemiology, and Management of Serrated Colorectal Neoplasia. Gastroenterology. 2019;157:949–966.CrossRef Crockett SD, Nagtegaal ID. Terminology, Molecular Features, Epidemiology, and Management of Serrated Colorectal Neoplasia. Gastroenterology. 2019;157:949–966.CrossRef
6.
go back to reference Szylberg Ł, Janiczek M, Popiel A, Marszałek A. Large Bowel Genetic Background and Inflammatory Processes in Carcinogenesis-Systematic Review. Adv Clin Exp Med. 2015;24:555–563.CrossRef Szylberg Ł, Janiczek M, Popiel A, Marszałek A. Large Bowel Genetic Background and Inflammatory Processes in Carcinogenesis-Systematic Review. Adv Clin Exp Med. 2015;24:555–563.CrossRef
7.
go back to reference Myers DJ, Arora K. Villous Adenoma. In: StatPearls. Treasure Island (FL): StatPearls Publishing; September 10, 2021. Myers DJ, Arora K. Villous Adenoma. In: StatPearls. Treasure Island (FL): StatPearls Publishing; September 10, 2021.
8.
go back to reference Hamilton SR, Aaltonen LA. World Health Organization Classification of Tumours. Pathology and Genetics of Tumours of the Digestive System. 3rd ed. IARC Press; 2000. Hamilton SR, Aaltonen LA. World Health Organization Classification of Tumours. Pathology and Genetics of Tumours of the Digestive System. 3rd ed. IARC Press; 2000.
9.
go back to reference Rex DK, Ahnen DJ, Baron JA et al. Serrated lesions of the colorectum: review and recommendations from an expert panel. Am J Gastroenterol. 2012;107:1315–1330.CrossRef Rex DK, Ahnen DJ, Baron JA et al. Serrated lesions of the colorectum: review and recommendations from an expert panel. Am J Gastroenterol. 2012;107:1315–1330.CrossRef
10.
go back to reference McCarthy AJ, O’Reilly SM, Shanley J et al. Colorectal Serrated Neoplasia: An Institutional 12-Year Review Highlights the Impact of a Screening Programme. Gastroenterol Res Pract. 2019;2019:1592306.CrossRef McCarthy AJ, O’Reilly SM, Shanley J et al. Colorectal Serrated Neoplasia: An Institutional 12-Year Review Highlights the Impact of a Screening Programme. Gastroenterol Res Pract. 2019;2019:1592306.CrossRef
11.
go back to reference Burgess NG, Tutticci NJ, Pellise M, Bourke MJ. Sessile serrated adenomas/polyps with cytologic dysplasia: a triple threat for interval cancer. Gastrointest Endosc. 2014;80:307–310.CrossRef Burgess NG, Tutticci NJ, Pellise M, Bourke MJ. Sessile serrated adenomas/polyps with cytologic dysplasia: a triple threat for interval cancer. Gastrointest Endosc. 2014;80:307–310.CrossRef
12.
go back to reference Kim SY, Kim TI. Serrated neoplasia pathway as an alternative route of colorectal cancer carcinogenesis. Intest Res. 2018;16:358–365.CrossRef Kim SY, Kim TI. Serrated neoplasia pathway as an alternative route of colorectal cancer carcinogenesis. Intest Res. 2018;16:358–365.CrossRef
13.
go back to reference Tadepalli US, Feihel D, Miller KM et al. A morphologic analysis of sessile serrated polyps observed during routine colonoscopy (with video). Gastrointest Endosc. 2011;74:1360–1368.CrossRef Tadepalli US, Feihel D, Miller KM et al. A morphologic analysis of sessile serrated polyps observed during routine colonoscopy (with video). Gastrointest Endosc. 2011;74:1360–1368.CrossRef
14.
go back to reference Ahadi M, Sokolova A, Brown I, Chou A, Gill AJ. The 2019 World Health Organization Classification of appendiceal, colorectal and anal canal tumours: an update and critical assessment. Pathology. 2021;53:454–461.CrossRef Ahadi M, Sokolova A, Brown I, Chou A, Gill AJ. The 2019 World Health Organization Classification of appendiceal, colorectal and anal canal tumours: an update and critical assessment. Pathology. 2021;53:454–461.CrossRef
15.
go back to reference Yamada M, Sakamoto T, Otake Y et al. Investigating endoscopic features of sessile serrated adenomas/polyps by using narrow-band imaging with optical magnification. Gastrointest Endosc. 2015;82:108–117.CrossRef Yamada M, Sakamoto T, Otake Y et al. Investigating endoscopic features of sessile serrated adenomas/polyps by using narrow-band imaging with optical magnification. Gastrointest Endosc. 2015;82:108–117.CrossRef
16.
go back to reference Vleugels JLA, Hazewinkel Y, Fockens P, Dekker E. Natural history of diminutive and small colorectal polyps: a systematic literature review. Gastrointest Endosc. 2017;85:1169–1176.CrossRef Vleugels JLA, Hazewinkel Y, Fockens P, Dekker E. Natural history of diminutive and small colorectal polyps: a systematic literature review. Gastrointest Endosc. 2017;85:1169–1176.CrossRef
17.
go back to reference Rex DK, Kahi C, O’Brien M et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc. 2011;73:419–422.CrossRef Rex DK, Kahi C, O’Brien M et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc. 2011;73:419–422.CrossRef
18.
go back to reference Yang HJ, Lee JI, Park SK et al. External Validation of the Endoscopic Features of Sessile Serrated Adenomas in Expert and Trainee Colonoscopists. Clin Endosc. 2017;50:279–286.CrossRef Yang HJ, Lee JI, Park SK et al. External Validation of the Endoscopic Features of Sessile Serrated Adenomas in Expert and Trainee Colonoscopists. Clin Endosc. 2017;50:279–286.CrossRef
20.
go back to reference Kaminski M, Hassan C, Bisschops R et al. Advanced imaging for detection and differentiation of colorectal neoplasia: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy. 2014;46:435–449.CrossRef Kaminski M, Hassan C, Bisschops R et al. Advanced imaging for detection and differentiation of colorectal neoplasia: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy. 2014;46:435–449.CrossRef
21.
go back to reference Bhat Y, Abu Dayyeh B, Chauhan S et al. ASGE Technological Status Evaluation Report: High-definition and high-magnification endoscopes. Gastrointestinal Endoscopy. 2014;80:919–927.CrossRef Bhat Y, Abu Dayyeh B, Chauhan S et al. ASGE Technological Status Evaluation Report: High-definition and high-magnification endoscopes. Gastrointestinal Endoscopy. 2014;80:919–927.CrossRef
22.
go back to reference Gupta N, Kaltenbach T, Sato T et al. Diagnosis time determines the accuracy of optical diagnosis of diminutive polyp histology. Gastrointest Endosc. 2013;77:AB553–AB554.CrossRef Gupta N, Kaltenbach T, Sato T et al. Diagnosis time determines the accuracy of optical diagnosis of diminutive polyp histology. Gastrointest Endosc. 2013;77:AB553–AB554.CrossRef
23.
go back to reference Anderson JC, Lisovsky M, Greene MA et al. Factors Associated With Classification of Hyperplastic Polyps as Sessile Serrated Adenomas/Polyps on Morphologic Review. J Clin Gastroenterol. 2018;52:524–529.CrossRef Anderson JC, Lisovsky M, Greene MA et al. Factors Associated With Classification of Hyperplastic Polyps as Sessile Serrated Adenomas/Polyps on Morphologic Review. J Clin Gastroenterol. 2018;52:524–529.CrossRef
24.
go back to reference Gill P, Rafferty H, Munday D et al. Proximal colon cancer and serrated adenomas - hunting the missing 10%. Clin Med (Lond). 2013;13:557–561.CrossRef Gill P, Rafferty H, Munday D et al. Proximal colon cancer and serrated adenomas - hunting the missing 10%. Clin Med (Lond). 2013;13:557–561.CrossRef
25.
go back to reference Singh H, Bay D, Ip S et al. Pathological reassessment of hyperplastic colon polyps in a city-wide pathology practice: implications for polyp surveillance recommendations. Gastrointest Endosc. 2012;76:1003–1008.CrossRef Singh H, Bay D, Ip S et al. Pathological reassessment of hyperplastic colon polyps in a city-wide pathology practice: implications for polyp surveillance recommendations. Gastrointest Endosc. 2012;76:1003–1008.CrossRef
26.
go back to reference Farris AB, Misdraji J, Srivastava A et al. Sessile serrated adenoma: challenging discrimination from other serrated colonic polyps. Am J Surg Pathol. 2008;32:30–35.CrossRef Farris AB, Misdraji J, Srivastava A et al. Sessile serrated adenoma: challenging discrimination from other serrated colonic polyps. Am J Surg Pathol. 2008;32:30–35.CrossRef
27.
go back to reference Vennelaganti S, Cuatrecasas M, Vennalaganti P et al. Interobserver Agreement Among Pathologists in the Differentiation of Sessile Serrated From Hyperplastic Polyps. Gastroenterology. 2021;160:452–454.CrossRef Vennelaganti S, Cuatrecasas M, Vennalaganti P et al. Interobserver Agreement Among Pathologists in the Differentiation of Sessile Serrated From Hyperplastic Polyps. Gastroenterology. 2021;160:452–454.CrossRef
28.
go back to reference Turner JK, Williams GT, Morgan M, Wright M, Dolwani S. Interobserver agreement in the reporting of colorectal polyp pathology among bowel cancer screening pathologists in Wales. Histopathology. 2013;62:916–924.CrossRef Turner JK, Williams GT, Morgan M, Wright M, Dolwani S. Interobserver agreement in the reporting of colorectal polyp pathology among bowel cancer screening pathologists in Wales. Histopathology. 2013;62:916–924.CrossRef
29.
go back to reference Hazewinkel Y, López-Cerón M, East JE et al. Endoscopic features of sessile serrated adenomas: validation by international experts using high-resolution white-light endoscopy and narrow-band imaging. Gastrointest Endosc. 2013;77:916–924.CrossRef Hazewinkel Y, López-Cerón M, East JE et al. Endoscopic features of sessile serrated adenomas: validation by international experts using high-resolution white-light endoscopy and narrow-band imaging. Gastrointest Endosc. 2013;77:916–924.CrossRef
30.
go back to reference Pereyra L, Gómez EJ, González R et al. Finding sessile serrated adenomas: is it possible to identify them during conventional colonoscopy? Dig Dis Sci. 2014;59:3021–3026.CrossRef Pereyra L, Gómez EJ, González R et al. Finding sessile serrated adenomas: is it possible to identify them during conventional colonoscopy? Dig Dis Sci. 2014;59:3021–3026.CrossRef
31.
go back to reference Ijspeert JE, Bastiaansen BA, van Leerdam ME et al. Development and validation of the WASP classification system for optical diagnosis of adenomas, hyperplastic polyps and sessile serrated adenomas/polyps. J. Gut. 2016;65:963–970.CrossRef Ijspeert JE, Bastiaansen BA, van Leerdam ME et al. Development and validation of the WASP classification system for optical diagnosis of adenomas, hyperplastic polyps and sessile serrated adenomas/polyps. J. Gut. 2016;65:963–970.CrossRef
32.
go back to reference Maratt JK, Dickens J, Schoenfeld PS et al. Factors Associated with Surveillance Adenoma and Sessile Serrated Polyp Detection Rates. Dig Dis Sci. 2017;62:3579–3585.CrossRef Maratt JK, Dickens J, Schoenfeld PS et al. Factors Associated with Surveillance Adenoma and Sessile Serrated Polyp Detection Rates. Dig Dis Sci. 2017;62:3579–3585.CrossRef
33.
go back to reference Telford J, Gondara L, Pi S, Gentile L, Enns R. Higher adenoma detection, sessile serrated lesion detection and proximal sessile serrated lesion detection are associated with physician specialty and performance on Direct Observation of Procedural Skills. BMJ Open Gastroenterol. 2021;8:e000677.CrossRef Telford J, Gondara L, Pi S, Gentile L, Enns R. Higher adenoma detection, sessile serrated lesion detection and proximal sessile serrated lesion detection are associated with physician specialty and performance on Direct Observation of Procedural Skills. BMJ Open Gastroenterol. 2021;8:e000677.CrossRef
34.
go back to reference Sarvepalli S, Garber A, Rothberg MB et al. Association of Adenoma and Proximal Sessile Serrated Polyp Detection Rate, s With Endoscopist. JAMA Surg. 2019;154:627–635.CrossRef Sarvepalli S, Garber A, Rothberg MB et al. Association of Adenoma and Proximal Sessile Serrated Polyp Detection Rate, s With Endoscopist. JAMA Surg. 2019;154:627–635.CrossRef
35.
go back to reference Rex DK. Narrow-band imaging without optical magnification for histologic analysis of colorectal polyps. Gastroenterology. 2009;136:1174–1181.CrossRef Rex DK. Narrow-band imaging without optical magnification for histologic analysis of colorectal polyps. Gastroenterology. 2009;136:1174–1181.CrossRef
36.
go back to reference Uraoka T, Higashi R, Horii J et al. Prospective evaluation of endoscopic criteria characteristic of sessile serrated adenomas/polyps. J Gastroenterol. 2015;50:555–563.CrossRef Uraoka T, Higashi R, Horii J et al. Prospective evaluation of endoscopic criteria characteristic of sessile serrated adenomas/polyps. J Gastroenterol. 2015;50:555–563.CrossRef
37.
go back to reference Vleugels JLA, Dijkgraaf MGW, Hazewinkel Y et al. Effects of Training and Feedback on Accuracy of Predicting Rectosigmoid Neoplastic Lesions and Selection of Surveillance Intervals by Endoscopists Performing Optical Diagnosis of Diminutive Polyps. Gastroenterology. 2018;154:1682–1693.CrossRef Vleugels JLA, Dijkgraaf MGW, Hazewinkel Y et al. Effects of Training and Feedback on Accuracy of Predicting Rectosigmoid Neoplastic Lesions and Selection of Surveillance Intervals by Endoscopists Performing Optical Diagnosis of Diminutive Polyps. Gastroenterology. 2018;154:1682–1693.CrossRef
Metadata
Title
Accuracy and Inter-observer Agreement Among Endoscopists for Visual Identification of Colorectal Polyps Using Endoscopy Images
Authors
Thi Khuc
Amol Agarwal
Feng Li
Sergey Kantsevoy
Bryan Curtin
Matilda Hagan
Mary Harris
Anurag Maheshwari
Amit Raina
Elinor Zhou
Paul Thuluvath
Publication date
10-08-2022
Publisher
Springer US
Published in
Digestive Diseases and Sciences / Issue 2/2023
Print ISSN: 0163-2116
Electronic ISSN: 1573-2568
DOI
https://doi.org/10.1007/s10620-022-07643-0

Other articles of this Issue 2/2023

Digestive Diseases and Sciences 2/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.