Skip to main content
Top
Published in: Esophagus 4/2017

01-10-2017 | Original Article

Poor inter-observer agreement on the endoscopic diagnosis of eosinophilic esophagitis among Japanese endoscopists

Authors: Daisuke Izumi, Norihisa Ishimura, Mayumi Okada, Hironobu Mikami, Eiko Okimoto, Masahito Aimi, Tsuyoshi Mishiro, Naoki Oshima, Shuichi Sato, Shunji Ishihara, Yoshikazu Kinoshita

Published in: Esophagus | Issue 4/2017

Login to get access

Abstract

Background

A variety of endoscopic findings are considered useful for the diagnosis of eosinophilic esophagitis (EoE). However, the diagnostic consistency among Japanese endoscopists for those findings has not been fully examined. The aim of this study was to investigate the inter- and intra-observer agreement for endoscopic findings suggesting EoE.

Methods

Forty endoscopists, including 20 with board certification from the Japan Gastroenterological Endoscopy Society (JGES), participated in this study. Initially, they examined 50 randomized white-light endoscopic images from 30 patients with EoE and 20 without EoE. Four weeks later, the same 50 endoscopic images were re-examined in a different random order. Inter- and intra-observer agreement was calculated using kappa statistics for multiple observers.

Results

The kappa coefficient of reliability [95% confidence interval (CI)] for all 40 endoscopists for diagnosis of EoE was 0.34 (0.33–0.35), indicating poor level of inter-observer agreement, while intra-observer agreement showed a moderate value of 0.52 (0.47–0.57). Among 4 possible endoscopic findings (linear furrows, concentric rings, edema, white exudates) for EoE, acceptable levels (kappa value >0.4) of inter- and intra-observer agreement were seen only for linear furrows. When the JGES board-certified and non-certified endoscopists were compared for successful diagnosis of EoE, the value was significantly higher for the board-certified group. However, the level of inter-observer agreement remained poor level.

Conclusion

We concluded that inter-observer agreement on the endoscopic diagnosis of EoE among Japanese endoscopists did not reach a clinically acceptable level.
Literature
1.
go back to reference Kinoshita Y, Ishimura N, Mishiro T, et al. Diagnosis and treatment of eosinophilic esophagitis in Japan. Esophagus. 2016;14:66–75.CrossRef Kinoshita Y, Ishimura N, Mishiro T, et al. Diagnosis and treatment of eosinophilic esophagitis in Japan. Esophagus. 2016;14:66–75.CrossRef
3.
go back to reference Arias A, Perez-Martinez I, Tenias JM, et al. Systematic review with meta-analysis: the incidence and prevalence of eosinophilic oesophagitis in children and adults in population-based studies. Aliment Pharmacol Ther. 2016;43:3–15.CrossRefPubMed Arias A, Perez-Martinez I, Tenias JM, et al. Systematic review with meta-analysis: the incidence and prevalence of eosinophilic oesophagitis in children and adults in population-based studies. Aliment Pharmacol Ther. 2016;43:3–15.CrossRefPubMed
4.
6.
go back to reference Oshima N, Ishihara S, Fukuba N, et al. Epidermal differentiation complex protein involucrin is down-regulated in eosinophilic esophagitis. Esophagus. 2017;14:171–7.CrossRef Oshima N, Ishihara S, Fukuba N, et al. Epidermal differentiation complex protein involucrin is down-regulated in eosinophilic esophagitis. Esophagus. 2017;14:171–7.CrossRef
7.
go back to reference Kinoshita Y, Furuta K, Ishimura N, et al. Clinical characteristics of Japanese patients with eosinophilic esophagitis and eosinophilic gastroenteritis. J Gastroenterol. 2013;48:333–9.CrossRefPubMed Kinoshita Y, Furuta K, Ishimura N, et al. Clinical characteristics of Japanese patients with eosinophilic esophagitis and eosinophilic gastroenteritis. J Gastroenterol. 2013;48:333–9.CrossRefPubMed
8.
go back to reference Dellon ES, Rusin S, Gebhart JH, et al. Utility of a noninvasive serum biomarker panel for diagnosis and monitoring of eosinophilic esophagitis: a prospective study. Am J Gastroenterol. 2015;110:821–7.CrossRefPubMedPubMedCentral Dellon ES, Rusin S, Gebhart JH, et al. Utility of a noninvasive serum biomarker panel for diagnosis and monitoring of eosinophilic esophagitis: a prospective study. Am J Gastroenterol. 2015;110:821–7.CrossRefPubMedPubMedCentral
9.
go back to reference Kinoshita Y, Furuta K, Ishimura N, et al. Elevated plasma cytokines in Japanese patients with eosinophilic esophagitis and gastroenteritis. Digestion. 2012;86:238–43.CrossRefPubMed Kinoshita Y, Furuta K, Ishimura N, et al. Elevated plasma cytokines in Japanese patients with eosinophilic esophagitis and gastroenteritis. Digestion. 2012;86:238–43.CrossRefPubMed
10.
go back to reference Dellon ES, Gonsalves N, Hirano I, et al. ACG clinical guideline: evidenced based approach to the diagnosis and management of esophageal eosinophilia and eosinophilic esophagitis (EoE). Am J Gastroenterol. 2013;108:679–92.CrossRefPubMed Dellon ES, Gonsalves N, Hirano I, et al. ACG clinical guideline: evidenced based approach to the diagnosis and management of esophageal eosinophilia and eosinophilic esophagitis (EoE). Am J Gastroenterol. 2013;108:679–92.CrossRefPubMed
11.
go back to reference Liacouras CA, Furuta GT, Hirano I, et al. Eosinophilic esophagitis: updated consensus recommendations for children and adults. J Allergy Clin Immunol. 2011;128:3–20.CrossRefPubMed Liacouras CA, Furuta GT, Hirano I, et al. Eosinophilic esophagitis: updated consensus recommendations for children and adults. J Allergy Clin Immunol. 2011;128:3–20.CrossRefPubMed
12.
go back to reference Hirano I, Moy N, Heckman MG, et al. Endoscopic assessment of the oesophageal features of eosinophilic oesophagitis: validation of a novel classification and grading system. Gut. 2013;62:489–95.CrossRefPubMed Hirano I, Moy N, Heckman MG, et al. Endoscopic assessment of the oesophageal features of eosinophilic oesophagitis: validation of a novel classification and grading system. Gut. 2013;62:489–95.CrossRefPubMed
13.
go back to reference Kim HP, Vance RB, Shaheen NJ, et al. The prevalence and diagnostic utility of endoscopic features of eosinophilic esophagitis: a meta-analysis. Clin Gastroenterol Hepatol. 2012;10:988–96.CrossRefPubMedPubMedCentral Kim HP, Vance RB, Shaheen NJ, et al. The prevalence and diagnostic utility of endoscopic features of eosinophilic esophagitis: a meta-analysis. Clin Gastroenterol Hepatol. 2012;10:988–96.CrossRefPubMedPubMedCentral
14.
go back to reference Salek J, Clayton F, Vinson L, et al. Endoscopic appearance and location dictate diagnostic yield of biopsies in eosinophilic esophagitis. Aliment Pharmacol Ther. 2015;41:1288–95.CrossRefPubMed Salek J, Clayton F, Vinson L, et al. Endoscopic appearance and location dictate diagnostic yield of biopsies in eosinophilic esophagitis. Aliment Pharmacol Ther. 2015;41:1288–95.CrossRefPubMed
15.
go back to reference Shimura S, Ishimura N, Tanimura T, et al. Reliability of symptoms and endoscopic findings for diagnosis of esophageal eosinophilia in a Japanese population. Digestion. 2014;90:49–57.CrossRefPubMed Shimura S, Ishimura N, Tanimura T, et al. Reliability of symptoms and endoscopic findings for diagnosis of esophageal eosinophilia in a Japanese population. Digestion. 2014;90:49–57.CrossRefPubMed
16.
go back to reference van Rhijn BD, Warners MJ, Curvers WL, et al. Evaluating the endoscopic reference score for eosinophilic esophagitis: moderate to substantial intra- and interobserver reliability. Endoscopy. 2014;46:1049–55.CrossRefPubMed van Rhijn BD, Warners MJ, Curvers WL, et al. Evaluating the endoscopic reference score for eosinophilic esophagitis: moderate to substantial intra- and interobserver reliability. Endoscopy. 2014;46:1049–55.CrossRefPubMed
17.
go back to reference Peery AF, Cao H, Dominik R, et al. Variable reliability of endoscopic findings with white-light and narrow-band imaging for patients with suspected eosinophilic esophagitis. Clin Gastroenterol Hepatol. 2011;9:475–80.CrossRefPubMedPubMedCentral Peery AF, Cao H, Dominik R, et al. Variable reliability of endoscopic findings with white-light and narrow-band imaging for patients with suspected eosinophilic esophagitis. Clin Gastroenterol Hepatol. 2011;9:475–80.CrossRefPubMedPubMedCentral
18.
go back to reference Cohen J. A Coefficient of Agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef Cohen J. A Coefficient of Agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef
19.
go back to reference Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychol Bull. 1979;86:974–7.CrossRef Fleiss JL, Nee JC, Landis JR. Large sample variance of kappa in the case of different sets of raters. Psychol Bull. 1979;86:974–7.CrossRef
20.
go back to reference Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci. 1986;1:54–75.CrossRef Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci. 1986;1:54–75.CrossRef
21.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
22.
go back to reference Straumann A, Rossi L, Simon HU, et al. Fragility of the esophageal mucosa: a pathognomonic endoscopic sign of primary eosinophilic esophagitis? Gastrointest Endosc. 2003;57:407–12.CrossRefPubMed Straumann A, Rossi L, Simon HU, et al. Fragility of the esophageal mucosa: a pathognomonic endoscopic sign of primary eosinophilic esophagitis? Gastrointest Endosc. 2003;57:407–12.CrossRefPubMed
23.
go back to reference Dellon ES, Gebhart JH, Higgins LL, et al. The esophageal biopsy “pull” sign: a highly specific and treatment-responsive endoscopic finding in eosinophilic esophagitis (with video). Gastrointest Endosc. 2016;83:92–100.CrossRefPubMed Dellon ES, Gebhart JH, Higgins LL, et al. The esophageal biopsy “pull” sign: a highly specific and treatment-responsive endoscopic finding in eosinophilic esophagitis (with video). Gastrointest Endosc. 2016;83:92–100.CrossRefPubMed
24.
go back to reference Okimoto E, Ishimura N, Okada M, et al. Specific locations of linear furrows in patients with esophageal eosinophilia. Dig Endosc. 2017;29:49–56.CrossRefPubMed Okimoto E, Ishimura N, Okada M, et al. Specific locations of linear furrows in patients with esophageal eosinophilia. Dig Endosc. 2017;29:49–56.CrossRefPubMed
25.
go back to reference Katsube T, Adachi K, Furuta K, et al. Difference in localization of esophageal mucosal breaks among grades of esophagitis. J Gastroenterol Hepatol. 2006;21:1656–9.CrossRefPubMed Katsube T, Adachi K, Furuta K, et al. Difference in localization of esophageal mucosal breaks among grades of esophagitis. J Gastroenterol Hepatol. 2006;21:1656–9.CrossRefPubMed
26.
go back to reference Ishimura N, Amano Y, Uno G, et al. Endoscopic characteristics of short-segment Barrett’s esophagus, focusing on squamous islands and mucosal folds. J Gastroenterol Hepatol. 2012;27(Suppl 3):82–7.CrossRefPubMed Ishimura N, Amano Y, Uno G, et al. Endoscopic characteristics of short-segment Barrett’s esophagus, focusing on squamous islands and mucosal folds. J Gastroenterol Hepatol. 2012;27(Suppl 3):82–7.CrossRefPubMed
27.
go back to reference Mann NS, Leung JW. Pathogenesis of esophageal rings in eosinophilic esophagitis. Med Hypotheses. 2005;64:520–3.CrossRefPubMed Mann NS, Leung JW. Pathogenesis of esophageal rings in eosinophilic esophagitis. Med Hypotheses. 2005;64:520–3.CrossRefPubMed
28.
go back to reference Adachi K, Mishiro T, Tanaka S, et al. Suitable biopsy site for detection of esophageal eosinophilia in eosinophilic esophagitis suspected cases. Dig Endosc. 2016;28:139–44.CrossRefPubMed Adachi K, Mishiro T, Tanaka S, et al. Suitable biopsy site for detection of esophageal eosinophilia in eosinophilic esophagitis suspected cases. Dig Endosc. 2016;28:139–44.CrossRefPubMed
29.
go back to reference Amano Y, Ishimura N, Furuta K, et al. Interobserver agreement on classifying endoscopic diagnoses of nonerosive esophagitis. Endoscopy. 2006;38:1032–5.CrossRefPubMed Amano Y, Ishimura N, Furuta K, et al. Interobserver agreement on classifying endoscopic diagnoses of nonerosive esophagitis. Endoscopy. 2006;38:1032–5.CrossRefPubMed
30.
go back to reference Miwa H, Yokoyama T, Hori K, et al. Interobserver agreement in endoscopic evaluation of reflux esophagitis using a modified Los Angeles classification incorporating grades N and M: a validation study in a cohort of Japanese endoscopists. Dis Esophagus. 2008;21:355–63.CrossRefPubMed Miwa H, Yokoyama T, Hori K, et al. Interobserver agreement in endoscopic evaluation of reflux esophagitis using a modified Los Angeles classification incorporating grades N and M: a validation study in a cohort of Japanese endoscopists. Dis Esophagus. 2008;21:355–63.CrossRefPubMed
Metadata
Title
Poor inter-observer agreement on the endoscopic diagnosis of eosinophilic esophagitis among Japanese endoscopists
Authors
Daisuke Izumi
Norihisa Ishimura
Mayumi Okada
Hironobu Mikami
Eiko Okimoto
Masahito Aimi
Tsuyoshi Mishiro
Naoki Oshima
Shuichi Sato
Shunji Ishihara
Yoshikazu Kinoshita
Publication date
01-10-2017
Publisher
Springer Japan
Published in
Esophagus / Issue 4/2017
Print ISSN: 1612-9059
Electronic ISSN: 1612-9067
DOI
https://doi.org/10.1007/s10388-017-0581-9

Other articles of this Issue 4/2017

Esophagus 4/2017 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.