Skip to main content
Top
Published in: Digestive Diseases and Sciences 7/2010

01-07-2010 | Original Article

Inter- and Intraobserver Reliability and Validation of a New Method for Determination of Eosinophil Counts in Patients with Esophageal Eosinophilia

Authors: Evan S. Dellon, Karen J. Fritchie, Tara C. Rubinas, John T. Woosley, Nicholas J. Shaheen

Published in: Digestive Diseases and Sciences | Issue 7/2010

Login to get access

Abstract

Background

Diagnosis of eosinophilic esophagitis (EoE) requires quantification of esophageal eosinophilia.

Aims

The aims of this study were to assess inter- and intraobserver reliability for measuring esophageal eosinophil counts and to validate a novel method of determining tissue eosinophil density using digitized histopathology slides.

Methods

Patients were selected from the University of North Carolina EoE clinicopathologic database. Glass slides were de-identified and scanned to create digitized slides. Using a set protocol, 40 slides were read by each of three pathologists for interobserver measures, and were also reread by one pathologist as traditional glass slides. Different sets of 20 unique slides were read twice by each pathologist for intraobserver measures. Correlation and agreement were calculated with Pearson’s rho and the κ statistic.

Results

There was excellent correction between digitized images and glass slides (r = 0.91–0.95, P < 0.001). For maximum eosinophil densities, interobserver correlations were 0.91, 0.76, and 0.79. For mean densities, interobserver correlations were 0.90, 0.89, and 0.85. Intraobserver correlations for maximum densities were 0.99, 0.94, and 0.96, and for mean densities were 0.97, 0.87, and 0.89 (P < 0.001 for all correlations). Agreement was in the “substantial” to “near-perfect” range for pathologists using several diagnostic cut-points for EoE.

Conclusions

Both inter- and intraobserver correlations were excellent for determining eosinophil densities and counts. A method of using digitized slides was valid when compared with traditional glass slides. This protocol could be adopted for research and clinical purposes to further standardize the diagnostic process for EoE.
Literature
1.
go back to reference Furuta GT, Liacouras CA, Collins MH, et al. Eosinophilic esophagitis in children and adults: a systematic review and consensus recommendations for diagnosis and treatment. Gastroenterology. 2007;133:1342–1363.CrossRefPubMed Furuta GT, Liacouras CA, Collins MH, et al. Eosinophilic esophagitis in children and adults: a systematic review and consensus recommendations for diagnosis and treatment. Gastroenterology. 2007;133:1342–1363.CrossRefPubMed
2.
go back to reference Desai TK, Stecevic V, Chang CH, et al. Association of eosinophilic inflammation with esophageal food impaction in adults. Gastrointest Endosc. 2005;61:795–801.CrossRefPubMed Desai TK, Stecevic V, Chang CH, et al. Association of eosinophilic inflammation with esophageal food impaction in adults. Gastrointest Endosc. 2005;61:795–801.CrossRefPubMed
3.
go back to reference Putnam PE. Eosinophilic esophagitis in children: clinical manifestations. Gastrointest Endosc Clin North Am. 2008;18:11–23. vii.CrossRef Putnam PE. Eosinophilic esophagitis in children: clinical manifestations. Gastrointest Endosc Clin North Am. 2008;18:11–23. vii.CrossRef
4.
go back to reference Katzka DA. Demographic data and symptoms of eosinophilic esophagitis in adults. Gastrointest Endosc Clin North Am. 2008;18:25–32. viii.CrossRef Katzka DA. Demographic data and symptoms of eosinophilic esophagitis in adults. Gastrointest Endosc Clin North Am. 2008;18:25–32. viii.CrossRef
5.
go back to reference Sgouros SN, Bergele C, Mantides A. Eosinophilic esophagitis in adults: a systematic review. Eur J Gastroenterol Hepatol. 2006;18:211–217.CrossRefPubMed Sgouros SN, Bergele C, Mantides A. Eosinophilic esophagitis in adults: a systematic review. Eur J Gastroenterol Hepatol. 2006;18:211–217.CrossRefPubMed
6.
go back to reference Straumann A, Rossi L, Simon HU, et al. Fragility of the esophageal mucosa: a pathognomonic endoscopic sign of primary eosinophilic esophagitis? Gastrointest Endosc. 2003;57:407–412.CrossRefPubMed Straumann A, Rossi L, Simon HU, et al. Fragility of the esophageal mucosa: a pathognomonic endoscopic sign of primary eosinophilic esophagitis? Gastrointest Endosc. 2003;57:407–412.CrossRefPubMed
7.
go back to reference Straumann A, Spichtin HP, Bucher KA, Heer P, Simon HU. Eosinophilic esophagitis: red on microscopy, white on endoscopy. Digestion. 2004;70:109–116.CrossRefPubMed Straumann A, Spichtin HP, Bucher KA, Heer P, Simon HU. Eosinophilic esophagitis: red on microscopy, white on endoscopy. Digestion. 2004;70:109–116.CrossRefPubMed
8.
go back to reference Fox VL. Eosinophilic esophagitis: endoscopic findings. Gastrointest Endosc Clin North Am. 2008;18:45–57. viii.CrossRef Fox VL. Eosinophilic esophagitis: endoscopic findings. Gastrointest Endosc Clin North Am. 2008;18:45–57. viii.CrossRef
9.
10.
go back to reference Straumann A, Simon HU. Eosinophilic esophagitis: escalating epidemiology? J Allergy Clin Immunol. 2005;115:418–419.CrossRefPubMed Straumann A, Simon HU. Eosinophilic esophagitis: escalating epidemiology? J Allergy Clin Immunol. 2005;115:418–419.CrossRefPubMed
11.
go back to reference Ronkainen J, Talley NJ, Aro P et al. (2006) Prevalence of oesophageal eosinophils and eosinophilic oesophagitis in adults: The population-based Kalixanda study. Gut. Ronkainen J, Talley NJ, Aro P et al. (2006) Prevalence of oesophageal eosinophils and eosinophilic oesophagitis in adults: The population-based Kalixanda study. Gut.
12.
go back to reference Gonsalves N. Eosinophilic esophagitis: history, nomenclature, and diagnostic guidelines. Gastrointest Endosc Clin North Am. 2008;18:1–9. vii.CrossRef Gonsalves N. Eosinophilic esophagitis: history, nomenclature, and diagnostic guidelines. Gastrointest Endosc Clin North Am. 2008;18:1–9. vii.CrossRef
13.
go back to reference Chehade M, Sampson HA. Epidemiology and etiology of eosinophilic esophagitis. Gastrointest Endosc Clin North Am. 2008;18:33–44. viii.CrossRef Chehade M, Sampson HA. Epidemiology and etiology of eosinophilic esophagitis. Gastrointest Endosc Clin North Am. 2008;18:33–44. viii.CrossRef
14.
go back to reference Dellon ES, Aderoju A, Woosley JT, Sandler RS, Shaheen NJ. Variability in diagnostic criteria for eosinophilic esophagitis: A systematic review. Am J Gastro. 2007;102:2300–2313.CrossRef Dellon ES, Aderoju A, Woosley JT, Sandler RS, Shaheen NJ. Variability in diagnostic criteria for eosinophilic esophagitis: A systematic review. Am J Gastro. 2007;102:2300–2313.CrossRef
15.
go back to reference Collins MH. Histopathologic features of eosinophilic esophagitis. Gastrointest Endosc Clin North Am. 2008;18:59–71. viii–ix.CrossRef Collins MH. Histopathologic features of eosinophilic esophagitis. Gastrointest Endosc Clin North Am. 2008;18:59–71. viii–ix.CrossRef
16.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.CrossRefPubMed
17.
go back to reference Pannarale G, Bebb G, Clark S, et al. Bias and variability in blood pressure measurement with ambulatory recorders. Hypertension. 1993;22:591–598.PubMed Pannarale G, Bebb G, Clark S, et al. Bias and variability in blood pressure measurement with ambulatory recorders. Hypertension. 1993;22:591–598.PubMed
18.
go back to reference Al-Kharrat T, Zarich S, Amoateng-Adjepong Y, Manthous CA. Analysis of observer variability in measurement of pulmonary artery occlusion pressures. Am J Respir Crit Care Med. 1999;160:415–420.PubMed Al-Kharrat T, Zarich S, Amoateng-Adjepong Y, Manthous CA. Analysis of observer variability in measurement of pulmonary artery occlusion pressures. Am J Respir Crit Care Med. 1999;160:415–420.PubMed
19.
go back to reference Aboyans V, Lacroix P, Lebourdon A, et al. The intra- and interobserver variability of ankle-arm blood pressure index according to its mode of calculation. J Clin Epidemiol. 2003;56:215–220.CrossRefPubMed Aboyans V, Lacroix P, Lebourdon A, et al. The intra- and interobserver variability of ankle-arm blood pressure index according to its mode of calculation. J Clin Epidemiol. 2003;56:215–220.CrossRefPubMed
20.
go back to reference Lazarus E, Mainiero MB, Schepps B, Koelliker SL, Livingston LS. BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value. Radiology. 2006;239:385–391.CrossRefPubMed Lazarus E, Mainiero MB, Schepps B, Koelliker SL, Livingston LS. BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value. Radiology. 2006;239:385–391.CrossRefPubMed
21.
go back to reference Allsbrook WC Jr, Mangold KA, Johnson MH, et al. Interobserver reproducibility of Gleason grading of prostatic carcinoma: urologic pathologists. Hum Pathol. 2001;32:74–80.CrossRefPubMed Allsbrook WC Jr, Mangold KA, Johnson MH, et al. Interobserver reproducibility of Gleason grading of prostatic carcinoma: urologic pathologists. Hum Pathol. 2001;32:74–80.CrossRefPubMed
22.
go back to reference Ormsby AH, Petras RE, Henricks WH, et al. Observer variation in the diagnosis of superficial oesophageal adenocarcinoma. Gut. 2002;51:671–676.CrossRefPubMed Ormsby AH, Petras RE, Henricks WH, et al. Observer variation in the diagnosis of superficial oesophageal adenocarcinoma. Gut. 2002;51:671–676.CrossRefPubMed
23.
go back to reference Downs-Kelly E, Mendelin JE, Bennett AE et al. (2008) Poor Interobserver Agreement in the Distinction of High-Grade Dysplasia and Adenocarcinoma in Pretreatment Barrett’s Esophagus Biopsies. Am J Gastroenterol. Downs-Kelly E, Mendelin JE, Bennett AE et al. (2008) Poor Interobserver Agreement in the Distinction of High-Grade Dysplasia and Adenocarcinoma in Pretreatment Barrett’s Esophagus Biopsies. Am J Gastroenterol.
24.
go back to reference Montgomery E, Bronner MP, Goldblum JR, et al. Reproducibility of the diagnosis of dysplasia in Barrett esophagus: a reaffirmation. Hum Pathol. 2001;32:368–378.CrossRefPubMed Montgomery E, Bronner MP, Goldblum JR, et al. Reproducibility of the diagnosis of dysplasia in Barrett esophagus: a reaffirmation. Hum Pathol. 2001;32:368–378.CrossRefPubMed
25.
go back to reference Kelly KJ, Lazenby AJ, Rowe PC, et al. Eosinophilic esophagitis attributed to gastroesophageal reflux: improvement with an amino acid-based formula. Gastroenterology. 1995;109:1503–1512.CrossRefPubMed Kelly KJ, Lazenby AJ, Rowe PC, et al. Eosinophilic esophagitis attributed to gastroesophageal reflux: improvement with an amino acid-based formula. Gastroenterology. 1995;109:1503–1512.CrossRefPubMed
26.
go back to reference Lowichik A, Weinberg AG. A quantitative evaluation of mucosal eosinophils in the pediatric gastrointestinal tract. Mod Pathol. 1996;9:110–114.PubMed Lowichik A, Weinberg AG. A quantitative evaluation of mucosal eosinophils in the pediatric gastrointestinal tract. Mod Pathol. 1996;9:110–114.PubMed
Metadata
Title
Inter- and Intraobserver Reliability and Validation of a New Method for Determination of Eosinophil Counts in Patients with Esophageal Eosinophilia
Authors
Evan S. Dellon
Karen J. Fritchie
Tara C. Rubinas
John T. Woosley
Nicholas J. Shaheen
Publication date
01-07-2010
Publisher
Springer US
Published in
Digestive Diseases and Sciences / Issue 7/2010
Print ISSN: 0163-2116
Electronic ISSN: 1573-2568
DOI
https://doi.org/10.1007/s10620-009-1005-z

Other articles of this Issue 7/2010

Digestive Diseases and Sciences 7/2010 Go to the issue