Skip to main content
Top
Published in: Clinical and Translational Allergy 1/2014

Open Access 01-12-2014 | Research

Standardized food challenges are subject to variability in interpretation of clinical symptoms

Authors: Francine C van Erp, André C Knulst, Yolanda Meijer, Carmelo Gabriele, Cornelis K van der Ent

Published in: Clinical and Translational Allergy | Issue 1/2014

Login to get access

Abstract

Background

Food challenge tests are the gold standard in diagnosing food allergy. Guidelines provide scoring systems to classify symptoms during challenge and typically recommend that challenges are considered positive when objective symptoms occur. However, currently no standard criteria for the definition of a positive challenge outcome exists and interpretation of food challenges mainly depends on clinical judgment. This study aims to assess inter- and intra-observer variability in outcomes of routinely performed peanut challenges in children.

Methods

All complete food challenge score sheets of double blind placebo controlled peanut challenges performed in 2008-2010 in an academic hospital were included. Score sheets were reassessed independently by three clinical experts including double reassessment in a subset of score sheets. Inter- and intra-observer variability was evaluated using kappa statistics.

Results

We included 191 food challenge score sheets. Inter-observer agreement on overall challenge outcome was moderate (κ = 0.59-0.65) and was fair (κ = 0.31-0.46) on challenges with symptoms. Intra-observer agreement on overall challenge outcome was good (κ = 0.63-0.77) but was moderate (κ = 0.50-0.60) on challenges with symptoms. Subjective symptoms (oral symptoms, abdominal complaints, food aversion) were significantly associated with disagreement between observers.

Conclusions

We demonstrate that, despite strict adherence to guidelines, there is a considerable amount of variability in reassessment of symptoms recorded on food challenges sheets between and within well trained clinicians, especially when subjective symptoms occur.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bindslev-Jensen C, Ballmer-Weber BK, Bengtsson U, Blanco C, Ebner C, Hourihane J, Knulst AC, Moneret-Vautrin DA, Nekam K, Niggemann B, Osterballe M, Ortolani C, Ring J, Schnopp C, Werfel T: Standardization of food challenges in patients with immediate reactions to foods–position paper from the European Academy of Allergology and Clinical Immunology. Allergy. 2004, 59: 690-697. 10.1111/j.1398-9995.2004.00466.x.CrossRefPubMed Bindslev-Jensen C, Ballmer-Weber BK, Bengtsson U, Blanco C, Ebner C, Hourihane J, Knulst AC, Moneret-Vautrin DA, Nekam K, Niggemann B, Osterballe M, Ortolani C, Ring J, Schnopp C, Werfel T: Standardization of food challenges in patients with immediate reactions to foods–position paper from the European Academy of Allergology and Clinical Immunology. Allergy. 2004, 59: 690-697. 10.1111/j.1398-9995.2004.00466.x.CrossRefPubMed
2.
go back to reference Sampson H, Gerthvan Wijk R, Bindslev-Jensen C, Sicherer S, Teuber SS, Burks AW, Dubois AEJ, Beyer K, Eigenmann PA, Spergel JM, Werfel T, Chinchilli VM: Standardizing double-blind, placebo-controlled oral food challenges: American Academy of Allergy, Asthma & Immunology-European Academy of Allergy and Clinical Immunology PRACTALL consensus report. J Allergy Clin Immunol. 2012, 130: 1260-1274. 10.1016/j.jaci.2012.10.017.CrossRefPubMed Sampson H, Gerthvan Wijk R, Bindslev-Jensen C, Sicherer S, Teuber SS, Burks AW, Dubois AEJ, Beyer K, Eigenmann PA, Spergel JM, Werfel T, Chinchilli VM: Standardizing double-blind, placebo-controlled oral food challenges: American Academy of Allergy, Asthma & Immunology-European Academy of Allergy and Clinical Immunology PRACTALL consensus report. J Allergy Clin Immunol. 2012, 130: 1260-1274. 10.1016/j.jaci.2012.10.017.CrossRefPubMed
3.
go back to reference Cochrane SA, Salt LJ, Wantling E, Rogers A, Coutts J, Ballmer-Weber BK, Fritsche P, Fernández-Rivas M, Reig I, Knulst A, Le T-M, Asero R, Beyer K, Golding M, Crevel R, Clare Mills EN, Mackie AR: Development of a standardized low-dose double-blind placebo-controlled challenge vehicle for the EuroPrevall project. Allergy. 2012, 67: 107-113. 10.1111/j.1398-9995.2011.02715.x.CrossRefPubMed Cochrane SA, Salt LJ, Wantling E, Rogers A, Coutts J, Ballmer-Weber BK, Fritsche P, Fernández-Rivas M, Reig I, Knulst A, Le T-M, Asero R, Beyer K, Golding M, Crevel R, Clare Mills EN, Mackie AR: Development of a standardized low-dose double-blind placebo-controlled challenge vehicle for the EuroPrevall project. Allergy. 2012, 67: 107-113. 10.1111/j.1398-9995.2011.02715.x.CrossRefPubMed
4.
go back to reference Flinterman AE, Pasmans SG, Hoekstra MO, Meijer Y, Van Hoffen E, Knol EF, Hefle SL, Bruijnzeel-Koomen CA, Knulst AC: Determination of no-observed-adverse-effect levels and eliciting doses in a representative group of peanut-sensitized children. J Allergy Clin Immunol. 2006, 117: 448-454. 10.1016/j.jaci.2005.11.035.CrossRefPubMed Flinterman AE, Pasmans SG, Hoekstra MO, Meijer Y, Van Hoffen E, Knol EF, Hefle SL, Bruijnzeel-Koomen CA, Knulst AC: Determination of no-observed-adverse-effect levels and eliciting doses in a representative group of peanut-sensitized children. J Allergy Clin Immunol. 2006, 117: 448-454. 10.1016/j.jaci.2005.11.035.CrossRefPubMed
5.
go back to reference Altman DG: Practical Statistics for Medical Research. 1991, Chapman & Hall/CRC, London Altman DG: Practical Statistics for Medical Research. 1991, Chapman & Hall/CRC, London
6.
go back to reference Sampson HA: Anaphylaxis and emergency treatment. Pediatrics. 2003, 111 (6 Pt 3): 1601-1608.PubMed Sampson HA: Anaphylaxis and emergency treatment. Pediatrics. 2003, 111 (6 Pt 3): 1601-1608.PubMed
7.
go back to reference Saps M, Di Lorenzo C: Interobserver and intraobserver reliability of the Rome II criteria in children. Am J Gastroenterol. 2005, 100: 2079-2082. 10.1111/j.1572-0241.2005.50082.x.CrossRefPubMed Saps M, Di Lorenzo C: Interobserver and intraobserver reliability of the Rome II criteria in children. Am J Gastroenterol. 2005, 100: 2079-2082. 10.1111/j.1572-0241.2005.50082.x.CrossRefPubMed
8.
go back to reference Nakagawa J, Ouk S, Schwartz B, Schriger DL: Interobserver agreement in emergency department triage. Ann Emerg Med. 2003, 41: 191-195. 10.1067/mem.2003.47.CrossRefPubMed Nakagawa J, Ouk S, Schwartz B, Schriger DL: Interobserver agreement in emergency department triage. Ann Emerg Med. 2003, 41: 191-195. 10.1067/mem.2003.47.CrossRefPubMed
9.
go back to reference Baker KM, Brand DA, Hen J: Classifying asthma: disagreement among specialists. Chest. 2003, 124: 2156-2163. 10.1378/chest.124.6.2156.CrossRefPubMed Baker KM, Brand DA, Hen J: Classifying asthma: disagreement among specialists. Chest. 2003, 124: 2156-2163. 10.1378/chest.124.6.2156.CrossRefPubMed
10.
go back to reference Niggemann B: When is an oral food challenge positive?. Allergy. 2010, 65: 2-6. 10.1111/j.1398-9995.2009.02170.x.CrossRefPubMed Niggemann B: When is an oral food challenge positive?. Allergy. 2010, 65: 2-6. 10.1111/j.1398-9995.2009.02170.x.CrossRefPubMed
11.
go back to reference Ahrens B, Niggemann B, Wahn U, Beyer K: Positive reactions to placebo in children undergoing double-blind, placebo-controlled food challenge. Clin Exp Allergy. 2014, 44: 572-578. 10.1111/cea.12284.CrossRefPubMed Ahrens B, Niggemann B, Wahn U, Beyer K: Positive reactions to placebo in children undergoing double-blind, placebo-controlled food challenge. Clin Exp Allergy. 2014, 44: 572-578. 10.1111/cea.12284.CrossRefPubMed
12.
go back to reference Clark AT, Mangat JS, Tay SS, King Y, Monk CJ, White PA, Ewan PW: Facial thermography is a sensitive and specific method for assessing food challenge outcome. Allergy. 2007, 62: 744-749. 10.1111/j.1398-9995.2007.01363.x.CrossRefPubMed Clark AT, Mangat JS, Tay SS, King Y, Monk CJ, White PA, Ewan PW: Facial thermography is a sensitive and specific method for assessing food challenge outcome. Allergy. 2007, 62: 744-749. 10.1111/j.1398-9995.2007.01363.x.CrossRefPubMed
13.
go back to reference Ruëff F, Friedl T, Arnold A, Kramer M, Przybilla B: Release of mast cell tryptase into saliva: a tool to diagnose food allergy by a mucosal challenge test?. Int Arch Allergy. 2011, 155: 282-288. 10.1159/000320492.CrossRef Ruëff F, Friedl T, Arnold A, Kramer M, Przybilla B: Release of mast cell tryptase into saliva: a tool to diagnose food allergy by a mucosal challenge test?. Int Arch Allergy. 2011, 155: 282-288. 10.1159/000320492.CrossRef
14.
go back to reference Glaumann S, Nopp A, Johansson SGO, Borres MP, Nilsson C: Oral peanut challenge identifies an allergy but the peanut allergen threshold sensitivity is not reproducible. PloS one. 2013, 8: e53465-10.1371/journal.pone.0053465.PubMedCentralCrossRefPubMed Glaumann S, Nopp A, Johansson SGO, Borres MP, Nilsson C: Oral peanut challenge identifies an allergy but the peanut allergen threshold sensitivity is not reproducible. PloS one. 2013, 8: e53465-10.1371/journal.pone.0053465.PubMedCentralCrossRefPubMed
15.
go back to reference Järvinen KM, Sicherer SH: Diagnostic oral food challenges: procedures and biomarkers. J Immunol Meth. 2012, 383: 30-38. 10.1016/j.jim.2012.02.019.CrossRef Järvinen KM, Sicherer SH: Diagnostic oral food challenges: procedures and biomarkers. J Immunol Meth. 2012, 383: 30-38. 10.1016/j.jim.2012.02.019.CrossRef
16.
go back to reference Caffarelli C, Ricò S, Rinaldi L, Povesi Dascola C, Terzi C, Bernasconi S: Blood pressure monitoring in children undergoing food challenge: association with anaphylaxis. Ann Allergy Asthma Immunol. 2012, 108: 285-286. 10.1016/j.anai.2012.02.001.CrossRefPubMed Caffarelli C, Ricò S, Rinaldi L, Povesi Dascola C, Terzi C, Bernasconi S: Blood pressure monitoring in children undergoing food challenge: association with anaphylaxis. Ann Allergy Asthma Immunol. 2012, 108: 285-286. 10.1016/j.anai.2012.02.001.CrossRefPubMed
Metadata
Title
Standardized food challenges are subject to variability in interpretation of clinical symptoms
Authors
Francine C van Erp
André C Knulst
Yolanda Meijer
Carmelo Gabriele
Cornelis K van der Ent
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Clinical and Translational Allergy / Issue 1/2014
Electronic ISSN: 2045-7022
DOI
https://doi.org/10.1186/s13601-014-0043-6

Other articles of this Issue 1/2014

Clinical and Translational Allergy 1/2014 Go to the issue