Skip to main content
Top
Published in: BMC Primary Care 1/2013

Open Access 01-12-2013 | Study protocol

Challenges in diagnostic accuracy studies in primary care: the fecal calprotectin example

Authors: Gea A Holtman, Leeuwen Yvonne Lisman-van, Boudewijn J Kollen, Johanna C Escher, Angelika Kindermann, Rheenen Patrick F van, Marjolein Y Berger

Published in: BMC Primary Care | Issue 1/2013

Login to get access

Abstract

Background

Low disease prevalence and lack of uniform reference standards in primary care induce methodological challenges for investigating the diagnostic accuracy of a test. We present a study design that copes with these methodological challenges and discuss the methodological implications of our choices, using a quality assessment tool for diagnostic accuracy studies (QUADAS-2).

Design

The study investigates the diagnostic value of fecal calprotectin for detecting inflammatory bowel disease in children presenting with chronic gastrointestinal symptoms in primary care. It is a prospective cohort study including two cohorts of children: one cohort will be recruited in primary care and the other in secondary/tertiary care. Test results of fecal calprotectin will be compared to one of the two reference standards for inflammatory bowel disease: endoscopy with histopathological examination of mucosal biopsies or assessment of clinical symptoms at 1-year follow-up.

Discussion

According to QUADAS-2 the use of two reference standards and the recruitment of patients in two populations may cause differential verification bias and spectrum bias, respectively. The clinical relevance of this potential bias and methods to adjust for this are presented. This study illustrates the importance of awareness of the different kinds of bias that result from choices in the design phase of a diagnostic study in a low prevalence setting. This approach is exemplary for other diagnostic research in primary care.
Appendix
Available only for authorised users
Literature
1.
go back to reference van der Zaag-Loonen HJ, Casparie M, Taminiau JA, Escher JC, Pereira RR, Derkx HH: The incidence of pediatric inflammatory bowel disease in the Netherlands: 1999-2001. J Pediatr Gastroenterol Nutr. 2004, 38 (3): 302-307.CrossRefPubMed van der Zaag-Loonen HJ, Casparie M, Taminiau JA, Escher JC, Pereira RR, Derkx HH: The incidence of pediatric inflammatory bowel disease in the Netherlands: 1999-2001. J Pediatr Gastroenterol Nutr. 2004, 38 (3): 302-307.CrossRefPubMed
2.
go back to reference Gieteling MJ, Lisman-van Leeuwen Y, van der Wouden JC, Schellevis FG, Berger MY: Childhood nonspecific abdominal pain in family practice: incidence, associated factors, and management. Ann Fam Med. 2011, 9 (4): 337-343.CrossRefPubMedPubMedCentral Gieteling MJ, Lisman-van Leeuwen Y, van der Wouden JC, Schellevis FG, Berger MY: Childhood nonspecific abdominal pain in family practice: incidence, associated factors, and management. Ann Fam Med. 2011, 9 (4): 337-343.CrossRefPubMedPubMedCentral
3.
go back to reference Rasquin A, Di Lorenzo C, Forbes D, Guiraldes E, Hyams JS, Staiano A, Walker LS: Childhood functional gastrointestinal disorders: child/adolescent. Gastroenterology. 2006, 130 (5): 1527-1537.CrossRefPubMed Rasquin A, Di Lorenzo C, Forbes D, Guiraldes E, Hyams JS, Staiano A, Walker LS: Childhood functional gastrointestinal disorders: child/adolescent. Gastroenterology. 2006, 130 (5): 1527-1537.CrossRefPubMed
4.
go back to reference van Rheenen PF, Van de Vijver E, Fidler V: Faecal calprotectin for screening of patients with suspected inflammatory bowel disease: diagnostic meta-analysis. BMJ. 2010, 341: c3369-CrossRefPubMedPubMedCentral van Rheenen PF, Van de Vijver E, Fidler V: Faecal calprotectin for screening of patients with suspected inflammatory bowel disease: diagnostic meta-analysis. BMJ. 2010, 341: c3369-CrossRefPubMedPubMedCentral
5.
go back to reference Roseth AG, Schmidt PN, Fagerhol MK: Correlation between faecal excretion of indium-111-labelled granulocytes and calprotectin, a granulocyte marker protein, in patients with inflammatory bowel disease. Scand J Gastroenterol. 1999, 34 (1): 50-54.CrossRefPubMed Roseth AG, Schmidt PN, Fagerhol MK: Correlation between faecal excretion of indium-111-labelled granulocytes and calprotectin, a granulocyte marker protein, in patients with inflammatory bowel disease. Scand J Gastroenterol. 1999, 34 (1): 50-54.CrossRefPubMed
6.
go back to reference Bunn SK, Bisset WM, Main MJ, Gray ES, Olson S, Golden BE: Fecal calprotectin: validation as a noninvasive measure of bowel inflammation in childhood inflammatory bowel disease. J Pediatr Gastroenterol Nutr. 2001, 33 (1): 14-22.CrossRefPubMed Bunn SK, Bisset WM, Main MJ, Gray ES, Olson S, Golden BE: Fecal calprotectin: validation as a noninvasive measure of bowel inflammation in childhood inflammatory bowel disease. J Pediatr Gastroenterol Nutr. 2001, 33 (1): 14-22.CrossRefPubMed
7.
go back to reference Canani RB, de Horatio LT, Terrin G, Romano MT, Miele E, Staiano A, Rapacciuolo L, Polito G, Bisesti V, Manguso F, Vallone G, Sodano A, Troncone R: Combined use of noninvasive tests is useful in the initial diagnostic approach to a child with suspected inflammatory bowel disease. J Pediatr Gastroenterol Nutr. 2006, 42 (1): 9-15.CrossRefPubMed Canani RB, de Horatio LT, Terrin G, Romano MT, Miele E, Staiano A, Rapacciuolo L, Polito G, Bisesti V, Manguso F, Vallone G, Sodano A, Troncone R: Combined use of noninvasive tests is useful in the initial diagnostic approach to a child with suspected inflammatory bowel disease. J Pediatr Gastroenterol Nutr. 2006, 42 (1): 9-15.CrossRefPubMed
8.
go back to reference Diamanti A, Panetta F, Basso MS, Forgione A, Colistro F, Bracci F, Papadatou B, Francalanci P, Torroni F, Knafelz D, Fina F, Castro M: Diagnostic work-up of inflammatory bowel disease in children: the role of calprotectin assay. Inflamm Bowel Dis. 2010, 16 (11): 1926-1930.CrossRefPubMed Diamanti A, Panetta F, Basso MS, Forgione A, Colistro F, Bracci F, Papadatou B, Francalanci P, Torroni F, Knafelz D, Fina F, Castro M: Diagnostic work-up of inflammatory bowel disease in children: the role of calprotectin assay. Inflamm Bowel Dis. 2010, 16 (11): 1926-1930.CrossRefPubMed
9.
go back to reference Buntinx F, Mant D, Van den Bruel A, Donner-Banzhof N, Dinant GJ: Dealing with low-incidence serious diseases in general practice. Br J Gen Pract. 2011, 61 (582): 43-46.CrossRefPubMedPubMedCentral Buntinx F, Mant D, Van den Bruel A, Donner-Banzhof N, Dinant GJ: Dealing with low-incidence serious diseases in general practice. Br J Gen Pract. 2011, 61 (582): 43-46.CrossRefPubMedPubMedCentral
10.
go back to reference Levine A, Griffiths A, Markowitz J, Wilson DC, Turner D, Russell RK, Fell J, Ruemmele FM, Walters T, Sherlock M, Dubinsky M, Hyams JS: Pediatric modification of the Montreal classification for inflammatory bowel disease: the Paris classification. Inflamm Bowel Dis. 2011, 17 (6): 1314-1321.CrossRefPubMed Levine A, Griffiths A, Markowitz J, Wilson DC, Turner D, Russell RK, Fell J, Ruemmele FM, Walters T, Sherlock M, Dubinsky M, Hyams JS: Pediatric modification of the Montreal classification for inflammatory bowel disease: the Paris classification. Inflamm Bowel Dis. 2011, 17 (6): 1314-1321.CrossRefPubMed
11.
go back to reference Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM: QUADAS-2 Group. QUADAS-2: a Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann Intern Med. 2011, 155 (8): 529-536.CrossRefPubMed Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM: QUADAS-2 Group. QUADAS-2: a Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann Intern Med. 2011, 155 (8): 529-536.CrossRefPubMed
13.
go back to reference Jellema P, van Tulder MW, van der Horst HE, Florie J, Mulder CJ, van der Windt DA: Inflammatory bowel disease: a systematic review on the value of diagnostic testing in primary care. Colorectal Dis. 2011, 13 (3): 239-254.CrossRefPubMed Jellema P, van Tulder MW, van der Horst HE, Florie J, Mulder CJ, van der Windt DA: Inflammatory bowel disease: a systematic review on the value of diagnostic testing in primary care. Colorectal Dis. 2011, 13 (3): 239-254.CrossRefPubMed
14.
go back to reference Lewis SJ, Heaton KW: Stool form scale as a useful guide to intestinal transit time. Scand J Gastroenterol. 1997, 32 (9): 920-924.CrossRefPubMed Lewis SJ, Heaton KW: Stool form scale as a useful guide to intestinal transit time. Scand J Gastroenterol. 1997, 32 (9): 920-924.CrossRefPubMed
15.
go back to reference Dutch association for pediatrics: CBO Dutch evidence based guidelines on the diagnosis and treatment of IBD in children. 2008, Utrecht: Van Zuiden Communications Dutch association for pediatrics: CBO Dutch evidence based guidelines on the diagnosis and treatment of IBD in children. 2008, Utrecht: Van Zuiden Communications
16.
go back to reference Baber KF, Anderson J, Puzanovova M, Walker LS: Rome II versus Rome III classification of functional gastrointestinal disorders in pediatric chronic abdominal pain. J Pediatr Gastroenterol Nutr. 2008, 47 (3): 299-302.CrossRefPubMedPubMedCentral Baber KF, Anderson J, Puzanovova M, Walker LS: Rome II versus Rome III classification of functional gastrointestinal disorders in pediatric chronic abdominal pain. J Pediatr Gastroenterol Nutr. 2008, 47 (3): 299-302.CrossRefPubMedPubMedCentral
17.
go back to reference Caplan A, Walker L, Rasquin A: Development and preliminary validation of the questionnaire on pediatric gastrointestinal symptoms to assess functional gastrointestinal disorders in children and adolescents. J Pediatr Gastroenterol Nutr. 2005, 41 (3): 296-304.CrossRefPubMed Caplan A, Walker L, Rasquin A: Development and preliminary validation of the questionnaire on pediatric gastrointestinal symptoms to assess functional gastrointestinal disorders in children and adolescents. J Pediatr Gastroenterol Nutr. 2005, 41 (3): 296-304.CrossRefPubMed
18.
go back to reference Caplan A, Walker L, Rasquin A: Validation of the pediatric Rome II criteria for functional gastrointestinal disorders using the questionnaire on pediatric gastrointestinal symptoms. J Pediatr Gastroenterol Nutr. 2005, 41 (3): 305-316.CrossRefPubMed Caplan A, Walker L, Rasquin A: Validation of the pediatric Rome II criteria for functional gastrointestinal disorders using the questionnaire on pediatric gastrointestinal symptoms. J Pediatr Gastroenterol Nutr. 2005, 41 (3): 305-316.CrossRefPubMed
19.
go back to reference de Boer RF, Ott A, Kesztyus B, Kooistra-Smid AM: Improved detection of five major gastrointestinal pathogens by use of a molecular screening approach. J Clin Microbiol. 2010, 48 (11): 4140-4146.CrossRefPubMedPubMedCentral de Boer RF, Ott A, Kesztyus B, Kooistra-Smid AM: Improved detection of five major gastrointestinal pathogens by use of a molecular screening approach. J Clin Microbiol. 2010, 48 (11): 4140-4146.CrossRefPubMedPubMedCentral
20.
go back to reference Roseth AG, Fagerhol MK, Aadland E, Schjonsby H: Assessment of the neutrophil dominating protein calprotectin in feces. A methodologic study. Scand J Gastroenterol. 1992, 27 (9): 793-798.CrossRefPubMed Roseth AG, Fagerhol MK, Aadland E, Schjonsby H: Assessment of the neutrophil dominating protein calprotectin in feces. A methodologic study. Scand J Gastroenterol. 1992, 27 (9): 793-798.CrossRefPubMed
21.
go back to reference Ton H, Brandsnes , Dale S, Holtlund J, Skuibina E, Schjonsby H, Johne B: Improved assay for fecal calprotectin. Clin Chim Acta. 2000, 29 (1-2): 41-54.CrossRef Ton H, Brandsnes , Dale S, Holtlund J, Skuibina E, Schjonsby H, Johne B: Improved assay for fecal calprotectin. Clin Chim Acta. 2000, 29 (1-2): 41-54.CrossRef
22.
go back to reference Pels LP, Van de Vijver E, Waalkens HJ, Uitentuis J, Gonera-de Jong G, van Overbeek LA, Norbruis OF, Rings EH, van Rheenen PF: Slow hematological recovery in children with IBD-associated anemia in cases of "expectant management". J Pediatr Gastroenterol Nutr. 2010, 51 (6): 708-713.CrossRefPubMed Pels LP, Van de Vijver E, Waalkens HJ, Uitentuis J, Gonera-de Jong G, van Overbeek LA, Norbruis OF, Rings EH, van Rheenen PF: Slow hematological recovery in children with IBD-associated anemia in cases of "expectant management". J Pediatr Gastroenterol Nutr. 2010, 51 (6): 708-713.CrossRefPubMed
23.
go back to reference Van de Vijver E, Schreuder AB, Cnossen WR, Muller Kobold AC, van Rheenen PF, North Netherlands Pediatric IBD Consortium: Safely ruling out inflammatory bowel disease in children and teenagers without referral for endoscopy. Arch Dis Child. 2012, 97 (12): 1014-1018.CrossRefPubMed Van de Vijver E, Schreuder AB, Cnossen WR, Muller Kobold AC, van Rheenen PF, North Netherlands Pediatric IBD Consortium: Safely ruling out inflammatory bowel disease in children and teenagers without referral for endoscopy. Arch Dis Child. 2012, 97 (12): 1014-1018.CrossRefPubMed
24.
go back to reference Mack DR, Langton C, Markowitz J, LeLeiko N, Griffiths A, Bousvaros A, Evans J, Kugathasan S, Otley A, Pfefferkorn M, Rosh J, Mezoff A, Moyer S, Oliva-Hemker M, Rothbaum R, Wyllie R, delRosario JF, Keljo D, Lerer T, Hyams J, Pediatric Inflammatory Bowel Disease Collaborative Research Group: Laboratory values for children with newly diagnosed inflammatory bowel disease. Pediatrics. 2007, 119 (6): 1113-1119.CrossRefPubMed Mack DR, Langton C, Markowitz J, LeLeiko N, Griffiths A, Bousvaros A, Evans J, Kugathasan S, Otley A, Pfefferkorn M, Rosh J, Mezoff A, Moyer S, Oliva-Hemker M, Rothbaum R, Wyllie R, delRosario JF, Keljo D, Lerer T, Hyams J, Pediatric Inflammatory Bowel Disease Collaborative Research Group: Laboratory values for children with newly diagnosed inflammatory bowel disease. Pediatrics. 2007, 119 (6): 1113-1119.CrossRefPubMed
25.
go back to reference Bremner A, Roked S, Robinson R, Phillips I, Beattie M: Faecal calprotectin in children with chronic gastrointestinal symptoms. Acta Paediatr. 2005, 94 (12): 1855-1858.CrossRefPubMed Bremner A, Roked S, Robinson R, Phillips I, Beattie M: Faecal calprotectin in children with chronic gastrointestinal symptoms. Acta Paediatr. 2005, 94 (12): 1855-1858.CrossRefPubMed
26.
go back to reference Carroccio A, Iacono G, Cottone M, Di Prima L, Cartabellotta F, Cavataio F, Scalici C, Montalto G, Di Fede G, Rini G, Notarbartolo A, Averna MR: Diagnostic accuracy of fecal calprotectin assay in distinguishing organic causes of chronic diarrhea from irritable bowel syndrome: a prospective study in adults and children. Clin Chem. 2003, 49 (6 Pt 1): 861-867.CrossRefPubMed Carroccio A, Iacono G, Cottone M, Di Prima L, Cartabellotta F, Cavataio F, Scalici C, Montalto G, Di Fede G, Rini G, Notarbartolo A, Averna MR: Diagnostic accuracy of fecal calprotectin assay in distinguishing organic causes of chronic diarrhea from irritable bowel syndrome: a prospective study in adults and children. Clin Chem. 2003, 49 (6 Pt 1): 861-867.CrossRefPubMed
27.
go back to reference Fagerberg UL, Loof L, Myrdal U, Hansson LO, Finkel Y: Colorectal inflammation is well predicted by fecal calprotectin in children with gastrointestinal symptoms. J Pediatr Gastroenterol Nutr. 2005, 40 (4): 450-455.CrossRefPubMed Fagerberg UL, Loof L, Myrdal U, Hansson LO, Finkel Y: Colorectal inflammation is well predicted by fecal calprotectin in children with gastrointestinal symptoms. J Pediatr Gastroenterol Nutr. 2005, 40 (4): 450-455.CrossRefPubMed
28.
go back to reference Buderer NM: Statistical methodology: I Incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996, 3 (9): 895-900.CrossRefPubMed Buderer NM: Statistical methodology: I Incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996, 3 (9): 895-900.CrossRefPubMed
29.
go back to reference Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM: A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009, 62 (8): 797-806.CrossRefPubMed Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM: A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol. 2009, 62 (8): 797-806.CrossRefPubMed
30.
go back to reference de Groot JA, Dendukuri N, Janssen KJ, Reitsma JB, Bossuyt PM, Moons KG: Adjusting for differential-verification bias in diagnostic-accuracy studies: a Bayesian approach. Epidemiology. 2011, 22 (2): 234-241.CrossRefPubMed de Groot JA, Dendukuri N, Janssen KJ, Reitsma JB, Bossuyt PM, Moons KG: Adjusting for differential-verification bias in diagnostic-accuracy studies: a Bayesian approach. Epidemiology. 2011, 22 (2): 234-241.CrossRefPubMed
31.
go back to reference Naaktgeboren CA, de Groot JAH, van Smeden M, Moons KGM, Reitsma JB: Evaluating diagnostic accuracy in the face of multiple reference standards. Ann Intern Med. 2013, 159 (3): 195-202.CrossRefPubMed Naaktgeboren CA, de Groot JAH, van Smeden M, Moons KGM, Reitsma JB: Evaluating diagnostic accuracy in the face of multiple reference standards. Ann Intern Med. 2013, 159 (3): 195-202.CrossRefPubMed
32.
go back to reference Mulherin SA, Miller WC: Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002, 137 (7): 598-602.CrossRefPubMed Mulherin SA, Miller WC: Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002, 137 (7): 598-602.CrossRefPubMed
Metadata
Title
Challenges in diagnostic accuracy studies in primary care: the fecal calprotectin example
Authors
Gea A Holtman
Leeuwen Yvonne Lisman-van
Boudewijn J Kollen
Johanna C Escher
Angelika Kindermann
Rheenen Patrick F van
Marjolein Y Berger
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2013
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-14-179

Other articles of this Issue 1/2013

BMC Primary Care 1/2013 Go to the issue