Skip to main content
Top
Published in: Journal of Translational Medicine 1/2009

Open Access 01-12-2009 | Research

Of gastro and the gold standard: evaluation and policy implications of norovirus test performance for outbreak detection

Authors: David N Fisman, Amy L Greer, George Brouhanski, Steven J Drews

Published in: Journal of Translational Medicine | Issue 1/2009

Login to get access

Abstract

Background

The norovirus group (NVG) of caliciviruses are the etiological agents of most institutional outbreaks of gastroenteritis in North America and Europe. Identification of NVG is complicated by the non-culturable nature of this virus, and the absence of a diagnostic gold standard makes traditional evaluation of test characteristics problematic.

Methods

We evaluated 189 specimens derived from 440 acute gastroenteritis outbreaks investigated in Ontario in 2006–07. Parallel testing for NVG was performed with real-time reverse-transcriptase polymerase chain reaction (RT2-PCR), enzyme immunoassay (EIA) and electron microscopy (EM). Test characteristics (sensitivity and specificity) were estimated using latent class models and composite reference standard methods. The practical implications of test characteristics were evaluated using binomial probability models.

Results

Latent class modelling estimated sensitivities of RT2-PCR, EIA, and EM as 100%, 86%, and 17% respectively; specificities were 84%, 92%, and 100%; estimates obtained using a composite reference standard were similar. If all specimens contained norovirus, RT2-PCR or EIA would be associated with > 99.9% likelihood of at least one test being positive after three specimens tested. Testing of more than 5 true negative specimens with RT2-PCR would be associated with a greater than 50% likelihood of a false positive test.

Conclusion

Our findings support the characterization of EM as lacking sensitivity for NVG outbreaks. The high sensitivity of RT2-PCR and EIA permit identification of NVG outbreaks with testing of limited numbers of clinical specimens. Given risks of false positive test results, it is reasonable to limit the number of specimens tested when RT2-PCR or EIA are available.
Appendix
Available only for authorised users
Literature
1.
go back to reference Norovirus activity – United States, 2006–2007. MMWR Morb Mortal Wkly Rep. 2007, 56: 842-846. Norovirus activity – United States, 2006–2007. MMWR Morb Mortal Wkly Rep. 2007, 56: 842-846.
2.
go back to reference Reynolds KA, Mena KD, Gerba CP: Risk of waterborne illness via drinking water in the United States. Rev Environ Contam Toxicol. 2008, 192: 117-158.PubMed Reynolds KA, Mena KD, Gerba CP: Risk of waterborne illness via drinking water in the United States. Rev Environ Contam Toxicol. 2008, 192: 117-158.PubMed
3.
go back to reference Last JM: A Dictionary of Epidemiology. 2001, New York: Oxford University Press, 4 Last JM: A Dictionary of Epidemiology. 2001, New York: Oxford University Press, 4
4.
go back to reference Castriciano S, Luinstra K, Petrich A, Smieja M, Lee C, Jang D, Portillo E, Chernesky M: Comparison of the RIDASCREEN norovirus enzyme immunoassay to IDEIA NLV GI/GII by testing stools also assayed by RT-PCR and electron microscopy. J Virol Methods. 2007, 141: 216-219.CrossRefPubMed Castriciano S, Luinstra K, Petrich A, Smieja M, Lee C, Jang D, Portillo E, Chernesky M: Comparison of the RIDASCREEN norovirus enzyme immunoassay to IDEIA NLV GI/GII by testing stools also assayed by RT-PCR and electron microscopy. J Virol Methods. 2007, 141: 216-219.CrossRefPubMed
5.
go back to reference Richards AF, Lopman B, Gunn A, Curry A, Ellis D, Cotterill H, Ratcliffe S, Jenkins M, Appleton H, Gallimore CI: Evaluation of a commercial ELISA for detecting Norwalk-like virus antigen in faeces. J Clin Virol. 2003, 26: 109-115.CrossRefPubMed Richards AF, Lopman B, Gunn A, Curry A, Ellis D, Cotterill H, Ratcliffe S, Jenkins M, Appleton H, Gallimore CI: Evaluation of a commercial ELISA for detecting Norwalk-like virus antigen in faeces. J Clin Virol. 2003, 26: 109-115.CrossRefPubMed
6.
go back to reference Jiang X, Wilton N, Zhong WM, Farkas T, Huang PW, Barrett E, Guerrero M, Ruiz-Palacios G, Green KY, Green J: Diagnosis of human caliciviruses by use of enzyme immunoassays. J Infect Dis. 2000, 181 (Suppl 2): S349-359.CrossRefPubMed Jiang X, Wilton N, Zhong WM, Farkas T, Huang PW, Barrett E, Guerrero M, Ruiz-Palacios G, Green KY, Green J: Diagnosis of human caliciviruses by use of enzyme immunoassays. J Infect Dis. 2000, 181 (Suppl 2): S349-359.CrossRefPubMed
7.
go back to reference Mladenova Z, Korsun N, Geonova T, Di Bartolo I, Fiore L, Ruggeri FM: Prevalence and molecular epidemiology of noroviruses detected in outbreak and sporadic cases of acute gastroenteritis in Bulgaria. J Med Virol. 2008, 80: 2161-2168.CrossRefPubMed Mladenova Z, Korsun N, Geonova T, Di Bartolo I, Fiore L, Ruggeri FM: Prevalence and molecular epidemiology of noroviruses detected in outbreak and sporadic cases of acute gastroenteritis in Bulgaria. J Med Virol. 2008, 80: 2161-2168.CrossRefPubMed
8.
go back to reference Dominguez A, Torner N, Ruiz L, Martinez A, Barrabeig I, Camps N, Godoy P, Minguell S, Parron I, Pumares A: Aetiology and epidemiology of viral gastroenteritis outbreaks in Catalonia (Spain) in 2004–2005. J Clin Virol. 2008, 43: 126-131.CrossRefPubMed Dominguez A, Torner N, Ruiz L, Martinez A, Barrabeig I, Camps N, Godoy P, Minguell S, Parron I, Pumares A: Aetiology and epidemiology of viral gastroenteritis outbreaks in Catalonia (Spain) in 2004–2005. J Clin Virol. 2008, 43: 126-131.CrossRefPubMed
9.
go back to reference Ishida S, Yoshizumi S, Ikeda T, Miyoshi M, Okano M, Okui T: Sensitive and rapid detection of norovirus using duplex TaqMan reverse transcription-polymerase chain reaction. J Med Virol. 2008, 80: 913-920.CrossRefPubMed Ishida S, Yoshizumi S, Ikeda T, Miyoshi M, Okano M, Okui T: Sensitive and rapid detection of norovirus using duplex TaqMan reverse transcription-polymerase chain reaction. J Med Virol. 2008, 80: 913-920.CrossRefPubMed
10.
go back to reference Hadgu A: Discrepant analysis: a biased and an unscientific method for estimating test sensitivity and specificity. J Clin Epidemiol. 1999, 52: 1231-1237.CrossRefPubMed Hadgu A: Discrepant analysis: a biased and an unscientific method for estimating test sensitivity and specificity. J Clin Epidemiol. 1999, 52: 1231-1237.CrossRefPubMed
11.
go back to reference Pepe M: Incomplete data and imperfect reference tests. The Statisticial Evaluation of Medical Tests for Classification and Prediction. 2003, Oxford, UK: Oxford University Press, 168-213. Pepe M: Incomplete data and imperfect reference tests. The Statisticial Evaluation of Medical Tests for Classification and Prediction. 2003, Oxford, UK: Oxford University Press, 168-213.
12.
go back to reference Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM: Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008, 15: 106-114.PubMedCentralCrossRefPubMed Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM: Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008, 15: 106-114.PubMedCentralCrossRefPubMed
13.
go back to reference Jothikumar N, Lowther JA, Henshilwood K, Lees DN, Hill VR, Vinje J: Rapid and sensitive detection of noroviruses by using TaqMan-based one-step reverse transcription-PCR assays and application to naturally contaminated shellfish samples. Appl Environ Microbiol. 2005, 71: 1870-1875.PubMedCentralCrossRefPubMed Jothikumar N, Lowther JA, Henshilwood K, Lees DN, Hill VR, Vinje J: Rapid and sensitive detection of noroviruses by using TaqMan-based one-step reverse transcription-PCR assays and application to naturally contaminated shellfish samples. Appl Environ Microbiol. 2005, 71: 1870-1875.PubMedCentralCrossRefPubMed
14.
go back to reference Kageyama T, Kojima S, Shinohara M, Uchida K, Fukushi S, Hoshino FB, Takeda N, Katayama K: Broadly reactive and highly sensitive assay for Norwalk-like viruses based on real-time quantitative reverse transcription-PCR. J Clin Microbiol. 2003, 41: 1548-1557.PubMedCentralCrossRefPubMed Kageyama T, Kojima S, Shinohara M, Uchida K, Fukushi S, Hoshino FB, Takeda N, Katayama K: Broadly reactive and highly sensitive assay for Norwalk-like viruses based on real-time quantitative reverse transcription-PCR. J Clin Microbiol. 2003, 41: 1548-1557.PubMedCentralCrossRefPubMed
15.
go back to reference Loisy F, Atmar RL, Guillon P, Le Cann P, Pommepuy M, Le Guyader FS: Real-time RT-PCR for norovirus screening in shellfish. J Virol Methods. 2005, 123: 1-7.CrossRefPubMed Loisy F, Atmar RL, Guillon P, Le Cann P, Pommepuy M, Le Guyader FS: Real-time RT-PCR for norovirus screening in shellfish. J Virol Methods. 2005, 123: 1-7.CrossRefPubMed
16.
go back to reference Dreier J, Stormer M, Kleesiek K: Use of bacteriophage MS2 as an internal control in viral reverse transcription-PCR assays. J Clin Microbiol. 2005, 43: 4551-4557.PubMedCentralCrossRefPubMed Dreier J, Stormer M, Kleesiek K: Use of bacteriophage MS2 as an internal control in viral reverse transcription-PCR assays. J Clin Microbiol. 2005, 43: 4551-4557.PubMedCentralCrossRefPubMed
17.
go back to reference Medici MC, Martinelli M, Ruggeri FM, Abelli LA, Bosco S, Arcangeletti MC, Pinardi F, De Conto F, Calderaro A, Chezzi C, Dettori G: Broadly reactive nested reverse transcription-PCR using an internal RNA standard control for detection of noroviruses in stool samples. J Clin Microbiol. 2005, 43: 3772-3778.PubMedCentralCrossRefPubMed Medici MC, Martinelli M, Ruggeri FM, Abelli LA, Bosco S, Arcangeletti MC, Pinardi F, De Conto F, Calderaro A, Chezzi C, Dettori G: Broadly reactive nested reverse transcription-PCR using an internal RNA standard control for detection of noroviruses in stool samples. J Clin Microbiol. 2005, 43: 3772-3778.PubMedCentralCrossRefPubMed
19.
go back to reference Thompson D: Latent Class Analysis in SAS: Promise, Problems, and Programming. SAS Global Forum 2007. Orlando, FL. 2007 Thompson D: Latent Class Analysis in SAS: Promise, Problems, and Programming. SAS Global Forum 2007. Orlando, FL. 2007
20.
go back to reference Armitage P, Berry G, Matthews J: Survival analysis. Statistical Methods in Medical Research. 2002, Oxford, UK: Blackwell Science Ltd., 568-590. 4CrossRef Armitage P, Berry G, Matthews J: Survival analysis. Statistical Methods in Medical Research. 2002, Oxford, UK: Blackwell Science Ltd., 568-590. 4CrossRef
21.
go back to reference Carter RE, Woolson RF: Statistical design considerations for pilot studies transitioning therapies from the bench to the bedside. J Transl Med. 2004, 2: 37-PubMedCentralCrossRefPubMed Carter RE, Woolson RF: Statistical design considerations for pilot studies transitioning therapies from the bench to the bedside. J Transl Med. 2004, 2: 37-PubMedCentralCrossRefPubMed
22.
go back to reference Duizer E, Pielaat A, Vennema H, Kroneman A, Koopmans M: Probabilities in norovirus outbreak diagnosis. J Clin Virol. 2007, 40: 38-42.CrossRefPubMed Duizer E, Pielaat A, Vennema H, Kroneman A, Koopmans M: Probabilities in norovirus outbreak diagnosis. J Clin Virol. 2007, 40: 38-42.CrossRefPubMed
23.
go back to reference Parashar U, Quiroz ES, Mounts AW, Monroe SS, Fankhauser RL, Ando T, Noel JS, Bulens SN, Beard SR, Li JF: "Norwalk-like viruses". Public health consequences and outbreak management. MMWR Recomm Rep. 2001, 50: 1-17.PubMed Parashar U, Quiroz ES, Mounts AW, Monroe SS, Fankhauser RL, Ando T, Noel JS, Bulens SN, Beard SR, Li JF: "Norwalk-like viruses". Public health consequences and outbreak management. MMWR Recomm Rep. 2001, 50: 1-17.PubMed
24.
go back to reference Kohler H, Jungert J, Korn K: Norovirus pseudo-outbreak in a neonatal intensive care unit. J Pediatr Gastroenterol Nutr. 2008, 46: 471-472.CrossRefPubMed Kohler H, Jungert J, Korn K: Norovirus pseudo-outbreak in a neonatal intensive care unit. J Pediatr Gastroenterol Nutr. 2008, 46: 471-472.CrossRefPubMed
25.
go back to reference Siebenga JJ, Beersma MF, Vennema H, van Biezen P, Hartwig NJ, Koopmans M: High prevalence of prolonged norovirus shedding and illness among hospitalized patients: a model for in vivo molecular evolution. J Infect Dis. 2008, 198: 994-1001.CrossRefPubMed Siebenga JJ, Beersma MF, Vennema H, van Biezen P, Hartwig NJ, Koopmans M: High prevalence of prolonged norovirus shedding and illness among hospitalized patients: a model for in vivo molecular evolution. J Infect Dis. 2008, 198: 994-1001.CrossRefPubMed
26.
go back to reference Atmar RL, Opekun AR, Gilger MA, Estes MK, Crawford SE, Neill FH, Graham DY: Norwalk virus shedding after experimental human infection. Emerg Infect Dis. 2008, 14: 1553-1557.PubMedCentralCrossRefPubMed Atmar RL, Opekun AR, Gilger MA, Estes MK, Crawford SE, Neill FH, Graham DY: Norwalk virus shedding after experimental human infection. Emerg Infect Dis. 2008, 14: 1553-1557.PubMedCentralCrossRefPubMed
27.
go back to reference Outbreaks of respiratory illness mistakenly attributed to pertussis – New Hampshire, Massachusetts, and Tennessee, 2004–2006. MMWR Morb Mortal Wkly Rep. 2007, 56: 837-842. Outbreaks of respiratory illness mistakenly attributed to pertussis – New Hampshire, Massachusetts, and Tennessee, 2004–2006. MMWR Morb Mortal Wkly Rep. 2007, 56: 837-842.
28.
go back to reference Rogers SM, Miller WC, Turner CF, Ellen J, Zenilman J, Rothman R, Villarroel MA, Al-Tayyib A, Leone P, Gaydos C: Concordance of chlamydia trachomatis infections within sexual partnerships. Sex Transm Infect. 2008, 84: 23-28.CrossRefPubMed Rogers SM, Miller WC, Turner CF, Ellen J, Zenilman J, Rothman R, Villarroel MA, Al-Tayyib A, Leone P, Gaydos C: Concordance of chlamydia trachomatis infections within sexual partnerships. Sex Transm Infect. 2008, 84: 23-28.CrossRefPubMed
Metadata
Title
Of gastro and the gold standard: evaluation and policy implications of norovirus test performance for outbreak detection
Authors
David N Fisman
Amy L Greer
George Brouhanski
Steven J Drews
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Journal of Translational Medicine / Issue 1/2009
Electronic ISSN: 1479-5876
DOI
https://doi.org/10.1186/1479-5876-7-23

Other articles of this Issue 1/2009

Journal of Translational Medicine 1/2009 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.