Skip to main content
Top
Published in: Emerging Themes in Epidemiology 1/2012

Open Access 01-12-2012 | Analytic perspective

A tutorial in estimating the prevalence of disease in humans and animals in the absence of a gold standard diagnostic

Authors: Fraser I Lewis, Paul R Torgerson

Published in: Emerging Themes in Epidemiology | Issue 1/2012

Login to get access

Abstract

Abstract

Epidemiological methods for estimating disease prevalence in humans and other animals in the absence of a gold standard diagnostic test are well established. Despite this, reporting apparent prevalence is still standard practice in public health studies and disease control programmes, even though apparent prevalence may differ greatly from the true prevalence of disease. Methods for estimating true prevalence are summarized and reviewed. A computing appendix is also provided which contains a brief guide in how to easily implement some of the methods presented using freely available software.
Appendix
Available only for authorised users
Literature
1.
go back to reference Greiner M, Gardner IA: Epidemiologic issues in the validation of veterinary diagnostic tests. Preventive Veterinary Med. 2000, 45 (1-2): 3-22. 10.1016/S0167-5877(00)00114-8.CrossRef Greiner M, Gardner IA: Epidemiologic issues in the validation of veterinary diagnostic tests. Preventive Veterinary Med. 2000, 45 (1-2): 3-22. 10.1016/S0167-5877(00)00114-8.CrossRef
2.
go back to reference Guatteo R, Seegers H, Taurel AF, Joly A, Beaudeau F: Prevalence of Coxiella burnetii infection in domestic ruminants: A critical review. Veterinary Microbiol. 2011, 149 (1-2): 1-16. 10.1016/j.vetmic.2010.10.007.CrossRef Guatteo R, Seegers H, Taurel AF, Joly A, Beaudeau F: Prevalence of Coxiella burnetii infection in domestic ruminants: A critical review. Veterinary Microbiol. 2011, 149 (1-2): 1-16. 10.1016/j.vetmic.2010.10.007.CrossRef
3.
go back to reference Rabenau HF, Kessler HH, Kortenbusch M, Steinhorst A, Raggam RB, Berger A: Verification and validation of diagnostic laboratory tests in clinical virology. J Clin Virol. 2007, 40 (2): 93-98. 10.1016/j.jcv.2007.07.009CrossRefPubMed Rabenau HF, Kessler HH, Kortenbusch M, Steinhorst A, Raggam RB, Berger A: Verification and validation of diagnostic laboratory tests in clinical virology. J Clin Virol. 2007, 40 (2): 93-98. 10.1016/j.jcv.2007.07.009CrossRefPubMed
4.
go back to reference Enoe C, Georgiadis MP, Johnson WO: Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Med. 2000, 45 (1-2): 61-81. 10.1016/S0167-5877(00)00117-3.CrossRef Enoe C, Georgiadis MP, Johnson WO: Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Med. 2000, 45 (1-2): 61-81. 10.1016/S0167-5877(00)00117-3.CrossRef
5.
go back to reference Greiner M, Gardner IA: Application of diagnostic tests in veterinary epidemiologic studies. Preventive Veterinary Med. 2000, 45 (1-2): 43-59. 10.1016/S0167-5877(00)00116-1CrossRef Greiner M, Gardner IA: Application of diagnostic tests in veterinary epidemiologic studies. Preventive Veterinary Med. 2000, 45 (1-2): 43-59. 10.1016/S0167-5877(00)00116-1CrossRef
6.
go back to reference Gardner IA, Stryhn H, Lind P, Collins MT: Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. Preventive Veterinary Med. 2000, 45 (1-2): 107-122. 10.1016/S0167-5877(00)00119-7.CrossRef Gardner IA, Stryhn H, Lind P, Collins MT: Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. Preventive Veterinary Med. 2000, 45 (1-2): 107-122. 10.1016/S0167-5877(00)00119-7.CrossRef
7.
go back to reference Christensen J, Gardner IA: Herd-level interpretation of test results for epidemiologic studies of animal diseases. Preventive Veterinary Med. 2000, 45 (1-2): 83-106. 10.1016/S0167-5877(00)00118-5.CrossRef Christensen J, Gardner IA: Herd-level interpretation of test results for epidemiologic studies of animal diseases. Preventive Veterinary Med. 2000, 45 (1-2): 83-106. 10.1016/S0167-5877(00)00118-5.CrossRef
8.
go back to reference Hui SL, Walter SD: Estimating The Error Rates of Diagnostic-Tests. Biometrics. 1980, 36: 167-171. 10.2307/2530508CrossRefPubMed Hui SL, Walter SD: Estimating The Error Rates of Diagnostic-Tests. Biometrics. 1980, 36: 167-171. 10.2307/2530508CrossRefPubMed
11.
go back to reference Joseph L, Gyorkos TW, Coupal L: Bayesian-Estimation of Disease Prevalence And The Parameters of Diagnostic-Tests In The Absence of A Gold Standard. Am J Epidemiol. 1995, 141 (3): 263-272.PubMed Joseph L, Gyorkos TW, Coupal L: Bayesian-Estimation of Disease Prevalence And The Parameters of Diagnostic-Tests In The Absence of A Gold Standard. Am J Epidemiol. 1995, 141 (3): 263-272.PubMed
12.
go back to reference Qu YS, Tan M, Kutner MH: Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics. 1996, 52 (3): 797-810. 10.2307/2533043CrossRefPubMed Qu YS, Tan M, Kutner MH: Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics. 1996, 52 (3): 797-810. 10.2307/2533043CrossRefPubMed
13.
go back to reference Dendukuri N, Joseph L: Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001, 57: 158-167. 10.1111/j.0006-341X.2001.00158.xCrossRefPubMed Dendukuri N, Joseph L: Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001, 57: 158-167. 10.1111/j.0006-341X.2001.00158.xCrossRefPubMed
14.
go back to reference Dendukuri N, Belisle P, Joseph L: Bayesian sample size for diagnostic test studies in the absence of a gold standard: Comparing identifiable with non-identifiable models. Stat Med. 2010, 29 (26): 2688-2697. 10.1002/sim.4037CrossRefPubMed Dendukuri N, Belisle P, Joseph L: Bayesian sample size for diagnostic test studies in the absence of a gold standard: Comparing identifiable with non-identifiable models. Stat Med. 2010, 29 (26): 2688-2697. 10.1002/sim.4037CrossRefPubMed
15.
go back to reference Lu Y, Dendukuri N, Schiller I, Joseph L: A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med. 2010, 29 (24): 2532-2543. 10.1002/sim.4018CrossRefPubMed Lu Y, Dendukuri N, Schiller I, Joseph L: A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med. 2010, 29 (24): 2532-2543. 10.1002/sim.4018CrossRefPubMed
16.
go back to reference Branscum AJ, Gardner IA, Johnson WO: Bayesian modeling of animal- and herd-level prevalences. Preventive Veterinary Med. 2004, 66 (1-4): 10.1016/j.prevetmed.2004.09.009CrossRef Branscum AJ, Gardner IA, Johnson WO: Bayesian modeling of animal- and herd-level prevalences. Preventive Veterinary Med. 2004, 66 (1-4): 10.1016/j.prevetmed.2004.09.009CrossRef
17.
go back to reference Branscum AJ, Gardner IA, Johnson WO: Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. Preventive Veterinary Med. 2005, 68 (2-4): 145-163. 10.1016/j.prevetmed.2004.12.005CrossRef Branscum AJ, Gardner IA, Johnson WO: Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. Preventive Veterinary Med. 2005, 68 (2-4): 145-163. 10.1016/j.prevetmed.2004.12.005CrossRef
18.
go back to reference Dendukuri N, Rahme E, Belisle P, Joseph L: Bayesian sample size determination for prevalence and diagnostic test studies in the absence of a gold standard test. Biometrics. 2004, 60 (2): 388-397. 10.1111/j.0006-341X.2004.00183.xCrossRefPubMed Dendukuri N, Rahme E, Belisle P, Joseph L: Bayesian sample size determination for prevalence and diagnostic test studies in the absence of a gold standard test. Biometrics. 2004, 60 (2): 388-397. 10.1111/j.0006-341X.2004.00183.xCrossRefPubMed
19.
go back to reference Hanson T, Johnson WO, Gardner IA: Hierarchical Models for Estimating Herd Prevalence and Test Accuracy in the Absence of a Gold Standard. J Agric, Biol, Environ Stat. 2003, 8 (2): 223-239. 10.1198/1085711031526.CrossRef Hanson T, Johnson WO, Gardner IA: Hierarchical Models for Estimating Herd Prevalence and Test Accuracy in the Absence of a Gold Standard. J Agric, Biol, Environ Stat. 2003, 8 (2): 223-239. 10.1198/1085711031526.CrossRef
20.
go back to reference Lewis F, Sanchez-Vazquez MJ, Torgerson PR: Association between covariates and disease occurrence in the presence of diagnostic error. Epidemiol Infection. 2012, 140 (8): 1515-1524. 10.1017/S0950268811001932.CrossRef Lewis F, Sanchez-Vazquez MJ, Torgerson PR: Association between covariates and disease occurrence in the presence of diagnostic error. Epidemiol Infection. 2012, 140 (8): 1515-1524. 10.1017/S0950268811001932.CrossRef
21.
go back to reference Pfeiffer DU: Veterinary Epidemiology An Introduction. United Kingdom: Wiley-Blackwell; 2010. Pfeiffer DU: Veterinary Epidemiology An Introduction. United Kingdom: Wiley-Blackwell; 2010.
22.
go back to reference Rogan WJ, Gladen B: Estimating Prevalence From Results of A Screening-test. Am J Epidemiol. 1978, 107: 71-76.PubMed Rogan WJ, Gladen B: Estimating Prevalence From Results of A Screening-test. Am J Epidemiol. 1978, 107: 71-76.PubMed
23.
go back to reference HIilden J: Estimating Prevalence From the Results of A Screening-test - Comment. Am J Epidemiol. 1979, 109 (6): 721-722. HIilden J: Estimating Prevalence From the Results of A Screening-test - Comment. Am J Epidemiol. 1979, 109 (6): 721-722.
24.
go back to reference Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility. Stat Comput. 2000, 10 (4): 325-337. 10.1023/A:1008929526011CrossRef Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility. Stat Comput. 2000, 10 (4): 325-337. 10.1023/A:1008929526011CrossRef
25.
go back to reference Plummer M: JAGS: a program for analysis of Bayesian graphical models using, Gibbs sampling. In Hornik K, et al., editors. Proceedings of the 3rd Internation Workshop on Distributed Statistical Computing. Vienna, Austria; 2003. Plummer M: JAGS: a program for analysis of Bayesian graphical models using, Gibbs sampling. In Hornik K, et al., editors. Proceedings of the 3rd Internation Workshop on Distributed Statistical Computing. Vienna, Austria; 2003.
27.
go back to reference Pepe MS, Janes H: Insights into latent class analysis of diagnostic test performance. Biostatistics. 2007, 8 (2): 474-484.CrossRefPubMed Pepe MS, Janes H: Insights into latent class analysis of diagnostic test performance. Biostatistics. 2007, 8 (2): 474-484.CrossRefPubMed
28.
go back to reference Gelman A, Carlin JB, Stern HS, Rubin DB: Bayesian Data Analysis. Boca Raton: Chapman and Hall/CRC; 2003, ISBN 1-58488-388-X. Gelman A, Carlin JB, Stern HS, Rubin DB: Bayesian Data Analysis. Boca Raton: Chapman and Hall/CRC; 2003, ISBN 1-58488-388-X.
29.
go back to reference Congdon P: Bayesian Statistical Modelling. The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, England: John Wiley and Sons Ltd; 2001. Congdon P: Bayesian Statistical Modelling. The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, England: John Wiley and Sons Ltd; 2001.
30.
go back to reference Spiegelhalter DJ, Best NG, Carlin BR, van der Linde A: Bayesian measures of model complexity and fit. J R Stat Soc Ser B-Stat Methodology. 2002, 64: 583-616. 10.1111/1467-9868.00353CrossRef Spiegelhalter DJ, Best NG, Carlin BR, van der Linde A: Bayesian measures of model complexity and fit. J R Stat Soc Ser B-Stat Methodology. 2002, 64: 583-616. 10.1111/1467-9868.00353CrossRef
31.
go back to reference Celeux G, Forbes F, Robert CP, Titterington DM: Deviance Information Criteria for Missing Data Models. Bayesian Anal. 2006, 1 (4): 651-673. 10.1214/06-BA122.CrossRef Celeux G, Forbes F, Robert CP, Titterington DM: Deviance Information Criteria for Missing Data Models. Bayesian Anal. 2006, 1 (4): 651-673. 10.1214/06-BA122.CrossRef
32.
go back to reference R Development CoreTeam:R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2006, [http://www.R-project.org]. [ISBN 3-900051-07-0]. R Development CoreTeam:R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2006, [http://​www.​R-project.​org]. [ISBN 3-900051-07-0].
33.
go back to reference Jackson: R (on the application of Jackson) v DEFRA [2011] EWHC 956 (Admin), [2011] All ER (D) 141 (Apr). 2011. Jackson: R (on the application of Jackson) v DEFRA [2011] EWHC 956 (Admin), [2011] All ER (D) 141 (Apr). 2011.
34.
go back to reference Whelan AO, Clifford D, Upadhyay B, Breadon EL, McNair J, Hewinson GR, Vordermeier MH: Development of a Skin Test for Bovine Tuberculosis for Differentiating Infected from Vaccinated Animals. J Clin Microbiol. 2010, 48 (9): 3176-3181. 10.1128/JCM.00420-10PubMedCentralCrossRefPubMed Whelan AO, Clifford D, Upadhyay B, Breadon EL, McNair J, Hewinson GR, Vordermeier MH: Development of a Skin Test for Bovine Tuberculosis for Differentiating Infected from Vaccinated Animals. J Clin Microbiol. 2010, 48 (9): 3176-3181. 10.1128/JCM.00420-10PubMedCentralCrossRefPubMed
35.
go back to reference Defra: Gamma Interferon diagnostic blood test for bovine tuberculosis: A Review of the GB Gamma Interferon testing policy for tuberculosis in cattle. Tech. rep., Defra, UK, 2009. Defra: Gamma Interferon diagnostic blood test for bovine tuberculosis: A Review of the GB Gamma Interferon testing policy for tuberculosis in cattle. Tech. rep., Defra, UK, 2009.
36.
go back to reference Schiller I, Waters WR, Vordermeier HM, Nonnecke B, Welsh M, Keck N, Whelan A, Sigafoose T, Stamm C, Palmer M, Thacker T, Hardegger R, Marg-Haufe B, Raeber A, Oesch B: Optimization of a Whole-Blood Gamma Interferon Assay for Detection of Mycobacterium bovis-Infected Cattle. Clin Vaccine Immunol. 2009, 16 (8): 1196-1202. 10.1128/CVI.00150-09PubMedCentralCrossRefPubMed Schiller I, Waters WR, Vordermeier HM, Nonnecke B, Welsh M, Keck N, Whelan A, Sigafoose T, Stamm C, Palmer M, Thacker T, Hardegger R, Marg-Haufe B, Raeber A, Oesch B: Optimization of a Whole-Blood Gamma Interferon Assay for Detection of Mycobacterium bovis-Infected Cattle. Clin Vaccine Immunol. 2009, 16 (8): 1196-1202. 10.1128/CVI.00150-09PubMedCentralCrossRefPubMed
37.
go back to reference Jones G, Johnson WO, Hanson TE, Christensen R: Identifiability of Models for Multiple Diagnostic Testing in the Absence of a Gold Standard. Biometrics. 2010, 66 (3): 855-863. 10.1111/j.1541-0420.2009.01330.xCrossRefPubMed Jones G, Johnson WO, Hanson TE, Christensen R: Identifiability of Models for Multiple Diagnostic Testing in the Absence of a Gold Standard. Biometrics. 2010, 66 (3): 855-863. 10.1111/j.1541-0420.2009.01330.xCrossRefPubMed
38.
go back to reference Gustafson P: On model expansion, model contraction, identifiability and prior information: Two illustrative scenarios involving mismeasured variables. Stat Sci. 2005, 20 (2): 111-129. 10.1214/088342305000000098.CrossRef Gustafson P: On model expansion, model contraction, identifiability and prior information: Two illustrative scenarios involving mismeasured variables. Stat Sci. 2005, 20 (2): 111-129. 10.1214/088342305000000098.CrossRef
39.
go back to reference Qu YS, Hadgu A: A model for evaluating sensitivity and specificity for correlated diagnostic tests in efficacy studies with an imperfect reference test. J Am Stat Assoc. 1998, 93 (443): 920-928. 10.1080/01621459.1998.10473748.CrossRef Qu YS, Hadgu A: A model for evaluating sensitivity and specificity for correlated diagnostic tests in efficacy studies with an imperfect reference test. J Am Stat Assoc. 1998, 93 (443): 920-928. 10.1080/01621459.1998.10473748.CrossRef
40.
go back to reference Georgiadis MP, Johnson WO, Gardner IA, Singh R: Correlation-Adjusted Estimation of Sensitivity and Specificity of Two Diagnostic Tests. J R Stat Soc Ser C (Appl Stat). 2003, 52: 63-76. 10.1111/1467-9876.00389.CrossRef Georgiadis MP, Johnson WO, Gardner IA, Singh R: Correlation-Adjusted Estimation of Sensitivity and Specificity of Two Diagnostic Tests. J R Stat Soc Ser C (Appl Stat). 2003, 52: 63-76. 10.1111/1467-9876.00389.CrossRef
41.
go back to reference Toft N, Jorgensen E, Hojsgaard S: Diagnosing diagnostic tests: evaluating the assumptions underlying the estimation of sensitivity and specificity in the absence of a gold standard. Preventive Veterinary Med. 2005, 68: 19-33. 10.1016/j.prevetmed.2005.01.006.CrossRef Toft N, Jorgensen E, Hojsgaard S: Diagnosing diagnostic tests: evaluating the assumptions underlying the estimation of sensitivity and specificity in the absence of a gold standard. Preventive Veterinary Med. 2005, 68: 19-33. 10.1016/j.prevetmed.2005.01.006.CrossRef
42.
go back to reference Brülisauer F, Lewis FI, Ganser AG, McKendrick IJ, Gunn GJ: The prevalence of bovine viral diarrhoea virus infection in beef suckler herds in Scotland. Veterinary J. 2010, 186 (2): 226-231. 10.1016/j.tvjl.2009.08.011.CrossRef Brülisauer F, Lewis FI, Ganser AG, McKendrick IJ, Gunn GJ: The prevalence of bovine viral diarrhoea virus infection in beef suckler herds in Scotland. Veterinary J. 2010, 186 (2): 226-231. 10.1016/j.tvjl.2009.08.011.CrossRef
43.
go back to reference Lewis F, Brulisauer F, Cousens C, McKendrick I, Gunn G: Diagnostic accuracy of PCR for Jaagsiekte sheep retrovirus using field data from 125 Scottish sheep flocks. Veterinary J. 2011, 187: 104-108. 10.1016/j.tvjl.2009.10.024.CrossRef Lewis F, Brulisauer F, Cousens C, McKendrick I, Gunn G: Diagnostic accuracy of PCR for Jaagsiekte sheep retrovirus using field data from 125 Scottish sheep flocks. Veterinary J. 2011, 187: 104-108. 10.1016/j.tvjl.2009.10.024.CrossRef
44.
go back to reference Pinheiro J, Bates D: Mixed-Effects Models in S and S-PLUS. New York LLC: Springer Verlag; 2009 Pinheiro J, Bates D: Mixed-Effects Models in S and S-PLUS. New York LLC: Springer Verlag; 2009
45.
go back to reference Johnson WO, Gardner IA, Metoyer CN, Branscum AJ: On the interpretation of test sensitivity in the two-test two-population problem: assumptions matter. Prev Vet Med. 2009, 91 (2-4): 116-21. 10.1016/j.prevetmed.2009.06.006CrossRefPubMed Johnson WO, Gardner IA, Metoyer CN, Branscum AJ: On the interpretation of test sensitivity in the two-test two-population problem: assumptions matter. Prev Vet Med. 2009, 91 (2-4): 116-21. 10.1016/j.prevetmed.2009.06.006CrossRefPubMed
46.
go back to reference Dorny P, Phiri IK, Vercruysse J, Gabriel S, Willingham AL, Brandt J, Victor B, Speybroeck N, Berkvens D: A Bayesian approach for estimating values for prevalence and diagnostic test characteristics of porcine cysticercosis. Int J Parasitology. 2004, 34 (5): 569-576. 10.1016/j.ijpara.2003.11.014.CrossRef Dorny P, Phiri IK, Vercruysse J, Gabriel S, Willingham AL, Brandt J, Victor B, Speybroeck N, Berkvens D: A Bayesian approach for estimating values for prevalence and diagnostic test characteristics of porcine cysticercosis. Int J Parasitology. 2004, 34 (5): 569-576. 10.1016/j.ijpara.2003.11.014.CrossRef
Metadata
Title
A tutorial in estimating the prevalence of disease in humans and animals in the absence of a gold standard diagnostic
Authors
Fraser I Lewis
Paul R Torgerson
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Emerging Themes in Epidemiology / Issue 1/2012
Electronic ISSN: 1742-7622
DOI
https://doi.org/10.1186/1742-7622-9-9

Other articles of this Issue 1/2012

Emerging Themes in Epidemiology 1/2012 Go to the issue