Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

A two-stage Bayesian method for estimating accuracy and disease prevalence for two dependent dichotomous screening tests when the status of individuals who are negative on both tests is unverified

Authors: Jin Liu, Feng Chen, Hao Yu, Ping Zeng, Liya Liu

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Estimating the disease prevalence and test accuracy (sensitivity and specificity) for two dependent screening tests when the status of individuals who are negative on both tests is unverified represents a considerable challenge, as the disease rates for individuals negative on both tests are not identifiable without additional assumptions.

Methods

This article presents a unified framework for handling this non-identifiability problem using two-step hierarchical informative prior on the sensitivities by two-stage Bayesian modeling with the characterized by joint testing strategies based on the inherent attribute of screening/diagnostic tests. We assign a diffuse and less risky two-step hierarchical informative uniform prior to the sensitivities while assigning a uniform (0,1) prior distribution to the specificities and prevalence. Strategies for model evaluation, general global evaluations, and individual cell checking are presented. Simulations are conducted under various scenarios to evaluate the performance of the proposed method. Applications to real data are also presented to illustrate the potential impact and benefit of the proposed method.

Results

Our results indicate that when the priors of sensitivities are assigned as appropriate two-step hierarchical informative priors, or even in the absence of the priors for the specificities and prevalence, the parameters involved in this study can still be estimated well. The advantages and limitations of this method in solving such problems are discussed and compared with other two-stage methods.

Conclusions

We developed a two-stage Bayesian method for two dependent dichotomous screening tests with unverified individuals who are negative on both tests, and addressed the ad hoc model evaluation and checking procedures. The method can be understood easily and used conveniently by non-statisticians.
Appendix
Available only for authorised users
Literature
1.
go back to reference Macaskill P, Walter SD, Irwig L, Franco EL: Assessing the gain in diagnostic performance when combining two diagnostic tests. Stat Med. 2002, 21 (17): 2527-2546. 10.1002/sim.1227.CrossRefPubMed Macaskill P, Walter SD, Irwig L, Franco EL: Assessing the gain in diagnostic performance when combining two diagnostic tests. Stat Med. 2002, 21 (17): 2527-2546. 10.1002/sim.1227.CrossRefPubMed
2.
go back to reference Castiglione G, Zappa M, Grazzini G, Mazzotta A, Biagini M, Salvadori P, Ciatto S: Immunochemical vs guaiac faecal occult blood tests in a population-based screening programme for colorectal cancer. Brit J Cancer. 1996, 74 (1): 141-144. 10.1038/bjc.1996.329.CrossRefPubMedPubMedCentral Castiglione G, Zappa M, Grazzini G, Mazzotta A, Biagini M, Salvadori P, Ciatto S: Immunochemical vs guaiac faecal occult blood tests in a population-based screening programme for colorectal cancer. Brit J Cancer. 1996, 74 (1): 141-144. 10.1038/bjc.1996.329.CrossRefPubMedPubMedCentral
3.
go back to reference Branscum AJ, Gardner IA, Johnson WO: Bayesian modeling of animal- and herd-level prevalences. Prev Vet Med. 2004, 66 (1–4): 101-112.CrossRefPubMed Branscum AJ, Gardner IA, Johnson WO: Bayesian modeling of animal- and herd-level prevalences. Prev Vet Med. 2004, 66 (1–4): 101-112.CrossRefPubMed
4.
go back to reference Liu P, Xiao S, Shi ZX, Bi XX, Yang HT, Jin H: Bayesian evaluation of the human immunodeficiency virus antibody screening strategy of duplicate enzyme-linked immunosorbent assay in Xuzhou Blood Center, China. Transfusion. 2011, 51 (4): 793-798. 10.1111/j.1537-2995.2010.02890.x.CrossRefPubMed Liu P, Xiao S, Shi ZX, Bi XX, Yang HT, Jin H: Bayesian evaluation of the human immunodeficiency virus antibody screening strategy of duplicate enzyme-linked immunosorbent assay in Xuzhou Blood Center, China. Transfusion. 2011, 51 (4): 793-798. 10.1111/j.1537-2995.2010.02890.x.CrossRefPubMed
5.
go back to reference Berkvens D, Speybroeck N, Praet N, Adel A, Lesaffre E: Estimating disease prevalence in a Bayesian framework using probabilistic constraints. Epidemiology. 2006, 17 (2): 145-153. 10.1097/01.ede.0000198422.64801.8d.CrossRefPubMed Berkvens D, Speybroeck N, Praet N, Adel A, Lesaffre E: Estimating disease prevalence in a Bayesian framework using probabilistic constraints. Epidemiology. 2006, 17 (2): 145-153. 10.1097/01.ede.0000198422.64801.8d.CrossRefPubMed
6.
go back to reference Berry G, Smith CL, Macaskill P, Irwig L: Analytic methods for comparing two dichotomous screening or diagnostic tests applied to two populations of differing disease prevalence when individuals negative on both tests are unverified. Stat Med. 2002, 21 (6): 853-862. 10.1002/sim.1066.CrossRefPubMed Berry G, Smith CL, Macaskill P, Irwig L: Analytic methods for comparing two dichotomous screening or diagnostic tests applied to two populations of differing disease prevalence when individuals negative on both tests are unverified. Stat Med. 2002, 21 (6): 853-862. 10.1002/sim.1066.CrossRefPubMed
7.
go back to reference Chu H, Zhou Y, Cole SR, Ibrahim JG: On the estimation of disease prevalence by latent class models for screening studies using two screening tests with categorical disease status verified in test positives only. Stat Med. 2010, 29 (11): 1206-1218.PubMedPubMedCentral Chu H, Zhou Y, Cole SR, Ibrahim JG: On the estimation of disease prevalence by latent class models for screening studies using two screening tests with categorical disease status verified in test positives only. Stat Med. 2010, 29 (11): 1206-1218.PubMedPubMedCentral
8.
go back to reference Li F, Chu H, Nie L: A two-stage estimation for screening studies using two diagnostic tests with binary disease status verified in test positives only. Stat Met Med Res. 2011, Epub ahead of print Li F, Chu H, Nie L: A two-stage estimation for screening studies using two diagnostic tests with binary disease status verified in test positives only. Stat Met Med Res. 2011, Epub ahead of print
9.
go back to reference Walter SD: Estimation of test sensitivity and specificity when disease confirmation is limited to positive results. Epidemiology. 1999, 10 (1): 67-72. 10.1097/00001648-199901000-00012.CrossRefPubMed Walter SD: Estimation of test sensitivity and specificity when disease confirmation is limited to positive results. Epidemiology. 1999, 10 (1): 67-72. 10.1097/00001648-199901000-00012.CrossRefPubMed
10.
go back to reference van der Merwe L, Maritz JS: Estimating the conditional false-positive rate for semi-latent data. Epidemiology. 2002, 13 (4): 424-430. 10.1097/00001648-200207000-00010.CrossRefPubMed van der Merwe L, Maritz JS: Estimating the conditional false-positive rate for semi-latent data. Epidemiology. 2002, 13 (4): 424-430. 10.1097/00001648-200207000-00010.CrossRefPubMed
11.
go back to reference Bohning D, Patilea V: A capture-recapture approach for screening using two diagnostic tests with availability of disease status for the test positives only. J Am Stat Assoc. 2008, 103 (481): 212-221. 10.1198/016214507000000383.CrossRef Bohning D, Patilea V: A capture-recapture approach for screening using two diagnostic tests with availability of disease status for the test positives only. J Am Stat Assoc. 2008, 103 (481): 212-221. 10.1198/016214507000000383.CrossRef
12.
go back to reference Branscum AJ, Gardner IA, Johnson WO: Estimation of diagnostic test sensitivity and specificity through Bayesian modeling. Prev Vet Med. 2005, 68 (2–4): 145-163.CrossRefPubMed Branscum AJ, Gardner IA, Johnson WO: Estimation of diagnostic test sensitivity and specificity through Bayesian modeling. Prev Vet Med. 2005, 68 (2–4): 145-163.CrossRefPubMed
13.
go back to reference Cheng D, Stamey JD, Branscum AJ: Bayesian approach to average power calculations for binary regression models with misclassified outcomes. Stat Med. 2009, 28 (5): 848-863. 10.1002/sim.3505.CrossRefPubMed Cheng D, Stamey JD, Branscum AJ: Bayesian approach to average power calculations for binary regression models with misclassified outcomes. Stat Med. 2009, 28 (5): 848-863. 10.1002/sim.3505.CrossRefPubMed
14.
go back to reference Hanson TE, Johnson WO, Gastwirth JL: Bayesian inference for prevalence and diagnostic test accuracy based on dual-pooled screening. Biostatistics. 2006, 7 (1): 41-57.CrossRefPubMed Hanson TE, Johnson WO, Gastwirth JL: Bayesian inference for prevalence and diagnostic test accuracy based on dual-pooled screening. Biostatistics. 2006, 7 (1): 41-57.CrossRefPubMed
15.
go back to reference Stamey JD, Young DM, Seaman JW: A Bayesian approach to adjust for diagnostic misclassification between two mortality causes in Poisson regression. Stat Med. 2008, 27 (13): 2440-2452. 10.1002/sim.3134.CrossRefPubMed Stamey JD, Young DM, Seaman JW: A Bayesian approach to adjust for diagnostic misclassification between two mortality causes in Poisson regression. Stat Med. 2008, 27 (13): 2440-2452. 10.1002/sim.3134.CrossRefPubMed
16.
go back to reference Suess EA, Gardner IA, Johnson WO: Hierarchical Bayesian model for prevalence inferences and determination of a country’s status for an animal pathogen. Prev Vet Med. 2002, 55 (3): 155-171. 10.1016/S0167-5877(02)00092-2.CrossRefPubMed Suess EA, Gardner IA, Johnson WO: Hierarchical Bayesian model for prevalence inferences and determination of a country’s status for an animal pathogen. Prev Vet Med. 2002, 55 (3): 155-171. 10.1016/S0167-5877(02)00092-2.CrossRefPubMed
17.
go back to reference Xia M, Gustafson P: A Bayesian method for estimating prevalence in the presence of a hidden sub-population. Stat Med. 2012, 31 (21): 2386-2398. 10.1002/sim.5374.CrossRefPubMed Xia M, Gustafson P: A Bayesian method for estimating prevalence in the presence of a hidden sub-population. Stat Med. 2012, 31 (21): 2386-2398. 10.1002/sim.5374.CrossRefPubMed
18.
go back to reference Black MA, Craig BA: Estimating disease prevalence in the absence of a gold standard. Stat Med. 2002, 21 (18): 2653-2669. 10.1002/sim.1178.CrossRefPubMed Black MA, Craig BA: Estimating disease prevalence in the absence of a gold standard. Stat Med. 2002, 21 (18): 2653-2669. 10.1002/sim.1178.CrossRefPubMed
19.
go back to reference Erkanli A, Soyer R, Stangl D: Bayesian inference in two-phase prevalence studies. Stat Med. 1997, 16 (10): 1121-1133. 10.1002/(SICI)1097-0258(19970530)16:10<1121::AID-SIM526>3.0.CO;2-L.CrossRefPubMed Erkanli A, Soyer R, Stangl D: Bayesian inference in two-phase prevalence studies. Stat Med. 1997, 16 (10): 1121-1133. 10.1002/(SICI)1097-0258(19970530)16:10<1121::AID-SIM526>3.0.CO;2-L.CrossRefPubMed
20.
go back to reference Dendukuri N, Joseph L: Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001, 57 (1): 158-167. 10.1111/j.0006-341X.2001.00158.x.CrossRefPubMed Dendukuri N, Joseph L: Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001, 57 (1): 158-167. 10.1111/j.0006-341X.2001.00158.x.CrossRefPubMed
21.
go back to reference Spiegelhalter DJ, Best NG, Carlin BP: Bayesian measures of model complexity and fit (with discussion). J R Stat Soc Ser B. 2002, 64: 583-640. 10.1111/1467-9868.00353.CrossRef Spiegelhalter DJ, Best NG, Carlin BP: Bayesian measures of model complexity and fit (with discussion). J R Stat Soc Ser B. 2002, 64: 583-640. 10.1111/1467-9868.00353.CrossRef
22.
go back to reference Su CL, Gardner IA, Johnson WO: Diagnostic test accuracy and prevalence inferences based on joint and sequential testing with finite population sampling. Stat Med. 2004, 23 (14): 2237-2255. 10.1002/sim.1809.CrossRefPubMed Su CL, Gardner IA, Johnson WO: Diagnostic test accuracy and prevalence inferences based on joint and sequential testing with finite population sampling. Stat Med. 2004, 23 (14): 2237-2255. 10.1002/sim.1809.CrossRefPubMed
23.
go back to reference Berry SM, Carlin BP, Lee JJ, Muller P: Bayesian adaptive methods for clinical trials. CRC press; 2010: 72 Berry SM, Carlin BP, Lee JJ, Muller P: Bayesian adaptive methods for clinical trials. CRC press; 2010: 72
24.
go back to reference Lu Y, Dendukuri N, Schiller I, Joseph L: A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med. 2010, 29 (24): 2532-2543. 10.1002/sim.4018.CrossRefPubMed Lu Y, Dendukuri N, Schiller I, Joseph L: A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med. 2010, 29 (24): 2532-2543. 10.1002/sim.4018.CrossRefPubMed
25.
go back to reference Joseph L, Gyorkos TW, Coupal L: Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. Am J Epidemiol. 1995, 141 (3): 263-272.PubMed Joseph L, Gyorkos TW, Coupal L: Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. Am J Epidemiol. 1995, 141 (3): 263-272.PubMed
26.
go back to reference Mao SS: Bayesian Statistics. 2005, Beijing: China Statistics Press, 105-110. Mao SS: Bayesian Statistics. 2005, Beijing: China Statistics Press, 105-110.
28.
go back to reference Gelman A, Rubin DB: Inference from iterative simulation using multiple sequences. Stat Sci. 1992, 7: 457-511. 10.1214/ss/1177011136.CrossRef Gelman A, Rubin DB: Inference from iterative simulation using multiple sequences. Stat Sci. 1992, 7: 457-511. 10.1214/ss/1177011136.CrossRef
29.
go back to reference Ntzoufras I: Bayesian Modeling Using WinBUGS. 2009, John Wiley & Sons, Inc: Hoboken, New JerseyCrossRef Ntzoufras I: Bayesian Modeling Using WinBUGS. 2009, John Wiley & Sons, Inc: Hoboken, New JerseyCrossRef
30.
go back to reference Castiglione G, Zappa M, Grazzini G, Sani C, Mazzotta A, Mantellini P, Ciatto S: Cost analysis in a population based screening programme for colorectal cancer: comparison of immunochemical and guaiac faecal occult blood testing. J Med Screen. 1997, 4 (3): 142-146.PubMed Castiglione G, Zappa M, Grazzini G, Sani C, Mazzotta A, Mantellini P, Ciatto S: Cost analysis in a population based screening programme for colorectal cancer: comparison of immunochemical and guaiac faecal occult blood testing. J Med Screen. 1997, 4 (3): 142-146.PubMed
31.
go back to reference Liu P, Yang HT, Qiang LY, Xiao S, Shi ZX: Estimation of the sensitivity and specificity of assays for screening antibodies to HIV: a comparison between the frequentist and Bayesian approaches. J Virol Met. 2012, 186: 89-93. 10.1016/j.jviromet.2012.08.018.CrossRef Liu P, Yang HT, Qiang LY, Xiao S, Shi ZX: Estimation of the sensitivity and specificity of assays for screening antibodies to HIV: a comparison between the frequentist and Bayesian approaches. J Virol Met. 2012, 186: 89-93. 10.1016/j.jviromet.2012.08.018.CrossRef
Metadata
Title
A two-stage Bayesian method for estimating accuracy and disease prevalence for two dependent dichotomous screening tests when the status of individuals who are negative on both tests is unverified
Authors
Jin Liu
Feng Chen
Hao Yu
Ping Zeng
Liya Liu
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-110

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue