Skip to main content
Top
Published in: BMC Public Health 1/2019

Open Access 01-12-2019 | Yersina Enterocolitica | Research article

Incidence estimation from sentinel surveillance data; a simulation study and application to data from the Belgian laboratory sentinel surveillance

Authors: Toon Braeye, Sophie Quoilin, Niel Hens

Published in: BMC Public Health | Issue 1/2019

Login to get access

Abstract

Background

Inverse probability weighting (IPW) methods can be used to estimate the total number of cases from the sample collected through sentinel surveillance. Central to these methods are the inverse weights which can be derived in several ways and, in this case, represent the probability that laboratory (lab) sentinel surveillance detects a lab-confirmed case.

Methods

We compare different weights in a simulation study. Weights are obtained from the proportion of participating labs over all labs. We adjust these weights for attractiveness and density of labs over population. The market share of sentinel labs, as estimated by the econometric Huff-model, is also considered. Additionally, we investigate the effect of not recognizing sentinel labs as sentinel labs when they report no cases. We estimate the bias associated with the different weights as the difference between the simulated number of cases and the estimate of this total from the sentinel sample.
As motivating data examples, we apply an extended Huff-model to four pathogens under laboratory sentinel surveillance in Belgium between 2010 and 2015 and discuss the model fit. We estimate the total number of lab-confirmed cases associated with Rotavirus, influenza virus, Y. enterocolitica and Campylobacter spp.. The extended Huff-model takes the lab-concept, the number of reimbursements and the number of departments, lab-density, regional borders, distance and competition between labs in account.

Results

Estimates obtained with the Huff-model were most accurate in the more complex simulation scenarios as compared to other weights. In the data examples, several significant coefficients are identified, but the fit of the Huff-model to the Belgian sentinel surveillance data leaves much variability in market shares unexplained.

Conclusion

The Huff-model allows for estimation of the spatial and population coverage of sentinel surveillance and through IPW-methods also for the estimation of the total number of cases. The Huff-model‘s gravity function allows us to differentiate inside an area while estimating from the full dataset. Our data examples show that additional data on the participation to surveillance and practices of labs is necessary for a more accurate estimation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Porta M. A Dictionary of Epidemiology. Oxford: Oxford University Press; 2014. Porta M. A Dictionary of Epidemiology. Oxford: Oxford University Press; 2014.
2.
go back to reference Schrag SJ, Zell ER, Schuchat A, Whitney CG. Sentinel surveillance: a reliable way to track antibiotic resistance in communities? Emerg Infect Dis. 2002;8:496–502.CrossRef Schrag SJ, Zell ER, Schuchat A, Whitney CG. Sentinel surveillance: a reliable way to track antibiotic resistance in communities? Emerg Infect Dis. 2002;8:496–502.CrossRef
3.
go back to reference Rodríguez-Prieto V, Vicente-Rubiano M, Sánchez-Matamoros A, Rubio-Guerri C, Melero M, Martínez-López B, et al. Systematic review of surveillance systems and methods for early detection of exotic, new and re-emerging diseases in animal populations. Epidemiol Infect. 2015;143:2018–42.CrossRef Rodríguez-Prieto V, Vicente-Rubiano M, Sánchez-Matamoros A, Rubio-Guerri C, Melero M, Martínez-López B, et al. Systematic review of surveillance systems and methods for early detection of exotic, new and re-emerging diseases in animal populations. Epidemiol Infect. 2015;143:2018–42.CrossRef
5.
go back to reference Chevalier V, Lecollinet S, Durand B. West Nile virus in Europe: a comparison of surveillance system designs in a changing epidemiological context. Vector Borne Zoonotic Dis Larchmt N. 2011;11:1085–91.CrossRef Chevalier V, Lecollinet S, Durand B. West Nile virus in Europe: a comparison of surveillance system designs in a changing epidemiological context. Vector Borne Zoonotic Dis Larchmt N. 2011;11:1085–91.CrossRef
6.
go back to reference Teixeira M da G, Barreto ML, Costa M da CN, Strina A, Martins D Jr, Prado M. Sentinel areas: a monitoring strategy in public health. Cad Saúde Pública. 2002;18:1189–95.CrossRef Teixeira M da G, Barreto ML, Costa M da CN, Strina A, Martins D Jr, Prado M. Sentinel areas: a monitoring strategy in public health. Cad Saúde Pública. 2002;18:1189–95.CrossRef
7.
go back to reference Polgreen PM, Chen Z, Segre AM, Harris ML, Pentella MA, Rushton G. Optimizing influenza sentinel surveillance at the state level. Am J Epidemiol. 2009;170:1300–6.CrossRef Polgreen PM, Chen Z, Segre AM, Harris ML, Pentella MA, Rushton G. Optimizing influenza sentinel surveillance at the state level. Am J Epidemiol. 2009;170:1300–6.CrossRef
8.
go back to reference Deckers JG, Paget WJ, Schellevis FG, Fleming DM. European primary care surveillance networks: their structure and operation. Fam Pract. 2006;23:151–8.CrossRef Deckers JG, Paget WJ, Schellevis FG, Fleming DM. European primary care surveillance networks: their structure and operation. Fam Pract. 2006;23:151–8.CrossRef
9.
go back to reference Schweikardt C, Verheij RA, Donker GA, Coppieters Y. The historical development of the Dutch sentinel general practice network from a paper-based into a digital primary care monitoring system. J Public Health. 2016;24:545–62.CrossRef Schweikardt C, Verheij RA, Donker GA, Coppieters Y. The historical development of the Dutch sentinel general practice network from a paper-based into a digital primary care monitoring system. J Public Health. 2016;24:545–62.CrossRef
10.
go back to reference Fairchild G, Polgreen PM, Foster E, Rushton G, Segre AM. How many suffice? A computational framework for sizing sentinel surveillance networks. Int J Health Geogr. 2013;12:56.CrossRef Fairchild G, Polgreen PM, Foster E, Rushton G, Segre AM. How many suffice? A computational framework for sizing sentinel surveillance networks. Int J Health Geogr. 2013;12:56.CrossRef
11.
go back to reference Lee EC, Arab A, Goldlust SM, Viboud C, Grenfell BT, Bansal S. Deploying digital health data to optimize influenza surveillance at national and local scales. PLoS Comput Biol. 2018;14:e1006020.CrossRef Lee EC, Arab A, Goldlust SM, Viboud C, Grenfell BT, Bansal S. Deploying digital health data to optimize influenza surveillance at national and local scales. PLoS Comput Biol. 2018;14:e1006020.CrossRef
12.
go back to reference Fricker RD. Some methodological issues in biosurveillance. Stat Med. 2011;30:403–15.CrossRef Fricker RD. Some methodological issues in biosurveillance. Stat Med. 2011;30:403–15.CrossRef
13.
go back to reference Unkel S, Farrington CP, Garthwaite PH, Robertson C, Andrews N. Statistical methods for the prospective detection of infectious disease outbreaks: a review. J R Stat Soc Ser A Stat Soc. 2012;175:49–82.CrossRef Unkel S, Farrington CP, Garthwaite PH, Robertson C, Andrews N. Statistical methods for the prospective detection of infectious disease outbreaks: a review. J R Stat Soc Ser A Stat Soc. 2012;175:49–82.CrossRef
14.
go back to reference Deville J-C, Särndal C-E. Calibration estimators in survey sampling. J Am Stat Assoc. 1992;87:376–82.CrossRef Deville J-C, Särndal C-E. Calibration estimators in survey sampling. J Am Stat Assoc. 1992;87:376–82.CrossRef
15.
go back to reference Souty C, Boëlle P-Y. Improving incidence estimation in practice-based sentinel surveillance networks using spatial variation in general practitioner density. BMC Med Res Methodol. 2016;16:156.CrossRef Souty C, Boëlle P-Y. Improving incidence estimation in practice-based sentinel surveillance networks using spatial variation in general practitioner density. BMC Med Res Methodol. 2016;16:156.CrossRef
16.
17.
go back to reference Victoor A, Delnoij DMJ, Friele RD, Rademakers JJDJM. Determinants of patient choice of healthcare providers: a scoping review. BMC Health Serv Res. 2012;12:272.CrossRef Victoor A, Delnoij DMJ, Friele RD, Rademakers JJDJM. Determinants of patient choice of healthcare providers: a scoping review. BMC Health Serv Res. 2012;12:272.CrossRef
18.
go back to reference Jones S, Wardlaw J, Crouch S, Carolan M. Modelling catchment areas for secondary care providers: a case study. Health Care Manag Sci. 2011;14:253–61.CrossRef Jones S, Wardlaw J, Crouch S, Carolan M. Modelling catchment areas for secondary care providers: a case study. Health Care Manag Sci. 2011;14:253–61.CrossRef
19.
go back to reference Schuurman N, Bérubé M, Crooks VA. Measuring potential spatial access to primary health care physicians using a modified gravity model. Can Geogr Géographe Can. 2010;54:29–45.CrossRef Schuurman N, Bérubé M, Crooks VA. Measuring potential spatial access to primary health care physicians using a modified gravity model. Can Geogr Géographe Can. 2010;54:29–45.CrossRef
21.
go back to reference Langford M, Higgs G, Fry R. Multi-modal two-step floating catchment area analysis of primary health care accessibility. Health Place. 2016;38(Supplement C):70–81.CrossRef Langford M, Higgs G, Fry R. Multi-modal two-step floating catchment area analysis of primary health care accessibility. Health Place. 2016;38(Supplement C):70–81.CrossRef
22.
go back to reference Horvitz DG, Thompson DJ. A generalization of sampling without replacement from a finite universe. J Am Stat Assoc. 1952;47:663.CrossRef Horvitz DG, Thompson DJ. A generalization of sampling without replacement from a finite universe. J Am Stat Assoc. 1952;47:663.CrossRef
23.
go back to reference Nakanishi M, Cooper LG. Parameter estimation for a multiplicative competitive interaction model: least squares approach. J Mark Res. 1974;11:303–11. Nakanishi M, Cooper LG. Parameter estimation for a multiplicative competitive interaction model: least squares approach. J Mark Res. 1974;11:303–11.
24.
go back to reference Muyldermans G, Ducoffre G, Leroy M, Dupont Y, Quolin S, Laboratories PS. Surveillance of infectious diseases by the sentinel laboratory network in Belgium: 30 years of continuous improvement. PLoS One. 2016;11:e0160429.CrossRef Muyldermans G, Ducoffre G, Leroy M, Dupont Y, Quolin S, Laboratories PS. Surveillance of infectious diseases by the sentinel laboratory network in Belgium: 30 years of continuous improvement. PLoS One. 2016;11:e0160429.CrossRef
25.
go back to reference Braeye T, Verheagen J, Mignon A, Flipse W, Pierard D, Huygen K, et al. Capture-recapture estimators in epidemiology with applications to pertussis and pneumococcal invasive disease surveillance. PLoS One. 2016;11:e0159832.CrossRef Braeye T, Verheagen J, Mignon A, Flipse W, Pierard D, Huygen K, et al. Capture-recapture estimators in epidemiology with applications to pertussis and pneumococcal invasive disease surveillance. PLoS One. 2016;11:e0159832.CrossRef
26.
go back to reference Chen C, Wakefield J, Lumely T. The use of sampling weights in Bayesian hierarchical models for small area estimation. Spat Spatiotemporal Epidemiol. 2014;11:33–43.CrossRef Chen C, Wakefield J, Lumely T. The use of sampling weights in Bayesian hierarchical models for small area estimation. Spat Spatiotemporal Epidemiol. 2014;11:33–43.CrossRef
27.
go back to reference Vandendijck Y, Faes C, Hens N. Prevalence and trend estimation from observational data with highly variable post-stratification weights. Ann Appl Stat. 2016;10:94–117.CrossRef Vandendijck Y, Faes C, Hens N. Prevalence and trend estimation from observational data with highly variable post-stratification weights. Ann Appl Stat. 2016;10:94–117.CrossRef
28.
go back to reference Zhao H, Green H, Lackenby A, et al. A new laboratory-based surveillance system (Respiratory DataMart System) for infl uenza and other respiratory viruses in England: results and experience from 2009 to 2012. Euro Surveill. 2014;19(3).CrossRef Zhao H, Green H, Lackenby A, et al. A new laboratory-based surveillance system (Respiratory DataMart System) for infl uenza and other respiratory viruses in England: results and experience from 2009 to 2012. Euro Surveill. 2014;19(3).CrossRef
29.
go back to reference Zhao H, Harris RJ, Ellis J, Donati M, Pebody RG. Epidemiology of parainfluenza infection in England and Wales, 1998–2013: any evidence of change? Epidemiol Infect. 2017;145:1210–20.CrossRef Zhao H, Harris RJ, Ellis J, Donati M, Pebody RG. Epidemiology of parainfluenza infection in England and Wales, 1998–2013: any evidence of change? Epidemiol Infect. 2017;145:1210–20.CrossRef
30.
go back to reference Scarpino SV, Dimitrov NB, Meyers LA. Optimizing provider recruitment for influenza surveillance networks. PLoS Comput Biol. 2012;8:e1002472.CrossRef Scarpino SV, Dimitrov NB, Meyers LA. Optimizing provider recruitment for influenza surveillance networks. PLoS Comput Biol. 2012;8:e1002472.CrossRef
31.
go back to reference Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278–95.CrossRef Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278–95.CrossRef
32.
go back to reference Schroeder SA, Kenders K, Cooper JK, Piemme TE. Use of laboratory tests and pharmaceuticals: variation among physicians and effect of cost audit on subsequent use. JAMA. 1973;225:969–73.CrossRef Schroeder SA, Kenders K, Cooper JK, Piemme TE. Use of laboratory tests and pharmaceuticals: variation among physicians and effect of cost audit on subsequent use. JAMA. 1973;225:969–73.CrossRef
33.
go back to reference Drezner T, Drezner Z, Salhi S. Solving the multiple competitive facilities location problem. Eur J Oper Res. 2002;142:138–51.CrossRef Drezner T, Drezner Z, Salhi S. Solving the multiple competitive facilities location problem. Eur J Oper Res. 2002;142:138–51.CrossRef
35.
go back to reference Vandendijck Y, Faes C, Kirby RS, Lawson A, Hens N. Model-based inference for small area estimation with sampling weights. Spat Stat. 2016;18:455–73.CrossRef Vandendijck Y, Faes C, Kirby RS, Lawson A, Hens N. Model-based inference for small area estimation with sampling weights. Spat Stat. 2016;18:455–73.CrossRef
36.
go back to reference Eaton JW, Bao L. Accounting for nonsampling error in estimates of HIV epidemic trends from antenatal clinic sentinel surveillance. AIDS. 2017;31(Suppl 1):S61–8.CrossRef Eaton JW, Bao L. Accounting for nonsampling error in estimates of HIV epidemic trends from antenatal clinic sentinel surveillance. AIDS. 2017;31(Suppl 1):S61–8.CrossRef
37.
go back to reference Kott PS. Calibration weighting in survey sampling. Wiley Interdiscip Rev Comput Stat. 2016;8:39–53.CrossRef Kott PS. Calibration weighting in survey sampling. Wiley Interdiscip Rev Comput Stat. 2016;8:39–53.CrossRef
Metadata
Title
Incidence estimation from sentinel surveillance data; a simulation study and application to data from the Belgian laboratory sentinel surveillance
Authors
Toon Braeye
Sophie Quoilin
Niel Hens
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2019
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-019-7279-y

Other articles of this Issue 1/2019

BMC Public Health 1/2019 Go to the issue