Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2021

Open Access 01-12-2021 | SARS-CoV-2 | Research article

Incorporating and addressing testing bias within estimates of epidemic dynamics for SARS-CoV-2

Authors: Yasir Suhail, Junaid Afzal, Kshitiz

Published in: BMC Medical Research Methodology | Issue 1/2021

Login to get access

Abstract

Background

The disease burden of SARS-CoV-2 as measured by tests from various localities, and at different time points present varying estimates of infection and fatality rates. Models based on these acquired data may suffer from systematic errors and large estimation variances due to the biases associated with testing. An unbiased randomized testing to estimate the true fatality rate is still missing.

Methods

Here, we characterize the effect of incidental sampling bias in the estimation of epidemic dynamics. Towards this, we explicitly modeled for sampling bias in an augmented compartment model to predict epidemic dynamics. We further calculate the bias from differences in disease prediction from biased, and randomized sampling, proposing a strategy to obtain unbiased estimates.

Results

Our simulations demonstrate that sampling biases in favor of patients with higher disease manifestation could significantly affect direct estimates of infection and fatality rates calculated from the numbers of confirmed cases and deaths, and serological testing can partially mitigate these biased estimates.

Conclusions

The augmented compartmental model allows the explicit modeling of different testing policies and their effects on disease estimates. Our calculations for the dependence of expected confidence on a randomized sample sizes, show that relatively small sample sizes can provide statistically significant estimates for SARS-CoV-2 related death rates.
Appendix
Available only for authorised users
Literature
1.
go back to reference WHO: Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19) 2020. WHO: Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19) 2020.
2.
go back to reference Spychalski P, Błażyńska-Spychalska A, Kobiela J. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):774-5. Spychalski P, Błażyńska-Spychalska A, Kobiela J. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):774-5.
3.
go back to reference Kim DD, Goel A. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):773-4. Kim DD, Goel A. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):773-4.
4.
go back to reference Lipsitch M. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):775. Lipsitch M. Estimating case fatality rates of COVID-19. Lancet Infect Dis. 2020;20(7):775.
5.
go back to reference Baud D, Qi X, Nielsen-Saines K, Musso D, Pomar L, Favre G. Real estimates of mortality following COVID-19 infection. Lancet Infect Dis. 2020;20(7):773.CrossRef Baud D, Qi X, Nielsen-Saines K, Musso D, Pomar L, Favre G. Real estimates of mortality following COVID-19 infection. Lancet Infect Dis. 2020;20(7):773.CrossRef
6.
go back to reference Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study. Lancet. 2020;395(10225):689–97.CrossRef Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study. Lancet. 2020;395(10225):689–97.CrossRef
8.
go back to reference Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, Ren R, Leung KSM, Lau EHY, Wong JY, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia. N Engl J Med. 2020;382(13):1199–207.CrossRef Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, Ren R, Leung KSM, Lau EHY, Wong JY, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia. N Engl J Med. 2020;382(13):1199–207.CrossRef
11.
go back to reference Wolfel R, Corman VM, Guggemos W, Seilmaier M, Zange S, Muller MA, Niemeyer D, Jones TC, Vollmar P, Rothe C, et al. Virological assessment of hospitalized patients with COVID-2019. Nature. 2020;581:465–9. Wolfel R, Corman VM, Guggemos W, Seilmaier M, Zange S, Muller MA, Niemeyer D, Jones TC, Vollmar P, Rothe C, et al. Virological assessment of hospitalized patients with COVID-2019. Nature. 2020;581:465–9.
12.
go back to reference To KK, Tsang OT, Leung WS, Tam AR, Wu TC, Lung DC, Yip CC, Cai JP, Chan JM, Chik TS, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20(5):565–74.CrossRef To KK, Tsang OT, Leung WS, Tam AR, Wu TC, Lung DC, Yip CC, Cai JP, Chan JM, Chik TS, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20(5):565–74.CrossRef
13.
go back to reference Sood N, Simon P, Ebner P, Eichner D, Reynolds J, Bendavid E, Bhattacharya J. Seroprevalence of SARS-CoV-2–Specific Antibodies Among Adults in Los Angeles County, California, on April 10-11, 2020. JAMA. 2020;323(23):2425-7. Sood N, Simon P, Ebner P, Eichner D, Reynolds J, Bendavid E, Bhattacharya J. Seroprevalence of SARS-CoV-2–Specific Antibodies Among Adults in Los Angeles County, California, on April 10-11, 2020. JAMA. 2020;323(23):2425-7.
15.
go back to reference Grifoni A, Weiskopf D, Ramirez SI, Mateus J, Dan JM, Moderbacher CR, Rawlings SA, Sutherland A, Premkumar L, Jadi RS, et al. Targets of T cell responses to SARS-CoV-2 coronavirus in humans with COVID-19 disease and unexposed individuals. Cell. 2020;181(7):1489–501 e1415.CrossRef Grifoni A, Weiskopf D, Ramirez SI, Mateus J, Dan JM, Moderbacher CR, Rawlings SA, Sutherland A, Premkumar L, Jadi RS, et al. Targets of T cell responses to SARS-CoV-2 coronavirus in humans with COVID-19 disease and unexposed individuals. Cell. 2020;181(7):1489–501 e1415.CrossRef
16.
go back to reference Mathew D, Giles JR, Baxter AE, Oldridge DA, Greenplate AR, Wu JE, Alanio C, Kuri-Cervantes L, Pampena MB, D'Andrea K, et al. Deep immune profiling of COVID-19 patients reveals distinct immunotypes with therapeutic implications. Science. 2020;369(6508):eabc8511. https://doi.org/10.1126/science.abc8511. Mathew D, Giles JR, Baxter AE, Oldridge DA, Greenplate AR, Wu JE, Alanio C, Kuri-Cervantes L, Pampena MB, D'Andrea K, et al. Deep immune profiling of COVID-19 patients reveals distinct immunotypes with therapeutic implications. Science. 2020;369(6508):eabc8511. https://​doi.​org/​10.​1126/​science.​abc8511.
19.
go back to reference Russell TW, Hellewell J, Jarvis CI, van Zandvoort K, Abbott S, Ratnayake R, Cmmid Covid-Working G, Flasche S, Eggo RM, Edmunds WJ et al: Estimating the infection and case fatality ratio for coronavirus disease (COVID-19) using age-adjusted data from the outbreak on the diamond princess cruise ship, February 2020. Euro Surveill 2020, 25(12). Russell TW, Hellewell J, Jarvis CI, van Zandvoort K, Abbott S, Ratnayake R, Cmmid Covid-Working G, Flasche S, Eggo RM, Edmunds WJ et al: Estimating the infection and case fatality ratio for coronavirus disease (COVID-19) using age-adjusted data from the outbreak on the diamond princess cruise ship, February 2020. Euro Surveill 2020, 25(12).
20.
go back to reference Lourenco J, Paton R, Ghafari M, Kraemer M, Thompson C, Simmonds P, Klenerman P, Gupta S: Fundamental principles of epidemic spread highlight the immediate need for large-scale serological surveys to assess the stage of the SARS-CoV-2 epidemic. medRxiv. 2020. https://doi.org/10.1101/2020.03.24.20042291. Accessed 29 Dec 2020. Lourenco J, Paton R, Ghafari M, Kraemer M, Thompson C, Simmonds P, Klenerman P, Gupta S: Fundamental principles of epidemic spread highlight the immediate need for large-scale serological surveys to assess the stage of the SARS-CoV-2 epidemic. medRxiv. 2020. https://​doi.​org/​10.​1101/​2020.​03.​24.​20042291. Accessed 29 Dec 2020.
21.
go back to reference Ferguson NM, Laydon D, Nedjati-Gilani G, Imai N, Ainslie K, Baguelin M, Bhatia S, Boonyasiri A, Cucunubá Z, Cuomo-Dannenburg G et al: Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand. . Imperial College COVID-19 Response Team 2020. Ferguson NM, Laydon D, Nedjati-Gilani G, Imai N, Ainslie K, Baguelin M, Bhatia S, Boonyasiri A, Cucunubá Z, Cuomo-Dannenburg G et al: Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand. . Imperial College COVID-19 Response Team 2020.
22.
go back to reference Sanchez-Caballero S, Selles MA, Peydro MA, Perez-Bernabeu E. An Efficient COVID-19 Prediction Model Validated with the Cases of China, Italy and Spain: Total or Partial Lockdowns? J Clin Med. 2020;9(5):1547. Sanchez-Caballero S, Selles MA, Peydro MA, Perez-Bernabeu E. An Efficient COVID-19 Prediction Model Validated with the Cases of China, Italy and Spain: Total or Partial Lockdowns? J Clin Med. 2020;9(5):1547.
23.
go back to reference Garcia-Basteiro AL, Chaccour C, Guinovart C, Llupia A, Brew J, Trilla A, Plasencia A. Monitoring the COVID-19 epidemic in the context of widespread local transmission. Lancet Respir Med. 2020;8(5):440–2. Garcia-Basteiro AL, Chaccour C, Guinovart C, Llupia A, Brew J, Trilla A, Plasencia A. Monitoring the COVID-19 epidemic in the context of widespread local transmission. Lancet Respir Med. 2020;8(5):440–2.
25.
go back to reference Nickel CH, Bingisser R. Mimics and chameleons of COVID-19. Swiss Med Wkly. 2020;150:w20231.PubMed Nickel CH, Bingisser R. Mimics and chameleons of COVID-19. Swiss Med Wkly. 2020;150:w20231.PubMed
26.
go back to reference Zhao Q, Ju N, Bacallado S: BETS: The dangers of selection bias in early analyses of the coronavirus disease (COVID-19) pandemic. arXiv preprint arXiv:200407743 2020. Zhao Q, Ju N, Bacallado S: BETS: The dangers of selection bias in early analyses of the coronavirus disease (COVID-19) pandemic. arXiv preprint arXiv:200407743 2020.
28.
go back to reference Brunner J, Chia N. Confidence in the dynamic spread of epidemics under biased sampling conditions. PeerJ. 2020;8:e9758.CrossRef Brunner J, Chia N. Confidence in the dynamic spread of epidemics under biased sampling conditions. PeerJ. 2020;8:e9758.CrossRef
29.
go back to reference Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, Shaman J. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2). Science. 2020;368(6490):489–93.CrossRef Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, Shaman J. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2). Science. 2020;368(6490):489–93.CrossRef
30.
go back to reference Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26(4):404–13.CrossRef Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26(4):404–13.CrossRef
31.
go back to reference Thacker T. ICMR intensifies random testing to check for covid-19. In: The Economic Times. 03.16; 2020. Thacker T. ICMR intensifies random testing to check for covid-19. In: The Economic Times. 03.16; 2020.
32.
go back to reference Marpakwar C: ICMR approves four more testing centres in Mumbai. In: Mumbai Mirror. Mumbai: Times of India Group; 2020. Marpakwar C: ICMR approves four more testing centres in Mumbai. In: Mumbai Mirror. Mumbai: Times of India Group; 2020.
33.
go back to reference Peddu V, Shean RC, Xie H, Shrestha L, Perchetti GA, Minot SS, Roychoudhury P, Huang ML, Nalla A, Reddy SB, et al. Metagenomic analysis reveals clinical SARS-CoV-2 infection and bacterial or viral Superinfection and colonization. Clin Chem. 2020;66(7):966–72.CrossRef Peddu V, Shean RC, Xie H, Shrestha L, Perchetti GA, Minot SS, Roychoudhury P, Huang ML, Nalla A, Reddy SB, et al. Metagenomic analysis reveals clinical SARS-CoV-2 infection and bacterial or viral Superinfection and colonization. Clin Chem. 2020;66(7):966–72.CrossRef
34.
go back to reference Sibley CD, Peirano G, Church DL. Molecular methods for pathogen and microbial community detection and characterization: current and potential application in diagnostic microbiology. Infect Genet Evol. 2012;12(3):505–21.CrossRef Sibley CD, Peirano G, Church DL. Molecular methods for pathogen and microbial community detection and characterization: current and potential application in diagnostic microbiology. Infect Genet Evol. 2012;12(3):505–21.CrossRef
35.
go back to reference Skums P, Artyomenko A, Glebova O, Ramachandran S, Mandoiu I, Campo DS, Dimitrova Z, Zelikovsky A, Khudyakov Y. Computational framework for next-generation sequencing of heterogeneous viral populations using combinatorial pooling. Bioinformatics. 2015;31(5):682–90.CrossRef Skums P, Artyomenko A, Glebova O, Ramachandran S, Mandoiu I, Campo DS, Dimitrova Z, Zelikovsky A, Khudyakov Y. Computational framework for next-generation sequencing of heterogeneous viral populations using combinatorial pooling. Bioinformatics. 2015;31(5):682–90.CrossRef
37.
go back to reference Sullum J. What We Should Have Learned From Iceland's Response to COVID-19. In: reasoncom. 4.3; 2020. Sullum J. What We Should Have Learned From Iceland's Response to COVID-19. In: reasoncom. 4.3; 2020.
38.
go back to reference Lock S. Coronavirus may be LESS deadly than we thought as Iceland testing reveals huge numbers had disease without realising. In: The US Sun. 4.29; 2020. Lock S. Coronavirus may be LESS deadly than we thought as Iceland testing reveals huge numbers had disease without realising. In: The US Sun. 4.29; 2020.
Metadata
Title
Incorporating and addressing testing bias within estimates of epidemic dynamics for SARS-CoV-2
Authors
Yasir Suhail
Junaid Afzal
Kshitiz
Publication date
01-12-2021
Publisher
BioMed Central
Keyword
SARS-CoV-2
Published in
BMC Medical Research Methodology / Issue 1/2021
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01196-4

Other articles of this Issue 1/2021

BMC Medical Research Methodology 1/2021 Go to the issue