Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | SARS-CoV-2 | Research article

Towards reduction in bias in epidemic curves due to outcome misclassification through Bayesian analysis of time-series of laboratory test results: case study of COVID-19 in Alberta, Canada and Philadelphia, USA

Authors: Igor Burstyn, Neal D. Goldstein, Paul Gustafson

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Despite widespread use, the accuracy of the diagnostic test for SARS-CoV-2 infection is poorly understood. The aim of our work was to better quantify misclassification errors in identification of true cases of COVID-19 and to study the impact of these errors in epidemic curves using publicly available surveillance data from Alberta, Canada and Philadelphia, USA.

Methods

We examined time-series data of laboratory tests for SARS-CoV-2 viral infection, the causal agent for COVID-19, to try to explore, using a Bayesian approach, the sensitivity and specificity of the diagnostic test.

Results

Our analysis revealed that the data were compatible with near-perfect specificity, but it was challenging to gain information about sensitivity. We applied these insights to uncertainty/bias analysis of epidemic curves under the assumptions of both improving and degrading sensitivity. If the sensitivity improved from 60 to 95%, the adjusted epidemic curves likely falls within the 95% confidence intervals of the observed counts. However, bias in the shape and peak of the epidemic curves can be pronounced, if sensitivity either degrades or remains poor in the 60–70% range. In the extreme scenario, hundreds of undiagnosed cases, even among the tested, are possible, potentially leading to further unchecked contagion should these cases not self-isolate.

Conclusion

The best way to better understand bias in the epidemic curves of COVID-19 due to errors in testing is to empirically evaluate misclassification of diagnosis in clinical settings and apply this knowledge to adjustment of epidemic curves.
Appendix
Available only for authorised users
Literature
4.
go back to reference Fang Y. Zhang H1, Xie J. sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology. 2020;19:200432.CrossRef Fang Y. Zhang H1, Xie J. sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology. 2020;19:200432.CrossRef
5.
go back to reference Ai T. Yang Z1, Hou H. correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. 2020;26:200642.CrossRef Ai T. Yang Z1, Hou H. correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. 2020;26:200642.CrossRef
6.
go back to reference Konrad R, Eberle U, Dangel A, et al. Rapid establishment of laboratory diagnostics for the novel coronavirus SARS-CoV-2 in Bavaria, Germany, February 2020. Euro Surveill. 2020;25(9). Konrad R, Eberle U, Dangel A, et al. Rapid establishment of laboratory diagnostics for the novel coronavirus SARS-CoV-2 in Bavaria, Germany, February 2020. Euro Surveill. 2020;25(9).
7.
go back to reference Corman VM, Landt O, Kaiser M, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020;25(3). Corman VM, Landt O, Kaiser M, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020;25(3).
9.
go back to reference Binsaeed AA, Al-Khedhairy AA, Mandil AM, et al. A validation study comparing the sensitivity and specificity of the new Dr. KSU H1N1 RT-PCR kit with real-time RT-PCR for diagnosing influenza a (H1N1). Ann Saudi Med. 2011;31(4):351–5.CrossRef Binsaeed AA, Al-Khedhairy AA, Mandil AM, et al. A validation study comparing the sensitivity and specificity of the new Dr. KSU H1N1 RT-PCR kit with real-time RT-PCR for diagnosing influenza a (H1N1). Ann Saudi Med. 2011;31(4):351–5.CrossRef
10.
go back to reference Merckx J. Wali R1, Schiller I, et al. diagnostic accuracy of novel and traditional rapid tests for influenza infection compared with reverse transcriptase polymerase chain reaction: a systematic review and meta-analysis. Ann Intern Med. 2017;167(6):394–409.CrossRef Merckx J. Wali R1, Schiller I, et al. diagnostic accuracy of novel and traditional rapid tests for influenza infection compared with reverse transcriptase polymerase chain reaction: a systematic review and meta-analysis. Ann Intern Med. 2017;167(6):394–409.CrossRef
14.
go back to reference Burstyn I, Kapur N, Shalapay C, Bamforth F, Wild TC, Liu J, LeGatt D. Evaluation of the accuracy of self-reported smoking in pregnancy when the biomarker level in an active smoker is uncertain. Nicotine Tob Res. 2009;11(6):670–8.CrossRef Burstyn I, Kapur N, Shalapay C, Bamforth F, Wild TC, Liu J, LeGatt D. Evaluation of the accuracy of self-reported smoking in pregnancy when the biomarker level in an active smoker is uncertain. Nicotine Tob Res. 2009;11(6):670–8.CrossRef
15.
go back to reference Dehning J, Zierenberg J, Spitzner PF, Wibral M, Neto JP, Wilczek M, Priesemann V. Inferring change points in the COVID-19 spreading reveals the effectiveness of interventions. arXiv. 2004:01105v3. Dehning J, Zierenberg J, Spitzner PF, Wibral M, Neto JP, Wilczek M, Priesemann V. Inferring change points in the COVID-19 spreading reveals the effectiveness of interventions. arXiv. 2004:01105v3.
Metadata
Title
Towards reduction in bias in epidemic curves due to outcome misclassification through Bayesian analysis of time-series of laboratory test results: case study of COVID-19 in Alberta, Canada and Philadelphia, USA
Authors
Igor Burstyn
Neal D. Goldstein
Paul Gustafson
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01037-4

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue