Top

Published in:

Open Access 01-12-2021 | SARS-CoV-2 | Research

A systematic and meta-analysis review on the diagnostic accuracy of antibodies in the serological diagnosis of COVID-19

Authors: Arthur Vengesai, Herald Midzi, Maritha Kasambala, Hamlet Mutandadzi, Tariro L. Mduluza-Jokonya, Simbarashe Rusakaniko, Francisca Mutapi, Thajasvarie Naicker, Takafira Mduluza

Published in: Systematic Reviews | Issue 1/2021

Abstract

Background

Serological testing based on different antibody types are an alternative method being used to diagnose SARS-CoV-2 and has the potential of having higher diagnostic accuracy compared to the current gold standard rRT-PCR. Therefore, the objective of this review was to evaluate the diagnostic accuracy of IgG and IgM based point-of-care (POC) lateral flow immunoassay (LFIA), chemiluminescence enzyme immunoassay (CLIA), fluorescence enzyme-linked immunoassay (FIA) and ELISA systems that detect SARS-CoV-2 antigens.

Method

A systematic literature search was carried out in PubMed, Medline complete and MedRxiv. Studies evaluating the diagnostic accuracy of serological assays for SARS-CoV-2 were eligible. Study selection and data-extraction were performed by two authors independently. QUADAS-2 checklist tool was used to assess the quality of the studies. The bivariate model and the hierarchical summary receiver operating characteristic curve model were performed to evaluate the diagnostic accuracy of the serological tests. Subgroup meta-analysis was performed to explore the heterogeneity.

Results

The pooled sensitivity for IgG (n = 17), IgM (n = 16) and IgG-IgM (n = 24) based LFIA tests were 0.5856, 0.4637 and 0.6886, respectively compared to rRT-PCR method. The pooled sensitivity for IgG (n = 9) and IgM (n = 10) based CLIA tests were 0.9311 and 0.8516, respectively compared to rRT-PCR. The pooled sensitivity the IgG (n = 10), IgM (n = 11) and IgG-IgM (n = 5) based ELISA tests were 0.8292, 0.8388 and 0.8531 respectively compared to rRT-PCR. All tests displayed high specificities ranging from 0.9693 to 0.9991. Amongst the evaluated tests, IgG based CLIA expressed the highest sensitivity signifying its accurate detection of the largest proportion of infections identified by rRT-PCR. ELISA and CLIA tests performed better in terms of sensitivity compared to LFIA. IgG based tests performed better compared to IgM except for the ELISA.

Conclusions

We report that IgG-IgM based ELISA tests have the best overall diagnostic test accuracy. Moreover, irrespective of the method, a combined IgG/IgM test seems to be a better choice in terms of sensitivity than measuring either antibody type independently. Given the poor performances of the current LFIA devices, there is a need for more research on the development of highly sensitivity and specific POC LFIA that are adequate for most individual patient applications and attractive for large sero-prevalence studies.

Systematic review registration

PROSPERO CRD42020179112

Available only for authorised users

Ludvigsson JF. Systematic review of COVID-19 in children shows milder cases and a better prognosis than adults. Acta Paediatr. 2020;109(6):1088–95 Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/apa.15270. Cited 2020 May 27.CrossRef

Ren L-L, Wang Y-M, Wu Z-Q, Xiang Z-C, Guo L, Xu T, et al. Identification of a novel coronavirus causing severe pneumonia in human. Chin Med J. 2020;133(9):1015–24 Available from: http://journals.lww.com/10.1097/CM9.0000000000000722. Cited 2020 May 28.CrossRef

Situation Summary | CDC. Available from: https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/summary.html. Cited 2020 May 27

NIH clinical trial of investigational vaccine for COVID-19 begins | National Institutes of Health (NIH). Available from: https://www.nih.gov/news-events/news-releases/nih-clinical-trial-investigational-vaccine-covid-19-begins. Cited 2020 May 27

COVID-19 situation update worldwide, as of 11 November 2020. Available from: https://www.ecdc.europa.eu/en/geographical-distribution-2019-ncov-cases. Cited 2020 Nov 12

Coronavirus. Available from: https://www.who.int/health-topics/coronavirus#tab=tab_1. Cited 2020 Nov 12

Coronavirus disease 2019 (COVID-19) Situation Report-63 HIGHLIGHTS. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports

Guo L, Ren L, Yang S, Xiao M, Chang D, Yang F, et al. Clinical infectious diseases Clinical Infectious Diseases ® 2020;XX(XX):1-8. Available from: https://academic.oup.com/cid/advance-article-abstract/doi/10.1093/cid/ciaa310/5810754. Cited 2020 May 28

Diagnostic testing for SARS-CoV-2. Available from: https://www.who.int/publications/i/item/diagnostic-testing-for-sars-cov-2. Cited 2020 Nov 18

10.

To KKW, Tsang OTY, Leung WS, Tam AR, Wu TC, Lung DC, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20(5):565–74.CrossRef

11.

Wikramaratna P, Paton RS, Ghafari M, Lourenco J. Estimating false-negative detection rate of SARS-CoV-2 by RT-PCR. medRxiv. 2020:2020.04.05.20053355 Available from: https://doi.org/10.1101/2020.04.05.20053355. Cited 2020 May 28.

12.

Li D, Wang D, Dong J, Wang N, Huang H, Xu H, et al. False-negative results of real-time reverse-transcriptase polymerase chain reaction for severe acute respiratory syndrome coronavirus 2: role of deep-learning-based ct diagnosis and insights from two cases. Korean J Radiol. 2020;21(4):505–8. https://doi.org/10.3348/kjr.2020.0146.CrossRefPubMedPubMedCentral

13.

Guo L, Ren L, Yang S, Xiao M, Chang D, Yang F, et al. Profiling early humoral response to diagnose novel coronavirus disease (COVID-19). Clin Infect Dis. 2020; Available from: http://www.ncbi.nlm.nih.gov/pubmed/32198501. Cited 2020 Apr 2.

14.

Zhang W, Du RH, Li B, Zheng XS, Lou YX, Hu B, et al. Molecular and serological investigation of 2019-nCoV infected patients: implication of multiple shedding routes. Emerg Microbes Infect. 2020;9(1):386–9 Available from: https://www.tandfonline.com/doi/full/10.1080/22221751.2020.1729071. Cited 2020 May 28.CrossRef

15.

Qian C, Zhou M, Cheng F, Lin X, Gong Y, Xie X, et al. Development and multicenter performance evaluation of the first fully automated SARS-CoV-2 IgM and IgG immunoassays. medRxiv. 2020:2020.04.16.20067231.

16.

The critical role of laboratory medicine during coronavirus disease 2019 (COVID-19) and other viral outbreaks in: Clinical Chemistry and Laboratory Medicine (CCLM) - Ahead of print. Available from: https://www.degruyter.com/view/journals/cclm/ahead-of-print/article-10.1515-cclm-2020-0240/article-10.1515-cclm-2020-0240.xml. Cited 2020 May 28

17.

McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies The PRISMA-DTA Statement. JAMA. 2018;319(4):388–96. https://doi.org/10.1001/jama.2017.19163.CrossRefPubMed

18.

Macaskill P, Gatsonis C, Deeks J, Harbord R, Takwoingi Y. Cochrane handbook for systematic reviews of diagnostic test accuracy Chapter 10 Analysing and presenting results. Available from: http://srdta.cochrane.org/. Cited 2020 May 31

19.

Zeller H, Van Bortel W. A systematic literature review on the diagnosis accuracy of serological tests for Lyme borreliosis; 2016.

20.

Steingart KR, Henry M, Laal S, Hopewell PC, Ramsay A, Menzies D, et al. A systematic review of commercial serological antibody detection tests for the diagnosis of extrapulmonary tuberculosis. Postgrad Med J. 2007;83:705–12 BMJ Publishing Group Ltd.CrossRef

21.

Volpe Chaves CE, do Valle Leone de Oliveira SM, Venturini J, Grande AJ, Sylvestre TF, Poncio Mendes R, et al. Accuracy of serological tests for diagnosis of chronic pulmonary aspergillosis: a systematic review and meta-analysis. PLoS One. 2020;15(3):e0222738 Available from: https://dx.plos.org/10.1371/journal.pone.0222738. Agarwal R, editor. Cited 2020 May 31.CrossRef

22.

Abba K, Deeks JJ, Olliaro PL, Naing C-M, Jackson SM, Takwoingi Y, et al. Rapid diagnostic tests for diagnosing uncomplicated P. falciparum malaria in endemic countries. Cochrane Database Syst Rev. 2011;(7).

23.

Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. Quadas-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529–36 American College of Physicians.CrossRef

24.

Takwoingi Y, Riley RD, Deeks JJ. Meta-analysis of diagnostic accuracy studies in mental health. Evid Based Ment Health. 2015;18(4):103–9. https://doi.org/10.1136/eb-2015-102228.CrossRefPubMedPubMedCentral

25.

Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. Br Med J. 2003;327:557–60 British Medical Journal Publishing Group.CrossRef

26.

Ochodo EA, Gopalakrishna G, Spek B, Reitsma JB, van Lieshout L, Polman K, et al. Circulating antigen tests and urine reagent strips for diagnosis of active schistosomiasis in endemic areas. Cochrane Database Syst Rev. 2015;2015 John Wiley and Sons Ltd.

27.

Kai-Wang To K, Tak-Yin Tsang O, Leung W-S, Raymond Tam A, Wu T-C, Christopher Lung D, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. 2020; Available from: www.thelancet.com/infection. Cited 2020 May 31

28.

Cassaniti I, Novazzi F, Giardina F, Salinaro F, Sachs M, Perlini S, et al. Performance of VivaDiag COVID-19 IgM/IgG rapid test is inadequate for diagnosis of COVID-19 in acute patients referring to emergency room department. J Med Virol. 2020:jmv.25800 Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/jmv.25800. Cited 2020 May 28.

29.

Lin D, Liu L, Zhang M, Hu Y, Yang Q, Guo J, et al. Evaluations of serological test in the diagnosis of 2019 novel coronavirus (SARS-CoV-2) infections during the COVID-19 outbreak. medRxiv. 2020:2020.03.27.20045153 Available from: https://www.medrxiv.org/content/10.1101/2020.03.27.20045153v1. Cited 2020 May 31.

30.

Xiang J, Yan M, Li H, Liu T, Lin C, Huang S, et al. Evaluation of enzyme-linked immunoassay and colloidal gold- immunochromatographic assay kit for detection of novel coronavirus (SARS-Cov-2) causing an outbreak of pneumonia (COVID-19). medRxiv. 2020:2020.02.27.20028787 Available from: https://doi.org/10.1101/2020.02.27.20028787. Cited 2020 May 31.

31.

Liu R, Liu X, Han H, Shereen MA, Niu Z, Li D, et al. The comparative superiority of IgM-IgG antibody test to real-time reverse transcriptase PCR detection for SARS-CoV-2 infection diagnosis. medRxiv. 2020:2020.03.28.20045765.

32.

Liu W, Liu L, Kou G, Zheng Y, Ding Y, Ni W, et al. Evaluation of nucleocapsid and Spike protein-based ELISAs for detecting antibodies against SARS-CoV-2. J Clin Microbiol. 2020;58(6).

33.

Chen J, Hu J, Long Q, Deng H, Fan K, Liao P, et al. A peptide-based magnetic chemiluminescence enzyme immunoassay for 1 Xue-fei. medrxiv.org. 2020:2020.02.22.20026617 Available from: https://doi.org/10.1101/2020.02.22.20026617. Cited 2020 May 31.

34.

Pan Y, Li X, Yang G, Fan J, Tang Y, Zhao J, et al. Serological immunochromatographic approach in diagnosis with SARS-CoV-2 infected COVID-19 patients. medRxiv. 2020:2020.03.13.20035428.

35.

Jin Y, Wang M, Zuo Z, Fan C, Ye F, Cai Z, et al. Diagnostic value and dynamic variance of serum antibody in coronavirus disease 2019. Int J Infect Dis. 2020;94:49–52 Available from: https://doi.org/10.1016/j.ijid.2020.03.065. Cited 2020 May 31.CrossRef

36.

Zhao J, Yuan Q, Wang H, Liu W, Liao X, Su Y, et al. Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. Clin Infect Dis. 2020; Available from: http://www.ncbi.nlm.nih.gov/pubmed/32221519. Cited 2020 Apr 2.

37.

Li Z, Yi Y, Luo X, Xiong N, Liu Y, Li S, et al. Development and clinical application of a rapid IgM-IgG combined antibody test for SARS-CoV-2 infection diagnosis. J Med Virol. 2020; Available from: http://www.ncbi.nlm.nih.gov/pubmed/32104917. Cited 2020 Apr 2.

38.

Zhao R, Li M, Song H, Chen J, Ren W, Feng Y, et al. Serological diagnostic kit of SARS-CoV-2 antibodies using CHO-expressed full-length SARS-CoV-2 S1 proteins. medRxiv. 2020:2020.03.26.20042184 Available from: https://www.medrxiv.org/content/10.1101/2020.03.26.20042184v1. Cited 2020 May 31.

39.

Zhang P, Gao Q, Wang T, Ke Y, Mo F, Jia R, et al. Evaluation of recombinant nucleocapsid and spike proteins for serological diagnosis of novel coronavirus disease 2019 (COVID-19). medRxiv. 2020:2020.03.17.20036954 Available from: https://www.medrxiv.org/content/10.1101/2020.03.17.20036954v1. Cited 2020 May 31.

40.

Paradiso AV, De Summa S, Loconsole D, Procacci V, Sallustio A, Centrone F, et al. Clinical meanings of rapid serological assay in patients tested for SARS-Co2 RT-PCR. medRxiv. 2020:2020.04.03.20052183.

41.

Ma H, Zeng W, He H, Zhao D, Yang Y, Jiang D, et al. COVID-19 diagnosis and study of serum SARS-CoV-2 specific IgA, IgM and IgG by a quantitative and sensitive immunoassay. medRxiv. 2020:2020.04.17.20064907.

42.

Zhong L, Chuan J, Gong B, Shuai P, Zhou Y, Zhang Y, et al. Detection of serum IgM and IgG for COVID-19 diagnosis. Sci China Life Sci. 2020;63(5):777–80. https://doi.org/10.1007/s11427-020-1688-9 Science in China Press.CrossRefPubMed

43.

Xie J, Ding C, Li J, Wang Y, Guo H, Lu Z, et al. Characteristics of patients with coronavirus disease (COVID-19) confirmed using an IgM-IgG antibody test. J Med Virol. 2020:jmv.25930 Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/jmv.25930. Cited 2020 May 31.

44.

Infantino M, Grossi V, Lari B, Bambi R, Perri A, Manneschi M, et al. Diagnostic accuracy of an automated chemiluminescent immunoassay for anti-SARS-CoV-2 IgM and IgG antibodies: an Italian experience. J Med Virol. 2020:jmv.25932 Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/jmv.25932. Cited 2020 May 31.

45.

Crook D. Evaluation of antibody testing for SARS-CoV-2 using ELISA and lateral flow immunoassays. Available from: https://doi.org/10.1101/2020.04.15.20066407. Cited 2020 May 31

46.

Lassaunière R, Frische A, Harboe ZB, Nielsen AC, Fomsgaard A, Krogfelt KA, et al. Evaluation of nine commercial SARS-CoV-2 immunoassays. medRxiv. 2020:2020.04.09.20056325.

47.

Wang Q, Du Q, Guo B, Mu D, Lu X, Ma Q, et al. A method to prevent SARS-CoV-2 IgM false positives in gold immunochromatography and enzyme-linked immunosorbent assays. J Clin Microbiol. 2020;58(6).

48.

Lou B, Li T, Zheng S, Su Y, Li Z, Liu W, et al. Serology characteristics of SARS-CoV-2 infection since the exposure and post symptoms onset. medRxiv. 2020:2020.03.23.20041707.

49.

Liu L, Liu W, Wang S, Zheng S. A preliminary study on serological assay for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in 238 admitted hospital patients. medRxiv. 2020:2020.03.06.20031856.

50.

Imai K, Tabata S, Ikeda M, Noguchi S, Kitagawa Y, Matuoka M, et al. Clinical evaluation of an immunochromatographic IgM/IgG antibody assay and chest computed tomography for the diagnosis of COVID-19. medRxiv. 2020:2020.04.22.20075564.

51.

Garcia FP, Tanoira RP, Cabrera JPR, Serrano TA, Herruz PG, Gonzalez JC. Rapid diagnosis of SARS-CoV-2 infection by detecting IgG and IgM antibodies with an immunochromatographic device: a prospective single-center study. medRxiv. 2020:2020.04.11.20062158.

52.

Chen Z, Zhang Z, Zhai X, Li Y, Lin L, Zhao H, et al. Rapid and sensitive detection of anti-SARS-CoV-2 IgG, using lanthanide-doped nanoparticles-based lateral flow immunoassay. Anal Chem. 2020.

53.

Döhla M, Boesecke C, Schulte B, Diegmann C, Sib E, Richter E, et al. Rapid point-of-care testing for SARS-CoV-2 in a community screening setting shows low sensitivity. Public Health. 2020;182:170–2. https://doi.org/10.1016/j.puhe.2020.04.009.CrossRefPubMedPubMedCentral

54.

Burbelo PD, Riedo FX, Morishima C, Rawlings S, Smith D, Das S, et al. Detection of nucleocapsid antibody to SARS-CoV-2 is more sensitive than antibody to Spike protein in COVID-19 patients. medRxiv. 2020:2020.04.20.20071423.

55.

Jones CM, Athanasiou T. Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests. Ann Thorac Surg. 2005 Jan 1;79(1):16–20. https://doi.org/10.1016/j.athoracsur.2004.09.040.CrossRefPubMed

56.

Deeks JJ, Dinnes J, Takwoingi Y, Davenport C, Spijker R, Taylor-Phillips S, et al. Antibody tests for identification of current and past infection with SARS-CoV-2. Cochrane Database Syst Rev. 2020;2020 Available from: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD013652/full. John Wiley and Sons Ltd. Cited 2021 Mar 19.

57.

Lisboa Bastos M, Tavaziva G, Abidi SK, Campbell JR, Haraoui LP, Johnston JC, et al. Diagnostic accuracy of serological tests for covid-19: Systematic review and meta-analysis. BMJ. 2020;370:2516 Available from: https://connect.medrxiv.org/relate/content/181. Cited 2021 Mar 19.CrossRef

58.

Wang H, Ai J, Loeffelholz MJ, Tang YW, Zhang W. Meta-analysis of diagnostic performance of serology tests for COVID-19: impact of assay design and post-symptom-onset intervals. Emerg Microbes Infect. 2020;9(1):2200–11 Available from: https://www.tandfonline.com/doi/full/10.1080/22221751.2020.1826362. Cited 2021 Mar 19.CrossRef

59.

Zhang X, Wu X, Wang D, Lu M, Hou X, Wang H, et al. Proteome-wide analysis of differentially-expressed SARS-CoV-2 antibodies in early COVID-19 infection. medRxiv. 2020:2020.04.14.20064535 Available from: https://www.medrxiv.org/content/10.1101/2020.04.14.20064535v2?%253fcollection=. Cited 2020 May 31.

60.

Kontou PI, Braliou GG, Dimou NL, Nikolopoulos G, Bagos PG. Antibody tests in detecting SARS-CoV-2 infection: a meta-analysis. medRxiv. 2020:2020.04.22.20074914 Available from: http://medrxiv.org/content/early/2020/04/25/2020.04.22.20074914.abstract. Cited 2020 May 31.

61.

Freeman SC, Kerby CR, Patel A, Cooper NJ, Quinn T, Sutton AJ. Development of an interactive web-based tool to conduct and interrogate meta-analysis of diagnostic test accuracy studies: MetaDTA. BMC Med Res Methodol. 2019;19(1).

62.

Tahamtan A, Ardebili A. Real-time RT-PCR in COVID-19 detection: issues affecting the results. Expert Rev Mol Diagn. 2020;20:453–4 Available from: https://www.tandfonline.com/doi/abs/10.1080/14737159.2020.1757437. Taylor and Francis Ltd. Cited 2020 Nov 18.CrossRef

63.

Watson J, Whiting PF, Brush JE. Interpreting a covid-19 test result. BMJ. 2020;369 Available from: https://calculator.testingwisely.com/playground. BMJ Publishing Group. Cited 2020 Nov 18.

64.

Arevalo-Rodriguez I, Buitrago-Garcia D, Simancas-Racines D, Zambrano-Achig P, del Campo R, Ciapponi A, et al. False-negative results of initial RT-PCR assays for COVID-19: a systematic review. medRxiv. 2020:2020.04.16.20066787 Available from: https://doi.org/10.1101/2020.04.16.20066787. Cited 2020 Nov 18.

65.

Ecdc. A systematic literature review on the diagnostic accuracy of serological tests for Lyme borreliosis. Available from: www.ecdc.europa.eu. Cited 2020 Nov 19

Title: A systematic and meta-analysis review on the diagnostic accuracy of antibodies in the serological diagnosis of COVID-19
Authors: Arthur Vengesai
Herald Midzi
Maritha Kasambala
Hamlet Mutandadzi
Tariro L. Mduluza-Jokonya
Simbarashe Rusakaniko
Francisca Mutapi
Thajasvarie Naicker
Takafira Mduluza
Publication date: 01-12-2021
Publisher: BioMed Central
Keywords: SARS-CoV-2
COVID-19
Published in: Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI: https://doi.org/10.1186/s13643-021-01689-3

Keynote webinar | Spotlight on medication adherence

Springer Medicine

A systematic and meta-analysis review on the diagnostic accuracy of antibodies in the serological diagnosis of COVID-19

Abstract

Background

Method

Results

Conclusions

Systematic review registration

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Method

Results

Conclusions

Systematic review registration

Please log in to get access to this content

Other articles of this Issue 1/2021

Mapping evidence on management of cervical cancer in sub-Saharan Africa: scoping review protocol

Obstructed labor and its association with adverse feto-maternal outcome in Ethiopia: a protocol for a systematic review and meta-analysis

Aetiology and outcome of non-traumatic coma in African children: protocol for a systematic review and meta-analysis

Climate change and health in North America: literature review protocol

The prevalence of tuberculosis, malaria and soil-transmitted helminth infection in minority indigenous people of Southeast Asia and the Western Pacific: protocol for a systematic review and meta-analysis

Effect of gut microbiota modulation on feeding tolerance of enterally fed critically ill adult patients: a systematic review