Skip to main content
Top
Published in: Virology Journal 1/2023

Open Access 01-12-2023 | SARS-CoV-2 | Research

Assessing the comparability of cycle threshold values derived from five external quality assessment rounds for omicron nucleic acid testing

Authors: Gaowei Fan, Yali Jin, Qingtao Wang, Yuhong Yue

Published in: Virology Journal | Issue 1/2023

Login to get access

Abstract

Background

A variety of open-system real-time reverse transcriptase polymerase chain reaction (RT-PCR) assays for several acute respiratory syndrome coronavirus 2 are currently in use. This study aimed to ensure the quality of omicron nucleic acid testing and to assess the comparability of cycle threshold (Ct) values derived from RT-PCR.

Methods

Five external quality assessment (EQA) rounds using the omicron virus-like particles were organized between February 2022 and June 2022.

Results

A total of 1401 qualitative EQA reports have been collected. The overall positive percentage agreement was 99.72%, the negative percentage agreement was 99.75%, and the percent agreement was 99.73%. This study observed a significant variance in Ct values derived from different test systems. There was a wide heterogeneity in PCR efficiency among different RT-PCR kits and inter-laboratories.

Conclusion

There was strong concordance among laboratories performing qualitative omicron nucleic acid testing. Ct values from qualitative RT-PCR tests should not be used for clinical or epidemiological decision-making to avoid the potential for misinterpretation of the results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Karim SSA, Karim QA. Omicron SARS-CoV-2 variant: a new chapter in the COVID-19 pandemic. The Lancet. 2021;398:2126–8.CrossRef Karim SSA, Karim QA. Omicron SARS-CoV-2 variant: a new chapter in the COVID-19 pandemic. The Lancet. 2021;398:2126–8.CrossRef
2.
go back to reference Cassone A, Crisanti A. Can reasoned mass testing impact covid-19 outcomes in wide community contexts? An evidence-based opinion. Pathog Glob Health. 2021;115:203–7.CrossRefPubMedPubMedCentral Cassone A, Crisanti A. Can reasoned mass testing impact covid-19 outcomes in wide community contexts? An evidence-based opinion. Pathog Glob Health. 2021;115:203–7.CrossRefPubMedPubMedCentral
3.
go back to reference Aranha C, Patel V, Bhor V, Gogoi D. Cycle threshold values in RT-PCR to determine dynamics of SARS-CoV-2 viral load: an approach to reduce the isolation period for COVID-19 patients. J Med Virol. 2021;93:6794–7.CrossRefPubMedPubMedCentral Aranha C, Patel V, Bhor V, Gogoi D. Cycle threshold values in RT-PCR to determine dynamics of SARS-CoV-2 viral load: an approach to reduce the isolation period for COVID-19 patients. J Med Virol. 2021;93:6794–7.CrossRefPubMedPubMedCentral
4.
go back to reference Han X, Li J, Chen Y, Li Y, Xu Y, Ying B, et al. SARS-CoV-2 nucleic acid testing is China’s key pillar of COVID-19 containment. The Lancet. 2022;399:1690–1.CrossRef Han X, Li J, Chen Y, Li Y, Xu Y, Ying B, et al. SARS-CoV-2 nucleic acid testing is China’s key pillar of COVID-19 containment. The Lancet. 2022;399:1690–1.CrossRef
5.
go back to reference Dong G-P, Guo X-J, Sun Y-A, Zhang Z, Du L-P, Li M-Y. Diagnostic techniques for COVID-19: a mini-review of early diagnostic methods. J Anal Test. 2021;5:314–26.CrossRefPubMedPubMedCentral Dong G-P, Guo X-J, Sun Y-A, Zhang Z, Du L-P, Li M-Y. Diagnostic techniques for COVID-19: a mini-review of early diagnostic methods. J Anal Test. 2021;5:314–26.CrossRefPubMedPubMedCentral
6.
go back to reference Abbasi H, Tabaraei A, Hosseini SM, Khosravi A, Nikoo HR. Real-time PCR Ct value in SARS-CoV-2 detection: RdRp or N gene? Infection. 2022;50:537–40.CrossRefPubMed Abbasi H, Tabaraei A, Hosseini SM, Khosravi A, Nikoo HR. Real-time PCR Ct value in SARS-CoV-2 detection: RdRp or N gene? Infection. 2022;50:537–40.CrossRefPubMed
7.
go back to reference Rabaan AA, Tirupathi R, Sule AA, Aldali J, Al Mutair A, Alhumaid S, et al. Viral dynamics and real-time RT-PCR Ct values correlation with disease severity in COVID-19. Diagnostics. 2021;11:1091.CrossRefPubMedPubMedCentral Rabaan AA, Tirupathi R, Sule AA, Aldali J, Al Mutair A, Alhumaid S, et al. Viral dynamics and real-time RT-PCR Ct values correlation with disease severity in COVID-19. Diagnostics. 2021;11:1091.CrossRefPubMedPubMedCentral
8.
go back to reference Zheng S, Fan J, Yu F, Feng B, Lou B, Zou Q, et al. Viral load dynamics and disease severity in patients infected with SARS-CoV-2 in Zhejiang province, China, January–March 2020: retrospective cohort study. BMJ. 2020;369:m1443.CrossRefPubMedPubMedCentral Zheng S, Fan J, Yu F, Feng B, Lou B, Zou Q, et al. Viral load dynamics and disease severity in patients infected with SARS-CoV-2 in Zhejiang province, China, January–March 2020: retrospective cohort study. BMJ. 2020;369:m1443.CrossRefPubMedPubMedCentral
9.
go back to reference Abu-Raddad LJ, Chemaitelly H, Ayoub HH, Tang P, Coyle P, Hasan MR, et al. Relative infectiousness of SARS-CoV-2 vaccine breakthrough infections, reinfections, and primary infections. Nat Commun. 2022;13:532.CrossRefPubMedPubMedCentral Abu-Raddad LJ, Chemaitelly H, Ayoub HH, Tang P, Coyle P, Hasan MR, et al. Relative infectiousness of SARS-CoV-2 vaccine breakthrough infections, reinfections, and primary infections. Nat Commun. 2022;13:532.CrossRefPubMedPubMedCentral
10.
go back to reference Wright J, Achana F, Diwakar L, Semple MG, Carroll WD, Baillie K, et al. Cycle threshold values are inversely associated with poorer outcomes in hospitalized patients with COVID-19: a prospective, observational cohort study conducted at a UK tertiary hospital. Int J Infect Dis. 2021;111:333–5.CrossRefPubMedPubMedCentral Wright J, Achana F, Diwakar L, Semple MG, Carroll WD, Baillie K, et al. Cycle threshold values are inversely associated with poorer outcomes in hospitalized patients with COVID-19: a prospective, observational cohort study conducted at a UK tertiary hospital. Int J Infect Dis. 2021;111:333–5.CrossRefPubMedPubMedCentral
11.
go back to reference la Scola B, le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P, et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39:1059–61.CrossRefPubMedPubMedCentral la Scola B, le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P, et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39:1059–61.CrossRefPubMedPubMedCentral
12.
go back to reference Drancourt M, Cortaredona S, Melenotte C, Amrane S, Eldin C, la Scola B, et al. SARS-CoV-2 persistent viral shedding in the context of hydroxychloroquine-azithromycin treatment. Viruses. 2021;13:890.CrossRefPubMedPubMedCentral Drancourt M, Cortaredona S, Melenotte C, Amrane S, Eldin C, la Scola B, et al. SARS-CoV-2 persistent viral shedding in the context of hydroxychloroquine-azithromycin treatment. Viruses. 2021;13:890.CrossRefPubMedPubMedCentral
13.
go back to reference Seeni R, Firzli T, Riddle MS, Krasner C, Ashraf S, Siddiqui F. Using COVID-19 cycle threshold and other lab values as predictors of hospitalization need. J Med Virol. 2021;93:3007–14.CrossRefPubMed Seeni R, Firzli T, Riddle MS, Krasner C, Ashraf S, Siddiqui F. Using COVID-19 cycle threshold and other lab values as predictors of hospitalization need. J Med Virol. 2021;93:3007–14.CrossRefPubMed
14.
go back to reference Han YX, Chen YQ, Li JM, Zhang R. National external quality assessment for molecular detection of severe acute respiratory syndrome coronavirus 2 Delta variant. Zhonghua Yi Xue Za Zhi. 2022;102:216–21.PubMed Han YX, Chen YQ, Li JM, Zhang R. National external quality assessment for molecular detection of severe acute respiratory syndrome coronavirus 2 Delta variant. Zhonghua Yi Xue Za Zhi. 2022;102:216–21.PubMed
15.
go back to reference Wang Z, Chen Y, Yang J, Han Y, Shi J, Zhan S, et al. External quality assessment for molecular detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in clinical laboratories. J Mol Diagn. 2021;23:19–28.CrossRefPubMed Wang Z, Chen Y, Yang J, Han Y, Shi J, Zhan S, et al. External quality assessment for molecular detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in clinical laboratories. J Mol Diagn. 2021;23:19–28.CrossRefPubMed
16.
17.
go back to reference Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC, et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT–qPCR primer–probe sets. Nat Microbiol Nat Microbiol. 2020;5:1299–305.CrossRefPubMed Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC, et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT–qPCR primer–probe sets. Nat Microbiol Nat Microbiol. 2020;5:1299–305.CrossRefPubMed
18.
go back to reference Buchta C, Görzer I, Chiba P, Camp JV, Holzmann H, Puchhammer-Stöckl E, et al. Variability of cycle threshold values in an external quality assessment scheme for detection of the SARS-CoV-2 virus genome by RT-PCR. Clin Chem Lab Med (CCLM). 2021;59:987–94.CrossRefPubMed Buchta C, Görzer I, Chiba P, Camp JV, Holzmann H, Puchhammer-Stöckl E, et al. Variability of cycle threshold values in an external quality assessment scheme for detection of the SARS-CoV-2 virus genome by RT-PCR. Clin Chem Lab Med (CCLM). 2021;59:987–94.CrossRefPubMed
19.
go back to reference Rhoads D, Peaper DR, She RC, Nolte FS, Wojewoda CM, Anderson NW, et al. College of American Pathologists (CAP) Microbiology Committee perspective: caution must be used in interpreting the cycle threshold (Ct) value. Clin Infect Dis. 2021;72:e685–6.CrossRefPubMed Rhoads D, Peaper DR, She RC, Nolte FS, Wojewoda CM, Anderson NW, et al. College of American Pathologists (CAP) Microbiology Committee perspective: caution must be used in interpreting the cycle threshold (Ct) value. Clin Infect Dis. 2021;72:e685–6.CrossRefPubMed
20.
go back to reference Wang S, Liu Y, Li D, Zhou T, Gao S, Zha E, et al. Preparation and evaluation of MS2 bacteriophage-like particles packaging hepatitis E virus RNA. FEMS Microbiol Lett. 2016;363:fnw221 (Enright M, editor).CrossRefPubMed Wang S, Liu Y, Li D, Zhou T, Gao S, Zha E, et al. Preparation and evaluation of MS2 bacteriophage-like particles packaging hepatitis E virus RNA. FEMS Microbiol Lett. 2016;363:fnw221 (Enright M, editor).CrossRefPubMed
21.
go back to reference Zhan S, Li J, Xu R, Wang L, Zhang K, Zhang R. Armored long RNA controls or standards for branched DNA assay for detection of human immunodeficiency virus type 1. J Clin Microbiol. 2009;47:2571–6.CrossRefPubMedPubMedCentral Zhan S, Li J, Xu R, Wang L, Zhang K, Zhang R. Armored long RNA controls or standards for branched DNA assay for detection of human immunodeficiency virus type 1. J Clin Microbiol. 2009;47:2571–6.CrossRefPubMedPubMedCentral
22.
go back to reference CNAS-GL003:2018. Guidance on evaluating the homogeneity and stability of samples used for proficiency testing; 2018. p. 0–7. CNAS-GL003:2018. Guidance on evaluating the homogeneity and stability of samples used for proficiency testing; 2018. p. 0–7.
23.
go back to reference Svec D, Tichopad A, Novosadova V, Pfaffl MW, Kubista M. How good is a PCR efficiency estimate: recommendations for precise and robust qPCR efficiency assessments. Biomol Detect Quantif. 2015;3:9–16.CrossRefPubMedPubMedCentral Svec D, Tichopad A, Novosadova V, Pfaffl MW, Kubista M. How good is a PCR efficiency estimate: recommendations for precise and robust qPCR efficiency assessments. Biomol Detect Quantif. 2015;3:9–16.CrossRefPubMedPubMedCentral
24.
go back to reference Evans D, Cowen S, Kammel M, O’Sullivan DM, Stewart G, Grunert H-P, et al. The dangers of using Cq to quantify nucleic acid in biological samples: a lesson from COVID-19. Clin Chem. 2021;68:153–62.CrossRefPubMed Evans D, Cowen S, Kammel M, O’Sullivan DM, Stewart G, Grunert H-P, et al. The dangers of using Cq to quantify nucleic acid in biological samples: a lesson from COVID-19. Clin Chem. 2021;68:153–62.CrossRefPubMed
25.
go back to reference Bisht A, Mishra A, Bisht H, Tripathi RM. Nanomaterial Based biosensors for detection of viruses including SARS-CoV-2: a review. J Anal Test. 2021;5:327–40.CrossRefPubMedPubMedCentral Bisht A, Mishra A, Bisht H, Tripathi RM. Nanomaterial Based biosensors for detection of viruses including SARS-CoV-2: a review. J Anal Test. 2021;5:327–40.CrossRefPubMedPubMedCentral
26.
go back to reference Fan G, Wang Q. Quality control and quality assurance. In: Pan S, Tang J, editors. Clinical molecular diagnostics. Singapore: Springer; 2021. p. 97–113.CrossRef Fan G, Wang Q. Quality control and quality assurance. In: Pan S, Tang J, editors. Clinical molecular diagnostics. Singapore: Springer; 2021. p. 97–113.CrossRef
27.
go back to reference Li R-H, Wang Q-Y. A localized small-scale external quality assessment (EQA) for PCR testing of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in the molecular laboratories. J Virol Methods. 2022;301:114441.CrossRefPubMed Li R-H, Wang Q-Y. A localized small-scale external quality assessment (EQA) for PCR testing of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in the molecular laboratories. J Virol Methods. 2022;301:114441.CrossRefPubMed
28.
go back to reference Wang X, Xu X, Zhu K, Zhang P, Yang X, Wang Q, et al. External quality assessment for nucleic acid test of the novel coronavirus. Chin J Lab Med. 2020;43:1100–5. Wang X, Xu X, Zhu K, Zhang P, Yang X, Wang Q, et al. External quality assessment for nucleic acid test of the novel coronavirus. Chin J Lab Med. 2020;43:1100–5.
29.
go back to reference Karahasan Yagci A, Sarinoglu RC, Bilgin H, Yanılmaz Ö, Sayın E, Deniz G, et al. Relationship of the cycle threshold values of SARS-CoV-2 polymerase chain reaction and total severity score of computerized tomography in patients with COVID 19. Int J Infect Dis. 2020;101:160–6.CrossRefPubMedPubMedCentral Karahasan Yagci A, Sarinoglu RC, Bilgin H, Yanılmaz Ö, Sayın E, Deniz G, et al. Relationship of the cycle threshold values of SARS-CoV-2 polymerase chain reaction and total severity score of computerized tomography in patients with COVID 19. Int J Infect Dis. 2020;101:160–6.CrossRefPubMedPubMedCentral
30.
go back to reference Wong GL-H, Yip TC-F, Wong VW-S, Tse Y-K, Hui DS-C, Lee S-S, et al. SARS-CoV-2 viral persistence based on cycle threshold value and liver injury in patients with COVID-19. Open Forum Infect Dis. 2021;8:1–12.CrossRef Wong GL-H, Yip TC-F, Wong VW-S, Tse Y-K, Hui DS-C, Lee S-S, et al. SARS-CoV-2 viral persistence based on cycle threshold value and liver injury in patients with COVID-19. Open Forum Infect Dis. 2021;8:1–12.CrossRef
31.
go back to reference Sakano T, Urashima M, Takao H, Takeshita K, Kobashi H, Fujiwara T. Differential kinetics of cycle threshold values during admission by symptoms among patients with mild COVID-19: a prospective cohort study. Int J Environ Res Public Health. 2021;18:8181.CrossRefPubMedPubMedCentral Sakano T, Urashima M, Takao H, Takeshita K, Kobashi H, Fujiwara T. Differential kinetics of cycle threshold values during admission by symptoms among patients with mild COVID-19: a prospective cohort study. Int J Environ Res Public Health. 2021;18:8181.CrossRefPubMedPubMedCentral
32.
go back to reference Schnuriger A, Perrier M, Marinho V, Michel Y, Saloum K, Boukli N, et al. Caution in interpretation of SARS-CoV-2 quantification based on RT-PCR cycle threshold value. Diagn Microbiol Infect Dis. 2021;100:115366.CrossRefPubMedPubMedCentral Schnuriger A, Perrier M, Marinho V, Michel Y, Saloum K, Boukli N, et al. Caution in interpretation of SARS-CoV-2 quantification based on RT-PCR cycle threshold value. Diagn Microbiol Infect Dis. 2021;100:115366.CrossRefPubMedPubMedCentral
33.
go back to reference Engelmann I, Alidjinou EK, Ogiez J, Pagneux Q, Miloudi S, Benhalima I, et al. Preanalytical issues and cycle threshold values in SARS-CoV-2 real-time RT-PCR testing: should test results include these? ACS Omega. 2021;6:6528–36.CrossRefPubMedPubMedCentral Engelmann I, Alidjinou EK, Ogiez J, Pagneux Q, Miloudi S, Benhalima I, et al. Preanalytical issues and cycle threshold values in SARS-CoV-2 real-time RT-PCR testing: should test results include these? ACS Omega. 2021;6:6528–36.CrossRefPubMedPubMedCentral
34.
go back to reference Malecki M, Luesebrink J, Wendel AF, Mattner F. Analysis of external quality assessment samples revealed crucial performance differences between commercial RT-PCR assays for SARS-CoV-2 detection when taking extraction methods and real-time-PCR instruments into account. J Virol Methods. 2021;295:114202.CrossRefPubMedPubMedCentral Malecki M, Luesebrink J, Wendel AF, Mattner F. Analysis of external quality assessment samples revealed crucial performance differences between commercial RT-PCR assays for SARS-CoV-2 detection when taking extraction methods and real-time-PCR instruments into account. J Virol Methods. 2021;295:114202.CrossRefPubMedPubMedCentral
35.
go back to reference Rhoads DD, Pinsky BA. The truth about SARS-CoV-2 cycle threshold values is rarely pure and never simple. Clin Chem. 2021;68:16–8.CrossRefPubMed Rhoads DD, Pinsky BA. The truth about SARS-CoV-2 cycle threshold values is rarely pure and never simple. Clin Chem. 2021;68:16–8.CrossRefPubMed
38.
go back to reference Han MS, Byun J-H, Cho Y, Rim JH. RT-PCR for SARS-CoV-2: quantitative versus qualitative. Lancet Infect Dis. 2021;21:165.CrossRefPubMed Han MS, Byun J-H, Cho Y, Rim JH. RT-PCR for SARS-CoV-2: quantitative versus qualitative. Lancet Infect Dis. 2021;21:165.CrossRefPubMed
39.
go back to reference Hayden RT, Hokanson KM, Pounds SB, Bankowski MJ, Belzer SW, Carr J, et al. Multicenter comparison of different real-time PCR assays for quantitative detection of Epstein–Barr virus. J Clin Microbiol. 2008;46:157–63.CrossRefPubMed Hayden RT, Hokanson KM, Pounds SB, Bankowski MJ, Belzer SW, Carr J, et al. Multicenter comparison of different real-time PCR assays for quantitative detection of Epstein–Barr virus. J Clin Microbiol. 2008;46:157–63.CrossRefPubMed
Metadata
Title
Assessing the comparability of cycle threshold values derived from five external quality assessment rounds for omicron nucleic acid testing
Authors
Gaowei Fan
Yali Jin
Qingtao Wang
Yuhong Yue
Publication date
01-12-2023
Publisher
BioMed Central
Keyword
SARS-CoV-2
Published in
Virology Journal / Issue 1/2023
Electronic ISSN: 1743-422X
DOI
https://doi.org/10.1186/s12985-023-02032-z

Other articles of this Issue 1/2023

Virology Journal 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.