Skip to main content
Top
Published in: BMC Infectious Diseases 1/2024

Open Access 01-02-2024 | Syphilis | Research

External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries

Authors: Weiping Cao, Yetunde F. Fakile, Mayur R. Shukla, Kevin Pettus, Kathryn Lupoli, Jaeyoung Hong, Allan Pillay, Ranmini Kularatne, Hicham Oumzil, Valeska Padovese, Nigel Sherriff, Isaac SSewanyana, Silver K. Vargas, Antonella Zorzi, Karel Blondeel, Igor Toskin, Ellen N. Kersh

Published in: BMC Infectious Diseases | Special Issue 1/2024

Login to get access

Abstract

Background

Sexually transmitted infections (STIs) such as syphilis and HIV remain to be a significant public health issue worldwide. Dual rapid point-of-care tests (POCTs) have shown promise for detecting antibodies to HIV and syphilis but have not been fully evaluated in the field. Our study supported the WHO ProSPeRo study on Sexually Transmitted Infection Point-of-Care Testing (STI POCT) by providing external quality assessment (EQA) for HIV and syphilis testing in reference laboratories and their associated clinical sites in seven countries.

Methods

HIV/syphilis serum liquid and dried tube specimen (DTS) panels were prepared by CDC. Liquid panels were distributed to the reference laboratories for three rounds of testing using commercially and locally available laboratory-based serological tests. DTS panels were sent to the clinical testing sites for 8 rounds of POC testing using the Abbott SD BIOLINE HIV/Syphilis Duo test (hereafter referred to as SD BIOLINE) and the Chembio Dual Path Platform (DPP) HIV-Syphilis assay. EQA panels were tested at CDC using the Rapid Plasma Reagin (RPR) test and the Treponema pallidum Particle Agglutination assay (TP-PA) for syphilis antibodies. Genetic Systems HIV-1/HIV-2 Plus O EIA, Geenius HIV Supplemental Assay and the Oraquick Advance HIV test were used to detect HIV antibodies in the EQA panels. Results from the reference laboratories and POCT sites were compared to those obtained at the CDC and a percentage agreement was calculated.

Results

Qualitative RPR and TP-PA performed at the reference laboratories demonstrated 95.4–100% agreement with CDC results while quantitative RPR and TP-PA tests demonstrated 87.7% and 89.2% agreement, respectively. A 93.8% concordance rate was observed for qualitative HIV testing in laboratories. EQA testing at clinical sites using dual tests showed 98.7% and 99.1% agreement for detection of HIV antibodies and eight out of 10 sites had > 95.8% agreement for syphilis testing. However, two clinical sites showed only 65.0–66.7% agreement for SD BIOLINE and 84.0–86.7% for DPP, respectively, for syphilis testing.

Conclusions

Overall, laboratories demonstrated high EQA performance in this study. Both HIV/syphilis POCTs gave expected results in the clinic-based evaluations using DTS. However, testing errors were identified in a few testing sites suggesting the necessity for continuous training and monitoring the quality of POC testing.
Literature
4.
go back to reference Wijesooriya NS, Rochat RW, Kamb ML, Turlapati P, Temmerman M, Broutet N, Newman LM. Global burden of maternal and congenital syphilis in 2008 and 2012: a health systems modelling study. Lancet Glob Health. 2016;4(8):e525-533.CrossRefPubMedPubMedCentral Wijesooriya NS, Rochat RW, Kamb ML, Turlapati P, Temmerman M, Broutet N, Newman LM. Global burden of maternal and congenital syphilis in 2008 and 2012: a health systems modelling study. Lancet Glob Health. 2016;4(8):e525-533.CrossRefPubMedPubMedCentral
10.
go back to reference Wu MY, Gong HZ, Hu KR, Zheng HY, Wan X, Li J. Effect of syphilis infection on HIV acquisition: a systematic review and meta-analysis. Sex Transm Infect. 2021;97(7):525–33.CrossRefPubMed Wu MY, Gong HZ, Hu KR, Zheng HY, Wan X, Li J. Effect of syphilis infection on HIV acquisition: a systematic review and meta-analysis. Sex Transm Infect. 2021;97(7):525–33.CrossRefPubMed
11.
go back to reference Jarzebowski W, Caumes E, Dupin N, Farhi D, Lascaux AS, Piketty C, de Truchis P, Bouldouyre MA, Derradji O, Pacanowski J, et al. Effect of early syphilis infection on plasma viral load and CD4 cell count in human immunodeficiency virus-infected men: results from the FHDH-ANRS CO4 cohort. Arch Intern Med. 2012;172(16):1237–43.CrossRefPubMed Jarzebowski W, Caumes E, Dupin N, Farhi D, Lascaux AS, Piketty C, de Truchis P, Bouldouyre MA, Derradji O, Pacanowski J, et al. Effect of early syphilis infection on plasma viral load and CD4 cell count in human immunodeficiency virus-infected men: results from the FHDH-ANRS CO4 cohort. Arch Intern Med. 2012;172(16):1237–43.CrossRefPubMed
12.
go back to reference Kofoed K, Gerstoft J, Mathiesen LR, Benfield T. Syphilis and human immunodeficiency virus (HIV)-1 coinfection: influence on CD4 T-cell count, HIV-1 viral load, and treatment response. Sex Transm Dis. 2006;33(3):143–8.CrossRefPubMed Kofoed K, Gerstoft J, Mathiesen LR, Benfield T. Syphilis and human immunodeficiency virus (HIV)-1 coinfection: influence on CD4 T-cell count, HIV-1 viral load, and treatment response. Sex Transm Dis. 2006;33(3):143–8.CrossRefPubMed
13.
go back to reference Lee MJ, Hallmark RJ, Frenkel LM, Del Priore G. Maternal syphilis and vertical perinatal transmission of human immunodeficiency virus type-1 infection. Int J Gynaecol Obstet. 1998;63(3):247–52.CrossRefPubMed Lee MJ, Hallmark RJ, Frenkel LM, Del Priore G. Maternal syphilis and vertical perinatal transmission of human immunodeficiency virus type-1 infection. Int J Gynaecol Obstet. 1998;63(3):247–52.CrossRefPubMed
14.
go back to reference Fleishman JA, Yehia BR, Moore RD, Gebo KA, Network HIVR. The economic burden of late entry into medical care for patients with HIV infection. Med Care. 2010;48(12):1071–9.CrossRefPubMedPubMedCentral Fleishman JA, Yehia BR, Moore RD, Gebo KA, Network HIVR. The economic burden of late entry into medical care for patients with HIV infection. Med Care. 2010;48(12):1071–9.CrossRefPubMedPubMedCentral
15.
go back to reference Parekh BS, Ou CY, Fonjungo PN, Kalou MB, Rottinghaus E, Puren A, Alexander H, Hurlston Cox M, Nkengasong JN. Diagnosis of Human Immunodeficiency Virus Infection. Clin Microbiol Rev. 2019;32(1):10–128. Parekh BS, Ou CY, Fonjungo PN, Kalou MB, Rottinghaus E, Puren A, Alexander H, Hurlston Cox M, Nkengasong JN. Diagnosis of Human Immunodeficiency Virus Infection. Clin Microbiol Rev. 2019;32(1):10–128.
17.
go back to reference Gaitan-Duarte HG, Newman L, Laverty M, Habib NA, Gonzalez-Gordon LM, Angel-Muller E, Abella C, Barros EC, Rincon C, Caicedo S, et al. Comparative effectiveness of single and dual rapid diagnostic tests for syphilis and HIV in antenatal care services in Colombia. Rev Panam Salud Publica. 2016;40(6):455–61.PubMed Gaitan-Duarte HG, Newman L, Laverty M, Habib NA, Gonzalez-Gordon LM, Angel-Muller E, Abella C, Barros EC, Rincon C, Caicedo S, et al. Comparative effectiveness of single and dual rapid diagnostic tests for syphilis and HIV in antenatal care services in Colombia. Rev Panam Salud Publica. 2016;40(6):455–61.PubMed
18.
go back to reference Kasaro MP, Bosomprah S, Taylor MM, Sindano N, Phiri C, Tambatamba B, Malumo S, Freeman B, Chibwe B, Laverty M, et al. Field performance evaluation of dual rapid HIV and syphilis tests in three antenatal care clinics in Zambia. Int J STD AIDS. 2019;30(4):323–8.CrossRefPubMed Kasaro MP, Bosomprah S, Taylor MM, Sindano N, Phiri C, Tambatamba B, Malumo S, Freeman B, Chibwe B, Laverty M, et al. Field performance evaluation of dual rapid HIV and syphilis tests in three antenatal care clinics in Zambia. Int J STD AIDS. 2019;30(4):323–8.CrossRefPubMed
19.
go back to reference Toskin I, Blondeel K, Peeling RW, Deal C, Kiarie J. Advancing point of care diagnostics for the control and prevention of STIs: the way forward. Sex Transm Infect. 2017;93(S4):S81–8.CrossRefPubMed Toskin I, Blondeel K, Peeling RW, Deal C, Kiarie J. Advancing point of care diagnostics for the control and prevention of STIs: the way forward. Sex Transm Infect. 2017;93(S4):S81–8.CrossRefPubMed
20.
go back to reference Network ProSPeRo. Standardised protocol for a prospective cross-sectional multicentre clinic-based evaluation of two dual point-of-care tests for the screening of HIV and syphilis in men who have sex with men, sex workers and pregnant women. BMJ Open. 2020;10(11):e044479.CrossRef Network ProSPeRo. Standardised protocol for a prospective cross-sectional multicentre clinic-based evaluation of two dual point-of-care tests for the screening of HIV and syphilis in men who have sex with men, sex workers and pregnant women. BMJ Open. 2020;10(11):e044479.CrossRef
21.
go back to reference Parekh BS, Anyanwu J, Patel H, Downer M, Kalou M, Gichimu C, Keipkerich BS, Clement N, Omondi M, Mayer O, et al. Dried tube specimens: a simple and cost-effective method for preparation of HIV proficiency testing panels and quality control materials for use in resource-limited settings. J Virol Methods. 2010;163(2):295–300.CrossRefPubMed Parekh BS, Anyanwu J, Patel H, Downer M, Kalou M, Gichimu C, Keipkerich BS, Clement N, Omondi M, Mayer O, et al. Dried tube specimens: a simple and cost-effective method for preparation of HIV proficiency testing panels and quality control materials for use in resource-limited settings. J Virol Methods. 2010;163(2):295–300.CrossRefPubMed
22.
go back to reference Hopkins AO, Trinh T, Fakile YF, Pillay A, Taylor MM, Kersh E, Kamb M. Evaluation of the WHO/CDC Syphilis Serology Proficiency Programme to support the global elimination of mother-to-child transmission of syphilis: an observational cross-sectional study, 2008–2015. BMJ Open. 2020;10(1):e029434.CrossRefPubMedPubMedCentral Hopkins AO, Trinh T, Fakile YF, Pillay A, Taylor MM, Kersh E, Kamb M. Evaluation of the WHO/CDC Syphilis Serology Proficiency Programme to support the global elimination of mother-to-child transmission of syphilis: an observational cross-sectional study, 2008–2015. BMJ Open. 2020;10(1):e029434.CrossRefPubMedPubMedCentral
25.
go back to reference Rodriguez PJ, Roberts DA, Meisner J, Sharma M, Owiredu MN, Gomez B, Mello MB, Bobrik A, Vodianyk A, Storey A, et al. Cost-effectiveness of dual maternal HIV and syphilis testing strategies in high and low HIV prevalence countries: a modelling study. Lancet Glob Health. 2021;9(1):e61–71.CrossRefPubMed Rodriguez PJ, Roberts DA, Meisner J, Sharma M, Owiredu MN, Gomez B, Mello MB, Bobrik A, Vodianyk A, Storey A, et al. Cost-effectiveness of dual maternal HIV and syphilis testing strategies in high and low HIV prevalence countries: a modelling study. Lancet Glob Health. 2021;9(1):e61–71.CrossRefPubMed
28.
go back to reference Hamill MM, Mbazira KJ, Kiragga AN, Gaydos CA, Jett-Goheen M, Parkes-Ratanshi R, Manabe YC, Nakku-Joloba E, Rompalo A. Challenges of rapid plasma reagin interpretation in syphilis screening in uganda: variability in nontreponemal results between different laboratories. Sex Transm Dis. 2018;45(12):829–33.CrossRefPubMedPubMedCentral Hamill MM, Mbazira KJ, Kiragga AN, Gaydos CA, Jett-Goheen M, Parkes-Ratanshi R, Manabe YC, Nakku-Joloba E, Rompalo A. Challenges of rapid plasma reagin interpretation in syphilis screening in uganda: variability in nontreponemal results between different laboratories. Sex Transm Dis. 2018;45(12):829–33.CrossRefPubMedPubMedCentral
30.
go back to reference Van Den Heuvel A, Smet H, Prat I, Sands A, Urassa W, Fransen K, Crucitti T. Laboratory evaluation of four HIV/syphilis rapid diagnostic tests. BMC Infect Dis. 2019;19(1):1.CrossRefPubMed Van Den Heuvel A, Smet H, Prat I, Sands A, Urassa W, Fransen K, Crucitti T. Laboratory evaluation of four HIV/syphilis rapid diagnostic tests. BMC Infect Dis. 2019;19(1):1.CrossRefPubMed
31.
go back to reference Liu F, Liu LL, Guo XJ, Xi Y, Lin LR, Zhang HL, Huang SJ, Chen YY, Zhang YF, Zhang Q, et al. Characterization of the classical biological false-positive reaction in the serological test for syphilis in the modern era. Int Immunopharmacol. 2014;20(2):331–6.CrossRefPubMed Liu F, Liu LL, Guo XJ, Xi Y, Lin LR, Zhang HL, Huang SJ, Chen YY, Zhang YF, Zhang Q, et al. Characterization of the classical biological false-positive reaction in the serological test for syphilis in the modern era. Int Immunopharmacol. 2014;20(2):331–6.CrossRefPubMed
32.
go back to reference Nandwani R, Evans DT. Are you sure it’s syphilis? A review of false positive serology. Int J STD AIDS. 1995;6(4):241–8.CrossRefPubMed Nandwani R, Evans DT. Are you sure it’s syphilis? A review of false positive serology. Int J STD AIDS. 1995;6(4):241–8.CrossRefPubMed
33.
go back to reference Rompalo AM, Cannon RO, Quinn TC, Hook EW 3rd. Association of biologic false-positive reactions for syphilis with human immunodeficiency virus infection. J Infect Dis. 1992;165(6):1124–6.CrossRefPubMed Rompalo AM, Cannon RO, Quinn TC, Hook EW 3rd. Association of biologic false-positive reactions for syphilis with human immunodeficiency virus infection. J Infect Dis. 1992;165(6):1124–6.CrossRefPubMed
34.
go back to reference Arora S, Doda V, Rani S, Kotwal U. Rapid plasma reagin test: high false positivity or important marker of high risk behavior. Asian J Transfus Sci. 2015;9(1):109.CrossRefPubMedPubMedCentral Arora S, Doda V, Rani S, Kotwal U. Rapid plasma reagin test: high false positivity or important marker of high risk behavior. Asian J Transfus Sci. 2015;9(1):109.CrossRefPubMedPubMedCentral
35.
go back to reference Benzaken AS, Bazzo ML, Galban E, Pinto IC, Nogueira CL, Golfetto L, Benzaken NS, Sollis KA, Mabey D, Peeling RW. External quality assurance with dried tube specimens (DTS) for point-of-care syphilis and HIV tests: experience in an indigenous populations screening programme in the Brazilian Amazon. Sex Transm Infect. 2014;90(1):14–8.CrossRefPubMed Benzaken AS, Bazzo ML, Galban E, Pinto IC, Nogueira CL, Golfetto L, Benzaken NS, Sollis KA, Mabey D, Peeling RW. External quality assurance with dried tube specimens (DTS) for point-of-care syphilis and HIV tests: experience in an indigenous populations screening programme in the Brazilian Amazon. Sex Transm Infect. 2014;90(1):14–8.CrossRefPubMed
Metadata
Title
External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries
Authors
Weiping Cao
Yetunde F. Fakile
Mayur R. Shukla
Kevin Pettus
Kathryn Lupoli
Jaeyoung Hong
Allan Pillay
Ranmini Kularatne
Hicham Oumzil
Valeska Padovese
Nigel Sherriff
Isaac SSewanyana
Silver K. Vargas
Antonella Zorzi
Karel Blondeel
Igor Toskin
Ellen N. Kersh
Publication date
01-02-2024

Other articles of this Special Issue 1/2024

BMC Infectious Diseases 1/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.