Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Technical advance

Imputing HIV treatment start dates from routine laboratory data in South Africa: a validation study

Authors: Mhairi Maskew, Jacob Bor, Cheryl Hendrickson, William MacLeod, Till Bärnighausen, Deenan Pillay, Ian Sanne, Sergio Carmona, Wendy Stevens, Matthew P Fox

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Poor clinical record keeping hinders health systems monitoring and patient care in many low resource settings. We develop and validate a novel method to impute dates of antiretroviral treatment (ART) initiation from routine laboratory data in South Africa’s public sector HIV program. This method will enable monitoring of the national ART program using real-time laboratory data, avoiding the error potential of chart review.

Methods

We developed an algorithm to impute ART start dates based on the date of a patient’s “ART workup”, i.e. the laboratory tests used to determine treatment readiness in national guidelines, and the time from ART workup to initiation based on clinical protocols (21 days). To validate the algorithm, we analyzed data from two large clinical HIV cohorts: Hlabisa HIV Treatment and Care Programme in rural KwaZulu-Natal; and Right to Care Cohort in urban Gauteng. Both cohorts contain known ART initiation dates and laboratory results imported directly from the National Health Laboratory Service. We assessed median time from ART workup to ART initiation and calculated sensitivity (SE), specificity (SP), positive predictive value (PPV), and negative predictive value (NPV) of our imputed start date vs. the true start date within a 6 month window. Heterogeneity was assessed across individual clinics and over time.

Results

We analyzed data from over 80,000 HIV-positive adults. Among patients who had a workup and initiated ART, median time to initiation was 16 days (IQR 7,31) in Hlabisa and 21 (IQR 8,43) in RTC cohort. Among patients with known ART start dates, SE of the imputed start date was 83% in Hlabisa and 88% in RTC, indicating this method accurately predicts ART start dates for about 85% of all ART initiators. In Hlabisa, PPV was 95%, indicating that for patients with a lab workup, true start dates were predicted with high accuracy. SP (100%) and NPV (92%) were also very high.

Conclusions

Routine laboratory data can be used to infer ART initiation dates in South Africa’s public sector. Where care is provided based on protocols, laboratory data can be used to monitor health systems performance and improve accuracy and completeness of clinical records.
Appendix
Available only for authorised users
Footnotes
1
This adjustment factor follows directly from Bayes Theorem, which says that PPV = sensitivity * Pr(ART)/Pr(workup). For example: if 100 patients have a lab work-up at a given clinic, then we expect that 95.4 of these patients will initiate ART within six months. However, those 95.4 patients represent only the 82.6% of ART initiators who also had a workup. Dividing by 82.6% yields an estimate of 115 total ART initiators at the clinic.
 
Literature
1.
go back to reference Forster M, Bailey C, Brinkhof MWG, Graber C, Boulle A, Spohr M, et al. Electronic medical record systems, data quality and loss to follow-up: Survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ. 2008;86:939–47.CrossRefPubMedPubMedCentral Forster M, Bailey C, Brinkhof MWG, Graber C, Boulle A, Spohr M, et al. Electronic medical record systems, data quality and loss to follow-up: Survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ. 2008;86:939–47.CrossRefPubMedPubMedCentral
2.
go back to reference Menachemi N, Brooks RG. Reviewing the benefits and costs of electronic health records and associated patient safety technologies. J Med Syst. 2006;30:159–68.CrossRefPubMed Menachemi N, Brooks RG. Reviewing the benefits and costs of electronic health records and associated patient safety technologies. J Med Syst. 2006;30:159–68.CrossRefPubMed
3.
go back to reference Pivovarov R, Elhadad N. Automated Methods for the Summarization of Electronic Health Records. J. Am. Med. Informatics Assoc. 2015;22(5):938-47. Pivovarov R, Elhadad N. Automated Methods for the Summarization of Electronic Health Records. J. Am. Med. Informatics Assoc. 2015;22(5):938-47.
4.
go back to reference Green LA, Potworowski G, Day A, May-Gentile R, Vibbert D, Maki B, et al. Sustaining “Meaningful Use” of health information technology in low-resource practices. Ann Fam Med. 2015;13:17–22.CrossRefPubMedPubMedCentral Green LA, Potworowski G, Day A, May-Gentile R, Vibbert D, Maki B, et al. Sustaining “Meaningful Use” of health information technology in low-resource practices. Ann Fam Med. 2015;13:17–22.CrossRefPubMedPubMedCentral
5.
go back to reference Blaya JA, Fraser HSF, Holt B. E-Health technologies show promise in developing countries. Health Aff. 2010;29:244–51.CrossRef Blaya JA, Fraser HSF, Holt B. E-Health technologies show promise in developing countries. Health Aff. 2010;29:244–51.CrossRef
6.
go back to reference Handford C, Tynan A-M, Rackal JM, Glazier R. Setting and organization of care for persons living with HIV/AIDS. In: Glazier R, editor. Cochrane database Syst. Rev. Chichester: Wiley; 2006. Handford C, Tynan A-M, Rackal JM, Glazier R. Setting and organization of care for persons living with HIV/AIDS. In: Glazier R, editor. Cochrane database Syst. Rev. Chichester: Wiley; 2006.
7.
go back to reference Fritz F, Tilahun B, Dugas M. Success criteria for electronic medical record implementations in low-resource settings: a systematic review. J Am Med Informatics Assoc. 2015;22:479–88.CrossRef Fritz F, Tilahun B, Dugas M. Success criteria for electronic medical record implementations in low-resource settings: a systematic review. J Am Med Informatics Assoc. 2015;22:479–88.CrossRef
9.
go back to reference UNAIDS. Report on the global AIDS epidemic. Geneva: UNAIDS; 2013. UNAIDS. Report on the global AIDS epidemic. Geneva: UNAIDS; 2013.
10.
go back to reference National Department of Health. Clinical Guidelines for the Management of HIV & AIDS in Adults and Adolescents. Republic of South Africa. 2004. National Department of Health. Clinical Guidelines for the Management of HIV & AIDS in Adults and Adolescents. Republic of South Africa. 2004.
11.
go back to reference National Department of Health. Clinical Guidelines for the Management of HIV & AIDS in Adults and Adolescents. Republic of South Africa. 2010. National Department of Health. Clinical Guidelines for the Management of HIV & AIDS in Adults and Adolescents. Republic of South Africa. 2010.
12.
go back to reference National Department of Health. The South African Antiretroviral Treatment Guidelines. Republic of South Africa. 2013. National Department of Health. The South African Antiretroviral Treatment Guidelines. Republic of South Africa. 2013.
13.
go back to reference Houlihan CF, Bland RM, Mutevedzi PC, Lessells RJ, Ndirangu J, Thulare H, et al. Cohort profile: Hlabisa HIV treatment and care programme. Int J Epidemiol. 2011;40:318–26.CrossRefPubMed Houlihan CF, Bland RM, Mutevedzi PC, Lessells RJ, Ndirangu J, Thulare H, et al. Cohort profile: Hlabisa HIV treatment and care programme. Int J Epidemiol. 2011;40:318–26.CrossRefPubMed
14.
go back to reference Fox MP, Maskew M, MacPhail AP, Long L, Brennan AT, Westreich D, et al. Cohort profile: the Themba Lethu clinical cohort, Johannesburg. South Africa Int J Epidemiol. 2013;42:430–9.CrossRefPubMed Fox MP, Maskew M, MacPhail AP, Long L, Brennan AT, Westreich D, et al. Cohort profile: the Themba Lethu clinical cohort, Johannesburg. South Africa Int J Epidemiol. 2013;42:430–9.CrossRefPubMed
15.
go back to reference National Department of Health. Policy and Guidelines for the Implementation of the PMTCT Programme. Republic South Africa. 2008. National Department of Health. Policy and Guidelines for the Implementation of the PMTCT Programme. Republic South Africa. 2008.
24.
go back to reference Bor J, Ahmed S, Fox MP, Rosen S, Tanser F, Pillay D, et al. Effect of eliminating CD4 thresholds on number of new ART initiators in South Africa. Boston, MA: CROI; 2016. Bor J, Ahmed S, Fox MP, Rosen S, Tanser F, Pillay D, et al. Effect of eliminating CD4 thresholds on number of new ART initiators in South Africa. Boston, MA: CROI; 2016.
25.
go back to reference Rosen S, Fox MP. Retention in HIV care between testing and treatment in sub-Saharan Africa: A systematic review. PLoS Med. 2011;8(7): e1001056. Rosen S, Fox MP. Retention in HIV care between testing and treatment in sub-Saharan Africa: A systematic review. PLoS Med. 2011;8(7): e1001056.
26.
go back to reference Fox MP, Brennan A, Maskew M, MacPhail P, Sanne I. Using vital registration data to update mortality among patients lost to follow-up from ART programmes: evidence from the Themba Lethu Clinic. South Africa Trop Med Int Health. 2010;15:405–13.PubMed Fox MP, Brennan A, Maskew M, MacPhail P, Sanne I. Using vital registration data to update mortality among patients lost to follow-up from ART programmes: evidence from the Themba Lethu Clinic. South Africa Trop Med Int Health. 2010;15:405–13.PubMed
27.
go back to reference Boulle A, Van Cutsem G, Hilderbrand K, Cragg C, Abrahams M, Mathee S, et al. Seven-year experience of a primary care antiretroviral treatment programme in Khayelitsha, South Africa. AIDS. 2010;24:563–72. Boulle A, Van Cutsem G, Hilderbrand K, Cragg C, Abrahams M, Mathee S, et al. Seven-year experience of a primary care antiretroviral treatment programme in Khayelitsha, South Africa. AIDS. 2010;24:563–72.
28.
go back to reference Sengayi M, Spoerri A, Egger M, Kielkowski D, Crankshaw T, Cloete C, Giddy J, Bohlius J. Record linkage to correct under‐ascertainment of cancers in HIV cohorts: The Sinikithemba HIV clinic linkage project. Int. J. Cancer. 2016;139:1209–16. Sengayi M, Spoerri A, Egger M, Kielkowski D, Crankshaw T, Cloete C, Giddy J, Bohlius J. Record linkage to correct under‐ascertainment of cancers in HIV cohorts: The Sinikithemba HIV clinic linkage project. Int. J. Cancer. 2016;139:1209–16. 
29.
go back to reference Braunstein S, Robertson M, Myers J, Nash D. Using HIV viral load from surveillance to estimate the timing of antiretroviral therapy initiation. JAIDS. 2016;73(2):222–27. Braunstein S, Robertson M, Myers J, Nash D. Using HIV viral load from surveillance to estimate the timing of antiretroviral therapy initiation. JAIDS. 2016;73(2):222–27.
Metadata
Title
Imputing HIV treatment start dates from routine laboratory data in South Africa: a validation study
Authors
Mhairi Maskew
Jacob Bor
Cheryl Hendrickson
William MacLeod
Till Bärnighausen
Deenan Pillay
Ian Sanne
Sergio Carmona
Wendy Stevens
Matthew P Fox
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1940-2

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue