Top

Published in:

Open Access 01-12-2018 | Technical advance

Treating loss-to-follow-up as a missing data problem: a case study using a longitudinal cohort of HIV-infected patients in Haiti

Authors: Deanna P. Jannat-Khah, Michelle Unterbrink, Margaret McNairy, Samuel Pierre, Dan W. Fitzgerald, Jean Pape, Arthur Evans

Published in: BMC Public Health | Issue 1/2018

Abstract

Background

HIV programs are often assessed by the proportion of patients who are alive and retained in care; however some patients are categorized as lost to follow-up (LTF) and have unknown vital status. LTF is not an outcome but a mixed category of patients who have undocumented death, transfer and disengagement from care. Estimating vital status (dead versus alive) among this category is critical for survival analyses and program evaluation.

Methods

We used three methods to estimate survival in the cohort and to ascertain factors associated with death among the first cohort of HIV positive patients to receive antiretroviral therapy in Haiti: complete case (CC) (drops missing), Inverse Probability Weights (IPW) (uses tracking data) and Multiple Imputation with Chained Equations (MICE) (imputes missing data). Logistic regression was used to calculate odds ratios and 95% confidence intervals for adjusted models for death at 10 years. The logistic regression models controlled for sex, age, severe poverty (living on <$1 USD per day), Port-au-Prince residence and baseline clinical characteristics of weight, CD4, WHO stage and tuberculosis diagnosis.

Results

Age, severe poverty, baseline weight and WHO stage were statistically significant predictors of AIDS related mortality across all models. Gender was only statistically significant in the MICE model but had at least a 10% difference in odds ratios across all models.

Conclusion

Each of these methods had different assumptions and differed in the number of observations included due to how missing values were addressed. We found MICE to be most robust in predicting survival status as it allowed us to impute missing data so that we had the maximum number of observations to perform regression analyses. MICE also provides a complementary alternative for estimating survival among patients with unassigned vital status. Additionally, the results were easier to interpret, less likely to be biased and provided an alternative to a problem that is often commented upon in the extant literature.

Available only for authorised users

Forster M, Bailey C, Brinkhof MWG, Graber C, Boulle A, Spohr M, et al. Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ. 2008;86:939–47. https://doi.org/10.2471/BLT.07.049908.CrossRefPubMedPubMedCentral

Lambdin BH, Micek MA, Koepsell TD, Hughes JP, Sherr K, Pfeiffer J, et al. An assessment of the accuracy and availability of data in electronic patient tracking systems for patients receiving HIV treatment in Central Mozambique. BMC Health Serv Res. 2012;12:30. https://doi.org/10.1186/1472-6963-12-30.CrossRefPubMedPubMedCentral

McNairy ML, Joseph P, Unterbrink M, Galbaud S, Mathon J-E, Rivera V, et al. Outcomes after antiretroviral therapy during the expansion of HIV services in Haiti. PLoS One. 2017;12:e0175521. https://doi.org/10.1371/journal.pone.0175521.CrossRefPubMedPubMedCentral

Wolff MJ, Giganti MJ, Cortes CP, Cahn P, Grinsztejn B, Pape JW, et al. A decade of HAART in Latin America: long term outcomes among the first wave of HIV patients to receive combination therapy. PLoS One. 2017;12:e0179769. https://doi.org/10.1371/journal.pone.0179769.CrossRefPubMedPubMedCentral

Carriquiry G, Fink V, Koethe JR, Giganti MJ, Jayathilake K, Blevins M, et al. Mortality and loss to follow-up among HIV-infected persons on long-term antiretroviral therapy in Latin America and the Caribbean. J Int AIDS Soc. 2015;18:20016 http://www.ncbi.nlm.nih.gov/pubmed/26165322. Accessed 14 Aug 2018.CrossRef

Farahani M, Vable A, Lebelonyane R, Seipone K, Anderson M, Avalos A, et al. Outcomes of the Botswana national HIV/AIDS treatment programme from 2002 to 2010: a longitudinal analysis. Lancet Glob Heal. 2014;2:e44–50. https://doi.org/10.1016/S2214-109X(13)70149-9.CrossRef

Kaplan SR, Oosthuizen C, Stinson K, Little F, Euvrard J, Schomaker M, et al. Contemporary disengagement from antiretroviral therapy in Khayelitsha South Africa: A cohort study. PLOS Med. 2017;14:e1002407. https://doi.org/10.1371/journal.pmed.1002407.CrossRefPubMedPubMedCentral

Mberi MN, Kuonza LR, Dube NM, Nattey C, Manda S, Summers R. Determinants of loss to follow-up in patients on antiretroviral treatment, South Africa, 2004–2012: a cohort study. BMC Health Serv Res. 2015;15:259. https://doi.org/10.1186/s12913-015-0912-2.CrossRefPubMedPubMedCentral

Sowah LA, Turenne FV, Buchwald UK, Delva G, Mesidor RN, Dessaigne CG, et al. Influence of transportation cost on long-term retention in clinic for HIV patients in rural Haiti. JAIDS J Acquir Immune Defic Syndr. 2014;67:e123–30. https://doi.org/10.1097/QAI.0000000000000315.CrossRefPubMed

10.

Puttkammer NH, Zeliadt SB, Baseman JG, Destiné R, Wysler Domerçant J, Labbé Coq NR, et al. Patient attrition from the HIV antiretroviral therapy program at two hospitals in Haiti. Rev Panam Salud Publica. 2014;36:238–47 http://www.ncbi.nlm.nih.gov/pubmed/25563149. Accessed 23 Apr 2015.PubMedPubMedCentral

11.

Gloyd S, Wagenaar BH, Woelk GB, Kalibala S. Opportunities and challenges in conducting secondary analysis of HIV programmes using data from routine health information systems and personal health information. J Int AIDS Soc. 2016;19(5 4). https://doi.org/10.7448/IAS.19.5.20847.

12.

Maskew M, MacPhail P, Menezes C, Rubel D. Lost to follow up: contributing factors and challenges in south African patients on antiretroviral therapy. S Afr Med J. 2007;97:853–7 http://www.ncbi.nlm.nih.gov/pubmed/17985056. Accessed 23 Apr 2015.PubMed

13.

Tweya H, Feldacker C, Estill J, Jahn A, Ng’ambi W, Ben-Smith A, et al. Are they really lost? “True” status and reasons for treatment discontinuation among HIV infected patients on antiretroviral therapy considered lost to follow up in urban Malawi. PLoS One. 2013;8:e75761. https://doi.org/10.1371/journal.pone.0075761.CrossRefPubMedPubMedCentral

14.

Geng EH, Glidden D V, Bangsberg DR, Bwana MB, Musinguzi N, Nash D, et al. A causal framework for understanding the effect of losses to follow-up on epidemiologic analyses in clinic-based cohorts: the case of HIV-infected patients on antiretroviral therapy in Africa. Am J Epidemiol 2012;175:1080–1087. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3353135&tool=pmcentrez&rendertype=abstract. Accessed 11 June 2015.CrossRef

15.

Karahalios A, Baglietto L, Carlin JB, English DR, Simpson JA. A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med Res Methodol. 2012;12:96. https://doi.org/10.1186/1471-2288-12-96.CrossRefPubMedPubMedCentral

16.

Kenward MG, Molenberghs G. Parametric models for incomplete continuous and categorical longitudinal data. Stat Methods Med Res 1999;8:51–83. http://www.ncbi.nlm.nih.gov/pubmed/10347860. Accessed 9 Oct 2015.CrossRef

17.

Kurth T, Walker AM, Glynn RJ, Chan KA, Gaziano JM, Berger K, et al. Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect. Am J Epidemiol. 2006;163:262–70. https://doi.org/10.1093/aje/kwj047.CrossRefPubMed

18.

Lippman SA, Shade SB, Hubbard AE. Inverse probability weighting in STI/HIV prevention research: methods for evaluating social and community interventions. Sex Transm Dis. 2010;37:1. https://doi.org/10.1097/OLQ.0b013e3181d73feb.CrossRef

19.

Buchanan AL, Hudgens MG, Cole SR, Lau B, Adimora AA. Worth the weight: using inverse probability weighted cox models in AIDS research. AIDS Res Hum Retrovir. 2014;30:1170–7. https://doi.org/10.1089/aid.2014.0037.CrossRefPubMed

20.

Van Cutsem G, Ford N, Hildebrand K, Goemaere E, Mathee S, Abrahams M, et al. Correcting for mortality among patients lost to follow up on antiretroviral therapy in South Africa: a cohort analysis. PLoS One. 2011;6:e14684. https://doi.org/10.1371/journal.pone.0014684.CrossRefPubMedPubMedCentral

21.

Henriques J, Pujades-Rodriguez M, McGuire M, Szumilin E, Iwaz J, Etard J-F, et al. Comparison of methods to correct survival estimates and survival regression analysis on a large HIV African cohort. PLoS One. 2012;7:e31706. https://doi.org/10.1371/journal.pone.0031706.CrossRefPubMedPubMedCentral

22.

Geng EH, Glidden DV, Bangsberg DR, Bwana MB, Musinguzi N, Nash D, et al. A causal framework for understanding the effect of losses to follow-up on epidemiologic analyses in clinic-based cohorts: the case of HIV-infected patients on antiretroviral therapy in Africa. Am J Epidemiol. 2012;175:1080–7. https://doi.org/10.1093/aje/kwr444.CrossRefPubMedPubMedCentral

23.

Goel MK, Khanna P, Kishore J. Understanding survival analysis: Kaplan-Meier estimate. Int J Ayurveda Res. 2010;1:274–8. https://doi.org/10.4103/0974-7788.76794.CrossRefPubMedPubMedCentral

24.

Brinkhof MWG, Pujades-Rodriguez M, Egger M. Mortality of patients lost to follow-up in antiretroviral treatment Programmes in resource-limited settings: systematic review and meta-analysis. PLoS One. 2009;4:e5790. https://doi.org/10.1371/journal.pone.0005790.CrossRefPubMedPubMedCentral

25.

Geng EH, Odeny TA, Lyamuya RE, Nakiwogga-Muwanga A, Diero L, Bwana M, et al. Estimation of mortality among HIV-infected people on antiretroviral treatment in East Africa: a sampling based approach in an observational, multisite, cohort study. Lancet HIV. 2015;2:e107–16. https://doi.org/10.1016/S2352-3018(15)00002-8.CrossRefPubMedPubMedCentral

26.

Plutzer K, Mejia GC, Spencer AJ, Keirse MJNC. Dealing with missing outcomes: lessons from a randomized trial of a prenatal intervention to prevent early childhood caries. Open Dent J. 2010;4:55–60. https://doi.org/10.2174/1874210601004020055.CrossRefPubMedPubMedCentral

27.

Tanski SE, McClure AC, Li Z, Jackson K, Morgenstern M, Li Z, et al. Cued recall of alcohol advertising on television and underage drinking behavior. JAMA Pediatr. 2015;169:264. https://doi.org/10.1001/jamapediatrics.2014.3345.CrossRefPubMedPubMedCentral

28.

Knol MJ, Janssen KJM, Donders ART, Egberts ACG, Heerdink ER, Grobbee DE, et al. Unpredictable bias when using the missing indicator method or complete case analysis for missing confounder values: an empirical example. J Clin Epidemiol. 2010;63:728–36. https://doi.org/10.1016/j.jclinepi.2009.08.028.CrossRefPubMed

29.

White IR, Carlin JB. Bias and efficiency of multiple imputation compared with complete-case analysis for missing covariate values. Stat Med. 2010;29:2920–31. https://doi.org/10.1002/sim.3944.CrossRefPubMed

30.

White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30:377–99. https://doi.org/10.1002/sim.4067.CrossRefPubMed

31.

Hedden SL, Woolson RF, Carter RE, Palesch Y, Upadhyaya HP, Malcolm RJ. The impact of loss to follow-up on hypothesis tests of the treatment effect for several statistical methods in substance abuse clinical trials. J Subst Abus Treat. 2009;37:54–63. https://doi.org/10.1016/j.jsat.2008.09.011.CrossRef

32.

Leger P, Charles M, Severe P, Riviere C, Pape JW, Fitzgerald DW. 5-year survival of patients with AIDS receiving antiretroviral therapy in Haiti. N Engl J Med. 2009;361:828–9. https://doi.org/10.1056/NEJMc0809485.CrossRef

33.

Severe P, Leger P, Charles M, Noel F, Bonhomme G, Bois G, et al. Antiretroviral therapy in a thousand patients with AIDS in Haiti. N Engl J Med. 2005;353:2325–34. https://doi.org/10.1056/NEJMoa051908.CrossRef

34.

Rodwell L, Lee KJ, Romaniuk H, Carlin JB. Comparison of methods for imputing limited-range variables: a simulation study. BMC Med Res Methodol. 2014;14:57. https://doi.org/10.1186/1471-2288-14-57.

35.

Allison P. Imputation by Predictive Mean Matching: Promise & Peril | Statistical Horizons. March 5. 2015. https://statisticalhorizons.com/predictive-mean-matching. Accessed 13 Jan 2018.

36.

Vink G, Frank LE, Pannekoek J, van Buuren S. Predictive mean matching imputation of semicontinuous variables. Stat Neerl. 2014;68:61–90. https://doi.org/10.1111/stan.12023.CrossRef

37.

Morris TP, White IR, Royston P. Tuning multiple imputation by predictive mean matching and local residual draws. BMC Med Res Methodol. 2014;14:75. https://doi.org/10.1186/1471-2288-14-75.

38.

Eddings W, Marchenko Y, Eddings W, Marchenko Y. Diagnostics for multiple imputation in Stata. Stata J 2012;12:353–367. http://econpapers.repec.org/article/tsjstataj/v_3a12_3ay_3a2012_3ai_3a3_3ap_3a353-367.htm. Accessed 8 Sept 2017.

39.

Recursive Partitioning and Regression Trees [R package rpart version 4.1–11]. https://cran.r-project.org/web/packages/rpart/index.html. Accessed 15 Nov 2017.

40.

Harrell FE, E. F. Regression modeling strategies : with applications to linear models, logistic regression, and survival analysis. Springer; 2001. http://dl.acm.org/citation.cfm?id=1196963. Accessed 22 Sept 2017.

41.

Hastie, Trevor, Tibshirani, Robert, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. Stanford: Springer; 2016.

42.

Rubin DB. Multiple imputation for nonresponse in surveys: Wiley-Interscience; 2004.

43.

Hippel PT von. Regression with Missing Ys: An Improved Strategy for Analyzing Multiply Imputed Data. Sociological Methodology. 37:83–117. https://doi.org/10.2307/20451132.

44.

Pierre S, Jannat-Khah D, Fitzgerald DW, Pape J, McNairy ML. 10-year survival of patients with AIDS receiving antiretroviral therapy in Haiti. N Engl J Med. 2016;374:397–8. https://doi.org/10.1056/NEJMc1508934.CrossRef

45.

Noel E, Esperance M, McLaughlin M, Bertrand R, Devieux J, Severe P, et al. Attrition from HIV testing to antiretroviral therapy initiation among patients newly diagnosed with HIV in Haiti. J Acquir Immune Defic Syndr. 2013;62:e61–9. https://doi.org/10.1097/QAI.0b013e318281e772.CrossRef

46.

Pierre S, Jannat-Khah D, Fitzgerald DW, Pape J, McNairy ML. No Title. 2016;374. https://doi.org/10.1056/NEJMc1508934.CrossRef

47.

Coria A, Noel F, Bonhomme J, Rouzier V, Perodin C, Marcelin A, et al. Consideration of Postpartum Management in HIV-Positive Haitian Women. JAIDS J Acquir Immune Defic Syndr. 2012;61:636–43. https://doi.org/10.1097/QAI.0b013e31826abdd1.CrossRef

48.

Hennessey KA, Leger TD, Rivera VR, Marcelin A, McNairy ML, Guiteau C, et al. Retention in care among patients with early HIV disease in Haiti. J Int Assoc Provid AIDS Care. 2017;16:523–6. https://doi.org/10.1177/2325957417742670.CrossRefPubMed

49.

Falcaro M, Nur U, Rachet B, Carpenter JR. Estimating excess Hazard ratios and net survival when covariate data are missing. Epidemiology. 2015;26:421–8. https://doi.org/10.1097/EDE.0000000000000283.CrossRefPubMed

50.

Wubshet M, Berhane Y, Worku A, Kebede Y. Death and seeking alternative therapy largely accounted for lost to follow-up of patients on ART in Northwest Ethiopia: a community tracking survey. PLoS One. 2013;8:e59197. https://doi.org/10.1371/journal.pone.0059197.CrossRefPubMedPubMedCentral

51.

Caluwaerts C, Maendaenda R, Maldonado F, Biot M, Ford N, Chu K. Risk factors and true outcomes for lost to follow-up individuals in an antiretroviral treatment programme in Tete Mozambique. Int Health. 2009;1:97–101. https://doi.org/10.1016/j.inhe.2009.03.002.CrossRefPubMed

52.

Reidy W, Agarwal M, Lamb M, Hawken M, Chege D, Elul B, et al. Loss to follow-up: determining outcomes for adults enrolled in HIV Services in Kenya. 2014. http://files.icap.columbia.edu/files/uploads/CROI_ICAP_Poster_Loss_to_Followup_Reidy_final.pdf.

53.

Schomaker M, Gsponer T, Estill J, Fox M, Boulle A. Non-ignorable loss to follow-up: correcting mortality estimates based on additional outcome ascertainment. Stat Med. 2014;33:129–42. https://doi.org/10.1002/sim.5912.CrossRefPubMed

54.

Geng EH, Odeny TA, Lyamuya RE, Nakiwogga-Muwanga A, Diero L, Bwana M, et al. Estimation of mortality among HIV-infected people on antiretroviral treatment in East Africa: a sampling based approach in an observational, multisite, cohort study. Lancet HIV 2015;2:e107–e116. http://www.thelancet.com/article/S2352301815000028/fulltext. Accessed 2 June 2015.CrossRef

55.

Geng EH, Glidden DV, Bwana MB, Musinguzi N, Emenyonu N, Muyindike W, et al. Retention in care and connection to care among HIV-infected patients on antiretroviral therapy in Africa: estimation via a sampling-based approach. PLoS One. 2011;6:2004.

56.

Witkiewitz K, Falk DE, Kranzler HR, Litten RZ, Hallgren KA, O’Malley SS, et al. Methods to analyze treatment effects in the presence of missing data for a continuous heavy drinking outcome measure when participants drop out from treatment in alcohol clinical trials. Alcohol Clin Exp Res. 2014;38:2826–34. https://doi.org/10.1111/acer.12543.CrossRefPubMedPubMedCentral

57.

Lawn SD, Campbell L, Kaplan R, Boulle A, Cornell M, Kerschberger B, et al. Time to initiation of antiretroviral therapy among patients with HIV-associated tuberculosis in Cape Town, South Africa. JAIDS J Acquir Immune Defic Syndr. 2011;57:136–40. https://doi.org/10.1097/QAI.0b013e3182199ee9.CrossRefPubMed

58.

White IR, Royston P. Imputing missing covariate values for the cox model. Stat Med. 2009;28:1982–98. https://doi.org/10.1002/sim.3618.CrossRefPubMedPubMedCentral

59.

Biering K, Hjollund NH, Frydenberg M. Using multiple imputation to deal with missing data and attrition in longitudinal studies with repeated measures of patient-reported outcomes. Clin Epidemiol. 2015;7:91–106. https://doi.org/10.2147/CLEP.S72247.CrossRefPubMedPubMedCentral

60.

McCaul KA, Almeida OP, Norman PE, Yeap BB, Hankey GJ, Golledge J, et al. How Many Older People Are Frail? Using Multiple Imputation to Investigate Frailty in the Population. J Am Med Dir Assoc. 2015;16:439.e1–7. https://doi.org/10.1016/j.jamda.2015.02.003.CrossRef

61.

Mackinnon A. The use and reporting of multiple imputation in medical research - a review. J Intern Med. 2010;268:586–93. https://doi.org/10.1111/j.1365-2796.2010.02274.x.CrossRefPubMed

62.

Fatti G, Meintjes G, Shea J, Eley B, Grimwood A. Improved survival and antiretroviral treatment outcomes in adults receiving community-based adherence support: 5-year results from a multicentre cohort study in South Africa. J Acquir Immune Defic Syndr. 2012;61:e50–8. https://doi.org/10.1097/QAI.0b013e31826a6aee.CrossRefPubMed

Title: Treating loss-to-follow-up as a missing data problem: a case study using a longitudinal cohort of HIV-infected patients in Haiti
Authors: Deanna P. Jannat-Khah
Michelle Unterbrink
Margaret McNairy
Samuel Pierre
Dan W. Fitzgerald
Jean Pape
Arthur Evans
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: BMC Public Health / Issue 1/2018
Electronic ISSN: 1471-2458
DOI: https://doi.org/10.1186/s12889-018-6115-0

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Treating loss-to-follow-up as a missing data problem: a case study using a longitudinal cohort of HIV-infected patients in Haiti

Abstract

Background

Methods

Results

Conclusion

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2018

Epidemiology of Humanpapilloma virus infection among women in Fujian, China

Know where to go: evidence from a controlled trial of a healthcare system information intervention among immigrants

The association of the Bolsa Familia Program with children’s oral health in Brazil

Economic evaluation of telephone-based weight loss support for patients with knee osteoarthritis: a randomised controlled trial

The association between self-rated health and social environments, health behaviors and health outcomes: a structural equation analysis

Economic evaluation of a dietary intervention for adults with major depression (the “SMILES” trial)