Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

An application of propensity score weighting to quantify the causal effect of rectal sexually transmitted infections on incident HIV among men who have sex with men

Authors: Adam S Vaughan, Colleen F Kelley, Nicole Luisi, Carlos del Rio, Patrick S Sullivan, Eli S Rosenberg

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

Exploring causal associations in HIV research requires careful consideration of numerous epidemiologic limitations. First, a primary cause of HIV, unprotected anal intercourse (UAI), is time-varying and, if it is also associated with an exposure of interest, may be on a confounding path. Second, HIV is a rare outcome, even in high-risk populations. Finally, for most causal, non-preventive exposures, a randomized trial is impossible. In order to address these limitations and provide a practical illustration of efficient statistical control via propensity-score weighting, we examine the causal association between rectal STI and HIV acquisition in the InvolveMENt study, a cohort of Atlanta-area men who have sex with men (MSM). We hypothesized that, after controlling for potentially confounding behavioral and demographic factors, the significant STI-HIV association would attenuate, but yield an estimate of the causal effect.

Methods

The exposure of interest was incident rectal gonorrhea or chlamydia infection; the outcome was incident HIV infection. To adjust for behavioral confounding, while accounting for limited HIV infections, we used an inverse probability of treatment weighted (IPTW) Cox proportional hazards (PH) model for incident HIV. Weights were derived from propensity score modeling of the probability of incident rectal STI as a function of potential confounders, including UAI in the interval of rectal STI acquisition/censoring.

Results

Of 556 HIV-negative MSM at baseline, 552 (99%) men were included in this analysis. 79 men were diagnosed with an incident rectal STI and 26 with HIV. 6 HIV-infected men were previously diagnosed with a rectal STI. In unadjusted analysis, incident rectal STI was significantly associated with subsequent incident HIV (HR (95%CI): 3.6 (1.4-9.2)). In the final weighted and adjusted model, the association was attenuated and more precise (HR (95% CI): 2.7 (1.2-6.4)).

Conclusions

We found that, controlling for time-varying risk behaviors and time-invariant demographic factors, diagnosis with HIV was significantly associated with prior diagnosis of rectal CT or GC. Our analysis lends support to the causal effect of incident rectal STI on HIV diagnosis and provides a framework for similar analyses of HIV incidence.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mayer KH, Venkatesh KK. Interactions of HIV, other sexually transmitted diseases, and genital tract inflammation facilitating local pathogen transmission and acquisition. Am J Reprod Immunol. 2011;65:308–16.CrossRefPubMedPubMedCentral Mayer KH, Venkatesh KK. Interactions of HIV, other sexually transmitted diseases, and genital tract inflammation facilitating local pathogen transmission and acquisition. Am J Reprod Immunol. 2011;65:308–16.CrossRefPubMedPubMedCentral
2.
go back to reference Howards PP, Schisterman EF, Poole C, Kaufman JS, Weinberg CR. “Toward a clearer definition of confounding” revisited with directed acyclic graphs. Am J Epidemiol. 2012;176:506–11.CrossRefPubMedPubMedCentral Howards PP, Schisterman EF, Poole C, Kaufman JS, Weinberg CR. “Toward a clearer definition of confounding” revisited with directed acyclic graphs. Am J Epidemiol. 2012;176:506–11.CrossRefPubMedPubMedCentral
3.
go back to reference Solomon MM, Mayer KH, Glidden DV, Liu AY, McMahan VM, Guanira JV, et al. Syphilis Predicts HIV Incidence Among Men and Transgender Women Who Have Sex With Men in a Preexposure Prophylaxis Trial. Clin Infect Dis. 2014;59:1020–6.CrossRefPubMedPubMedCentral Solomon MM, Mayer KH, Glidden DV, Liu AY, McMahan VM, Guanira JV, et al. Syphilis Predicts HIV Incidence Among Men and Transgender Women Who Have Sex With Men in a Preexposure Prophylaxis Trial. Clin Infect Dis. 2014;59:1020–6.CrossRefPubMedPubMedCentral
4.
go back to reference Bernstein KT, Marcus JL, Nieri G, Philip SS, Klausner JD. Rectal gonorrhea and chlamydia reinfection is associated with increased risk of HIV seroconversion. J Acquir Immune Defic Syndr. 2010;53:537–43.CrossRefPubMed Bernstein KT, Marcus JL, Nieri G, Philip SS, Klausner JD. Rectal gonorrhea and chlamydia reinfection is associated with increased risk of HIV seroconversion. J Acquir Immune Defic Syndr. 2010;53:537–43.CrossRefPubMed
5.
go back to reference Buchbinder SP, Glidden DV, Liu AY, McMahan V, Guanira JV, Mayer KH, et al. HIV pre-exposure prophylaxis in men who have sex with men and transgender women: a secondary analysis of a phase 3 randomised controlled efficacy trial. Lancet Infect Dis. 2014;14:468–75.CrossRefPubMedPubMedCentral Buchbinder SP, Glidden DV, Liu AY, McMahan V, Guanira JV, Mayer KH, et al. HIV pre-exposure prophylaxis in men who have sex with men and transgender women: a secondary analysis of a phase 3 randomised controlled efficacy trial. Lancet Infect Dis. 2014;14:468–75.CrossRefPubMedPubMedCentral
6.
go back to reference Jin F, Prestage GP, Imrie J, Kippax SC, Donovan B, Templeton DJ, et al. Anal sexually transmitted infections and risk of HIV infection in homosexual men. J Acquir Immune Defic Syndr. 2010;53:144–9.CrossRefPubMed Jin F, Prestage GP, Imrie J, Kippax SC, Donovan B, Templeton DJ, et al. Anal sexually transmitted infections and risk of HIV infection in homosexual men. J Acquir Immune Defic Syndr. 2010;53:144–9.CrossRefPubMed
7.
go back to reference Pathela P, Braunstein SL, Blank S, Schillinger JA. HIV Incidence Among Men With and Those Without Sexually Transmitted Rectal Infections: Estimates From Matching Against an HIV Case Registry. Clin Infect Dis. 2013;57:1203–9.CrossRefPubMed Pathela P, Braunstein SL, Blank S, Schillinger JA. HIV Incidence Among Men With and Those Without Sexually Transmitted Rectal Infections: Estimates From Matching Against an HIV Case Registry. Clin Infect Dis. 2013;57:1203–9.CrossRefPubMed
8.
go back to reference Austin PC. An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies. Multivar Behav Res. 2011;46:399–424.CrossRef Austin PC. An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies. Multivar Behav Res. 2011;46:399–424.CrossRef
9.
go back to reference Røttingen J-A, Cameron DW, Garnett GP. A Systematic Review of the Epidemiologic Interactions between Classic Sexually Transmitted Diseases: HIV How Much Really Is Known ? Sex Transm Dis. 2001;28:579–97.CrossRefPubMed Røttingen J-A, Cameron DW, Garnett GP. A Systematic Review of the Epidemiologic Interactions between Classic Sexually Transmitted Diseases: HIV How Much Really Is Known ? Sex Transm Dis. 2001;28:579–97.CrossRefPubMed
10.
go back to reference Sexton J, Garnett G, Røttingen J-A. Metaanalysis and Metaregression in Interpreting Study Variability in the Impact of Sexually Transmitted Diseases on Susceptibility to HIV Infection. Sex Transm Dis. 2005;32:351–7.CrossRefPubMed Sexton J, Garnett G, Røttingen J-A. Metaanalysis and Metaregression in Interpreting Study Variability in the Impact of Sexually Transmitted Diseases on Susceptibility to HIV Infection. Sex Transm Dis. 2005;32:351–7.CrossRefPubMed
11.
go back to reference Payn B, Tanfer K, Billy JOG, Grady WR. Men’s Behavior Change Following Infection With a Sexually Transmitted Disease. Fam Plann Perspect. 1997;29:152–7.CrossRefPubMed Payn B, Tanfer K, Billy JOG, Grady WR. Men’s Behavior Change Following Infection With a Sexually Transmitted Disease. Fam Plann Perspect. 1997;29:152–7.CrossRefPubMed
12.
go back to reference Fox J, White PJ, Macdonald N, Weber J, McClure M, Fidler S, et al. Reductions in HIV transmission risk behaviour following diagnosis of primary HIV infection: a cohort of high-risk men who have sex with men. HIV Med. 2009;10:432–8.CrossRefPubMed Fox J, White PJ, Macdonald N, Weber J, McClure M, Fidler S, et al. Reductions in HIV transmission risk behaviour following diagnosis of primary HIV infection: a cohort of high-risk men who have sex with men. HIV Med. 2009;10:432–8.CrossRefPubMed
13.
go back to reference Fortenberry JD. Post-treatment sexual and prevention behaviours of adolescents with sexually transmitted infections. Sex Transm Infect. 2002;78:365–8.CrossRefPubMedPubMedCentral Fortenberry JD. Post-treatment sexual and prevention behaviours of adolescents with sexually transmitted infections. Sex Transm Infect. 2002;78:365–8.CrossRefPubMedPubMedCentral
14.
go back to reference Kelley CF, Vaughan AS, Luisi N, Sanchez TH, Del Rio C, Sullivan PS, et al. The effect of high rates of bacterial sexually transmitted infections on HIV incidence in a cohort of Black and White men who have sex with men in Atlanta, GA. AIDS Res Hum Retroviruses. 2015: epub ahead of print. Kelley CF, Vaughan AS, Luisi N, Sanchez TH, Del Rio C, Sullivan PS, et al. The effect of high rates of bacterial sexually transmitted infections on HIV incidence in a cohort of Black and White men who have sex with men in Atlanta, GA. AIDS Res Hum Retroviruses. 2015: epub ahead of print.
15.
go back to reference Sullivan PS, Peterson J, Rosenberg ES, Kelley CF, Cooper H, Vaughan AS, et al. Understanding Racial HIV/STI Disparities in Black and White Men Who Have Sex with Men: A Multilevel Approach. PLoS One. 2014;9:e90514.CrossRefPubMedPubMedCentral Sullivan PS, Peterson J, Rosenberg ES, Kelley CF, Cooper H, Vaughan AS, et al. Understanding Racial HIV/STI Disparities in Black and White Men Who Have Sex with Men: A Multilevel Approach. PLoS One. 2014;9:e90514.CrossRefPubMedPubMedCentral
17.
go back to reference Van Der Pol B, Ferrero DV, Buck-Barrington L, Hook III E, Lenderman C, Quinn T, et al. Multicenter Evaluation of the BDProbeTec ET System for Detection of Chlamydia trachomatis and Neisseria gonorrhoeae in Urine Specimens, Female Endocervical Swabs, and Male Urethral Swabs. J Clin Microbiol. 2001;39:1008–16.CrossRef Van Der Pol B, Ferrero DV, Buck-Barrington L, Hook III E, Lenderman C, Quinn T, et al. Multicenter Evaluation of the BDProbeTec ET System for Detection of Chlamydia trachomatis and Neisseria gonorrhoeae in Urine Specimens, Female Endocervical Swabs, and Male Urethral Swabs. J Clin Microbiol. 2001;39:1008–16.CrossRef
18.
go back to reference Rosenberg ES, Sullivan PS, Kelley CF, Sanchez TH, Luisi N, del Rio C, et al. Race and Age Disparities in HIV Incidence and Prevalence Among MSM in Atlanta, GA. In: Conf Retroviruses Opportunistic Infect. Boston, MA. 2014. p. 108. Rosenberg ES, Sullivan PS, Kelley CF, Sanchez TH, Luisi N, del Rio C, et al. Race and Age Disparities in HIV Incidence and Prevalence Among MSM in Atlanta, GA. In: Conf Retroviruses Opportunistic Infect. Boston, MA. 2014. p. 108.
19.
go back to reference Robins JM, Hernán MÁ, Brumback B. Marginal Structural Models and Causal Inference in Epidemiology. Epidemiology. 2013;11:550–60.CrossRef Robins JM, Hernán MÁ, Brumback B. Marginal Structural Models and Causal Inference in Epidemiology. Epidemiology. 2013;11:550–60.CrossRef
20.
go back to reference Williamson EJ, Forbes A, White IR. Variance reduction in randomised trials by inverse probability weighting using the propensity score. Stat Med. 2014;33:721–37.CrossRefPubMed Williamson EJ, Forbes A, White IR. Variance reduction in randomised trials by inverse probability weighting using the propensity score. Stat Med. 2014;33:721–37.CrossRefPubMed
21.
go back to reference Austin PC. The performance of different propensity score methods for estimating marginal hazard ratios. Stat Med. 2013;32:2837–49.CrossRefPubMed Austin PC. The performance of different propensity score methods for estimating marginal hazard ratios. Stat Med. 2013;32:2837–49.CrossRefPubMed
22.
go back to reference Harder VS, Stuart EA, Anthony JC. Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychol Methods. 2010;15:234–49.CrossRefPubMedPubMedCentral Harder VS, Stuart EA, Anthony JC. Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychol Methods. 2010;15:234–49.CrossRefPubMedPubMedCentral
24.
go back to reference Ho DE, Imai K, King G, Stuart EA. Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference. Polit Anal. 2006;15:199–236.CrossRef Ho DE, Imai K, King G, Stuart EA. Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference. Polit Anal. 2006;15:199–236.CrossRef
25.
go back to reference Normand ST, Landrum MB, Guadagnoli E, Ayanian JZ, Ryan TJ, Cleary PD, et al. Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores. J Clin Epidemiol. 2001;54:387–98.CrossRefPubMed Normand ST, Landrum MB, Guadagnoli E, Ayanian JZ, Ryan TJ, Cleary PD, et al. Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores. J Clin Epidemiol. 2001;54:387–98.CrossRefPubMed
26.
go back to reference Imai K, King G, Stuart EA. Misunderstandings between experimentalists and observationalists about causal inference. J R Stat Soc Ser A. 2008;171:481–502.CrossRef Imai K, King G, Stuart EA. Misunderstandings between experimentalists and observationalists about causal inference. J R Stat Soc Ser A. 2008;171:481–502.CrossRef
27.
go back to reference Austin PC. The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Med Decis Making. 2009;29:661–77.CrossRefPubMed Austin PC. The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Med Decis Making. 2009;29:661–77.CrossRefPubMed
28.
go back to reference Kelley CF, Rosenberg ES, O’Hara BM, Frew PM, Sanchez TH, Peterson JL, et al. Measuring population transmission risk for HIV: an alternative metric of exposure risk in men who have sex with men (MSM) in the US. PLoS One. 2012;7:e53284.CrossRefPubMedPubMedCentral Kelley CF, Rosenberg ES, O’Hara BM, Frew PM, Sanchez TH, Peterson JL, et al. Measuring population transmission risk for HIV: an alternative metric of exposure risk in men who have sex with men (MSM) in the US. PLoS One. 2012;7:e53284.CrossRefPubMedPubMedCentral
29.
go back to reference Newcomb ME, Mustanski B. Racial differences in same-race partnering and the effects of sexual partnership characteristics on HIV Risk in MSM: a prospective sexual diary study. J Acquir Immune Defic Syndr. 2013;62:329–33.CrossRefPubMedPubMedCentral Newcomb ME, Mustanski B. Racial differences in same-race partnering and the effects of sexual partnership characteristics on HIV Risk in MSM: a prospective sexual diary study. J Acquir Immune Defic Syndr. 2013;62:329–33.CrossRefPubMedPubMedCentral
30.
go back to reference Millett GA, Peterson JL, Flores SA, Hart TA, Jeffries WL, Wilson PA, et al. Comparisons of disparities and risks of HIV infection in black and other men who have sex with men in Canada, UK, and USA: a meta-analysis. Lancet. 2012;380:341–8.CrossRefPubMed Millett GA, Peterson JL, Flores SA, Hart TA, Jeffries WL, Wilson PA, et al. Comparisons of disparities and risks of HIV infection in black and other men who have sex with men in Canada, UK, and USA: a meta-analysis. Lancet. 2012;380:341–8.CrossRefPubMed
31.
go back to reference Morgan SL, Todd JJ. A diagnostic routine for the detection of consequential heterogeneity of causal effects. Sociol Methodol. 2008;38:231–81. Morgan SL, Todd JJ. A diagnostic routine for the detection of consequential heterogeneity of causal effects. Sociol Methodol. 2008;38:231–81.
32.
go back to reference Flury BK, Riedwyl H. Standard distance in univariate and multivariate analysis. Am Stat. 1986;40:249–51. Flury BK, Riedwyl H. Standard distance in univariate and multivariate analysis. Am Stat. 1986;40:249–51.
33.
go back to reference Robins JM. Marginal structural models versus structural nested models as tools for causal inference. In: Halloran E, Berry D, editors. Stat Model Epidemiol Environ Clin trials. New York, NY: Springer; 1999. p. 95–134. Robins JM. Marginal structural models versus structural nested models as tools for causal inference. In: Halloran E, Berry D, editors. Stat Model Epidemiol Environ Clin trials. New York, NY: Springer; 1999. p. 95–134.
34.
go back to reference Kleinbaum DG, Klein M. Evaluating the proportional hazards assumption. In: Surviv Anal A, editor. Self-Learning Text. 3rd ed. New York: Springer; 2012. p. 161–200. Kleinbaum DG, Klein M. Evaluating the proportional hazards assumption. In: Surviv Anal A, editor. Self-Learning Text. 3rd ed. New York: Springer; 2012. p. 161–200.
35.
go back to reference Cole SR, Hernán MÁ. Adjusted survival curves with inverse probability weights. Comput Methods Programs Biomed. 2004;75:45–9.CrossRefPubMed Cole SR, Hernán MÁ. Adjusted survival curves with inverse probability weights. Comput Methods Programs Biomed. 2004;75:45–9.CrossRefPubMed
36.
go back to reference Lanehart RE, de Gil PR, Kim ES, Bellara AP, Kromrey JD, Lee RS. Propensity score analysis and assessment of propensity score approaches using SAS procedures. In: Proc SAS Glob Forum 2012 Conf. Volume 1. Cary, NC: SAS Institute Inc; 2012. p. 314. Lanehart RE, de Gil PR, Kim ES, Bellara AP, Kromrey JD, Lee RS. Propensity score analysis and assessment of propensity score approaches using SAS procedures. In: Proc SAS Glob Forum 2012 Conf. Volume 1. Cary, NC: SAS Institute Inc; 2012. p. 314.
37.
go back to reference Peduzzi P, Concato J, Feinstein A, Holford T. Importance of events per independent variable in proportional hazards regression analysis II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48:1503–10.CrossRefPubMed Peduzzi P, Concato J, Feinstein A, Holford T. Importance of events per independent variable in proportional hazards regression analysis II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48:1503–10.CrossRefPubMed
38.
go back to reference Jansen IAV, Geskus RB, Davidovich U, Jurriaans S, Coutinho RA, Prins M, et al. Ongoing HIV-1 transmission among men who have sex with men in Amsterdam: a 25-year prospective cohort study. AIDS. 2011;25:493–501.CrossRefPubMed Jansen IAV, Geskus RB, Davidovich U, Jurriaans S, Coutinho RA, Prins M, et al. Ongoing HIV-1 transmission among men who have sex with men in Amsterdam: a 25-year prospective cohort study. AIDS. 2011;25:493–501.CrossRefPubMed
39.
go back to reference Anderson C, Gallo MF, Hylton-Kong T, Steiner MJ, Hobbs MM, Macaluso M, et al. Randomized controlled trial on the effectiveness of counseling messages for avoiding unprotected sexual intercourse during sexually transmitted infection and reproductive tract infection treatment among female sexually transmitted infection clinic patient. Sex Transm Dis. 2013;40:105–10.CrossRefPubMed Anderson C, Gallo MF, Hylton-Kong T, Steiner MJ, Hobbs MM, Macaluso M, et al. Randomized controlled trial on the effectiveness of counseling messages for avoiding unprotected sexual intercourse during sexually transmitted infection and reproductive tract infection treatment among female sexually transmitted infection clinic patient. Sex Transm Dis. 2013;40:105–10.CrossRefPubMed
40.
go back to reference Mayer KH, Wang L, Koblin B, Mannheimer S, Magnus M, del Rio C, et al. Concomitant socioeconomic, behavioral, and biological factors associated with the disproportionate HIV infection burden among Black men who have sex with men in 6 U.S. cities. PLoS One. 2014;9:e87298.CrossRefPubMedPubMedCentral Mayer KH, Wang L, Koblin B, Mannheimer S, Magnus M, del Rio C, et al. Concomitant socioeconomic, behavioral, and biological factors associated with the disproportionate HIV infection burden among Black men who have sex with men in 6 U.S. cities. PLoS One. 2014;9:e87298.CrossRefPubMedPubMedCentral
41.
go back to reference Sanders EJ, Okuku HS, Smith AD, Mwangome M, Wahome E, Fegan G, et al. High HIV-1 incidence, correlates of HIV-1 acquisition, and high viral loads following seroconversion among MSM. AIDS. 2013;27:437–46.CrossRefPubMedPubMedCentral Sanders EJ, Okuku HS, Smith AD, Mwangome M, Wahome E, Fegan G, et al. High HIV-1 incidence, correlates of HIV-1 acquisition, and high viral loads following seroconversion among MSM. AIDS. 2013;27:437–46.CrossRefPubMedPubMedCentral
42.
go back to reference Sullivan PS, Carballo-Diéguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, et al. Successes and challenges of HIV prevention in men who have sex with men. Lancet. 2012;380:388–99.CrossRefPubMedPubMedCentral Sullivan PS, Carballo-Diéguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, et al. Successes and challenges of HIV prevention in men who have sex with men. Lancet. 2012;380:388–99.CrossRefPubMedPubMedCentral
Metadata
Title
An application of propensity score weighting to quantify the causal effect of rectal sexually transmitted infections on incident HIV among men who have sex with men
Authors
Adam S Vaughan
Colleen F Kelley
Nicole Luisi
Carlos del Rio
Patrick S Sullivan
Eli S Rosenberg
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-015-0017-y

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue