Skip to main content
Top
Published in: BMC Medicine 1/2018

Open Access 01-12-2018 | Research article

The cost-effectiveness of oral HIV pre-exposure prophylaxis and early antiretroviral therapy in the presence of drug resistance among men who have sex with men in San Francisco

Authors: Mingwang Shen, Yanni Xiao, Libin Rong, Lauren Ancel Meyers, Steven E. Bellan

Published in: BMC Medicine | Issue 1/2018

Login to get access

Abstract

Background

Poor adherence to either antiretroviral treatment (ART) or pre-exposure prophylaxis (PrEP) can promote drug resistance, though this risk is thought to be considerably higher for ART. In the population of men who have sex with men (MSM) in San Francisco, PrEP coverage reached 9.6% in 2014 and has continued to rise. Given the risk of drug resistance and high cost of second-line drugs, the costs and benefits of initiating ART earlier while expanding PrEP coverage remain unclear.

Methods

We develop an infection–age-structured mathematical model and fit this model to the annual incidence of AIDS cases and deaths directly, and to resistance and demographic data indirectly. We investigate the impact of six various intervention scenarios (low, medium, or high PrEP coverage, with or without earlier ART) over the next 20 years.

Results

Low (medium, high) PrEP coverage with earlier ART could prevent 22% (42%, 57%) of a projected 44,508 total new infections and 8% (26%, 41%) of a projected 18,426 new drug-resistant infections, and result in a gain of 43,649 (74,048, 103,270) QALYs over 20 years compared to the status quo, at a cost of $4745 ($78,811, $115,320) per QALY gained, respectively.

Conclusions

High PrEP coverage with earlier ART is expected to provide the greatest benefit but also entail the highest costs among the strategies considered. This strategy is cost-effective for the San Francisco MSM population, even considering the acquisition and transmission of ART-mediated drug resistance. However, without a substantial increase to San Francisco’s annual HIV budget, the most advisable strategy may be initiating ART earlier, while maintaining current strategies of PrEP enrollment.
Appendix
Available only for authorised users
Literature
2.
go back to reference Abdool Karim Q, Abdool Karim SS, Frohlich JA, et al. Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science. 2010;329:1168–74.CrossRefPubMedPubMedCentral Abdool Karim Q, Abdool Karim SS, Frohlich JA, et al. Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science. 2010;329:1168–74.CrossRefPubMedPubMedCentral
3.
4.
go back to reference Molina JM, Capitant C, Spire B, et al. On-demand preexposure prophylaxis in men at high risk for HIV-1 infection. N Engl J Med. 2015;373:2237–46.CrossRefPubMed Molina JM, Capitant C, Spire B, et al. On-demand preexposure prophylaxis in men at high risk for HIV-1 infection. N Engl J Med. 2015;373:2237–46.CrossRefPubMed
5.
go back to reference Grant RM, Anderson PL, McMahan V, et al. Uptake of pre-exposure prophylaxis, sexual practices, and HIV incidence in men and transgender women who have sex with men: a cohort study. Lancet Infect Dis. 2014;14:820–9.CrossRefPubMed Grant RM, Anderson PL, McMahan V, et al. Uptake of pre-exposure prophylaxis, sexual practices, and HIV incidence in men and transgender women who have sex with men: a cohort study. Lancet Infect Dis. 2014;14:820–9.CrossRefPubMed
6.
go back to reference McCormack S, Dunn DT, Desai M, et al. Pre-exposure prophylaxis to prevent the acquisition of HIV-1 infection (PROUD): effectiveness results from the pilot phase of a pragmatic open-label randomised trial. Lancet. 2016;387:53–60.CrossRefPubMedPubMedCentral McCormack S, Dunn DT, Desai M, et al. Pre-exposure prophylaxis to prevent the acquisition of HIV-1 infection (PROUD): effectiveness results from the pilot phase of a pragmatic open-label randomised trial. Lancet. 2016;387:53–60.CrossRefPubMedPubMedCentral
8.
go back to reference Chen YH, Snowden JM, McFarland W, Raymond HF. Pre-exposure prophylaxis (PrEP) use, seroadaptation, and sexual behavior among men who have sex with men, San Francisco, 2004-2014. AIDS Behav. 2016;20:2791–7. Chen YH, Snowden JM, McFarland W, Raymond HF. Pre-exposure prophylaxis (PrEP) use, seroadaptation, and sexual behavior among men who have sex with men, San Francisco, 2004-2014. AIDS Behav. 2016;20:2791–7.
11.
go back to reference Grey JA, Bernstein KT, Sullivan PS, et al. Estimating the population sizes of men who have sex with men in US states and counties using data from the American community survey. JMIR Public Health Surveill. 2016;2:e14.CrossRefPubMedPubMedCentral Grey JA, Bernstein KT, Sullivan PS, et al. Estimating the population sizes of men who have sex with men in US states and counties using data from the American community survey. JMIR Public Health Surveill. 2016;2:e14.CrossRefPubMedPubMedCentral
14.
go back to reference Supervie V, García-Lerma JG, Heneine W, Blower S. HIV, transmitted drug resistance, and the paradox of preexposure prophylaxis. Proc Natl Acad Sci U S A. 2010;107:12381–6.CrossRefPubMedPubMedCentral Supervie V, García-Lerma JG, Heneine W, Blower S. HIV, transmitted drug resistance, and the paradox of preexposure prophylaxis. Proc Natl Acad Sci U S A. 2010;107:12381–6.CrossRefPubMedPubMedCentral
15.
go back to reference Supervie V, Barrett M, Kahn JS, et al. Modeling dynamic interactions between pre-exposure prophylaxis interventions & treatment programs: predicting HIV transmission & resistance. Sci Rep. 2011;1:185.CrossRefPubMedPubMedCentral Supervie V, Barrett M, Kahn JS, et al. Modeling dynamic interactions between pre-exposure prophylaxis interventions & treatment programs: predicting HIV transmission & resistance. Sci Rep. 2011;1:185.CrossRefPubMedPubMedCentral
16.
go back to reference Abbas UL, Anderson RM, Mellors JW. Potential impact of antiretroviral chemoprophylaxis on HIV-1 transmission in resource-limited settings. PLoS One. 2007;2:e875.CrossRefPubMedPubMedCentral Abbas UL, Anderson RM, Mellors JW. Potential impact of antiretroviral chemoprophylaxis on HIV-1 transmission in resource-limited settings. PLoS One. 2007;2:e875.CrossRefPubMedPubMedCentral
17.
go back to reference Shen MW, Xiao YN, Rong LB. Global stability of an infection-age structured HIV-1 model linking within-host and between-host dynamics. Math Biosci. 2015;263:37–50.CrossRefPubMed Shen MW, Xiao YN, Rong LB. Global stability of an infection-age structured HIV-1 model linking within-host and between-host dynamics. Math Biosci. 2015;263:37–50.CrossRefPubMed
18.
go back to reference Shen MW, Xiao YN, Rong LB, Meyers LA, Bellan SE. Early antiretroviral therapy and potent second-line drugs could decrease HIV incidence of drug resistance. P Roy Soc B-Biol Sci. 2017;284:20170525.CrossRef Shen MW, Xiao YN, Rong LB, Meyers LA, Bellan SE. Early antiretroviral therapy and potent second-line drugs could decrease HIV incidence of drug resistance. P Roy Soc B-Biol Sci. 2017;284:20170525.CrossRef
19.
go back to reference Adamson BJ, Bounthavong M, Kublin JG, Garrison L. Cost-effectiveness analysis of a partially effective HIV vaccine in San Francisco. Value Health. 2015;18:A237.CrossRef Adamson BJ, Bounthavong M, Kublin JG, Garrison L. Cost-effectiveness analysis of a partially effective HIV vaccine in San Francisco. Value Health. 2015;18:A237.CrossRef
20.
go back to reference Desai K, Sansom SL, Ackers ML, et al. Modeling the impact of HIV chemoprophylaxis strategies among men who have sex with men in the United States: HIV infections prevented and costeffectiveness. AIDS. 2008;22:1829–39.CrossRefPubMed Desai K, Sansom SL, Ackers ML, et al. Modeling the impact of HIV chemoprophylaxis strategies among men who have sex with men in the United States: HIV infections prevented and costeffectiveness. AIDS. 2008;22:1829–39.CrossRefPubMed
21.
go back to reference Paltiel AD, Freedberg KA, Scott CA, et al. HIV preexposure prophylaxis in the United States: impact on lifetime infection risk, clinical outcomes, and cost-effectiveness. Clin Infect Dis. 2009;48:806–15.CrossRefPubMedPubMedCentral Paltiel AD, Freedberg KA, Scott CA, et al. HIV preexposure prophylaxis in the United States: impact on lifetime infection risk, clinical outcomes, and cost-effectiveness. Clin Infect Dis. 2009;48:806–15.CrossRefPubMedPubMedCentral
22.
go back to reference Koppenhaver RT, Sorensen SW. The cost-effectiveness of pre-exposure prophylaxis in men who have sex with men in the United States: an epidemic model. J Acquir Immune Defic Syndr. 2011;58:e51–2.CrossRefPubMed Koppenhaver RT, Sorensen SW. The cost-effectiveness of pre-exposure prophylaxis in men who have sex with men in the United States: an epidemic model. J Acquir Immune Defic Syndr. 2011;58:e51–2.CrossRefPubMed
23.
go back to reference Juusola JL, Brandeau ML, Owens DK, Bendavid E. The cost-effectiveness of preexposure prophylaxis for HIV prevention in the United States in men who have sex with men. Ann Intern Med. 2012;156:541–50.CrossRefPubMedPubMedCentral Juusola JL, Brandeau ML, Owens DK, Bendavid E. The cost-effectiveness of preexposure prophylaxis for HIV prevention in the United States in men who have sex with men. Ann Intern Med. 2012;156:541–50.CrossRefPubMedPubMedCentral
24.
go back to reference Kessler J, Myers JE, Nucifora KA, et al. Averting HIV infections in New York City: a modeling approach estimating the future impact of additional behavioral and biomedical prevention strategies. AIDS. 2014;28:2683–91.CrossRefPubMed Kessler J, Myers JE, Nucifora KA, et al. Averting HIV infections in New York City: a modeling approach estimating the future impact of additional behavioral and biomedical prevention strategies. AIDS. 2014;28:2683–91.CrossRefPubMed
25.
go back to reference Ross EL, Cinti SK, Hutton DW. Implementation and operational research: a cost-effective, clinically actionable strategy for targeting HIV preexposure prophylaxis to high-risk men who have sex with men. J Acquir Immune Defic Syndr. 2016;72:e61–7.CrossRefPubMed Ross EL, Cinti SK, Hutton DW. Implementation and operational research: a cost-effective, clinically actionable strategy for targeting HIV preexposure prophylaxis to high-risk men who have sex with men. J Acquir Immune Defic Syndr. 2016;72:e61–7.CrossRefPubMed
26.
go back to reference Drabo EF, Hay JW, Vardavas R, Wagner ZR, Sood N. A cost-effectiveness analysis of preexposure prophylaxis for the prevention of HIV among Los Angeles County men who have sex with men. Clin Infect Dis. 2016;63:1495–504. Drabo EF, Hay JW, Vardavas R, Wagner ZR, Sood N. A cost-effectiveness analysis of preexposure prophylaxis for the prevention of HIV among Los Angeles County men who have sex with men. Clin Infect Dis. 2016;63:1495–504.
27.
go back to reference Bernard CL, Brandeau ML, Humphreys K, et al. Cost-effectiveness of HIV preexposure prophylaxis for people who inject drugs in the United States. Ann Intern Med. 2016;165:10–9.CrossRef Bernard CL, Brandeau ML, Humphreys K, et al. Cost-effectiveness of HIV preexposure prophylaxis for people who inject drugs in the United States. Ann Intern Med. 2016;165:10–9.CrossRef
28.
go back to reference Gomez GB, Borquez A, Case KK, Wheelock A, Vassall A, Hankins C. The cost and impact of scaling up pre-exposure prophylaxis for HIV prevention: a systematic review of cost-effectiveness modelling studies. PLoS Med. 2013;10:e1001401.CrossRefPubMedPubMedCentral Gomez GB, Borquez A, Case KK, Wheelock A, Vassall A, Hankins C. The cost and impact of scaling up pre-exposure prophylaxis for HIV prevention: a systematic review of cost-effectiveness modelling studies. PLoS Med. 2013;10:e1001401.CrossRefPubMedPubMedCentral
29.
go back to reference Anderson SJ, Cherutich P, Kilonzo N, et al. Maximising the effect of combination HIV prevention through prioritisation of the people and places in greatest need: a modelling study. Lancet. 2014;384:249–56.CrossRefPubMed Anderson SJ, Cherutich P, Kilonzo N, et al. Maximising the effect of combination HIV prevention through prioritisation of the people and places in greatest need: a modelling study. Lancet. 2014;384:249–56.CrossRefPubMed
30.
go back to reference Nichols BE, Baltussen R, van Dijk JH, et al. Cost-effectiveness of PrEP in HIV/AIDS control in Zambia: a stochastic league approach. J Acquir Immune Defic Syndr. 2014;66:221–8.PubMed Nichols BE, Baltussen R, van Dijk JH, et al. Cost-effectiveness of PrEP in HIV/AIDS control in Zambia: a stochastic league approach. J Acquir Immune Defic Syndr. 2014;66:221–8.PubMed
31.
go back to reference Hallett TB, Baeten JM, Heffron R, et al. Optimal uses of antiretrovirals for prevention in HIV-1 serodiscordant heterosexual couples in South Africa: a modelling study. PLoS Med. 2011;8:e1001123.CrossRefPubMedPubMedCentral Hallett TB, Baeten JM, Heffron R, et al. Optimal uses of antiretrovirals for prevention in HIV-1 serodiscordant heterosexual couples in South Africa: a modelling study. PLoS Med. 2011;8:e1001123.CrossRefPubMedPubMedCentral
32.
go back to reference Kim SB, Yoon M, Ku NS, et al. Mathematical modeling of HIV prevention measures including pre-exposure prophylaxis on HIV incidence in South Korea. PLoS One. 2014;9:e90080.CrossRefPubMedPubMedCentral Kim SB, Yoon M, Ku NS, et al. Mathematical modeling of HIV prevention measures including pre-exposure prophylaxis on HIV incidence in South Korea. PLoS One. 2014;9:e90080.CrossRefPubMedPubMedCentral
33.
go back to reference Cremin I, Alsallaq R, Dybul M, Piot P, Garnett G, Hallett TB. The new role of antiretrovirals in combination HIV prevention: a mathematical modelling analysis. AIDS. 2013;27:447–58.CrossRefPubMed Cremin I, Alsallaq R, Dybul M, Piot P, Garnett G, Hallett TB. The new role of antiretrovirals in combination HIV prevention: a mathematical modelling analysis. AIDS. 2013;27:447–58.CrossRefPubMed
34.
go back to reference Smith JA, Anderson SJ, Harris KL, et al. Maximising HIV prevention by balancing the opportunities of today with the promises of tomorrow: a modelling study. Lancet HIV. 2016;3:e289–96.CrossRefPubMedPubMedCentral Smith JA, Anderson SJ, Harris KL, et al. Maximising HIV prevention by balancing the opportunities of today with the promises of tomorrow: a modelling study. Lancet HIV. 2016;3:e289–96.CrossRefPubMedPubMedCentral
35.
go back to reference Ramadhani HO, Bartlett JA, Thielman NM, et al. Association of first-line and second-line antiretroviral therapy adherence. Open Forum Infect Dis. 2014;1(2):ofu079.CrossRefPubMedPubMedCentral Ramadhani HO, Bartlett JA, Thielman NM, et al. Association of first-line and second-line antiretroviral therapy adherence. Open Forum Infect Dis. 2014;1(2):ofu079.CrossRefPubMedPubMedCentral
36.
37.
go back to reference May M, Gompels M, Sabin C. Life expectancy of HIV-1-positive individuals approaches normal, conditional on response to antiretroviral therapy: UK collaborative HIV cohort study. J Int AIDS Soc. 2012;15(Suppl 4):18078.PubMedCentral May M, Gompels M, Sabin C. Life expectancy of HIV-1-positive individuals approaches normal, conditional on response to antiretroviral therapy: UK collaborative HIV cohort study. J Int AIDS Soc. 2012;15(Suppl 4):18078.PubMedCentral
38.
go back to reference May M, Gompels M, Delpech V, et al. Impact on life expectancy of HIV-1 positive individuals of CD4+ cell count and viral load response to antiretroviral therapy. AIDS. 2014;28:1193–202.CrossRefPubMedPubMedCentral May M, Gompels M, Delpech V, et al. Impact on life expectancy of HIV-1 positive individuals of CD4+ cell count and viral load response to antiretroviral therapy. AIDS. 2014;28:1193–202.CrossRefPubMedPubMedCentral
39.
go back to reference Richman DD, Morton SC, Wrin T, et al. The prevalence of antiretroviral drug resistance in the United States. AIDS. 2004;18:1393–401.CrossRefPubMed Richman DD, Morton SC, Wrin T, et al. The prevalence of antiretroviral drug resistance in the United States. AIDS. 2004;18:1393–401.CrossRefPubMed
40.
go back to reference Jiang J, Yang X, Ye L, et al. Pre-exposure prophylaxis for the prevention of HIV infection in high risk populations: a meta-analysis of randomized controlled trials. PLoS One. 2014;9:e87674.CrossRefPubMedPubMedCentral Jiang J, Yang X, Ye L, et al. Pre-exposure prophylaxis for the prevention of HIV infection in high risk populations: a meta-analysis of randomized controlled trials. PLoS One. 2014;9:e87674.CrossRefPubMedPubMedCentral
41.
go back to reference Liu A, Cohen S, Follansbee S, et al. Early experiences implementing preexposure prophylaxis (PrEP) for HIV prevention in San Francisco. PLoS Med. 2014;11:e1001613.CrossRefPubMedPubMedCentral Liu A, Cohen S, Follansbee S, et al. Early experiences implementing preexposure prophylaxis (PrEP) for HIV prevention in San Francisco. PLoS Med. 2014;11:e1001613.CrossRefPubMedPubMedCentral
42.
go back to reference Lehman DA, Baeten JM, McCoy CO, et al. Risk of drug resistance among persons acquiring HIV within a randomized clinical trial of single- or dual-agent preexposure prophylaxis. J Infect Dis. 2015;211:1211–8.PubMedPubMedCentral Lehman DA, Baeten JM, McCoy CO, et al. Risk of drug resistance among persons acquiring HIV within a randomized clinical trial of single- or dual-agent preexposure prophylaxis. J Infect Dis. 2015;211:1211–8.PubMedPubMedCentral
43.
go back to reference Grant RM, Liegler T, Defechereux P, et al. Drug resistance and plasma viral RNA level after ineffective use of oral pre-exposure prophylaxis in women. AIDS. 2015;29:331–7.CrossRefPubMed Grant RM, Liegler T, Defechereux P, et al. Drug resistance and plasma viral RNA level after ineffective use of oral pre-exposure prophylaxis in women. AIDS. 2015;29:331–7.CrossRefPubMed
44.
go back to reference van de Vijver DA, Nichols BE, Abbas UL, et al. Preexposure prophylaxis will have a limited impact on HIV-1 drug resistance in sub-Saharan Africa: a comparison of mathematical models. AIDS. 2013;27:2943–51.CrossRefPubMed van de Vijver DA, Nichols BE, Abbas UL, et al. Preexposure prophylaxis will have a limited impact on HIV-1 drug resistance in sub-Saharan Africa: a comparison of mathematical models. AIDS. 2013;27:2943–51.CrossRefPubMed
45.
go back to reference Abbas UL, Glaubius R, Mubayi A, Hood G, Mellors JW. Antiretroviral therapy and preexposure prophylaxis: combined impact on HIV-1 transmission and drug resistance in South Africa. J Infect Dis. 2013;208:224–34.CrossRefPubMedPubMedCentral Abbas UL, Glaubius R, Mubayi A, Hood G, Mellors JW. Antiretroviral therapy and preexposure prophylaxis: combined impact on HIV-1 transmission and drug resistance in South Africa. J Infect Dis. 2013;208:224–34.CrossRefPubMedPubMedCentral
46.
47.
go back to reference Zetola NM, Bernstein K, Ahrens K, et al. Using surveillance data to monitor entry into care of newly diagnosed HIV-infected persons: San Francisco, 2006-2007. BMC Public Health. 2009;9:17.CrossRefPubMedPubMedCentral Zetola NM, Bernstein K, Ahrens K, et al. Using surveillance data to monitor entry into care of newly diagnosed HIV-infected persons: San Francisco, 2006-2007. BMC Public Health. 2009;9:17.CrossRefPubMedPubMedCentral
48.
go back to reference Tengs TO, Lin TH. A meta-analysis of utility estimates for HIV/AIDS. Med Decis Mak. 2002;22:475–81.CrossRef Tengs TO, Lin TH. A meta-analysis of utility estimates for HIV/AIDS. Med Decis Mak. 2002;22:475–81.CrossRef
49.
go back to reference Long EF, Brandeau ML, Owens DK. Potential population health outcomes and expenditures of HIV vaccination strategies in the United States. Vaccine. 2009;27:5402–10.CrossRefPubMedPubMedCentral Long EF, Brandeau ML, Owens DK. Potential population health outcomes and expenditures of HIV vaccination strategies in the United States. Vaccine. 2009;27:5402–10.CrossRefPubMedPubMedCentral
50.
go back to reference Long EF, Brandeau ML, Owens DK. The cost-effectiveness and population outcomes of expanded HIV screening and antiretroviral treatment in the United States. Ann Intern Med. 2010;153:778–89.CrossRefPubMedPubMedCentral Long EF, Brandeau ML, Owens DK. The cost-effectiveness and population outcomes of expanded HIV screening and antiretroviral treatment in the United States. Ann Intern Med. 2010;153:778–89.CrossRefPubMedPubMedCentral
51.
go back to reference Juusola JL, Brandeau ML, Long EF, Owens DK, Bendavid E. The costeffectiveness of symptom-based testing and routine screening for acute HIV infection in men who have sex with men in the USA. AIDS. 2011;25:1779–87.CrossRefPubMedPubMedCentral Juusola JL, Brandeau ML, Long EF, Owens DK, Bendavid E. The costeffectiveness of symptom-based testing and routine screening for acute HIV infection in men who have sex with men in the USA. AIDS. 2011;25:1779–87.CrossRefPubMedPubMedCentral
52.
go back to reference Nichols BE, Sigaloff KC, Kityo C, et al. Increasing the use of second-line therapy is a cost-effective approach to prevent the spread of drug-resistant HIV: a mathematical modelling study. J Int AIDS Soc. 2014;17:19164.CrossRefPubMedPubMedCentral Nichols BE, Sigaloff KC, Kityo C, et al. Increasing the use of second-line therapy is a cost-effective approach to prevent the spread of drug-resistant HIV: a mathematical modelling study. J Int AIDS Soc. 2014;17:19164.CrossRefPubMedPubMedCentral
53.
54.
go back to reference Horberg M, Raymond B. Financial policy issues for HIV pre-exposure prophylaxis: cost and access to insurance. Am J Prev Med. 2013;44(Suppl 2):S125–8.CrossRefPubMed Horberg M, Raymond B. Financial policy issues for HIV pre-exposure prophylaxis: cost and access to insurance. Am J Prev Med. 2013;44(Suppl 2):S125–8.CrossRefPubMed
55.
go back to reference Drummond M, Sculpher M, Torrance G, O'Brien B, Stoddart G. Methods for the economic evaluation of health care programmes. New York: Oxford University Press; 2005. Drummond M, Sculpher M, Torrance G, O'Brien B, Stoddart G. Methods for the economic evaluation of health care programmes. New York: Oxford University Press; 2005.
59.
go back to reference Schackman BR. Cost-effectiveness of pre-exposure prophylaxis for HIV: a review. Curr Opin HIV AIDS. 2012;7:587–92.CrossRefPubMed Schackman BR. Cost-effectiveness of pre-exposure prophylaxis for HIV: a review. Curr Opin HIV AIDS. 2012;7:587–92.CrossRefPubMed
Metadata
Title
The cost-effectiveness of oral HIV pre-exposure prophylaxis and early antiretroviral therapy in the presence of drug resistance among men who have sex with men in San Francisco
Authors
Mingwang Shen
Yanni Xiao
Libin Rong
Lauren Ancel Meyers
Steven E. Bellan
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2018
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-018-1047-1

Other articles of this Issue 1/2018

BMC Medicine 1/2018 Go to the issue