Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Sexually Transmitted Infection | Research

Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis

Authors: Rebecca Meiksin, G. J. Melendez-Torres, Jane Falconer, T. Charles Witzel, Peter Weatherburn, Chris Bonell

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

Background

Sexual risk, substance use, and mental ill health constitute a syndemic of co-occurring, mutually reinforcing epidemics amongst men who have sex with men (MSM). Developed since 1995, e-health interventions offer accessible, anonymous support and can be effective in addressing these outcomes, suggesting the potential value of developing e-health interventions that address these simultaneously amongst MSM. We conducted a systematic review of e-health interventions addressing one or more of these outcomes amongst MSM and in this paper describe the theories of change underpinning relevant interventions, what these offer and how they might complement each other.

Methods

We identified eligible reports via expert requests, reference-checking and database and Google searches. Results were screened for reports published in 1995 or later; focused on MSM; reporting on e-health interventions providing ongoing support to prevent HIV/STIs, sexual risk behaviour, substance use, anxiety or depression; and describing intervention theories of change. Reviewers assessed report quality, extracted intervention and theory of change data, and developed a novel method of synthesis using diagrammatic representations of theories of change.

Results

Thirty-three reports on 22 intervention theories of change were included, largely of low/medium-quality. Inductively grouping these theories according to their core constructs, we identified three distinct groupings of theorised pathways. In the largest, the ‘cognitive/skills’ grouping, interventions provide information and activities which are theorised to influence behaviour via motivation/intention and self-efficacy/perceived control. In the ‘self-monitoring’ grouping, interventions are theorised to trigger reflection, self-reward/critique and self-regulation. In the ‘cognitive therapy’ grouping, the theory of change is rooted in cognitive therapy techniques, aiming to reframe negative emotions to improve mental health.

Conclusions

The synthesised theories of change provide a framework for developing e-health interventions that might holistically address syndemic health problems amongst MSM. Improving reporting on theories of change in primary studies of e-health interventions would enable a better understanding of how they are intended to work and the evidence supporting this. The novel diagrammatic method of theory of change synthesis used here could be used for future reviews where interventions are driven by existing well-defined behaviour and behaviour change theories.

Systematic review registration

Appendix
Available only for authorised users
Literature
1.
go back to reference UNAIDS. UNAIDS data 2019. Geneva: UNAIDS, Joint United Nations, Programme on HIV/AIDS; 2019. UNAIDS. UNAIDS data 2019. Geneva: UNAIDS, Joint United Nations, Programme on HIV/AIDS; 2019.
2.
go back to reference Network TE. MIS-2017 – The European Men-Who-Have-Sex-With-Men Internet Survey. Key findings from 50 countries. Stockholm: European Centre for Disease Prevention and Control; 2019. Network TE. MIS-2017 – The European Men-Who-Have-Sex-With-Men Internet Survey. Key findings from 50 countries. Stockholm: European Centre for Disease Prevention and Control; 2019.
3.
go back to reference Guasp A. The gay and bisexual men’s health survey. London: Stonewall; 2012. Guasp A. The gay and bisexual men’s health survey. London: Stonewall; 2012.
4.
go back to reference Buffin J. Part of the picture: lesbian, gay and bisexual people’s alocohol and drug use in England (2009-2011). Manchester: The National LGB Drug & Alcohol Database; 2012. Buffin J. Part of the picture: lesbian, gay and bisexual people’s alocohol and drug use in England (2009-2011). Manchester: The National LGB Drug & Alcohol Database; 2012.
5.
go back to reference Lee JGL, Griffen GK, Melvin CL. Tobacco use among sexual minorities in the USA 1987-May 2007: a systematic review. Tobacco Control. 2009;18:275–82.PubMedCrossRef Lee JGL, Griffen GK, Melvin CL. Tobacco use among sexual minorities in the USA 1987-May 2007: a systematic review. Tobacco Control. 2009;18:275–82.PubMedCrossRef
6.
go back to reference Vosburgh HW, Mansergh G, Sullivan PS, Purcell DW. A review of the literature on event-level substance use and sexual risk behavior among men who have sex with men. AIDS Behav. 2012;16(6):1394–410.PubMedCrossRef Vosburgh HW, Mansergh G, Sullivan PS, Purcell DW. A review of the literature on event-level substance use and sexual risk behavior among men who have sex with men. AIDS Behav. 2012;16(6):1394–410.PubMedCrossRef
7.
go back to reference Hickson FCI, Bonell C, Weatherburn P, Reid D, Hammond G. Illicit drugs use among men who have sex with men in England and Wales. Addiction Res Theory. 2010;18(1):14–22.CrossRef Hickson FCI, Bonell C, Weatherburn P, Reid D, Hammond G. Illicit drugs use among men who have sex with men in England and Wales. Addiction Res Theory. 2010;18(1):14–22.CrossRef
8.
go back to reference Schmidt AJ, Bourne A, Weatherburn P, Reid D, Marcus U, Hickson F, et al. Illicit drug use among gay and bisexual men in 44 cities: findings from the European MSM Internet Survey (EMIS). Int J Drug Policy. 2016;38:4–12.PubMedCrossRef Schmidt AJ, Bourne A, Weatherburn P, Reid D, Marcus U, Hickson F, et al. Illicit drug use among gay and bisexual men in 44 cities: findings from the European MSM Internet Survey (EMIS). Int J Drug Policy. 2016;38:4–12.PubMedCrossRef
9.
go back to reference King M, Semlyen J, Tai SS, Killaspy H, Osborn D, Popelyuk D, et al. A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry. 2008;8:70.PubMedPubMedCentralCrossRef King M, Semlyen J, Tai SS, Killaspy H, Osborn D, Popelyuk D, et al. A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry. 2008;8:70.PubMedPubMedCentralCrossRef
10.
go back to reference McFall SL. Understanding society. Colchester: Institute for Social and Economic Research, University of Essex; 2012. McFall SL. Understanding society. Colchester: Institute for Social and Economic Research, University of Essex; 2012.
11.
go back to reference Mercer CH. The health and well-being of men who have sex with men (MSM) in Britain: evidence from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). BMC Public Health. 2016;16:525. Mercer CH. The health and well-being of men who have sex with men (MSM) in Britain: evidence from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). BMC Public Health. 2016;16:525.
12.
go back to reference Regier. Comorbidity of mental disorders with alcohol and other drug abuse. Results from the epidemiologic catchment area (ECA study). J Am Med Assoc. 1990;264(19):2511–8.CrossRef Regier. Comorbidity of mental disorders with alcohol and other drug abuse. Results from the epidemiologic catchment area (ECA study). J Am Med Assoc. 1990;264(19):2511–8.CrossRef
13.
go back to reference Colfax G, Mansergh G, Guzman R, Marks G, Rader M, Buchbinder S. Drug use and sexual risk behavior among gay and bisexual men who attend circuit parties: a venue-based comparison. JAIDS. 2001;28(4):373–9.PubMed Colfax G, Mansergh G, Guzman R, Marks G, Rader M, Buchbinder S. Drug use and sexual risk behavior among gay and bisexual men who attend circuit parties: a venue-based comparison. JAIDS. 2001;28(4):373–9.PubMed
14.
go back to reference Mansergh G, Flores S, Koblin B, Hudson S, McKirnan D, Colfax GN, et al. Alcohol and drug use in the context of anal sex and other factors associated with sexually transmitted infections: results from a multi-city study of high-risk men who have sex with men in the USA. Sex Transm Infect. 2008;84(6):509–11.PubMedCrossRef Mansergh G, Flores S, Koblin B, Hudson S, McKirnan D, Colfax GN, et al. Alcohol and drug use in the context of anal sex and other factors associated with sexually transmitted infections: results from a multi-city study of high-risk men who have sex with men in the USA. Sex Transm Infect. 2008;84(6):509–11.PubMedCrossRef
15.
go back to reference Mustanski B, Garofalo R, Herrick A, Donenberg G. Psychosocial health problems increase risk for HIV among urban young men who have sex with men: preliminary evidence of a syndemic in need of attention. Ann Behav Med. 2007;34(1):37–45.PubMedPubMedCentralCrossRef Mustanski B, Garofalo R, Herrick A, Donenberg G. Psychosocial health problems increase risk for HIV among urban young men who have sex with men: preliminary evidence of a syndemic in need of attention. Ann Behav Med. 2007;34(1):37–45.PubMedPubMedCentralCrossRef
16.
go back to reference Daskalopoulou M, Rodger A, Phillips AN, Sherr L, Speakman A, Collins S, et al. Recreational drug use, polydrug use, and sexual behaviour in HIV-diagnosed men who have sex with men in the UK: results from the cross-sectional ASTRA study. Lancet HIV. 2014;1(1):e22–31.PubMedCrossRef Daskalopoulou M, Rodger A, Phillips AN, Sherr L, Speakman A, Collins S, et al. Recreational drug use, polydrug use, and sexual behaviour in HIV-diagnosed men who have sex with men in the UK: results from the cross-sectional ASTRA study. Lancet HIV. 2014;1(1):e22–31.PubMedCrossRef
18.
go back to reference Heiligenberg M. Recreational drug use during sex and sexually transmitted infections among clients of a city sexually transmitted infections clinic in Amsterdam, the Netherlands. Sex Transmit Dis. 2015;39(7):518–27.CrossRef Heiligenberg M. Recreational drug use during sex and sexually transmitted infections among clients of a city sexually transmitted infections clinic in Amsterdam, the Netherlands. Sex Transmit Dis. 2015;39(7):518–27.CrossRef
19.
go back to reference Stall R, Friedman M, Catania J. Interacting epidemics and gay men’s health: a theory of syndemic production among urban gay men. In: Wolitski R, Stall R, Valdiserri R, editors. Unequal opportunity: health disparities affecting gay and bisexual men in the United States. New York: Oxford University Press; 2008. Stall R, Friedman M, Catania J. Interacting epidemics and gay men’s health: a theory of syndemic production among urban gay men. In: Wolitski R, Stall R, Valdiserri R, editors. Unequal opportunity: health disparities affecting gay and bisexual men in the United States. New York: Oxford University Press; 2008.
20.
go back to reference Guadamuz T, McCarthy KW, Wimonsate W, Thienkrua W, Varangrat A, Chaikummao S, et al. Psychosocial health conditions and HIV prevalence and incidence in a cohort of men who have sex with men in Bangkok, Thailand: evidence of a syndemic effect. AIDS Behav. 2014;18(11):2089–96.PubMedPubMedCentralCrossRef Guadamuz T, McCarthy KW, Wimonsate W, Thienkrua W, Varangrat A, Chaikummao S, et al. Psychosocial health conditions and HIV prevalence and incidence in a cohort of men who have sex with men in Bangkok, Thailand: evidence of a syndemic effect. AIDS Behav. 2014;18(11):2089–96.PubMedPubMedCentralCrossRef
21.
go back to reference Kramer S, Schmidt A, Berg R, Furegato M, Hospers H, Folch C, et al. Factors associated with unprotected anal sex with multiple non-steady partners in the past 12 months: results from the European Men-Who-Have-Sex-With-Men Internet Survey (EMIS 2010). BMC Public Health. 2016;16(47). https://doi.org/10.1186/s12889-016-2691-z. Kramer S, Schmidt A, Berg R, Furegato M, Hospers H, Folch C, et al. Factors associated with unprotected anal sex with multiple non-steady partners in the past 12 months: results from the European Men-Who-Have-Sex-With-Men Internet Survey (EMIS 2010). BMC Public Health. 2016;16(47). https://​doi.​org/​10.​1186/​s12889-016-2691-z.
22.
go back to reference Santos G, Do T, Beck J, Keletso M, Arreola S, Pyun T, et al. Syndemic conditions associated with increased HIV risk in a global sample of men who have sex with men. Sex Transmit Infect. 2014;90:250–3.CrossRef Santos G, Do T, Beck J, Keletso M, Arreola S, Pyun T, et al. Syndemic conditions associated with increased HIV risk in a global sample of men who have sex with men. Sex Transmit Infect. 2014;90:250–3.CrossRef
23.
go back to reference Semple S, Pitpitan E, Goodman-Meza D, Strathdee S, Chavarin C, Rangel G, et al. Correlates of condomless anal sex among men who have sex with men (MSM) in Tijuana, Mexico: The role of public sex venues. PLoS One. 2017;12(10):e0186814.PubMedPubMedCentralCrossRef Semple S, Pitpitan E, Goodman-Meza D, Strathdee S, Chavarin C, Rangel G, et al. Correlates of condomless anal sex among men who have sex with men (MSM) in Tijuana, Mexico: The role of public sex venues. PLoS One. 2017;12(10):e0186814.PubMedPubMedCentralCrossRef
24.
go back to reference Ayala G, Beck J, Lauer K, Reynolds R, Sundararaj M. Social discrimination against men who have sex with men (MSM): Implications for HIV Policy and Programs. Oakland, CA; 2010 May; 2010. Ayala G, Beck J, Lauer K, Reynolds R, Sundararaj M. Social discrimination against men who have sex with men (MSM): Implications for HIV Policy and Programs. Oakland, CA; 2010 May; 2010.
25.
go back to reference Ayala G, Makofane K, Santos G, Beck J, Do T, Hebert P, et al. Access to basic HIV-related services and PrEP acceptability among men who have sex with men worldwide: barriers, facilitators, and implications for combination prevention. J Sex Transmit Dis. 2013. Ayala G, Makofane K, Santos G, Beck J, Do T, Hebert P, et al. Access to basic HIV-related services and PrEP acceptability among men who have sex with men worldwide: barriers, facilitators, and implications for combination prevention. J Sex Transmit Dis. 2013.
26.
go back to reference Ramos S, Warren R, Shedlin M, Melkus G, Kershaw T, Vorderstrasse A. A framework for using eHealth interventions to overcome medical mistrust among sexual minority men of color living with chronic conditions. Behav Med. 2019;45(2):166–76.PubMedPubMedCentralCrossRef Ramos S, Warren R, Shedlin M, Melkus G, Kershaw T, Vorderstrasse A. A framework for using eHealth interventions to overcome medical mistrust among sexual minority men of color living with chronic conditions. Behav Med. 2019;45(2):166–76.PubMedPubMedCentralCrossRef
27.
go back to reference Flores J, Santos G, Makofane K, Arreola S, Ayala G. Availability and use of substance abuse treatment programs among substance-using men who have sex with men worldwide. Substance Use & Misuse; 2017.CrossRef Flores J, Santos G, Makofane K, Arreola S, Ayala G. Availability and use of substance abuse treatment programs among substance-using men who have sex with men worldwide. Substance Use & Misuse; 2017.CrossRef
28.
go back to reference Arreola S, Santos G, Beck J, Sundararaj M, Wilson P, Herbert P, et al. Sexual stigma, criminalization, investment, and access to HIV services among men who have sex with men worldwide. AIDS Behav. 2015;19:227–34.PubMedCrossRef Arreola S, Santos G, Beck J, Sundararaj M, Wilson P, Herbert P, et al. Sexual stigma, criminalization, investment, and access to HIV services among men who have sex with men worldwide. AIDS Behav. 2015;19:227–34.PubMedCrossRef
29.
go back to reference Miltz A, Rodger A, Sewell J, Speakman A, Phillips A, Sherr L, et al. 07 Depression and sexual behaviour among men who have sex with men in the UK. Sex Transmit Infect. 2015;91:A3. Miltz A, Rodger A, Sewell J, Speakman A, Phillips A, Sherr L, et al. 07 Depression and sexual behaviour among men who have sex with men in the UK. Sex Transmit Infect. 2015;91:A3.
30.
go back to reference Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912.PubMedPubMedCentralCrossRef Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912.PubMedPubMedCentralCrossRef
31.
go back to reference Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205.PubMedCrossRef Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205.PubMedCrossRef
32.
go back to reference Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196.PubMedPubMedCentralCrossRef Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196.PubMedPubMedCentralCrossRef
33.
go back to reference Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLoS One. 2014;9(5):e98118.PubMedPubMedCentralCrossRef Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLoS One. 2014;9(5):e98118.PubMedPubMedCentralCrossRef
34.
go back to reference Pasarelu CR, Andersson G, Bergman Nordgren L, Dobrean A. Internet-delivered transdiagnostic and tailored cognitive behavioral therapy for anxiety and depression: a systematic review and meta-analysis of randomized controlled trials. Cogn Behav Ther. 2017;46(1):1–28.PubMedCrossRef Pasarelu CR, Andersson G, Bergman Nordgren L, Dobrean A. Internet-delivered transdiagnostic and tailored cognitive behavioral therapy for anxiety and depression: a systematic review and meta-analysis of randomized controlled trials. Cogn Behav Ther. 2017;46(1):1–28.PubMedCrossRef
35.
go back to reference Spijkerman MP, Pots WT, Bohlmeijer ET. Effectiveness of online mindfulness-based interventions in improving mental health: a review and meta-analysis of randomised controlled trials. Clin Psychol Rev. 2016;45:102–14.PubMedCrossRef Spijkerman MP, Pots WT, Bohlmeijer ET. Effectiveness of online mindfulness-based interventions in improving mental health: a review and meta-analysis of randomised controlled trials. Clin Psychol Rev. 2016;45:102–14.PubMedCrossRef
36.
go back to reference Christensen H, Batterham P, Calear A. Online interventions for anxiety disorders. Curr Opin Psychiatry. 2014;27(1):7–13.PubMedCrossRef Christensen H, Batterham P, Calear A. Online interventions for anxiety disorders. Curr Opin Psychiatry. 2014;27(1):7–13.PubMedCrossRef
37.
go back to reference Kaltenthaler E, Parry G, Beverley C, Ferriter M. Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry. 2008;193(3):181–4.PubMedCrossRef Kaltenthaler E, Parry G, Beverley C, Ferriter M. Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry. 2008;193(3):181–4.PubMedCrossRef
38.
go back to reference Gabarron E, Wynn R. Use of social media for sexual health promotion: a scoping review. Glob Health Action. 2016;9(1):32193.PubMedCrossRef Gabarron E, Wynn R. Use of social media for sexual health promotion: a scoping review. Glob Health Action. 2016;9(1):32193.PubMedCrossRef
39.
go back to reference Schnall R, Travers J, Rojas M, Carballo-Diéguez A. eHealth interventions for HIV prevention in high-risk men who have sex with men: a systematic review. J Med Internet Res. 2014;16(5):e134.PubMedPubMedCentralCrossRef Schnall R, Travers J, Rojas M, Carballo-Diéguez A. eHealth interventions for HIV prevention in high-risk men who have sex with men: a systematic review. J Med Internet Res. 2014;16(5):e134.PubMedPubMedCentralCrossRef
40.
go back to reference L’Engle KL, Mangone ER, Parcesepe AM, Agarwal S, Ippoliti NB. Mobile phone interventions for adolescent sexual and reproductive health: a systematic review. Pediatrics. 2016;138(3):e20160884.PubMedCrossRef L’Engle KL, Mangone ER, Parcesepe AM, Agarwal S, Ippoliti NB. Mobile phone interventions for adolescent sexual and reproductive health: a systematic review. Pediatrics. 2016;138(3):e20160884.PubMedCrossRef
41.
go back to reference Noar S, Black H, Pierce L. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. AIDS. 2009;23(1):107–15.PubMedCrossRef Noar S, Black H, Pierce L. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. AIDS. 2009;23(1):107–15.PubMedCrossRef
42.
go back to reference Rozbroj T, Lyons A, Pitts M, Mitchell A, Christensen H. Assessing the applicability of e-therapies for depression, anxiety, and other mood disorders among lesbians and gay men: analysis of 24 web- and mobile phone-based self-help interventions. J Med Internet Res. 2014;16(7):e166. Rozbroj T, Lyons A, Pitts M, Mitchell A, Christensen H. Assessing the applicability of e-therapies for depression, anxiety, and other mood disorders among lesbians and gay men: analysis of 24 web- and mobile phone-based self-help interventions. J Med Internet Res. 2014;16(7):e166.
43.
go back to reference Sullivan P, Jones J, Kishore N, Stephenson R. The roles of technology in primary HIV prevention for men who have sex with men. Curr HIV/AIDS Rep. 2015;12(4):481–8.PubMedCrossRef Sullivan P, Jones J, Kishore N, Stephenson R. The roles of technology in primary HIV prevention for men who have sex with men. Curr HIV/AIDS Rep. 2015;12(4):481–8.PubMedCrossRef
45.
go back to reference Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010;12(1):e4.PubMedPubMedCentralCrossRef Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010;12(1):e4.PubMedPubMedCentralCrossRef
46.
go back to reference Moore G, Evans R. What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions. SSM Popul Health. 2017;3:132–5.PubMedCrossRef Moore G, Evans R. What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions. SSM Popul Health. 2017;3:132–5.PubMedCrossRef
47.
go back to reference Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Keertan D, et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996-2017). BMJ Open. 2017;7. Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Keertan D, et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996-2017). BMJ Open. 2017;7.
48.
go back to reference Nguyen L, Tran B, Rocha L, Nguyen H, Yang C, Latkin C, et al. A systematic review of eHealth interventions addressing HIV/STI prevention among men who have sex with men. AIDS Behav. 2019;23:2253–72.PubMedPubMedCentralCrossRef Nguyen L, Tran B, Rocha L, Nguyen H, Yang C, Latkin C, et al. A systematic review of eHealth interventions addressing HIV/STI prevention among men who have sex with men. AIDS Behav. 2019;23:2253–72.PubMedPubMedCentralCrossRef
50.
go back to reference Falconer J. Search strategies for: how can e-health interventions reduce the ‘syndemic’ of HIV/STIs and sexual risk, substance use and mental ill health among men who have sex with men? [Data Collection]. London: London School of Hygiene & Tropical Medicine; 2020. Falconer J. Search strategies for: how can e-health interventions reduce the ‘syndemic’ of HIV/STIs and sexual risk, substance use and mental ill health among men who have sex with men? [Data Collection]. London: London School of Hygiene & Tropical Medicine; 2020.
51.
go back to reference Bonell C, Hinds K, Dickson K, Thomas J, Fletcher A, Murphy S, et al. What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature. BMC Public Health. 2016;16:13. Bonell C, Hinds K, Dickson K, Thomas J, Fletcher A, Murphy S, et al. What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature. BMC Public Health. 2016;16:13.
52.
go back to reference Tancred T, Paparini S, Melendez-Torres G, Thomas J, Fletcher A, Campbell R, et al. A systematic review and synthesis of theories of change of school-based interventions integrating health and academic education as a novel means of preventing violence and substance use among students. Syst Rev. 2018;7(1):22. Tancred T, Paparini S, Melendez-Torres G, Thomas J, Fletcher A, Campbell R, et al. A systematic review and synthesis of theories of change of school-based interventions integrating health and academic education as a novel means of preventing violence and substance use among students. Syst Rev. 2018;7(1):22.
53.
go back to reference Bonell C, Fletcher A, Morton M, Lorenc T. ‘Realist Randomised Controlled Trials’: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75(12):8.CrossRef Bonell C, Fletcher A, Morton M, Lorenc T. ‘Realist Randomised Controlled Trials’: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75(12):8.CrossRef
54.
go back to reference Green J, Thorogood N. Qualitative methods for health research. 4 ed. Silverman D, editor. London: Sage; 2018. Green J, Thorogood N. Qualitative methods for health research. 4 ed. Silverman D, editor. London: Sage; 2018.
55.
go back to reference Bauermeister J, Tingler R, Michele Demers M, Harper G. Development of a tailored HIV prevention intervention for single young men who have sex with men who meet partners online: protocol for the myDEx Project. JMIR Res Protocol. 2017;6(7):12.CrossRef Bauermeister J, Tingler R, Michele Demers M, Harper G. Development of a tailored HIV prevention intervention for single young men who have sex with men who meet partners online: protocol for the myDEx Project. JMIR Res Protocol. 2017;6(7):12.CrossRef
56.
go back to reference Bowen A, Williams M, Daniel C, Clayton S. Internet based HIV prevention research targeting rural MSM: feasibility, acceptability, and preliminary efficacy. J Behav Med. 2008;31(6):15.CrossRef Bowen A, Williams M, Daniel C, Clayton S. Internet based HIV prevention research targeting rural MSM: feasibility, acceptability, and preliminary efficacy. J Behav Med. 2008;31(6):15.CrossRef
58.
go back to reference Avellar T. The feasibility and acceptability of an online mindfulness-based cognitive therapy intervention for same-sex attracted men: University of California Santa Barbara; 2016. Avellar T. The feasibility and acceptability of an online mindfulness-based cognitive therapy intervention for same-sex attracted men: University of California Santa Barbara; 2016.
60.
go back to reference Bauermeister J, Tingler R, Demers M, Connochie D, Gillard G, Shaver J, et al. Acceptability and preliminary efficacy of an online HIV prevention intervention for single young men who have sex with men seeking partners online: the myDEx Project. AIDS Behavior. 2019;23(11):3064–77.PubMedCrossRef Bauermeister J, Tingler R, Demers M, Connochie D, Gillard G, Shaver J, et al. Acceptability and preliminary efficacy of an online HIV prevention intervention for single young men who have sex with men seeking partners online: the myDEx Project. AIDS Behavior. 2019;23(11):3064–77.PubMedCrossRef
61.
go back to reference Chiou P, Liao P, Liu C, Hsu Y. Effects of mobile health on HIV risk reduction for men who have sex with men. AIDS CARE. 2020;32(3):316–24.PubMedCrossRef Chiou P, Liao P, Liu C, Hsu Y. Effects of mobile health on HIV risk reduction for men who have sex with men. AIDS CARE. 2020;32(3):316–24.PubMedCrossRef
62.
go back to reference Coulter R, Sang J, Louth-Marquez W, Henderson E, Espelage D, Hunter S, et al. Pilot testing the feasibility of a game intervention aimed at improving help seeking and coping among sexual and gender minority youth: protocol for a randomized controlled trial. JMIR Res Protoc. 2019;8(2). Coulter R, Sang J, Louth-Marquez W, Henderson E, Espelage D, Hunter S, et al. Pilot testing the feasibility of a game intervention aimed at improving help seeking and coping among sexual and gender minority youth: protocol for a randomized controlled trial. JMIR Res Protoc. 2019;8(2).
63.
go back to reference Hirshfield S, Downing MJ, Chiasson M, Yoon I, Houang S, Teran R, et al. Evaluation of sex positive! A video eHealth intervention for men living with HIV. AIDS Behav. 2019;23(11):3103–18.PubMedPubMedCentralCrossRef Hirshfield S, Downing MJ, Chiasson M, Yoon I, Houang S, Teran R, et al. Evaluation of sex positive! A video eHealth intervention for men living with HIV. AIDS Behav. 2019;23(11):3103–18.PubMedPubMedCentralCrossRef
64.
go back to reference Madkins K, Moskowitz D, Moran K, Dellucci T, Mustanski B. Measuring Acceptability and engagement of the Keep It Up! Internet-based HIV prevention randomized controlled trial for young men who have sex with men. AIDS Educ Prev. 2019;31(4):287–305.PubMedPubMedCentralCrossRef Madkins K, Moskowitz D, Moran K, Dellucci T, Mustanski B. Measuring Acceptability and engagement of the Keep It Up! Internet-based HIV prevention randomized controlled trial for young men who have sex with men. AIDS Educ Prev. 2019;31(4):287–305.PubMedPubMedCentralCrossRef
65.
go back to reference Tan R, Koh W, Le D, Tan A, Tyler A, Tan C, et al. Effect of a web drama video series on HIV and other sexually transmitted infection testing among gay, bisexual and queer men: study protocol for a community-based, pragmatic randomised controlled trial in Singapore: the People Like Us (PLU) Evaluation Study. BMJ Open. 2020;10:e033855.PubMedPubMedCentralCrossRef Tan R, Koh W, Le D, Tan A, Tyler A, Tan C, et al. Effect of a web drama video series on HIV and other sexually transmitted infection testing among gay, bisexual and queer men: study protocol for a community-based, pragmatic randomised controlled trial in Singapore: the People Like Us (PLU) Evaluation Study. BMJ Open. 2020;10:e033855.PubMedPubMedCentralCrossRef
66.
go back to reference Jones J, Dominguez K, Stephenson R, Stekler J, Castel A, Mena L, et al. A theoretically based mobile app to increase pre-exposure prophylaxis uptake among men who have sex with men: protocol for a randomized controlled trial. JMIR Res Protoc. 2020;9(2):e16231.PubMedPubMedCentralCrossRef Jones J, Dominguez K, Stephenson R, Stekler J, Castel A, Mena L, et al. A theoretically based mobile app to increase pre-exposure prophylaxis uptake among men who have sex with men: protocol for a randomized controlled trial. JMIR Res Protoc. 2020;9(2):e16231.PubMedPubMedCentralCrossRef
67.
go back to reference Bowen A, Horvath K, Williams M. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res. 2007;22(1):8. Bowen A, Horvath K, Williams M. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res. 2007;22(1):8.
68.
go back to reference Carpenter K, Stoner S, Mikko A, Dhanak L, Parsons J. Efficacy of a web-based intervention to reduce sexual risk in men who have sex with men. AIDS Behav. 2010;14(3):9.CrossRef Carpenter K, Stoner S, Mikko A, Dhanak L, Parsons J. Efficacy of a web-based intervention to reduce sexual risk in men who have sex with men. AIDS Behav. 2010;14(3):9.CrossRef
69.
go back to reference Christensen J, Miller L, Appleby P, Corsbie-Massay C, Godoy C, Marsella S, et al. Reducing shame in a game that predicts HIV risk reduction for young adult men who have sex with men: a randomized trial delivered nationally over the web. J Int AIDS Soc. 2013;16:8.CrossRef Christensen J, Miller L, Appleby P, Corsbie-Massay C, Godoy C, Marsella S, et al. Reducing shame in a game that predicts HIV risk reduction for young adult men who have sex with men: a randomized trial delivered nationally over the web. J Int AIDS Soc. 2013;16:8.CrossRef
70.
go back to reference Davidovich U, de Wit J, Stroebe W. Using the internet to reduce risk of HIV-infection in steady relationships: a randomized controlled trial of a tailored intervention for gay men; 2006. Davidovich U, de Wit J, Stroebe W. Using the internet to reduce risk of HIV-infection in steady relationships: a randomized controlled trial of a tailored intervention for gay men; 2006.
71.
go back to reference Greene G, Madkins K, Andrews K, Dispenza J, Mustanski B. Implementation and evaluation of the Keep it Up! online HIV prevention intervention in a community-based setting. AIDS Educ Prev. 2016;28(3):15.CrossRef Greene G, Madkins K, Andrews K, Dispenza J, Mustanski B. Implementation and evaluation of the Keep it Up! online HIV prevention intervention in a community-based setting. AIDS Educ Prev. 2016;28(3):15.CrossRef
72.
go back to reference Hirshfield S, Downing MJ, Parsons J, Grov C, Gordon R, Houang S, et al. Developing a video-based eHealth intervention for HIV-positive gay, bisexual, and other men who have sex with men: study protocol for a randomized controlled trial. JMIR Res Protocols. 2016;5(2):14.CrossRef Hirshfield S, Downing MJ, Parsons J, Grov C, Gordon R, Houang S, et al. Developing a video-based eHealth intervention for HIV-positive gay, bisexual, and other men who have sex with men: study protocol for a randomized controlled trial. JMIR Res Protocols. 2016;5(2):14.CrossRef
73.
go back to reference Kok G, Harterink P, Vriens P, de Zwart O, Hospers H. The gay cruise: developing a theory- and evidence-based internet HIV-prevention intervention. Sex Res Soci Policy. 2006;3(2):52–67.CrossRef Kok G, Harterink P, Vriens P, de Zwart O, Hospers H. The gay cruise: developing a theory- and evidence-based internet HIV-prevention intervention. Sex Res Soci Policy. 2006;3(2):52–67.CrossRef
74.
go back to reference Linnemayr S, MacCarthy S, Kim A, Giguere R, Carballo-Dieguez A, Barreras J. Behavioral economics-based incentives supported by mobile technology on HIV knowledge and testing frequency among Latino/a men who have sex with men and transgender women: protocol for a randomized pilot study to test intervention feasibility and acceptability. Trials. 2018;19:9.CrossRef Linnemayr S, MacCarthy S, Kim A, Giguere R, Carballo-Dieguez A, Barreras J. Behavioral economics-based incentives supported by mobile technology on HIV knowledge and testing frequency among Latino/a men who have sex with men and transgender women: protocol for a randomized pilot study to test intervention feasibility and acceptability. Trials. 2018;19:9.CrossRef
75.
go back to reference Lucassen M, Merry S, Hatcher S, Frampton C. Rainbow SPARX: a novel approach to addressing depression in sexual minority youth. Cogn Behav Pract. 2015;22(2):14.CrossRef Lucassen M, Merry S, Hatcher S, Frampton C. Rainbow SPARX: a novel approach to addressing depression in sexual minority youth. Cogn Behav Pract. 2015;22(2):14.CrossRef
76.
go back to reference Milam J, Morris S, Jain S, Sun X, Dubé M, Daar E, et al. Randomized controlled trial of an internet application to reduce HIV transmission behavior among HIV infected men who have sex with men. AIDS Behav. 2016;20(6):11.CrossRef Milam J, Morris S, Jain S, Sun X, Dubé M, Daar E, et al. Randomized controlled trial of an internet application to reduce HIV transmission behavior among HIV infected men who have sex with men. AIDS Behav. 2016;20(6):11.CrossRef
77.
go back to reference Mustanski B, Garofalo R, Monahan C, Gratzer B, Andrews R. Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: the Keep It Up! Intervention. AIDS Behav. 2013;17(9):14.CrossRef Mustanski B, Garofalo R, Monahan C, Gratzer B, Andrews R. Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: the Keep It Up! Intervention. AIDS Behav. 2013;17(9):14.CrossRef
78.
go back to reference Mustanski B, Greene G, Ryan D, Whitton S. Feasibility, acceptability, and initial efficacy of an online sexual health promotion program for LGBT youth: the Queer Sex Ed Intervention. J Sex Res. 2015;42(2):11. Mustanski B, Greene G, Ryan D, Whitton S. Feasibility, acceptability, and initial efficacy of an online sexual health promotion program for LGBT youth: the Queer Sex Ed Intervention. J Sex Res. 2015;42(2):11.
79.
go back to reference Mustanski B, Madkins K, Greene G, Parsons J, Johnson B, Sullivan P, et al. Internet-based HIV prevention with at-home sexually transmitted infection testing for young men having sex with men: study protocol of a randomized controlled trial of Keep It Up! 2.0. JMIR Res Protocols. 2017;6(1):17.CrossRef Mustanski B, Madkins K, Greene G, Parsons J, Johnson B, Sullivan P, et al. Internet-based HIV prevention with at-home sexually transmitted infection testing for young men having sex with men: study protocol of a randomized controlled trial of Keep It Up! 2.0. JMIR Res Protocols. 2017;6(1):17.CrossRef
80.
go back to reference Mustanski B, Parsons J, Sullivan P, Madkins K, Rosenberg E, Swann G. Biomedical and behavioral outcomes of Keep It Up!: an eHealth HIV prevention program RCT. Am J Prev Med. 2018;55(2):8.CrossRef Mustanski B, Parsons J, Sullivan P, Madkins K, Rosenberg E, Swann G. Biomedical and behavioral outcomes of Keep It Up!: an eHealth HIV prevention program RCT. Am J Prev Med. 2018;55(2):8.CrossRef
81.
go back to reference Reback C, Fletcher J, Swendeman D, Metzner M. Theory-based text-messaging to reduce methamphetamine use and HIV sexual risk behaviors among men who have sex with men: automated unidirectional delivery outperforms bidirectional peer interactive delivery. AIDS Behav. 2019;23(1):11.CrossRef Reback C, Fletcher J, Swendeman D, Metzner M. Theory-based text-messaging to reduce methamphetamine use and HIV sexual risk behaviors among men who have sex with men: automated unidirectional delivery outperforms bidirectional peer interactive delivery. AIDS Behav. 2019;23(1):11.CrossRef
82.
go back to reference Rosser B, Oakes J, Konstan J, Hooper S, Horvath K, Danilenko G, et al. Reducing HIV risk behavior of MSM through persuasive computing: results of the Men’s INTernet Study (MINTS-II). AIDS. 2010;24(13):9.CrossRef Rosser B, Oakes J, Konstan J, Hooper S, Horvath K, Danilenko G, et al. Reducing HIV risk behavior of MSM through persuasive computing: results of the Men’s INTernet Study (MINTS-II). AIDS. 2010;24(13):9.CrossRef
83.
go back to reference Schonnesson L, Bowen A, Williams M. Project SMART: preliminary results from a test of the efficacy of a Swedish Internet-Based HIV risk-reduction intervention for men who have sex with men. Arch Sex Behav. 2016;45(6):11.CrossRef Schonnesson L, Bowen A, Williams M. Project SMART: preliminary results from a test of the efficacy of a Swedish Internet-Based HIV risk-reduction intervention for men who have sex with men. Arch Sex Behav. 2016;45(6):11.CrossRef
84.
go back to reference Sullivan P, Driggers R, Stekler J, Siegler A, Goldenberg T, McDougal S, et al. Usability and acceptability of a mobile comprehensive HIV prevention app for men who have sex with men: a pilot study. JMIR Mhealth Uhealth. 2017;5(3):14.CrossRef Sullivan P, Driggers R, Stekler J, Siegler A, Goldenberg T, McDougal S, et al. Usability and acceptability of a mobile comprehensive HIV prevention app for men who have sex with men: a pilot study. JMIR Mhealth Uhealth. 2017;5(3):14.CrossRef
85.
go back to reference Swendeman D, Ramanathan C, Baetscher L, Medich M, Scheffler A, Comulada W, et al. Smartphone self-monitoring to support self-management among people living with HIV: perceived benefits and theory of change from a mixed-methods, randomized pilot study. J Acquir Immune Defic Syndr. 2015;69:12.CrossRef Swendeman D, Ramanathan C, Baetscher L, Medich M, Scheffler A, Comulada W, et al. Smartphone self-monitoring to support self-management among people living with HIV: perceived benefits and theory of change from a mixed-methods, randomized pilot study. J Acquir Immune Defic Syndr. 2015;69:12.CrossRef
86.
go back to reference Wilkerson J, Danilenko G, Myer B, Rosser B. The role of critical self-reflection on assumptions in changes in sexual beliefs and behaviors by men who use the internet to seek sex with men. AIDS Educ Prev. 2011;23(1):12.CrossRef Wilkerson J, Danilenko G, Myer B, Rosser B. The role of critical self-reflection on assumptions in changes in sexual beliefs and behaviors by men who use the internet to seek sex with men. AIDS Educ Prev. 2011;23(1):12.CrossRef
87.
go back to reference Williams M, Bowen A, Ei S. An evaluation of the experiences of rural MSM who accessed an online HIV/AIDS health promotion intervention. Health Promot Pract. 2010;11(4):9.CrossRef Williams M, Bowen A, Ei S. An evaluation of the experiences of rural MSM who accessed an online HIV/AIDS health promotion intervention. Health Promot Pract. 2010;11(4):9.CrossRef
88.
go back to reference Kuhns L, Garofalo R, Hidalgo M, Hirshfield S, Pearson C, Bruce J, et al. A randomized controlled efficacy trial of an mHealth HIV prevention intervention for sexual minority young men: MyPEEPS mobile study protocol. BMC Public Health. 2020;20(65). https://doi.org/10.1186/s12889-020-8180-4. Kuhns L, Garofalo R, Hidalgo M, Hirshfield S, Pearson C, Bruce J, et al. A randomized controlled efficacy trial of an mHealth HIV prevention intervention for sexual minority young men: MyPEEPS mobile study protocol. BMC Public Health. 2020;20(65). https://​doi.​org/​10.​1186/​s12889-020-8180-4.
89.
go back to reference Bandura A. Social cognitive theory of self-regulation. Org Behav Hum Decision Processes. 1991;50(2):40.CrossRef Bandura A. Social cognitive theory of self-regulation. Org Behav Hum Decision Processes. 1991;50(2):40.CrossRef
90.
go back to reference Fisher W, Fisher J, Harman J. The information-motivation-behavioral skills model: a general social psychological approach to understanding and promoting health behavior. In: Suls J, Wallston K, editors. Social Psychological Foundations of Health and Illness. Blackwell Series in Health Psychology and Behavioral Medicine. Malden: Blackwell Publishing Ltd; 2009. Fisher W, Fisher J, Harman J. The information-motivation-behavioral skills model: a general social psychological approach to understanding and promoting health behavior. In: Suls J, Wallston K, editors. Social Psychological Foundations of Health and Illness. Blackwell Series in Health Psychology and Behavioral Medicine. Malden: Blackwell Publishing Ltd; 2009.
91.
go back to reference Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health. 1998;13:27.CrossRef Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health. 1998;13:27.CrossRef
92.
go back to reference Bozack A. Social cognitive learning theory. In: Springer, editor. Encyclopedia of Child Behavior and DevelopmentEncyclopedia of Child Behavior and Development. Boston: Apringer; 2011.CrossRef Bozack A. Social cognitive learning theory. In: Springer, editor. Encyclopedia of Child Behavior and DevelopmentEncyclopedia of Child Behavior and Development. Boston: Apringer; 2011.CrossRef
93.
go back to reference Becker M. The health belief model: a decade later. Health Educ Behav. 1984;11(1):1–47. Becker M. The health belief model: a decade later. Health Educ Behav. 1984;11(1):1–47.
94.
go back to reference Ajzen I. The theory of planned behavior. Organizational behavior and human decision processes. 1991;50(2):179–211.CrossRef Ajzen I. The theory of planned behavior. Organizational behavior and human decision processes. 1991;50(2):179–211.CrossRef
95.
go back to reference Reback C, Fletcher J, Shoptaw S, Mansergh G. Exposure to theory-driven text messages is associated with HIV risk reduction among methamphetamine-using men who have sex with men. AIDS Behav. 2015;19:130–41.PubMedCrossRef Reback C, Fletcher J, Shoptaw S, Mansergh G. Exposure to theory-driven text messages is associated with HIV risk reduction among methamphetamine-using men who have sex with men. AIDS Behav. 2015;19:130–41.PubMedCrossRef
96.
go back to reference Robinson B, Bockting W, Rosser B, Miner M, Coleman E. The sexual health model: application of a sexological approach to HIV prevention. Health Educ Res. 2002;17(1):43–57.PubMedCrossRef Robinson B, Bockting W, Rosser B, Miner M, Coleman E. The sexual health model: application of a sexological approach to HIV prevention. Health Educ Res. 2002;17(1):43–57.PubMedCrossRef
97.
go back to reference Prochaska J, Redding C, Evers K. The transtheoretical model and stages of change. In: Glanz K, Rimer B, Viswanath K, editors. Health Behavior: Theory, Research, and Practice. San Francisco: Jossey-Bass; 2015. Prochaska J, Redding C, Evers K. The transtheoretical model and stages of change. In: Glanz K, Rimer B, Viswanath K, editors. Health Behavior: Theory, Research, and Practice. San Francisco: Jossey-Bass; 2015.
98.
go back to reference Lucassen M, Hatcher S, Fleming T, Stasiak K, Shepherd M, Merry S. A qualitative study of sexual minority young people’s experiences of computerised therapy for depression. Aust Psychiatr. 2015;23(3):6.CrossRef Lucassen M, Hatcher S, Fleming T, Stasiak K, Shepherd M, Merry S. A qualitative study of sexual minority young people’s experiences of computerised therapy for depression. Aust Psychiatr. 2015;23(3):6.CrossRef
99.
go back to reference Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.PubMedCrossRef Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.PubMedCrossRef
100.
go back to reference Morrison L, Yardley L, Powell J, Michie S. What design features are used in effective eHealth interventions? A review using techniques from critical interpretative synthesis. Telemed e-Health. 2012;18(2):137–44.CrossRef Morrison L, Yardley L, Powell J, Michie S. What design features are used in effective eHealth interventions? A review using techniques from critical interpretative synthesis. Telemed e-Health. 2012;18(2):137–44.CrossRef
101.
go back to reference Halkitis P. Discrimination and homophobia fuel the HIV epidemic in gay and bisexual men. Psychol AIDS Exchange Newsletter. April 2012. Halkitis P. Discrimination and homophobia fuel the HIV epidemic in gay and bisexual men. Psychol AIDS Exchange Newsletter. April 2012.
103.
go back to reference Petty R, Cacioppo J. The elaboration likelihood model of persuasion. Adv Exp Soc Psychol. 1986;19:123–205.CrossRef Petty R, Cacioppo J. The elaboration likelihood model of persuasion. Adv Exp Soc Psychol. 1986;19:123–205.CrossRef
104.
go back to reference West R. The PRIME theory of motivation as a possible foundation for addiction treatment. In: Henningfield J, Santora P, editors. Drug Addiction Treatment in the 21st Century: Science and Policy Issues. Baltimore: Johns Hopkins University Press; 2007. West R. The PRIME theory of motivation as a possible foundation for addiction treatment. In: Henningfield J, Santora P, editors. Drug Addiction Treatment in the 21st Century: Science and Policy Issues. Baltimore: Johns Hopkins University Press; 2007.
105.
go back to reference Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.PubMedPubMedCentralCrossRef Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.PubMedPubMedCentralCrossRef
Metadata
Title
Theories of change for e-health interventions targeting HIV/STIs and sexual risk, substance use and mental ill health amongst men who have sex with men: systematic review and synthesis
Authors
Rebecca Meiksin
G. J. Melendez-Torres
Jane Falconer
T. Charles Witzel
Peter Weatherburn
Chris Bonell
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-020-01523-2

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue