Skip to main content
Top
Published in: Prevention Science 8/2021

01-11-2021 | Human Immunodeficiency Virus

Using Machine Learning to Predict Young People’s Internet Health and Social Service Information Seeking

Authors: W. Scott Comulada, Cameron Goldbeck, Ellen Almirol, Heather J. Gunn, Manuel A. Ocasio, M. Isabel Fernández, Elizabeth Mayfield Arnold, Adriana Romero-Espinoza, Stacey Urauchi, Wilson Ramos, Mary Jane Rotheram-Borus, Jeffrey D. Klausner, Dallas Swendeman, Adolescent Medicine Trials Network (ATN) CARES Team

Published in: Prevention Science | Issue 8/2021

Login to get access

Abstract

Machine learning creates new opportunities to design digital health interventions for youth at risk for acquiring HIV (YARH), capitalizing on YARH’s health information seeking on the internet. To date, researchers have focused on descriptive analyses that associate individual factors with health-seeking behaviors, without estimating of the strength of these predictive models. We developed predictive models by applying machine learning methods (i.e., elastic net and lasso regression models) to YARH’s self-reports of internet use. The YARH were aged 14–24 years old (N = 1287) from Los Angeles and New Orleans. Models were fit to three binary indicators of YARH’s lifetime internet searches for general health, sexual and reproductive health (SRH), and social service information. YARH responses regarding internet health information seeking were fed into machine learning models with potential predictor variables based on findings from previous research, including sociodemographic characteristics, sexual and gender minority identity, healthcare access and engagement, sexual behavior, substance use, and mental health. About half of the YARH reported seeking general health and SRH information and 26% sought social service information. Areas under the ROC curve (≥ .75) indicated strong predictive models and results were consistent with the existing literature. For example, higher education and sexual minority identification was associated with seeking general health, SRH, and social service information. New findings also emerged. Cisgender identity versus transgender and non-binary identities was associated with lower odds of general health, SRH, and social service information seeking. Experiencing intimate partner violence was associated with higher odds of seeking general health, SRH, and social service information. Findings demonstrate the ability to develop predictive models to inform targeted health information dissemination strategies but underscore the need to better understand health disparities that can be operationalized as predictors in machine learning algorithms.
Literature
go back to reference Aidala, A. A., Wilson, M. G., Shubert, V., Gogolishvili, D., Globerman, J., Rueda, S., et al. (2016). Housing status, medical care, and health outcomes among people living with HIV/AIDS: A systematic review. American Journal of Public Health, 106, e1–e23.CrossRef Aidala, A. A., Wilson, M. G., Shubert, V., Gogolishvili, D., Globerman, J., Rueda, S., et al. (2016). Housing status, medical care, and health outcomes among people living with HIV/AIDS: A systematic review. American Journal of Public Health, 106, e1–e23.CrossRef
go back to reference Barman-Adhikari, A., & Rice, E. (2011). Sexual health information seeking online among runaway and homeless youth. Journal of the Society for Social Work and Research, 2, 89–103.CrossRef Barman-Adhikari, A., & Rice, E. (2011). Sexual health information seeking online among runaway and homeless youth. Journal of the Society for Social Work and Research, 2, 89–103.CrossRef
go back to reference Barrett, T. S., & Lockhart, G. (2019). Efficient exploration of many variables and interactions using regularized regression. Prevention Science, 20, 575–584.CrossRef Barrett, T. S., & Lockhart, G. (2019). Efficient exploration of many variables and interactions using regularized regression. Prevention Science, 20, 575–584.CrossRef
go back to reference Bowleg, L., & Raj, A. (2012). Shared communities, structural contexts, and HIV risk: Prioritizing the HIV risk and prevention needs of black heterosexual men. AJPH, 102, S173–S177.CrossRef Bowleg, L., & Raj, A. (2012). Shared communities, structural contexts, and HIV risk: Prioritizing the HIV risk and prevention needs of black heterosexual men. AJPH, 102, S173–S177.CrossRef
go back to reference Brown, J. L., Gause, N. K., & Northern, N. (2016). The association between alcohol and sexual risk behaviors among college students: A review. Current Addiction Reports, 3, 349–355.CrossRef Brown, J. L., Gause, N. K., & Northern, N. (2016). The association between alcohol and sexual risk behaviors among college students: A review. Current Addiction Reports, 3, 349–355.CrossRef
go back to reference Bush, K., Kivlahan, D. R., McDonell, M. B., Fihn, S. D., & Bradley, K. A. (1998). The AUDIT Alcohol Consumption Questions (AUDIT-C): An effective brief screening test for problem drinking. Archives of Internal Medicine, 3, 1789–1795.CrossRef Bush, K., Kivlahan, D. R., McDonell, M. B., Fihn, S. D., & Bradley, K. A. (1998). The AUDIT Alcohol Consumption Questions (AUDIT-C): An effective brief screening test for problem drinking. Archives of Internal Medicine, 3, 1789–1795.CrossRef
go back to reference Calvert, J. K., Aidala, A. A., & West, J. H. (2013). An ecological view of internet health information seeking behavior predictors: findings from the CHAIN Study. Open AIDS Journal, 7, 42–46.CrossRef Calvert, J. K., Aidala, A. A., & West, J. H. (2013). An ecological view of internet health information seeking behavior predictors: findings from the CHAIN Study. Open AIDS Journal, 7, 42–46.CrossRef
go back to reference Cao, B., Gupta, S., Wang, J., Hightow-Weidman, L. B., Muessig, K. E., Tang, W., et al. (2017). Social media interventions to promote HIV testing, linkage, adherence, and retention: Systematic review and meta-analysis. JMIR, 19, e394.PubMedPubMedCentral Cao, B., Gupta, S., Wang, J., Hightow-Weidman, L. B., Muessig, K. E., Tang, W., et al. (2017). Social media interventions to promote HIV testing, linkage, adherence, and retention: Systematic review and meta-analysis. JMIR, 19, e394.PubMedPubMedCentral
go back to reference Chen, Y. Y., Li, C. M., Liang, J. C., & Tsai, C. C. (2018). Health information obtained from the Internet and changes in medical decision making: Questionnaire development and cross-sectional survey. JMIR, 20, e47.PubMedPubMedCentral Chen, Y. Y., Li, C. M., Liang, J. C., & Tsai, C. C. (2018). Health information obtained from the Internet and changes in medical decision making: Questionnaire development and cross-sectional survey. JMIR, 20, e47.PubMedPubMedCentral
go back to reference Claborn, K. R., Meier, E., Miller, M. B., Leavens, E. L., Brett, E. I., & Leffingwell, T. (2018). Improving adoption and acceptability of digital health interventions for HIV disease management. Translational Behavioral Medicine, 8, 268–279.CrossRef Claborn, K. R., Meier, E., Miller, M. B., Leavens, E. L., Brett, E. I., & Leffingwell, T. (2018). Improving adoption and acceptability of digital health interventions for HIV disease management. Translational Behavioral Medicine, 8, 268–279.CrossRef
go back to reference Comulada, W. S., Step, M. M., Fletcher, J., Tanner, A. E., Dowshen, N., Arayasirikul, S., et al. (2020). Predictors of Internet health information seeking behaviors among young adults living with HIV across the United States. JMIR, 22, e18309.PubMedPubMedCentral Comulada, W. S., Step, M. M., Fletcher, J., Tanner, A. E., Dowshen, N., Arayasirikul, S., et al. (2020). Predictors of Internet health information seeking behaviors among young adults living with HIV across the United States. JMIR, 22, e18309.PubMedPubMedCentral
go back to reference Curry, S. R., Rhoades, H., & Rice, E. (2016). Correlates of homeless youths’ stability-seeking behaviors online and in person. Journal of the Society for Social Work and Research, 7, 2334–2315.CrossRef Curry, S. R., Rhoades, H., & Rice, E. (2016). Correlates of homeless youths’ stability-seeking behaviors online and in person. Journal of the Society for Social Work and Research, 7, 2334–2315.CrossRef
go back to reference De Bellis, M. D., & Zisk, A. (2014). The biological effects of childhood trauma. Child and Adolescent Psychiatric Clinics of North America, 23, 185–222.CrossRef De Bellis, M. D., & Zisk, A. (2014). The biological effects of childhood trauma. Child and Adolescent Psychiatric Clinics of North America, 23, 185–222.CrossRef
go back to reference Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33, 1–22.CrossRef Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33, 1–22.CrossRef
go back to reference Gonzalez, M., Sanders-Jackson, A., & Emory, J. (2016). Online health information-seeking behavior and confidence in filling out online forms among Latinos: a cross-sectional analysis of the California Health Interview Survey, 2011–2012. JMIR, 18, e184.PubMedPubMedCentral Gonzalez, M., Sanders-Jackson, A., & Emory, J. (2016). Online health information-seeking behavior and confidence in filling out online forms among Latinos: a cross-sectional analysis of the California Health Interview Survey, 2011–2012. JMIR, 18, e184.PubMedPubMedCentral
go back to reference Graffigna, G., Barello, S., Bonanomi, A., & Riva, G. (2017). Factors affecting patients’ online health information-seeking behaviours: The role of the Patient Health Engagement (PHE) Model. Patient Education and Counseling, 100, 1918–1927.CrossRef Graffigna, G., Barello, S., Bonanomi, A., & Riva, G. (2017). Factors affecting patients’ online health information-seeking behaviours: The role of the Patient Health Engagement (PHE) Model. Patient Education and Counseling, 100, 1918–1927.CrossRef
go back to reference Grieb, S. M. D., Davey-Rothwell, M., & Latkin, C. A. (2013). Housing stability, residential transience, and HIV testing among low-income urban African Americans. AIDS Education and Prevention, 25, 430–444.CrossRef Grieb, S. M. D., Davey-Rothwell, M., & Latkin, C. A. (2013). Housing stability, residential transience, and HIV testing among low-income urban African Americans. AIDS Education and Prevention, 25, 430–444.CrossRef
go back to reference Jacobs, W., Amuta, A. O., & Jeon, K. C. (2017). Health information seeking in the digital age: An analysis of health information seeking behavior among US adults. Cogent Social Sciences, 3, 1302785.CrossRef Jacobs, W., Amuta, A. O., & Jeon, K. C. (2017). Health information seeking in the digital age: An analysis of health information seeking behavior among US adults. Cogent Social Sciences, 3, 1302785.CrossRef
go back to reference James, G., Witten, D., Hastie, T., & Tibshirani, R. (2014). An introduction to statistical learning with applications in R. Springer, New York., Chapter 6. James, G., Witten, D., Hastie, T., & Tibshirani, R. (2014). An introduction to statistical learning with applications in R. Springer, New York., Chapter 6.
go back to reference Holloway, I. W., Dunlap, S., del Pino, H., Hermanstyne, K., Pulsipher, C., & Landovitz, R. J. (2014). Online social networking, sexual risk and protective behaviors: Considerations for clinicians and researchers. Current Addiction Reports, 1, 220–228.CrossRef Holloway, I. W., Dunlap, S., del Pino, H., Hermanstyne, K., Pulsipher, C., & Landovitz, R. J. (2014). Online social networking, sexual risk and protective behaviors: Considerations for clinicians and researchers. Current Addiction Reports, 1, 220–228.CrossRef
go back to reference Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ9. Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.CrossRef Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ9. Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.CrossRef
go back to reference Lagoe, C., & Atkin, D. (2015). Healthy anxiety in the digital age: An exploration of psychological determinants of online health information seeking. Computers in Human Behavior, 52, 484–491.CrossRef Lagoe, C., & Atkin, D. (2015). Healthy anxiety in the digital age: An exploration of psychological determinants of online health information seeking. Computers in Human Behavior, 52, 484–491.CrossRef
go back to reference Li, J., Theng, Y.-L., & Foo, S. (2016). Predictors of online health information seeking behavior: Changes between 2002 and 2012. Health Informatics Journal, 22, 804–814.CrossRef Li, J., Theng, Y.-L., & Foo, S. (2016). Predictors of online health information seeking behavior: Changes between 2002 and 2012. Health Informatics Journal, 22, 804–814.CrossRef
go back to reference Lo, A., Chernoff, H., Zheng, T., & Lo, S.-H. (2015). Why significant variables aren’t automatically good predictors. Proceeding of the National Academy of Sciences of the United States of America, 112, 13892–13897.CrossRef Lo, A., Chernoff, H., Zheng, T., & Lo, S.-H. (2015). Why significant variables aren’t automatically good predictors. Proceeding of the National Academy of Sciences of the United States of America, 112, 13892–13897.CrossRef
go back to reference McCloud, R. F., Okechukwu, C. A., Sorensen, G., & Viswanath, K. (2016). Beyond access: Barriers to internet health information seeking among the urban poor. Journal of the American Medical Informatics Association, 23, 1053–1059.CrossRef McCloud, R. F., Okechukwu, C. A., Sorensen, G., & Viswanath, K. (2016). Beyond access: Barriers to internet health information seeking among the urban poor. Journal of the American Medical Informatics Association, 23, 1053–1059.CrossRef
go back to reference Metrik, J., Caswell, A. J., Magill, M., Monti, P. M., & Kahler, C. W. (2016). Sexual risk behavior and heavy drinking among weekly marijuana users. Journal of Studies on Alcohol and Drugs, 77, 104–112.CrossRef Metrik, J., Caswell, A. J., Magill, M., Monti, P. M., & Kahler, C. W. (2016). Sexual risk behavior and heavy drinking among weekly marijuana users. Journal of Studies on Alcohol and Drugs, 77, 104–112.CrossRef
go back to reference Mitchell, K. J., Ybarra, M. L., Korchmaros, J. D., & Kosciw, J. G. (2014). Accessing sexual health information online: Use, motivations and consequences for youth with different sexual orientations. Health Education Research, 29, 147–157.CrossRef Mitchell, K. J., Ybarra, M. L., Korchmaros, J. D., & Kosciw, J. G. (2014). Accessing sexual health information online: Use, motivations and consequences for youth with different sexual orientations. Health Education Research, 29, 147–157.CrossRef
go back to reference Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., et al. (2016). Evaluating digital health interventions: Key questions and approaches. American Journal of Preventive Medicine, 51, 843–851.CrossRef Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., et al. (2016). Evaluating digital health interventions: Key questions and approaches. American Journal of Preventive Medicine, 51, 843–851.CrossRef
go back to reference Mustanski, B., Lyons, T., & Garcia, S. C. (2011). Internet use and sexual health of young men who have sex with men: A mixed-methods study. Archives of Sexual Behavior, 40, 289–300.CrossRef Mustanski, B., Lyons, T., & Garcia, S. C. (2011). Internet use and sexual health of young men who have sex with men: A mixed-methods study. Archives of Sexual Behavior, 40, 289–300.CrossRef
go back to reference Nikoloudakis, I. A., Vandelanotte, C., Rebar, A. L., Schoeppe, S., Alley, S., Duncan, M. J., & Short, C. E. (2018). Examining the correlates of online health information–seeking behavior among men compared with women. American Journal of Men's Health, 12, 1358–1367.CrossRef Nikoloudakis, I. A., Vandelanotte, C., Rebar, A. L., Schoeppe, S., Alley, S., Duncan, M. J., & Short, C. E. (2018). Examining the correlates of online health information–seeking behavior among men compared with women. American Journal of Men's Health, 12, 1358–1367.CrossRef
go back to reference Nguyen, A., Mosadeghi, S., & Almario, C. V. (2017). Persistent digital divide in access to and use of the Internet as a resource for health information: Results from a California population-based study. International Journal of Medical Informatics, 103, 49–54.CrossRef Nguyen, A., Mosadeghi, S., & Almario, C. V. (2017). Persistent digital divide in access to and use of the Internet as a resource for health information: Results from a California population-based study. International Journal of Medical Informatics, 103, 49–54.CrossRef
go back to reference Onnela, J. P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41, 1691–1696.CrossRef Onnela, J. P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41, 1691–1696.CrossRef
go back to reference Park, E., & Kwon, M. (2018). Health-related Internet use by children and adolescents: Systematic review. JMIR, 20, e120.PubMedPubMedCentral Park, E., & Kwon, M. (2018). Health-related Internet use by children and adolescents: Systematic review. JMIR, 20, e120.PubMedPubMedCentral
go back to reference Reback, C. J., Ferlito, D., Kisler, K. A., & Fletcher, J. B. (2015). Recruiting, linking, and retaining high-risk transgender women into HIV prevention and care services: An overview of barriers, strategies, and lessons learned. International Journal of Transgenderism, 16, 209–221.CrossRef Reback, C. J., Ferlito, D., Kisler, K. A., & Fletcher, J. B. (2015). Recruiting, linking, and retaining high-risk transgender women into HIV prevention and care services: An overview of barriers, strategies, and lessons learned. International Journal of Transgenderism, 16, 209–221.CrossRef
go back to reference Simoni, J. M., Kutner, B. A., & Horvath, K. J. (2015). Opportunities and challenges of digital technology for HIV treatment and prevention. Current HIV/AIDS Reports, 12, 437–440.CrossRef Simoni, J. M., Kutner, B. A., & Horvath, K. J. (2015). Opportunities and challenges of digital technology for HIV treatment and prevention. Current HIV/AIDS Reports, 12, 437–440.CrossRef
go back to reference Sipe, T. A., Barham, T. L., Johnson, W., Joseph, H., Tungol-Ashmon, M. L., & O’Leary, A. (2017). Structural interventions in HIV prevention: A taxonomy and descriptive systematic review. AIDS and Behavior, 21, 3366–3430.CrossRef Sipe, T. A., Barham, T. L., Johnson, W., Joseph, H., Tungol-Ashmon, M. L., & O’Leary, A. (2017). Structural interventions in HIV prevention: A taxonomy and descriptive systematic review. AIDS and Behavior, 21, 3366–3430.CrossRef
go back to reference Spitzer, R. L., Kroenke, K., Williams, J. B., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 1092–7.CrossRef Spitzer, R. L., Kroenke, K., Williams, J. B., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 1092–7.CrossRef
go back to reference Swendeman, D., Arnold, E. M., Harris, D., Fournier, J., Comulada, W. S., Reback, C., et al. (2019). Text-messaging, online peer support group, and coaching strategies to optimize the HIV prevention continuum for youth: Protocol for a randomized controlled trial. JMIR Research Protocols, 8, e11165.CrossRef Swendeman, D., Arnold, E. M., Harris, D., Fournier, J., Comulada, W. S., Reback, C., et al. (2019). Text-messaging, online peer support group, and coaching strategies to optimize the HIV prevention continuum for youth: Protocol for a randomized controlled trial. JMIR Research Protocols, 8, e11165.CrossRef
go back to reference Tan, S.S.-L., & Goonawardene, N. (2017). Internet health information seeking and the patient-physician relationship: A systematic review. JMIR, 19, e9.PubMedPubMedCentral Tan, S.S.-L., & Goonawardene, N. (2017). Internet health information seeking and the patient-physician relationship: A systematic review. JMIR, 19, e9.PubMedPubMedCentral
go back to reference Tomori, C., Risher, K., Limaye, R. J., Van Lith, L., Gibbs, S., Smelyanskaya, M., & Celentano, D. (2014). A role for health communication in the continuum of HIV care, treatment, and prevention. JAIDS, 66, S306–S310.PubMed Tomori, C., Risher, K., Limaye, R. J., Van Lith, L., Gibbs, S., Smelyanskaya, M., & Celentano, D. (2014). A role for health communication in the continuum of HIV care, treatment, and prevention. JAIDS, 66, S306–S310.PubMed
go back to reference Yigzaw, K. Y., Wynn, R., Marco-Ruiz, L., Budrionis, A., Oyeyemi, S. O., Fagerlund, A. J., & Bellika, J. G. (2020). The association between health information seeking on the Internet and physician visits (the seventh Tromsø study - part 4): Population-based questionnaire study. JMIR, 22, e13120.PubMedPubMedCentral Yigzaw, K. Y., Wynn, R., Marco-Ruiz, L., Budrionis, A., Oyeyemi, S. O., Fagerlund, A. J., & Bellika, J. G. (2020). The association between health information seeking on the Internet and physician visits (the seventh Tromsø study - part 4): Population-based questionnaire study. JMIR, 22, e13120.PubMedPubMedCentral
Metadata
Title
Using Machine Learning to Predict Young People’s Internet Health and Social Service Information Seeking
Authors
W. Scott Comulada
Cameron Goldbeck
Ellen Almirol
Heather J. Gunn
Manuel A. Ocasio
M. Isabel Fernández
Elizabeth Mayfield Arnold
Adriana Romero-Espinoza
Stacey Urauchi
Wilson Ramos
Mary Jane Rotheram-Borus
Jeffrey D. Klausner
Dallas Swendeman
Adolescent Medicine Trials Network (ATN) CARES Team
Publication date
01-11-2021
Publisher
Springer US
Published in
Prevention Science / Issue 8/2021
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-021-01255-2

Other articles of this Issue 8/2021

Prevention Science 8/2021 Go to the issue