Skip to main content
Top
Published in: AIDS and Behavior 2/2015

01-02-2015 | Original Paper

Reliability and Validity of Daily Self-Monitoring by Smartphone Application for Health-Related Quality-of-Life, Antiretroviral Adherence, Substance Use, and Sexual Behaviors Among People Living with HIV

Authors: Dallas Swendeman, W. Scott Comulada, Nithya Ramanathan, Maya Lazar, Deborah Estrin

Published in: AIDS and Behavior | Issue 2/2015

Login to get access

Abstract

This paper examines inter-method reliability and validity of daily self-reports by smartphone application compared to 14-day recall web-surveys repeated over 6 weeks with people living with HIV (PLH). A participatory sensing framework guided participant-centered design prioritizing external validity of methods for potential applications in both research and self-management interventions. Inter-method reliability correlations were consistent with prior research for physical and mental health quality-of-life (r = 0.26–0.61), antiretroviral adherence (r = 0.70–0.73), and substance use (r = 0.65–0.92) but not for detailed sexual encounter surveys (r = 0.15–0.61). Concordant and discordant pairwise comparisons show potential trends in reporting biases, for example, lower recall reports of unprotected sex or alcohol use, and rounding up errors for frequent events. Event-based reporting likely compensated for modest response rates to daily time-based prompts, particularly for sexual and drug use behaviors that may not occur daily. Recommendations are discussed for future continuous assessment designs and analyses.
Appendix
Available only for authorised users
Literature
1.
go back to reference Swendeman D, Rotheram-Borus MJ. Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion. Curr Opin Psychiatry. 2010;23:139–44.CrossRefPubMedCentralPubMed Swendeman D, Rotheram-Borus MJ. Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion. Curr Opin Psychiatry. 2010;23:139–44.CrossRefPubMedCentralPubMed
2.
go back to reference Kumar S, Nilsen WJ, Abernethy A, Atienza A, et al. Mobile health technology evaluation: the mHealth evidence workshop. Am J Prev Med. 2013;45(2):228–36.CrossRefPubMedCentralPubMed Kumar S, Nilsen WJ, Abernethy A, Atienza A, et al. Mobile health technology evaluation: the mHealth evidence workshop. Am J Prev Med. 2013;45(2):228–36.CrossRefPubMedCentralPubMed
3.
go back to reference Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. J Nerv Ment Dis. 1987;175(9):526–36.CrossRefPubMed Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. J Nerv Ment Dis. 1987;175(9):526–36.CrossRefPubMed
4.
go back to reference Shiffman S, Stone AA. Introduction to the special section: ecological momentary assessment in health psychology. Health Psycho. 1998;17(1):3.CrossRef Shiffman S, Stone AA. Introduction to the special section: ecological momentary assessment in health psychology. Health Psycho. 1998;17(1):3.CrossRef
5.
go back to reference Fahrenberg J, Myrtek M, Pawlik K, Perrez M. Ambulatory assessment-monitoring behavior in daily life settings. Eur J Psychol Assess. 2007;23(4):206–13.CrossRef Fahrenberg J, Myrtek M, Pawlik K, Perrez M. Ambulatory assessment-monitoring behavior in daily life settings. Eur J Psychol Assess. 2007;23(4):206–13.CrossRef
6.
go back to reference Ebner-Priemer UW, Trull TJ. Ecological momentary assessment of mood disorders and mood dysregulation. Psychol Assess. 2009;21(4):463–75.CrossRefPubMed Ebner-Priemer UW, Trull TJ. Ecological momentary assessment of mood disorders and mood dysregulation. Psychol Assess. 2009;21(4):463–75.CrossRefPubMed
7.
go back to reference Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010;15(Pt 1):1–39.CrossRefPubMedCentralPubMed Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010;15(Pt 1):1–39.CrossRefPubMedCentralPubMed
8.
go back to reference Reddy S, Shilton K, Burke J, Estrin D, Hansen M, Srivastava M. Evaluating participation and performance in participatory sensing. In International workshop on urban, community, and social applications of networked sensing systems. Raleigh, North Carolina: 2013.p. 1–5. Reddy S, Shilton K, Burke J, Estrin D, Hansen M, Srivastava M. Evaluating participation and performance in participatory sensing. In International workshop on urban, community, and social applications of networked sensing systems. Raleigh, North Carolina: 2013.p. 1–5.
9.
11.
go back to reference Buysse DJ, Ancoli-lsrael S, Edinger JD, Lichstein KL, Morin CM. Recommendations for a standard research assessment of insomnia. Sleep: J Sleep and Sleep Disorders Res. 2006;29(9):1155–73. Buysse DJ, Ancoli-lsrael S, Edinger JD, Lichstein KL, Morin CM. Recommendations for a standard research assessment of insomnia. Sleep: J Sleep and Sleep Disorders Res. 2006;29(9):1155–73.
12.
go back to reference Peters ML, Sorbi MJ, Kruise DA, Kerssens JJ, Verhaak PF, Bensing JM. Electronic diary assessment of pain, disability and psychological adaptation in patients differing in duration of pain. Pain. 2000;84(2):181–92.CrossRefPubMed Peters ML, Sorbi MJ, Kruise DA, Kerssens JJ, Verhaak PF, Bensing JM. Electronic diary assessment of pain, disability and psychological adaptation in patients differing in duration of pain. Pain. 2000;84(2):181–92.CrossRefPubMed
13.
go back to reference Mustanski BS. Are sexual partners met online associated with HIV/STI risk behaviours? retrospective and daily diary data in conflict. AIDS Care. 2007;19(6):822–7.CrossRefPubMed Mustanski BS. Are sexual partners met online associated with HIV/STI risk behaviours? retrospective and daily diary data in conflict. AIDS Care. 2007;19(6):822–7.CrossRefPubMed
14.
go back to reference Grov C, Golub SA, Mustanski B, Parsons JT. Sexual compulsivity, state affect, and sexual risk behavior in a daily diary study of gay and bisexual men. Psychol Addict Behav. 2010;24(3):487–97.CrossRefPubMed Grov C, Golub SA, Mustanski B, Parsons JT. Sexual compulsivity, state affect, and sexual risk behavior in a daily diary study of gay and bisexual men. Psychol Addict Behav. 2010;24(3):487–97.CrossRefPubMed
15.
go back to reference Dockray S, Grant N, Stone AA, Kahneman D, Wardle J, Steptoe A. A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method. Soc Indic Res. 2010;99(2):269–83.CrossRefPubMedCentralPubMed Dockray S, Grant N, Stone AA, Kahneman D, Wardle J, Steptoe A. A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method. Soc Indic Res. 2010;99(2):269–83.CrossRefPubMedCentralPubMed
16.
go back to reference Solhan MB, Trull TJ, Jahng S, Wood PK. Clinical assessment of affective instability: comparing EMA indices, questionnaire reports, and retrospective recall. Psychol Assess. 2009;21(3):425.CrossRefPubMedCentralPubMed Solhan MB, Trull TJ, Jahng S, Wood PK. Clinical assessment of affective instability: comparing EMA indices, questionnaire reports, and retrospective recall. Psychol Assess. 2009;21(3):425.CrossRefPubMedCentralPubMed
17.
go back to reference Kerr T, Walsh J, Lloyd-Smith E, Wood E. Measuring adherence to highly active antiretroviral therapy: implications for research and practice. Curr HIV/AIDS Rep. 2005;2:200–5.CrossRefPubMed Kerr T, Walsh J, Lloyd-Smith E, Wood E. Measuring adherence to highly active antiretroviral therapy: implications for research and practice. Curr HIV/AIDS Rep. 2005;2:200–5.CrossRefPubMed
18.
go back to reference Simoni JM, Kurth AE, Pearson CR, Pantalone DW, Merrill JO, Frick PA. Self-report measures of antiretroviral therapy adherence: a review with recommendations for HIV research and clinical management. AIDS Beh. 2006;10(3):227–45.CrossRef Simoni JM, Kurth AE, Pearson CR, Pantalone DW, Merrill JO, Frick PA. Self-report measures of antiretroviral therapy adherence: a review with recommendations for HIV research and clinical management. AIDS Beh. 2006;10(3):227–45.CrossRef
19.
go back to reference Haberer JE, Kiwanuka J, Nansera D, et al. Real-time adherence monitoring of antiretroviral therapy among hiv-infected adults and children in rural uganda. AIDS. 2013;27(13):2166–8.CrossRefPubMed Haberer JE, Kiwanuka J, Nansera D, et al. Real-time adherence monitoring of antiretroviral therapy among hiv-infected adults and children in rural uganda. AIDS. 2013;27(13):2166–8.CrossRefPubMed
20.
go back to reference Shiffman S. Ecological momentary assessment (EMA) in studies of substance use. Eur J Psychol Asess. 2009;21(4):486–97.CrossRef Shiffman S. Ecological momentary assessment (EMA) in studies of substance use. Eur J Psychol Asess. 2009;21(4):486–97.CrossRef
21.
go back to reference Searles JS, Helzer JE, Rose GL, Badger GJ. Concurrent and retrospective reports of alcohol consumption across 30, 90 and 366 days: interactive voice response compared with the timeline follow back. J Stud Alcohol Drugs. 2002;63(3):352. Searles JS, Helzer JE, Rose GL, Badger GJ. Concurrent and retrospective reports of alcohol consumption across 30, 90 and 366 days: interactive voice response compared with the timeline follow back. J Stud Alcohol Drugs. 2002;63(3):352.
22.
go back to reference Hopper JW, Su Z, Looby AR, et al. Incidence and patterns of polydrug use and craving for ecstasy in regular ecstasy users: an ecological momentary assessment study. Drug Alcohol Depen. 2006;85(3):221–35.CrossRef Hopper JW, Su Z, Looby AR, et al. Incidence and patterns of polydrug use and craving for ecstasy in regular ecstasy users: an ecological momentary assessment study. Drug Alcohol Depen. 2006;85(3):221–35.CrossRef
23.
go back to reference Coxon AP. Parallel accounts? discrepancies between self-report (diary) and recall (questionnaire) measures of the same sexual behaviour. AIDS Care. 1999;11(2):221–34.CrossRefPubMed Coxon AP. Parallel accounts? discrepancies between self-report (diary) and recall (questionnaire) measures of the same sexual behaviour. AIDS Care. 1999;11(2):221–34.CrossRefPubMed
24.
go back to reference Garry M, Sharman SJ, Feldman J, Marlatt GA, Loftus EF. Examining memory for heterosexual college students’ sexual experiences using an electronic mail diary. Health Psycho. 2002;21(6):629–34.CrossRef Garry M, Sharman SJ, Feldman J, Marlatt GA, Loftus EF. Examining memory for heterosexual college students’ sexual experiences using an electronic mail diary. Health Psycho. 2002;21(6):629–34.CrossRef
25.
go back to reference Leigh BC, Gillmore MR, Morrison DM. Comparison of diary and retrospective measures for recording alcohol consumption and sexual activity. J Clin Epidemiol. 1998;51(2):119–27.CrossRefPubMed Leigh BC, Gillmore MR, Morrison DM. Comparison of diary and retrospective measures for recording alcohol consumption and sexual activity. J Clin Epidemiol. 1998;51(2):119–27.CrossRefPubMed
26.
go back to reference Shrier LA, Shih MC, Beardslee WR. Affect and sexual behavior in adolescents: a review of the literature and comparison of momentary sampling with diary and retrospective self-report methods of measurement. Pediatrics. 2005;115(5):e573–81.CrossRefPubMedCentralPubMed Shrier LA, Shih MC, Beardslee WR. Affect and sexual behavior in adolescents: a review of the literature and comparison of momentary sampling with diary and retrospective self-report methods of measurement. Pediatrics. 2005;115(5):e573–81.CrossRefPubMedCentralPubMed
27.
go back to reference Durant LE, Carey MP. Self-administered questionnaires versus face-to-face interviews in assessing sexual behavior in young women. Arch Sex Behav. 2000;29(4):309–22.CrossRefPubMed Durant LE, Carey MP. Self-administered questionnaires versus face-to-face interviews in assessing sexual behavior in young women. Arch Sex Behav. 2000;29(4):309–22.CrossRefPubMed
28.
go back to reference Graham CA, Catania JA, Brand R, Duong T, Canchola JA. Recalling sexual behavior: a methodological analysis of memory recall bias via interview using the diary as the gold standard. J Sex Res. 2003;40(4):325–32.CrossRefPubMed Graham CA, Catania JA, Brand R, Duong T, Canchola JA. Recalling sexual behavior: a methodological analysis of memory recall bias via interview using the diary as the gold standard. J Sex Res. 2003;40(4):325–32.CrossRefPubMed
29.
go back to reference Jaccard J, McDonald R, Wan CK, Guilamo-Ramos V, Dittus P, Quinlan S. Recalling sexual partners: the accuracy of self-reports. J Health Psychol. 2004;9(6):699–712.CrossRefPubMed Jaccard J, McDonald R, Wan CK, Guilamo-Ramos V, Dittus P, Quinlan S. Recalling sexual partners: the accuracy of self-reports. J Health Psychol. 2004;9(6):699–712.CrossRefPubMed
30.
go back to reference McAuliffe TL, DiFranceisco W, Reed BR. Effects of question format and collection mode on the accuracy of retrospective surveys of health risk behavior: a comparison with daily sexual activity diaries. Health Psycho. 2007;26(1):60.CrossRef McAuliffe TL, DiFranceisco W, Reed BR. Effects of question format and collection mode on the accuracy of retrospective surveys of health risk behavior: a comparison with daily sexual activity diaries. Health Psycho. 2007;26(1):60.CrossRef
31.
go back to reference Horvath KJ, Beadnell B, Bowen AM. A daily web diary of the sexual experiences of men who have sex with men: comparisons with a retrospective recall survey. AIDS Beh. 2007;11(4):537–48.CrossRef Horvath KJ, Beadnell B, Bowen AM. A daily web diary of the sexual experiences of men who have sex with men: comparisons with a retrospective recall survey. AIDS Beh. 2007;11(4):537–48.CrossRef
32.
go back to reference Ramanathan N, Swendeman D, Comulada WS, Estrin D, Rotheram-Borus MJ. Identifying preferences for mobile health applications for self-monitoring and self-management: focus group findings from HIV-positive persons and young mothers. Int J Medical Inform. 2013;82(4):e38–46.CrossRef Ramanathan N, Swendeman D, Comulada WS, Estrin D, Rotheram-Borus MJ. Identifying preferences for mobile health applications for self-monitoring and self-management: focus group findings from HIV-positive persons and young mothers. Int J Medical Inform. 2013;82(4):e38–46.CrossRef
33.
go back to reference Swendeman D, Mendenhall B, Lazar M, et al. Daily mobile phone self-monitoring of medication use, mood, stress, sexual behaviours and substance use is feasible and acceptable among people living with HIV (PLHIV) and demonstrates benefits for self-management of health behaviours and quality of life. 19th International AIDS Conference. 2013. Swendeman D, Mendenhall B, Lazar M, et al. Daily mobile phone self-monitoring of medication use, mood, stress, sexual behaviours and substance use is feasible and acceptable among people living with HIV (PLHIV) and demonstrates benefits for self-management of health behaviours and quality of life. 19th International AIDS Conference. 2013.
35.
go back to reference Chesney M, Ickovics J. ACTG Adherence baseline questionnaire. San Francisco: AIDS clinical trial group recruitments, adherence and retention sub Committee; 1997. Chesney M, Ickovics J. ACTG Adherence baseline questionnaire. San Francisco: AIDS clinical trial group recruitments, adherence and retention sub Committee; 1997.
36.
go back to reference Comulada SW, Weiss RE, Cumberland W, Rotheram-Borus MJ. Reductions in drug use among young people living with HIV. Am J Drug Alcohol Abuse. 2007;33(3):493–501.CrossRefPubMedCentralPubMed Comulada SW, Weiss RE, Cumberland W, Rotheram-Borus MJ. Reductions in drug use among young people living with HIV. Am J Drug Alcohol Abuse. 2007;33(3):493–501.CrossRefPubMedCentralPubMed
37.
go back to reference NIMH Multisite HIV Prevention Trial. Conceptual basis and procedures for the intervention in a multisite HIV prevention trial. AIDS. 1997;11:S29–35.CrossRef NIMH Multisite HIV Prevention Trial. Conceptual basis and procedures for the intervention in a multisite HIV prevention trial. AIDS. 1997;11:S29–35.CrossRef
38.
go back to reference Carney MA, Tennen H, Affleck G, Del Boca FK, Kranzler HR. Levels and patterns of alcohol consumption using timeline follow-back, daily diaries and real-time “electronic interviews”. J Stud Alcohol. 1998;59:447–54.PubMed Carney MA, Tennen H, Affleck G, Del Boca FK, Kranzler HR. Levels and patterns of alcohol consumption using timeline follow-back, daily diaries and real-time “electronic interviews”. J Stud Alcohol. 1998;59:447–54.PubMed
39.
go back to reference SAS Institute Inc, Cary, N.C: SAS Institute Inc. SAS Institute Inc, Cary, N.C: SAS Institute Inc.
40.
go back to reference R Development Core Team R: A language and environment for statistical computing. R foundation for statistical computing, Vienna, Austria. 2008. http://www.R-project.org. Accessed August 21 2013. R Development Core Team R: A language and environment for statistical computing. R foundation for statistical computing, Vienna, Austria. 2008. http://​www.​R-project.​org. Accessed August 21 2013.
Metadata
Title
Reliability and Validity of Daily Self-Monitoring by Smartphone Application for Health-Related Quality-of-Life, Antiretroviral Adherence, Substance Use, and Sexual Behaviors Among People Living with HIV
Authors
Dallas Swendeman
W. Scott Comulada
Nithya Ramanathan
Maya Lazar
Deborah Estrin
Publication date
01-02-2015
Publisher
Springer US
Published in
AIDS and Behavior / Issue 2/2015
Print ISSN: 1090-7165
Electronic ISSN: 1573-3254
DOI
https://doi.org/10.1007/s10461-014-0923-8

Other articles of this Issue 2/2015

AIDS and Behavior 2/2015 Go to the issue