Skip to main content
Top
Published in: Journal of General Internal Medicine 12/2016

01-12-2016 | Original Research

Usability of Commercially Available Mobile Applications for Diverse Patients

Authors: Urmimala Sarkar, MD, MPH, Gato I. Gourley, MSc, Courtney R. Lyles, PhD, Lina Tieu, MPH, Cassidy Clarity, BA, Lisa Newmark, BA, Karandeep Singh, MD, MMSc, David W. Bates, MD, MSc

Published in: Journal of General Internal Medicine | Issue 12/2016

Login to get access

ABSTRACT

BACKGROUND

Mobile applications or ‘apps’ intended to help people manage their health and chronic conditions are widespread and gaining in popularity. However, little is known about their acceptability and usability for low-income, racially/ethnically diverse populations who experience a disproportionate burden of chronic disease and its complications.

OBJECTIVE

The objective of this study was to investigate the usability of existing mobile health applications (“apps”) for diabetes, depression, and caregiving, in order to facilitate development and tailoring of patient-facing apps for diverse populations.

DESIGN

Usability testing, a mixed-methods approach that includes interviewing and direct observation of participant technology use, was conducted with participants (n = 9 caregivers; n = 10 patients with depression; and n = 10 patients with diabetes) on a total of 11 of the most popular health apps (four diabetes apps, four depression apps, and three caregiver apps) on both iPad and Android tablets.

PARTICIPANTS

The participants were diverse: 15 (58 %) African Americans, seven (27 %) Whites, two (8 %) Asians, two (8 %) Latinos with either diabetes, depression, or who were caregivers.

MAIN MEASURES

Participants were given condition-specific tasks, such as entering a blood glucose value into a diabetes app. Participant interviews were video recorded and were coded using standard methods to evaluate attempts and completions of tasks. We performed inductive coding of participant comments to identify emergent themes.

KEY RESULTS

Participants completed 79 of 185 (43 %) tasks across 11 apps without assistance. Three themes emerged from participant comments: lack of confidence with technology, frustration with design features and navigation, and interest in having technology to support their self-management.

CONCLUSIONS

App developers should employ participatory design strategies in order to have an impact on chronic conditions such as diabetes and depression that disproportionately affect vulnerable populations. While patients express interest in using technologies for self-management, current tools are not consistently usable for diverse patients.
Appendix
Available only for authorised users
Literature
4.
go back to reference Tieu L, Sarkar U, Schillinger D, Ralston JD, Ratanawongsa N, Pasick R, et al. Barriers and facilitators to online portal use among patients and caregivers in a safety net health care system: a qualitative study. J Med Int Re. 2015;17(12):e275. doi:10.2196/jmir.4847. Tieu L, Sarkar U, Schillinger D, Ralston JD, Ratanawongsa N, Pasick R, et al. Barriers and facilitators to online portal use among patients and caregivers in a safety net health care system: a qualitative study. J Med Int Re. 2015;17(12):e275. doi:10.​2196/​jmir.​4847.
5.
go back to reference Lopez L, Green AR, Tan-McGrory A, King R, Betancourt JR. Bridging the digital divide in health care: the role of health information technology in addressing racial and ethnic disparities. Joint Comm J Qual Patient Safe / J Comm Resour. 2011;37(10):437–45. Lopez L, Green AR, Tan-McGrory A, King R, Betancourt JR. Bridging the digital divide in health care: the role of health information technology in addressing racial and ethnic disparities. Joint Comm J Qual Patient Safe / J Comm Resour. 2011;37(10):437–45.
13.
go back to reference Rivers BM, Bernhardt JM, Fleisher L, Green BL. Opportunities and challenges of using technology to address health disparities. Future Oncol (London, England). 2014;10(4):519–22. doi:10.2217/fon.14.17.CrossRef Rivers BM, Bernhardt JM, Fleisher L, Green BL. Opportunities and challenges of using technology to address health disparities. Future Oncol (London, England). 2014;10(4):519–22. doi:10.​2217/​fon.​14.​17.CrossRef
15.
go back to reference Bender MS, Choi J, Arai S, Paul SM, Gonzalez P, Fukuoka Y. Digital technology ownership, usage, and factors predicting downloading health apps among caucasian, Filipino, Korean, and Latino Americans: the digital link to health survey. JMIR mHealth uHealth. 2014;2(4):e43. doi:10.2196/mhealth.3710. Bender MS, Choi J, Arai S, Paul SM, Gonzalez P, Fukuoka Y. Digital technology ownership, usage, and factors predicting downloading health apps among caucasian, Filipino, Korean, and Latino Americans: the digital link to health survey. JMIR mHealth uHealth. 2014;2(4):e43. doi:10.​2196/​mhealth.​3710.
16.
go back to reference Humble JR, Tolley EA, Krukowski RA, Womack CR, Motley TS, Bailey JE. Use of and interest in mobile health for diabetes self-care in vulnerable populations. J Telemed Telecare. 2015. doi:10.1177/1357633x15586641.PubMed Humble JR, Tolley EA, Krukowski RA, Womack CR, Motley TS, Bailey JE. Use of and interest in mobile health for diabetes self-care in vulnerable populations. J Telemed Telecare. 2015. doi:10.​1177/​1357633x15586641​.PubMed
17.
go back to reference Taha J, Sharit J, Czaja SJ. The impact of numeracy ability and technology skills on older adults’ performance of health management tasks using a patient portal. J Appl Gerontol Offic J Southern Gerontol Soc. 2014;33(4):416–36. doi:10.1177/0733464812447283. Taha J, Sharit J, Czaja SJ. The impact of numeracy ability and technology skills on older adults’ performance of health management tasks using a patient portal. J Appl Gerontol Offic J Southern Gerontol Soc. 2014;33(4):416–36. doi:10.​1177/​0733464812447283​.
18.
go back to reference Wildenbos GA, Peute LW, Jaspers MW. A framework for evaluating mHealth tools for older patients on usability. Stud Health Technol Inform. 2015;210:783–7.PubMed Wildenbos GA, Peute LW, Jaspers MW. A framework for evaluating mHealth tools for older patients on usability. Stud Health Technol Inform. 2015;210:783–7.PubMed
20.
go back to reference Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Int Res. 2014;16(4):e104. Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Int Res. 2014;16(4):e104.
21.
go back to reference Caburnay CA, Graff K, Harris JK, McQueen A, Smith M, Fairchild M, et al. Evaluating diabetes mobile applications for health literate designs and functionality, 2014. Prev Chronic Dis. 2015;12:E61. doi:10.5888/pcd12.140433. Caburnay CA, Graff K, Harris JK, McQueen A, Smith M, Fairchild M, et al. Evaluating diabetes mobile applications for health literate designs and functionality, 2014. Prev Chronic Dis. 2015;12:E61. doi:10.​5888/​pcd12.​140433.
22.
go back to reference Garabedian LF, Ross-Degnan D, Wharam JF. Mobile phone and smartphone technologies for diabetes care and self-management. Curr Diab Rep. 2015;15(12):109. doi:10.1007/s11892-015-0680-8. Garabedian LF, Ross-Degnan D, Wharam JF. Mobile phone and smartphone technologies for diabetes care and self-management. Curr Diab Rep. 2015;15(12):109. doi:10.​1007/​s11892-015-0680-8.
23.
24.
go back to reference Georgsson M, Staggers N. Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics. J Am Med Inform Assoc. 2016;23(1):5–11. doi:10.1093/jamia/ocv099.CrossRefPubMed Georgsson M, Staggers N. Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics. J Am Med Inform Assoc. 2016;23(1):5–11. doi:10.​1093/​jamia/​ocv099.CrossRefPubMed
29.
go back to reference Miller CJ, McInnes DK, Stolzmann K, Bauer MS. Interest in use of technology for healthcare among veterans receiving treatment for mental health. Telemed J E-Health Offic J Am Telemed Assoc. 2016. doi:10.1089/tmj.2015.0190. Miller CJ, McInnes DK, Stolzmann K, Bauer MS. Interest in use of technology for healthcare among veterans receiving treatment for mental health. Telemed J E-Health Offic J Am Telemed Assoc. 2016. doi:10.​1089/​tmj.​2015.​0190.
32.
go back to reference Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med. 2004;36(8):588–94.PubMed Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med. 2004;36(8):588–94.PubMed
33.
go back to reference Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE). J Health Commun. 2010;15(Suppl 2):183–96. doi:10.1080/10810730.2010.499988.CrossRefPubMedPubMedCentral Sarkar U, Karter AJ, Liu JY, Adler NE, Nguyen R, Lopez A, et al. The literacy divide: health literacy and the use of an internet-based patient portal in an integrated health system-results from the diabetes study of northern California (DISTANCE). J Health Commun. 2010;15(Suppl 2):183–96. doi:10.​1080/​10810730.​2010.​499988.CrossRefPubMedPubMedCentral
34.
35.
go back to reference Bailey SC, Wolf MS, Lopez A, Russell A, Chen AH, Schillinger D, et al. Expanding the universal medication schedule: a patient-centred approach. BMJ Open. 2014;4(1):e003699. doi:10.1136/bmjopen-2013-003699. Bailey SC, Wolf MS, Lopez A, Russell A, Chen AH, Schillinger D, et al. Expanding the universal medication schedule: a patient-centred approach. BMJ Open. 2014;4(1):e003699. doi:10.​1136/​bmjopen-2013-003699.
36.
go back to reference Ratanawongsa N, Handley MA, Quan J, Sarkar U, Pfeifer K, Soria C, et al. Quasi-experimental trial of diabetes Self-Management automated and real-time telephonic support (SMARTSteps) in a medicaid managed care plan: study protocol. BMC Health Serv Res. 2012;12:22-. doi:10.1186/1472-6963-12-22. Ratanawongsa N, Handley MA, Quan J, Sarkar U, Pfeifer K, Soria C, et al. Quasi-experimental trial of diabetes Self-Management automated and real-time telephonic support (SMARTSteps) in a medicaid managed care plan: study protocol. BMC Health Serv Res. 2012;12:22-. doi:10.​1186/​1472-6963-12-22.
37.
go back to reference Segall N, Saville JG, L’Engle P, Carlson B, Wright MC, Schulman K, et al. Usability evaluation of a personal health record. AMIA Annu Symp Proc. 2011;2011:1233–42.PubMedPubMedCentral Segall N, Saville JG, L’Engle P, Carlson B, Wright MC, Schulman K, et al. Usability evaluation of a personal health record. AMIA Annu Symp Proc. 2011;2011:1233–42.PubMedPubMedCentral
38.
go back to reference Pope C, Mays N. Reaching the parts other methods cannot reach - an introduction to qualitative methods in health and health services research. Brit Med J. 1995;(311(6996)):4. Pope C, Mays N. Reaching the parts other methods cannot reach - an introduction to qualitative methods in health and health services research. Brit Med J. 1995;(311(6996)):4.
39.
go back to reference Miles M, Huberman M. Qualitative data analyses: an expanded sourcebook, vol. 2. Thousand Oaks, CA: Sage Publications; 1994. Miles M, Huberman M. Qualitative data analyses: an expanded sourcebook, vol. 2. Thousand Oaks, CA: Sage Publications; 1994.
40.
41.
go back to reference Borycki EM, Monkman H, Griffith J, Kushniruk AW. Mobile usability testing in healthcare: methodological approaches. Stud Health Technol Inform. 2015;216:338–42.PubMed Borycki EM, Monkman H, Griffith J, Kushniruk AW. Mobile usability testing in healthcare: methodological approaches. Stud Health Technol Inform. 2015;216:338–42.PubMed
42.
go back to reference Unertl KM, Schaefbauer CL, Campbell TR, Senteio C, Siek KA, Bakken S, et al. Integrating community-based participatory research and informatics approaches to improve the engagement and health of underserved populations. J Am Med Inform Assoc. 2015. doi:10.1093/jamia/ocv094.PubMed Unertl KM, Schaefbauer CL, Campbell TR, Senteio C, Siek KA, Bakken S, et al. Integrating community-based participatory research and informatics approaches to improve the engagement and health of underserved populations. J Am Med Inform Assoc. 2015. doi:10.​1093/​jamia/​ocv094.PubMed
43.
go back to reference Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRefPubMedPubMedCentral Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRefPubMedPubMedCentral
Metadata
Title
Usability of Commercially Available Mobile Applications for Diverse Patients
Authors
Urmimala Sarkar, MD, MPH
Gato I. Gourley, MSc
Courtney R. Lyles, PhD
Lina Tieu, MPH
Cassidy Clarity, BA
Lisa Newmark, BA
Karandeep Singh, MD, MMSc
David W. Bates, MD, MSc
Publication date
01-12-2016
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 12/2016
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-016-3771-6

Other articles of this Issue 12/2016

Journal of General Internal Medicine 12/2016 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine