Skip to main content
Top
Published in: Journal of Medical Systems 2/2015

01-02-2015 | Mobile Systems

Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review

Authors: Belén Cruz Zapata, José Luis Fernández-Alemán, Ali Idri, Ambrosio Toval

Published in: Journal of Medical Systems | Issue 2/2015

Login to get access

Abstract

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients’ lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson’s disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users’ need.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hernandez Munoz, L. U., Woolley, S. I., A user-centered mobile health device to manage life-threatening anaphylactic allergies and provide support in allergic reactions. 9th Int. Conf. Inf. Technol. Appl. Biomed. ITAB 2009. pp 1–4, 2009. Hernandez Munoz, L. U., Woolley, S. I., A user-centered mobile health device to manage life-threatening anaphylactic allergies and provide support in allergic reactions. 9th Int. Conf. Inf. Technol. Appl. Biomed. ITAB 2009. pp 1–4, 2009.
4.
go back to reference Lee, H., Ahn, H., Choi, S., and Choi, W., The SAMS: Smartphone Addiction Management System and Verification. J. Med. Syst. 38:1–10, 2014.CrossRef Lee, H., Ahn, H., Choi, S., and Choi, W., The SAMS: Smartphone Addiction Management System and Verification. J. Med. Syst. 38:1–10, 2014.CrossRef
7.
go back to reference Lobo, D., Kaskaloglu, K., Kim, C. Y., and Herbert, S., Web usability guidelines for smartphones : a synergic approach. Int. J. Inf. Electron. Eng. 1:33–37, 2011. Lobo, D., Kaskaloglu, K., Kim, C. Y., and Herbert, S., Web usability guidelines for smartphones : a synergic approach. Int. J. Inf. Electron. Eng. 1:33–37, 2011.
10.
go back to reference Liu, B., Lin, J., Sadeh, N., Reconciling mobile app privacy and usability on smartphones: could user privacy profiles help? Proc. 23rd Int. Conf. World Wide Web. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, pp 201–212, 2014. Liu, B., Lin, J., Sadeh, N., Reconciling mobile app privacy and usability on smartphones: could user privacy profiles help? Proc. 23rd Int. Conf. World Wide Web. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, pp 201–212, 2014.
13.
go back to reference Barendse, R. J., van Dam, T. B., Nelwan, S. P., Portable platform independent patient monitoring. Comput. Cardiol. Conf. CinC. pp 983–986, 2013. Barendse, R. J., van Dam, T. B., Nelwan, S. P., Portable platform independent patient monitoring. Comput. Cardiol. Conf. CinC. pp 983–986, 2013.
14.
go back to reference Martinez-Perez, B., de la Torre-Diez, I., and Lopez-Coronado, M., Mobile Health Applications for the Most Prevalent Conditions by the World Health Organization: Review and Analysis. J. Med. Internet. Res. 15:e120, 2013.CrossRef Martinez-Perez, B., de la Torre-Diez, I., and Lopez-Coronado, M., Mobile Health Applications for the Most Prevalent Conditions by the World Health Organization: Review and Analysis. J. Med. Internet. Res. 15:e120, 2013.CrossRef
15.
go back to reference Onashoga, S. A., Sodiya, A. S., Omilani, T. O., Ajisegiri, H. O., A mobile phone-based antenatal care support system. Proc. 2011 21st Int. Conf. Syst. Eng. IEEE Computer Society, Washington, DC, USA, pp 410–415, 2011. Onashoga, S. A., Sodiya, A. S., Omilani, T. O., Ajisegiri, H. O., A mobile phone-based antenatal care support system. Proc. 2011 21st Int. Conf. Syst. Eng. IEEE Computer Society, Washington, DC, USA, pp 410–415, 2011.
16.
go back to reference De Barros, A. C., Cevada, J., Bayés, À., et al., User-centred design of a mobile self-management solution for Parkinson’s disease. Proc. 12th Int. Conf. Mob. Ubiquitous Multimed. ACM, New York, NY, USA, pp 23:1–23:10, 2013. De Barros, A. C., Cevada, J., Bayés, À., et al., User-centred design of a mobile self-management solution for Parkinson’s disease. Proc. 12th Int. Conf. Mob. Ubiquitous Multimed. ACM, New York, NY, USA, pp 23:1–23:10, 2013.
17.
go back to reference World Health Organization, mHealth: New horizons for health through mobile technologies, 2011. World Health Organization, mHealth: New horizons for health through mobile technologies, 2011.
18.
go back to reference Coursaris, C. K., and Kim, D. J., A meta-analytical review of empirical mobile usability studies. J. Usability Stud. 6:11:117–11:171, 2011. Coursaris, C. K., and Kim, D. J., A meta-analytical review of empirical mobile usability studies. J. Usability Stud. 6:11:117–11:171, 2011.
19.
go back to reference Baharuddin, R., Singh, D., and Razali, R., Usability dimensions for mobile applications—A review. Res. J. Appl. Sci. Eng. Technol. 5:2225–2231, 2013. Baharuddin, R., Singh, D., and Razali, R., Usability dimensions for mobile applications—A review. Res. J. Appl. Sci. Eng. Technol. 5:2225–2231, 2013.
20.
go back to reference International Organisation for Standardisation ISO 9241–11:1998 Guidance on usability. International Organisation for Standardisation ISO 9241–11:1998 Guidance on usability.
21.
go back to reference International Organisation for Standardisation ISO/IEC 9126–1 Quality model. International Organisation for Standardisation ISO/IEC 9126–1 Quality model.
22.
go back to reference ISO/IEC 25010:2011 System and software quality models. ISO/IEC 25010:2011 System and software quality models.
23.
go back to reference Abran, A., Khelifi, A., Suryn, W., Seffah, A., Consolidating the ISO usability models. Submitt. 11th Int. Softw. Qual. Manag. Conf. 8th Annu. INSPIRE Conf., 2003. Abran, A., Khelifi, A., Suryn, W., Seffah, A., Consolidating the ISO usability models. Submitt. 11th Int. Softw. Qual. Manag. Conf. 8th Annu. INSPIRE Conf., 2003.
24.
go back to reference Dix, A., Finlay, J. E., Abowd, G. D., and Beale, R., Human-Computer Interaction, 3rd edition. Prentice-Hall, Inc., Upper Saddle River, 2003. Dix, A., Finlay, J. E., Abowd, G. D., and Beale, R., Human-Computer Interaction, 3rd edition. Prentice-Hall, Inc., Upper Saddle River, 2003.
25.
go back to reference Nielsen, J., Usability engineering. Morgan Kaufmann Publishers Inc., San Francisco, 1993.MATH Nielsen, J., Usability engineering. Morgan Kaufmann Publishers Inc., San Francisco, 1993.MATH
26.
go back to reference Insfran, E., and Fernandez, A., A Systematic Review of Usability Evaluation in Web Development. In: Hartmann, S., Zhou, X., and Kirchberg, M. (Eds.), Web Information System Engineering – WISE 2008 Workshop. Springer, Berlin, pp. 81–91, 2008.CrossRef Insfran, E., and Fernandez, A., A Systematic Review of Usability Evaluation in Web Development. In: Hartmann, S., Zhou, X., and Kirchberg, M. (Eds.), Web Information System Engineering – WISE 2008 Workshop. Springer, Berlin, pp. 81–91, 2008.CrossRef
27.
go back to reference Kitchenham, B., Procedures for performing systematic reviews. Departament of Computer Science, Keele University, 2004. Kitchenham, B., Procedures for performing systematic reviews. Departament of Computer Science, Keele University, 2004.
28.
go back to reference Fernández-Alemán, J. L., Señor, I. C., Lozoya, P. Á. O., and Toval, A., Security and privacy in electronic health records: a systematic literature review. J. Biomed. Inform. 46:541–562, 2013.CrossRef Fernández-Alemán, J. L., Señor, I. C., Lozoya, P. Á. O., and Toval, A., Security and privacy in electronic health records: a systematic literature review. J. Biomed. Inform. 46:541–562, 2013.CrossRef
29.
go back to reference Brereton, P., Kitchenham, B. A., Budgen, D., et al., Lessons from Applying the Systematic Literature Review Process Within the Software Engineering Domain. J. Syst. Softw. 80:571–583, 2007.CrossRef Brereton, P., Kitchenham, B. A., Budgen, D., et al., Lessons from Applying the Systematic Literature Review Process Within the Software Engineering Domain. J. Syst. Softw. 80:571–583, 2007.CrossRef
30.
go back to reference Stone, P. W., Popping the (PICO) question in research and evidence-based practice. Appl. Nurs. Res. 15:197–198, 2002.CrossRef Stone, P. W., Popping the (PICO) question in research and evidence-based practice. Appl. Nurs. Res. 15:197–198, 2002.CrossRef
31.
go back to reference Ouhbi, S., Idri, A., Fernández-Alemán, J. L., Toval, A., Requirements engineering education: a systematic mapping study. Requir. Eng. 1–20, 2013. Ouhbi, S., Idri, A., Fernández-Alemán, J. L., Toval, A., Requirements engineering education: a systematic mapping study. Requir. Eng. 1–20, 2013.
34.
go back to reference Bowyer, K. W., Mentoring advice on “Conferences Versus Journals” for CSE Faculty, 2012. Bowyer, K. W., Mentoring advice on “Conferences Versus Journals” for CSE Faculty, 2012.
35.
go back to reference Reynoldson, C., Stones, C., Allsop, M., et al., Assessing the Quality and Usability of Smartphone Apps for Pain Self-Management. Pain Med. 15:898–909, 2014.CrossRef Reynoldson, C., Stones, C., Allsop, M., et al., Assessing the Quality and Usability of Smartphone Apps for Pain Self-Management. Pain Med. 15:898–909, 2014.CrossRef
36.
go back to reference Fritz, F., Balhorn, S., Riek, M., et al., Qualitative and quantitative evaluation of EHR-integrated mobile patient questionnaires regarding usability and cost-efficiency. Int. J. Med. Inf. 81:303–313, 2012.CrossRef Fritz, F., Balhorn, S., Riek, M., et al., Qualitative and quantitative evaluation of EHR-integrated mobile patient questionnaires regarding usability and cost-efficiency. Int. J. Med. Inf. 81:303–313, 2012.CrossRef
37.
go back to reference Lawson, S., Jamison-Powell, S., Garbett, A., et al., Validating a mobile phone application for the everyday, unobtrusive, objective measurement of sleep. Proc. SIGCHI Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 2497–2506, 2013. Lawson, S., Jamison-Powell, S., Garbett, A., et al., Validating a mobile phone application for the everyday, unobtrusive, objective measurement of sleep. Proc. SIGCHI Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 2497–2506, 2013.
38.
go back to reference Holzinger, A., Kosec, P., Schwantzer, G., et al., Design and development of a mobile computer application to reengineer workflows in the hospital and the methodology to evaluate its effectiveness. J. Biomed. Inform. 44:968–977, 2011.CrossRef Holzinger, A., Kosec, P., Schwantzer, G., et al., Design and development of a mobile computer application to reengineer workflows in the hospital and the methodology to evaluate its effectiveness. J. Biomed. Inform. 44:968–977, 2011.CrossRef
39.
go back to reference Zargaran, E., Schuurman, N., Nicol, A. J., et al., The Electronic Trauma Health Record: Design and Usability of a Novel Tablet-Based Tool for Trauma Care and Injury Surveillance in Low Resource Settings. J. Am. Coll. Surg. 218:41–50, 2014.CrossRef Zargaran, E., Schuurman, N., Nicol, A. J., et al., The Electronic Trauma Health Record: Design and Usability of a Novel Tablet-Based Tool for Trauma Care and Injury Surveillance in Low Resource Settings. J. Am. Coll. Surg. 218:41–50, 2014.CrossRef
40.
go back to reference Hwang, Y., Shin, D., Yang, C.-Y., et al., Developing a voice user interface with improved usability for people with dysarthria. Proc. 13th Int. Conf. Comput. Help. People Spec. Needs - Vol. Part II. Springer-Verlag, Berlin, Heidelberg, pp 117–124, 2012. Hwang, Y., Shin, D., Yang, C.-Y., et al., Developing a voice user interface with improved usability for people with dysarthria. Proc. 13th Int. Conf. Comput. Help. People Spec. Needs - Vol. Part II. Springer-Verlag, Berlin, Heidelberg, pp 117–124, 2012.
41.
go back to reference de Barros, A. C., Leitão, R., and Ribeiro, J., Design and Evaluation of a Mobile User Interface for Older Adults: Navigation, Interaction and Visual Design Recommendations. Procedia Comput. Sci. 27:369–378, 2014.CrossRef de Barros, A. C., Leitão, R., and Ribeiro, J., Design and Evaluation of a Mobile User Interface for Older Adults: Navigation, Interaction and Visual Design Recommendations. Procedia Comput. Sci. 27:369–378, 2014.CrossRef
42.
go back to reference Kascak, L., Rébola, C. B., Braunstein, R., Sanford, J., Mobile application concept development for remote patient monitoring. Proc. 2013 I.E. Int. Conf. Healthc. Inform. IEEE Computer Society, Washington, DC, USA, pp 545–550, 2013. Kascak, L., Rébola, C. B., Braunstein, R., Sanford, J., Mobile application concept development for remote patient monitoring. Proc. 2013 I.E. Int. Conf. Healthc. Inform. IEEE Computer Society, Washington, DC, USA, pp 545–550, 2013.
43.
go back to reference Costa, R., Marcelino, L., Silva, C., Profile-based system for nutritional information management. 2013 I.E. 15th Int. Conf. E-Health Netw. Appl. Serv. Heal. pp 638–642, 2013. Costa, R., Marcelino, L., Silva, C., Profile-based system for nutritional information management. 2013 I.E. 15th Int. Conf. E-Health Netw. Appl. Serv. Heal. pp 638–642, 2013.
44.
go back to reference Hosono, N., Miyajima, F., Inaba, T., et al., The urgent communication system for deaf and language dysfunction people. Proc. 15th Int. Conf. Hum. Interface Manag. Inf. Inf. Interact. Health Saf. Mobil. Complex Environ. - Vol. Part II. Springer-Verlag, Berlin, Heidelberg, pp 269–274, 2013. Hosono, N., Miyajima, F., Inaba, T., et al., The urgent communication system for deaf and language dysfunction people. Proc. 15th Int. Conf. Hum. Interface Manag. Inf. Inf. Interact. Health Saf. Mobil. Complex Environ. - Vol. Part II. Springer-Verlag, Berlin, Heidelberg, pp 269–274, 2013.
45.
go back to reference Khan, S., Tahir, M. N., Raza, A., Usability issues for smartphone users with special needs - Autism. 2013 Int. Conf. Open Source Syst. Technol. ICOSST. pp 107–113, 2013. Khan, S., Tahir, M. N., Raza, A., Usability issues for smartphone users with special needs - Autism. 2013 Int. Conf. Open Source Syst. Technol. ICOSST. pp 107–113, 2013.
46.
go back to reference Navarro, R. F., Favela, J., Usability assessment of a pervasive system to assist caregivers in dealing with repetitive behaviors of patients with dementia. Proc. 4th Int. Conf. PErvasive Technol. Relat. Assist. Environ. ACM, New York, NY, USA, pp 28:1–28:8, 2011. Navarro, R. F., Favela, J., Usability assessment of a pervasive system to assist caregivers in dealing with repetitive behaviors of patients with dementia. Proc. 4th Int. Conf. PErvasive Technol. Relat. Assist. Environ. ACM, New York, NY, USA, pp 28:1–28:8, 2011.
47.
go back to reference Khan, D. U., Ananthanarayan, S., Le, A. T., et al., Designing mobile snack application for low socioeconomic status families. 2012 6th Int. Conf. Pervasive Comput. Technol. Healthc. PervasiveHealth. pp 57–64, 2012. Khan, D. U., Ananthanarayan, S., Le, A. T., et al., Designing mobile snack application for low socioeconomic status families. 2012 6th Int. Conf. Pervasive Comput. Technol. Healthc. PervasiveHealth. pp 57–64, 2012.
48.
go back to reference Tang. H.-H., Jheng, C.-M., Chien, M.-E., et al., iCAN: A tablet-based pedagogical system for improving the user experience of children with autism in the learning process. 2013 Int. Conf. Orange Technol. ICOT. pp 177–180, 2013. Tang. H.-H., Jheng, C.-M., Chien, M.-E., et al., iCAN: A tablet-based pedagogical system for improving the user experience of children with autism in the learning process. 2013 Int. Conf. Orange Technol. ICOT. pp 177–180, 2013.
49.
go back to reference Ferati, M., Mannheimer, S., Bolchini, D., Usability evaluation of acoustic interfaces for the blind. Proc. 29th ACM Int. Conf. Des. Commun. ACM, New York, NY, USA, pp 9–16, 2011. Ferati, M., Mannheimer, S., Bolchini, D., Usability evaluation of acoustic interfaces for the blind. Proc. 29th ACM Int. Conf. Des. Commun. ACM, New York, NY, USA, pp 9–16, 2011.
50.
go back to reference Strisland, F., Svagard, I., Seeberg, T. M., et al., ESUMS: A mobile system for continuous home monitoring of rehabilitation patients. 2013 35th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBC. pp 4670–4673, 2013. Strisland, F., Svagard, I., Seeberg, T. M., et al., ESUMS: A mobile system for continuous home monitoring of rehabilitation patients. 2013 35th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBC. pp 4670–4673, 2013.
51.
go back to reference Yamagata, C., Kowtko, M., Coppola, J. F., Joyce, S., Mobile app development and usability research to help dementia and Alzheimer patients. Syst. Appl. Technol. Conf. LISAT 2013 I.E. Long Isl. pp 1–6. 2013. Yamagata, C., Kowtko, M., Coppola, J. F., Joyce, S., Mobile app development and usability research to help dementia and Alzheimer patients. Syst. Appl. Technol. Conf. LISAT 2013 I.E. Long Isl. pp 1–6. 2013.
52.
go back to reference Kukec, M., Ljubic, S., Glavinic, V. Need for usability and wish for mobility: case study of client end applications for primary healthcare providers in Croatia. Proc. 7th Conf. Workgr. Hum.-Comput. Interact. Usability Eng. Austrian Comput. Soc. Inf. Qual. E-Health. Springer-Verlag, Berlin, Heidelberg, pp 171–190, 2011. Kukec, M., Ljubic, S., Glavinic, V. Need for usability and wish for mobility: case study of client end applications for primary healthcare providers in Croatia. Proc. 7th Conf. Workgr. Hum.-Comput. Interact. Usability Eng. Austrian Comput. Soc. Inf. Qual. E-Health. Springer-Verlag, Berlin, Heidelberg, pp 171–190, 2011.
53.
go back to reference Xiao, B., Asghar, M. Z., Jamsa, T, Pulii, P., “Canderoid”: A mobile system to remotely monitor travelling status of the elderly with dementia. 2013 Int. Jt. Conf. Aware. Sci. Technol. Ubi-Media Comput. ICAST-UMEDIA. pp 648–654, 2013. Xiao, B., Asghar, M. Z., Jamsa, T, Pulii, P., “Canderoid”: A mobile system to remotely monitor travelling status of the elderly with dementia. 2013 Int. Jt. Conf. Aware. Sci. Technol. Ubi-Media Comput. ICAST-UMEDIA. pp 648–654, 2013.
54.
go back to reference Gay, V., Leijdekkers, P., Barin, E. Feasibility trial of a novel mobile cardiac rehabilitation application. 2010 12th IEEE Int. Conf. E-Health Netw. Appl. Serv. Heal. pp 86–92, 2010. Gay, V., Leijdekkers, P., Barin, E. Feasibility trial of a novel mobile cardiac rehabilitation application. 2010 12th IEEE Int. Conf. E-Health Netw. Appl. Serv. Heal. pp 86–92, 2010.
55.
go back to reference Brooke, J., SUS: A quick and dirty usability scale. Usability Eval. Ind., 1996. Brooke, J., SUS: A quick and dirty usability scale. Usability Eval. Ind., 1996.
56.
go back to reference Rai, A., Chen, L., Pye, J., and Baird, A., Understanding Determinants of Consumer Mobile Health Usage Intentions, Assimilation, and Channel Preferences. J. Med. Internet. Res. 15:e149, 2013.CrossRef Rai, A., Chen, L., Pye, J., and Baird, A., Understanding Determinants of Consumer Mobile Health Usage Intentions, Assimilation, and Channel Preferences. J. Med. Internet. Res. 15:e149, 2013.CrossRef
57.
go back to reference Kumar, S., Nilsen, W., Pavel, M., and Srivastava, M., Mobile Health: Revolutionizing Healthcare Through Transdisciplinary Research. Computer 46:28–35, 2013.CrossRef Kumar, S., Nilsen, W., Pavel, M., and Srivastava, M., Mobile Health: Revolutionizing Healthcare Through Transdisciplinary Research. Computer 46:28–35, 2013.CrossRef
58.
go back to reference Fiordelli, M., Diviani, N., and Schulz, P. J., Mapping mHealth Research: A Decade of Evolution. J. Med. Internet. Res. 15:e95, 2013.CrossRef Fiordelli, M., Diviani, N., and Schulz, P. J., Mapping mHealth Research: A Decade of Evolution. J. Med. Internet. Res. 15:e95, 2013.CrossRef
59.
go back to reference Riley, W. T., Rivera, D. E., Atienza, A. A., et al., Health behavior models in the age of mobile interventions: are our theories up to the task? Transl. Behav. Med. 1:53–71, 2011.CrossRef Riley, W. T., Rivera, D. E., Atienza, A. A., et al., Health behavior models in the age of mobile interventions: are our theories up to the task? Transl. Behav. Med. 1:53–71, 2011.CrossRef
60.
go back to reference Razvan Andonie, I. D., How to write a good paper in Computer Science and how will it be Measured by ISI Web of Knowledge. Int. J. Comput. V.:432–446, 2010. Razvan Andonie, I. D., How to write a good paper in Computer Science and how will it be Measured by ISI Web of Knowledge. Int. J. Comput. V.:432–446, 2010.
62.
go back to reference Nolan, G., Cinar, O., and Truxall, D., Android best practices, 1st edition. Apress, Berkely, 2013. Nolan, G., Cinar, O., and Truxall, D., Android best practices, 1st edition. Apress, Berkely, 2013.
63.
go back to reference Dong, P., Loh, M., and Mondry, A., Publication lag in biomedical journals varies due to the periodical’s publishing model. Scientometrics 69:271–286, 2006.CrossRef Dong, P., Loh, M., and Mondry, A., Publication lag in biomedical journals varies due to the periodical’s publishing model. Scientometrics 69:271–286, 2006.CrossRef
64.
go back to reference Björk, B.-C., and Solomon, D., The publishing delay in scholarly peer-reviewed journals. J. Inf. 7:914–923, 2013.CrossRef Björk, B.-C., and Solomon, D., The publishing delay in scholarly peer-reviewed journals. J. Inf. 7:914–923, 2013.CrossRef
66.
go back to reference Chawda, B., Craft, B., Cairns, P., et al., Do “attractive things work better”? An exploration of search tool visualisations. Proc. 19th BCS Conf. Hum. Comput. Interact. pp 46–51, 2005. Chawda, B., Craft, B., Cairns, P., et al., Do “attractive things work better”? An exploration of search tool visualisations. Proc. 19th BCS Conf. Hum. Comput. Interact. pp 46–51, 2005.
67.
go back to reference Lindgaard, G., Fernandes, G., Dudek, C., and Brown, J., Attention web designers: You have 50 milliseconds to make a good first impression! Behav. Inf. Technol. 25:115–126, 2006.CrossRef Lindgaard, G., Fernandes, G., Dudek, C., and Brown, J., Attention web designers: You have 50 milliseconds to make a good first impression! Behav. Inf. Technol. 25:115–126, 2006.CrossRef
68.
go back to reference Chang, T.-R., Kaasinen, E., Kaipainen, K., What influences users’ decisions to take apps into use?: A framework for evaluating persuasive and engaging design in mobile apps for well-being. Proc. 11th Int. Conf. Mob. Ubiquitous Multimed. ACM, New York, NY, USA, pp 2:1–2:10. 2012. Chang, T.-R., Kaasinen, E., Kaipainen, K., What influences users’ decisions to take apps into use?: A framework for evaluating persuasive and engaging design in mobile apps for well-being. Proc. 11th Int. Conf. Mob. Ubiquitous Multimed. ACM, New York, NY, USA, pp 2:1–2:10. 2012.
69.
go back to reference Sutcliffe, A., Assessing the reliability of heuristic evaluation for website attractiveness and usability. Proc. 35th Annu. Hawaii Int. Conf. Syst. Sci. HICSS02-Vol. 5 - Vol. 5. IEEE Computer Society, Washington, DC, USA, p 137, 2002. Sutcliffe, A., Assessing the reliability of heuristic evaluation for website attractiveness and usability. Proc. 35th Annu. Hawaii Int. Conf. Syst. Sci. HICSS02-Vol. 5 - Vol. 5. IEEE Computer Society, Washington, DC, USA, p 137, 2002.
70.
go back to reference Capretz, L. F., Ali, A., and Ouda, A., A Conceptual Framework for Measuring the Quality Aspect of Mobile Learning. Bull. IEEE Tech. Comm. Learn Technol. 14:31–34, 2012. Capretz, L. F., Ali, A., and Ouda, A., A Conceptual Framework for Measuring the Quality Aspect of Mobile Learning. Bull. IEEE Tech. Comm. Learn Technol. 14:31–34, 2012.
71.
go back to reference Rauch, M., Mobile documentation: Usability guidelines, and considerations for providing documentation on Kindle, tablets, and smartphones. Prof. Commun. Conf. IPCC 2011 I.E. Int. pp 1–13, 2011. Rauch, M., Mobile documentation: Usability guidelines, and considerations for providing documentation on Kindle, tablets, and smartphones. Prof. Commun. Conf. IPCC 2011 I.E. Int. pp 1–13, 2011.
72.
go back to reference Arnhold, M., Quade, M., and Kirch, W., Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J. Med. Internet. Res. 16:e104, 2014.CrossRef Arnhold, M., Quade, M., and Kirch, W., Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J. Med. Internet. Res. 16:e104, 2014.CrossRef
73.
go back to reference Huygens, M., Vermeulen, J., de Witte, L., Expectations of middle-aged and elderly persons towards using telecare technologies and eHealth applications in primary care. pp 241–246, 2014. Huygens, M., Vermeulen, J., de Witte, L., Expectations of middle-aged and elderly persons towards using telecare technologies and eHealth applications in primary care. pp 241–246, 2014.
74.
go back to reference Leung, R., Improving the learnability of mobile device applications for older adults. CHI 09 Ext. Abstr. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 3125–3128, 2009. Leung, R., Improving the learnability of mobile device applications for older adults. CHI 09 Ext. Abstr. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 3125–3128, 2009.
75.
go back to reference Fernandez, A., Insfran, E., and Abrahão, S., Usability evaluation methods for the web: A systematic mapping study. Inf. Softw. Technol. 53:789–817, 2011.CrossRef Fernandez, A., Insfran, E., and Abrahão, S., Usability evaluation methods for the web: A systematic mapping study. Inf. Softw. Technol. 53:789–817, 2011.CrossRef
76.
go back to reference Riihiaho, S., Experiences with usability evaluation methods. Helsinki University of Technology, 2000. Riihiaho, S., Experiences with usability evaluation methods. Helsinki University of Technology, 2000.
77.
go back to reference Matera, M., Rizzo, F., and Carughi, G. T., Web Usability: Principles and Evaluation Methods. In: Mosley, N., and Mendes, E. (Eds.), Web Engeneering. Springer, Berlin, pp. 143–180, 2006.CrossRef Matera, M., Rizzo, F., and Carughi, G. T., Web Usability: Principles and Evaluation Methods. In: Mosley, N., and Mendes, E. (Eds.), Web Engeneering. Springer, Berlin, pp. 143–180, 2006.CrossRef
78.
go back to reference Rana, A., and Mridu, M., Analytical Comparison of usability Measurement Methods. Int. J. Comput. Appl. 39:11–18, 2012. Rana, A., and Mridu, M., Analytical Comparison of usability Measurement Methods. Int. J. Comput. Appl. 39:11–18, 2012.
79.
go back to reference Heo, J., Ham, D.-H., Park, S., et al., A Framework for Evaluating the Usability of Mobile Phones Based on Multi-level, Hierarchical Model of Usability Factors. Interact. Comput. 21:263–275, 2009.CrossRef Heo, J., Ham, D.-H., Park, S., et al., A Framework for Evaluating the Usability of Mobile Phones Based on Multi-level, Hierarchical Model of Usability Factors. Interact. Comput. 21:263–275, 2009.CrossRef
80.
go back to reference Jaspers, M. W. M., A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int. J. Med. Inf. 78:340–353, 2009.CrossRef Jaspers, M. W. M., A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int. J. Med. Inf. 78:340–353, 2009.CrossRef
81.
go back to reference Boren, T., and Ramey, J., Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43:261–278, 2000.CrossRef Boren, T., and Ramey, J., Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43:261–278, 2000.CrossRef
82.
go back to reference Adams, A., and Cox, A. L., Questionnaires, in-depth interviews and focus groups. In: Cox, A. L., and Cairns, P. (Eds.), Research Methods Human-Computer Interaction. Cambridge University Press, Cambridge, pp. 17–34, 2008. Adams, A., and Cox, A. L., Questionnaires, in-depth interviews and focus groups. In: Cox, A. L., and Cairns, P. (Eds.), Research Methods Human-Computer Interaction. Cambridge University Press, Cambridge, pp. 17–34, 2008.
83.
go back to reference Bangor, A., Kortum, P., and Miller, J., Determining what individual SUS scores mean: Adding an adjective rating scale. J. Usability Stud. 4:114–123, 2009. Bangor, A., Kortum, P., and Miller, J., Determining what individual SUS scores mean: Adding an adjective rating scale. J. Usability Stud. 4:114–123, 2009.
84.
go back to reference Ryu, Y. S., and Smith-Jackson, T. L., Reliability and Validity of the Mobile Phone Usability Questionnaire (MPUQ). J. Usability Stud. 2:39–53, 2006. Ryu, Y. S., and Smith-Jackson, T. L., Reliability and Validity of the Mobile Phone Usability Questionnaire (MPUQ). J. Usability Stud. 2:39–53, 2006.
85.
go back to reference Cronbach, L. J., Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334, 1951.CrossRef Cronbach, L. J., Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334, 1951.CrossRef
86.
go back to reference Dell, N., Vaidyanathan, V., Medhi, I., et al., “Yours is Better!”: Participant response bias in HCI. Proc. SIGCHI Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 1321–1330, 2012. Dell, N., Vaidyanathan, V., Medhi, I., et al., “Yours is Better!”: Participant response bias in HCI. Proc. SIGCHI Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 1321–1330, 2012.
87.
go back to reference Ivory, M. Y., and Hearst, M. A., The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Comput. Surv. 33:470–516, 2001.CrossRef Ivory, M. Y., and Hearst, M. A., The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Comput. Surv. 33:470–516, 2001.CrossRef
88.
go back to reference Fabo, P., Durikovic, R., Automated usability measurement of arbitrary desktop application with eyetracking. Proc. 2012 16th Int. Conf. Inf. Vis. IEEE Computer Society, Washington, DC, USA, pp 625–629, 2012. Fabo, P., Durikovic, R., Automated usability measurement of arbitrary desktop application with eyetracking. Proc. 2012 16th Int. Conf. Inf. Vis. IEEE Computer Society, Washington, DC, USA, pp 625–629, 2012.
89.
go back to reference Bastien, J. M. C., Usability testing: a review of some methodological and technical aspects of the method. Int. J. Med. Inf. 79:e18–e23, 2010.CrossRef Bastien, J. M. C., Usability testing: a review of some methodological and technical aspects of the method. Int. J. Med. Inf. 79:e18–e23, 2010.CrossRef
90.
go back to reference Waterson, S., Landay, J. A., Matthews, T., In the lab and out in the wild: remote web usability testing for mobile devices. CHI 02 Ext. Abstr. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 796–797, 2002. Waterson, S., Landay, J. A., Matthews, T., In the lab and out in the wild: remote web usability testing for mobile devices. CHI 02 Ext. Abstr. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 796–797, 2002.
91.
go back to reference Burzacca, P., Paternò, F., Remote usability evaluation of mobile web applications. Proc. 15th Int. Conf. Hum.-Comput. Interact. Hum.-Centred Des. Approaches Methods Tools Environ. - Vol. Part I. Springer-Verlag, Berlin, Heidelberg, pp 241–248, 2013. Burzacca, P., Paternò, F., Remote usability evaluation of mobile web applications. Proc. 15th Int. Conf. Hum.-Comput. Interact. Hum.-Centred Des. Approaches Methods Tools Environ. - Vol. Part I. Springer-Verlag, Berlin, Heidelberg, pp 241–248, 2013.
92.
go back to reference Thompson, K. E., Rozanski, E. P., Haake, A. R., Here, there, anywhere: remote usability testing that works. Proc. 5th Conf. Inf. Technol. Educ. ACM, New York, NY, USA, pp 132–137, 2004. Thompson, K. E., Rozanski, E. P., Haake, A. R., Here, there, anywhere: remote usability testing that works. Proc. 5th Conf. Inf. Technol. Educ. ACM, New York, NY, USA, pp 132–137, 2004.
93.
go back to reference Bruin, J. A. de, Malan, K. M., Eloff, J. H. P., Saccade deviation indicators for automated eye tracking analysis. Proc. 2013 Conf. Eye Track. South Afr. ACM, New York, NY, USA, pp 47–54. 2013. Bruin, J. A. de, Malan, K. M., Eloff, J. H. P., Saccade deviation indicators for automated eye tracking analysis. Proc. 2013 Conf. Eye Track. South Afr. ACM, New York, NY, USA, pp 47–54. 2013.
94.
go back to reference Chynal, P., Szymański, J. M., Sobecki, J., Using eyetracking in a mobile applications usability testing. Proc. 4th Asian Conf. Intell. Inf. Database Syst. - Vol. Part III. Springer-Verlag, Berlin, Heidelberg, pp 178–186, 2012. Chynal, P., Szymański, J. M., Sobecki, J., Using eyetracking in a mobile applications usability testing. Proc. 4th Asian Conf. Intell. Inf. Database Syst. - Vol. Part III. Springer-Verlag, Berlin, Heidelberg, pp 178–186, 2012.
95.
go back to reference Hornbæk, K., Current practice in measuring usability: Challenges to usability studies and research. Int. J. Hum.-Comput. Stud. 64:79–102, 2006.CrossRef Hornbæk, K., Current practice in measuring usability: Challenges to usability studies and research. Int. J. Hum.-Comput. Stud. 64:79–102, 2006.CrossRef
97.
go back to reference Mc Carthy, S., Sayers, H., McKevitt, P., Investigating the usability of PDAs with ageing users. Proc. 21st Br. HCI Group Annu. Conf. People Comput. HCIBut We Know It - Vol. 2. British Computer Society, Swinton, UK, UK, pp 67–70, 2007. Mc Carthy, S., Sayers, H., McKevitt, P., Investigating the usability of PDAs with ageing users. Proc. 21st Br. HCI Group Annu. Conf. People Comput. HCIBut We Know It - Vol. 2. British Computer Society, Swinton, UK, UK, pp 67–70, 2007.
98.
go back to reference Tseng, K. C., Hsu, C.-L., and Chuang, Y.-H., Designing an Intelligent Health Monitoring System and Exploring User Acceptance for the Elderly. J. Med. Syst. 37:1–18, 2013.CrossRef Tseng, K. C., Hsu, C.-L., and Chuang, Y.-H., Designing an Intelligent Health Monitoring System and Exploring User Acceptance for the Elderly. J. Med. Syst. 37:1–18, 2013.CrossRef
99.
go back to reference Pak, R., McLaughlin, A., Designing displays for older adults. CRC Press, 2010. Pak, R., McLaughlin, A., Designing displays for older adults. CRC Press, 2010.
100.
go back to reference Fisk, A. D., Rogers, W. A., Charness, N., et al., Designing for Older Adults: Principles and Creative Human Factors Approaches, 2nd edition. CRC Press, Boca Raton, 2009.CrossRef Fisk, A. D., Rogers, W. A., Charness, N., et al., Designing for Older Adults: Principles and Creative Human Factors Approaches, 2nd edition. CRC Press, Boca Raton, 2009.CrossRef
101.
go back to reference Chisnell, D. E., Redish, J. C., and Lee, A., New Heuristics for Understanding Older Adults as Web Users. Tech. Commun. 53:39–59, 2006. Chisnell, D. E., Redish, J. C., and Lee, A., New Heuristics for Understanding Older Adults as Web Users. Tech. Commun. 53:39–59, 2006.
103.
go back to reference Joe, J., and Demiris, G., Older adults and mobile phones for health: A review. J. Biomed. Inform. 46:947–954, 2013.CrossRef Joe, J., and Demiris, G., Older adults and mobile phones for health: A review. J. Biomed. Inform. 46:947–954, 2013.CrossRef
104.
go back to reference Leo, G. D., Gonzales, C. H., Battagiri, P., and Leroy, G., A Smart-Phone Application and a Companion Website for the Improvement of the Communication Skills of Children with Autism: Clinical Rationale, Technical Development and Preliminary Results. J. Med. Syst. 35:703–711, 2011.CrossRef Leo, G. D., Gonzales, C. H., Battagiri, P., and Leroy, G., A Smart-Phone Application and a Companion Website for the Improvement of the Communication Skills of Children with Autism: Clinical Rationale, Technical Development and Preliminary Results. J. Med. Syst. 35:703–711, 2011.CrossRef
105.
go back to reference Hanna, L., Risden, K., and Alexander, K., Guidelines for Usability Testing with Children. Interactions 4:9–14, 1997.CrossRef Hanna, L., Risden, K., and Alexander, K., Guidelines for Usability Testing with Children. Interactions 4:9–14, 1997.CrossRef
106.
go back to reference Markopoulos, P., and Bekker, M., On the assessment of usability testing methods for children. Interact. Comput. 15:227–243, 2003.CrossRef Markopoulos, P., and Bekker, M., On the assessment of usability testing methods for children. Interact. Comput. 15:227–243, 2003.CrossRef
107.
go back to reference Edwards, H., Benedyk, R., A comparison of usability evaluation methods for child participants in a school setting. Proc. 6th Int. Conf. Interact. Des. Child. ACM, New York, NY, USA, pp 9–16, 2007. Edwards, H., Benedyk, R., A comparison of usability evaluation methods for child participants in a school setting. Proc. 6th Int. Conf. Interact. Des. Child. ACM, New York, NY, USA, pp 9–16, 2007.
108.
go back to reference Nielsen, J., Landauer, T. K., A mathematical model of the finding of usability problems. Proc. INTERACT 93 CHI 93 Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 206–213, 1993. Nielsen, J., Landauer, T. K., A mathematical model of the finding of usability problems. Proc. INTERACT 93 CHI 93 Conf. Hum. Factors Comput. Syst. ACM, New York, NY, USA, pp 206–213, 1993.
110.
go back to reference Gulliksen, J., Göransson, B., Boivie, I., et al., Key principles for user-centred systems design. In: Seffah, A., Gulliksen, J., and Desmarais, M. C. (Eds.), Human-Centered Softwafe Engineering — Integrating Usability Software Devevelopment Lifecycle. Springer, Netherlands, pp. 17–36, 2005.CrossRef Gulliksen, J., Göransson, B., Boivie, I., et al., Key principles for user-centred systems design. In: Seffah, A., Gulliksen, J., and Desmarais, M. C. (Eds.), Human-Centered Softwafe Engineering — Integrating Usability Software Devevelopment Lifecycle. Springer, Netherlands, pp. 17–36, 2005.CrossRef
111.
go back to reference Leonardi, C., Albertini, A., Pianesi, F., Zancanaro, M., An exploratory study of a touch-based gestural interface for elderly. Proc. 6th Nord. Conf. Hum.-Comput. Interact. Extending Boundaries. ACM, New York, NY, USA, pp 845–850, 2010. Leonardi, C., Albertini, A., Pianesi, F., Zancanaro, M., An exploratory study of a touch-based gestural interface for elderly. Proc. 6th Nord. Conf. Hum.-Comput. Interact. Extending Boundaries. ACM, New York, NY, USA, pp 845–850, 2010.
112.
go back to reference Leitao, R., Silva, P. A., A study of novice older adults and gestural interaction on smartphones. 3rd Workshop Mob. Access. HCI13, 2013. Leitao, R., Silva, P. A., A study of novice older adults and gestural interaction on smartphones. 3rd Workshop Mob. Access. HCI13, 2013.
113.
go back to reference Nudelman, G., Android design patterns: interaction design solutions for developers. John Wiley & Sons, 2013. Nudelman, G., Android design patterns: interaction design solutions for developers. John Wiley & Sons, 2013.
116.
go back to reference Mendoza, A., Mobile user experience: patterns to make sense of it all. Morgan Kaufmann, 2013. Mendoza, A., Mobile user experience: patterns to make sense of it all. Morgan Kaufmann, 2013.
117.
go back to reference Zapata, B. C., Niñirola, A. H., Idri, A., et al., Mobile PHRs Compliance with Android and iOS Usability Guidelines. J. Med. Syst. 38:1–16, 2014.CrossRef Zapata, B. C., Niñirola, A. H., Idri, A., et al., Mobile PHRs Compliance with Android and iOS Usability Guidelines. J. Med. Syst. 38:1–16, 2014.CrossRef
118.
go back to reference Plaza, I., MartíN, L., Martin, S., and Medrano, C., Mobile Applications in an Aging Society: Status and Trends. J. Syst. Softw. 84:1977–1988, 2011.CrossRef Plaza, I., MartíN, L., Martin, S., and Medrano, C., Mobile Applications in an Aging Society: Status and Trends. J. Syst. Softw. 84:1977–1988, 2011.CrossRef
119.
go back to reference Kurniawan, S., Mobile Phone Design for Older Persons. Interactions 14:24–25, 2007.CrossRef Kurniawan, S., Mobile Phone Design for Older Persons. Interactions 14:24–25, 2007.CrossRef
120.
go back to reference Kalkov, I., Franke, D., Schommer, J. F., Kowalewski, S., A real-time extension to the android platform. Proc. 10th Int. Workshop Java Technol. Real-Time Embed. Syst. ACM, New York, NY, USA, pp 105–114, 2012. Kalkov, I., Franke, D., Schommer, J. F., Kowalewski, S., A real-time extension to the android platform. Proc. 10th Int. Workshop Java Technol. Real-Time Embed. Syst. ACM, New York, NY, USA, pp 105–114, 2012.
126.
go back to reference Sclafani, J., Tirrell, T. F., and Franko, O. I., Mobile Tablet Use among Academic Physicians and Trainees. J. Med. Syst. 37:1–6, 2013.CrossRef Sclafani, J., Tirrell, T. F., and Franko, O. I., Mobile Tablet Use among Academic Physicians and Trainees. J. Med. Syst. 37:1–6, 2013.CrossRef
127.
go back to reference Robinson, R. L., and Burk, M. S., Tablet Computer Use by Medical Students in the United States. J. Med. Syst. 37:1–4, 2013. Robinson, R. L., and Burk, M. S., Tablet Computer Use by Medical Students in the United States. J. Med. Syst. 37:1–4, 2013.
128.
go back to reference Cheung, A., Janssen, A., Amft, O., et al., Usability of digital media in patients with COPD: a pilot study. Int. J. Technol. Assess. Health Care 29:162–165, 2013.CrossRef Cheung, A., Janssen, A., Amft, O., et al., Usability of digital media in patients with COPD: a pilot study. Int. J. Technol. Assess. Health Care 29:162–165, 2013.CrossRef
129.
go back to reference Toval, A., Carrillo-de-Gea, J. M., Fernandez-Aleman, J. L., Toval, R., Learning systems development using reusable standard-based requirements catalogs. 2011 I.E. Glob. Eng. Educ. Conf. EDUCON. pp 907–912, 2011. Toval, A., Carrillo-de-Gea, J. M., Fernandez-Aleman, J. L., Toval, R., Learning systems development using reusable standard-based requirements catalogs. 2011 I.E. Glob. Eng. Educ. Conf. EDUCON. pp 907–912, 2011.
130.
go back to reference Sánchez-Henarejos, A., Fernández-Alemán, J. L., Toval, A., et al., Guía de buenas prácticas de seguridad informática en el tratamiento de datos de salud para el personal sanitario en atención primaria. Aten. Primaria 46:214–222, 2014.CrossRef Sánchez-Henarejos, A., Fernández-Alemán, J. L., Toval, A., et al., Guía de buenas prácticas de seguridad informática en el tratamiento de datos de salud para el personal sanitario en atención primaria. Aten. Primaria 46:214–222, 2014.CrossRef
131.
go back to reference Cos, J. A., Toval, A., Fernández-Alemán, J. L., et al., Internationalization requirements for e-learning audit purposes. 2012 I.E. Glob. Eng. Educ. Conf. EDUCON. pp 1–6, 2012. Cos, J. A., Toval, A., Fernández-Alemán, J. L., et al., Internationalization requirements for e-learning audit purposes. 2012 I.E. Glob. Eng. Educ. Conf. EDUCON. pp 1–6, 2012.
Metadata
Title
Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Authors
Belén Cruz Zapata
José Luis Fernández-Alemán
Ali Idri
Ambrosio Toval
Publication date
01-02-2015
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 2/2015
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-014-0182-2

Other articles of this Issue 2/2015

Journal of Medical Systems 2/2015 Go to the issue