Skip to main content
Top
Published in: Journal of Medical Systems 4/2014

01-04-2014 | Systems-Level Quality Improvement

Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System

Authors: Ehsan Nabovati, Hasan Vakili-Arki, Saeid Eslami, Reza Khajouei

Published in: Journal of Medical Systems | Issue 4/2014

Login to get access

Abstract

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen’s heuristics to identify and classify usability problems and Nielsen’s severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, “consistency and standards” was violated most frequently. Moreover, mean severity of problems concerning “error prevention” and “help and documentation” heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.
Literature
1.
go back to reference Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., To err is human: building a safer health system. Institute of Medicine, Washington, 2000. Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., To err is human: building a safer health system. Institute of Medicine, Washington, 2000.
2.
go back to reference Kaushal, R., Shojania, K. G., and Bates, D. W., Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 163(12):1409–1416, 2003.CrossRef Kaushal, R., Shojania, K. G., and Bates, D. W., Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 163(12):1409–1416, 2003.CrossRef
3.
go back to reference Khajouei, R., and Jaspers, M. W., The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1):3–19, 2010. Khajouei, R., and Jaspers, M. W., The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1):3–19, 2010.
4.
go back to reference Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., and Strom, B. L., Role of computerized physician order entry systems in facilitating medication errors. J. Am. Med. Assoc. 293(10):1197–1203, 2005.CrossRef Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., and Strom, B. L., Role of computerized physician order entry systems in facilitating medication errors. J. Am. Med. Assoc. 293(10):1197–1203, 2005.CrossRef
5.
go back to reference Shu, K., Boyle, D., Spurr, C., Horsky, J., Heiman, H., O’Connor, P., Lepore, J., and Bates, D. W., Comparison of time spent writing orders on paper with computerized physician order entry. Stud. Health. Technol. Inform. 84(Pt 2):1207–1211, 2001. Shu, K., Boyle, D., Spurr, C., Horsky, J., Heiman, H., O’Connor, P., Lepore, J., and Bates, D. W., Comparison of time spent writing orders on paper with computerized physician order entry. Stud. Health. Technol. Inform. 84(Pt 2):1207–1211, 2001.
6.
go back to reference Tierney, W. M., Miller, M. E., Overhage, J. M., and McDonald, C. J., Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. J. Am. Med. Assoc. 269(3):379–383, 1993.CrossRef Tierney, W. M., Miller, M. E., Overhage, J. M., and McDonald, C. J., Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. J. Am. Med. Assoc. 269(3):379–383, 1993.CrossRef
7.
go back to reference Horsky J, Kaufman DR, Patel VL (2003) The cognitive complexity of a provider order entry interface. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium:294–298 Horsky J, Kaufman DR, Patel VL (2003) The cognitive complexity of a provider order entry interface. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium:294–298
8.
go back to reference Khajouei, R., Peek, N., Wierenga, P. C., Kersten, M. J., and Jaspers, M. W., Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int. J. Med. Inform. 79(10):690–698, 2010.CrossRef Khajouei, R., Peek, N., Wierenga, P. C., Kersten, M. J., and Jaspers, M. W., Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int. J. Med. Inform. 79(10):690–698, 2010.CrossRef
9.
go back to reference Kushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., and Kannry, J. L., Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int. J. Med. Inform. 74(7–8):519–526, 2005.CrossRef Kushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., and Kannry, J. L., Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int. J. Med. Inform. 74(7–8):519–526, 2005.CrossRef
10.
go back to reference Thyvalikakath, T. P., Monaco, V., Thambuganipalle, H. B., and Schleyer, T., A usability evaluation of four commercial dental computer-based patient record systems. J. Am. Dent. Assoc. 139(12):1632–1642, 2008.CrossRef Thyvalikakath, T. P., Monaco, V., Thambuganipalle, H. B., and Schleyer, T., A usability evaluation of four commercial dental computer-based patient record systems. J. Am. Dent. Assoc. 139(12):1632–1642, 2008.CrossRef
11.
go back to reference Part 11 : Guidance on usability (ISO 9242–11) (1998). In: Ergonomic requirements for office work with visual display terminals (VDTs). Part 11 : Guidance on usability (ISO 9242–11) (1998). In: Ergonomic requirements for office work with visual display terminals (VDTs).
12.
go back to reference Shah, S. G., and Robinson, I., Benefits of and barriers to involving users in medical device technology development and evaluation. Int. J. Technol. Assess. Health Care 23(1):131–137, 2007.CrossRef Shah, S. G., and Robinson, I., Benefits of and barriers to involving users in medical device technology development and evaluation. Int. J. Technol. Assess. Health Care 23(1):131–137, 2007.CrossRef
13.
go back to reference Jaspers, M. W., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78(5):340–353, 2009.CrossRef Jaspers, M. W., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78(5):340–353, 2009.CrossRef
14.
go back to reference Yui, B. H., Jim, W. T., Chen, M., Hsu, J. M., Liu, C. Y., and Lee, T. T., Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan. J. Med. Syst. 36(6):3817–3824, 2012.CrossRef Yui, B. H., Jim, W. T., Chen, M., Hsu, J. M., Liu, C. Y., and Lee, T. T., Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan. J. Med. Syst. 36(6):3817–3824, 2012.CrossRef
15.
go back to reference Karahoca, A., Bayraktar, E., Tatoglu, E., and Karahoca, D., Information system design for a hospital emergency department: a usability analysis of software prototypes. J. Biomed. Inform. 43(2):224–232, 2010.CrossRef Karahoca, A., Bayraktar, E., Tatoglu, E., and Karahoca, D., Information system design for a hospital emergency department: a usability analysis of software prototypes. J. Biomed. Inform. 43(2):224–232, 2010.CrossRef
16.
go back to reference Thyvalikakath, T. P., Schleyer, T. K., and Monaco, V., Heuristic evaluation of clinical functions in four practice management systems: a pilot study. J. Am. Dent. Assoc. 138(2):209–210, 2007. 212–208.CrossRef Thyvalikakath, T. P., Schleyer, T. K., and Monaco, V., Heuristic evaluation of clinical functions in four practice management systems: a pilot study. J. Am. Dent. Assoc. 138(2):209–210, 2007. 212–208.CrossRef
17.
go back to reference Joshi, A., Arora, M., Dai, L., Price, K., Vizer, L., and Sears, A., Usability of a patient education and motivation tool using heuristic evaluation. J. Med. Internet Res. 11(4):e47, 2009.CrossRef Joshi, A., Arora, M., Dai, L., Price, K., Vizer, L., and Sears, A., Usability of a patient education and motivation tool using heuristic evaluation. J. Med. Internet Res. 11(4):e47, 2009.CrossRef
18.
go back to reference Peute, L. W., and Jaspers, M. M., Usability evaluation of a laboratory order entry system: cognitive walkthrough and think aloud combined. Stud. Health. Technol. Inform. 116:599–604, 2005. Peute, L. W., and Jaspers, M. M., Usability evaluation of a laboratory order entry system: cognitive walkthrough and think aloud combined. Stud. Health. Technol. Inform. 116:599–604, 2005.
19.
go back to reference Safdari, R., Dargahi, H., Shahmoradi, L., and Farzaneh Nejad, A., Comparing four softwares based on ISO 9241 part 10. J. Med. Syst. 36(5):2787–2793, 2012.CrossRef Safdari, R., Dargahi, H., Shahmoradi, L., and Farzaneh Nejad, A., Comparing four softwares based on ISO 9241 part 10. J. Med. Syst. 36(5):2787–2793, 2012.CrossRef
20.
go back to reference Nielsen, J., Usability inspection methods. Wiley, New York, 1994. Nielsen, J., Usability inspection methods. Wiley, New York, 1994.
21.
go back to reference Nielsen, J., Usability engineering, 1st edition. Morgan Kaufmann, San Francisco, 1993.MATH Nielsen, J., Usability engineering, 1st edition. Morgan Kaufmann, San Francisco, 1993.MATH
22.
go back to reference Choi, J., and Bakken, S., Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inform. 79(8):565–575, 2010.CrossRef Choi, J., and Bakken, S., Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inform. 79(8):565–575, 2010.CrossRef
23.
go back to reference Edwards, P. J., Moloney, K. P., Jacko, J. A., and Sainfort, F., Evaluating usability of a commercial electronic health record: A case study. Int. J. Hum. Comput. Stud. 66(10):718–728, 2008.CrossRef Edwards, P. J., Moloney, K. P., Jacko, J. A., and Sainfort, F., Evaluating usability of a commercial electronic health record: A case study. Int. J. Hum. Comput. Stud. 66(10):718–728, 2008.CrossRef
24.
go back to reference Pressler, T. R., Yen, P. Y., Ding, J., Liu, J., Embi, P. J., and Payne, P. R., Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools. BMC Med. Inform. Decis. Mak. 12:47, 2012.CrossRef Pressler, T. R., Yen, P. Y., Ding, J., Liu, J., Embi, P. J., and Payne, P. R., Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools. BMC Med. Inform. Decis. Mak. 12:47, 2012.CrossRef
25.
go back to reference Su, K. W., and Liu, C. L., A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J. Med. Syst. 36(3):1139–1153, 2012.CrossRef Su, K. W., and Liu, C. L., A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J. Med. Syst. 36(3):1139–1153, 2012.CrossRef
26.
go back to reference Nielsen J, Landauer TK A mathematical model of the finding of usability problems. In: Proceedings ACM/IFIP INTERCHI’93 Conference, Amsterdam, The Netherlands, April 24–29 1993. pp 206–213. Nielsen J, Landauer TK A mathematical model of the finding of usability problems. In: Proceedings ACM/IFIP INTERCHI’93 Conference, Amsterdam, The Netherlands, April 24–29 1993. pp 206–213.
Metadata
Title
Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System
Authors
Ehsan Nabovati
Hasan Vakili-Arki
Saeid Eslami
Reza Khajouei
Publication date
01-04-2014
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 4/2014
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-014-0035-z

Other articles of this Issue 4/2014

Journal of Medical Systems 4/2014 Go to the issue