Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Journal of Medical Systems
Published in: Journal of Medical Systems 4/2016

Open Access 01-04-2016 | Systems-Level Quality Improvement

Efficiency of Clinical Decision Support Systems Improves with Experience

Authors: Michiel C. Meulendijk, Marco R. Spruit, Floor Willeboordse, Mattijs E. Numans, Sjaak Brinkkemper, Wilma Knol, Paul A. F. Jansen, Marjan Askari

Published in: Journal of Medical Systems | Issue 4/2016

Login to get access

Abstract

Efficiency, or the resources spent while performing a specific task, is widely regarded as one the determinants of usability. In this study, the authors hypothesize that having a group of users perform a similar task over a prolonged period of time will lead to improvements in efficiency of that task. This study was performed in the domain of decision-supported medication reviews. Data was gathered during a randomized controlled trial. Three expert teams consisting of an independent physician and an independent pharmacist conducted 150 computerized medication reviews on patients in 13 general practices located in Amsterdam, the Netherlands. Results were analyzed with a linear mixed model. A fixed effects test on the linear mixed model showed a significant difference in the time required to conduct medication reviews over time; F(31.145) = 14.043, p < .001. The average time in minutes required to conduct medication reviews up to the first quartile was M = 20.42 (SD = 9.00), while the time from the third quartile up was M = 9.81 (SD = 6.13). This leads the authors to conclude that the amount of time users needed to perform similar tasks decreased significantly as they gained experience over time.
Literature
1.
International Organization for Standardization (ISO). ISO/IEC 25010:2011: Systems and software engineering -- Systems and software Quality Requirements and Evaluation (SQuaRE) -- System and software quality models. Standard.; 2011.
2.
Venkatesh, V., and Davis, F. D., A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 46(2):186–204, 2000.CrossRef
3.
Venkatesh, V., Morris, M. G., Davis, G. B., and Davis, F. D., User acceptance of information technology: Toward a unified view. MIS Q. 27(3):425–478, 2003.
4.
Mendoza, V., Novick, D.G., Usability over time. In: Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information. p. 151–158. 2005.
5.
Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.B., User experience over time. In: Modeling Users’ Experiences with Interactive Systems. p. 57–83. Berlin Heidelberg; Springer, 2013.
6.
Nielsen, J., Usability engineering. Elsevier, 1994.
7.
Davis, F., Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 13(3):319–340, 1989.CrossRef
8.
Meulendijk, M. C., Spruit, M. R., Drenth-van Maanen, A. C., Numans, M., Brinkkemper, S., and Jansen, P. A. F., General practitioners’ attitudes towards decision-supported prescribing: an analysis of the Dutch primary care sector. Health Informatics J. 19(4):247–263, 2013.CrossRefPubMed
9.
Meulendijk, M.C., Spruit, M.R., Drenth-van, Maanen, A.C., Numans, M.E., Brinkkemper, S., Jansen, P.A.F., et al. Computerized decision support improves m edication review effectiveness: An experiment evaluating the STRIP Assistant’s usability. Drugs Aging. 2015.
10.
Croll, J., The Impact of Usability on Clinician Acceptance of a Health Information System. PhD Thesis. Queensland University of Technology, Centre for Learning Innovation, Faculty of Education. 2009.
11.
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., et al., Effect of clinical decision-support systems: a systematic review. Ann. Intern. Med. 157(1):29–43, 2012.CrossRefPubMed
12.
Roshanov, P.S., Fernandes, N., Wilczynski, J.M., Hemens, B.J., You, J.J., Handler, S.M., et al. Features of effective computerised clinical decision support systems: Meta-regression of 162 randomised trials. Br. Med. J. 346, 2013
13.
Kesselheim, A. S., Cresswell, K., Phansalkar, S., Bates, D. W., and Sheikh, A., Clinical decision support systems could be modified to reduce ‘alert fatigue’ while still minimizing the risk of litigation. Health Aff. 30(12):2310–2317, 2011.CrossRef
14.
Van der Sijs, H., Drug safety alerting in computerized physician order entry: unraveling and counteracting alert fatigue. PhD Thesis. Erasmus MC: University Medical Center Rotterdam. 2009.
15.
Leendertse, A., Egberts, A., van den Bemt, P., and Stoker, L., Frequency of and Risk Factors for Preventable Medication-Related Hospital Admissions in the Netherlands. Arch. Intern. Med. 168(17):1890–1896, 2008.PubMed
16.
Mallet, L., Spinewine, A., and Huang, A., The challenge of managing drug interactions in elderly people. Lancet 370(9582):185–191, 2007.CrossRefPubMed
17.
Spinewine, A., Schmader, K. E., Barber, N., Hughes, C., Lapane, K. L., Swine, C., et al., Appropriate prescribing in elderly people: how well can it be measured and optimised? Lancet 370(9582):173–184, 2007.CrossRefPubMed
18.
Gallagher, P., Ryan, C., Byrne, S., Kennedy, J., and O’Mahony, D., STOPP (screening tool of older person’s prescriptions) and START (screening tool to alert doctors to right treatment). Consensus validation. Int. J. Clin. Pharmacol. Ther. 46(2):72–83, 2008.CrossRefPubMed
19.
Drenth-van Maanen, A. C., Van Marum, R. J., Knol, W., Van der Linden, C. M., and Jansen, P. A., Prescribing Optimization Method for Improving Prescribing in Elderly Patients Receiving Polypharmacy. Drugs Aging 26(8):1–15, 2009.CrossRef
20.
Willeboordse, F., Hugtenburg, J.G., van Dijk, L., Bosmans, J.E., de Vries, O.J., Schellevis, F.G., et al. Opti-Med: the effectiveness of optimised clinical medication reviews in older people with ‘geriatric giants’ in general practice; study protocol of a cluster randomised controlled trial. BMC Geriatr. 14(1), 2014.
21.
Dutch College of General Practitioners (‘Nederlands Huisartsengenootschap’ in Dutch). Multidisciplinary guideline Polypharmacy in elderly (‘Multidisciplinaire richtlijn Polyfarmacie bij ouderen’ in Dutch). Guideline. Utrecht, 2012.
22.
Meulendijk, M.C., Spruit, M.R., Jansen, P.A.F., Numans, M.E., Brinkkemper, S., STRIPA: A Rule-Based Decision Support System for Medication Reviews in Primary Care. In: ECIS 2015. 2015.
23.
O’Mahony, D., O’Sullivan, D., Byrne, S., O’Connor, M.N., Ryan, C., Gallagher, P., STOPP/START criteria for potentially inappropriate prescribing in older people: version 2. Age Ageing. 2014.
24.
25.
26.
Bucklin, R. E., and Sismeiro, C., Click here for Internet insight: Advances in clickstream data analysis in marketing. J. Interact. Mark. 23(1):35–48, 2009.CrossRef
27.
Pachidi, S., and Spruit, M., Weerd Ivd. Understanding Users’ Behavior with Software Operation Data Mining. Comput. Hum. Behav. 30:583–594, 2014.CrossRef
28.
Nilsson, E.G., Følstad, A., Effectiveness and efficiency as conflicting requirements in designing emergency mission reporting. I-UxSED. p. 20–25. 2012
Metadata
Title
Efficiency of Clinical Decision Support Systems Improves with Experience
Authors
Michiel C. Meulendijk
Marco R. Spruit
Floor Willeboordse
Mattijs E. Numans
Sjaak Brinkkemper
Wilma Knol
Paul A. F. Jansen
Marjan Askari
Publication date
01-04-2016
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 4/2016
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-015-0423-z

Other articles of this Issue 4/2016

Journal of Medical Systems 4/2016 Go to the issue

Systems-Level Quality Improvement

An Improved CAD System for Breast Cancer Diagnosis Based on Generalized Pseudo-Zernike Moment and Ada-DEWNN Classifier

Systems-Level Quality Improvement

A Prognosis Tool Based on Fuzzy Anthropometric and Questionnaire Data for Obstructive Sleep Apnea Severity

Patient Facing Systems

An Automatic 3-D Reconstruction of Coronary Arteries by Stereopsis

Patient Facing Systems

Connected-Health Algorithm: Development and Evaluation

Systems-Level Quality Improvement

Cloud Image Data Center for Healthcare Network in Taiwan

Patient Facing Systems

Detection of Shockable Ventricular Arrhythmia using Variational Mode Decomposition