Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Research article

Alerts for community pharmacist-provided medication therapy management: recommendations from a heuristic evaluation

Authors: Margie E. Snyder, Heather Jaynes, Stephanie A. Gernant, Julie DiIulio, Laura G. Militello, William R. Doucette, Omolola A. Adeoye, Alissa L. Russ

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

Medication therapy management (MTM) is a service, most commonly provided by pharmacists, intended to identify and resolve medication therapy problems (MTPs) to enhance patient care. MTM is typically documented by the community pharmacist in an MTM vendor’s web-based platform. These platforms often include integrated alerts to assist the pharmacist with assessing MTPs. In order to maximize the usability and usefulness of alerts to the end users (e.g., community pharmacists), MTM alert design should follow principles from human factors science. Therefore, the objectives of this study were to 1) evaluate the extent to which alerts for community pharmacist-delivered MTM align with established human factors principles, and 2) identify areas of opportunity and recommendations to improve MTM alert design.

Methods

Five categories of MTM alerts submitted by community pharmacists were evaluated: 1) indication, 2) effectiveness; 3) safety; 4) adherence; and 5) cost-containment. This heuristic evaluation was guided by the Instrument for Evaluating Human-Factors Principles in Medication-Related Decision Support Alerts (I-MeDeSA) which we adapted and contained 32 heuristics. For each MTM alert, four analysts’ individual ratings were summed and a mean score on the modified I-MeDeSA computed. For each heuristic, we also computed the percent of analyst ratings indicating alignment with the heuristic. We did this for all alerts evaluated to produce an “overall” summary of analysts’ ratings for a given heuristic, and we also computed this separately for each alert category. Our results focus on heuristics where ≤50% of analysts’ ratings indicated the alerts aligned with the heuristic.

Results

I-MeDeSA scores across the five alert categories were similar. Heuristics pertaining to visibility and color were generally met. Opportunities for improvement across all MTM alert categories pertained to the principles of alert prioritization; text-based information; alarm philosophy; and corrective actions.

Conclusions

MTM alerts have several opportunities for improvement related to human factors principles, resulting in MTM alert design recommendations. Enhancements to MTM alert design may increase the effectiveness of MTM delivery by community pharmacists and result in improved patient outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference McKibbon KA, Lokker C, Handler SM, Dolovich LR, Holbrook AM, O’Reilly D, Tamblyn R, Hemens BJ, Basu R, Troyan S, Roshanov PS, Archer NP, Raina P. Enabling Medication Management Through Health Information Technology. Rockville: Agency for Healthcare Research and Quality (AHRQ) AHRQ Publication No. 11-E008-EF; 2011. McKibbon KA, Lokker C, Handler SM, Dolovich LR, Holbrook AM, O’Reilly D, Tamblyn R, Hemens BJ, Basu R, Troyan S, Roshanov PS, Archer NP, Raina P. Enabling Medication Management Through Health Information Technology. Rockville: Agency for Healthcare Research and Quality (AHRQ) AHRQ Publication No. 11-E008-EF; 2011.
2.
go back to reference Bright TJ, Wong A, Dhurjati R, et al. Effect of clinician decision-support systems. A systematic review. Ann Intern Med. 2012;157:29–43.CrossRef Bright TJ, Wong A, Dhurjati R, et al. Effect of clinician decision-support systems. A systematic review. Ann Intern Med. 2012;157:29–43.CrossRef
3.
go back to reference Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety. Arch Intern Med. 2003;163:1409–16.CrossRef Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety. Arch Intern Med. 2003;163:1409–16.CrossRef
4.
go back to reference Curtain C, Peterson GM. Review of computerized clinical decision support in community pharmacy. J Clin Pharm Ther. 2014;39:343–8.CrossRef Curtain C, Peterson GM. Review of computerized clinical decision support in community pharmacy. J Clin Pharm Ther. 2014;39:343–8.CrossRef
5.
go back to reference Watkins K, Wood H, Schneider CR, Clifford R. Effectiveness of implementation strategies for clinical guidelines to community pharmacy: a systematic review. Implement Sci. 2015;10:151.CrossRef Watkins K, Wood H, Schneider CR, Clifford R. Effectiveness of implementation strategies for clinical guidelines to community pharmacy: a systematic review. Implement Sci. 2015;10:151.CrossRef
6.
go back to reference Miller L, Pater KS, Corman S. The role of clinical decision support in pharmacist response to drug-interaction alerts. Res Soc Adm Pharm. 2015;11:480–6.CrossRef Miller L, Pater KS, Corman S. The role of clinical decision support in pharmacist response to drug-interaction alerts. Res Soc Adm Pharm. 2015;11:480–6.CrossRef
7.
go back to reference Saverno KR, Hines LE, Warholak TL, et al. Ability of clinical decision-support software to alert users about clinically important drug-drug interactions. J Am Med Inform Assoc. 2011;18:32–7.CrossRef Saverno KR, Hines LE, Warholak TL, et al. Ability of clinical decision-support software to alert users about clinically important drug-drug interactions. J Am Med Inform Assoc. 2011;18:32–7.CrossRef
8.
go back to reference Field TS, Gilman BH, Subramanian S, Fuller JC, Bates DW, Gurwitz JH. The costs associated with adverse drug events among older adults in the ambulatory setting. Med Care. 2005;43(12):1171–6.CrossRef Field TS, Gilman BH, Subramanian S, Fuller JC, Bates DW, Gurwitz JH. The costs associated with adverse drug events among older adults in the ambulatory setting. Med Care. 2005;43(12):1171–6.CrossRef
9.
go back to reference Bluml BM. Definition of medication therapy management: development of professionwide consensus. J Am Pharm Assoc. 2005;45:566–72.CrossRef Bluml BM. Definition of medication therapy management: development of professionwide consensus. J Am Pharm Assoc. 2005;45:566–72.CrossRef
10.
go back to reference American Pharmacists Association; National Association of Chain Drug Stores Foundation. Medication therapy management in pharmacy practice: core elements of an MTM service model (version 2.0). J Am Pharm Assoc. 2008;48:341–53.CrossRef American Pharmacists Association; National Association of Chain Drug Stores Foundation. Medication therapy management in pharmacy practice: core elements of an MTM service model (version 2.0). J Am Pharm Assoc. 2008;48:341–53.CrossRef
11.
go back to reference Centers for Medicare and Medicaid Services (CMS) HHS. Medicare program; medicare prescription drug benefit, Final Rule. Federal Register. 2005;70:4193–585. Centers for Medicare and Medicaid Services (CMS) HHS. Medicare program; medicare prescription drug benefit, Final Rule. Federal Register. 2005;70:4193–585.
14.
go back to reference Viswanathan M, Lahwati LC, Golin CE, et al. Medication therapy management interventions in outpatient settings: a systematic review and meta-analysis. JAMA Intern Med. 2015;175:76–87.CrossRef Viswanathan M, Lahwati LC, Golin CE, et al. Medication therapy management interventions in outpatient settings: a systematic review and meta-analysis. JAMA Intern Med. 2015;175:76–87.CrossRef
15.
go back to reference Snyder ME, Jaynes HA, Gernant SA, Lantaff WM, Hudmon KS, Doucette WR. Variation in medication therapy management (MTM) delivery: implications for healthcare policy. J Manag Care Spec Pharm. 2018;24:896–902.PubMed Snyder ME, Jaynes HA, Gernant SA, Lantaff WM, Hudmon KS, Doucette WR. Variation in medication therapy management (MTM) delivery: implications for healthcare policy. J Manag Care Spec Pharm. 2018;24:896–902.PubMed
16.
go back to reference Russ AL, Fairbanks RJ, Karsh B, Militello LG, Saleem JJ, Wears RL. The science of human factors: separating facts from fiction. BMJ Qual Saf. 2013;22:802–8.CrossRef Russ AL, Fairbanks RJ, Karsh B, Militello LG, Saleem JJ, Wears RL. The science of human factors: separating facts from fiction. BMJ Qual Saf. 2013;22:802–8.CrossRef
17.
go back to reference Sheridan TB. Understanding human error and aiding human diagnostic behaviour in nuclear power plants. In: Human detection and diagnosis of system failures. Boston: Springer; 1981. p. 19–35.CrossRef Sheridan TB. Understanding human error and aiding human diagnostic behaviour in nuclear power plants. In: Human detection and diagnosis of system failures. Boston: Springer; 1981. p. 19–35.CrossRef
18.
go back to reference Wickens C, Colcombe A. Dual-task performance consequences of imperfect alerting associated with a cockpit display of traffic information. Hum Factors. 2007;49(5):839–50.CrossRef Wickens C, Colcombe A. Dual-task performance consequences of imperfect alerting associated with a cockpit display of traffic information. Hum Factors. 2007;49(5):839–50.CrossRef
19.
go back to reference McCarley JS, Wickens CD. Human factors implications of UAVs in the national airspace; 2005. McCarley JS, Wickens CD. Human factors implications of UAVs in the national airspace; 2005.
20.
go back to reference Wickens CD, et al. False alerts in air traffic control conflict alerting system: is there a “cry wolf” effect? Hum Factors. 2009;51(4):446–62.CrossRef Wickens CD, et al. False alerts in air traffic control conflict alerting system: is there a “cry wolf” effect? Hum Factors. 2009;51(4):446–62.CrossRef
21.
go back to reference Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, Bates DW. A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. JAMIA. 2010;17:493–501.PubMed Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, Bates DW. A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. JAMIA. 2010;17:493–501.PubMed
22.
go back to reference Holden RJ, Carayon P, Gurses AP, et al. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics. 2013;56:1669–86.CrossRef Holden RJ, Carayon P, Gurses AP, et al. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics. 2013;56:1669–86.CrossRef
23.
go back to reference Cipolle RJ, Strand LM, Morley PC. Pharmaceutical Care Practice. McGraw Hill: The Clinician’s Guide; 2004. Cipolle RJ, Strand LM, Morley PC. Pharmaceutical Care Practice. McGraw Hill: The Clinician’s Guide; 2004.
26.
go back to reference Savoy A, Patel H, Flanagan ME, Weiner M, Russ AL. Systematic heuristic evaluation of computerized consultation order templates: clinicians’ and human factors engineers’ perspectives. J Med Syst. 2017;41:129.CrossRef Savoy A, Patel H, Flanagan ME, Weiner M, Russ AL. Systematic heuristic evaluation of computerized consultation order templates: clinicians’ and human factors engineers’ perspectives. J Med Syst. 2017;41:129.CrossRef
27.
go back to reference Jaspers MWM. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform. 2009;78:340–53.CrossRef Jaspers MWM. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform. 2009;78:340–53.CrossRef
28.
go back to reference Thyvalikakath TP, Schleyer TKL, Monaco V. Heuristic evaluation of clinical functions in four practice management systems. J Am Dent Assoc. 2007;138:209–18.CrossRef Thyvalikakath TP, Schleyer TKL, Monaco V. Heuristic evaluation of clinical functions in four practice management systems. J Am Dent Assoc. 2007;138:209–18.CrossRef
29.
go back to reference Nielsen J, Molich R. Heuristic evaluation of user interfaces. Assoc Comput Mach. 1990:249–56. Nielsen J, Molich R. Heuristic evaluation of user interfaces. Assoc Comput Mach. 1990:249–56.
30.
go back to reference Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform. 2003;36:23–30.CrossRef Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform. 2003;36:23–30.CrossRef
31.
go back to reference Zachariah M, Phansalkar S, Seidling HM, Neri PM, Cresswell KM, Duke J, Bloomrosen M, Volk LA, Bates DW. Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems - I-MeDeSA. J Am Med Inform Assoc. 2011;18:62–72.CrossRef Zachariah M, Phansalkar S, Seidling HM, Neri PM, Cresswell KM, Duke J, Bloomrosen M, Volk LA, Bates DW. Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems - I-MeDeSA. J Am Med Inform Assoc. 2011;18:62–72.CrossRef
33.
go back to reference Wogalter MS. Handbook of warnings. Mahwah: Lawrence Erlbaum Associates; 2006.CrossRef Wogalter MS. Handbook of warnings. Mahwah: Lawrence Erlbaum Associates; 2006.CrossRef
35.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009 Apr;42(2):377–81.CrossRef Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009 Apr;42(2):377–81.CrossRef
37.
go back to reference Brender J, Talmon J, de Keizer N, et al. STARE-HI-statement on reporting of evaluation studies in health informatics: explanation and elaboration. Appl Clin Inf. 2013;4:331–58.CrossRef Brender J, Talmon J, de Keizer N, et al. STARE-HI-statement on reporting of evaluation studies in health informatics: explanation and elaboration. Appl Clin Inf. 2013;4:331–58.CrossRef
38.
go back to reference Bilici E, Despotou G, Arvanitis TN. The use of computer-interpretable clinical guidelines to manage care complexities of patients with multimorbid conditions: a review. Digital Health. 2018;4:1–21.CrossRef Bilici E, Despotou G, Arvanitis TN. The use of computer-interpretable clinical guidelines to manage care complexities of patients with multimorbid conditions: a review. Digital Health. 2018;4:1–21.CrossRef
39.
go back to reference Tolley CL, Slight SP, Husband AK, Watson N, Bates DW. Improving medication-related clinical decision support. Am J Health-Syst Pharm. 2018;75:239–46.CrossRef Tolley CL, Slight SP, Husband AK, Watson N, Bates DW. Improving medication-related clinical decision support. Am J Health-Syst Pharm. 2018;75:239–46.CrossRef
40.
go back to reference Brown CL, Mulcaster HL, Triffitt KL. A systematic review of the types and causes of prescribing errors generated from using computerized provider order entry systems in primary and secondary care. J Am Med Inform Assoc. 2017;24:432–40.PubMed Brown CL, Mulcaster HL, Triffitt KL. A systematic review of the types and causes of prescribing errors generated from using computerized provider order entry systems in primary and secondary care. J Am Med Inform Assoc. 2017;24:432–40.PubMed
41.
go back to reference Chau S, Jansen APD, van de Ven PM, et al. Clinical medication reviews in elderly patients with polypharmacy: a cross-sectional study on drug-related problems in the Netherlands. Int J Clin Pharm. 2016;38(1):46–53.CrossRef Chau S, Jansen APD, van de Ven PM, et al. Clinical medication reviews in elderly patients with polypharmacy: a cross-sectional study on drug-related problems in the Netherlands. Int J Clin Pharm. 2016;38(1):46–53.CrossRef
43.
go back to reference Russ AL, Saleem JJ, McManus MS, Zillich AJ, Doebbeling BN. “Computerized Medication Alerts and Prescriber Mental Models: Observing Routine Patient Care”, Proceedings of the Human Factors and Ergonomics Society, 53rd Annual Meeting, San Antonio, TX, [CD-ROM] 655–659, Oct 2009. Russ AL, Saleem JJ, McManus MS, Zillich AJ, Doebbeling BN. “Computerized Medication Alerts and Prescriber Mental Models: Observing Routine Patient Care”, Proceedings of the Human Factors and Ergonomics Society, 53rd Annual Meeting, San Antonio, TX, [CD-ROM] 655–659, Oct 2009.
45.
go back to reference Marcilly R, Ammenwerth E, Vasseur F, Roehrer E, Beuscart-Zéphir MC. Usability flaws of medication-related alerting functions: a systematic qualitative review. J Biomed Inform. 2015:260–71.CrossRef Marcilly R, Ammenwerth E, Vasseur F, Roehrer E, Beuscart-Zéphir MC. Usability flaws of medication-related alerting functions: a systematic qualitative review. J Biomed Inform. 2015:260–71.CrossRef
46.
go back to reference Van de Velde S, Heselmans A, Delvaux N, et al. A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implement Sci. 2018;13:114.CrossRef Van de Velde S, Heselmans A, Delvaux N, et al. A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implement Sci. 2018;13:114.CrossRef
47.
go back to reference RTI International. Report on the safe use of pick lists in ambulatory care settings. Prepared for the Office of the National Coordinator for Health Information Technology under contract number HHSP23320095651WC_HHSP233337047T. September 2016. RTI International. Report on the safe use of pick lists in ambulatory care settings. Prepared for the Office of the National Coordinator for Health Information Technology under contract number HHSP23320095651WC_HHSP233337047T. September 2016.
48.
go back to reference Guo J, Iribarren S, Kapsandoy S, Perri S, Staggers N. Usability evaluation of an electronic medication administration record (eMAR) application. Appl Cin Inf. 2011;2:202–24.CrossRef Guo J, Iribarren S, Kapsandoy S, Perri S, Staggers N. Usability evaluation of an electronic medication administration record (eMAR) application. Appl Cin Inf. 2011;2:202–24.CrossRef
49.
go back to reference Pelayo S, Marcilly R, Bernonville S, Leroy N, Beuscart-Zephir MC. Human factors based recommendations for the design of medication related clinical decision support systems (CDSS). User Centred Networked Health Care. 2011:412–6. Pelayo S, Marcilly R, Bernonville S, Leroy N, Beuscart-Zephir MC. Human factors based recommendations for the design of medication related clinical decision support systems (CDSS). User Centred Networked Health Care. 2011:412–6.
50.
go back to reference Russ AL, Zillich AJ, Melton BL, et al. Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation. J Am Med Inform Assoc. 2014;21(e2):e287–96.CrossRef Russ AL, Zillich AJ, Melton BL, et al. Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation. J Am Med Inform Assoc. 2014;21(e2):e287–96.CrossRef
Metadata
Title
Alerts for community pharmacist-provided medication therapy management: recommendations from a heuristic evaluation
Authors
Margie E. Snyder
Heather Jaynes
Stephanie A. Gernant
Julie DiIulio
Laura G. Militello
William R. Doucette
Omolola A. Adeoye
Alissa L. Russ
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0866-0

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue