Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Research article

On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop

Authors: Jamie J Coleman, Heleen van der Sijs, Walter E Haefeli, Sarah P Slight, Sarah E McDowell, Hanna M Seidling, Birgit Eiermann, Jos Aarts, Elske Ammenwerth, Robin E Ferner, Ann Slee

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

Clinical decision support (CDS) for electronic prescribing systems (computerized physician order entry) should help prescribers in the safe and rational use of medicines. However, the best ways to alert users to unsafe or irrational prescribing are uncertain. Specifically, CDS systems may generate too many alerts, producing unwelcome distractions for prescribers, or too few alerts running the risk of overlooking possible harms. Obtaining the right balance of alerting to adequately improve patient safety should be a priority.

Methods

A workshop funded through the European Regional Development Fund was convened by the University Hospitals Birmingham NHS Foundation Trust to assess current knowledge on alerts in CDS and to reach a consensus on a future research agenda on this topic. Leading European researchers in CDS and alerts in electronic prescribing systems were invited to the workshop.

Results

We identified important knowledge gaps and suggest research priorities including (1) the need to determine the optimal sensitivity and specificity of alerts; (2) whether adaptation to the environment or characteristics of the user may improve alerts; and (3) whether modifying the timing and number of alerts will lead to improvements. We have also discussed the challenges and benefits of using naturalistic or experimental studies in the evaluation of alerts and suggested appropriate outcome measures.

Conclusions

We have identified critical problems in CDS, which should help to guide priorities in research to evaluate alerts. It is hoped that this will spark the next generation of novel research from which practical steps can be taken to implement changes to CDS systems that will ultimately reduce alert fatigue and improve the design of future systems.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U: The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. J Am Med Inform Assoc. 2008, 15 (5): 585-600. 10.1197/jamia.M2667.CrossRefPubMedPubMedCentral Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U: The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. J Am Med Inform Assoc. 2008, 15 (5): 585-600. 10.1197/jamia.M2667.CrossRefPubMedPubMedCentral
2.
go back to reference Hug BL, Witkowski DJ, Sox CM, Keohane CA, Seger DL, Yoon C, Matheny ME, Bates DW: Adverse drug event rates in six community hospitals and the potential impact of computerized physician order entry for prevention. J Gen Intern Med. 2010, 25 (1): 31-38. 10.1007/s11606-009-1141-3.CrossRefPubMed Hug BL, Witkowski DJ, Sox CM, Keohane CA, Seger DL, Yoon C, Matheny ME, Bates DW: Adverse drug event rates in six community hospitals and the potential impact of computerized physician order entry for prevention. J Gen Intern Med. 2010, 25 (1): 31-38. 10.1007/s11606-009-1141-3.CrossRefPubMed
3.
go back to reference Reckmann MH, Westbrook JI, Koh Y, Lo C, Day RO: Does computerized provider order entry reduce prescribing errors for hospital inpatients? A systematic review. J Am Med Inform Assoc. 2009, 16 (5): 613-623. 10.1197/jamia.M3050.CrossRefPubMedPubMedCentral Reckmann MH, Westbrook JI, Koh Y, Lo C, Day RO: Does computerized provider order entry reduce prescribing errors for hospital inpatients? A systematic review. J Am Med Inform Assoc. 2009, 16 (5): 613-623. 10.1197/jamia.M3050.CrossRefPubMedPubMedCentral
4.
go back to reference Shamliyan TA, Duval S, Du J, Kane RL: Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors. Health Serv Res. 2008, 43 (1 Pt 1): 32-53.PubMedPubMedCentral Shamliyan TA, Duval S, Du J, Kane RL: Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors. Health Serv Res. 2008, 43 (1 Pt 1): 32-53.PubMedPubMedCentral
5.
go back to reference van Doormaal JE, van den Bemt PM, Zaal RJ, Egberts AC, Lenderink BW, Kosterink JG, Haaijer-Ruskamp FM, Mol PG: The influence that electronic prescribing has on medication errors and preventable adverse drug events: an interrupted time-series study. J Am Med Inform Assoc. 2009, 16 (6): 816-825. 10.1197/jamia.M3099.CrossRefPubMedPubMedCentral van Doormaal JE, van den Bemt PM, Zaal RJ, Egberts AC, Lenderink BW, Kosterink JG, Haaijer-Ruskamp FM, Mol PG: The influence that electronic prescribing has on medication errors and preventable adverse drug events: an interrupted time-series study. J Am Med Inform Assoc. 2009, 16 (6): 816-825. 10.1197/jamia.M3099.CrossRefPubMedPubMedCentral
6.
go back to reference Wolfstadt JI, Gurwitz JH, Field TS, Lee M, Kalkar S, Wu W, Rochon PA: The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review. J Gen Intern Med. 2008, 23 (4): 451-458. 10.1007/s11606-008-0504-5.CrossRefPubMedPubMedCentral Wolfstadt JI, Gurwitz JH, Field TS, Lee M, Kalkar S, Wu W, Rochon PA: The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review. J Gen Intern Med. 2008, 23 (4): 451-458. 10.1007/s11606-008-0504-5.CrossRefPubMedPubMedCentral
7.
go back to reference Mulherin DP, Zimmerman CR, Chaffee BW: National standards for computerized prescriber order entry and clinical decision support: the case of drug interactions. Am J Health Syst Pharm. 2013, 70 (1): 59-64. 10.2146/ajhp120217.CrossRefPubMed Mulherin DP, Zimmerman CR, Chaffee BW: National standards for computerized prescriber order entry and clinical decision support: the case of drug interactions. Am J Health Syst Pharm. 2013, 70 (1): 59-64. 10.2146/ajhp120217.CrossRefPubMed
8.
go back to reference Eiermann B, Bastholm Rahmner P, Korkmaz S, Landberg C, Lilja B, Shemeikka T, Veg A, Wettermark B, Gustafsson LL: Knowledge Bases for Clinical Decision Support in Drug Prescribing – Development, Quality Assurance, Management, Integration, Implementation and Evaluation of Clinical Value. Decision Support Systems. Edited by: Jao CS. 2010, Crotia: InTech Eiermann B, Bastholm Rahmner P, Korkmaz S, Landberg C, Lilja B, Shemeikka T, Veg A, Wettermark B, Gustafsson LL: Knowledge Bases for Clinical Decision Support in Drug Prescribing – Development, Quality Assurance, Management, Integration, Implementation and Evaluation of Clinical Value. Decision Support Systems. Edited by: Jao CS. 2010, Crotia: InTech
9.
go back to reference Böttiger Y, Laine K, Andersson ML, Korhonen T, Molin B, Ovesjö ML, Tirkkonen T, Rane A, Gustafsson LL, Eiermann B: SFINX-a drug-drug interaction database designed for clinical decision support systems. Eur J Clin Pharmacol. 2009, 65 (6): 627-633. 10.1007/s00228-008-0612-5.CrossRefPubMed Böttiger Y, Laine K, Andersson ML, Korhonen T, Molin B, Ovesjö ML, Tirkkonen T, Rane A, Gustafsson LL, Eiermann B: SFINX-a drug-drug interaction database designed for clinical decision support systems. Eur J Clin Pharmacol. 2009, 65 (6): 627-633. 10.1007/s00228-008-0612-5.CrossRefPubMed
10.
go back to reference Quinzler R, Schmitt SP, Pritsch M, Kaltschmidt J, Haefeli WE: Substantial reduction of inappropriate tablet splitting with computerised decision support: a prospective intervention study assessing potential benefit and harm. BMC Med Inform Decis Mak. 2009, 9: 30-10.1186/1472-6947-9-30.CrossRefPubMedPubMedCentral Quinzler R, Schmitt SP, Pritsch M, Kaltschmidt J, Haefeli WE: Substantial reduction of inappropriate tablet splitting with computerised decision support: a prospective intervention study assessing potential benefit and harm. BMC Med Inform Decis Mak. 2009, 9: 30-10.1186/1472-6947-9-30.CrossRefPubMedPubMedCentral
11.
go back to reference Ko Y, Abarca J, Malone DC, Dare DC, Geraets D, Houranieh A, Jones WN, Nichol WP, Schepers GP, Wilhardt M: Practitioners' views on computerized drug-drug interaction alerts in the VA system. J Am Med Inform Assoc. 2007, 14 (1): 56-64.CrossRefPubMedPubMedCentral Ko Y, Abarca J, Malone DC, Dare DC, Geraets D, Houranieh A, Jones WN, Nichol WP, Schepers GP, Wilhardt M: Practitioners' views on computerized drug-drug interaction alerts in the VA system. J Am Med Inform Assoc. 2007, 14 (1): 56-64.CrossRefPubMedPubMedCentral
12.
go back to reference Ammenwerth E, Jung M: Expectations and barriers versus cxCDSS-CPOE: a European user survey. Proceedings of the PSIP International Workshop, Sofia, Bulgaria, 23 June 2011. Edited by: Beuscart R, Tcharaktchiev D, Angelova G. 2011, Shoumen: Incoma, 49-52. Ammenwerth E, Jung M: Expectations and barriers versus cxCDSS-CPOE: a European user survey. Proceedings of the PSIP International Workshop, Sofia, Bulgaria, 23 June 2011. Edited by: Beuscart R, Tcharaktchiev D, Angelova G. 2011, Shoumen: Incoma, 49-52.
13.
go back to reference Lapane KL, Waring ME, Schneider KL, Dubé C, Quilliam BJ: A mixed method study of the merits of e-prescribing drug alerts in primary care. J Gen Intern Med. 2008, 23 (4): 442-446. 10.1007/s11606-008-0505-4.CrossRefPubMedPubMedCentral Lapane KL, Waring ME, Schneider KL, Dubé C, Quilliam BJ: A mixed method study of the merits of e-prescribing drug alerts in primary care. J Gen Intern Med. 2008, 23 (4): 442-446. 10.1007/s11606-008-0505-4.CrossRefPubMedPubMedCentral
14.
go back to reference Weingart SN, Simchowitz B, Shiman L, Brouillard D, Cyrulik A, Davis RB, Isaac T, Massagli M, Morway L, Sands DZ, et al: Clinicians' assessments of electronic medication safety alerts in ambulatory care. Arch Intern Med. 2009, 169 (17): 1627-1632.CrossRefPubMed Weingart SN, Simchowitz B, Shiman L, Brouillard D, Cyrulik A, Davis RB, Isaac T, Massagli M, Morway L, Sands DZ, et al: Clinicians' assessments of electronic medication safety alerts in ambulatory care. Arch Intern Med. 2009, 169 (17): 1627-1632.CrossRefPubMed
15.
go back to reference van der Sijs H, Aarts J, Vulto A, Berg M: Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006, 13 (2): 138-147. 10.1197/jamia.M1809.CrossRefPubMedPubMedCentral van der Sijs H, Aarts J, Vulto A, Berg M: Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006, 13 (2): 138-147. 10.1197/jamia.M1809.CrossRefPubMedPubMedCentral
16.
go back to reference Osheroff JA: Improving Medication Use and Outcomes with Clinical Decision Support: A Step-by-Step Guide. 2009, Chicago, IL: Health Information and Management Systems Society Osheroff JA: Improving Medication Use and Outcomes with Clinical Decision Support: A Step-by-Step Guide. 2009, Chicago, IL: Health Information and Management Systems Society
17.
go back to reference Riedmann D, Jung M, Hackl WO, Stühlinger W, van der Sijs H, Ammenwerth E: Development of a context model to prioritize drug safety alerts in CPOE systems. BMC Med Inform Decis Mak. 2011, 11: 35-10.1186/1472-6947-11-35.CrossRefPubMedPubMedCentral Riedmann D, Jung M, Hackl WO, Stühlinger W, van der Sijs H, Ammenwerth E: Development of a context model to prioritize drug safety alerts in CPOE systems. BMC Med Inform Decis Mak. 2011, 11: 35-10.1186/1472-6947-11-35.CrossRefPubMedPubMedCentral
18.
go back to reference Seidling HM, Schmitt SP, Bruckner T, Kaltschmidt J, Pruszydlo MG, Senger C, Bertsche T, Walter-Sack I, Haefeli WE: Patient-specific electronic decision support reduces prescription of excessive doses. Qual Saf Health Care. 2010, 19 (5): e15-10.1136/qshc.2009.033175.PubMed Seidling HM, Schmitt SP, Bruckner T, Kaltschmidt J, Pruszydlo MG, Senger C, Bertsche T, Walter-Sack I, Haefeli WE: Patient-specific electronic decision support reduces prescription of excessive doses. Qual Saf Health Care. 2010, 19 (5): e15-10.1136/qshc.2009.033175.PubMed
19.
go back to reference Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS: Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003, 163 (21): 2625-2631. 10.1001/archinte.163.21.2625.CrossRefPubMed Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS: Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003, 163 (21): 2625-2631. 10.1001/archinte.163.21.2625.CrossRefPubMed
20.
go back to reference Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K: The unintended consequences of computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform. 2009, 78 (Suppl 1): S69-S76.CrossRefPubMed Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K: The unintended consequences of computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform. 2009, 78 (Suppl 1): S69-S76.CrossRefPubMed
21.
go back to reference Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH: The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2007, 14 (4): 415-423. 10.1197/jamia.M2373.CrossRefPubMedPubMedCentral Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH: The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2007, 14 (4): 415-423. 10.1197/jamia.M2373.CrossRefPubMedPubMedCentral
22.
go back to reference Isaac T, Weissman JS, Davis RB, Massagli M, Cyrulik A, Sands DZ, Weingart SN: Overrides of medication alerts in ambulatory care. Arch Intern Med. 2009, 169 (3): 305-311. 10.1001/archinternmed.2008.551.CrossRefPubMed Isaac T, Weissman JS, Davis RB, Massagli M, Cyrulik A, Sands DZ, Weingart SN: Overrides of medication alerts in ambulatory care. Arch Intern Med. 2009, 169 (3): 305-311. 10.1001/archinternmed.2008.551.CrossRefPubMed
23.
go back to reference van der Sijs H: Drug Safety Alerting in Computerized Physician Order Entry - Unraveling and Counteracting Alert Fatigue. 2009, Rotterdam: Erasmus University van der Sijs H: Drug Safety Alerting in Computerized Physician Order Entry - Unraveling and Counteracting Alert Fatigue. 2009, Rotterdam: Erasmus University
24.
go back to reference Getty DJ, Swets JA, Pickett RM, Gonthier D: System operator response to warnings of danger: a laboratory investigation of the effects of the predictive value of a warning on human response time. J Exp Psychol Appl. 1995, 1 (1): 19-33.CrossRef Getty DJ, Swets JA, Pickett RM, Gonthier D: System operator response to warnings of danger: a laboratory investigation of the effects of the predictive value of a warning on human response time. J Exp Psychol Appl. 1995, 1 (1): 19-33.CrossRef
25.
go back to reference Del Beccaro M, Villanueva R, Knudson K, Harvey E, Langle J, Paul W: Decision Support Alerts for Medication Ordering in a Computerized Provider Order Entry (CPOE) System: a systematic approach to decrease alerts. Appl Clin Inform. 2010, 1: 346-362. 10.4338/ACI-2009-11-RA-0014.CrossRef Del Beccaro M, Villanueva R, Knudson K, Harvey E, Langle J, Paul W: Decision Support Alerts for Medication Ordering in a Computerized Provider Order Entry (CPOE) System: a systematic approach to decrease alerts. Appl Clin Inform. 2010, 1: 346-362. 10.4338/ACI-2009-11-RA-0014.CrossRef
26.
go back to reference Resetar E, Reichley RM, Noirot LA, Doherty JA, Dunagan WC, Bailey TC: Strategies for reducing nuisance alerts in a dose checking application. AMIA Annu Symp Proc. 2005, 624-628. Resetar E, Reichley RM, Noirot LA, Doherty JA, Dunagan WC, Bailey TC: Strategies for reducing nuisance alerts in a dose checking application. AMIA Annu Symp Proc. 2005, 624-628.
27.
go back to reference Resetar E, Reichley RM, Noirot LA, Dunagan WC, Bailey TC: Implementing daily dosing rules using a commercial rule base. AMIA Annu Symp Proc. 2006, 1073- Resetar E, Reichley RM, Noirot LA, Dunagan WC, Bailey TC: Implementing daily dosing rules using a commercial rule base. AMIA Annu Symp Proc. 2006, 1073-
28.
go back to reference Reichley RM, Seaton TL, Resetar E, Micek ST, Scott KL, Fraser VJ, Dunagan WC, Bailey TC: Implementing a commercial rule base as a medication order safety net. J Am Med Inform Assoc. 2005, 12 (4): 383-389. 10.1197/jamia.M1783.CrossRefPubMedPubMedCentral Reichley RM, Seaton TL, Resetar E, Micek ST, Scott KL, Fraser VJ, Dunagan WC, Bailey TC: Implementing a commercial rule base as a medication order safety net. J Am Med Inform Assoc. 2005, 12 (4): 383-389. 10.1197/jamia.M1783.CrossRefPubMedPubMedCentral
29.
go back to reference Paterno MD, Maviglia SM, Gorman PN, Seger DL, Yoshida E, Seger AC, Bates DW, Gandhi TK: Tiering drug-drug interaction alerts by severity increases compliance rates. J Am Med Inform Assoc. 2009, 16 (1): 40-46. 10.1197/jamia.M2808.CrossRefPubMedPubMedCentral Paterno MD, Maviglia SM, Gorman PN, Seger DL, Yoshida E, Seger AC, Bates DW, Gandhi TK: Tiering drug-drug interaction alerts by severity increases compliance rates. J Am Med Inform Assoc. 2009, 16 (1): 40-46. 10.1197/jamia.M2808.CrossRefPubMedPubMedCentral
30.
go back to reference Anton C, Nightingale PG, Adu D, Lipkin G, Ferner RE: Improving prescribing using a rule based prescribing system. Qual Saf Health Care. 2004, 13 (3): 186-190. 10.1136/qshc.2003.006882.CrossRefPubMedPubMedCentral Anton C, Nightingale PG, Adu D, Lipkin G, Ferner RE: Improving prescribing using a rule based prescribing system. Qual Saf Health Care. 2004, 13 (3): 186-190. 10.1136/qshc.2003.006882.CrossRefPubMedPubMedCentral
31.
go back to reference van der Sijs H, Lammers L, van den Tweel A, Aarts J, Berg M, Vulto A, van Gelder T: Time-dependent drug-drug interaction alerts in care provider order entry: software may inhibit medication error reductions. J Am Med Inform Assoc. 2009, 16 (6): 864-868. 10.1197/jamia.M2810.CrossRefPubMedPubMedCentral van der Sijs H, Lammers L, van den Tweel A, Aarts J, Berg M, Vulto A, van Gelder T: Time-dependent drug-drug interaction alerts in care provider order entry: software may inhibit medication error reductions. J Am Med Inform Assoc. 2009, 16 (6): 864-868. 10.1197/jamia.M2810.CrossRefPubMedPubMedCentral
32.
go back to reference van der Sijs H, Aarts J, van Gelder T, Berg M, Vulto A: Turning off frequently overridden drug alerts: limited opportunities for doing it safely. J Am Med Inform Assoc. 2008, 15 (4): 439-448. 10.1197/jamia.M2311.CrossRefPubMedPubMedCentral van der Sijs H, Aarts J, van Gelder T, Berg M, Vulto A: Turning off frequently overridden drug alerts: limited opportunities for doing it safely. J Am Med Inform Assoc. 2008, 15 (4): 439-448. 10.1197/jamia.M2311.CrossRefPubMedPubMedCentral
33.
go back to reference McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, Peterson JF: A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc. 2012, 19 (3): 346-352. 10.1136/amiajnl-2011-000185.CrossRefPubMed McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, Peterson JF: A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc. 2012, 19 (3): 346-352. 10.1136/amiajnl-2011-000185.CrossRefPubMed
34.
go back to reference Perna G: Clinical alerts that cried wolf. As clinical alerts pose physician workflow problems, healthcare IT leaders look for answers. Healthc Inform. 2012, 29 (4): 18, 20-PubMed Perna G: Clinical alerts that cried wolf. As clinical alerts pose physician workflow problems, healthcare IT leaders look for answers. Healthc Inform. 2012, 29 (4): 18, 20-PubMed
35.
go back to reference Kesselheim AS, Cresswell K, Phansalkar S, Bates DW, Sheikh A: Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. Health Aff (Millwood). 2011, 30 (12): 2310-2317. 10.1377/hlthaff.2010.1111.CrossRef Kesselheim AS, Cresswell K, Phansalkar S, Bates DW, Sheikh A: Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. Health Aff (Millwood). 2011, 30 (12): 2310-2317. 10.1377/hlthaff.2010.1111.CrossRef
36.
go back to reference Hoffman S, Podgurski A: Drug-drug interaction alerts: emphasizing the evidence. St Louis Univ J Health Law Pol. 2012, 5: 297-310. Hoffman S, Podgurski A: Drug-drug interaction alerts: emphasizing the evidence. St Louis Univ J Health Law Pol. 2012, 5: 297-310.
37.
go back to reference Ridgely MS, Greenberg MD: Too many alerts, too much liability: sorting through the malpractice implications of drug-drug interaction clinical decision support. St Louis Univ J Health Law Pol. 2012, 5: 257-296. Ridgely MS, Greenberg MD: Too many alerts, too much liability: sorting through the malpractice implications of drug-drug interaction clinical decision support. St Louis Univ J Health Law Pol. 2012, 5: 257-296.
38.
go back to reference Weingart SN, Simchowitz B, Padolsky H, Isaac T, Seger AC, Massagli M, Davis RB, Weissman JS: An empirical model to estimate the potential impact of medication safety alerts on patient safety, health care utilization, and cost in ambulatory care. Arch Intern Med. 2009, 169 (16): 1465-1473. 10.1001/archinternmed.2009.252.CrossRefPubMed Weingart SN, Simchowitz B, Padolsky H, Isaac T, Seger AC, Massagli M, Davis RB, Weissman JS: An empirical model to estimate the potential impact of medication safety alerts on patient safety, health care utilization, and cost in ambulatory care. Arch Intern Med. 2009, 169 (16): 1465-1473. 10.1001/archinternmed.2009.252.CrossRefPubMed
39.
go back to reference Troiano D, Jones MA, Smith AH, Chan RC, Laegeler AP, Le T, Flynn A, Chaffee BW: The need for collaborative engagement in creating clinical decision-support alerts. Am J Health Syst Pharm. 2013, 70 (2): 150-153. 10.2146/ajhp120435.CrossRefPubMed Troiano D, Jones MA, Smith AH, Chan RC, Laegeler AP, Le T, Flynn A, Chaffee BW: The need for collaborative engagement in creating clinical decision-support alerts. Am J Health Syst Pharm. 2013, 70 (2): 150-153. 10.2146/ajhp120435.CrossRefPubMed
40.
go back to reference Coleman JJ, Nwulu U, Ferner RE: Decision support for sensible dosing in electronic prescribing systems. J Clin Pharm Ther. 2011, 37 (4): 415-419.CrossRefPubMed Coleman JJ, Nwulu U, Ferner RE: Decision support for sensible dosing in electronic prescribing systems. J Clin Pharm Ther. 2011, 37 (4): 415-419.CrossRefPubMed
41.
go back to reference Ferner RE, Coleman JJ: An algorithm for integrating contraindications into electronic prescribing decision support. Drug Saf. 2010, 33 (12): 1089-1096. 10.2165/11539390-000000000-00000.CrossRefPubMed Ferner RE, Coleman JJ: An algorithm for integrating contraindications into electronic prescribing decision support. Drug Saf. 2010, 33 (12): 1089-1096. 10.2165/11539390-000000000-00000.CrossRefPubMed
42.
go back to reference Seidling HM, Storch CH, Bertsche T, Senger C, Kaltschmidt J, Walter-Sack I, Haefeli WE: Successful strategy to improve the specificity of electronic statin-drug interaction alerts. Eur J Clin Pharmacol. 2009, 65 (11): 1149-1157. 10.1007/s00228-009-0704-x.CrossRefPubMed Seidling HM, Storch CH, Bertsche T, Senger C, Kaltschmidt J, Walter-Sack I, Haefeli WE: Successful strategy to improve the specificity of electronic statin-drug interaction alerts. Eur J Clin Pharmacol. 2009, 65 (11): 1149-1157. 10.1007/s00228-009-0704-x.CrossRefPubMed
43.
go back to reference Kawamoto K, Hongsermeier T, Wright A, Lewis J, Bell DS, Middleton B: Key principles for a national clinical decision support knowledge sharing framework: synthesis of insights from leading subject matter experts. J Am Med Inform Assoc. 2013, 20 (1): 199-207. 10.1136/amiajnl-2012-000887.CrossRefPubMedPubMedCentral Kawamoto K, Hongsermeier T, Wright A, Lewis J, Bell DS, Middleton B: Key principles for a national clinical decision support knowledge sharing framework: synthesis of insights from leading subject matter experts. J Am Med Inform Assoc. 2013, 20 (1): 199-207. 10.1136/amiajnl-2012-000887.CrossRefPubMedPubMedCentral
44.
go back to reference Aarts J, Koppel R: Implementation of computerized physician order entry in seven countries. Health Aff (Millwood). 2009, 28 (2): 404-414. 10.1377/hlthaff.28.2.404.CrossRef Aarts J, Koppel R: Implementation of computerized physician order entry in seven countries. Health Aff (Millwood). 2009, 28 (2): 404-414. 10.1377/hlthaff.28.2.404.CrossRef
45.
go back to reference van der Sijs H, Bouamar R, van Gelder T, Aarts J, Berg M, Vulto A: Functionality test for drug safety alerting in computerized physician order entry systems. Int J Med Inform. 2010, 79 (4): 243-251. 10.1016/j.ijmedinf.2010.01.005.CrossRefPubMed van der Sijs H, Bouamar R, van Gelder T, Aarts J, Berg M, Vulto A: Functionality test for drug safety alerting in computerized physician order entry systems. Int J Med Inform. 2010, 79 (4): 243-251. 10.1016/j.ijmedinf.2010.01.005.CrossRefPubMed
46.
go back to reference van Doormaal JE, Rommers MK, Kosterink JGW, Teepe-Twiss IM, Haaijer-Ruskamp FM, Mol PGM: Comparison of methods for identifying patients at risk of medication-related harm. Qual Saf Health Care. 2010, 19: 1-5. 10.1097/QMH.0b013e3181d1391c.CrossRef van Doormaal JE, Rommers MK, Kosterink JGW, Teepe-Twiss IM, Haaijer-Ruskamp FM, Mol PGM: Comparison of methods for identifying patients at risk of medication-related harm. Qual Saf Health Care. 2010, 19: 1-5. 10.1097/QMH.0b013e3181d1391c.CrossRef
47.
go back to reference Wickens CD, Dixon SR: The benefits of imperfect diagnostic automation: a synthesis of the literature. Theor Issues Ergon. 2007, 8 (3): 201-212. 10.1080/14639220500370105.CrossRef Wickens CD, Dixon SR: The benefits of imperfect diagnostic automation: a synthesis of the literature. Theor Issues Ergon. 2007, 8 (3): 201-212. 10.1080/14639220500370105.CrossRef
48.
go back to reference Russ AL, Zillich AJ, McManus MS, Doebbeling BN, Saleem JJ: A human factors investigation of medication alerts: barriers to prescriber decision-making and clinical workflow. AMIA Annu Symp Proc. 2009, 2009: 548-552.PubMedPubMedCentral Russ AL, Zillich AJ, McManus MS, Doebbeling BN, Saleem JJ: A human factors investigation of medication alerts: barriers to prescriber decision-making and clinical workflow. AMIA Annu Symp Proc. 2009, 2009: 548-552.PubMedPubMedCentral
49.
go back to reference Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, Bates DW: A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. J Am Med Inform Assoc. 2010, 17 (5): 493-501. 10.1136/jamia.2010.005264.CrossRefPubMedPubMedCentral Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, Bates DW: A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. J Am Med Inform Assoc. 2010, 17 (5): 493-501. 10.1136/jamia.2010.005264.CrossRefPubMedPubMedCentral
50.
go back to reference Zachariah M, Phansalkar S, Seidling HM, Neri PM, Cresswell KM, Duke J, Bloomrosen M, Volk LA, Bates DW: Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems–I-MeDeSA. J Am Med Inform Assoc. 2011, 18 (Suppl 1): i62-i72. 10.1136/amiajnl-2011-000362.CrossRefPubMedPubMedCentral Zachariah M, Phansalkar S, Seidling HM, Neri PM, Cresswell KM, Duke J, Bloomrosen M, Volk LA, Bates DW: Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems–I-MeDeSA. J Am Med Inform Assoc. 2011, 18 (Suppl 1): i62-i72. 10.1136/amiajnl-2011-000362.CrossRefPubMedPubMedCentral
51.
53.
go back to reference Ferner RE, Aronson JK: Clarification of terminology in medication errors: definitions and classification. Drug Saf. 2006, 29 (11): 1011-1022. 10.2165/00002018-200629110-00001.CrossRefPubMed Ferner RE, Aronson JK: Clarification of terminology in medication errors: definitions and classification. Drug Saf. 2006, 29 (11): 1011-1022. 10.2165/00002018-200629110-00001.CrossRefPubMed
54.
go back to reference Lisby M, Nielsen LP, Brock B, Mainz J: How are medication errors defined? A systematic literature review of definitions and characteristics. Int J Qual Health Care. 2010, 22 (6): 507-518. 10.1093/intqhc/mzq059.CrossRefPubMed Lisby M, Nielsen LP, Brock B, Mainz J: How are medication errors defined? A systematic literature review of definitions and characteristics. Int J Qual Health Care. 2010, 22 (6): 507-518. 10.1093/intqhc/mzq059.CrossRefPubMed
55.
go back to reference Weingart SN, Seger AC, Feola N, Heffernan J, Schiff G, Isaac T: Electronic drug interaction alerts in ambulatory care: the value and acceptance of high-value alerts in US medical practices as assessed by an expert clinical panel. Drug Saf. 2011, 34 (7): 587-593. 10.2165/11589360-000000000-00000.CrossRefPubMed Weingart SN, Seger AC, Feola N, Heffernan J, Schiff G, Isaac T: Electronic drug interaction alerts in ambulatory care: the value and acceptance of high-value alerts in US medical practices as assessed by an expert clinical panel. Drug Saf. 2011, 34 (7): 587-593. 10.2165/11589360-000000000-00000.CrossRefPubMed
56.
go back to reference Phansalkar S, Desai AA, Bell D, Yoshida E, Doole J, Czochanski M, Middleton B, Bates DW: High-priority drug-drug interactions for use in electronic health records. J Am Med Inform Assoc. 2012, 19 (5): 735-743. 10.1136/amiajnl-2011-000612.CrossRefPubMedPubMedCentral Phansalkar S, Desai AA, Bell D, Yoshida E, Doole J, Czochanski M, Middleton B, Bates DW: High-priority drug-drug interactions for use in electronic health records. J Am Med Inform Assoc. 2012, 19 (5): 735-743. 10.1136/amiajnl-2011-000612.CrossRefPubMedPubMedCentral
57.
go back to reference Phansalkar S, van der Sijs H, Tucker AD, Desai AA, Bell DS, Teich JM, Middleton B, Bates DW: Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. J Am Med Inform Assoc. 2013, 20 (3): 489-493. 10.1136/amiajnl-2012-001089.CrossRefPubMed Phansalkar S, van der Sijs H, Tucker AD, Desai AA, Bell DS, Teich JM, Middleton B, Bates DW: Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. J Am Med Inform Assoc. 2013, 20 (3): 489-493. 10.1136/amiajnl-2012-001089.CrossRefPubMed
58.
go back to reference Dean B, Schachter M, Vincent C, Barber N: Causes of prescribing errors in hospital inpatients: a prospective study. Lancet. 2002, 359 (9315): 1373-1378. 10.1016/S0140-6736(02)08350-2.CrossRefPubMed Dean B, Schachter M, Vincent C, Barber N: Causes of prescribing errors in hospital inpatients: a prospective study. Lancet. 2002, 359 (9315): 1373-1378. 10.1016/S0140-6736(02)08350-2.CrossRefPubMed
59.
go back to reference Andersson ML, Bottiger Y, Lindh JD, Wettermark B, Eiermann B: Impact of the drug-drug interaction database SFINX on prevalence of potentially serious drug-drug interactions in primary health care. Eur J Clin Pharmacol. 2013, 69 (3): 565-571. 10.1007/s00228-012-1338-y.CrossRefPubMed Andersson ML, Bottiger Y, Lindh JD, Wettermark B, Eiermann B: Impact of the drug-drug interaction database SFINX on prevalence of potentially serious drug-drug interactions in primary health care. Eur J Clin Pharmacol. 2013, 69 (3): 565-571. 10.1007/s00228-012-1338-y.CrossRefPubMed
60.
go back to reference Metzger J, Welebob E, Bates DW, Lipsitz S, Classen DC: Mixed results in the safety performance of computerized physician order entry. Health Aff (Millwood). 2010, 29 (4): 655-663. 10.1377/hlthaff.2010.0160.CrossRef Metzger J, Welebob E, Bates DW, Lipsitz S, Classen DC: Mixed results in the safety performance of computerized physician order entry. Health Aff (Millwood). 2010, 29 (4): 655-663. 10.1377/hlthaff.2010.0160.CrossRef
61.
go back to reference Scott GP, Shah P, Wyatt JC, Makubate B, Cross FW: Making electronic prescribing alerts more effective: scenario-based experimental study in junior doctors. J Am Med Inform Assoc. 2011, 18 (6): 789-798. 10.1136/amiajnl-2011-000199.CrossRefPubMedPubMedCentral Scott GP, Shah P, Wyatt JC, Makubate B, Cross FW: Making electronic prescribing alerts more effective: scenario-based experimental study in junior doctors. J Am Med Inform Assoc. 2011, 18 (6): 789-798. 10.1136/amiajnl-2011-000199.CrossRefPubMedPubMedCentral
62.
go back to reference Chuang JH, Hripcsak G, Heitjan DF: Design and analysis of controlled trials in naturally clustered environments: implications for medical informatics. J Am Med Inform Assoc. 2002, 9 (3): 230-238. 10.1197/jamia.M0997.CrossRefPubMedPubMedCentral Chuang JH, Hripcsak G, Heitjan DF: Design and analysis of controlled trials in naturally clustered environments: implications for medical informatics. J Am Med Inform Assoc. 2002, 9 (3): 230-238. 10.1197/jamia.M0997.CrossRefPubMedPubMedCentral
Metadata
Title
On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop
Authors
Jamie J Coleman
Heleen van der Sijs
Walter E Haefeli
Sarah P Slight
Sarah E McDowell
Hanna M Seidling
Birgit Eiermann
Jos Aarts
Elske Ammenwerth
Robin E Ferner
Ann Slee
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-111

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue