Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2020

Open Access 01-12-2020 | Acute Kidney Injury | Research article

Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury

Authors: Megan Howarth, Meha Bhatt, Eleanor Benterud, Anna Wolska, Evan Minty, Kyoo-Yoon Choi, Andrea Devrome, Tyrone G. Harrison, Barry Baylis, Elijah Dixon, Indraneel Datta, Neesh Pannu, Matthew T. James

Published in: BMC Medical Informatics and Decision Making | Issue 1/2020

Login to get access

Abstract

Background

Acute kidney injury (AKI) is common in hospitalized patients and is associated with poor patient outcomes and high costs of care. The implementation of clinical decision support tools within electronic medical record (EMR) could improve AKI care and outcomes. While clinical decision support tools have the potential to enhance recognition and management of AKI, there is limited description in the literature of how these tools were developed and whether they meet end-user expectations.

Methods

We developed and evaluated the content, acceptability, and usability of electronic clinical decision support tools for AKI care. Multi-component tools were developed within a hospital EMR (Sunrise Clinical Manager™, Allscripts Healthcare Solutions Inc.) currently deployed in Calgary, Alberta, and included: AKI stage alerts, AKI adverse medication warnings, AKI clinical summary dashboard, and an AKI order set. The clinical decision support was developed for use by multiple healthcare providers at the time and point of care on general medical and surgical units. Functional and usability testing for the alerts and clinical summary dashboard was conducted via in-person evaluation sessions, interviews, and surveys of care providers. Formal user acceptance testing with clinical end-users, including physicians and nursing staff, was conducted to evaluate the AKI order set.

Results

Considerations for appropriate deployment of both non-disruptive and interruptive functions was important to gain acceptability by clinicians. Functional testing and usability surveys for the alerts and clinical summary dashboard indicated that the tools were operating as desired and 74% (17/23) of surveyed healthcare providers reported that these tools were easy to use and could be learned quickly. Over three-quarters of providers (18/23) reported that they would utilize the tools in their practice. Three-quarters of the participants (13/17) in user acceptance testing agreed that recommendations within the order set were useful. Overall, 88% (15/17) believed that the order set would improve the care and management of AKI patients.

Conclusions

Development and testing of EMR-based decision support tools for AKI with clinicians led to high acceptance by clinical end-users. Subsequent implementation within clinical environments will require end-user education and engagement in system-level initiatives to use the tools to improve care.
Appendix
Available only for authorised users
Literature
1.
go back to reference James MT, Dixon E, Roberts DJ, Barry R, Balint C, Bharwani A, Buie WD, Godinez T, Hemmelgarn BR, Kortbeek JB, et al. Improving prevention, early recognition and management of acute kidney injury after major surgery: results of a planning meeting with multidisciplinary stakeholders. Can J Kidney Health Dis. 2014;1:20.CrossRefPubMed James MT, Dixon E, Roberts DJ, Barry R, Balint C, Bharwani A, Buie WD, Godinez T, Hemmelgarn BR, Kortbeek JB, et al. Improving prevention, early recognition and management of acute kidney injury after major surgery: results of a planning meeting with multidisciplinary stakeholders. Can J Kidney Health Dis. 2014;1:20.CrossRefPubMed
2.
go back to reference Hoste EAJ, Kellum JA, Selby NM, Zarbock A, Palevsky PM, Bagshaw SM, Goldstein SL, Cerda J, Chawla LS. Global epidemiology and outcomes of acute kidney injury. Nat Rev Nephrol. 2018;14(10):607–25.CrossRefPubMed Hoste EAJ, Kellum JA, Selby NM, Zarbock A, Palevsky PM, Bagshaw SM, Goldstein SL, Cerda J, Chawla LS. Global epidemiology and outcomes of acute kidney injury. Nat Rev Nephrol. 2018;14(10):607–25.CrossRefPubMed
3.
go back to reference Muniraju T, Lillicrap M, Horrocks J, Fisher J, Clark R, Kanagasundaram N. Diagnosis and management of acute kidney injury: deficiencies in the knowledge base of non-specialist, trainee medical staff. Clin Med. 2012;12(3):216–21.CrossRef Muniraju T, Lillicrap M, Horrocks J, Fisher J, Clark R, Kanagasundaram N. Diagnosis and management of acute kidney injury: deficiencies in the knowledge base of non-specialist, trainee medical staff. Clin Med. 2012;12(3):216–21.CrossRef
4.
go back to reference Stewart J, Findlay G, Smith N, Kelly K, Mason M. A review of the care of patients who died in hospital with a primary diagnosis of acute kidney injury. London: National Confidential Enquiry into Patient Outcome and Death, Adding Insult to Injury 2009. Stewart J, Findlay G, Smith N, Kelly K, Mason M. A review of the care of patients who died in hospital with a primary diagnosis of acute kidney injury. London: National Confidential Enquiry into Patient Outcome and Death, Adding Insult to Injury 2009.
5.
go back to reference Phipps DL, Morris RL, Blakeman T, Ashcroft DM. What is involved in medicines management across care boundaries? A qualitative study of healthcare practitioners’ experiences in the case of acute kidney injury. BMJ Open. 2017;7(1):e011765.CrossRefPubMed Phipps DL, Morris RL, Blakeman T, Ashcroft DM. What is involved in medicines management across care boundaries? A qualitative study of healthcare practitioners’ experiences in the case of acute kidney injury. BMJ Open. 2017;7(1):e011765.CrossRefPubMed
7.
go back to reference James MT, Hobson CE, Darmon M, Mohan S, Hudson D, Goldstein SL, Ronco C, Kellum JA, Bagshaw SM. For the acute dialysis quality initiative consensus G: applications for detection of acute kidney injury using electronic medical records and clinical information systems: workgroup statements from the 15th ADQI Consensus Conference. Can J Kidney Health Dis. 2016;3(1):9.PubMed James MT, Hobson CE, Darmon M, Mohan S, Hudson D, Goldstein SL, Ronco C, Kellum JA, Bagshaw SM. For the acute dialysis quality initiative consensus G: applications for detection of acute kidney injury using electronic medical records and clinical information systems: workgroup statements from the 15th ADQI Consensus Conference. Can J Kidney Health Dis. 2016;3(1):9.PubMed
8.
go back to reference Haase M, Kribben A, Zidek W, Floege J, Albert C, Isermann B, Robra BP, Haase-Fielitz A. Electronic alerts for acute kidney injury: a systematic review. Deutsches Ärzteblatt Int. 2017;114(1–2):1–8. Haase M, Kribben A, Zidek W, Floege J, Albert C, Isermann B, Robra BP, Haase-Fielitz A. Electronic alerts for acute kidney injury: a systematic review. Deutsches Ärzteblatt Int. 2017;114(1–2):1–8.
9.
go back to reference Selby NM, Crowley L, Fluck RJ, McIntyre CW, Monaghan J, Lawson N, Kolhe NV. Use of electronic results reporting to diagnose and monitor AKI in hospitalized patients. Clin J Am Soc Nephrol. 2012;7(4):533–40.CrossRefPubMed Selby NM, Crowley L, Fluck RJ, McIntyre CW, Monaghan J, Lawson N, Kolhe NV. Use of electronic results reporting to diagnose and monitor AKI in hospitalized patients. Clin J Am Soc Nephrol. 2012;7(4):533–40.CrossRefPubMed
10.
go back to reference Flynn N, Dawnay A. A simple electronic alert for acute kidney injury. Ann Clin Biochem. 2015;52(2):206–12.CrossRefPubMed Flynn N, Dawnay A. A simple electronic alert for acute kidney injury. Ann Clin Biochem. 2015;52(2):206–12.CrossRefPubMed
11.
go back to reference Porter CJ, Juurlink I, Bisset LH, Bavakunji R, Mehta RL, Devonald MAJ. A real-time electronic alert to improve detection of acute kidney injury in a large teaching hospital. Nephrol Dial Transplant. 2014;29(10):1888–93.CrossRefPubMed Porter CJ, Juurlink I, Bisset LH, Bavakunji R, Mehta RL, Devonald MAJ. A real-time electronic alert to improve detection of acute kidney injury in a large teaching hospital. Nephrol Dial Transplant. 2014;29(10):1888–93.CrossRefPubMed
12.
go back to reference Wallace K, Mallard AS, Stratton JD, Johnston PA, Dickinson S, Parry RG. Use of an electronic alert to identify patients with acute kidney injury. Clin Med (London, England). 2014;14(1):22–6.CrossRef Wallace K, Mallard AS, Stratton JD, Johnston PA, Dickinson S, Parry RG. Use of an electronic alert to identify patients with acute kidney injury. Clin Med (London, England). 2014;14(1):22–6.CrossRef
13.
go back to reference Kolhe NV, Staples D, Reilly T, Merrison D, McIntyre CW, Fluck RJ, Selby NM, Taal MW. Impact of compliance with a care bundle on acute kidney injury outcomes: a prospective observational study. PLoS ONE. 2015;10(7):e0132279.CrossRefPubMed Kolhe NV, Staples D, Reilly T, Merrison D, McIntyre CW, Fluck RJ, Selby NM, Taal MW. Impact of compliance with a care bundle on acute kidney injury outcomes: a prospective observational study. PLoS ONE. 2015;10(7):e0132279.CrossRefPubMed
14.
go back to reference Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMed Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMed
15.
go back to reference Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HGC. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013;346:f657.CrossRefPubMed Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HGC. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013;346:f657.CrossRefPubMed
16.
go back to reference James MT, Pannu N, Barry R, Karsanji D, Tonelli M, Hemmelgarn BR, Manns BJ, Bagshaw SM, Stelfox HT, Dixon E. A modified Delphi process to identify process of care indicators for the identification, prevention and management of acute kidney injury after major surgery. Can J Kidney Health Dis . 2015;2(1):11.PubMed James MT, Pannu N, Barry R, Karsanji D, Tonelli M, Hemmelgarn BR, Manns BJ, Bagshaw SM, Stelfox HT, Dixon E. A modified Delphi process to identify process of care indicators for the identification, prevention and management of acute kidney injury after major surgery. Can J Kidney Health Dis . 2015;2(1):11.PubMed
17.
go back to reference James M, Bouchard J, Ho J, Klarenbach S, LaFrance J-P, Rigatto C, Wald R, Zappitelli M, Pannu N. Canadian society of nephrology commentary on the 2012 KDIGO clinical practice guideline for acute kidney injury. Am J Kidney Dis. 2013;61(5):673–85.CrossRefPubMed James M, Bouchard J, Ho J, Klarenbach S, LaFrance J-P, Rigatto C, Wald R, Zappitelli M, Pannu N. Canadian society of nephrology commentary on the 2012 KDIGO clinical practice guideline for acute kidney injury. Am J Kidney Dis. 2013;61(5):673–85.CrossRefPubMed
18.
go back to reference Khwaja A. KDIGO clinical practice guidelines for acute kidney injury. Nephron Clin Pract. 2012;120(4):c179–84.PubMed Khwaja A. KDIGO clinical practice guidelines for acute kidney injury. Nephron Clin Pract. 2012;120(4):c179–84.PubMed
19.
go back to reference Ahmed A, Vairavan S, Akhoundi A, Wilson G, Chiofolo C, Chbat N, Cartin-Ceba R, Li G, Kashani K. Development and validation of electronic surveillance tool for acute kidney injury: a retrospective analysis. J Crit Care. 2015;30(5):988–93.CrossRef Ahmed A, Vairavan S, Akhoundi A, Wilson G, Chiofolo C, Chbat N, Cartin-Ceba R, Li G, Kashani K. Development and validation of electronic surveillance tool for acute kidney injury: a retrospective analysis. J Crit Care. 2015;30(5):988–93.CrossRef
20.
go back to reference Colpaert K, Hoste E, Van Hoecke S, Vandijck D, Danneels C, Steurbaut K, De Turck F, Decruyenaere J. Implementation of a real-time electronic alert based on the RIFLE criteria for acute kidney injury in ICU patients. Acta Clin Belg. 2007;62(sup2):322–5.CrossRefPubMed Colpaert K, Hoste E, Van Hoecke S, Vandijck D, Danneels C, Steurbaut K, De Turck F, Decruyenaere J. Implementation of a real-time electronic alert based on the RIFLE criteria for acute kidney injury in ICU patients. Acta Clin Belg. 2007;62(sup2):322–5.CrossRefPubMed
21.
go back to reference Colpaert K, Hoste EA, Steurbaut K, Benoit D, Van Hoecke S, De Turck F, Decruyenaere J. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med. 2012;40(4):1164–70.CrossRefPubMed Colpaert K, Hoste EA, Steurbaut K, Benoit D, Van Hoecke S, De Turck F, Decruyenaere J. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med. 2012;40(4):1164–70.CrossRefPubMed
22.
go back to reference Garzotto F, Piccinni P, Cruz D, Gramaticopolo S, Dal Santo M, Aneloni G, Kim JC, Rocco M, Alessandri E, Giunta F. RIFLE-based data collection/management system applied to a prospective cohort multicenter Italian study on the epidemiology of acute kidney injury in the intensive care unit. Blood Purif. 2011;31(1–3):159–71.CrossRefPubMed Garzotto F, Piccinni P, Cruz D, Gramaticopolo S, Dal Santo M, Aneloni G, Kim JC, Rocco M, Alessandri E, Giunta F. RIFLE-based data collection/management system applied to a prospective cohort multicenter Italian study on the epidemiology of acute kidney injury in the intensive care unit. Blood Purif. 2011;31(1–3):159–71.CrossRefPubMed
23.
go back to reference Goldstein SL, Kirkendall E, Nguyen H, Schaffzin JK, Bucuvalas J, Bracke T, Seid M, Ashby M, Foertmeyer N, Brunner L. Electronic health record identification of nephrotoxin exposure and associated acute kidney injury. Pediatrics. 2013;132(3):e756–67.CrossRefPubMed Goldstein SL, Kirkendall E, Nguyen H, Schaffzin JK, Bucuvalas J, Bracke T, Seid M, Ashby M, Foertmeyer N, Brunner L. Electronic health record identification of nephrotoxin exposure and associated acute kidney injury. Pediatrics. 2013;132(3):e756–67.CrossRefPubMed
24.
go back to reference Hill R, Selby N. Acute kidney injury Warning algorithm best practice guidance. Think Kidneys NHS; 2014. Hill R, Selby N. Acute kidney injury Warning algorithm best practice guidance. Think Kidneys NHS; 2014.
25.
go back to reference Kirkendall E, Spires W, Mottes T, Schaffzin J, Barclay C, Goldstein S. Development and performance of electronic acute kidney injury triggers to identify pediatric patients at risk for nephrotoxic medication-associated harm. Appl Clin Inform. 2014;5(02):313–33.CrossRefPubMed Kirkendall E, Spires W, Mottes T, Schaffzin J, Barclay C, Goldstein S. Development and performance of electronic acute kidney injury triggers to identify pediatric patients at risk for nephrotoxic medication-associated harm. Appl Clin Inform. 2014;5(02):313–33.CrossRefPubMed
26.
go back to reference Matheny ME, Miller RA, Ikizler TA, Waitman LR, Denny JC, Schildcrout JS, Dittus RS, Peterson JF. Development of inpatient risk stratification models of acute kidney injury for use in electronic health records. Med Decis Mak. 2010;30(6):639–50.CrossRef Matheny ME, Miller RA, Ikizler TA, Waitman LR, Denny JC, Schildcrout JS, Dittus RS, Peterson JF. Development of inpatient risk stratification models of acute kidney injury for use in electronic health records. Med Decis Mak. 2010;30(6):639–50.CrossRef
27.
go back to reference McCoy AB, Cox ZL, Neal EB, Waitman LR, Peterson NB, Bhave G, Siew ED, Danciu I, Lewis JB, Peterson JF. Real-time pharmacy surveillance and clinical decision support to reduce adverse drug events in acute kidney injury. Appl Clin Inform. 2012;3(02):221–38.CrossRefPubMed McCoy AB, Cox ZL, Neal EB, Waitman LR, Peterson NB, Bhave G, Siew ED, Danciu I, Lewis JB, Peterson JF. Real-time pharmacy surveillance and clinical decision support to reduce adverse drug events in acute kidney injury. Appl Clin Inform. 2012;3(02):221–38.CrossRefPubMed
28.
go back to reference McCoy AB, Waitman LR, Gadd CS, Danciu I, Smith JP, Lewis JB, Schildcrout JS, Peterson JF. A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report. Am J Kidney Dis. 2010;56(5):832–41.CrossRefPubMed McCoy AB, Waitman LR, Gadd CS, Danciu I, Smith JP, Lewis JB, Schildcrout JS, Peterson JF. A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report. Am J Kidney Dis. 2010;56(5):832–41.CrossRefPubMed
29.
go back to reference McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, Peterson JF. A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc. 2011;19(3):346–52.CrossRefPubMed McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, Peterson JF. A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc. 2011;19(3):346–52.CrossRefPubMed
30.
31.
go back to reference Thomas M, Sitch A, Dowswell G. The initial development and assessment of an automatic alert warning of acute kidney injury. Nephrol Dial Transplant. 2010;26(7):2161–8.CrossRefPubMed Thomas M, Sitch A, Dowswell G. The initial development and assessment of an automatic alert warning of acute kidney injury. Nephrol Dial Transplant. 2010;26(7):2161–8.CrossRefPubMed
32.
go back to reference Wilson FP, Shashaty M, Testani J, Aqeel I, Borovskiy Y, Ellenberg SS, Feldman HI, Fernandez H, Gitelman Y, Lin J. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial. The Lancet. 2015;385(9981):1966–74.CrossRef Wilson FP, Shashaty M, Testani J, Aqeel I, Borovskiy Y, Ellenberg SS, Feldman HI, Fernandez H, Gitelman Y, Lin J. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial. The Lancet. 2015;385(9981):1966–74.CrossRef
33.
go back to reference England N. Algorithm for detecting Acute Kidney Injury (AKI) based on serum creatinine changes with time. 2014; 2018. England N. Algorithm for detecting Acute Kidney Injury (AKI) based on serum creatinine changes with time. 2014; 2018.
34.
go back to reference England N: Patient safety alert: stage 3 directive: standardising the early identification of acute kidney injury. NHS England 2014. England N: Patient safety alert: stage 3 directive: standardising the early identification of acute kidney injury. NHS England 2014.
35.
go back to reference Selby NM, Hill R, Fluck RJ. Standardizing the early identification of acute kidney injury: the NHS England national patient safety alert. Nephron. 2015;131(2):113–7.CrossRefPubMed Selby NM, Hill R, Fluck RJ. Standardizing the early identification of acute kidney injury: the NHS England national patient safety alert. Nephron. 2015;131(2):113–7.CrossRefPubMed
36.
go back to reference Licurse A, Kim MC, Dziura J, Forman HP, Formica RN, Makarov DV, Parikh CR, Gross CP. Renal ultrasonography in the evaluation of acute kidney injury: developing a risk stratification framework. Arch Intern Med. 2010;170(21):1900–7.CrossRefPubMed Licurse A, Kim MC, Dziura J, Forman HP, Formica RN, Makarov DV, Parikh CR, Gross CP. Renal ultrasonography in the evaluation of acute kidney injury: developing a risk stratification framework. Arch Intern Med. 2010;170(21):1900–7.CrossRefPubMed
37.
go back to reference Brooke J. SUS-A quick and dirty usability scale. Usability Eval Ind. 1996;189(194):4–7. Brooke J. SUS-A quick and dirty usability scale. Usability Eval Ind. 1996;189(194):4–7.
38.
Metadata
Title
Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury
Authors
Megan Howarth
Meha Bhatt
Eleanor Benterud
Anna Wolska
Evan Minty
Kyoo-Yoon Choi
Andrea Devrome
Tyrone G. Harrison
Barry Baylis
Elijah Dixon
Indraneel Datta
Neesh Pannu
Matthew T. James
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2020
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-020-01303-x

Other articles of this Issue 1/2020

BMC Medical Informatics and Decision Making 1/2020 Go to the issue