Skip to main content
Top
Published in: Journal of General Internal Medicine 7/2018

01-07-2018 | Original Research

The Impact of Automated Notification on Follow-up of Actionable Tests Pending at Discharge: a Cluster-Randomized Controlled Trial

Authors: Anuj K. Dalal, MD, Adam Schaffer, MD, MPH, Esteban F. Gershanik, MD, MPH, MMSc, Ranganath Papanna, MD, Katyuska Eibensteiner, Nyryan V. Nolido, MA, Cathy S. Yoon, MS, Deborah Williams, MHA, Stuart R. Lipsitz, ScD, Christopher L. Roy, MD, Jeffrey L. Schnipper, MD, MPH

Published in: Journal of General Internal Medicine | Issue 7/2018

Login to get access

Abstract

Background

Follow-up of tests pending at discharge (TPADs) is poor. We previously demonstrated a twofold increase in awareness of any TPAD by attendings and primary care physicians (PCPs) using an automated email intervention

Objective

To determine whether automated notification improves documented follow-up for actionable TPADs

Design

Cluster-randomized controlled trial

Subjects

Attendings and PCPs caring for adult patients discharged from general medicine and cardiology services with at least one actionable TPAD between June 2011 and May 2012

Intervention

An automated system that notifies discharging attendings and network PCPs of finalized TPADs by email

Main Measures

The primary outcome was the proportion of actionable TPADs with documented action determined by independent physician review of the electronic health record (EHR). Secondary outcomes included documented acknowledgment, 30-day readmissions, and adjusted median days to documented follow-up.

Key Results

Of the 3378 TPADs sampled, 253 (7.5%) were determined to be actionable by physician review. Of these, 150 (123 patients discharged by 53 attendings) and 103 (90 patients discharged by 44 attendings) were assigned to intervention and usual care groups, respectively, and underwent chart review. The proportion of actionable TPADs with documented action was 60.7 vs. 56.3% (p = 0.82) in the intervention vs. usual care groups, similar for documented acknowledgment. The proportion of patients with actionable TPADs readmitted within 30 days was 22.8 vs. 31.1% in the intervention vs. usual care groups (p = 0.24). The adjusted median days [95% CI] to documented action was 9 [6.2, 11.8] vs. 14 [10.2, 17.8] (p = 0.04) in the intervention vs. usual care groups, similar for documented acknowledgment. In sub-group analysis, the intervention had greater impact on documented action for patients with network PCPs compared with usual care (70 vs. 50%, p = 0.03).

Conclusions

Automated notification of actionable TPADs shortened time to action but did not significantly improve documented follow-up, except for network-affiliated patients. The high proportion of actionable TPADs without any documented follow-up (~ 40%) represents an ongoing safety concern.

Clinical Trials Identifier

Appendix
Available only for authorised users
Literature
1.
go back to reference Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161–167.CrossRef Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161–167.CrossRef
2.
go back to reference Forster AJ, Clark HD, Menard A, et al. Adverse events among medical patients after discharge from hospital. CMAJ. 2004;170(3):345–349.PubMedPubMedCentral Forster AJ, Clark HD, Menard A, et al. Adverse events among medical patients after discharge from hospital. CMAJ. 2004;170(3):345–349.PubMedPubMedCentral
3.
go back to reference Roy CL, Poon EG, Karson AS, et al. Patient safety concerns arising from test results that return after hospital discharge. Ann Intern Med. 2005;143(2):121–128.CrossRef Roy CL, Poon EG, Karson AS, et al. Patient safety concerns arising from test results that return after hospital discharge. Ann Intern Med. 2005;143(2):121–128.CrossRef
4.
go back to reference Callen J, Georgiou A, Li J, Westbrook JI. The safety implications of missed test results for hospitalised patients: a systematic review. BMJ Quality & Safety. 2011;20(2):194–199.CrossRef Callen J, Georgiou A, Li J, Westbrook JI. The safety implications of missed test results for hospitalised patients: a systematic review. BMJ Quality & Safety. 2011;20(2):194–199.CrossRef
5.
go back to reference El-Kareh R, Roy C, Brodsky G, Perencevich M, Poon EG. Incidence and predictors of microbiology results returning post-discharge and requiring follow-up. Journal of Hospital Medicine. 2011;6(5):291–296.CrossRef El-Kareh R, Roy C, Brodsky G, Perencevich M, Poon EG. Incidence and predictors of microbiology results returning post-discharge and requiring follow-up. Journal of Hospital Medicine. 2011;6(5):291–296.CrossRef
6.
go back to reference Callen JL, Westbrook JI, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med. 2012;27(10):1334–1348.CrossRef Callen JL, Westbrook JI, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med. 2012;27(10):1334–1348.CrossRef
7.
go back to reference Dalal AK, Pesterev BM, Eibensteiner K, Newmark LP, Samal L, Rothschild JM. Linking acknowledgement to action: closing the loop on non-urgent, clinically significant test results in the electronic health record. J Am Med Inform Assoc. 2015;22(4):905–908.CrossRef Dalal AK, Pesterev BM, Eibensteiner K, Newmark LP, Samal L, Rothschild JM. Linking acknowledgement to action: closing the loop on non-urgent, clinically significant test results in the electronic health record. J Am Med Inform Assoc. 2015;22(4):905–908.CrossRef
8.
go back to reference El-Kareh R, Roy C, Williams DH, Poon EG. Impact of automated alerts on follow-up of post-discharge microbiology results: a cluster randomized controlled trial. J Gen Intern Med. 2012;27(10):1243–50.CrossRef El-Kareh R, Roy C, Williams DH, Poon EG. Impact of automated alerts on follow-up of post-discharge microbiology results: a cluster randomized controlled trial. J Gen Intern Med. 2012;27(10):1243–50.CrossRef
9.
go back to reference Liao JM, Roy CL, Eibensteiner K, Nolido N, Schnipper JL, Dalal AK. Lost in transition: discrepancies in how physicians perceive the actionability of the results of tests pending at discharge. J Hosp Med. 2014;9(6):407–409.CrossRef Liao JM, Roy CL, Eibensteiner K, Nolido N, Schnipper JL, Dalal AK. Lost in transition: discrepancies in how physicians perceive the actionability of the results of tests pending at discharge. J Hosp Med. 2014;9(6):407–409.CrossRef
10.
go back to reference Gandhi TK, Kachalia A, Thomas EJ, et al. Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims. Annals of Internal Medicine. 2006;145(7):488–496.CrossRef Gandhi TK, Kachalia A, Thomas EJ, et al. Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims. Annals of Internal Medicine. 2006;145(7):488–496.CrossRef
11.
go back to reference Wahls T, Haugen T, Cram P. The continuing problem of missed test results in an integrated health system with an advanced electronic medical record. Jt Comm J Qual Patient Saf. 2007;33(8):485–492.CrossRef Wahls T, Haugen T, Cram P. The continuing problem of missed test results in an integrated health system with an advanced electronic medical record. Jt Comm J Qual Patient Saf. 2007;33(8):485–492.CrossRef
12.
go back to reference Wahls TL, Cram PM. The frequency of missed test results and associated treatment delays in a highly computerized health system. BMC Fam Pract. 2007;8:32.CrossRef Wahls TL, Cram PM. The frequency of missed test results and associated treatment delays in a highly computerized health system. BMC Fam Pract. 2007;8:32.CrossRef
13.
go back to reference Singh H, Thomas EJ, Mani S, et al. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? Arch Intern Med. 2009;169(17):1578–1586.CrossRef Singh H, Thomas EJ, Mani S, et al. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? Arch Intern Med. 2009;169(17):1578–1586.CrossRef
14.
go back to reference Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in electronic health record-based settings. JAMA Intern Med. 2013;173(8):702–704.CrossRef Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in electronic health record-based settings. JAMA Intern Med. 2013;173(8):702–704.CrossRef
15.
go back to reference Cutrona SL, Fouayzi H, Burns L, et al. Primary care providers’ opening of time-sensitive alerts sent to commercial electronic health record InBaskets. J Gen Intern Med. 2017;32(11):1210–1219.CrossRef Cutrona SL, Fouayzi H, Burns L, et al. Primary care providers’ opening of time-sensitive alerts sent to commercial electronic health record InBaskets. J Gen Intern Med. 2017;32(11):1210–1219.CrossRef
16.
go back to reference Dalal AK, Schnipper JL, Poon EG, et al. Design and implementation of an automated email notification system for results of tests pending at discharge. J Am Med Inform Assoc. 2012;19(4):523–528.CrossRef Dalal AK, Schnipper JL, Poon EG, et al. Design and implementation of an automated email notification system for results of tests pending at discharge. J Am Med Inform Assoc. 2012;19(4):523–528.CrossRef
17.
go back to reference Dalal AK, Roy CL, Poon EG, et al. Impact of an automated email notification system for results of tests pending at discharge: a cluster-randomized controlled trial. J Am Med Inform Assoc. 2014;21(3):473–480.CrossRef Dalal AK, Roy CL, Poon EG, et al. Impact of an automated email notification system for results of tests pending at discharge: a cluster-randomized controlled trial. J Am Med Inform Assoc. 2014;21(3):473–480.CrossRef
18.
go back to reference Singh H, Vij MS. Eight recommendations for policies for communicating abnormal test results. Jt Comm J Qual Patient Saf. 2010;36(5):226–232.CrossRef Singh H, Vij MS. Eight recommendations for policies for communicating abnormal test results. Jt Comm J Qual Patient Saf. 2010;36(5):226–232.CrossRef
19.
go back to reference Schiff GD, Bates DW. Can electronic clinical documentation help prevent diagnostic errors? N Engl J Med. 2010;362(12):1066–1069.CrossRef Schiff GD, Bates DW. Can electronic clinical documentation help prevent diagnostic errors? N Engl J Med. 2010;362(12):1066–1069.CrossRef
20.
go back to reference Callen J, Georgiou A, Li J, Westbrook JI. The impact for patient outcomes of failure to follow up on test results. how can we do better? EJIFCC. 2015;26(1):38–46.PubMedPubMedCentral Callen J, Georgiou A, Li J, Westbrook JI. The impact for patient outcomes of failure to follow up on test results. how can we do better? EJIFCC. 2015;26(1):38–46.PubMedPubMedCentral
21.
go back to reference Were MC, Li X, Kesterson J, et al. Adequacy of hospital discharge summaries in documenting tests with pending results and outpatient follow-up providers. J Gen Intern Med. 2009;24(9):1002–1006.CrossRef Were MC, Li X, Kesterson J, et al. Adequacy of hospital discharge summaries in documenting tests with pending results and outpatient follow-up providers. J Gen Intern Med. 2009;24(9):1002–1006.CrossRef
23.
go back to reference Chow SC, Shao J, Wang H. Sample size calculations in clinical research. New York: Marcel Dekker; 2003. Chow SC, Shao J, Wang H. Sample size calculations in clinical research. New York: Marcel Dekker; 2003.
24.
go back to reference Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8–27.CrossRef Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8–27.CrossRef
25.
go back to reference McGreevy KM, Lipsitz SR, Linder JA, Rimm E, Hoel DG. Using median regression to obtain adjusted estimates of central tendency for skewed laboratory and epidemiologic data. Clin Chem. 2009;55(1):165–169.CrossRef McGreevy KM, Lipsitz SR, Linder JA, Rimm E, Hoel DG. Using median regression to obtain adjusted estimates of central tendency for skewed laboratory and epidemiologic data. Clin Chem. 2009;55(1):165–169.CrossRef
26.
go back to reference Georgiou A, McCaughey EJ, Tariq A, et al. What is the impact of an electronic test result acknowledgement system on emergency department physicians’ work processes? A mixed-method pre-post observational study. Int J Med Inform. 2017;99:29–36.CrossRef Georgiou A, McCaughey EJ, Tariq A, et al. What is the impact of an electronic test result acknowledgement system on emergency department physicians’ work processes? A mixed-method pre-post observational study. Int J Med Inform. 2017;99:29–36.CrossRef
27.
go back to reference Roy CL, Rothschild JM, Dighe AS, et al. An initiative to improve the management of clinically significant test results in a large health care network. Jt Comm J Qual Patient Saf. 2013;39(11):517–527.CrossRef Roy CL, Rothschild JM, Dighe AS, et al. An initiative to improve the management of clinically significant test results in a large health care network. Jt Comm J Qual Patient Saf. 2013;39(11):517–527.CrossRef
28.
go back to reference Lacson R, Prevedello LM, Andriole KP, et al. Four-year impact of an alert notification system on closed-loop communication of critical test results. AJR Am J Roentgenol. 2014;203(5):933–938.CrossRef Lacson R, Prevedello LM, Andriole KP, et al. Four-year impact of an alert notification system on closed-loop communication of critical test results. AJR Am J Roentgenol. 2014;203(5):933–938.CrossRef
29.
go back to reference Lacson R, O'Connor SD, Sahni VA, et al. Impact of an electronic alert notification system embedded in radiologists’ workflow on closed-loop communication of critical results: a time series analysis. BMJ Qual Saf. 2016;25(7):518–24.CrossRef Lacson R, O'Connor SD, Sahni VA, et al. Impact of an electronic alert notification system embedded in radiologists’ workflow on closed-loop communication of critical results: a time series analysis. BMJ Qual Saf. 2016;25(7):518–24.CrossRef
30.
go back to reference Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: Implications for patient safety and continuity of care. JAM. 2007;297(8):831–841.CrossRef Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: Implications for patient safety and continuity of care. JAM. 2007;297(8):831–841.CrossRef
31.
go back to reference O'Leary KJ, Liebovitz DM, Feinglass J, et al. Creating a better discharge summary: improvement in quality and timeliness using an electronic discharge summary. J Hosp Med. 2009;4(4):219–225.CrossRef O'Leary KJ, Liebovitz DM, Feinglass J, et al. Creating a better discharge summary: improvement in quality and timeliness using an electronic discharge summary. J Hosp Med. 2009;4(4):219–225.CrossRef
32.
go back to reference Walz SE, Smith M, Cox E, Sattin J, Kind AJ. Pending laboratory tests and the hospital discharge summary in patients discharged to sub-acute care. J Gen Intern Med. 2011;26(4):393–398.CrossRef Walz SE, Smith M, Cox E, Sattin J, Kind AJ. Pending laboratory tests and the hospital discharge summary in patients discharged to sub-acute care. J Gen Intern Med. 2011;26(4):393–398.CrossRef
33.
go back to reference Dinescu A, Fernandez H, Ross JS, Karani R. Audit and feedback: an intervention to improve discharge summary completion. J Hosp Med. 2011;6(1):28–32.CrossRef Dinescu A, Fernandez H, Ross JS, Karani R. Audit and feedback: an intervention to improve discharge summary completion. J Hosp Med. 2011;6(1):28–32.CrossRef
34.
go back to reference Singh H, Thomas EJ, Sittig DF, et al. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Am J Med. 2010;123(3):238–244.CrossRef Singh H, Thomas EJ, Sittig DF, et al. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Am J Med. 2010;123(3):238–244.CrossRef
35.
go back to reference Babbott S, Manwell LB, Brown R, et al. Electronic medical records and physician stress in primary care: results from the MEMO study. Journal of the American Medical Informatics Association : JAMIA. 2013;21:e100–e106.CrossRef Babbott S, Manwell LB, Brown R, et al. Electronic medical records and physician stress in primary care: results from the MEMO study. Journal of the American Medical Informatics Association : JAMIA. 2013;21:e100–e106.CrossRef
36.
go back to reference Shanafelt TD, Dyrbye LN, Sinsky C, et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc. 2016;91(7):836–848.CrossRef Shanafelt TD, Dyrbye LN, Sinsky C, et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc. 2016;91(7):836–848.CrossRef
37.
go back to reference Davis Giardina T, Singh H. Should patients get direct access to their laboratory test results? an answer with many questions. JAMA. 2011;306(22):2502–2503.CrossRef Davis Giardina T, Singh H. Should patients get direct access to their laboratory test results? an answer with many questions. JAMA. 2011;306(22):2502–2503.CrossRef
38.
go back to reference Giardina TD, Modi V, Parrish DE, Singh H. The patient portal and abnormal test results: an exploratory study of patient experiences. Patient experience journal. 2015;2(1):148–154.PubMedPubMedCentral Giardina TD, Modi V, Parrish DE, Singh H. The patient portal and abnormal test results: an exploratory study of patient experiences. Patient experience journal. 2015;2(1):148–154.PubMedPubMedCentral
39.
go back to reference Dalal AK, Schnipper JL. Care team identification in the electronic health record: a critical first step for patient-centered communication. J Hosp Med. 2016;11(5):381–385.CrossRef Dalal AK, Schnipper JL. Care team identification in the electronic health record: a critical first step for patient-centered communication. J Hosp Med. 2016;11(5):381–385.CrossRef
40.
go back to reference Dalal AK, Schnipper J, Massaro A, et al. A web-based and mobile patient-centered “microblog” messaging platform to improve care team communication in acute care. J Am Med Inform Assoc. 2017;24(e1):e178–e184.PubMed Dalal AK, Schnipper J, Massaro A, et al. A web-based and mobile patient-centered “microblog” messaging platform to improve care team communication in acute care. J Am Med Inform Assoc. 2017;24(e1):e178–e184.PubMed
41.
go back to reference Hyman JL, Luks HJ, Sechrest R. Online professional networks for physicians: risk management. Clin Orthop Relat Res. 2012;470(5):1386–1392.CrossRef Hyman JL, Luks HJ, Sechrest R. Online professional networks for physicians: risk management. Clin Orthop Relat Res. 2012;470(5):1386–1392.CrossRef
42.
go back to reference Ayele RA, Lawrence E, McCreight M, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient's medical home. BMC Health Serv Res. 2017;17(1):123-017-2048-z.CrossRef Ayele RA, Lawrence E, McCreight M, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient's medical home. BMC Health Serv Res. 2017;17(1):123-017-2048-z.CrossRef
43.
go back to reference Sittig DF, Singh H. Improving test result follow-up through electronic health records requires more than just an alert. J Gen Intern Med. 2012;27(10):1235–1237.CrossRef Sittig DF, Singh H. Improving test result follow-up through electronic health records requires more than just an alert. J Gen Intern Med. 2012;27(10):1235–1237.CrossRef
Metadata
Title
The Impact of Automated Notification on Follow-up of Actionable Tests Pending at Discharge: a Cluster-Randomized Controlled Trial
Authors
Anuj K. Dalal, MD
Adam Schaffer, MD, MPH
Esteban F. Gershanik, MD, MPH, MMSc
Ranganath Papanna, MD
Katyuska Eibensteiner
Nyryan V. Nolido, MA
Cathy S. Yoon, MS
Deborah Williams, MHA
Stuart R. Lipsitz, ScD
Christopher L. Roy, MD
Jeffrey L. Schnipper, MD, MPH
Publication date
01-07-2018
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 7/2018
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-018-4393-y

Other articles of this Issue 7/2018

Journal of General Internal Medicine 7/2018 Go to the issue