Skip to main content
Top
Published in: Journal of General Internal Medicine 7/2017

01-07-2017 | Original Research

Electronic Detection of Delayed Test Result Follow-Up in Patients with Hypothyroidism

Authors: Ashley N. D. Meyer, PhD, Daniel R. Murphy, MD, MBA, Aymer Al-Mutairi, MD, Dean F. Sittig, PhD, Li Wei, MS, Elise Russo, MPH, Hardeep Singh, MD, MPH

Published in: Journal of General Internal Medicine | Issue 7/2017

Login to get access

Abstract

Background

Delays in following up abnormal test results are a common problem in outpatient settings. Surveillance systems that use trigger tools to identify delayed follow-up can help reduce missed opportunities in care.

Objective

To develop and test an electronic health record (EHR)-based trigger algorithm to identify instances of delayed follow-up of abnormal thyroid-stimulating hormone (TSH) results in patients being treated for hypothyroidism.

Design

We developed an algorithm using structured EHR data to identify patients with hypothyroidism who had delayed follow-up (>60 days) after an abnormal TSH. We then retrospectively applied the algorithm to a large EHR data warehouse within the Department of Veterans Affairs (VA), on patient records from two large VA networks for the period from January 1, 2011, to December 31, 2011. Identified records were reviewed to confirm the presence of delays in follow-up.

Key Results

During the study period, 645,555 patients were seen in the outpatient setting within the two networks. Of 293,554 patients with at least one TSH test result, the trigger identified 1250 patients on treatment for hypothyroidism with elevated TSH. Of these patients, 271 were flagged as potentially having delayed follow-up of their test result. Chart reviews confirmed delays in 163 of the 271 flagged patients (PPV = 60.1%).

Conclusions

An automated trigger algorithm applied to records in a large EHR data warehouse identified patients with hypothyroidism with potential delays in thyroid function test results follow-up. Future prospective application of the TSH trigger algorithm can be used by clinical teams as a surveillance and quality improvement technique to monitor and improve follow-up.
Literature
1.
go back to reference Singh H, Naik A, Rao R, Petersen L. Reducing diagnostic errors through effective communication: harnessing the power of information technology. J Gen Intern Med. 2008;23:489–94.CrossRefPubMedPubMedCentral Singh H, Naik A, Rao R, Petersen L. Reducing diagnostic errors through effective communication: harnessing the power of information technology. J Gen Intern Med. 2008;23:489–94.CrossRefPubMedPubMedCentral
2.
go back to reference Poon E, Gandhi T, Sequist T, Murff H, Karson A, Bates D. “I wish I had seen this test result earlier!”: dissatisfaction with test result management systems in primary care. Arch Intern Med. 2004;164:2223–8.CrossRefPubMed Poon E, Gandhi T, Sequist T, Murff H, Karson A, Bates D. “I wish I had seen this test result earlier!”: dissatisfaction with test result management systems in primary care. Arch Intern Med. 2004;164:2223–8.CrossRefPubMed
3.
5.
go back to reference Schiff GD. Introduction: communicating critical test results. Jt Comm J Qual Patient Saf. 2005;31:63–5.CrossRefPubMed Schiff GD. Introduction: communicating critical test results. Jt Comm J Qual Patient Saf. 2005;31:63–5.CrossRefPubMed
6.
go back to reference Hickner J, Graham DG, Elder NC, et al. Testing process errors and their harms and consequences reported from family medicine practices: a study of the American Academy of Family Physicians National Research Network. Qual Saf Health Care. 2008;17:194–200.CrossRefPubMed Hickner J, Graham DG, Elder NC, et al. Testing process errors and their harms and consequences reported from family medicine practices: a study of the American Academy of Family Physicians National Research Network. Qual Saf Health Care. 2008;17:194–200.CrossRefPubMed
9.
go back to reference Moore C, Saigh O, Trikha A, Lin JJ. Timely follow-up of abnormal outpatient test results: Perceived barriers and impact on patient safety. J Patient Saf. 2008;4. Moore C, Saigh O, Trikha A, Lin JJ. Timely follow-up of abnormal outpatient test results: Perceived barriers and impact on patient safety. J Patient Saf. 2008;4.
10.
go back to reference Wears RL, Berg M. Computer technology and clinical work: still waiting for Godot. JAMA. 2005;293:1261–3.CrossRefPubMed Wears RL, Berg M. Computer technology and clinical work: still waiting for Godot. JAMA. 2005;293:1261–3.CrossRefPubMed
11.
go back to reference Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010;19:i68–74.CrossRefPubMedPubMedCentral Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010;19:i68–74.CrossRefPubMedPubMedCentral
12.
go back to reference Singh H, Arora H, Vij M, Rao R, Khan MM, Petersen L. Communication outcomes of critical imaging results in a computerized notification system. J Am Med Inform Assoc. 2007;14:459–66.CrossRefPubMedPubMedCentral Singh H, Arora H, Vij M, Rao R, Khan MM, Petersen L. Communication outcomes of critical imaging results in a computerized notification system. J Am Med Inform Assoc. 2007;14:459–66.CrossRefPubMedPubMedCentral
13.
go back to reference Singh H, Thomas EJ, Mani S, et al. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? Arch Intern Med. 2009;169:1578–86.PubMedPubMedCentral Singh H, Thomas EJ, Mani S, et al. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? Arch Intern Med. 2009;169:1578–86.PubMedPubMedCentral
14.
go back to reference Al-Mutairi A, Meyer AN, Chang P, Singh H. Lack of timely follow-up of abnormal imaging results and radiologists’ recommendations. J Am Coll Radiol. 2015. Al-Mutairi A, Meyer AN, Chang P, Singh H. Lack of timely follow-up of abnormal imaging results and radiologists’ recommendations. J Am Coll Radiol. 2015.
15.
go back to reference Singh H, Thomas EJ, Sittig DF, et al. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Am J Med. 2010;123:238–44.CrossRefPubMedPubMedCentral Singh H, Thomas EJ, Sittig DF, et al. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Am J Med. 2010;123:238–44.CrossRefPubMedPubMedCentral
16.
go back to reference Murphy DR, Reis B, Sittig DF, Singh H. Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. Am J Med. 2012;125:209e1–7.CrossRef Murphy DR, Reis B, Sittig DF, Singh H. Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. Am J Med. 2012;125:209e1–7.CrossRef
17.
go back to reference Murphy DR, Meyer AND, Russo E, Sittig DF, Wei L, Singh H. The burden of inbox notifications in commercial electronic health records. JAMA Intern Med. 2016. Murphy DR, Meyer AND, Russo E, Sittig DF, Wei L, Singh H. The burden of inbox notifications in commercial electronic health records. JAMA Intern Med. 2016.
18.
go back to reference Improving diagnosis in health care. National Academies of Sciences Engineering and Medicine [serial online]. 2015. Available from: The National Academies Press. Accessed 14 June 2016. Improving diagnosis in health care. National Academies of Sciences Engineering and Medicine [serial online]. 2015. Available from: The National Academies Press. Accessed 14 June 2016.
19.
go back to reference Institute for Healthcare Improvement, Kaiser Permanente, Baylor Health Care System. Outpatient adverse event trigger tool. IHI 2006 [serial online]. 2008. Institute for Healthcare Improvement, Kaiser Permanente, Baylor Health Care System. Outpatient adverse event trigger tool. IHI 2006 [serial online]. 2008.
20.
go back to reference Classen DC, Resar R, Griffin F, et al. “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff. 2011;30:581–9.CrossRef Classen DC, Resar R, Griffin F, et al. “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff. 2011;30:581–9.CrossRef
21.
go back to reference de Wet C, Bowie P. The preliminary development and testing of a global trigger tool to detect error and patient harm in primary-care records. Postgrad Med J. 2009;85:176–80.CrossRefPubMed de Wet C, Bowie P. The preliminary development and testing of a global trigger tool to detect error and patient harm in primary-care records. Postgrad Med J. 2009;85:176–80.CrossRefPubMed
22.
go back to reference Kaafarani HMA, Rosen AK, Nebeker JR, et al. Development of trigger tools for surveillance of adverse events in ambulatory surgery. Qual Saf Health Care. 2010;19:425–9.PubMed Kaafarani HMA, Rosen AK, Nebeker JR, et al. Development of trigger tools for surveillance of adverse events in ambulatory surgery. Qual Saf Health Care. 2010;19:425–9.PubMed
23.
go back to reference Murphy DR, Laxmisan A, Reis BA, et al. Electronic health record-based triggers to detect potential delays in cancer diagnosis. BMJ Qual Saf. 2014;23:8–16.CrossRefPubMed Murphy DR, Laxmisan A, Reis BA, et al. Electronic health record-based triggers to detect potential delays in cancer diagnosis. BMJ Qual Saf. 2014;23:8–16.CrossRefPubMed
24.
go back to reference Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AND, Singh H. Electronic trigger-based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol. 2015;33:3560–7.CrossRefPubMedPubMedCentral Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AND, Singh H. Electronic trigger-based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol. 2015;33:3560–7.CrossRefPubMedPubMedCentral
25.
go back to reference Schiff GD, Kim S, Krosnjar N, et al. Missed Hypothyroidism diagnosis uncovered by linking laboratory and pharmacy data. Arch Intern Med. 2005;165:574–7.CrossRefPubMed Schiff GD, Kim S, Krosnjar N, et al. Missed Hypothyroidism diagnosis uncovered by linking laboratory and pharmacy data. Arch Intern Med. 2005;165:574–7.CrossRefPubMed
26.
go back to reference Garber JR, Cobin RH, Gharib H, et al. Clinical practice guidelines for hypothyroidism in adults: cosponsored by the American Association of Clinical Endocrinologists and the American Thyroid Association. Endocr Pract. 2012;18:988–1028.CrossRefPubMed Garber JR, Cobin RH, Gharib H, et al. Clinical practice guidelines for hypothyroidism in adults: cosponsored by the American Association of Clinical Endocrinologists and the American Thyroid Association. Endocr Pract. 2012;18:988–1028.CrossRefPubMed
28.
go back to reference Poppe K, Velkeniers B, Glinoer D. The role of thyroid autoimmunity infertility and pregnancy. Nat Clin Pract Endocrinol Metab. 2008;4:394–405.CrossRefPubMed Poppe K, Velkeniers B, Glinoer D. The role of thyroid autoimmunity infertility and pregnancy. Nat Clin Pract Endocrinol Metab. 2008;4:394–405.CrossRefPubMed
29.
go back to reference Gulseren S, Gulseren L, Hekimsoy Z, Cetinay P, Ozen C, Tokatlioglu B. Depression, anxiety, health-related quality of life, and disability in patients with overt and subclinical thyroid dysfunction. Arch Med Res. 2006;37:133–9.CrossRefPubMed Gulseren S, Gulseren L, Hekimsoy Z, Cetinay P, Ozen C, Tokatlioglu B. Depression, anxiety, health-related quality of life, and disability in patients with overt and subclinical thyroid dysfunction. Arch Med Res. 2006;37:133–9.CrossRefPubMed
30.
go back to reference Khoury MJ, Becerra JE, D’Almada PJ. Maternal thyroid disease and risk of birth defects in offspring: a population-based case–control study. Paediatr Perinat Epidemiol. 1989;3:402–20.CrossRefPubMed Khoury MJ, Becerra JE, D’Almada PJ. Maternal thyroid disease and risk of birth defects in offspring: a population-based case–control study. Paediatr Perinat Epidemiol. 1989;3:402–20.CrossRefPubMed
31.
go back to reference Fihn SD, Francis J, Clancy C, et al. Insights from advanced analytics at the veterans health administration. Health Aff. 2014;33:1203–11.CrossRef Fihn SD, Francis J, Clancy C, et al. Insights from advanced analytics at the veterans health administration. Health Aff. 2014;33:1203–11.CrossRef
32.
go back to reference Wang Y, Pakhomov S, Dale J, Chen E, Melton G. Application of HL7/LOINC document ontology to a university-affiliated integrated health system research clinical data repository. AMIA Summits Transl Sci Proc. 2014;2014:230–4.PubMedPubMedCentral Wang Y, Pakhomov S, Dale J, Chen E, Melton G. Application of HL7/LOINC document ontology to a university-affiliated integrated health system research clinical data repository. AMIA Summits Transl Sci Proc. 2014;2014:230–4.PubMedPubMedCentral
33.
go back to reference Murphy DR, Thomas EJ, Meyer AND, Singh H. Development and validation of electronic health record-based triggers to detect delays in follow-up of abnormal lung imaging. Radiology. 2015;277:81–7.CrossRefPubMedPubMedCentral Murphy DR, Thomas EJ, Meyer AND, Singh H. Development and validation of electronic health record-based triggers to detect delays in follow-up of abnormal lung imaging. Radiology. 2015;277:81–7.CrossRefPubMedPubMedCentral
35.
go back to reference Murphy DR, Meyer AND, Bhise V, et al. Computerized triggers of big data to detect delays in follow-up of chest imaging results. Chest. 2016;150:613–20.CrossRefPubMed Murphy DR, Meyer AND, Bhise V, et al. Computerized triggers of big data to detect delays in follow-up of chest imaging results. Chest. 2016;150:613–20.CrossRefPubMed
36.
go back to reference Meyer AND, Murphy DR, Singh H. Communicating findings of delayed diagnostic evaluation to primary care providers. J Am Board Fam Med. 2016;29:469–73.CrossRefPubMed Meyer AND, Murphy DR, Singh H. Communicating findings of delayed diagnostic evaluation to primary care providers. J Am Board Fam Med. 2016;29:469–73.CrossRefPubMed
Metadata
Title
Electronic Detection of Delayed Test Result Follow-Up in Patients with Hypothyroidism
Authors
Ashley N. D. Meyer, PhD
Daniel R. Murphy, MD, MBA
Aymer Al-Mutairi, MD
Dean F. Sittig, PhD
Li Wei, MS
Elise Russo, MPH
Hardeep Singh, MD, MPH
Publication date
01-07-2017
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 7/2017
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-017-3988-z

Other articles of this Issue 7/2017

Journal of General Internal Medicine 7/2017 Go to the issue