Skip to main content
Top
Published in: Journal of General Internal Medicine 1/2008

Open Access 01-01-2008 | Original Article

Performance of a Web-Based Clinical Diagnosis Support System for Internists

Authors: Mark L. Graber, MD, Ashlei Mathew

Published in: Journal of General Internal Medicine | Special Issue 1/2008

Login to get access

Abstract

BACKGROUND

Clinical decision support systems can improve medical diagnosis and reduce diagnostic errors. Older systems, however, were cumbersome to use and had limited success in identifying the correct diagnosis in complicated cases.

OBJECTIVE

To measure the sensitivity and speed of “Isabel” (Isabel Healthcare Inc., USA), a new web-based clinical decision support system designed to suggest the correct diagnosis in complex medical cases involving adults.

METHODS

We tested 50 consecutive Internal Medicine case records published in the New England Journal of Medicine. We first either manually entered 3 to 6 key clinical findings from the case (recommended approach) or pasted in the entire case history. The investigator entering key words was aware of the correct diagnosis. We then determined how often the correct diagnosis was suggested in the list of 30 differential diagnoses generated by the clinical decision support system. We also evaluated the speed of data entry and results recovery.

RESULTS

The clinical decision support system suggested the correct diagnosis in 48 of 50 cases (96%) with key findings entry, and in 37 of the 50 cases (74%) if the entire case history was pasted in. Pasting took seconds, manual entry less than a minute, and results were provided within 2–3 seconds with either approach.

CONCLUSIONS

The Isabel clinical decision support system quickly suggested the correct diagnosis in almost all of these complex cases, particularly with key finding entry. The system performed well in this experimental setting and merits evaluation in more natural settings and clinical practice.
Literature
1.
go back to reference Berner ES. Clinical Decision Support Systems. New York: Springer; 1999. Berner ES. Clinical Decision Support Systems. New York: Springer; 1999.
2.
go back to reference Garg AX, Adhikari NKJ, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. JAMA. 2005;293:1223–38.PubMedCrossRef Garg AX, Adhikari NKJ, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. JAMA. 2005;293:1223–38.PubMedCrossRef
3.
go back to reference Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792–6.PubMedCrossRef Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792–6.PubMedCrossRef
4.
go back to reference Friedman CP, Elstein AS, Wolf FM, et al. Enhancement of clinicians’ diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999;282:1851–6.PubMedCrossRef Friedman CP, Elstein AS, Wolf FM, et al. Enhancement of clinicians’ diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999;282:1851–6.PubMedCrossRef
5.
go back to reference Lincoln MJ, Turner CW, Haug PJ, et al. Iliad’s role in the generalization of learning across a medical domain. Proc Annu Symp Comput Appl Med Care. 1992;174–8. Lincoln MJ, Turner CW, Haug PJ, et al. Iliad’s role in the generalization of learning across a medical domain. Proc Annu Symp Comput Appl Med Care. 1992;174–8.
6.
go back to reference Kassirer JP. A report card on computer-assisted diagnosis—the grade: C. N Engl J Med. 1994;330:1824–5.PubMedCrossRef Kassirer JP. A report card on computer-assisted diagnosis—the grade: C. N Engl J Med. 1994;330:1824–5.PubMedCrossRef
7.
go back to reference Graber MA, VanScoy D. How well does decision support software perform in the emergency department? Emerg Med J. 2003;20:426–8.PubMedCrossRef Graber MA, VanScoy D. How well does decision support software perform in the emergency department? Emerg Med J. 2003;20:426–8.PubMedCrossRef
8.
go back to reference Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnosis aid for paediatrics: results from an initial performance evaluation. Arch Dis Child. 2003;88:408–13.PubMedCrossRef Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnosis aid for paediatrics: results from an initial performance evaluation. Arch Dis Child. 2003;88:408–13.PubMedCrossRef
9.
go back to reference Ramnarayan P, Roberts GC, Coren M, et al. Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006;6:22.PubMedCrossRef Ramnarayan P, Roberts GC, Coren M, et al. Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006;6:22.PubMedCrossRef
10.
go back to reference Graber ML. Diagnostic error in medicine—a case of neglect. Joint Comm J Saf Qual Improv. 2004;31:112–19. Graber ML. Diagnostic error in medicine—a case of neglect. Joint Comm J Saf Qual Improv. 2004;31:112–19.
11.
go back to reference Graber ML, Franklin N, Gordon RR. Diagnostic error in internal medicine. Arch Int Med. 2005;165:1493–9.CrossRef Graber ML, Franklin N, Gordon RR. Diagnostic error in internal medicine. Arch Int Med. 2005;165:1493–9.CrossRef
12.
go back to reference Tang H, Ng JHK. Googling for a diagnosis—use of Google as a diagnostic aid: internet based study. Br Med J. 2006. Tang H, Ng JHK. Googling for a diagnosis—use of Google as a diagnostic aid: internet based study. Br Med J. 2006.
13.
go back to reference Kantor G. Guest software review: Isabel diagnosis software. 2006;1–31. Kantor G. Guest software review: Isabel diagnosis software. 2006;1–31.
14.
go back to reference Graber ML, Franklin N, Gordon R. Reducing diagnostic error in medicine: what’s the goal? Acad Med. 2002;77:981–92.PubMedCrossRef Graber ML, Franklin N, Gordon R. Reducing diagnostic error in medicine: what’s the goal? Acad Med. 2002;77:981–92.PubMedCrossRef
Metadata
Title
Performance of a Web-Based Clinical Diagnosis Support System for Internists
Authors
Mark L. Graber, MD
Ashlei Mathew
Publication date
01-01-2008
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue Special Issue 1/2008
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-007-0271-8

Other articles of this Special Issue 1/2008

Journal of General Internal Medicine 1/2008 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.