Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Debate

Using value of information to guide evaluation of decision supports for differential diagnosis: is it time for a new look?

Authors: R Scott Braithwaite, Matthew Scotch

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

Decision support systems for differential diagnosis have traditionally been evaluated on the basis of criteria how sensitively and specifically they are able to identify the correct diagnosis established by expert clinicians.

Discussion

This article questions whether evaluation criteria pertaining to identifying the correct diagnosis are most appropriate or useful. Instead it advocates evaluation of decision support systems for differential diagnosis based on the criterion of maximizing value of information.

Summary

This approach quantitatively and systematically integrates several important clinical management priorities, including avoiding serious diagnostic errors of omission and avoiding harmful or expensive tests.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ramnarayan P, Roberts GC, Coren M, Nanduri V, Tomlinson A, Taylor PM, Wyatt JC, Britto JF: Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006, 6: 22-10.1186/1472-6947-6-22.CrossRefPubMedPubMedCentral Ramnarayan P, Roberts GC, Coren M, Nanduri V, Tomlinson A, Taylor PM, Wyatt JC, Britto JF: Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006, 6: 22-10.1186/1472-6947-6-22.CrossRefPubMedPubMedCentral
2.
go back to reference Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, Purves I: Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325 (7370): 941-10.1136/bmj.325.7370.941.CrossRefPubMedPubMedCentral Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, Purves I: Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325 (7370): 941-10.1136/bmj.325.7370.941.CrossRefPubMedPubMedCentral
3.
go back to reference Smith WR: Evidence for the effectiveness of techniques to change physician behavior. Chest. 2000, 118 (2 Suppl): 8S-17S.CrossRefPubMed Smith WR: Evidence for the effectiveness of techniques to change physician behavior. Chest. 2000, 118 (2 Suppl): 8S-17S.CrossRefPubMed
4.
go back to reference Berner ES, Maisiak RS, Heuderbert GR, Young KR: Clinician performance and prominence of diagnoses displayed by a clinical diagnostic decision support system. AMIA Annu Symp Proc. 2003, 76-80. Berner ES, Maisiak RS, Heuderbert GR, Young KR: Clinician performance and prominence of diagnoses displayed by a clinical diagnostic decision support system. AMIA Annu Symp Proc. 2003, 76-80.
5.
go back to reference Claxton K, Posnett J: An economic approach to clinical trial design and research priority-setting. Health Econ. 1996, 5 (6): 513-524. 10.1002/(SICI)1099-1050(199611)5:6<513::AID-HEC237>3.0.CO;2-9.CrossRefPubMed Claxton K, Posnett J: An economic approach to clinical trial design and research priority-setting. Health Econ. 1996, 5 (6): 513-524. 10.1002/(SICI)1099-1050(199611)5:6<513::AID-HEC237>3.0.CO;2-9.CrossRefPubMed
6.
go back to reference Ramnarayan P, Kapoor RR, Coren M, Nanduri V, Tomlinson AL, Taylor PM, Wyatt JC, Britto JF: Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score. J Am Med Inform Assoc. 2003, 10 (6): 563-572. 10.1197/jamia.M1338.CrossRefPubMedPubMedCentral Ramnarayan P, Kapoor RR, Coren M, Nanduri V, Tomlinson AL, Taylor PM, Wyatt JC, Britto JF: Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score. J Am Med Inform Assoc. 2003, 10 (6): 563-572. 10.1197/jamia.M1338.CrossRefPubMedPubMedCentral
7.
go back to reference Berner ES, Webster GD, Shugerman AA, Jackson JR, Algina J, Baker AL, Ball EV, Cobbs CG, Dennis VW, Frenkel EP: Performance of four computer-based diagnostic systems. N Engl J Med. 1994, 330 (25): 1792-1796. 10.1056/NEJM199406233302506.CrossRefPubMed Berner ES, Webster GD, Shugerman AA, Jackson JR, Algina J, Baker AL, Ball EV, Cobbs CG, Dennis VW, Frenkel EP: Performance of four computer-based diagnostic systems. N Engl J Med. 1994, 330 (25): 1792-1796. 10.1056/NEJM199406233302506.CrossRefPubMed
8.
go back to reference Friedman CP, Elstein AS, Wolf FM, Murphy GC, Franz TM, Heckerling PS, Fine PL, Miller TM, Abraham V: Enhancement of clinicians’ diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999, 282 (19): 1851-1856. 10.1001/jama.282.19.1851.CrossRefPubMed Friedman CP, Elstein AS, Wolf FM, Murphy GC, Franz TM, Heckerling PS, Fine PL, Miller TM, Abraham V: Enhancement of clinicians’ diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999, 282 (19): 1851-1856. 10.1001/jama.282.19.1851.CrossRefPubMed
10.
go back to reference Turner CW, Lincoln MJ, Haug P, Williamson JW, Jessen S, Cundick K, Warner H: Iliad training effects: a cognitive model and empirical findings. Proc Annu Symp Comput Appl Med Care. 1991, 68-72. Turner CW, Lincoln MJ, Haug P, Williamson JW, Jessen S, Cundick K, Warner H: Iliad training effects: a cognitive model and empirical findings. Proc Annu Symp Comput Appl Med Care. 1991, 68-72.
11.
go back to reference Lincoln MJ, Turner CW, Haug PJ, Warner HR, Williamson JW, Bouhaddou O, Jessen SG, Sorenson D, Cundick RC, Grant M: Iliad training enhances medical students’ diagnostic skills. J Med Syst. 1991, 15 (1): 93-110. 10.1007/BF00993883.CrossRefPubMed Lincoln MJ, Turner CW, Haug PJ, Warner HR, Williamson JW, Bouhaddou O, Jessen SG, Sorenson D, Cundick RC, Grant M: Iliad training enhances medical students’ diagnostic skills. J Med Syst. 1991, 15 (1): 93-110. 10.1007/BF00993883.CrossRefPubMed
12.
go back to reference PCORI: Patient-centered outcomes research institute. National priorities for research and research agenda. 2012 PCORI: Patient-centered outcomes research institute. National priorities for research and research agenda. 2012
13.
go back to reference Griffin S, Welton NJ, Claxton K: Exploring the research decision space: the expected value of information for sequential research designs. Med Decis Making. 2010, 30 (2): 155-162. 10.1177/0272989X09344746.CrossRefPubMed Griffin S, Welton NJ, Claxton K: Exploring the research decision space: the expected value of information for sequential research designs. Med Decis Making. 2010, 30 (2): 155-162. 10.1177/0272989X09344746.CrossRefPubMed
14.
go back to reference Miller RA, Pople HE, Myers JD: Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982, 307 (8): 468-476. 10.1056/NEJM198208193070803.CrossRefPubMed Miller RA, Pople HE, Myers JD: Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982, 307 (8): 468-476. 10.1056/NEJM198208193070803.CrossRefPubMed
15.
go back to reference Downs SM, Friedman CP, Marasigan F, Gartner G: A decision analytic method for scoring performance on computer-based patient simulations. Proc AMIA Annu Fall Symp. 1997, 667-671. Downs SM, Friedman CP, Marasigan F, Gartner G: A decision analytic method for scoring performance on computer-based patient simulations. Proc AMIA Annu Fall Symp. 1997, 667-671.
16.
go back to reference Gold MR, Siegel JE, Russell LB, Weinstein MC: Cost-Effectiveness in Health and Medicine. 1996, New York: Oxford University Press Gold MR, Siegel JE, Russell LB, Weinstein MC: Cost-Effectiveness in Health and Medicine. 1996, New York: Oxford University Press
17.
go back to reference Downs SM, Marasigan F, Abraham V, Wildemuth B, Friedman CP: Scoring performance on computer-based patient simulations: beyond value of information. Proc AMIA Symp. 1999, 520-524. Downs SM, Marasigan F, Abraham V, Wildemuth B, Friedman CP: Scoring performance on computer-based patient simulations: beyond value of information. Proc AMIA Symp. 1999, 520-524.
18.
go back to reference Kassirer JP, Kopelman RI: Cognitive errors in diagnosis: instantiation, classification, and consequences. Am J Med. 1989, 86 (4): 433-441. 10.1016/0002-9343(89)90342-2.CrossRefPubMed Kassirer JP, Kopelman RI: Cognitive errors in diagnosis: instantiation, classification, and consequences. Am J Med. 1989, 86 (4): 433-441. 10.1016/0002-9343(89)90342-2.CrossRefPubMed
Metadata
Title
Using value of information to guide evaluation of decision supports for differential diagnosis: is it time for a new look?
Authors
R Scott Braithwaite
Matthew Scotch
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-105

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue