Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2006

Open Access 01-12-2006 | Debate

Decision tools in health care: focus on the problem, not the solution

Authors: Joseph Liu, Jeremy C Wyatt, Douglas G Altman

Published in: BMC Medical Informatics and Decision Making | Issue 1/2006

Login to get access

Abstract

Background

Systematic reviews or randomised-controlled trials usually help to establish the effectiveness of drugs and other health technologies, but are rarely sufficient by themselves to ensure actual clinical use of the technology. The process from innovation to routine clinical use is complex. Numerous computerised decision support systems (DSS) have been developed, but many fail to be taken up into actual use. Some developers construct technologically advanced systems with little relevance to the real world. Others did not determine whether a clinical need exists. With NHS investing £5 billion in computer systems, also occurring in other countries, there is an urgent need to shift from a technology-driven approach to one that identifies and employs the most cost-effective method to manage knowledge, regardless of the technology. The generic term, 'decision tool' (DT), is therefore suggested to demonstrate that these aids, which seem different technically, are conceptually the same from a clinical viewpoint.

Discussion

Many computerised DSSs failed for various reasons, for example, they were not based on best available knowledge; there was insufficient emphasis on their need for high quality clinical data; their development was technology-led; or evaluation methods were misapplied. We argue that DSSs and other computer-based, paper-based and even mechanical decision aids are members of a wider family of decision tools. A DT is an active knowledge resource that uses patient data to generate case specific advice, which supports decision making about individual patients by health professionals, the patients themselves or others concerned about them. The identification of DTs as a consistent and important category of health technology should encourage the sharing of lessons between DT developers and users and reduce the frequency of decision tool projects focusing only on technology. The focus of evaluation should become more clinical, with the impact of computer-based DTs being evaluated against other computer, paper- or mechanical tools, to identify the most cost effective tool for each clinical problem.

Summary

We suggested the generic term 'decision tool' to demonstrate that decision-making aids, such as computerised DSSs, paper algorithms, and reminders are conceptually the same, so the methods to evaluate them should be the same.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kennedy I: The Report of the Public Inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995: Learning from Bristol. The Bristol Royal Infirmary Inquiry. 2001, http://www.bristol-inquiry.org.uk/final_report/ Kennedy I: The Report of the Public Inquiry into children's heart surgery at the Bristol Royal Infirmary 1984-1995: Learning from Bristol. The Bristol Royal Infirmary Inquiry. 2001, http://​www.​bristol-inquiry.​org.​uk/​final_​report/​
2.
go back to reference Society BC, Association BH, Society BH, Association BD: Joint British recommendations on prevention of coronary heart disease in clinical practice: summary. BMJ. 2000, 320: 705-708. 10.1136/bmj.320.7236.705.CrossRef Society BC, Association BH, Society BH, Association BD: Joint British recommendations on prevention of coronary heart disease in clinical practice: summary. BMJ. 2000, 320: 705-708. 10.1136/bmj.320.7236.705.CrossRef
3.
go back to reference Monkman D: Treating dyslipidaemia in primary care: the gap between policy and reality is large in the UK. BMJ. 2000, 320: 1299-1300. 10.1136/bmj.321.7272.1299.CrossRef Monkman D: Treating dyslipidaemia in primary care: the gap between policy and reality is large in the UK. BMJ. 2000, 320: 1299-1300. 10.1136/bmj.321.7272.1299.CrossRef
4.
go back to reference Adams ID, Chan M, Clifford PC, Cooke WM, Dallos V, de Dombal FT, Edwards MH, Hancock DM, Hewett DJ, McCintyre N, Somerville PG, Spiegelhalter DJ, Wellwood J, Wilson DH: Computer aided diagnosis of acute abdominal pain: a multicentre study. BMJ. 1986, 293: 800-804.CrossRefPubMedPubMedCentral Adams ID, Chan M, Clifford PC, Cooke WM, Dallos V, de Dombal FT, Edwards MH, Hancock DM, Hewett DJ, McCintyre N, Somerville PG, Spiegelhalter DJ, Wellwood J, Wilson DH: Computer aided diagnosis of acute abdominal pain: a multicentre study. BMJ. 1986, 293: 800-804.CrossRefPubMedPubMedCentral
5.
go back to reference Wyatt JC: Practice guidelines and other support for clinical innovation. Journal of the Royal Society of Medicine. 2000, 93: 290-304. Wyatt JC: Practice guidelines and other support for clinical innovation. Journal of the Royal Society of Medicine. 2000, 93: 290-304.
6.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene S, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene S, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
7.
go back to reference Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, Purves I: Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325: 941-944. 10.1136/bmj.325.7370.941.CrossRefPubMedPubMedCentral Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, Purves I: Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325: 941-944. 10.1136/bmj.325.7370.941.CrossRefPubMedPubMedCentral
8.
go back to reference Randolph AD, Haynes RB, Wyatt JC, Cook DJ, Guyatt GH: Users' guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system. JAMA. 1999, 282: 67-74. 10.1001/jama.282.1.67.CrossRefPubMed Randolph AD, Haynes RB, Wyatt JC, Cook DJ, Guyatt GH: Users' guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system. JAMA. 1999, 282: 67-74. 10.1001/jama.282.1.67.CrossRefPubMed
9.
go back to reference Wyatt JC: Clinical data systems, Part 3: Development and evaluation. Lancet. 1994, 344: 1682-1688. 10.1016/S0140-6736(94)90463-4.CrossRefPubMed Wyatt JC: Clinical data systems, Part 3: Development and evaluation. Lancet. 1994, 344: 1682-1688. 10.1016/S0140-6736(94)90463-4.CrossRefPubMed
10.
11.
go back to reference Eccles M, Steen N, Grimshaw J, Thomas L, McNamee SJ, Soutter J, Wilsdon J, Matowe L, Needham G, Gilbert F, Bond S: Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001, 357: 1406-1409. 10.1016/S0140-6736(00)04564-5.CrossRefPubMed Eccles M, Steen N, Grimshaw J, Thomas L, McNamee SJ, Soutter J, Wilsdon J, Matowe L, Needham G, Gilbert F, Bond S: Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001, 357: 1406-1409. 10.1016/S0140-6736(00)04564-5.CrossRefPubMed
12.
go back to reference Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ: A computerized reminder system to increase the use of preventive care for hospitalized patients. New England Journal of Medicine. 2001, 345: 965-970. 10.1056/NEJMsa010181.CrossRefPubMed Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ: A computerized reminder system to increase the use of preventive care for hospitalized patients. New England Journal of Medicine. 2001, 345: 965-970. 10.1056/NEJMsa010181.CrossRefPubMed
13.
go back to reference O'Connor AM, Rostom A, Fiset V, Tetroe J, Entwistle V, Llewellyn-Thomas H, Holmes-Rovner M, Barry M, Jones J: Decision aids for patients facing health treatment or screening decisions: systematic review. BMJ. 1999, 319: 731-734.CrossRefPubMedPubMedCentral O'Connor AM, Rostom A, Fiset V, Tetroe J, Entwistle V, Llewellyn-Thomas H, Holmes-Rovner M, Barry M, Jones J: Decision aids for patients facing health treatment or screening decisions: systematic review. BMJ. 1999, 319: 731-734.CrossRefPubMedPubMedCentral
14.
go back to reference Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenniger J, Hubert P, Lacroix J, Leclerc F: Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003, 362: 192-197. 10.1016/S0140-6736(03)13908-6.CrossRefPubMed Leteurtre S, Martinot A, Duhamel A, Proulx F, Grandbastien B, Cotting J, Gottesman R, Joffe A, Pfenniger J, Hubert P, Lacroix J, Leclerc F: Validation of the paediatric logistic organ dysfunction (PELOD) score: prospective, observational, multicentre study. Lancet. 2003, 362: 192-197. 10.1016/S0140-6736(03)13908-6.CrossRefPubMed
15.
go back to reference Bachmann LM, Kolb E, Koller MT, Steurer J, ter Riet G: Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ. 2003, 326: 417-419. 10.1136/bmj.326.7386.417.CrossRefPubMedPubMedCentral Bachmann LM, Kolb E, Koller MT, Steurer J, ter Riet G: Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ. 2003, 326: 417-419. 10.1136/bmj.326.7386.417.CrossRefPubMedPubMedCentral
16.
go back to reference Murray LS, Teasdale GM, Murray GD, Jennett B, Miller JD, Pickard JD, Shaw MD, Achilles J, Bailey S, Jones P, Kelly D, Lacey J: Does prediction of outcome alter patient management?. Lancet. 1993, 341: 1487-1491. 10.1016/0140-6736(93)90631-P.CrossRefPubMed Murray LS, Teasdale GM, Murray GD, Jennett B, Miller JD, Pickard JD, Shaw MD, Achilles J, Bailey S, Jones P, Kelly D, Lacey J: Does prediction of outcome alter patient management?. Lancet. 1993, 341: 1487-1491. 10.1016/0140-6736(93)90631-P.CrossRefPubMed
17.
go back to reference Rood E, Bosnan RJ, Van der Spoel JI, Taylor P, Zandstra DF: Use of a computerized guideline for glucose regulation in the ICU improved both guideline adherence and glucose regulation. J Am Med Inform Assoc. 2005, 12: 172-180. 10.1197/jamia.M1598.CrossRefPubMedPubMedCentral Rood E, Bosnan RJ, Van der Spoel JI, Taylor P, Zandstra DF: Use of a computerized guideline for glucose regulation in the ICU improved both guideline adherence and glucose regulation. J Am Med Inform Assoc. 2005, 12: 172-180. 10.1197/jamia.M1598.CrossRefPubMedPubMedCentral
18.
go back to reference Gremy F: Information systems evaluation and subjectivity. International Journal of Medical Informatics. 1999, 56: 13-23. 10.1016/S1386-5056(99)00034-9.CrossRefPubMed Gremy F: Information systems evaluation and subjectivity. International Journal of Medical Informatics. 1999, 56: 13-23. 10.1016/S1386-5056(99)00034-9.CrossRefPubMed
19.
go back to reference Whitten PS, Mair FS, Haycox A, May CR, Williams TL, Hellmich S: Systematic review of cost effectiveness studies of telemedicine interventions. BMJ. 2002, 324: 1434-1437. 10.1136/bmj.324.7351.1434.CrossRefPubMedPubMedCentral Whitten PS, Mair FS, Haycox A, May CR, Williams TL, Hellmich S: Systematic review of cost effectiveness studies of telemedicine interventions. BMJ. 2002, 324: 1434-1437. 10.1136/bmj.324.7351.1434.CrossRefPubMedPubMedCentral
20.
go back to reference Wyatt JC, Spiegelhalter DJ: Field trials of medical decision-aids: potential problems and solutions. Proc Annu Symp Comput Appl Med Care. 1991, 3-7. Wyatt JC, Spiegelhalter DJ: Field trials of medical decision-aids: potential problems and solutions. Proc Annu Symp Comput Appl Med Care. 1991, 3-7.
21.
go back to reference Brahams D, Wyatt JC: Decision aids and the law. Lancet. 1989, 2: 632-634. 10.1016/S0140-6736(89)90765-4.CrossRefPubMed Brahams D, Wyatt JC: Decision aids and the law. Lancet. 1989, 2: 632-634. 10.1016/S0140-6736(89)90765-4.CrossRefPubMed
22.
go back to reference Hart A, Wyatt JC: Evaluating black boxes as medical decision aids: issues arising from a study of neural networks. Med Inform. 1990, 15: 229-236.CrossRef Hart A, Wyatt JC: Evaluating black boxes as medical decision aids: issues arising from a study of neural networks. Med Inform. 1990, 15: 229-236.CrossRef
23.
go back to reference Donawa M: FDA final guidance on software validation. Medical Device Technology. 2002, 13: 20-24.PubMed Donawa M: FDA final guidance on software validation. Medical Device Technology. 2002, 13: 20-24.PubMed
24.
go back to reference National Institute for Health and Clinical Excellence: NICE to assess the feasibility of evaluating computerised decision support systems. 2005, http://www.nice.org.uk/page.aspx?o=265920 National Institute for Health and Clinical Excellence: NICE to assess the feasibility of evaluating computerised decision support systems. 2005, http://​www.​nice.​org.​uk/​page.​aspx?​o=​265920
26.
go back to reference Bryce FP, Neville RG, Crombie IK, Clark RA, McKenzie P: Controlled trial of an audit facilitator in diagnosis and treatment of childhood asthma in general practice. BMJ. 1995, 310: 838-842.CrossRefPubMedPubMedCentral Bryce FP, Neville RG, Crombie IK, Clark RA, McKenzie P: Controlled trial of an audit facilitator in diagnosis and treatment of childhood asthma in general practice. BMJ. 1995, 310: 838-842.CrossRefPubMedPubMedCentral
27.
go back to reference Holtzman J, Bjerke T, Kane R: The effects of clinical pathways for renal transplantation on patient outcomes and length of stay. Medical Care. 1998, 36: 826-834. 10.1097/00005650-199806000-00006.CrossRefPubMed Holtzman J, Bjerke T, Kane R: The effects of clinical pathways for renal transplantation on patient outcomes and length of stay. Medical Care. 1998, 36: 826-834. 10.1097/00005650-199806000-00006.CrossRefPubMed
28.
29.
go back to reference Lilford RJ, Kelly M, Baines A, Cameron S, Cave M, Guthrie K, Thornton J: Effect of using protocols on medical care; randomised controlled trial of three methods of antenatal history taking. BMJ. 1992, 305: 1181-1184.CrossRefPubMedPubMedCentral Lilford RJ, Kelly M, Baines A, Cameron S, Cave M, Guthrie K, Thornton J: Effect of using protocols on medical care; randomised controlled trial of three methods of antenatal history taking. BMJ. 1992, 305: 1181-1184.CrossRefPubMedPubMedCentral
30.
go back to reference Wallace P, Haines A, Harrison R, Barber J, Thompson S, Jacklin P, Roberts J, Lewis L, Wainwright P: Joint teleconsultations (virtual outreach) versus standard outpatient appointments for patients referred by their general practitioner for a specialist opinion: a randomised trial. Lancet. 2002, 359: 1961-1968. 10.1016/S0140-6736(02)08828-1.CrossRefPubMed Wallace P, Haines A, Harrison R, Barber J, Thompson S, Jacklin P, Roberts J, Lewis L, Wainwright P: Joint teleconsultations (virtual outreach) versus standard outpatient appointments for patients referred by their general practitioner for a specialist opinion: a randomised trial. Lancet. 2002, 359: 1961-1968. 10.1016/S0140-6736(02)08828-1.CrossRefPubMed
31.
go back to reference Davis DA, Thomson MA, Oxman AD, Haynes RB: Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995, 274: 700-705. 10.1001/jama.274.9.700.CrossRefPubMed Davis DA, Thomson MA, Oxman AD, Haynes RB: Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995, 274: 700-705. 10.1001/jama.274.9.700.CrossRefPubMed
32.
go back to reference Hoffer EP, Barnett GO: Computer-aided instruction in medicine: 16 years of MGH experience. MEDINFO 1986. Edited by: Salamon R, Blum B and Jorgensen M. 1986, Amsterdam, Elsevier North-Holland Hoffer EP, Barnett GO: Computer-aided instruction in medicine: 16 years of MGH experience. MEDINFO 1986. Edited by: Salamon R, Blum B and Jorgensen M. 1986, Amsterdam, Elsevier North-Holland
Metadata
Title
Decision tools in health care: focus on the problem, not the solution
Authors
Joseph Liu
Jeremy C Wyatt
Douglas G Altman
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2006
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-6-4

Other articles of this Issue 1/2006

BMC Medical Informatics and Decision Making 1/2006 Go to the issue