Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2010

Open Access 01-12-2010 | Research article

How to translate therapeutic recommendations in clinical practice guidelines into rules for critiquing physician prescriptions? Methods and application to five guidelines

Authors: Jean-Baptiste Lamy, Vahid Ebrahiminia, Christine Riou, Brigitte Seroussi, Jacques Bouaud, Christian Simon, Stéphane Dubois, Antoine Butti, Gérard Simon, Madeleine Favre, Hector Falcoff, Alain Venot

Published in: BMC Medical Informatics and Decision Making | Issue 1/2010

Login to get access

Abstract

Background

Clinical practice guidelines give recommendations about what to do in various medical situations, including therapeutical recommendations for drug prescription. An effective way to computerize these recommendations is to design critiquing decision support systems, i.e. systems that criticize the physician's prescription when it does not conform to the guidelines. These systems are commonly based on a list of "if conditions then criticism" rules. However, writing these rules from the guidelines is not a trivial task. The objective of this article is to propose methods that (1) simplify the implementation of guidelines' therapeutical recommendations in critiquing systems by automatically translating structured therapeutical recommendations into a list of "if conditions then criticize" rules, and (2) can generate an appropriate textual label to explain to the physician why his/her prescription is not recommended.

Methods

We worked on the therapeutic recommendations in five clinical practice guidelines concerning chronic diseases related to the management of cardiovascular risk. We evaluated the system using a test base of more than 2000 cases.

Results

Algorithms for automatically translating therapeutical recommendations into "if conditions then criticize" rules are presented. Eight generic recommendations are also proposed; they are guideline-independent, and can be used as default behaviour for handling various situations that are usually implicit in the guidelines, such as decreasing the dose of a poorly tolerated drug. Finally, we provide models and methods for generating a human-readable textual critique. The system was successfully evaluated on the test base.

Conclusion

We show that it is possible to criticize physicians' prescriptions starting from a structured clinical guideline, and to provide clear explanations. We are now planning a randomized clinical trial to evaluate the impact of the system on practices.
Appendix
Available only for authorised users
Literature
1.
go back to reference Grimshaw J, Russel I: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993, 342 (8883): 1317-22. 10.1016/0140-6736(93)92244-N.CrossRefPubMed Grimshaw J, Russel I: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993, 342 (8883): 1317-22. 10.1016/0140-6736(93)92244-N.CrossRefPubMed
2.
go back to reference Dufour J, Bouvenot J, Ambrosi P, Fieschi D, Fieschi M: Textual Guidelines versus Computable Guidelines: A Comparative Study in the Framework of the PRESGUID Project in Order to Appreciate the Impact of Guideline Format on Physician Compliance. Proc AMIA Symp. 2006, Washington, DC, 219-223. Dufour J, Bouvenot J, Ambrosi P, Fieschi D, Fieschi M: Textual Guidelines versus Computable Guidelines: A Comparative Study in the Framework of the PRESGUID Project in Order to Appreciate the Impact of Guideline Format on Physician Compliance. Proc AMIA Symp. 2006, Washington, DC, 219-223.
3.
go back to reference Perria C, Mandolini D, Guerrera C, Jefferson T, Billi P, Calzini V, Fiorillo A, Grasso G, Leotta S, Marrocco W, Suraci C, Pasquarella A: Implementing a guideline for the treatment of type 2 diabetics: results of a Cluster-Randomized Controlled Trial (C-RCT). BMC Health Services Research. 2007, 7: 79-10.1186/1472-6963-7-79.CrossRefPubMedPubMedCentral Perria C, Mandolini D, Guerrera C, Jefferson T, Billi P, Calzini V, Fiorillo A, Grasso G, Leotta S, Marrocco W, Suraci C, Pasquarella A: Implementing a guideline for the treatment of type 2 diabetics: results of a Cluster-Randomized Controlled Trial (C-RCT). BMC Health Services Research. 2007, 7: 79-10.1186/1472-6963-7-79.CrossRefPubMedPubMedCentral
4.
go back to reference Garg A, Adhikari N, McDonald H, Rosas-Arellano M, Devereaux P, Beyene J, Sam J, Haynes R: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed Garg A, Adhikari N, McDonald H, Rosas-Arellano M, Devereaux P, Beyene J, Sam J, Haynes R: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
5.
go back to reference Kawamoto K, Houlihan C, Balas E, Lobach D: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330 (7494): 765-10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral Kawamoto K, Houlihan C, Balas E, Lobach D: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330 (7494): 765-10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral
6.
go back to reference Green C, Fortin P, Maclure M, Macgregor A, Robinson S: Information system support as a critical success factor for chronic disease management: Necessary but not sufficient. Int J Med Inf. 2006, 75 (12): 818-828. 10.1016/j.ijmedinf.2006.05.042.CrossRef Green C, Fortin P, Maclure M, Macgregor A, Robinson S: Information system support as a critical success factor for chronic disease management: Necessary but not sufficient. Int J Med Inf. 2006, 75 (12): 818-828. 10.1016/j.ijmedinf.2006.05.042.CrossRef
7.
go back to reference Sittig D, Krall M, Dykstra R, Russell A, Chin H: A survey of factors affecting clinician acceptance of clinical decision support. BMC Medical Informatics and Decision Making. 2006, 6: 6-10.1186/1472-6947-6-6.CrossRefPubMedPubMedCentral Sittig D, Krall M, Dykstra R, Russell A, Chin H: A survey of factors affecting clinician acceptance of clinical decision support. BMC Medical Informatics and Decision Making. 2006, 6: 6-10.1186/1472-6947-6-6.CrossRefPubMedPubMedCentral
8.
go back to reference Sips R, Braun L, Roos N: Enabling protocol-based medical critiquing. Stud Health Technol Inform. 2006, 124: 471-476.PubMed Sips R, Braun L, Roos N: Enabling protocol-based medical critiquing. Stud Health Technol Inform. 2006, 124: 471-476.PubMed
9.
go back to reference Van Wyk J, van Wijk M, Sturkenboom M, Mosseveld M, Moorman P, van der Lei J: Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation. 2008, 117 (3): 371-378. 10.1161/CIRCULATIONAHA.107.697201.CrossRefPubMed Van Wyk J, van Wijk M, Sturkenboom M, Mosseveld M, Moorman P, van der Lei J: Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation. 2008, 117 (3): 371-378. 10.1161/CIRCULATIONAHA.107.697201.CrossRefPubMed
10.
11.
go back to reference Kuilboer M, van Wijk M, Mosseveld M, van der Does E, de Jongste J, Overbeek S, Ponsioen B, van der Lei J: Computed critiquing integrated into daily clinical practice affects physicians' behavior--a randomized clinical trial with AsthmaCritic. Methods Inf Med. 2006, 45 (4): 447-454.PubMed Kuilboer M, van Wijk M, Mosseveld M, van der Does E, de Jongste J, Overbeek S, Ponsioen B, van der Lei J: Computed critiquing integrated into daily clinical practice affects physicians' behavior--a randomized clinical trial with AsthmaCritic. Methods Inf Med. 2006, 45 (4): 447-454.PubMed
12.
go back to reference Kuilboer M, van Wijk M, Mosseveld M, van der Lei J: AsthmaCritic: Issues in designing a noninquisitive critiquing system for daily practice. J Am Med Inform Assoc. 2003, 10 (5): 419-424. 10.1197/jamia.M1273.CrossRefPubMedPubMedCentral Kuilboer M, van Wijk M, Mosseveld M, van der Lei J: AsthmaCritic: Issues in designing a noninquisitive critiquing system for daily practice. J Am Med Inform Assoc. 2003, 10 (5): 419-424. 10.1197/jamia.M1273.CrossRefPubMedPubMedCentral
13.
go back to reference Martens J, van der Weijden T, Severens J, de Clercq P, de Bruijn D, Kester A, Winkens R: The effect of computer reminders on GPs' prescribing behaviour: a cluster-randomised trial. Int J Med Inf. 2007, 76 (S3): S403-S416. 10.1016/j.ijmedinf.2007.04.005.CrossRef Martens J, van der Weijden T, Severens J, de Clercq P, de Bruijn D, Kester A, Winkens R: The effect of computer reminders on GPs' prescribing behaviour: a cluster-randomised trial. Int J Med Inf. 2007, 76 (S3): S403-S416. 10.1016/j.ijmedinf.2007.04.005.CrossRef
14.
go back to reference Bindels R, de Clercq P, Winkens R, Hasman A: A test ordering system with automated reminders for primary care based on practice guidelines. Int J Med Inf. 2000, 58-59: 219-233. 10.1016/S1386-5056(00)00089-7.CrossRef Bindels R, de Clercq P, Winkens R, Hasman A: A test ordering system with automated reminders for primary care based on practice guidelines. Int J Med Inf. 2000, 58-59: 219-233. 10.1016/S1386-5056(00)00089-7.CrossRef
15.
go back to reference Bindels R, Hasman A, van Wersch J, Talmon J, Winkens R: Evaluation of an automated test ordering and feedback system for general practitioners in daily practice. Int J Med Inf. 2004, 73 (9-10): 705-712. 10.1016/j.ijmedinf.2004.06.001.CrossRef Bindels R, Hasman A, van Wersch J, Talmon J, Winkens R: Evaluation of an automated test ordering and feedback system for general practitioners in daily practice. Int J Med Inf. 2004, 73 (9-10): 705-712. 10.1016/j.ijmedinf.2004.06.001.CrossRef
16.
go back to reference Séroussi B, Bouaud J, Dreau H, Falcoff H, Riou C, Joubert M, Simon C, Simon G, Venot A: ASTI: a guideline-based drug-ordering system for primary care. Medinfo, the Netherlands. 2001, 10: 528-32. Séroussi B, Bouaud J, Dreau H, Falcoff H, Riou C, Joubert M, Simon C, Simon G, Venot A: ASTI: a guideline-based drug-ordering system for primary care. Medinfo, the Netherlands. 2001, 10: 528-32.
17.
go back to reference Ebrahiminia V, Riou C, Séroussi B, Bouaud J, Dubois S, Falcoff H, Venot A: Design of a decision support system for chronic diseases coupling generic therapeutic algorithms with guideline-based specific rules. Stud Health Technol Inform. 2006, 124: 483-488.PubMed Ebrahiminia V, Riou C, Séroussi B, Bouaud J, Dubois S, Falcoff H, Venot A: Design of a decision support system for chronic diseases coupling generic therapeutic algorithms with guideline-based specific rules. Stud Health Technol Inform. 2006, 124: 483-488.PubMed
18.
go back to reference Ebrahiminia V, Duclos C, Toussi M, Riou C, Cohen R, Venot A: Representing the patient's therapeutic history in medical records and in guideline recommendations for chronic diseases using a unique model. Stud Health Technol Inform. 2005, 116: 101-6.PubMed Ebrahiminia V, Duclos C, Toussi M, Riou C, Cohen R, Venot A: Representing the patient's therapeutic history in medical records and in guideline recommendations for chronic diseases using a unique model. Stud Health Technol Inform. 2005, 116: 101-6.PubMed
19.
go back to reference Lamy JB, Ellini A, Ebrahiminia V, Zucker JD, Falcoff H, Venot A: Use of the C4.5 machine learning algorithm to test a clinical guideline-based decision support system. Stud Health Technol Inform. 2008, 136: 223-228.PubMedPubMedCentral Lamy JB, Ellini A, Ebrahiminia V, Zucker JD, Falcoff H, Venot A: Use of the C4.5 machine learning algorithm to test a clinical guideline-based decision support system. Stud Health Technol Inform. 2008, 136: 223-228.PubMedPubMedCentral
20.
go back to reference Bouaud J, Séroussi B, Falcoff H, Venot A: Complementarity of reminder-based and on-demand decision support according to clinical case complexity. Stud Health Technol Inform. 2005, 116: 1086-1091. Bouaud J, Séroussi B, Falcoff H, Venot A: Complementarity of reminder-based and on-demand decision support according to clinical case complexity. Stud Health Technol Inform. 2005, 116: 1086-1091.
21.
go back to reference Séroussi B, Bouaud J, Chatellier G: Guideline-based modeling of therapeutic strategies in the special case of chronic diseases. Int J Med Inf. 2005, 74 (2): 89-99. 10.1016/j.ijmedinf.2004.06.004.CrossRef Séroussi B, Bouaud J, Chatellier G: Guideline-based modeling of therapeutic strategies in the special case of chronic diseases. Int J Med Inf. 2005, 74 (2): 89-99. 10.1016/j.ijmedinf.2004.06.004.CrossRef
27.
go back to reference De Clercq P, Blom J, Korsten H, Hasman A: Approaches for creating computer-interpretable guidelines that facilitate decision support. Artif Intell Med. 2004, 31: 1-27. 10.1016/j.artmed.2004.02.003.CrossRefPubMed De Clercq P, Blom J, Korsten H, Hasman A: Approaches for creating computer-interpretable guidelines that facilitate decision support. Artif Intell Med. 2004, 31: 1-27. 10.1016/j.artmed.2004.02.003.CrossRefPubMed
28.
go back to reference Van der Lei J, Musen M: The separation of reviewing knowledge from medical knowledge. Methods Inf Med. 1995, 34 (1-2): 131-9.PubMed Van der Lei J, Musen M: The separation of reviewing knowledge from medical knowledge. Methods Inf Med. 1995, 34 (1-2): 131-9.PubMed
29.
go back to reference Albisser A, Alejandro R, Sperlich M, Ricordi C: Prescription checking device promises to resolve intractable hypoglycemia. Journal of diabetes science and technology. 2009, 3 (3): 524-532.CrossRefPubMed Albisser A, Alejandro R, Sperlich M, Ricordi C: Prescription checking device promises to resolve intractable hypoglycemia. Journal of diabetes science and technology. 2009, 3 (3): 524-532.CrossRefPubMed
30.
go back to reference Albisser A, Alejandro R, Sperlich M, Ricordi C: Closing the circle of care with new firmware for diabetes: MyDiaBase + RxChecker. Journal of diabetes science and technology. 2009, 3 (3): 619-623.CrossRefPubMedPubMedCentral Albisser A, Alejandro R, Sperlich M, Ricordi C: Closing the circle of care with new firmware for diabetes: MyDiaBase + RxChecker. Journal of diabetes science and technology. 2009, 3 (3): 619-623.CrossRefPubMedPubMedCentral
31.
go back to reference Albisser A: Technophobia, prescription checking and the future of diabetes management. Diabetologia. 2009, 52 (6): 1013-1018. 10.1007/s00125-009-1341-8.CrossRefPubMed Albisser A: Technophobia, prescription checking and the future of diabetes management. Diabetologia. 2009, 52 (6): 1013-1018. 10.1007/s00125-009-1341-8.CrossRefPubMed
32.
go back to reference Groot P, Hommersom A, Lucas P, Merk RJ, ten Teije A, van Harmelen F, Serban R: Using model checking for critiquing based on clinical guidelines. Artif Intell Med. 2009, 46: 19-36. 10.1016/j.artmed.2008.07.007.CrossRefPubMed Groot P, Hommersom A, Lucas P, Merk RJ, ten Teije A, van Harmelen F, Serban R: Using model checking for critiquing based on clinical guidelines. Artif Intell Med. 2009, 46: 19-36. 10.1016/j.artmed.2008.07.007.CrossRefPubMed
33.
go back to reference Ramnarayan P, Roberts G, Coren M, Nanduri V, Tomlinson A, Taylor P, Wyatt J, Britto J: Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Medical Informatics and Decision Making. 2006, 6: 22-10.1186/1472-6947-6-22.CrossRefPubMedPubMedCentral Ramnarayan P, Roberts G, Coren M, Nanduri V, Tomlinson A, Taylor P, Wyatt J, Britto J: Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Medical Informatics and Decision Making. 2006, 6: 22-10.1186/1472-6947-6-22.CrossRefPubMedPubMedCentral
34.
go back to reference Peleg M, Tu S, Bury J, Ciccarese P, Fox J, Greenes RA, Hall R, Johnson PD, Jones N, Kumar A, Miksch S, Quaglini S, Seyfang A, Shortliffe EH, Stefanelli M: Comparing computer-interpretable guideline models: a case-study approach. J Am Med Inform Assoc. 2003, 10: 52-68. 10.1197/jamia.M1135.CrossRefPubMedPubMedCentral Peleg M, Tu S, Bury J, Ciccarese P, Fox J, Greenes RA, Hall R, Johnson PD, Jones N, Kumar A, Miksch S, Quaglini S, Seyfang A, Shortliffe EH, Stefanelli M: Comparing computer-interpretable guideline models: a case-study approach. J Am Med Inform Assoc. 2003, 10: 52-68. 10.1197/jamia.M1135.CrossRefPubMedPubMedCentral
35.
36.
go back to reference Purves I, Sugden B, Booth N, Sowerby M: The PRODIGY project - the interactive development of the release one model. Proc AMIA Symp. 1999 Purves I, Sugden B, Booth N, Sowerby M: The PRODIGY project - the interactive development of the release one model. Proc AMIA Symp. 1999
37.
go back to reference Peleg M, Boxwala A, Tu S, Zeng Q, Ogunyemi O, Wang D, Patel V, Greenes R, Shortliffe E: The InterMed approach to sharable Computer-Interpretable Guidelines: a review. J Am Med Inform Assoc. 2004, 11: 1-10. 10.1197/jamia.M1399.CrossRefPubMedPubMedCentral Peleg M, Boxwala A, Tu S, Zeng Q, Ogunyemi O, Wang D, Patel V, Greenes R, Shortliffe E: The InterMed approach to sharable Computer-Interpretable Guidelines: a review. J Am Med Inform Assoc. 2004, 11: 1-10. 10.1197/jamia.M1399.CrossRefPubMedPubMedCentral
Metadata
Title
How to translate therapeutic recommendations in clinical practice guidelines into rules for critiquing physician prescriptions? Methods and application to five guidelines
Authors
Jean-Baptiste Lamy
Vahid Ebrahiminia
Christine Riou
Brigitte Seroussi
Jacques Bouaud
Christian Simon
Stéphane Dubois
Antoine Butti
Gérard Simon
Madeleine Favre
Hector Falcoff
Alain Venot
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2010
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-10-31

Other articles of this Issue 1/2010

BMC Medical Informatics and Decision Making 1/2010 Go to the issue