Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Debate

CDSS-RM: a clinical decision support system reference model

Authors: Dimitrios Zikos, Nailya DeLellis

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Clinical Decision Support Systems (CDSS) provide aid in clinical decision making and therefore need to take into consideration human, data interactions, and cognitive functions of clinical decision makers. The objective of this paper is to introduce a high level reference model that is intended to be used as a foundation to design successful and contextually relevant CDSS systems. The paper begins by introducing the information flow, use, and sharing characteristics in a hospital setting, and then it outlines the referential context for the model, which are clinical decisions in a hospital setting. Important characteristics of the Clinical decision making process include: (i) Temporally ordered steps, each leading to new data, which in turn becomes useful for a new decision, (ii) Feedback loops where acquisition of new data improves certainty and generates new questions to examine, (iii) Combining different kinds of clinical data for decision making, (iv) Reusing the same data in two or more different decisions, and (v) Clinical decisions requiring human cognitive skills and knowledge, to process the available information. These characteristics form the foundation to delineate important considerations of Clinical Decision Support Systems design. The model includes six interacting and interconnected elements, which formulate the high-level reference model (CDSS-RM). These elements are introduced in the form of questions, as considerations, and are examined with the use of illustrated scenario-based and data-driven examples. The six elements /considerations of the reference model are: (i) Do CDSS mimic the cognitive process of clinical decision makers? (ii) Do CDSS provide recommendations with longitudinal insight? (iii) Is the model performance contextually realistic? (iv) Is the ‘Historical Decision’ bias taken into consideration in CDSS design? (v) Do CDSS integrate established clinical standards and protocols? (vi) Do CDSS utilize unstructured data? The CDSS-RM reference model can contribute to optimized design of modeling methodologies, in order to improve response of health systems to clinical decision-making challenges.
Literature
4.
go back to reference Ruland C, Bakken S. Developing, implementing, and evaluating decision support Systems for Shared Decision Making in patient care: a conceptual model and case illustration. J Biomed Inform. 2002;35(5–6):313–21.CrossRef Ruland C, Bakken S. Developing, implementing, and evaluating decision support Systems for Shared Decision Making in patient care: a conceptual model and case illustration. J Biomed Inform. 2002;35(5–6):313–21.CrossRef
7.
go back to reference Smith DH, Perrin N, Feldstein A, Yang X, Kuang D, Simon SR, Sittig DF, Platt R, Soumerai SB. The impact of prescribing safety alerts for elderly persons in an electronic medical record: an interrupted time series evaluation. Arch Intern Med. 2006;166(10):1098–104.CrossRef Smith DH, Perrin N, Feldstein A, Yang X, Kuang D, Simon SR, Sittig DF, Platt R, Soumerai SB. The impact of prescribing safety alerts for elderly persons in an electronic medical record: an interrupted time series evaluation. Arch Intern Med. 2006;166(10):1098–104.CrossRef
9.
go back to reference Yao W, Kumar A. CONFlexFlow: integrating flexible clinical pathways into clinical decision support systems using context and rules. Decis Support Syst. 2013;55(2):499–515.CrossRef Yao W, Kumar A. CONFlexFlow: integrating flexible clinical pathways into clinical decision support systems using context and rules. Decis Support Syst. 2013;55(2):499–515.CrossRef
10.
go back to reference Miller RA. Why the standard view is standard: people, not machines, understand patients’ problems. J Med Philos. 1990;15(6):581–91.CrossRef Miller RA. Why the standard view is standard: people, not machines, understand patients’ problems. J Med Philos. 1990;15(6):581–91.CrossRef
11.
go back to reference Bennett CC, Hauser K. Artificial intelligence framework for simulating clinical decision-making: a Markov decision process approach. Artif Intell Med. 2013;57(1):9–19.CrossRef Bennett CC, Hauser K. Artificial intelligence framework for simulating clinical decision-making: a Markov decision process approach. Artif Intell Med. 2013;57(1):9–19.CrossRef
12.
go back to reference Charles Safran C, MD Bloomrosen M, Hammond EW, Labkoff S, Markel-Fox S, Tang PC, Detmer DE. Toward a National Framework for the secondary use of health data: an American medical informatics association white paper. J Am Med Inform Assoc. 2007;14(1):1–9.CrossRef Charles Safran C, MD Bloomrosen M, Hammond EW, Labkoff S, Markel-Fox S, Tang PC, Detmer DE. Toward a National Framework for the secondary use of health data: an American medical informatics association white paper. J Am Med Inform Assoc. 2007;14(1):1–9.CrossRef
16.
go back to reference Fox J, Johns N, Lyons C, Rahmanzadeh A, Thomson R, Wilson P. PROforma: a general technology for clinical decision support systems. Comput Methods Prog Biomed. 1997;54:59–67.CrossRef Fox J, Johns N, Lyons C, Rahmanzadeh A, Thomson R, Wilson P. PROforma: a general technology for clinical decision support systems. Comput Methods Prog Biomed. 1997;54:59–67.CrossRef
17.
go back to reference Musen MA, Tu SW, Das AK, Shahar Y. EON: a component-based approach to automation of protocol-directed therapy. J Am Med Inform Assoc. 1996;3(6):367–88.CrossRef Musen MA, Tu SW, Das AK, Shahar Y. EON: a component-based approach to automation of protocol-directed therapy. J Am Med Inform Assoc. 1996;3(6):367–88.CrossRef
18.
go back to reference Greenes RA. Clinical decision support: the road ahead. Burlington: Academic Press; 2009. Greenes RA. Clinical decision support: the road ahead. Burlington: Academic Press; 2009.
19.
go back to reference Combi C, Posenato R. Controllability in Temporal Conceptual Workflow Schemata. In: Dayal U, Eder J, Koehler J, Reijers HA, editors. Business Process Management. BPM 2009. Lecture notes in computer science, vol. 5701. Berlin, Heidelberg: Springer; 2009. Combi C, Posenato R. Controllability in Temporal Conceptual Workflow Schemata. In: Dayal U, Eder J, Koehler J, Reijers HA, editors. Business Process Management. BPM 2009. Lecture notes in computer science, vol. 5701. Berlin, Heidelberg: Springer; 2009.
20.
go back to reference Shah K. Case-study-an answer to analytical clinical decision making. J Orthop Case Rep. 2014;4(2):3–4.PubMedCentral Shah K. Case-study-an answer to analytical clinical decision making. J Orthop Case Rep. 2014;4(2):3–4.PubMedCentral
21.
go back to reference Zikos D, Vandeliwala I, Makedon Ph. A probabilistic algorithm with user feedback loop for decision making during the hospital triage process. Published in: Proceeding PETRA ‘s14 Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments Article No. 7. Zikos D, Vandeliwala I, Makedon Ph. A probabilistic algorithm with user feedback loop for decision making during the hospital triage process. Published in: Proceeding PETRA ‘s14 Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments Article No. 7.
22.
go back to reference Weiskopf N, Weng C. Methods and dimensions of electronic health record data quality assessment: Enabling reuse for clinical research. J Am Med Inform Assoc. 2012;20(1):144–51.CrossRef Weiskopf N, Weng C. Methods and dimensions of electronic health record data quality assessment: Enabling reuse for clinical research. J Am Med Inform Assoc. 2012;20(1):144–51.CrossRef
23.
go back to reference Weiskopf NG, Hripcsak G, Swaminathan S, Weng C. Defining and measuring completeness of electronic health records. J Biomed Inform. 2013;46(5):830–6.CrossRef Weiskopf NG, Hripcsak G, Swaminathan S, Weng C. Defining and measuring completeness of electronic health records. J Biomed Inform. 2013;46(5):830–6.CrossRef
24.
go back to reference Botsis T, Hartvigsen G, Chen F, Weng C. Secondary use of EHR: data quality issues and informatics opportunities. Summit on Translat Bioinforma. 2010;2010:1–5.PubMedCentral Botsis T, Hartvigsen G, Chen F, Weng C. Secondary use of EHR: data quality issues and informatics opportunities. Summit on Translat Bioinforma. 2010;2010:1–5.PubMedCentral
25.
go back to reference Nkanginieme KE. Clinical diagnosis as a dynamic cognitive process: application of Bloom’s taxonomy for educational objectives in the cognitive domain. Medical Education Online. 1997;2(1):4288.CrossRef Nkanginieme KE. Clinical diagnosis as a dynamic cognitive process: application of Bloom’s taxonomy for educational objectives in the cognitive domain. Medical Education Online. 1997;2(1):4288.CrossRef
28.
go back to reference Richardson WS, Glasziou P, Polashenski WA, Wilson MC. A new arrival: evidence about differential diagnosis. Evidence-Based Medicine. 2000;5(6):164–5.CrossRef Richardson WS, Glasziou P, Polashenski WA, Wilson MC. A new arrival: evidence about differential diagnosis. Evidence-Based Medicine. 2000;5(6):164–5.CrossRef
29.
go back to reference Rajkomar A, Dhaliwal G. Improving diagnostic reasoning to improve patient safety. Permanente J. 2011;15:68–73.CrossRef Rajkomar A, Dhaliwal G. Improving diagnostic reasoning to improve patient safety. Permanente J. 2011;15:68–73.CrossRef
30.
go back to reference Hudson DL, Cohen ME. Temporal trend analysis in personal health records. In: proceedings of 2008 IEEE engineering in medicine and biology society 30th annual conference; 2008 Aug 25-29, Vancouver, Canada. New York: IEEE; 2008, p. 3811-3814. Available from: IEEE Xplore. Hudson DL, Cohen ME. Temporal trend analysis in personal health records. In: proceedings of 2008 IEEE engineering in medicine and biology society 30th annual conference; 2008 Aug 25-29, Vancouver, Canada. New York: IEEE; 2008, p. 3811-3814. Available from: IEEE Xplore.
31.
go back to reference Procop GW, Yerian LM, Wyllie R, Harrison AM, Kottke-Marchant K. Duplicate laboratory test reduction using a clinical decision support tool. Am J Clin Pathol. 2014;141(5):718–23.CrossRef Procop GW, Yerian LM, Wyllie R, Harrison AM, Kottke-Marchant K. Duplicate laboratory test reduction using a clinical decision support tool. Am J Clin Pathol. 2014;141(5):718–23.CrossRef
32.
go back to reference Rosenberg MA, Frees EW, Sun J, Johnson PH Jr, Robinson J. Predictive modeling with longitudinal data: a case study of Wisconsin nursing homes. North American Actuarial Journal. 2007;11(3):54–69.CrossRef Rosenberg MA, Frees EW, Sun J, Johnson PH Jr, Robinson J. Predictive modeling with longitudinal data: a case study of Wisconsin nursing homes. North American Actuarial Journal. 2007;11(3):54–69.CrossRef
33.
go back to reference Ali T, Hussain M, Khan WA, Afzal M, Kang BH, Lee S. Arden syntax studio: creating medical logic module as shareable knowledge. In: Proceedings of innovations in intelligent systems and applications (INISTA) international symposium; 2014 June 23-25, Alberobello, Italy. New York: IEEE; 2014, p. 266-272. Available from: IEEE Xplore. Ali T, Hussain M, Khan WA, Afzal M, Kang BH, Lee S. Arden syntax studio: creating medical logic module as shareable knowledge. In: Proceedings of innovations in intelligent systems and applications (INISTA) international symposium; 2014 June 23-25, Alberobello, Italy. New York: IEEE; 2014, p. 266-272. Available from: IEEE Xplore.
34.
go back to reference Fried TR. Shared decision making—finding the sweet spot. N Engl J Med. 2016;374(2):104–6.CrossRef Fried TR. Shared decision making—finding the sweet spot. N Engl J Med. 2016;374(2):104–6.CrossRef
36.
go back to reference Meystrea SM, Lovisb C, Bürklec T, Tognolad G, Budrionise A, Lehmann CU. Clinical data reuse or secondary use: current status and potential future Progress. Yearb Med Inform. 2017;26(1):38–52.CrossRef Meystrea SM, Lovisb C, Bürklec T, Tognolad G, Budrionise A, Lehmann CU. Clinical data reuse or secondary use: current status and potential future Progress. Yearb Med Inform. 2017;26(1):38–52.CrossRef
38.
go back to reference Lusted L. Logical analysis in medical diagnosis. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. 1967 University of California Press; Biology and Problems of Health (4): 903–923. Lusted L. Logical analysis in medical diagnosis. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. 1967 University of California Press; Biology and Problems of Health (4): 903–923.
39.
go back to reference Higgs J, Jones MA, Loftus S, Christensen N. Clinical reasoning in the health professions. Amsterdam: Butterworth-Heinemann, Elsevier Health Sciences; 2008. 530 p. Higgs J, Jones MA, Loftus S, Christensen N. Clinical reasoning in the health professions. Amsterdam: Butterworth-Heinemann, Elsevier Health Sciences; 2008. 530 p.
40.
go back to reference Barrows HS, Feltovich PJ. The clinical reasoning process. Med Educ. 1987;21(2):86–91.CrossRef Barrows HS, Feltovich PJ. The clinical reasoning process. Med Educ. 1987;21(2):86–91.CrossRef
41.
42.
go back to reference Miller RA. Medical diagnostic decision support systems--past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc. 1994;1(1):8–27.CrossRef Miller RA. Medical diagnostic decision support systems--past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc. 1994;1(1):8–27.CrossRef
44.
go back to reference Shortreed SM, Laber E, Lizotte DJ, Stroup TS, Pineau J, Murphy SA. Informing sequential clinical decision-making through reinforcement learning: an empirical study. Mach Learn. 2011;84(1–2):109–36.CrossRef Shortreed SM, Laber E, Lizotte DJ, Stroup TS, Pineau J, Murphy SA. Informing sequential clinical decision-making through reinforcement learning: an empirical study. Mach Learn. 2011;84(1–2):109–36.CrossRef
45.
go back to reference Strite S, Stuart ME. What is an evidence-based, value-based health care system? (part 1). Physician executive. 2005;31(1):50.PubMed Strite S, Stuart ME. What is an evidence-based, value-based health care system? (part 1). Physician executive. 2005;31(1):50.PubMed
47.
go back to reference Leondes CT, editor. Expert systems, six-volume set: the Technology of Knowledge Management and Decision Making for the 21st century. 1st ed. San Diego: Academic Press; 2001. Leondes CT, editor. Expert systems, six-volume set: the Technology of Knowledge Management and Decision Making for the 21st century. 1st ed. San Diego: Academic Press; 2001.
48.
go back to reference Morik K, Brockhausen P, Joachims T. Combining statistical learning with a knowledge-based approach: a case study in intensive care monitoring. Technical Report, SFB 475: Komplexitätsreduktion in Multivariaten Datenstrukturen, Universität Dortmund; 1999 (24). Morik K, Brockhausen P, Joachims T. Combining statistical learning with a knowledge-based approach: a case study in intensive care monitoring. Technical Report, SFB 475: Komplexitätsreduktion in Multivariaten Datenstrukturen, Universität Dortmund; 1999 (24).
49.
50.
go back to reference Romano MJ, Stafford RS. Electronic health records and clinical decision support systems: impact on national ambulatory care quality. Arch Intern Med. 2011;171(10):897–903.PubMedPubMedCentral Romano MJ, Stafford RS. Electronic health records and clinical decision support systems: impact on national ambulatory care quality. Arch Intern Med. 2011;171(10):897–903.PubMedPubMedCentral
52.
go back to reference Levetan C. Controlling hyperglycemia in the hospital: a matter of life and death. Clinical Diabetes. 2000;18(1):17. Levetan C. Controlling hyperglycemia in the hospital: a matter of life and death. Clinical Diabetes. 2000;18(1):17.
53.
go back to reference Carlson MD, Morrison RS. Study design, precision, and validity in observational studies. J Palliat Med. 2009;12(1):77–82.CrossRef Carlson MD, Morrison RS. Study design, precision, and validity in observational studies. J Palliat Med. 2009;12(1):77–82.CrossRef
54.
go back to reference Carter EM, Potts HW. Predicting length of stay from an electronic patient record system: a primary total knee replacement example. BMC medical informatics and decision making. 2014;14(1):26.CrossRef Carter EM, Potts HW. Predicting length of stay from an electronic patient record system: a primary total knee replacement example. BMC medical informatics and decision making. 2014;14(1):26.CrossRef
55.
go back to reference Mak G, Grant WD, McKenzie JC, McCabe JB. Physicians’ ability to predict hospital length of stay for patients admitted to the hospital from the emergency department. Emergency medicine international. Volume 2012 (2012); Article ID 824674, 4 pages.CrossRef Mak G, Grant WD, McKenzie JC, McCabe JB. Physicians’ ability to predict hospital length of stay for patients admitted to the hospital from the emergency department. Emergency medicine international. Volume 2012 (2012); Article ID 824674, 4 pages.CrossRef
56.
go back to reference Yang CS, Wei CP, Yuan CC, Schoung JY. Predicting the length of hospital stay of burn patients: comparisons of prediction accuracy among different clinical stages. Decis Support Syst. 2010;50(1):325–35.CrossRef Yang CS, Wei CP, Yuan CC, Schoung JY. Predicting the length of hospital stay of burn patients: comparisons of prediction accuracy among different clinical stages. Decis Support Syst. 2010;50(1):325–35.CrossRef
57.
go back to reference Zikos D, Tsiakas K, Qudah F, Athitsos V, Makedon F. Evaluation of classification methods for the prediction of hospital length of stay using Medicare claims data. In: Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments. 2014 27-30; Rhodes, Greece. ACM: 2014:54. Zikos D, Tsiakas K, Qudah F, Athitsos V, Makedon F. Evaluation of classification methods for the prediction of hospital length of stay using Medicare claims data. In: Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments. 2014 27-30; Rhodes, Greece. ACM: 2014:54.
58.
go back to reference Abdiansah A, Wardoyo R. Time complexity analysis of support vector machines (svm) in libsvm. Int J Comput Appl. 2015;128(3):28–34. Abdiansah A, Wardoyo R. Time complexity analysis of support vector machines (svm) in libsvm. Int J Comput Appl. 2015;128(3):28–34.
59.
go back to reference Ashby D, Smith AF. Evidence-based medicine as Bayesian decision-making. Stat Med. 2000;19(23):3291–305.CrossRef Ashby D, Smith AF. Evidence-based medicine as Bayesian decision-making. Stat Med. 2000;19(23):3291–305.CrossRef
61.
go back to reference Castaneda C, Nalley K, Mannion C, Bhattacharyya P, Blake P, Pecora A, Suh KS. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. Journal of clinical bioinformatics. 2015;5(1):4.CrossRef Castaneda C, Nalley K, Mannion C, Bhattacharyya P, Blake P, Pecora A, Suh KS. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. Journal of clinical bioinformatics. 2015;5(1):4.CrossRef
63.
go back to reference Jolliffe IT. Graphical representation of data using principal components. Principal Component Analysis. 2nd ed. New York: Springer-Verlag; 2002. p. 78–110. Jolliffe IT. Graphical representation of data using principal components. Principal Component Analysis. 2nd ed. New York: Springer-Verlag; 2002. p. 78–110.
64.
go back to reference Futoma J, Morris J, Lucas J. A comparison of models for predicting early hospital readmissions. J Biomed Inform. 2015;56:229–3.CrossRef Futoma J, Morris J, Lucas J. A comparison of models for predicting early hospital readmissions. J Biomed Inform. 2015;56:229–3.CrossRef
65.
go back to reference Bennett C, Doub T, Bragg A, Luellen J, Van Regenmorter C, Lockman J, Reiserer R. Data mining session-based patient reported outcomes (PROs) in a mental health setting: toward data-driven clinical decision support and personalized treatment. In: Healthcare Informatics, Imaging and Systems Biology (HISB), 2011 First IEEE international conference. San Jose; 2011(July): pp. 229–236. Bennett C, Doub T, Bragg A, Luellen J, Van Regenmorter C, Lockman J, Reiserer R. Data mining session-based patient reported outcomes (PROs) in a mental health setting: toward data-driven clinical decision support and personalized treatment. In: Healthcare Informatics, Imaging and Systems Biology (HISB), 2011 First IEEE international conference. San Jose; 2011(July): pp. 229–236.
66.
go back to reference Hix C, McKeon L, Walters S. Clinical nurse leader impact on clinical microsystems outcomes. J Nurs Adm. 2009;39(2):71–6.CrossRef Hix C, McKeon L, Walters S. Clinical nurse leader impact on clinical microsystems outcomes. J Nurs Adm. 2009;39(2):71–6.CrossRef
70.
go back to reference Your guide to anemia. US Department of Health and Human Services. Technical Report NIH 11–7629. National Institutes of Health. Bethesda: National Heart, Lung and Blood Institute; 2011. Your guide to anemia. US Department of Health and Human Services. Technical Report NIH 11–7629. National Institutes of Health. Bethesda: National Heart, Lung and Blood Institute; 2011.
71.
go back to reference Liu Y, Wang J, Yang Y, Sun J. A semi-automatic approach for workflow staff assignment. Comput Ind. 2008;59(5):463–76.CrossRef Liu Y, Wang J, Yang Y, Sun J. A semi-automatic approach for workflow staff assignment. Comput Ind. 2008;59(5):463–76.CrossRef
74.
go back to reference Penz JF, Wilcox AB, Hurdle JF. Automated identification of adverse events related to central venous catheters. Journal of Biomed Inform. 2007;40:174–82.CrossRef Penz JF, Wilcox AB, Hurdle JF. Automated identification of adverse events related to central venous catheters. Journal of Biomed Inform. 2007;40:174–82.CrossRef
75.
go back to reference Miller RH, Sim I. Physicians’ use of electronic medical records: barriers and solutions. Health Aff. 2004;23(2):116–26.CrossRef Miller RH, Sim I. Physicians’ use of electronic medical records: barriers and solutions. Health Aff. 2004;23(2):116–26.CrossRef
Metadata
Title
CDSS-RM: a clinical decision support system reference model
Authors
Dimitrios Zikos
Nailya DeLellis
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0587-6

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue