Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2015

Open Access 01-12-2015 | Research article

Multiple perspectives on clinical decision support: a qualitative study of fifteen clinical and vendor organizations

Authors: Joan S Ash, Dean F Sittig, Carmit K McMullen, Adam Wright, Arwen Bunce, Vishnu Mohan, Deborah J Cohen, Blackford Middleton

Published in: BMC Medical Informatics and Decision Making | Issue 1/2015

Login to get access

Abstract

Background

Computerized clinical decision support (CDS) can help hospitals to improve healthcare. However, CDS can be problematic. The purpose of this study was to discover how the views of clinical stakeholders, CDS content vendors, and EHR vendors are alike or different with respect to challenges in the development, management, and use of CDS.

Methods

We conducted ethnographic fieldwork using a Rapid Assessment Process within ten clinical and five health information technology (HIT) vendor organizations. Using an inductive analytical approach, we generated themes from the clinical, content vendor, and electronic health record vendor perspectives and compared them.

Results

The groups share views on the importance of appropriate manpower, careful knowledge management, CDS that fits user workflow, the need for communication among the groups, and for mutual strategizing about the future of CDS. However, views of usability, training, metrics, interoperability, product use, and legal issues differed. Recommendations for improvement include increased collaboration to address legal, manpower, and CDS sharing issues.

Conclusions

The three groups share thinking about many aspects of CDS, but views differ in a number of important respects as well. Until these three groups can reach a mutual understanding of the views of the other stakeholders, and work together, CDS will not reach its potential.
Literature
2.
go back to reference Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30.CrossRefPubMedPubMedCentral Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30.CrossRefPubMedPubMedCentral
3.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.CrossRefPubMed
4.
go back to reference Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280(15):1339–46.CrossRefPubMed Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280(15):1339–46.CrossRefPubMed
5.
go back to reference Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMedPubMedCentral Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMedPubMedCentral
6.
go back to reference Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, et al. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:92.CrossRefPubMedPubMedCentral Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, et al. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:92.CrossRefPubMedPubMedCentral
7.
go back to reference Sahota N, Lloyd R, Ramakrishna A, Mackay JA, Prorok JC, Weise-Kelly L, et al. Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011;6:91.CrossRefPubMedPubMedCentral Sahota N, Lloyd R, Ramakrishna A, Mackay JA, Prorok JC, Weise-Kelly L, et al. Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011;6:91.CrossRefPubMedPubMedCentral
8.
go back to reference Nieuwlaat R, Connolly SJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, et al. Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:90.CrossRefPubMedPubMedCentral Nieuwlaat R, Connolly SJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, et al. Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:90.CrossRefPubMedPubMedCentral
9.
go back to reference Roshanov PS, You JJ, Dhaliwal J, Koff D, Mackay JA, Weise-Kelly L, et al. Can computerized clinical decision support systems improve practitioners’ diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:88.CrossRefPubMedPubMedCentral Roshanov PS, You JJ, Dhaliwal J, Koff D, Mackay JA, Weise-Kelly L, et al. Can computerized clinical decision support systems improve practitioners’ diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:88.CrossRefPubMedPubMedCentral
10.
go back to reference Souza NM, Sebaldt RJ, Mackay JA, Prorok JC, Weise-Kelly L, Navarro T, et al. Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011;6:87.CrossRefPubMedPubMedCentral Souza NM, Sebaldt RJ, Mackay JA, Prorok JC, Weise-Kelly L, Navarro T, et al. Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011;6:87.CrossRefPubMedPubMedCentral
11.
go back to reference Hemens BJ, Holbrook A, Tonkin M, Mackay JA, Weise-Kelly L, Navarro T, et al. Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:89.CrossRefPubMedPubMedCentral Hemens BJ, Holbrook A, Tonkin M, Mackay JA, Weise-Kelly L, Navarro T, et al. Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:89.CrossRefPubMedPubMedCentral
12.
go back to reference Ahmad F, Norman C, O’Campo P. What is needed to implement a computer-assisted health risk assessment tool? An exploratory concept mapping study. BMC Med Inform Dec Mak. 2012;12:149.CrossRef Ahmad F, Norman C, O’Campo P. What is needed to implement a computer-assisted health risk assessment tool? An exploratory concept mapping study. BMC Med Inform Dec Mak. 2012;12:149.CrossRef
13.
go back to reference Lesselroth B, Yang J, McConnachie J, Brenk T, Winterbottom L. Addressing the sociotechnical drivers of quality improvement: a case study of post-operative DVT prophylaxis computerized decision support. BMJ Qual Safety. 2011;20(5):381–9.CrossRef Lesselroth B, Yang J, McConnachie J, Brenk T, Winterbottom L. Addressing the sociotechnical drivers of quality improvement: a case study of post-operative DVT prophylaxis computerized decision support. BMJ Qual Safety. 2011;20(5):381–9.CrossRef
14.
go back to reference Campion Jr TR, Waitman LR, Lorenzi NM, May AK, Gadd CS. Barriers and facilitators to the use of computer-based intensive insulin therapy. Int J Med Inform. 2011;80(12):863–71.CrossRefPubMedPubMedCentral Campion Jr TR, Waitman LR, Lorenzi NM, May AK, Gadd CS. Barriers and facilitators to the use of computer-based intensive insulin therapy. Int J Med Inform. 2011;80(12):863–71.CrossRefPubMedPubMedCentral
15.
go back to reference Goldstein MK, Coleman RW, Tu SW, Shankar RD, O’Connor MJ, Musen MA, et al. Translating research into practice: organizational issues in implementing automated decision support for hypertension in three medical centers. J Am Med Inform Assoc. 2004;11(5):368–76.CrossRefPubMedPubMedCentral Goldstein MK, Coleman RW, Tu SW, Shankar RD, O’Connor MJ, Musen MA, et al. Translating research into practice: organizational issues in implementing automated decision support for hypertension in three medical centers. J Am Med Inform Assoc. 2004;11(5):368–76.CrossRefPubMedPubMedCentral
16.
go back to reference Currie L, Sheehan B, Graham 3rd PL, Stetson P, Cato K, Wilcox A. Sociotechnical analysis of a neonatal ICU. Stud Heal Technol Inform. 2009;146:258–62. Currie L, Sheehan B, Graham 3rd PL, Stetson P, Cato K, Wilcox A. Sociotechnical analysis of a neonatal ICU. Stud Heal Technol Inform. 2009;146:258–62.
17.
go back to reference Ash JS, Sittig DF, McMullen CK, McCormack J, Wright A, Bunce A, et al. Studying the vendor perspective on clinical decision support. AMIA Annu Symp Proc. 2011;2011:26–30. Ash JS, Sittig DF, McMullen CK, McCormack J, Wright A, Bunce A, et al. Studying the vendor perspective on clinical decision support. AMIA Annu Symp Proc. 2011;2011:26–30.
18.
go back to reference McMullen CK, Ash JS, Sittig DF, Bunce A, Guappone K, Dykstra R, et al. Rapid assessment of clinical information systems in the healthcare setting: an efficient method for time-pressed evaluation. Meth Inform Med. 2010;50(2):299–307.CrossRefPubMedPubMedCentral McMullen CK, Ash JS, Sittig DF, Bunce A, Guappone K, Dykstra R, et al. Rapid assessment of clinical information systems in the healthcare setting: an efficient method for time-pressed evaluation. Meth Inform Med. 2010;50(2):299–307.CrossRefPubMedPubMedCentral
19.
go back to reference Beebe J. Rapid assessment process: an introduction. Walnut Creek, CA: AltaMira Press; 2001. Beebe J. Rapid assessment process: an introduction. Walnut Creek, CA: AltaMira Press; 2001.
21.
go back to reference Ash JS, Sittig DF, Guappone KP, Dykstra RH, Richardson J, Wright A, et al. Recommended practices for computerized clinical decision support and knowledge management in community settings: a qualitative study. BMC Med Inform Decis Mak. 2012;12:6.CrossRefPubMedPubMedCentral Ash JS, Sittig DF, Guappone KP, Dykstra RH, Richardson J, Wright A, et al. Recommended practices for computerized clinical decision support and knowledge management in community settings: a qualitative study. BMC Med Inform Decis Mak. 2012;12:6.CrossRefPubMedPubMedCentral
22.
go back to reference Berg BL, Lune H. Qualitative research methods for the social sciences, 8thed. Pearson: Boston, MA; 2012. Berg BL, Lune H. Qualitative research methods for the social sciences, 8thed. Pearson: Boston, MA; 2012.
23.
go back to reference Crabtree BF, Miller WL. Doing qualitative research. 2nd ed. Thousand Oaks, CA: Sage; 1999. Crabtree BF, Miller WL. Doing qualitative research. 2nd ed. Thousand Oaks, CA: Sage; 1999.
24.
go back to reference Wright A, Ash JS, Erickson JL, Wasserman J, Bunce A, Stanescu A, et al. A qualitative study of the activities performed by people involved in clinical decision support: recommended practices for success. J Am Med Inform Assoc. 2014;21:464–72.CrossRefPubMed Wright A, Ash JS, Erickson JL, Wasserman J, Bunce A, Stanescu A, et al. A qualitative study of the activities performed by people involved in clinical decision support: recommended practices for success. J Am Med Inform Assoc. 2014;21:464–72.CrossRefPubMed
29.
go back to reference Richardson JE, Ash JS, Sittig DF, Bunce A, Carpenter J, Dykstra RH, et al. Multiple perspectives on the meaning of clinical decision support. AMIA Annu Symp Proc. 2010;2010:1427–31.PubMedPubMedCentral Richardson JE, Ash JS, Sittig DF, Bunce A, Carpenter J, Dykstra RH, et al. Multiple perspectives on the meaning of clinical decision support. AMIA Annu Symp Proc. 2010;2010:1427–31.PubMedPubMedCentral
30.
go back to reference Kawamoto K, Hongsermeier T, Wright A, Lewis J, Bell DS, Middleton B. Key principles for a national clinical decision support knowledge sharing framework: synthesis of insights from leading subject matter experts. J Am Med Inform Assoc. 2013;20:199–206.CrossRefPubMedPubMedCentral Kawamoto K, Hongsermeier T, Wright A, Lewis J, Bell DS, Middleton B. Key principles for a national clinical decision support knowledge sharing framework: synthesis of insights from leading subject matter experts. J Am Med Inform Assoc. 2013;20:199–206.CrossRefPubMedPubMedCentral
31.
32.
go back to reference Phansalkar S, van der Sijs H, Tucker AD, Desai AA, Bell DS, Teich JM, et al. Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. J Am Med Inform Assoc. 2013;20(3):489–93. doi: 10.1136/amiajnl-2012-001089.CrossRefPubMed Phansalkar S, van der Sijs H, Tucker AD, Desai AA, Bell DS, Teich JM, et al. Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. J Am Med Inform Assoc. 2013;20(3):489–93. doi: 10.1136/amiajnl-2012-001089.CrossRefPubMed
33.
go back to reference Paterno MD, Goldberg HS, Simonaitis L, Dixon BE, Wright A, Rocha BH, et al. Using a service oriented architecture approach to clinical decision support: performance results from two CDS Consortium demonstration. AMIA Annu Symp Proc. 2012;2012:690–8.PubMedPubMedCentral Paterno MD, Goldberg HS, Simonaitis L, Dixon BE, Wright A, Rocha BH, et al. Using a service oriented architecture approach to clinical decision support: performance results from two CDS Consortium demonstration. AMIA Annu Symp Proc. 2012;2012:690–8.PubMedPubMedCentral
34.
go back to reference Goldberg HS, Paterno MD, Rocha BH, Schaeffer M, Wright A, Erickson JL, et al. A highly scalable, interoperable clinical decision support service. J Am Med Inform Assoc. 2014;21(e1):e55–62.CrossRefPubMed Goldberg HS, Paterno MD, Rocha BH, Schaeffer M, Wright A, Erickson JL, et al. A highly scalable, interoperable clinical decision support service. J Am Med Inform Assoc. 2014;21(e1):e55–62.CrossRefPubMed
35.
go back to reference Hongsermeier T, Maviglia S, Tsurikova L, Bogaty D, Rocha RA, Goldberg H, et al. A legal framework to enable sharing of clinical decision support knowledge and services across institutional boundaries. AMIA Annu Symp Proc. 2011;2011:925–33.PubMedPubMedCentral Hongsermeier T, Maviglia S, Tsurikova L, Bogaty D, Rocha RA, Goldberg H, et al. A legal framework to enable sharing of clinical decision support knowledge and services across institutional boundaries. AMIA Annu Symp Proc. 2011;2011:925–33.PubMedPubMedCentral
36.
go back to reference Middleton B. The clinical decision support consortium. Stud Health Technol Inform. 2009;150:26–30.PubMed Middleton B. The clinical decision support consortium. Stud Health Technol Inform. 2009;150:26–30.PubMed
37.
go back to reference Dixon BE, Simonaitis L, Goldberg HS, Paterno MD, Schaeffer M, Hongsermeier T, et al. A pilot study of distributed knowledge management and clinical decision support in the cloud. Artif Intell Med. 2013;59(1):45–53.CrossRefPubMed Dixon BE, Simonaitis L, Goldberg HS, Paterno MD, Schaeffer M, Hongsermeier T, et al. A pilot study of distributed knowledge management and clinical decision support in the cloud. Artif Intell Med. 2013;59(1):45–53.CrossRefPubMed
38.
go back to reference National Quality Forum (NQF). Driving quality—a health IT framework for measurement: a consensus report. Washington, D.C: NQF; 2010. National Quality Forum (NQF). Driving quality—a health IT framework for measurement: a consensus report. Washington, D.C: NQF; 2010.
Metadata
Title
Multiple perspectives on clinical decision support: a qualitative study of fifteen clinical and vendor organizations
Authors
Joan S Ash
Dean F Sittig
Carmit K McMullen
Adam Wright
Arwen Bunce
Vishnu Mohan
Deborah J Cohen
Blackford Middleton
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2015
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-015-0156-4

Other articles of this Issue 1/2015

BMC Medical Informatics and Decision Making 1/2015 Go to the issue