Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2015

Open Access 01-12-2015 | Research article

Understanding complex clinical reasoning in infectious diseases for improving clinical decision support design

Authors: Roosan Islam, Charlene R. Weir, Makoto Jones, Guilherme Del Fiol, Matthew H. Samore

Published in: BMC Medical Informatics and Decision Making | Issue 1/2015

Login to get access

Abstract

Background

Clinical experts’ cognitive mechanisms for managing complexity have implications for the design of future innovative healthcare systems. The purpose of the study is to examine the constituents of decision complexity and explore the cognitive strategies clinicians use to control and adapt to their information environment.

Methods

We used Cognitive Task Analysis (CTA) methods to interview 10 Infectious Disease (ID) experts at the University of Utah and Salt Lake City Veterans Administration Medical Center. Participants were asked to recall a complex, critical and vivid antibiotic-prescribing incident using the Critical Decision Method (CDM), a type of Cognitive Task Analysis (CTA). Using the four iterations of the Critical Decision Method, questions were posed to fully explore the incident, focusing in depth on the clinical components underlying the complexity. Probes were included to assess cognitive and decision strategies used by participants.

Results

The following three themes emerged as the constituents of decision complexity experienced by the Infectious Diseases experts: 1) the overall clinical picture does not match the pattern, 2) a lack of comprehension of the situation and 3) dealing with social and emotional pressures such as fear and anxiety. All these factors contribute to decision complexity. These factors almost always occurred together, creating unexpected events and uncertainty in clinical reasoning. Five themes emerged in the analyses of how experts deal with the complexity. Expert clinicians frequently used 1) watchful waiting instead of over- prescribing antibiotics, engaged in 2) theory of mind to project and simulate other practitioners’ perspectives, reduced very complex cases into simple 3) heuristics, employed 4) anticipatory thinking to plan and re-plan events and consulted with peers to share knowledge, solicit opinions and 5) seek help on patient cases.

Conclusion

The cognitive strategies to deal with decision complexity found in this study have important implications for design future decision support systems for the management of complex patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. doi:10.7326/M13-1531.CrossRefPubMed Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. doi:10.​7326/​M13-1531.CrossRefPubMed
4.
go back to reference Sintchenko V, Coiera EW. Which clinical decisions benefit from automation? A task complexity approach. Int J Med Inform. 2003;70(2–3):309–16.CrossRefPubMed Sintchenko V, Coiera EW. Which clinical decisions benefit from automation? A task complexity approach. Int J Med Inform. 2003;70(2–3):309–16.CrossRefPubMed
7.
go back to reference Shaffer, J. and Coustasse, A. Computer physician order entry and clinical decision support systems: Benefits and concerns. Business and Health Administration Association Annual Conference 2012. Paper presented at the Business and Health Administration Association (BHAA) Annual Conference 2012, at the 48th Annual Midwest Business Administration Association International Conference. Chicago, Illinois. Mar 2012. Shaffer, J. and Coustasse, A. Computer physician order entry and clinical decision support systems: Benefits and concerns. Business and Health Administration Association Annual Conference 2012. Paper presented at the Business and Health Administration Association (BHAA) Annual Conference 2012, at the 48th Annual Midwest Business Administration Association International Conference. Chicago, Illinois. Mar 2012.
8.
go back to reference Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMedPubMedCentral Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.CrossRefPubMedPubMedCentral
9.
go back to reference Miller RA. Computer-assisted diagnostic decision support: history, challenges, and possible paths forward. Adv Health Sci Educ. 2009;14(1 SUPPL):89–106.CrossRef Miller RA. Computer-assisted diagnostic decision support: history, challenges, and possible paths forward. Adv Health Sci Educ. 2009;14(1 SUPPL):89–106.CrossRef
10.
go back to reference Welch BM, Kawamoto K. Clinical decision support for genetically guided personalized medicine: a systematic review. J Am Med Inform Assoc. 2013;20(2):388–400.CrossRefPubMed Welch BM, Kawamoto K. Clinical decision support for genetically guided personalized medicine: a systematic review. J Am Med Inform Assoc. 2013;20(2):388–400.CrossRefPubMed
13.
go back to reference Rasmussen J. Risk management in a dynamic society: a modelling problem. Saf Sci. 1997;27(2):183–213.CrossRef Rasmussen J. Risk management in a dynamic society: a modelling problem. Saf Sci. 1997;27(2):183–213.CrossRef
14.
go back to reference Converse S. Shared mental models in expert team decision making. Individual and group decision making: Current Issues. 1993;221 Converse S. Shared mental models in expert team decision making. Individual and group decision making: Current Issues. 1993;221
15.
go back to reference Markman KD, Klein WM, Suhr JA. Handbook of imagination and mental simulation. New York: Psychology Press; 2012. Markman KD, Klein WM, Suhr JA. Handbook of imagination and mental simulation. New York: Psychology Press; 2012.
17.
go back to reference Sintchenko V, Coiera E. Decision complexity affects the extent and type of decision support use. AMIA Annu Symp Proc. 2006:724–8 Sintchenko V, Coiera E. Decision complexity affects the extent and type of decision support use. AMIA Annu Symp Proc. 2006:724–8
19.
go back to reference Tleyjeh IM, Nada H, Baddour LM. VisualDx: decision-support software for the diagnosis and management of dermatologic disorders. Clin Infect Dis. 2006;43(9):1177–84.CrossRefPubMed Tleyjeh IM, Nada H, Baddour LM. VisualDx: decision-support software for the diagnosis and management of dermatologic disorders. Clin Infect Dis. 2006;43(9):1177–84.CrossRefPubMed
20.
22.
go back to reference Morens DM, Folkers GK, Fauci AS. The challenge of emerging and re-emerging infectious diseases. Nature. 2004;430(6996):242–9.CrossRefPubMed Morens DM, Folkers GK, Fauci AS. The challenge of emerging and re-emerging infectious diseases. Nature. 2004;430(6996):242–9.CrossRefPubMed
26.
go back to reference Islam R, Weir C, Del Fiol G. Clinical complexity in medicine: a measurement model of task and patient complexity. Methods of Information in Medicine. 2015;54(5). doi:10.3414/me15-01-0031. Islam R, Weir C, Del Fiol G. Clinical complexity in medicine: a measurement model of task and patient complexity. Methods of Information in Medicine. 2015;54(5). doi:10.​3414/​me15-01-0031.
28.
go back to reference Sintchenko V, Coiera E, editors. Decision complexity affects the extent and type of decision support use. AMIA Annual Symposium Proceedings; 2006: American Medical Informatics Association. Sintchenko V, Coiera E, editors. Decision complexity affects the extent and type of decision support use. AMIA Annual Symposium Proceedings; 2006: American Medical Informatics Association.
29.
go back to reference Hoffman RR, Militello LG. Perspectives on cognitive task analysis: historical origins and modern communities of practice. New York: Psychology Press; 2012. Hoffman RR, Militello LG. Perspectives on cognitive task analysis: historical origins and modern communities of practice. New York: Psychology Press; 2012.
30.
go back to reference Lobach DSG, Bright TJ. Enabling Health Care Decisionmaking Through Clinical Decision Support and Knowledge Management. Evidence Report/Technology Assessments. Rockville: Agency for Healthcare Research and Quality; 2012. Lobach DSG, Bright TJ. Enabling Health Care Decisionmaking Through Clinical Decision Support and Knowledge Management. Evidence Report/Technology Assessments. Rockville: Agency for Healthcare Research and Quality; 2012.
32.
go back to reference Islam R, Weir C, Fiol GD, editors. Heuristics in managing complex clinical decision tasks in experts’ decision making. Healthcare Informatics (ICHI), 2014 IEEE International Conference on; 2014 15–17 Sept. 2014. Islam R, Weir C, Fiol GD, editors. Heuristics in managing complex clinical decision tasks in experts’ decision making. Healthcare Informatics (ICHI), 2014 IEEE International Conference on; 2014 15–17 Sept. 2014.
35.
go back to reference Crandall B, Klein GA, Hoffman RR. Working minds: a practitioner’s guide to cognitive task analysis. Cambride: MIT Press; 2006. Crandall B, Klein GA, Hoffman RR. Working minds: a practitioner’s guide to cognitive task analysis. Cambride: MIT Press; 2006.
36.
go back to reference Klein G. Cognitive task analysis of teams. Cognitive Task Analysis. 2000;11:417–29. Klein G. Cognitive task analysis of teams. Cognitive Task Analysis. 2000;11:417–29.
37.
go back to reference Craig C, Klein MI, Griswold J, Gaitonde K, McGill T, Halldorsson A. Using cognitive task analysis to identify critical decisions in the laparoscopic environment. Hum Factors. 2012;54(6):1025–39.CrossRefPubMed Craig C, Klein MI, Griswold J, Gaitonde K, McGill T, Halldorsson A. Using cognitive task analysis to identify critical decisions in the laparoscopic environment. Hum Factors. 2012;54(6):1025–39.CrossRefPubMed
38.
go back to reference Clark J. How to peer review a qualitative manuscript. Peer Review in Health Sciences. 2003;2:219–35. Clark J. How to peer review a qualitative manuscript. Peer Review in Health Sciences. 2003;2:219–35.
39.
go back to reference Crandall B, Klein G, Hoffman R. Working minds: a practitioner’s guide to cognitive task analysis. Cambridge: Massachusetts Institute of Technology Press; 2006. Crandall B, Klein G, Hoffman R. Working minds: a practitioner’s guide to cognitive task analysis. Cambridge: Massachusetts Institute of Technology Press; 2006.
40.
go back to reference Wong BW, Blandford A. Analysing ambulance dispatcher decision making: Trialing emergent themes analysis. 2002. Ergonomics Society of Australia Wong BW, Blandford A. Analysing ambulance dispatcher decision making: Trialing emergent themes analysis. 2002. Ergonomics Society of Australia
41.
go back to reference Hoffman RR, Crandall B, Shadbolt NR. Use of the critical decision method to elicit expert knowledge: a case study in the methodology of cognitive task analysis. Hum Factors. 1998;40:254–76.CrossRef Hoffman RR, Crandall B, Shadbolt NR. Use of the critical decision method to elicit expert knowledge: a case study in the methodology of cognitive task analysis. Hum Factors. 1998;40:254–76.CrossRef
42.
go back to reference Barry CA, Britten N, Barber N, Bradley C, Stevenson F. Using reflexivity to optimize teamwork in qualitative research. Qual Health Res. 1999;9(1):26–44.CrossRefPubMed Barry CA, Britten N, Barber N, Bradley C, Stevenson F. Using reflexivity to optimize teamwork in qualitative research. Qual Health Res. 1999;9(1):26–44.CrossRefPubMed
44.
go back to reference Berends L, Johnston J. Using multiple coders to enhance qualitative analysis: the case of interviews with consumers of drug treatment. Addict Res Theory. 2005;13(4):373–81.CrossRef Berends L, Johnston J. Using multiple coders to enhance qualitative analysis: the case of interviews with consumers of drug treatment. Addict Res Theory. 2005;13(4):373–81.CrossRef
45.
47.
go back to reference Calvo RA, D’Mello S, Gratch J, Kappas A. The Oxford handbook of affective computing. Oxford: Oxford University Press; 2014. Calvo RA, D’Mello S, Gratch J, Kappas A. The Oxford handbook of affective computing. Oxford: Oxford University Press; 2014.
48.
go back to reference Mosier KL, Fischer UM. Informed by knowledge: expert performance in complex situations. New York: Psychology Press; 2011. Mosier KL, Fischer UM. Informed by knowledge: expert performance in complex situations. New York: Psychology Press; 2011.
49.
go back to reference Bedny GZ, Karwowski W, Bedny IS. Complexity evaluation of computer-based tasks. Int J Hum Comput Interact. 2012;28(4):236–57.CrossRef Bedny GZ, Karwowski W, Bedny IS. Complexity evaluation of computer-based tasks. Int J Hum Comput Interact. 2012;28(4):236–57.CrossRef
50.
go back to reference Franklin A, Liu Y, Li Z, Nguyen V, Johnson TR, Robinson D, et al. Opportunistic decision making and complexity in emergency care. J Biomed Inform. 2011;44(3):469–76.CrossRefPubMed Franklin A, Liu Y, Li Z, Nguyen V, Johnson TR, Robinson D, et al. Opportunistic decision making and complexity in emergency care. J Biomed Inform. 2011;44(3):469–76.CrossRefPubMed
51.
go back to reference Jenkins DP. Cognitive work analysis: coping with complexity. Burlington, VT: Ashgate Publishing, Ltd.; 2009. Jenkins DP. Cognitive work analysis: coping with complexity. Burlington, VT: Ashgate Publishing, Ltd.; 2009.
52.
go back to reference Kannampallil TG, Schauer GF, Cohen T, Patel VL. Considering complexity in healthcare systems. J Biomed Inform. 2011;44(6):943–7.CrossRefPubMed Kannampallil TG, Schauer GF, Cohen T, Patel VL. Considering complexity in healthcare systems. J Biomed Inform. 2011;44(6):943–7.CrossRefPubMed
53.
go back to reference Meyer TS, Muething JZ, Lima GA, Torres BR, del Rosario TK, Gomes JO. Radiological emergency response for community agencies with cognitive task analysis, risk analysis, and decision support framework. Work (Reading, Mass). 2012;41 Suppl 1:2925–32. doi:10.3233/wor-2012-0659-2925. Meyer TS, Muething JZ, Lima GA, Torres BR, del Rosario TK, Gomes JO. Radiological emergency response for community agencies with cognitive task analysis, risk analysis, and decision support framework. Work (Reading, Mass). 2012;41 Suppl 1:2925–32. doi:10.​3233/​wor-2012-0659-2925.
55.
go back to reference Vance J, Sprivulis P. Triage nurses validly and reliably estimate emergency department patient complexity. Emerg Med Australas. 2005;17(4):382–6.CrossRefPubMed Vance J, Sprivulis P. Triage nurses validly and reliably estimate emergency department patient complexity. Emerg Med Australas. 2005;17(4):382–6.CrossRefPubMed
57.
go back to reference Crandall B, Klein G, Hoffman R. Incident-based CTA: Helping practitioners “tell stories”. Working minds: a practitioners’ or ‘s guide to cognitive task analysis. Cambridge: MIT Press; 2006. p. 69–90. Crandall B, Klein G, Hoffman R. Incident-based CTA: Helping practitioners “tell stories”. Working minds: a practitioners’ or ‘s guide to cognitive task analysis. Cambridge: MIT Press; 2006. p. 69–90.
59.
go back to reference Weir CR, Nebeker JJR, Hicken BL, Campo R, Drews F, LeBar B. A cognitive task analysis of information management strategies in a computerized provider order entry environment. J Am Med Inform Assoc. 2007;14(1):65–75.CrossRefPubMedPubMedCentral Weir CR, Nebeker JJR, Hicken BL, Campo R, Drews F, LeBar B. A cognitive task analysis of information management strategies in a computerized provider order entry environment. J Am Med Inform Assoc. 2007;14(1):65–75.CrossRefPubMedPubMedCentral
60.
go back to reference Gigerenzer G, Hertwig R, Pachur T. Heuristics: the foundations of adaptive behavior. New York: Oxford University Press, Inc.; 2011.CrossRef Gigerenzer G, Hertwig R, Pachur T. Heuristics: the foundations of adaptive behavior. New York: Oxford University Press, Inc.; 2011.CrossRef
61.
go back to reference Gigerenzer G, Kurzenhäuser S. Fast and frugal heuristics in medical decision making. Science and Medicine in Dialogue: Thinking Through Particulars and Universals. I assume this is the journal title. 2005:3–15. Gigerenzer G, Kurzenhäuser S. Fast and frugal heuristics in medical decision making. Science and Medicine in Dialogue: Thinking Through Particulars and Universals. I assume this is the journal title. 2005:3–15.
64.
go back to reference Patterson ES, Woods DD, Tinapple D, Roth EM, editors. Using cognitive task analysis (CTA) to seed design concepts for intelligence analysts under data overload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting; 2001: Sage Publications. Patterson ES, Woods DD, Tinapple D, Roth EM, editors. Using cognitive task analysis (CTA) to seed design concepts for intelligence analysts under data overload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting; 2001: Sage Publications.
66.
go back to reference Sherman JW, Gawronski B, Trope Y. Dual-process theories of the social mind. New York Guilford Publications; 2014 Sherman JW, Gawronski B, Trope Y. Dual-process theories of the social mind. New York Guilford Publications; 2014
67.
go back to reference Dhanaraj C, Lyles MA, Steensma HK, Tihanyi L. Managing tacit and explicit knowledge transfer in IJVs: the role of relational embeddedness and the impact on performance. J Int Bus Stud. 2004;35(5):428–42.CrossRef Dhanaraj C, Lyles MA, Steensma HK, Tihanyi L. Managing tacit and explicit knowledge transfer in IJVs: the role of relational embeddedness and the impact on performance. J Int Bus Stud. 2004;35(5):428–42.CrossRef
70.
go back to reference Timmermans DR, Sprij AJ, de Bel CE. The discrepancy between daily practice and the policy of a decision-analytic model: the management of fever of unknown origin. Med Decis Making. 1996;16(4):357–66.CrossRefPubMed Timmermans DR, Sprij AJ, de Bel CE. The discrepancy between daily practice and the policy of a decision-analytic model: the management of fever of unknown origin. Med Decis Making. 1996;16(4):357–66.CrossRefPubMed
73.
go back to reference Arora S, Thornton K, Murata G, Deming P, Kalishman S, Dion D, et al. Outcomes of treatment for hepatitis C virus infection by primary care providers. N Engl J Med. 2011;364(23):2199–207.CrossRefPubMed Arora S, Thornton K, Murata G, Deming P, Kalishman S, Dion D, et al. Outcomes of treatment for hepatitis C virus infection by primary care providers. N Engl J Med. 2011;364(23):2199–207.CrossRefPubMed
74.
go back to reference Schnipper JL, Linder JA, Palchuk MB, Einbinder JS, Li Q, Postilnik A, et al. “Smart Forms” in an electronic medical record: documentation-based clinical decision support to improve disease management. J Am Med Inform Assoc. 2008;15(4):513–23.CrossRefPubMedPubMedCentral Schnipper JL, Linder JA, Palchuk MB, Einbinder JS, Li Q, Postilnik A, et al. “Smart Forms” in an electronic medical record: documentation-based clinical decision support to improve disease management. J Am Med Inform Assoc. 2008;15(4):513–23.CrossRefPubMedPubMedCentral
75.
go back to reference Zhang J, Norman DA. Representations in distributed cognitive tasks. Cogn Sci. 1994;18(1):87–122.CrossRef Zhang J, Norman DA. Representations in distributed cognitive tasks. Cogn Sci. 1994;18(1):87–122.CrossRef
76.
go back to reference Zhang Y, Li Z, Wu B, Wu S. A spaceflight operation complexity measure and its experimental validation. Int J Ind Ergon. 2009;39(5):756–65.CrossRef Zhang Y, Li Z, Wu B, Wu S. A spaceflight operation complexity measure and its experimental validation. Int J Ind Ergon. 2009;39(5):756–65.CrossRef
77.
78.
go back to reference Zhang J, Patel VL, Johnson KA, Smith JW, Malin J. Designing human-centered distributed information systems. IEEE Intell Syst. 2002;17(5):42–7.CrossRef Zhang J, Patel VL, Johnson KA, Smith JW, Malin J. Designing human-centered distributed information systems. IEEE Intell Syst. 2002;17(5):42–7.CrossRef
81.
go back to reference Shneiderman B. Medical illuminations using evidence, visualizations and statistical thinking to improve healthcare. Science. 2014;343(6171):614.CrossRef Shneiderman B. Medical illuminations using evidence, visualizations and statistical thinking to improve healthcare. Science. 2014;343(6171):614.CrossRef
82.
go back to reference Shneiderman B, Plaisant C, Hesse B. Improving health and healthcare with interactive visualization methods. IEEE Computer Special Issue on Challenges in Information Visualization. 2013:58–66 Shneiderman B, Plaisant C, Hesse B. Improving health and healthcare with interactive visualization methods. IEEE Computer Special Issue on Challenges in Information Visualization. 2013:58–66
83.
go back to reference Wong HJ, Caesar M, Bandali S, Agnew J, Abrams H. Electronic inpatient whiteboards: improving multidisciplinary communication and coordination of care. Int J Med Inform. 2009;78(4):239–47.CrossRefPubMed Wong HJ, Caesar M, Bandali S, Agnew J, Abrams H. Electronic inpatient whiteboards: improving multidisciplinary communication and coordination of care. Int J Med Inform. 2009;78(4):239–47.CrossRefPubMed
84.
go back to reference Krall MAG, Samore MH. Big data and population-based decision support. In: Greenes RA, editor. Clinical decison support: the road to broad adoption. 2nd ed. Oxford: Elsevier Inc.; 2014. p. 363–78.CrossRef Krall MAG, Samore MH. Big data and population-based decision support. In: Greenes RA, editor. Clinical decison support: the road to broad adoption. 2nd ed. Oxford: Elsevier Inc.; 2014. p. 363–78.CrossRef
85.
go back to reference Newell A, Carmichael A, Gregor P, Alm N, Waller A. Information technology for cognitive support. 2003 Newell A, Carmichael A, Gregor P, Alm N, Waller A. Information technology for cognitive support. 2003
87.
go back to reference Murray JS, Amin PM. Overprescribing antibiotics in children: an enduring public health concern. J Spec Pediatr Nurs. 2014;19(3):266–9.CrossRefPubMed Murray JS, Amin PM. Overprescribing antibiotics in children: an enduring public health concern. J Spec Pediatr Nurs. 2014;19(3):266–9.CrossRefPubMed
88.
go back to reference Ascioglu S, Samore MH, Lipsitch M. A new approach to the analysis of antibiotic resistance data from hospitals. Microb Drug Resist. 2014;20:6.CrossRef Ascioglu S, Samore MH, Lipsitch M. A new approach to the analysis of antibiotic resistance data from hospitals. Microb Drug Resist. 2014;20:6.CrossRef
Metadata
Title
Understanding complex clinical reasoning in infectious diseases for improving clinical decision support design
Authors
Roosan Islam
Charlene R. Weir
Makoto Jones
Guilherme Del Fiol
Matthew H. Samore
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2015
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-015-0221-z

Other articles of this Issue 1/2015

BMC Medical Informatics and Decision Making 1/2015 Go to the issue