Skip to main content
Top
Published in: BMC Emergency Medicine 1/2016

Open Access 01-12-2016 | Study protocol

Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial

Authors: Deepika Mohan, Matthew R. Rosengart, Baruch Fischhoff, Derek C. Angus, Coreen Farris, Donald M. Yealy, David J. Wallace, Amber E. Barnato

Published in: BMC Emergency Medicine | Issue 1/2016

Login to get access

Abstract

Background

Between 30 and 40 % of patients with severe injuries receive treatment at non-trauma centers (under-triage), largely because of physician decision making. Existing interventions to improve triage by physicians ignore the role that intuition (heuristics) plays in these decisions. One such heuristic is to form an initial impression based on representativeness (how typical does a patient appear of one with severe injuries). We created a video game (Night Shift) to recalibrate physician’s representativeness heuristic in trauma triage.

Methods

We developed Night Shift in collaboration with emergency medicine physicians, trauma surgeons, behavioral scientists, and game designers. Players take on the persona of Andy Jordan, an emergency medicine physician, who accepts a new job in a small town. Through a series of cases that go awry, they gain experience with the contextual cues that distinguish patients with minor and severe injuries (based on the theory of analogical encoding) and receive emotionally-laden feedback on their performance (based on the theory of narrative engagement). The planned study will compare the effect of Night Shift with that of an educational program on physician triage decisions and on physician heuristics. Psychological theory predicts that cognitive load increases reliance on heuristics, thereby increasing the under-triage rate when heuristics are poorly calibrated. We will randomize physicians (n = 366) either to play the game or to review an educational program, and will assess performance using a validated virtual simulation. The validated simulation includes both control and cognitive load conditions. We will compare rates of under-triage after exposure to the two interventions (primary outcome) and will compare the effect of cognitive load on physicians’ under-triage rates (secondary outcome). We hypothesize that: a) physicians exposed to Night Shift will have lower rates of under-triage compared to those exposed to the educational program, and b) cognitive load will not degrade triage performance among physicians exposed to Night Shift as much as it will among those exposed to the educational program.

Discussion

Serious games offer a new approach to the problem of poorly-calibrated heuristics in trauma triage. The results of this trial will contribute to the understanding of physician quality improvement and the efficacy of video games as behavioral interventions.

Trial registration

clinicaltrials.gov; NCT02857348; August 2, 2016.
Literature
1.
go back to reference Mackenzie EJ, Rivara FP, Jurkovich GJ, et al. A national evaluation of the effect of trauma-center care on mortality. NEJM. 2006;354:366–78.CrossRefPubMed Mackenzie EJ, Rivara FP, Jurkovich GJ, et al. A national evaluation of the effect of trauma-center care on mortality. NEJM. 2006;354:366–78.CrossRefPubMed
2.
go back to reference Celso B, Tepas J, Langland-Orban B, et al. A systematic review and meta-analysis comparing outcome of severely injured patients treated in trauma centers following the establishment of trauma systems. J Trauma. 2006;60(2):371–8.CrossRefPubMed Celso B, Tepas J, Langland-Orban B, et al. A systematic review and meta-analysis comparing outcome of severely injured patients treated in trauma centers following the establishment of trauma systems. J Trauma. 2006;60(2):371–8.CrossRefPubMed
3.
go back to reference Demetriades D, Martin M, Salim A, et al. The effect of trauma center designation and trauma volume on outcome in specific severe injuries. Ann Surg. 2005;242(4):512–7.PubMedPubMedCentral Demetriades D, Martin M, Salim A, et al. The effect of trauma center designation and trauma volume on outcome in specific severe injuries. Ann Surg. 2005;242(4):512–7.PubMedPubMedCentral
4.
go back to reference Committee on Trauma—American College of Surgeons. Resources for optimal care of the injured patient 2006. Chicago: American College of Surgeons; 2006. Committee on Trauma—American College of Surgeons. Resources for optimal care of the injured patient 2006. Chicago: American College of Surgeons; 2006.
5.
go back to reference Macias CA, Rosengart MR, Puyana JC, et al. The effects of trauma center care, admission volume, and surgical volume on paralysis after traumatic spinal cord injury. Ann Surg. 2009;249(1):10–7.CrossRefPubMedPubMedCentral Macias CA, Rosengart MR, Puyana JC, et al. The effects of trauma center care, admission volume, and surgical volume on paralysis after traumatic spinal cord injury. Ann Surg. 2009;249(1):10–7.CrossRefPubMedPubMedCentral
6.
go back to reference Nathens AB, Jurkovich GJ, Mackenzie EJ, Rivara FP. A resource-based assessment of trauma care in the United States. J Trauma. 2004;56(1):173–8.CrossRefPubMed Nathens AB, Jurkovich GJ, Mackenzie EJ, Rivara FP. A resource-based assessment of trauma care in the United States. J Trauma. 2004;56(1):173–8.CrossRefPubMed
7.
go back to reference Delgado MK, Yokell MA, Staudenmayer KL, et al. Factors associated with the disposition of severely injured patients initially seen at non-trauma center emergency departments: disparities by insurance status. JAMA Surg. 2014;149:422–30.CrossRefPubMedPubMedCentral Delgado MK, Yokell MA, Staudenmayer KL, et al. Factors associated with the disposition of severely injured patients initially seen at non-trauma center emergency departments: disparities by insurance status. JAMA Surg. 2014;149:422–30.CrossRefPubMedPubMedCentral
8.
go back to reference Mohan D, Rosengart MR, Farris C, et al. Assessing the feasibility of the American College of Surgeons’ benchmarks for the triage of trauma patients. Arch Surg. 2011;146:786–92.CrossRefPubMedPubMedCentral Mohan D, Rosengart MR, Farris C, et al. Assessing the feasibility of the American College of Surgeons’ benchmarks for the triage of trauma patients. Arch Surg. 2011;146:786–92.CrossRefPubMedPubMedCentral
9.
go back to reference Gomez D, Haas B, de Mestral C, et al. Institutional and provider factors impeding access to trauma center care: an analysis of transfer practices in a regional trauma system. J Trauma. 2012;73(5):1288–93.CrossRef Gomez D, Haas B, de Mestral C, et al. Institutional and provider factors impeding access to trauma center care: an analysis of transfer practices in a regional trauma system. J Trauma. 2012;73(5):1288–93.CrossRef
11.
go back to reference Kahneman D, Tversky A. Judgment under uncertainty: Heuristics and biases. In: Judgment under uncertainty: Heuristics and biases, by Daniel Kahneman, Paul Slovic and Amos Tversky. New York: Cambridge University Press; 2003. p. 3–20. Kahneman D, Tversky A. Judgment under uncertainty: Heuristics and biases. In: Judgment under uncertainty: Heuristics and biases, by Daniel Kahneman, Paul Slovic and Amos Tversky. New York: Cambridge University Press; 2003. p. 3–20.
12.
go back to reference Sanfey AG, Loewenstein G, McClure SM, Cohen JD. Neuroeconomics: cross-currents in research on decision making. Trends Cogn Sci. 2006;10:108–16.CrossRefPubMed Sanfey AG, Loewenstein G, McClure SM, Cohen JD. Neuroeconomics: cross-currents in research on decision making. Trends Cogn Sci. 2006;10:108–16.CrossRefPubMed
13.
go back to reference Shah AJ, Oppenheimer DM. Heuristics made easy: an effort-reduction framework. Psychol Bull. 2010;134:207–22.CrossRef Shah AJ, Oppenheimer DM. Heuristics made easy: an effort-reduction framework. Psychol Bull. 2010;134:207–22.CrossRef
14.
go back to reference Mohan D, Barnato AE, Angus DC, et al. Determinants of compliance with transfer guidelines for trauma patients: a retrospective analysis of CT scans acquired prior to transfer to a Level I trauma center. Ann Surg. 2010;251(5):946–51.CrossRefPubMed Mohan D, Barnato AE, Angus DC, et al. Determinants of compliance with transfer guidelines for trauma patients: a retrospective analysis of CT scans acquired prior to transfer to a Level I trauma center. Ann Surg. 2010;251(5):946–51.CrossRefPubMed
15.
go back to reference Mohan D, Rosengart MR, Farris C, et al. Sources of non-compliance with clinical practice guidelines in trauma triage: a decision science study. Implement Sci. 2012;7(1):103.CrossRefPubMedPubMedCentral Mohan D, Rosengart MR, Farris C, et al. Sources of non-compliance with clinical practice guidelines in trauma triage: a decision science study. Implement Sci. 2012;7(1):103.CrossRefPubMedPubMedCentral
16.
go back to reference Mohan D, Angus DC, Ricketts D, et al. Assessing the validity of using serious game technology to analyze physician decision making. PLoS One. 2014;9:e105445.CrossRefPubMedPubMedCentral Mohan D, Angus DC, Ricketts D, et al. Assessing the validity of using serious game technology to analyze physician decision making. PLoS One. 2014;9:e105445.CrossRefPubMedPubMedCentral
17.
go back to reference Kahneman D, Klein G. Conditions for intuitive expertise: a failure to disagree. Am Psychol. 2009;64:515–26.CrossRefPubMed Kahneman D, Klein G. Conditions for intuitive expertise: a failure to disagree. Am Psychol. 2009;64:515–26.CrossRefPubMed
18.
go back to reference Milkman KL, Chugh D, Bazerman M. How can decision making be improved. Perspect Psychol Sci. 2009;4:379–83.CrossRefPubMed Milkman KL, Chugh D, Bazerman M. How can decision making be improved. Perspect Psychol Sci. 2009;4:379–83.CrossRefPubMed
19.
go back to reference Idson LC, Chugh D, Bereby-Meyer Y, et al. Overcoming focusing failures in competitive environments. J Behav Decis Mak. 2004;17:159–72.CrossRef Idson LC, Chugh D, Bereby-Meyer Y, et al. Overcoming focusing failures in competitive environments. J Behav Decis Mak. 2004;17:159–72.CrossRef
20.
go back to reference Moran S, Bereby-Meyer Y, Bazerman M. Stretching the effectiveness of analogical training in negotiations: teaching diverse principles for creating value. Negot Confl Manag Res. 2008;1:99–134.CrossRef Moran S, Bereby-Meyer Y, Bazerman M. Stretching the effectiveness of analogical training in negotiations: teaching diverse principles for creating value. Negot Confl Manag Res. 2008;1:99–134.CrossRef
21.
go back to reference Thompson L, Gentner D, Loewenstein J. Avoiding missed opportunities in managerial life: analogical training more powerful than individual case training. Organ Behav Hum Decis Process. 2000;82:60–75.CrossRef Thompson L, Gentner D, Loewenstein J. Avoiding missed opportunities in managerial life: analogical training more powerful than individual case training. Organ Behav Hum Decis Process. 2000;82:60–75.CrossRef
22.
go back to reference Miller-Day M, Hecht ML. Narrative means to preventative ends: a narrative engagement framework for designing prevention interventions. Health Commun. 2013;28:657–70.CrossRefPubMedPubMedCentral Miller-Day M, Hecht ML. Narrative means to preventative ends: a narrative engagement framework for designing prevention interventions. Health Commun. 2013;28:657–70.CrossRefPubMedPubMedCentral
23.
go back to reference Nabi RL, Green MC. The role of narrative’s emotional flow in promoting persuasive outcomes. Med Psychol. 2015;18:137–62.CrossRef Nabi RL, Green MC. The role of narrative’s emotional flow in promoting persuasive outcomes. Med Psychol. 2015;18:137–62.CrossRef
24.
go back to reference Gillard E, van Dooren W, Schaeken W, Verschaffel L. Proportional reasoning as a heuristic-based process: time constraint and dual task considerations. Exp Psychol. 2009;56:92–9.CrossRefPubMed Gillard E, van Dooren W, Schaeken W, Verschaffel L. Proportional reasoning as a heuristic-based process: time constraint and dual task considerations. Exp Psychol. 2009;56:92–9.CrossRefPubMed
27.
go back to reference Rammstedt B, John OP. A 10-item short version of the Big Five Inventory in English and German. J Res Pers. 2007;41:203–12.CrossRef Rammstedt B, John OP. A 10-item short version of the Big Five Inventory in English and German. J Res Pers. 2007;41:203–12.CrossRef
28.
go back to reference Busselle R, Bilandzic H. Measuring narrative engagement. Med Psychol. 2009;12:321–47.CrossRef Busselle R, Bilandzic H. Measuring narrative engagement. Med Psychol. 2009;12:321–47.CrossRef
29.
30.
go back to reference National Academies of Sciences, Engineering and Medicine. Improving diagnosis in health care. Washington DC: The National Academies Press; 2015. National Academies of Sciences, Engineering and Medicine. Improving diagnosis in health care. Washington DC: The National Academies Press; 2015.
31.
go back to reference Graber ML, Kissam S, Payne VL, et al. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf. 2012;21:535–57.CrossRefPubMed Graber ML, Kissam S, Payne VL, et al. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf. 2012;21:535–57.CrossRefPubMed
32.
go back to reference Mamede S, Schmidt HG, Penaforte JC. Effects of reflective practice on the accuracy of medical diagnoses. Med Educ. 2008;42:468–75.CrossRefPubMed Mamede S, Schmidt HG, Penaforte JC. Effects of reflective practice on the accuracy of medical diagnoses. Med Educ. 2008;42:468–75.CrossRefPubMed
33.
go back to reference Mamede S, Schmidt HG, Rikers RM, et al. Conscious thought beats deliberation without attention in diagnostic decision making: at least when you are an expert. Psychol Res. 2010;74:586–92.CrossRefPubMedPubMedCentral Mamede S, Schmidt HG, Rikers RM, et al. Conscious thought beats deliberation without attention in diagnostic decision making: at least when you are an expert. Psychol Res. 2010;74:586–92.CrossRefPubMedPubMedCentral
34.
go back to reference Coderre S, Mandin H, Harasym PH, et al. Diagnostic reasoning strategies and diagnostic success. Med Educ. 2003;37:695–703.CrossRefPubMed Coderre S, Mandin H, Harasym PH, et al. Diagnostic reasoning strategies and diagnostic success. Med Educ. 2003;37:695–703.CrossRefPubMed
35.
36.
go back to reference Mulvaney SA, Bickman L, Guise NB, et al. A randomized effectiveness trial of a clinical informatics consult service: imact on evidence-based decision-making and knowledge implementation. J Am Med Inform Assoc. 2008;15:203–11.CrossRefPubMedPubMedCentral Mulvaney SA, Bickman L, Guise NB, et al. A randomized effectiveness trial of a clinical informatics consult service: imact on evidence-based decision-making and knowledge implementation. J Am Med Inform Assoc. 2008;15:203–11.CrossRefPubMedPubMedCentral
37.
go back to reference Gigerenzer G, Todd PM, the ABC Research Group. Simple heuristics that make us smart. New York: Oxford University Press; 1999. Gigerenzer G, Todd PM, the ABC Research Group. Simple heuristics that make us smart. New York: Oxford University Press; 1999.
38.
go back to reference Bartsch A, Oliver MB. Making sense of entertainment: on the interplay of emotion and cognition in entertainment experience. J Med Psychol. 2011;23:12–7.CrossRef Bartsch A, Oliver MB. Making sense of entertainment: on the interplay of emotion and cognition in entertainment experience. J Med Psychol. 2011;23:12–7.CrossRef
39.
go back to reference Chung S, Cheon J, Lee KW. Emotion and multimedia learning: an investigation of the effects of valence and arousal on different modalities in an instructional animation. Instr Sci. 2015;43:545–59.CrossRef Chung S, Cheon J, Lee KW. Emotion and multimedia learning: an investigation of the effects of valence and arousal on different modalities in an instructional animation. Instr Sci. 2015;43:545–59.CrossRef
Metadata
Title
Testing a videogame intervention to recalibrate physician heuristics in trauma triage: study protocol for a randomized controlled trial
Authors
Deepika Mohan
Matthew R. Rosengart
Baruch Fischhoff
Derek C. Angus
Coreen Farris
Donald M. Yealy
David J. Wallace
Amber E. Barnato
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2016
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-016-0108-z

Other articles of this Issue 1/2016

BMC Emergency Medicine 1/2016 Go to the issue