Skip to main content
Top
Published in: Human Resources for Health 1/2020

01-12-2020 | Ventricular Tachycardia | Research

Do cognitive aids reduce error rates in resuscitation team performance? Trial of emergency medicine protocols in simulation training (TEMPIST) in Australia

Authors: Charlotte Hall, Dean Robertson, Margaret Rolfe, Sharene Pascoe, Megan E. Passey, Sabrina Winona Pit

Published in: Human Resources for Health | Issue 1/2020

Login to get access

Abstract

Background

Resuscitation of patients with time-critical and life-threatening illness represents a cognitive challenge for emergency room (ER) clinicians. We designed a cognitive aid, the Emergency Protocols Handbook, to simplify clinical management and team processes. Resuscitation guidelines were reformatted into simple, single step-by-step pathways. This Australian randomised controlled trial tested the effectiveness of this cognitive aid in a simulated ER environment by observing team error rates when current resuscitation guidelines were followed, with and without the handbook.

Methods

Resuscitation teams were randomised to manage two scenarios with the handbook and two without in a high-fidelity simulation centre. Each scenario was video-recorded. The primary outcome measure was error rates (the number of errors made out of 15 key tasks per scenario). Key tasks varied by scenario. Each team completed four scenarios and was measured on 60 key tasks. Participants were surveyed regarding their perception of the usefulness of the handbook.

Results

Twenty-one groups performed 84 ER crisis simulations. The unadjusted error rate in the handbook group was 18.8% (121/645) versus 38.9% (239/615) in the non-handbook group. There was a statistically significant reduction of 54.0% (95% CI 49.9–57.9) in the estimated percentage error rate when the handbook was available across all scenarios 17.9% (95% CI 14.4–22.0%) versus 38.9% (95% CI 34.2–43.9%). Almost all (97%) participants said they would want to use this cognitive aid during a real medical crisis situation.

Conclusion

This trial showed that by following the step-by-step, linear pathways in the handbook, clinicians more than halved their teams’ rate of error, across four simulated medical crises. The handbook improves team performance and enables healthcare teams to reduce clinical error rates and thus reduce harm for patients.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Schull MJ, Ferris LE. Tu et al. Problems for clinical judgement: 3. Thinking clearly in an emergency. CMAJ. 2001;164(8):1170–5.PubMedPubMedCentral Schull MJ, Ferris LE. Tu et al. Problems for clinical judgement: 3. Thinking clearly in an emergency. CMAJ. 2001;164(8):1170–5.PubMedPubMedCentral
2.
go back to reference Marshall S. The use of cognitive aids during emergencies in anesthesia: a review of the literature. Anesth Analg. 2013;117(5):1162–71.CrossRef Marshall S. The use of cognitive aids during emergencies in anesthesia: a review of the literature. Anesth Analg. 2013;117(5):1162–71.CrossRef
3.
go back to reference Roth E, Mumaw R, Lewis P. An empirical investigation of operator performance in cognitively demanding simulated emergencies. Nuclear Regulatory Commission, Washington, DC (United States). Div. of Systems Research; Westinghouse Electric Corp., Pittsburgh, PA (United States). Science and Technology Center, 1994. Roth E, Mumaw R, Lewis P. An empirical investigation of operator performance in cognitively demanding simulated emergencies. Nuclear Regulatory Commission, Washington, DC (United States). Div. of Systems Research; Westinghouse Electric Corp., Pittsburgh, PA (United States). Science and Technology Center, 1994.
4.
go back to reference Kuhlmann S, Piel M, Wolf OT. Impaired memory retrieval after psychosocial stress in healthy young men. Journal Neurosci. 2005;25(11):2977–82.CrossRef Kuhlmann S, Piel M, Wolf OT. Impaired memory retrieval after psychosocial stress in healthy young men. Journal Neurosci. 2005;25(11):2977–82.CrossRef
5.
go back to reference Hales BM, Pronovost PJ. The checklist—a tool for error management and performance improvement. J Crit Care. 2006;21(3):231–5.CrossRef Hales BM, Pronovost PJ. The checklist—a tool for error management and performance improvement. J Crit Care. 2006;21(3):231–5.CrossRef
6.
go back to reference Forero R, Nugus P. Australasian College for Emergency Medicine (ACEM) literature review on the Australasian Triage Scale (ATS). Institute of Health Innovation, 2012. Forero R, Nugus P. Australasian College for Emergency Medicine (ACEM) literature review on the Australasian Triage Scale (ATS). Institute of Health Innovation, 2012.
7.
go back to reference Australian Institute of Health and Welfare (AIHW). Emergency department care 2015–16: Australian hospital statistics. Health services series no. 72. Cat. no. HSE 182. Canberra: AIHW, 2016. Australian Institute of Health and Welfare (AIHW). Emergency department care 2015–16: Australian hospital statistics. Health services series no. 72. Cat. no. HSE 182. Canberra: AIHW, 2016.
8.
go back to reference Helmreich RL. On error management: lessons from aviation. BMJ. 2000;320(7237):781.CrossRef Helmreich RL. On error management: lessons from aviation. BMJ. 2000;320(7237):781.CrossRef
9.
go back to reference Neily J, DeRosier JM, Mills PD, et al. Awareness and use of a cognitive aid for anesthesiology. The Joint Commission Journal on Quality and Patient Safety. 2007;33(8):502–11.CrossRef Neily J, DeRosier JM, Mills PD, et al. Awareness and use of a cognitive aid for anesthesiology. The Joint Commission Journal on Quality and Patient Safety. 2007;33(8):502–11.CrossRef
10.
go back to reference Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system: Washington (DC): National Academies Press, 2000. Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system: Washington (DC): National Academies Press, 2000.
11.
go back to reference Gawande A. The checklist manifesto: how to get things right. London: Profile Books; 2010. Gawande A. The checklist manifesto: how to get things right. London: Profile Books; 2010.
12.
go back to reference Arriaga AF, Bader AM, Wong JM, et al. Simulation-based trial of surgical-crisis checklists. N Engl J Med. 2013;368(3):246–53.CrossRef Arriaga AF, Bader AM, Wong JM, et al. Simulation-based trial of surgical-crisis checklists. N Engl J Med. 2013;368(3):246–53.CrossRef
13.
go back to reference Marshall SD. Helping experts and expert teams perform under duress: an agenda for cognitive aid research. Anaesthesia. 2017;72(3):289–95.CrossRef Marshall SD. Helping experts and expert teams perform under duress: an agenda for cognitive aid research. Anaesthesia. 2017;72(3):289–95.CrossRef
14.
go back to reference Marshall SD, Sanderson P, Mcintosh CA, Kolawole H. The effect of two cognitive aid designs on team functioning during intra-operative anaphylaxis emergencies: a multi-centre simulation study. Anaesthesia. 2016;71(4):389–404.CrossRef Marshall SD, Sanderson P, Mcintosh CA, Kolawole H. The effect of two cognitive aid designs on team functioning during intra-operative anaphylaxis emergencies: a multi-centre simulation study. Anaesthesia. 2016;71(4):389–404.CrossRef
15.
go back to reference Weller J, Henderson R, Webster CS, Shulruf B, Torrie J, Davies E, Henderson K, Frampton C, Merry AF. Building the evidence on simulation validity comparison of anesthesiologists’ communication patterns in real and simulated cases. Anesthesiology. 2014;120(1):142–8.CrossRef Weller J, Henderson R, Webster CS, Shulruf B, Torrie J, Davies E, Henderson K, Frampton C, Merry AF. Building the evidence on simulation validity comparison of anesthesiologists’ communication patterns in real and simulated cases. Anesthesiology. 2014;120(1):142–8.CrossRef
16.
go back to reference Merry AF, Hannam JA, Webster CS, Edwards KE, Torrie J, Frampton C, Wheeler DW, Gupta AK, Mahajan RP, Evley R, Weller JM. Retesting the hypothesis of a clinical randomized controlled trial in a simulation environment to validate anesthesia simulation in error research (the VASER Study). Anesthesiology. 2017;126(3):472–81.CrossRef Merry AF, Hannam JA, Webster CS, Edwards KE, Torrie J, Frampton C, Wheeler DW, Gupta AK, Mahajan RP, Evley R, Weller JM. Retesting the hypothesis of a clinical randomized controlled trial in a simulation environment to validate anesthesia simulation in error research (the VASER Study). Anesthesiology. 2017;126(3):472–81.CrossRef
Metadata
Title
Do cognitive aids reduce error rates in resuscitation team performance? Trial of emergency medicine protocols in simulation training (TEMPIST) in Australia
Authors
Charlotte Hall
Dean Robertson
Margaret Rolfe
Sharene Pascoe
Megan E. Passey
Sabrina Winona Pit
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Human Resources for Health / Issue 1/2020
Electronic ISSN: 1478-4491
DOI
https://doi.org/10.1186/s12960-019-0441-x

Other articles of this Issue 1/2020

Human Resources for Health 1/2020 Go to the issue