Skip to main content
Top
Published in: European Journal of Trauma and Emergency Surgery 6/2022

07-06-2022 | Original Article

Introducing the Safety Threats and Adverse events in Trauma (STAT) taxonomy: standardized classification system for evaluating safety during trauma resuscitation

Authors: Nemanja Baletic, Jamie Riggs, Gerald Lebovic, Andrew Petrosoniak, Ryan P. Dumas, Brodie Nolan

Published in: European Journal of Trauma and Emergency Surgery | Issue 6/2022

Login to get access

Abstract

Purpose

Adverse events (AEs) during trauma resuscitation are common and heterogeneity in reporting limits comparisons between hospitals and systems. A recent modified Delphi study established a taxonomy of AEs that occur during trauma resuscitation. This tool was further refined to yield the Safety Threats and Adverse events in Trauma (STAT) taxonomy. The objective of this study was to evaluate the inter-rater reliability of the STAT taxonomy using in-situ simulation resuscitations.

Methods

Two reviewers utilized the STAT taxonomy to score 12 in-situ simulated trauma resuscitations. AEs were reported for each simulation and timestamped in the case of multiple occurrences of a single AE. Inter-rater reliability was assessed using Gwet’s AC1.

Results

The agreement on all AEs between reviewers was 90.1% (973/1080). The Gwet’s AC1 across AE categories were: EMS handover (median 0.72, IQR [0.54, 0.82]), airway and breathing (median 0.91, IQR [0.60, 1.0]), circulation (median 0.91, IQR [0.72, 1.0]), assessment of injuries (median 0.80, IQR [0.24, 0.91]), management of injuries (median 1.00, IQR [1.00, 1.00]), procedure related (median 1.00, IQR [81, 1.00]), patient monitoring and IV access (median 1.00, IQR [1.00, 1.00]), disposition (median 1.00, IQR [1.00, 1.00]), team communication and dynamics (median 0.80, IQR [0.62, 1.00]).

Conclusions

The STAT taxonomy yielded 90.1% agreement and demonstrated excellent inter-rater reliability between reviewers in the in-situ simulation scenario. The STAT taxonomy may serve as a standardized evaluation tool of latent safety threats and adverse events in the trauma bay. Future work should focus on applying this tool to live trauma patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nolan B, Petrosoniak A, Hicks CM, Cripps MW, Dumas RP. Defining adverse events during trauma resuscitation: a modified RAND Delphi study. Trauma Surg Acute Care Open. 2021;6(1): e000805.CrossRefPubMedPubMedCentral Nolan B, Petrosoniak A, Hicks CM, Cripps MW, Dumas RP. Defining adverse events during trauma resuscitation: a modified RAND Delphi study. Trauma Surg Acute Care Open. 2021;6(1): e000805.CrossRefPubMedPubMedCentral
3.
go back to reference Fitzgerald M, Gocentas R, Dziukas L, Cameron P, Mackenzie C, Farrow N. Using video audit to improve trauma resuscitation–time for a new approach. Can J Surg J Can De Chir. 2006;49(3):208–11. Fitzgerald M, Gocentas R, Dziukas L, Cameron P, Mackenzie C, Farrow N. Using video audit to improve trauma resuscitation–time for a new approach. Can J Surg J Can De Chir. 2006;49(3):208–11.
4.
go back to reference Chang A, Schyve PM, Croteau RJ, O’Leary DS, Loeb JM. The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events. Int J Qual Health C. 2005;17(2):95–105.CrossRef Chang A, Schyve PM, Croteau RJ, O’Leary DS, Loeb JM. The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events. Int J Qual Health C. 2005;17(2):95–105.CrossRef
5.
go back to reference Fan M, Petrosoniak A, Pinkney S, Hicks C, White K, Almeida APSS, et al. Study protocol for a framework analysis using video review to identify latent safety threats: trauma resuscitation using in situ simulation team training (TRUST). BMJ Open. 2016;6(11):e013683.CrossRefPubMedPubMedCentral Fan M, Petrosoniak A, Pinkney S, Hicks C, White K, Almeida APSS, et al. Study protocol for a framework analysis using video review to identify latent safety threats: trauma resuscitation using in situ simulation team training (TRUST). BMJ Open. 2016;6(11):e013683.CrossRefPubMedPubMedCentral
6.
go back to reference Petrosoniak A, Fan M, Hicks CM, White K, McGowan M, Campbell D, et al. Trauma Resuscitation Using in situ Simulation Team Training (TRUST) study: latent safety threat evaluation using framework analysis and video review. Bmj Qual Saf. 2021;30(9):739–46. https://doi.org/10.1136/bmjqs-2020-011363 Petrosoniak A, Fan M, Hicks CM, White K, McGowan M, Campbell D, et al. Trauma Resuscitation Using in situ Simulation Team Training (TRUST) study: latent safety threat evaluation using framework analysis and video review. Bmj Qual Saf. 2021;30(9):739–46. https://​doi.​org/​10.​1136/​bmjqs-2020-011363
7.
go back to reference Dumas RP, Vella MA, Hatchimonji JS, Ma L, Maher Z, Holena DN. Trauma video review utilization: a survey of practice in the United States. Am J Surg. 2020;219:49–53.CrossRefPubMed Dumas RP, Vella MA, Hatchimonji JS, Ma L, Maher Z, Holena DN. Trauma video review utilization: a survey of practice in the United States. Am J Surg. 2020;219:49–53.CrossRefPubMed
8.
go back to reference Dumas RP, Vella MA, Chreiman KC, Smith BP, Subramanian M, Maher Z, et al. Team assessment and decision making is associated with outcomes: a trauma video review analysis. J Surg Res. 2020;246:544–9.CrossRefPubMed Dumas RP, Vella MA, Chreiman KC, Smith BP, Subramanian M, Maher Z, et al. Team assessment and decision making is associated with outcomes: a trauma video review analysis. J Surg Res. 2020;246:544–9.CrossRefPubMed
10.
go back to reference Nolan B, Hicks CM, Petrosoniak A, Jung J, Grantcharov T. Pushing boundaries of video review in trauma: using comprehensive data to improve the safety of trauma care. Trauma Surg Acute Care Open. 2020;5(1): e000510.CrossRefPubMedPubMedCentral Nolan B, Hicks CM, Petrosoniak A, Jung J, Grantcharov T. Pushing boundaries of video review in trauma: using comprehensive data to improve the safety of trauma care. Trauma Surg Acute Care Open. 2020;5(1): e000510.CrossRefPubMedPubMedCentral
11.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef
12.
go back to reference Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol. 2008;61(1):29–48.CrossRefPubMed Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol. 2008;61(1):29–48.CrossRefPubMed
13.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.CrossRef
17.
go back to reference LaGrone LN, McIntyre L, Riggle A, Robinson BRH, Maier RV, Bulger E, et al. Changes in error patterns in unanticipated trauma deaths during 20 years: in pursuit of zero preventable deaths. J Trauma Acute Care. 2020;89(6):1046–53.CrossRef LaGrone LN, McIntyre L, Riggle A, Robinson BRH, Maier RV, Bulger E, et al. Changes in error patterns in unanticipated trauma deaths during 20 years: in pursuit of zero preventable deaths. J Trauma Acute Care. 2020;89(6):1046–53.CrossRef
18.
go back to reference Nagaraj MB, Lowe JE, Marinica AL, Morshedi BB, Isaacs SM, Miller BL, et al. Using Trauma Video Review to Assess EMS Handoff and Trauma Team Non-Technical Skills. Prehosp Emerg Care. 2021;22:1–8.CrossRef Nagaraj MB, Lowe JE, Marinica AL, Morshedi BB, Isaacs SM, Miller BL, et al. Using Trauma Video Review to Assess EMS Handoff and Trauma Team Non-Technical Skills. Prehosp Emerg Care. 2021;22:1–8.CrossRef
19.
go back to reference Iedema R, Ball C, Daly B, Young J, Green T, Middleton PM, et al. Design and trial of a new ambulance-to-emergency department handover protocol: ‘IMIST-AMBO.’ Bmj Qual Saf. 2012;21(8):627.CrossRefPubMed Iedema R, Ball C, Daly B, Young J, Green T, Middleton PM, et al. Design and trial of a new ambulance-to-emergency department handover protocol: ‘IMIST-AMBO.’ Bmj Qual Saf. 2012;21(8):627.CrossRefPubMed
20.
go back to reference Patterson MD, Geis GL, Falcone RA, LeMaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. Bmj Qual Saf. 2013;22(6):468.CrossRefPubMed Patterson MD, Geis GL, Falcone RA, LeMaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. Bmj Qual Saf. 2013;22(6):468.CrossRefPubMed
21.
go back to reference Wheeler DS, Geis G, Mack EH, LeMaster T, Patterson MD. High-reliability emergency response teams in the hospital: improving quality and safety using in situ simulation training. Bmj Qual Saf. 2013;22(6):507.CrossRefPubMed Wheeler DS, Geis G, Mack EH, LeMaster T, Patterson MD. High-reliability emergency response teams in the hospital: improving quality and safety using in situ simulation training. Bmj Qual Saf. 2013;22(6):507.CrossRefPubMed
Metadata
Title
Introducing the Safety Threats and Adverse events in Trauma (STAT) taxonomy: standardized classification system for evaluating safety during trauma resuscitation
Authors
Nemanja Baletic
Jamie Riggs
Gerald Lebovic
Andrew Petrosoniak
Ryan P. Dumas
Brodie Nolan
Publication date
07-06-2022
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Trauma and Emergency Surgery / Issue 6/2022
Print ISSN: 1863-9933
Electronic ISSN: 1863-9941
DOI
https://doi.org/10.1007/s00068-022-02007-9

Other articles of this Issue 6/2022

European Journal of Trauma and Emergency Surgery 6/2022 Go to the issue