Skip to main content
Top
Published in: European Journal of Medical Research 1/2021

Open Access 01-12-2021 | Polytrauma | Research

Interobserver variability of injury severity assessment in polytrauma patients: does the anatomical region play a role?

Authors: Eftychios Bolierakis, Sylvia Schick, Kai Sprengel, Kai Oliver Jensen, Frank Hildebrand, Hans-Christoph Pape, Roman Pfeifer

Published in: European Journal of Medical Research | Issue 1/2021

Login to get access

Abstract

Background

The Abbreviated Injury Scale (AIS) and Injury Severity Score (ISS) are widely used to assess trauma patients. In this study, the interobserver variability of the injury severity assessment for severely injured patients was analyzed based on different injured anatomical regions, and the various demographic backgrounds of the observers.

Methods

A standardized questionnaire was presented to surgical experts and participants of clinical polytrauma courses. It contained medical information and initial X-rays/CT-scans of 10 cases of severely injured patients. Participants estimated the severity of each injury based on the AIS. Interobserver variability for the AIS, ISS, and New Injury Severity Score (NISS) was calculated by employing the statistical method of Krippendorff's α coefficient.

Results

Overall, 54 participants were included. The major contributing medical specialties were orthopedic trauma surgery (N = 36, 67%) and general surgery (N = 13, 24%). The measured interobserver variability in the assessment of the overall injury severity was high (α ISS: 0.33 / α NISS: 0.23). Moreover, there were differences in the interobserver variability of the maximum AIS (MAIS) depending on the anatomical region: αhead and neck: 0.06, αthorax: 0.45, αabdomen: 0.27 and αextremities: 0.55.

Conclusions

Interobserver agreement concerning injury severity assessment appears to be low among clinicians. We also noted marked differences in variability according to injury anatomy. The study shows that the assessment of injury severity is also highly variable between experts in the field. This implies the need for appropriate education to improve the accuracy of trauma evaluation in the respective trauma registries.
Appendix
Available only for authorised users
Literature
1.
go back to reference World Health Organization. The injury chartbook: a graphical overview of the global burden of injuries. Geneva: WHO; 2002. World Health Organization. The injury chartbook: a graphical overview of the global burden of injuries. Geneva: WHO; 2002.
2.
go back to reference Lyons RA, Finch CF, McClure R, van Beeck E, Macey S. The injury list of all deficits (LOAD) framework–conceptualising the full range of deficits and adverse outcomes following injury and violence. Int J Inj Contr Saf Promot. 2010;17:145–59.CrossRef Lyons RA, Finch CF, McClure R, van Beeck E, Macey S. The injury list of all deficits (LOAD) framework–conceptualising the full range of deficits and adverse outcomes following injury and violence. Int J Inj Contr Saf Promot. 2010;17:145–59.CrossRef
4.
go back to reference Costa CDS, Scarpelini S. Avaliação da qualidade do atendimento ao traumatizado através do estudo das mortes em um hospital terciário. Rev Col Bras Cir. 2012;39(4):249–54.CrossRef Costa CDS, Scarpelini S. Avaliação da qualidade do atendimento ao traumatizado através do estudo das mortes em um hospital terciário. Rev Col Bras Cir. 2012;39(4):249–54.CrossRef
5.
go back to reference Van Belleghem G, Devos S, De Wit L, Hubloue I, Lauwaert D, Pien K, et al. Predicting in-hospital mortality of traffic victims: a comparison between AIS-and ICD-9-CM-related injury severity scales when only ICD-9-CM is reported. Injury. 2016;47(1):141–6.CrossRef Van Belleghem G, Devos S, De Wit L, Hubloue I, Lauwaert D, Pien K, et al. Predicting in-hospital mortality of traffic victims: a comparison between AIS-and ICD-9-CM-related injury severity scales when only ICD-9-CM is reported. Injury. 2016;47(1):141–6.CrossRef
6.
go back to reference Lefering R. Trauma score systems for quality assessment. Eur J Trauma. 2002;28:52–63.CrossRef Lefering R. Trauma score systems for quality assessment. Eur J Trauma. 2002;28:52–63.CrossRef
7.
go back to reference Gennarelli TA, Wodzin E. Abbreviated Injury Scale 2005 update 2008. Barrington: Association for the Advancement of Automotive Medicine; 2008. Gennarelli TA, Wodzin E. Abbreviated Injury Scale 2005 update 2008. Barrington: Association for the Advancement of Automotive Medicine; 2008.
8.
go back to reference Baker SP, O’Neill B, Haddon W, Long WB. The Injury Severity Score: a method for describing patients with multiple injuries and evaluating emergency care. J Trauma. 1974;14:187–96.CrossRef Baker SP, O’Neill B, Haddon W, Long WB. The Injury Severity Score: a method for describing patients with multiple injuries and evaluating emergency care. J Trauma. 1974;14:187–96.CrossRef
9.
go back to reference Copes WS, Champion H, Sacco WJ, Lawnick MM, Keast SL, Bain LW. The Injury Severity Score revisited. J Trauma. 1988;28:69–77.CrossRef Copes WS, Champion H, Sacco WJ, Lawnick MM, Keast SL, Bain LW. The Injury Severity Score revisited. J Trauma. 1988;28:69–77.CrossRef
10.
go back to reference States JD. Abbreviated and the comprehensive research injury scales. Proceedings of the 13th Stapp Car Crash Conference. New York, NY, USA: Society of Automotive Engineers; 1969. States JD. Abbreviated and the comprehensive research injury scales. Proceedings of the 13th Stapp Car Crash Conference. New York, NY, USA: Society of Automotive Engineers; 1969.
11.
go back to reference Pape HC, Giannoudis PV. Management of the multiply injured patient. In: Bucholz RW, Heckman JD, Court-Brown C, Tornetta P, Koval KJ, Wirth MA, editors. Rockwood & Green’s fractures in adults. 6th ed. Philadelphia: Lippincott Williams & Wilkins; 2005. p. 60–93. Pape HC, Giannoudis PV. Management of the multiply injured patient. In: Bucholz RW, Heckman JD, Court-Brown C, Tornetta P, Koval KJ, Wirth MA, editors. Rockwood & Green’s fractures in adults. 6th ed. Philadelphia: Lippincott Williams & Wilkins; 2005. p. 60–93.
12.
go back to reference Mica L, Rufibach K, Keel M, Trentz O. The risk of early mortality of polytrauma patients associated to ISS, NISS, APACHE II values and prothrombin time. J Trauma Manag Outcomes. 2013;7(1):6.CrossRef Mica L, Rufibach K, Keel M, Trentz O. The risk of early mortality of polytrauma patients associated to ISS, NISS, APACHE II values and prothrombin time. J Trauma Manag Outcomes. 2013;7(1):6.CrossRef
13.
go back to reference Trentz OL. Polytrauma: pathophysiology, priorities, and management. In: Rüedi TP, Murphy WM, editors. AO principles of fracture management. 1st ed. Stuttgart: Thieme; 2000. p. 661–73. Trentz OL. Polytrauma: pathophysiology, priorities, and management. In: Rüedi TP, Murphy WM, editors. AO principles of fracture management. 1st ed. Stuttgart: Thieme; 2000. p. 661–73.
14.
go back to reference Stahel PF, Heyde CE, Ertel W. Current concepts of polytrauma management. Eur J Trauma. 2005;31:200–11.CrossRef Stahel PF, Heyde CE, Ertel W. Current concepts of polytrauma management. Eur J Trauma. 2005;31:200–11.CrossRef
15.
go back to reference Lecky FE, Bouamra O, Woodford M, Alexandrescu R, O’Brien SJ. Epidemiology of polytrauma. In: Pape HC, Peitzman A, Schwab CW, Giannoudis PV, editors. Damage control management in the polytrauma patient. New York: Springer; 2010. p. 13–24.CrossRef Lecky FE, Bouamra O, Woodford M, Alexandrescu R, O’Brien SJ. Epidemiology of polytrauma. In: Pape HC, Peitzman A, Schwab CW, Giannoudis PV, editors. Damage control management in the polytrauma patient. New York: Springer; 2010. p. 13–24.CrossRef
16.
go back to reference Hildebrand F, Giannoudis P, Krettek C, Pape HC. Damage control: extremities. Injury. 2004;35(7):678–89.CrossRef Hildebrand F, Giannoudis P, Krettek C, Pape HC. Damage control: extremities. Injury. 2004;35(7):678–89.CrossRef
17.
go back to reference Border JR, LaDuca J, Seibel R. Priorities in the management of the patient with polytrauma. Prog Surg. 1975;14:84–120.CrossRef Border JR, LaDuca J, Seibel R. Priorities in the management of the patient with polytrauma. Prog Surg. 1975;14:84–120.CrossRef
18.
go back to reference Faist E, Baue AE, Dittmer H, Heberer G. Multiple organ failure in polytrauma patients. J Trauma. 1983;23(9):775–87.CrossRef Faist E, Baue AE, Dittmer H, Heberer G. Multiple organ failure in polytrauma patients. J Trauma. 1983;23(9):775–87.CrossRef
19.
go back to reference Tscherne H, Oestern HJ, Sturm JA. Stress tolerance of patients with multiple injuries and its significance for operative care. Langenbecks Arch Chir. 1984;364:71–7.CrossRef Tscherne H, Oestern HJ, Sturm JA. Stress tolerance of patients with multiple injuries and its significance for operative care. Langenbecks Arch Chir. 1984;364:71–7.CrossRef
20.
go back to reference Palmer CS, Gabbe BJ, Cameron PA. Defining major trauma using the 2008 Abbreviated Injury Scale. Injury. 2016;47(1):109–15.CrossRef Palmer CS, Gabbe BJ, Cameron PA. Defining major trauma using the 2008 Abbreviated Injury Scale. Injury. 2016;47(1):109–15.CrossRef
21.
go back to reference Huber S, Biberthaler P, Delhey P, Trentzsch H, Winter H, van Griensven M, et al. Predictors of poor outcomes after significant chest trauma in multiply injured patients: a retrospective analysis from the German Trauma Registry (Trauma Register DGU®). Scand J Trauma Resusc Emerg Med. 2014;22(1):52.CrossRef Huber S, Biberthaler P, Delhey P, Trentzsch H, Winter H, van Griensven M, et al. Predictors of poor outcomes after significant chest trauma in multiply injured patients: a retrospective analysis from the German Trauma Registry (Trauma Register DGU®). Scand J Trauma Resusc Emerg Med. 2014;22(1):52.CrossRef
22.
go back to reference Maduz R, Kugelmeier P, Meili S, Döring R, Meier C, Wahl P. Major influence of interobserver reliability on polytrauma identification with the Injury Severity Score (ISS): time for a centralised coding in trauma registries? Injury. 2017;48(4):885–9.CrossRef Maduz R, Kugelmeier P, Meili S, Döring R, Meier C, Wahl P. Major influence of interobserver reliability on polytrauma identification with the Injury Severity Score (ISS): time for a centralised coding in trauma registries? Injury. 2017;48(4):885–9.CrossRef
23.
go back to reference Lavoie A, Moore L, LeSage N, Liberman M, Sampalis JS. The Injury Severity Score or the new Injury Severity Score for predicting intensive care unit admission and hospital length of stay? Injury. 2005;36(4):477–83.CrossRef Lavoie A, Moore L, LeSage N, Liberman M, Sampalis JS. The Injury Severity Score or the new Injury Severity Score for predicting intensive care unit admission and hospital length of stay? Injury. 2005;36(4):477–83.CrossRef
24.
go back to reference Rutledge R, Hoyt DB, Eastman AB, Sise MJ, Velky T, Canty T, et al. Comparison of the Injury Severity Score and ICD-9 diagnosis codes as predictors of outcome in injury: analysis of 44,032 patients. J Trauma Acute Care Surg. 1997;42(3):477–89.CrossRef Rutledge R, Hoyt DB, Eastman AB, Sise MJ, Velky T, Canty T, et al. Comparison of the Injury Severity Score and ICD-9 diagnosis codes as predictors of outcome in injury: analysis of 44,032 patients. J Trauma Acute Care Surg. 1997;42(3):477–89.CrossRef
25.
go back to reference Stevenson M, Segui-Gomez M, Lescohier I, Di Scala C, McDonald-Smith GJ. An overview of the Injury Severity Score and the new Injury Severity Score. Inj Prev. 2001;7(1):10–3.CrossRef Stevenson M, Segui-Gomez M, Lescohier I, Di Scala C, McDonald-Smith GJ. An overview of the Injury Severity Score and the new Injury Severity Score. Inj Prev. 2001;7(1):10–3.CrossRef
26.
go back to reference MacKenzie EJ, Garthe, EA, Gibson G. Evaluating the abbreviated injury scale. Proceedings of the American Association for Automotive Medicine Annual Conference in Ann Arbor. Barrington, IL, USA: Association for the Advancement of Automotive Medicine; 1978. MacKenzie EJ, Garthe, EA, Gibson G. Evaluating the abbreviated injury scale. Proceedings of the American Association for Automotive Medicine Annual Conference in Ann Arbor. Barrington, IL, USA: Association for the Advancement of Automotive Medicine; 1978.
27.
go back to reference MacKenzie EJ, Shapiro S, Eastham JN. The abbreviated injury scale and Injury Severity Score levels of inter- and intrarater reliability. Med Care. 1985;23(6):823–35.CrossRef MacKenzie EJ, Shapiro S, Eastham JN. The abbreviated injury scale and Injury Severity Score levels of inter- and intrarater reliability. Med Care. 1985;23(6):823–35.CrossRef
28.
go back to reference Rutledge R. The Injury Severity Score is unable to differentiate between poor care and severe injury. J Trauma Acute Care Surg. 1996;40:944–50.CrossRef Rutledge R. The Injury Severity Score is unable to differentiate between poor care and severe injury. J Trauma Acute Care Surg. 1996;40:944–50.CrossRef
29.
go back to reference Butcher NE, Enninghorst N, Sisak K, Balogh ZJ. The definition of polytrauma: variable interrater versus intrarater agreement—a prospective international study among trauma surgeons. J Trauma Acute Care Surg. 2013;74(3):884–9.CrossRef Butcher NE, Enninghorst N, Sisak K, Balogh ZJ. The definition of polytrauma: variable interrater versus intrarater agreement—a prospective international study among trauma surgeons. J Trauma Acute Care Surg. 2013;74(3):884–9.CrossRef
30.
go back to reference Ringdal KG, Skaga NO, Hestnes M, Steen PA, Roislien J, Rehn M, et al. Abbreviated injury scale: not a reliable basis for summation of injury severity in trauma facilities? Injury. 2013;44:691–9.CrossRef Ringdal KG, Skaga NO, Hestnes M, Steen PA, Roislien J, Rehn M, et al. Abbreviated injury scale: not a reliable basis for summation of injury severity in trauma facilities? Injury. 2013;44:691–9.CrossRef
31.
go back to reference Neale R, Rokkas P, McClure RJ. Interrater reliability of injury coding in the Queensland Trauma Registry. Emerg Med. 2003;15:38–41.CrossRef Neale R, Rokkas P, McClure RJ. Interrater reliability of injury coding in the Queensland Trauma Registry. Emerg Med. 2003;15:38–41.CrossRef
33.
go back to reference Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1(1):77–89.CrossRef Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1(1):77–89.CrossRef
35.
go back to reference Fleiss JL. The measurement of interrater agreement. In: Fleiss JL, editor. Statistical methods for rates and proportions. New York: Wiley; 1981. p. 212–25. Fleiss JL. The measurement of interrater agreement. In: Fleiss JL, editor. Statistical methods for rates and proportions. New York: Wiley; 1981. p. 212–25.
36.
go back to reference Paffrath T, Lefering R, Flohe S, TraumaRegister DGU. How to define severely injured patients?—An Injury Severity Score (ISS) based approach alone is not sufficient. Injury. 2014;45(S3):64–9.CrossRef Paffrath T, Lefering R, Flohe S, TraumaRegister DGU. How to define severely injured patients?—An Injury Severity Score (ISS) based approach alone is not sufficient. Injury. 2014;45(S3):64–9.CrossRef
37.
38.
go back to reference Zoltie N, de Dombal FT. The hit and miss of ISS and TRISS. Yorkshire Trauma Audit Group. BMJ. 1993;307(6909):906–9.CrossRef Zoltie N, de Dombal FT. The hit and miss of ISS and TRISS. Yorkshire Trauma Audit Group. BMJ. 1993;307(6909):906–9.CrossRef
40.
go back to reference Brown JB, Gestring ML, Leeper CM, Sperry JL, Peitzman AB, Billiar TR, et al. The value of the injury severity score in pediatric trauma: time for a new definition of severe injury? J Trauma Acute Care Surg. 2017;82(6):995–1001.CrossRef Brown JB, Gestring ML, Leeper CM, Sperry JL, Peitzman AB, Billiar TR, et al. The value of the injury severity score in pediatric trauma: time for a new definition of severe injury? J Trauma Acute Care Surg. 2017;82(6):995–1001.CrossRef
41.
go back to reference Waydhas C, Nast-Kolb D, Trupka A, Kerim-Sade C, Kanz G, Zoller J, et al. Trauma scores: reproducibility and reliability. Unfallchirurg. 1992;95:67–70.PubMed Waydhas C, Nast-Kolb D, Trupka A, Kerim-Sade C, Kanz G, Zoller J, et al. Trauma scores: reproducibility and reliability. Unfallchirurg. 1992;95:67–70.PubMed
42.
go back to reference Joosse P, de Jongh MA, van Delft-Schreurs CC, Verhofstad MH, Goslings JC. Improving performance and agreement in injury coding using the Abbreviated Injury Scale: a training course helps. HIM J. 2014;43(2):17–22.CrossRef Joosse P, de Jongh MA, van Delft-Schreurs CC, Verhofstad MH, Goslings JC. Improving performance and agreement in injury coding using the Abbreviated Injury Scale: a training course helps. HIM J. 2014;43(2):17–22.CrossRef
Metadata
Title
Interobserver variability of injury severity assessment in polytrauma patients: does the anatomical region play a role?
Authors
Eftychios Bolierakis
Sylvia Schick
Kai Sprengel
Kai Oliver Jensen
Frank Hildebrand
Hans-Christoph Pape
Roman Pfeifer
Publication date
01-12-2021
Publisher
BioMed Central
Published in
European Journal of Medical Research / Issue 1/2021
Electronic ISSN: 2047-783X
DOI
https://doi.org/10.1186/s40001-021-00506-w

Other articles of this Issue 1/2021

European Journal of Medical Research 1/2021 Go to the issue