Skip to main content
Top
Published in: European Spine Journal 4/2016

01-04-2016 | Original Article

Reliability analysis of the AOSpine thoracolumbar spine injury classification system by a worldwide group of naïve spinal surgeons

Authors: Christopher K. Kepler, Alexander R. Vaccaro, John D. Koerner, Marcel F. Dvorak, Frank Kandziora, Shanmuganathan Rajasekaran, Bizhan Aarabi, Luiz R. Vialle, Michael G. Fehlings, Gregory D. Schroeder, Maximilian Reinhold, Klaus John Schnake, Carlo Bellabarba, F. Cumhur Öner

Published in: European Spine Journal | Issue 4/2016

Login to get access

Abstract

Purpose

The aims of this study were (1) to demonstrate the AOSpine thoracolumbar spine injury classification system can be reliably applied by an international group of surgeons and (2) to delineate those injury types which are difficult for spine surgeons to classify reliably.

Methods

A previously described classification system of thoracolumbar injuries which consists of a morphologic classification of the fracture, a grading system for the neurologic status and relevant patient-specific modifiers was applied to 25 cases by 100 spinal surgeons from across the world twice independently, in grading sessions 1 month apart. The results were analyzed for classification reliability using the Kappa coefficient (κ).

Results

The overall Kappa coefficient for all cases was 0.56, which represents moderate reliability. Kappa values describing interobserver agreement were 0.80 for type A injuries, 0.68 for type B injuries and 0.72 for type C injuries, all representing substantial reliability. The lowest level of agreement for specific subtypes was for fracture subtype A4 (Kappa = 0.19). Intraobserver analysis demonstrated overall average Kappa statistic for subtype grading of 0.68 also representing substantial reproducibility.

Conclusion

In a worldwide sample of spinal surgeons without previous exposure to the recently described AOSpine Thoracolumbar Spine Injury Classification System, we demonstrated moderate interobserver and substantial intraobserver reliability. These results suggest that most spine surgeons can reliably apply this system to spine trauma patients as or more reliably than previously described systems.
Literature
2.
go back to reference Bailey CS, Urquhart JC, Dvorak MF, Nadeau M, Boyd MC, Thomas KC, Kwon BK, Gurr KR, Bailey SI, Fisher CG (2014) Orthosis versus no orthosis for the treatment of thoracolumbar burst fractures without neurologic injury: a multicenter prospective randomized equivalence trial. Spine J 14(11):2557–2564CrossRefPubMed Bailey CS, Urquhart JC, Dvorak MF, Nadeau M, Boyd MC, Thomas KC, Kwon BK, Gurr KR, Bailey SI, Fisher CG (2014) Orthosis versus no orthosis for the treatment of thoracolumbar burst fractures without neurologic injury: a multicenter prospective randomized equivalence trial. Spine J 14(11):2557–2564CrossRefPubMed
3.
go back to reference Harrop JS, Vaccaro AR, Hurlbert RJ, Wilsey JT, Baron EM, Shaffrey CI, Fisher CG, Dvorak MF, Oner FC, Wood KB, Anand N, Anderson DG, Lim MR, Lee JY, Bono CM, Arnold PM, Rampersaud YR, Fehlings MG, Spine Trauma Study Group (2006) Intrarater and interrater reliability and validity in the assessment of the mechanism of injury and integrity of the posterior ligamentous complex: a novel injury severity scoring system for thoracolumbar injuries. Invited submission from the Joint Section Meeting On Disorders of the Spine and Peripheral Nerves, March 2005. J Neurosurg Spine 4:118–122CrossRefPubMed Harrop JS, Vaccaro AR, Hurlbert RJ, Wilsey JT, Baron EM, Shaffrey CI, Fisher CG, Dvorak MF, Oner FC, Wood KB, Anand N, Anderson DG, Lim MR, Lee JY, Bono CM, Arnold PM, Rampersaud YR, Fehlings MG, Spine Trauma Study Group (2006) Intrarater and interrater reliability and validity in the assessment of the mechanism of injury and integrity of the posterior ligamentous complex: a novel injury severity scoring system for thoracolumbar injuries. Invited submission from the Joint Section Meeting On Disorders of the Spine and Peripheral Nerves, March 2005. J Neurosurg Spine 4:118–122CrossRefPubMed
4.
go back to reference Hauptfleisch J, Meagher TM, King D, Lopez de Heredia L, Hughes RJ (2013) Out-of-hours MRI provision in the UK and models of service delivery. Clin Radiol 68:e245–e248CrossRefPubMed Hauptfleisch J, Meagher TM, King D, Lopez de Heredia L, Hughes RJ (2013) Out-of-hours MRI provision in the UK and models of service delivery. Clin Radiol 68:e245–e248CrossRefPubMed
5.
go back to reference Kelly JC, O’Briain DE, Kelly GA, Mc Cabe JP (2012) Imaging the spine for tumour and trauma—a national audit of practice in Irish hospitals. Surgeon 10:80–83CrossRefPubMed Kelly JC, O’Briain DE, Kelly GA, Mc Cabe JP (2012) Imaging the spine for tumour and trauma—a national audit of practice in Irish hospitals. Surgeon 10:80–83CrossRefPubMed
6.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed
7.
go back to reference Magerl F, Aebi M, Gertzbein SD, Harms J, Nazarian S (1994) A comprehensive classification of thoracic and lumbar injuries. Eur Spine J 3:184–201CrossRefPubMed Magerl F, Aebi M, Gertzbein SD, Harms J, Nazarian S (1994) A comprehensive classification of thoracic and lumbar injuries. Eur Spine J 3:184–201CrossRefPubMed
8.
go back to reference Oner FC, Ramos LM, Simmermacher RK, Kingma PT, Diekerhof CH, Dhert WJ, Verbout AJ (2002) Classification of thoracic and lumbar spine fractures: problems of reproducibility. A study of 53 patients using CT and MRI. Eur Spine J 11:235–245CrossRefPubMedPubMedCentral Oner FC, Ramos LM, Simmermacher RK, Kingma PT, Diekerhof CH, Dhert WJ, Verbout AJ (2002) Classification of thoracic and lumbar spine fractures: problems of reproducibility. A study of 53 patients using CT and MRI. Eur Spine J 11:235–245CrossRefPubMedPubMedCentral
9.
go back to reference Reinhold M, Audige L, Schnake KJ, Bellabarba C, Dai LY, Oner FC (2013) AO spine injury classification system: a revision proposal for the thoracic and lumbar spine. Eur Spine J 22:2184–2201CrossRefPubMedPubMedCentral Reinhold M, Audige L, Schnake KJ, Bellabarba C, Dai LY, Oner FC (2013) AO spine injury classification system: a revision proposal for the thoracic and lumbar spine. Eur Spine J 22:2184–2201CrossRefPubMedPubMedCentral
10.
go back to reference Rihn JA, Yang N, Fisher C, Saravanja D, Smith H, Morrison WB, Harrop J, Vacaro AR (2010) Using magnetic resonance imaging to accurately assess injury to the posterior ligamentous complex of the spine: a prospective comparison of the surgeon and radiologist. J Neurosurg Spine 12:391–396CrossRefPubMed Rihn JA, Yang N, Fisher C, Saravanja D, Smith H, Morrison WB, Harrop J, Vacaro AR (2010) Using magnetic resonance imaging to accurately assess injury to the posterior ligamentous complex of the spine: a prospective comparison of the surgeon and radiologist. J Neurosurg Spine 12:391–396CrossRefPubMed
11.
go back to reference Schmid R, Krappinger D, Seykora P, Blauth M, Kathrein A (2010) PLIF in thoracolumbar trauma: technique and radiological results. Eur Spine J 19:1079–1086CrossRefPubMed Schmid R, Krappinger D, Seykora P, Blauth M, Kathrein A (2010) PLIF in thoracolumbar trauma: technique and radiological results. Eur Spine J 19:1079–1086CrossRefPubMed
12.
go back to reference Schmid R, Lindtner RA, Lill M, Blauth M, Krappinger D, Kammerlander C (2012) Combined posteroanterior fusion versus transforaminal lumbar interbody fusion (TLIF) in thoracolumbar burst fractures. Injury 43:475–479CrossRefPubMed Schmid R, Lindtner RA, Lill M, Blauth M, Krappinger D, Kammerlander C (2012) Combined posteroanterior fusion versus transforaminal lumbar interbody fusion (TLIF) in thoracolumbar burst fractures. Injury 43:475–479CrossRefPubMed
13.
go back to reference Schnake KJ, Stavridis SI, Kandziora F (2014) Five-year clinical and radiological results of combined anteroposterior stabilization of thoracolumbar fractures. J Neurosurg Spine 20:497–504CrossRefPubMed Schnake KJ, Stavridis SI, Kandziora F (2014) Five-year clinical and radiological results of combined anteroposterior stabilization of thoracolumbar fractures. J Neurosurg Spine 20:497–504CrossRefPubMed
14.
go back to reference Vaccaro AR, Lehman RA Jr, Hurlbert RJ, Anderson PA, Harris M, Hedlund R, Harrop J, Dvorak M, Wood K, Fehlings MG, Fisher C, Zeiller SC, Anderson DG, Bono CM, Stock GH, Brown AK, Kuklo T, Oner FC (2005) A new classification of thoracolumbar injuries: the importance of injury morphology, the integrity of the posterior ligamentous complex, and neurologic status. Spine (Phila Pa 1976) 30:2325–2333CrossRef Vaccaro AR, Lehman RA Jr, Hurlbert RJ, Anderson PA, Harris M, Hedlund R, Harrop J, Dvorak M, Wood K, Fehlings MG, Fisher C, Zeiller SC, Anderson DG, Bono CM, Stock GH, Brown AK, Kuklo T, Oner FC (2005) A new classification of thoracolumbar injuries: the importance of injury morphology, the integrity of the posterior ligamentous complex, and neurologic status. Spine (Phila Pa 1976) 30:2325–2333CrossRef
15.
go back to reference Vaccaro AR, Oner C, Kepler CK, Dvorak M, Schnake K, Bellabarba C, Reinhold M, Aarabi B, Kandziora F, Chapman J, Shanmuganathan R, Fehlings M, Vialle L, Forum AOSpine Spinal Cord Injury and Trauma Knowledge (2013) AOSpine thoracolumbar spine injury classification system: fracture description, neurological status, and key modifiers. Spine 38:2028–2037CrossRefPubMed Vaccaro AR, Oner C, Kepler CK, Dvorak M, Schnake K, Bellabarba C, Reinhold M, Aarabi B, Kandziora F, Chapman J, Shanmuganathan R, Fehlings M, Vialle L, Forum AOSpine Spinal Cord Injury and Trauma Knowledge (2013) AOSpine thoracolumbar spine injury classification system: fracture description, neurological status, and key modifiers. Spine 38:2028–2037CrossRefPubMed
16.
go back to reference Whang PG, Vaccaro AR, Poelstra KA, Patel AA, Anderson DG, Albert TJ, Hilibrand AS, Harrop JS, Sharan AD, Ratliff JK, Hurlbert RJ, Anderson P, Aarabi B, Sekhon LH, Gahr R, Carrino JA (2007) The influence of fracture mechanism and morphology on the reliability and validity of two novel thoracolumbar injury classification systems. Spine (Phila Pa 1976) 32:791–795CrossRef Whang PG, Vaccaro AR, Poelstra KA, Patel AA, Anderson DG, Albert TJ, Hilibrand AS, Harrop JS, Sharan AD, Ratliff JK, Hurlbert RJ, Anderson P, Aarabi B, Sekhon LH, Gahr R, Carrino JA (2007) The influence of fracture mechanism and morphology on the reliability and validity of two novel thoracolumbar injury classification systems. Spine (Phila Pa 1976) 32:791–795CrossRef
17.
go back to reference Wood KB, Khanna G, Vaccaro AR, Arnold PM, Harris MB, Mehbod AA (2005) Assessment of two thoracolumbar fracture classification systems as used by multiple surgeons. J Bone Joint Surg Am 87:1423–1429CrossRefPubMed Wood KB, Khanna G, Vaccaro AR, Arnold PM, Harris MB, Mehbod AA (2005) Assessment of two thoracolumbar fracture classification systems as used by multiple surgeons. J Bone Joint Surg Am 87:1423–1429CrossRefPubMed
Metadata
Title
Reliability analysis of the AOSpine thoracolumbar spine injury classification system by a worldwide group of naïve spinal surgeons
Authors
Christopher K. Kepler
Alexander R. Vaccaro
John D. Koerner
Marcel F. Dvorak
Frank Kandziora
Shanmuganathan Rajasekaran
Bizhan Aarabi
Luiz R. Vialle
Michael G. Fehlings
Gregory D. Schroeder
Maximilian Reinhold
Klaus John Schnake
Carlo Bellabarba
F. Cumhur Öner
Publication date
01-04-2016
Publisher
Springer Berlin Heidelberg
Published in
European Spine Journal / Issue 4/2016
Print ISSN: 0940-6719
Electronic ISSN: 1432-0932
DOI
https://doi.org/10.1007/s00586-015-3765-9

Other articles of this Issue 4/2016

European Spine Journal 4/2016 Go to the issue