Skip to main content
Top
Published in: Knee Surgery, Sports Traumatology, Arthroscopy 4/2016

Open Access 01-04-2016 | Ankle

Reliability of classification for post-traumatic ankle osteoarthritis

Authors: Femke M. A. P. Claessen, Diederik T. Meijer, Michel P. J. van den Bekerom, Barend D. J. Gevers Deynoot, Wouter H. Mallee, Job N. Doornberg, C. Niek van Dijk

Published in: Knee Surgery, Sports Traumatology, Arthroscopy | Issue 4/2016

Login to get access

Abstract

Purpose

The purpose of this study was to identify the most reliable classification system for clinical outcome studies to categorize post-traumatic—fracture—osteoarthritis.

Methods

A total of 118 orthopaedic surgeons and residents—gathered in the Ankle Platform Study Collaborative Science of Variation Group—evaluated 128 anteroposterior and lateral radiographs of patients after a bi- or trimalleolar ankle fracture on a Web-based platform in order to rate post-traumatic osteoarthritis according to the classification systems coined by (1) van Dijk, (2) Kellgren, and (3) Takakura. Reliability was evaluated with the use of the Siegel and Castellan’s multirater kappa measure. Differences between classification systems were compared using the two-sample Z-test.

Results

Interobserver agreement of surgeons who participated in the survey was fair for the van Dijk osteoarthritis scale (k = 0.24), and poor for the Takakura (k = 0.19) and the Kellgren systems (k = 0.18) according to the categorical rating of Landis and Koch. This difference in one categorical rating was found to be significant (p < 0.001, CI 0.046–0.053) with the high numbers of observers and cases available.

Conclusions

This study documents fair interobserver agreement for the van Dijk osteoarthritis scale, and poor interobserver agreement for the Takakura and Kellgren osteoarthritis classification systems. Because of the low interobserver agreement for the van Dijk, Kellgren, and Takakura classification systems, those systems cannot be used for clinical decision-making.

Level of evidence

Development of diagnostic criteria on basis of consecutive patients, Level II.
Appendix
Available only for authorised users
Literature
1.
go back to reference Barg A, Pagenstert GI, Hugle T, Gloyer M, Wiewiorski M, Henninger HB, Valderrabano V (2013) Ankle osteoarthritis: etiology, diagnostics, and classification. Foot Ankle Clin 18(3):411–426CrossRefPubMed Barg A, Pagenstert GI, Hugle T, Gloyer M, Wiewiorski M, Henninger HB, Valderrabano V (2013) Ankle osteoarthritis: etiology, diagnostics, and classification. Foot Ankle Clin 18(3):411–426CrossRefPubMed
2.
go back to reference Bruinsma WE, Guitton TG, Warner JJ, Ring D, Science of Variation G (2013) Interobserver reliability of classification and characterization of proximal humeral fractures: a comparison of two and three-dimensional CT. J Bone Joint Surg Am 95(17):1600–1604CrossRefPubMed Bruinsma WE, Guitton TG, Warner JJ, Ring D, Science of Variation G (2013) Interobserver reliability of classification and characterization of proximal humeral fractures: a comparison of two and three-dimensional CT. J Bone Joint Surg Am 95(17):1600–1604CrossRefPubMed
3.
go back to reference Buchner M, Sabo D (2003) Ankle fusion attributable to posttraumatic arthrosis: a long-term followup of 48 patients. Clin Orthop Relat Res 406:155–164CrossRefPubMed Buchner M, Sabo D (2003) Ankle fusion attributable to posttraumatic arthrosis: a long-term followup of 48 patients. Clin Orthop Relat Res 406:155–164CrossRefPubMed
4.
go back to reference Buijze GA, Guitton TG, van Dijk CN, Ring D, Science of Variation G (2012) Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clin Orthop Relat Res 470(7):2029–2034CrossRefPubMedPubMedCentral Buijze GA, Guitton TG, van Dijk CN, Ring D, Science of Variation G (2012) Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clin Orthop Relat Res 470(7):2029–2034CrossRefPubMedPubMedCentral
5.
go back to reference Coester LM, Saltzman CL, Leupold J, Pontarelli W (2001) Long-term results following ankle arthrodesis for post-traumatic arthritis. J Bone Joint Surg Am 83-A(2):219–228PubMed Coester LM, Saltzman CL, Leupold J, Pontarelli W (2001) Long-term results following ankle arthrodesis for post-traumatic arthritis. J Bone Joint Surg Am 83-A(2):219–228PubMed
6.
go back to reference Doornberg JN, Guitton TG, Ring D, Science of Variation G (2013) Diagnosis of elbow fracture patterns on radiographs: interobserver reliability and diagnostic accuracy. Clin Orthop Relat Res 471(4):1373–1378CrossRefPubMedPubMedCentral Doornberg JN, Guitton TG, Ring D, Science of Variation G (2013) Diagnosis of elbow fracture patterns on radiographs: interobserver reliability and diagnostic accuracy. Clin Orthop Relat Res 471(4):1373–1378CrossRefPubMedPubMedCentral
7.
go back to reference Doring AC, Hageman MG, Mulder FJ, Guitton TG, Ring D, Science of Variation G (2014) Trigger finger: assessment of surgeon and patient preferences and priorities for decision making. J Hand Surg Am 39(11):2208–2213 (e2202)CrossRefPubMed Doring AC, Hageman MG, Mulder FJ, Guitton TG, Ring D, Science of Variation G (2014) Trigger finger: assessment of surgeon and patient preferences and priorities for decision making. J Hand Surg Am 39(11):2208–2213 (e2202)CrossRefPubMed
8.
go back to reference Fitzgibbons TC (1999) Arthroscopic ankle debridement and fusion: indications, techniques, and results. Instr Course Lect 48:243–248PubMed Fitzgibbons TC (1999) Arthroscopic ankle debridement and fusion: indications, techniques, and results. Instr Course Lect 48:243–248PubMed
9.
go back to reference Gross AE, Agnidis Z, Hutchison CR (2001) Osteochondral defects of the talus treated with fresh osteochondral allograft transplantation. J Foot Ankle Surg 22(5):385–391 Gross AE, Agnidis Z, Hutchison CR (2001) Osteochondral defects of the talus treated with fresh osteochondral allograft transplantation. J Foot Ankle Surg 22(5):385–391
10.
go back to reference Guitton TG, Ring D, Science of Variation G (2011) Interobserver reliability of radial head fracture classification: two-dimensional compared with three-dimensional CT. J Bone Joint Surg Am 93(21):2015–2021CrossRefPubMed Guitton TG, Ring D, Science of Variation G (2011) Interobserver reliability of radial head fracture classification: two-dimensional compared with three-dimensional CT. J Bone Joint Surg Am 93(21):2015–2021CrossRefPubMed
11.
go back to reference Hageman MG, Becker SJ, Bot AG, Guitton T, Ring D, Science of Variation G (2013) Variation in recommendation for surgical treatment for compressive neuropathy. J Hand Surg Am 38(5):856–862CrossRefPubMed Hageman MG, Becker SJ, Bot AG, Guitton T, Ring D, Science of Variation G (2013) Variation in recommendation for surgical treatment for compressive neuropathy. J Hand Surg Am 38(5):856–862CrossRefPubMed
12.
go back to reference Hageman MG, Guitton TG, Ring D, Science of Variation G (2013) How surgeons make decisions when the evidence is inconclusive. J Hand Surg Am 38(6):1202–1208CrossRefPubMed Hageman MG, Guitton TG, Ring D, Science of Variation G (2013) How surgeons make decisions when the evidence is inconclusive. J Hand Surg Am 38(6):1202–1208CrossRefPubMed
13.
go back to reference Hageman MG, Jayakumar P, King JD, Guitton TG, Doornberg JN, Ring D, Science of Variation G (2015) The factors influencing the decision making of operative treatment for proximal humeral fractures. J Shoulder Elbow Surg 24(1):e21–e26CrossRefPubMed Hageman MG, Jayakumar P, King JD, Guitton TG, Doornberg JN, Ring D, Science of Variation G (2015) The factors influencing the decision making of operative treatment for proximal humeral fractures. J Shoulder Elbow Surg 24(1):e21–e26CrossRefPubMed
14.
go back to reference Hageman MG, Kinaci A, Ju K, Guitton TG, Mudgal CS, Ring D, Science of Variation G (2014) Carpal tunnel syndrome: assessment of surgeon and patient preferences and priorities for decision-making. J Hand Surg Am 39(9):1799–1804 (e1791)CrossRefPubMed Hageman MG, Kinaci A, Ju K, Guitton TG, Mudgal CS, Ring D, Science of Variation G (2014) Carpal tunnel syndrome: assessment of surgeon and patient preferences and priorities for decision-making. J Hand Surg Am 39(9):1799–1804 (e1791)CrossRefPubMed
16.
go back to reference Krause FG, Di Silvestro M, Penner MJ, Wing KJ, Glazebrook MA, Daniels TR, Lau JT, Younger AS (2012) The postoperative COFAS end-stage ankle arthritis classification system: interobserver and intraobserver reliability. Foot Ankle Spec 5(1):31–36CrossRefPubMed Krause FG, Di Silvestro M, Penner MJ, Wing KJ, Glazebrook MA, Daniels TR, Lau JT, Younger AS (2012) The postoperative COFAS end-stage ankle arthritis classification system: interobserver and intraobserver reliability. Foot Ankle Spec 5(1):31–36CrossRefPubMed
17.
go back to reference Lambers KT, van den Bekerom MP, Doornberg JN, Stufkens SA, van Dijk CN, Kloen P (2013) Long-term outcome of pronation-external rotation ankle fractures treated with syndesmotic screws only. J Bone Joint Surg Am 95(17):e1221–e1227CrossRefPubMed Lambers KT, van den Bekerom MP, Doornberg JN, Stufkens SA, van Dijk CN, Kloen P (2013) Long-term outcome of pronation-external rotation ankle fractures treated with syndesmotic screws only. J Bone Joint Surg Am 95(17):e1221–e1227CrossRefPubMed
18.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed
19.
go back to reference Mayich DJ, Pinsker E, Mayich MS, Mak W, Daniels TR (2013) An analysis of the use of the Kellgren and Lawrence grading system to evaluate peritalar arthritis following total ankle arthroplasty. J Foot Ankle Surg 34(11):1508–1515CrossRef Mayich DJ, Pinsker E, Mayich MS, Mak W, Daniels TR (2013) An analysis of the use of the Kellgren and Lawrence grading system to evaluate peritalar arthritis following total ankle arthroplasty. J Foot Ankle Surg 34(11):1508–1515CrossRef
20.
go back to reference Mellema JJ, Doornberg JN, Guitton TG, Ring D, Science of Variation G (2014) Biomechanical studies: Science (f)or common sense? Injury 45(12):2035–2039CrossRefPubMed Mellema JJ, Doornberg JN, Guitton TG, Ring D, Science of Variation G (2014) Biomechanical studies: Science (f)or common sense? Injury 45(12):2035–2039CrossRefPubMed
21.
go back to reference Newton SE 3rd (1982) Total ankle arthroplasty. Clinical study of fifty cases. J Bone Joint Surg Am 64(1):104–111PubMed Newton SE 3rd (1982) Total ankle arthroplasty. Clinical study of fifty cases. J Bone Joint Surg Am 64(1):104–111PubMed
22.
go back to reference Nihal A, Gellman RE, Embil JM, Trepman E (2008) Ankle arthrodesis. J Foot Ankle Surg 14(1):1–10CrossRef Nihal A, Gellman RE, Embil JM, Trepman E (2008) Ankle arthrodesis. J Foot Ankle Surg 14(1):1–10CrossRef
23.
go back to reference Patzkowski JC, Owens JG, Blanck RV, Kirk KL, Hsu JR, Skeletal Trauma Research C (2012) Management of posttraumatic osteoarthritis with an integrated orthotic and rehabilitation initiative. J Am Acad Orthop Surg 20(Suppl 1):S48–S53CrossRefPubMed Patzkowski JC, Owens JG, Blanck RV, Kirk KL, Hsu JR, Skeletal Trauma Research C (2012) Management of posttraumatic osteoarthritis with an integrated orthotic and rehabilitation initiative. J Am Acad Orthop Surg 20(Suppl 1):S48–S53CrossRefPubMed
24.
go back to reference Posner KL, Sampson PD, Caplan RA, Ward RJ, Cheney FW (1990) Measuring interrater reliability among multiple raters: an example of methods for nominal data. Stat Med 9(9):1103–1115CrossRefPubMed Posner KL, Sampson PD, Caplan RA, Ward RJ, Cheney FW (1990) Measuring interrater reliability among multiple raters: an example of methods for nominal data. Stat Med 9(9):1103–1115CrossRefPubMed
25.
go back to reference Raikin SM (2009) Fresh osteochondral allografts for large-volume cystic osteochondral defects of the talus. J Bone Joint Surg Am 91(12):2818–2826CrossRefPubMed Raikin SM (2009) Fresh osteochondral allografts for large-volume cystic osteochondral defects of the talus. J Bone Joint Surg Am 91(12):2818–2826CrossRefPubMed
26.
go back to reference Saltzman CL, Mann RA, Ahrens JE, Amendola A, Anderson RB, Berlet GC, Brodsky JW, Chou LB, Clanton TO, Deland JT, Deorio JK, Horton GA, Lee TH, Mann JA, Nunley JA, Thordarson DB, Walling AK, Wapner KL, Coughlin MJ (2009) Prospective controlled trial of STAR total ankle replacement versus ankle fusion: initial results. J Foot Ankle Surg 30(7):579–596CrossRef Saltzman CL, Mann RA, Ahrens JE, Amendola A, Anderson RB, Berlet GC, Brodsky JW, Chou LB, Clanton TO, Deland JT, Deorio JK, Horton GA, Lee TH, Mann JA, Nunley JA, Thordarson DB, Walling AK, Wapner KL, Coughlin MJ (2009) Prospective controlled trial of STAR total ankle replacement versus ankle fusion: initial results. J Foot Ankle Surg 30(7):579–596CrossRef
27.
go back to reference Siegel S, Castellan NJ (eds) (1988) Nonparametric statistics for the behavioral sciences. McGraw-Hill Siegel S, Castellan NJ (eds) (1988) Nonparametric statistics for the behavioral sciences. McGraw-Hill
29.
go back to reference Stamatis ED, Cooper PS, Myerson MS (2003) Supramalleolar osteotomy for the treatment of distal tibial angular deformities and arthritis of the ankle joint. J Foot Ankle Surg 24(10):754–764 Stamatis ED, Cooper PS, Myerson MS (2003) Supramalleolar osteotomy for the treatment of distal tibial angular deformities and arthritis of the ankle joint. J Foot Ankle Surg 24(10):754–764
30.
go back to reference Stufkens SA, van den Bekerom MP, Kerkhoffs GM, Hintermann B, van Dijk CN (2011) Long-term outcome after 1822 operatively treated ankle fractures: a systematic review of the literature. Injury 42(2):119–127CrossRefPubMed Stufkens SA, van den Bekerom MP, Kerkhoffs GM, Hintermann B, van Dijk CN (2011) Long-term outcome after 1822 operatively treated ankle fractures: a systematic review of the literature. Injury 42(2):119–127CrossRefPubMed
31.
go back to reference Tanaka Y, Takakura Y, Hayashi K, Taniguchi A, Kumai T, Sugimoto K (2006) Low tibial osteotomy for varus-type osteoarthritis of the ankle. J Bone Joint Surg Br 88(7):909–913CrossRefPubMed Tanaka Y, Takakura Y, Hayashi K, Taniguchi A, Kumai T, Sugimoto K (2006) Low tibial osteotomy for varus-type osteoarthritis of the ankle. J Bone Joint Surg Br 88(7):909–913CrossRefPubMed
32.
go back to reference Tosti R, Ilyas AM, Mellema JJ, Guitton TG, Ring D, Science of Variation G (2014) Interobserver variability in the treatment of little finger metacarpal neck fractures. J Hand Surg Am 39(9):1722–1727CrossRefPubMed Tosti R, Ilyas AM, Mellema JJ, Guitton TG, Ring D, Science of Variation G (2014) Interobserver variability in the treatment of little finger metacarpal neck fractures. J Hand Surg Am 39(9):1722–1727CrossRefPubMed
33.
go back to reference van den Bekerom MP, Haverkamp D, Kloen P (2009) Biomechanical and clinical evaluation of posterior malleolar fractures. A systematic review of the literature. J Trauma 66(1):279–284CrossRefPubMed van den Bekerom MP, Haverkamp D, Kloen P (2009) Biomechanical and clinical evaluation of posterior malleolar fractures. A systematic review of the literature. J Trauma 66(1):279–284CrossRefPubMed
34.
go back to reference van Dijk CN, Verhagen RA, Tol JL (1997) Arthroscopy for problems after ankle fracture. J Bone Joint Surg Br 79(2):280–284CrossRefPubMed van Dijk CN, Verhagen RA, Tol JL (1997) Arthroscopy for problems after ankle fracture. J Bone Joint Surg Br 79(2):280–284CrossRefPubMed
35.
go back to reference Weatherall JM, Mroczek K, McLaurin T, Ding B, Tejwani N (2013) Post-traumatic ankle arthritis. Bull Hosp Jt Dis 71(1):104–112 Weatherall JM, Mroczek K, McLaurin T, Ding B, Tejwani N (2013) Post-traumatic ankle arthritis. Bull Hosp Jt Dis 71(1):104–112
36.
go back to reference Wijffels MM, Guitton TG, Ring D, Science of Variation G (2012) Inter-observer variation in the diagnosis of coronal articular fracture lines in the lunate facet of the distal radius. Hand 7(3):271–275CrossRefPubMedPubMedCentral Wijffels MM, Guitton TG, Ring D, Science of Variation G (2012) Inter-observer variation in the diagnosis of coronal articular fracture lines in the lunate facet of the distal radius. Hand 7(3):271–275CrossRefPubMedPubMedCentral
Metadata
Title
Reliability of classification for post-traumatic ankle osteoarthritis
Authors
Femke M. A. P. Claessen
Diederik T. Meijer
Michel P. J. van den Bekerom
Barend D. J. Gevers Deynoot
Wouter H. Mallee
Job N. Doornberg
C. Niek van Dijk
Publication date
01-04-2016
Publisher
Springer Berlin Heidelberg
Published in
Knee Surgery, Sports Traumatology, Arthroscopy / Issue 4/2016
Print ISSN: 0942-2056
Electronic ISSN: 1433-7347
DOI
https://doi.org/10.1007/s00167-015-3871-6

Other articles of this Issue 4/2016

Knee Surgery, Sports Traumatology, Arthroscopy 4/2016 Go to the issue