Skip to main content
Top
Published in: Knee Surgery, Sports Traumatology, Arthroscopy 4/2023

25-08-2022 | KNEE

Deep learning-based landmark recognition and angle measurement of full-leg plain radiographs can be adopted to assess lower extremity alignment

Authors: Changwung Jo, Doohyun Hwang, Sunho Ko, Myung Ho Yang, Myung Chul Lee, Hyuk-Soo Han, Du Hyun Ro

Published in: Knee Surgery, Sports Traumatology, Arthroscopy | Issue 4/2023

Login to get access

Abstract

Purpose

Evaluating lower extremity alignment using full-leg plain radiographs is an essential step in diagnosis and treatment of patients with knee osteoarthritis. The study objective was to present a deep learning-based anatomical landmark recognition and angle measurement model, using full-leg radiographs, and validate its performance.

Methods

A total of 11,212 full-leg plain radiographs were used to create the model. To train the data, 15 anatomical landmarks were marked by two orthopaedic surgeons. Mechanical lateral distal femoral angle (mLDFA), medial proximal tibial angle (MPTA), joint line convergence angle (JLCA), and hip-knee-ankle angle (HKAA) were then measured. For inter-observer reliability, the inter-observer intraclass correlation coefficient (ICC) was evaluated by comparing measurements from the model, surgeons, and students, to ground truth measurements annotated by an orthopaedic specialist with 14 years of experience. To evaluate test–retest reliability, all measurements were made twice by each measurer. Intra-observer ICCs were then derived. Performance evaluation metrics used in previous studies were also derived for direct comparison of the model’s performance.

Results

Inter-observer ICCs for all angles of the model were 0.98 or higher (p < 0.001). Intra-observer ICCs for all angles were 1.00, which was higher than that of the orthopaedic specialist (0.97–1.00). Measurements made by the model showed no significant systemic variation. Except for JLCA, angles were precisely measured with absolute error averages under 0.52 degrees and proportion of outliers under 4.26%.

Conclusions

The deep learning model is capable of evaluating lower extremity alignment with performance as accurate as an orthopaedic specialist with 14 years of experience.

Level of evidence

III, retrospective cohort study.
Appendix
Available only for authorised users
Literature
2.
go back to reference Ahmad SS, Kerber V, Konrads C, Ateschrang A, Hirschmann MT, Stockle U et al (2021) The ischiofemoral space of the hip is influenced by the frontal knee alignment. Knee Surg Sports Traumatol Arthrosc 29:2446–2452CrossRefPubMedPubMedCentral Ahmad SS, Kerber V, Konrads C, Ateschrang A, Hirschmann MT, Stockle U et al (2021) The ischiofemoral space of the hip is influenced by the frontal knee alignment. Knee Surg Sports Traumatol Arthrosc 29:2446–2452CrossRefPubMedPubMedCentral
4.
go back to reference Babazadeh S, Dowsey MM, Bingham RJ, Ek ET, Stoney JD, Choong PF (2013) The long leg radiograph is a reliable method of assessing alignment when compared to computer-assisted navigation and computer tomography. Knee 20:242–249CrossRefPubMed Babazadeh S, Dowsey MM, Bingham RJ, Ek ET, Stoney JD, Choong PF (2013) The long leg radiograph is a reliable method of assessing alignment when compared to computer-assisted navigation and computer tomography. Knee 20:242–249CrossRefPubMed
5.
go back to reference Bowman A, Shunmugam M, Watts AR, Bramwell DC, Wilson C, Krishnan J (2016) Inter-observer and intra-observer reliability of mechanical axis alignment before and after total knee arthroplasty using long leg radiographs. Knee 23:203–208CrossRefPubMed Bowman A, Shunmugam M, Watts AR, Bramwell DC, Wilson C, Krishnan J (2016) Inter-observer and intra-observer reliability of mechanical axis alignment before and after total knee arthroplasty using long leg radiographs. Knee 23:203–208CrossRefPubMed
6.
go back to reference Brouwer GM, van Tol AW, Bergink AP, Belo JN, Bernsen RM, Reijman M et al (2007) Association between valgus and varus alignment and the development and progression of radiographic osteoarthritis of the knee. Arthritis Rheum 56:1204–1211CrossRefPubMed Brouwer GM, van Tol AW, Bergink AP, Belo JN, Bernsen RM, Reijman M et al (2007) Association between valgus and varus alignment and the development and progression of radiographic osteoarthritis of the knee. Arthritis Rheum 56:1204–1211CrossRefPubMed
7.
go back to reference Cicuttini F, Wluka A, Hankin J, Wang Y (2004) Longitudinal study of the relationship between knee angle and tibiofemoral cartilage volume in subjects with knee osteoarthritis. Rheumatology 43:321–324CrossRefPubMed Cicuttini F, Wluka A, Hankin J, Wang Y (2004) Longitudinal study of the relationship between knee angle and tibiofemoral cartilage volume in subjects with knee osteoarthritis. Rheumatology 43:321–324CrossRefPubMed
8.
go back to reference Driban JB, Harkey MS, Barbe MF, Ward RJ, MacKay JW, Davis JE et al (2020) Risk factors and the natural history of accelerated knee osteoarthritis: a narrative review. BMC Musculoskelet Disord 21:332CrossRefPubMedPubMedCentral Driban JB, Harkey MS, Barbe MF, Ward RJ, MacKay JW, Davis JE et al (2020) Risk factors and the natural history of accelerated knee osteoarthritis: a narrative review. BMC Musculoskelet Disord 21:332CrossRefPubMedPubMedCentral
9.
go back to reference Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24:381–395CrossRef Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24:381–395CrossRef
10.
go back to reference Gaasbeek R, Welsing R, Barink M, Verdonschot N, van Kampen A (2007) The influence of open and closed high tibial osteotomy on dynamic patellar tracking: a biomechanical study. Knee Surg Sports Traumatol Arthrosc 15:978–984CrossRefPubMed Gaasbeek R, Welsing R, Barink M, Verdonschot N, van Kampen A (2007) The influence of open and closed high tibial osteotomy on dynamic patellar tracking: a biomechanical study. Knee Surg Sports Traumatol Arthrosc 15:978–984CrossRefPubMed
11.
go back to reference Gielis WP, Rayegan H, Arbabi V, Ahmadi Brooghani SY, Lindner C, Cootes TF et al (2020) Predicting the mechanical hip-knee-ankle angle accurately from standard knee radiographs: a cross-validation experiment in 100 patients. Acta Orthop 91:732–737CrossRefPubMedPubMedCentral Gielis WP, Rayegan H, Arbabi V, Ahmadi Brooghani SY, Lindner C, Cootes TF et al (2020) Predicting the mechanical hip-knee-ankle angle accurately from standard knee radiographs: a cross-validation experiment in 100 patients. Acta Orthop 91:732–737CrossRefPubMedPubMedCentral
12.
go back to reference Greene WB (1996) Genu varum and genu valgum in children: differential diagnosis and guidelines for evaluation. Compr Ther 22:22–29PubMed Greene WB (1996) Genu varum and genu valgum in children: differential diagnosis and guidelines for evaluation. Compr Ther 22:22–29PubMed
13.
go back to reference Hanson JA, Kapron AL, Swenson KM, Maak TG, Peters CL, Aoki SK (2015) Discrepancies in measuring acetabular coverage: revisiting the anterior and lateral center edge angles. Journal of Hip Preservation Surgery 2:280–286CrossRefPubMedPubMedCentral Hanson JA, Kapron AL, Swenson KM, Maak TG, Peters CL, Aoki SK (2015) Discrepancies in measuring acetabular coverage: revisiting the anterior and lateral center edge angles. Journal of Hip Preservation Surgery 2:280–286CrossRefPubMedPubMedCentral
16.
go back to reference Johannsen AM, Cook AM, Gardner MJ, Bishop JA (2018) Defining the width of the normal tibial plateau relative to the distal femur: critical normative data for identifying pathologic widening in tibial plateau fractures. Clin Anat 31:688–692CrossRefPubMed Johannsen AM, Cook AM, Gardner MJ, Bishop JA (2018) Defining the width of the normal tibial plateau relative to the distal femur: critical normative data for identifying pathologic widening in tibial plateau fractures. Clin Anat 31:688–692CrossRefPubMed
17.
18.
go back to reference Nguyen TP, Chae DS, Park SJ, Kang KY, Lee WS, Yoon J (2020) Intelligent analysis of coronal alignment in lower limbs based on radiographic image with convolutional neural network. Comput Biol Med 120:103732CrossRefPubMed Nguyen TP, Chae DS, Park SJ, Kang KY, Lee WS, Yoon J (2020) Intelligent analysis of coronal alignment in lower limbs based on radiographic image with convolutional neural network. Comput Biol Med 120:103732CrossRefPubMed
19.
go back to reference Paley D, Tetsworth K (1992) Mechanical axis deviation of the lower limbs. Preoperative planning of uniapical angular deformities of the tibia or femur. Clin Orthop Relat Res 1:48–64 Paley D, Tetsworth K (1992) Mechanical axis deviation of the lower limbs. Preoperative planning of uniapical angular deformities of the tibia or femur. Clin Orthop Relat Res 1:48–64
20.
go back to reference Pei Y, Yang W, Wei S, Cai R, Li J, Guo S et al (2021) Automated measurement of hip-knee-ankle angle on the unilateral lower limb X-rays using deep learning. Phys Eng Sci Med 44:53–62CrossRefPubMed Pei Y, Yang W, Wei S, Cai R, Li J, Guo S et al (2021) Automated measurement of hip-knee-ankle angle on the unilateral lower limb X-rays using deep learning. Phys Eng Sci Med 44:53–62CrossRefPubMed
21.
go back to reference Piovan G, Farinelli L, Screpis D, Iacono V, Povegliano L, Bonomo M et al (2022) Distal femoral osteotomy versus lateral unicompartmental arthroplasty for isolated lateral tibiofemoral osteoarthritis with intra-articular and extra-articular deformity: a propensity score-matched analysis. Knee Surg Relat Res 34:34CrossRefPubMedPubMedCentral Piovan G, Farinelli L, Screpis D, Iacono V, Povegliano L, Bonomo M et al (2022) Distal femoral osteotomy versus lateral unicompartmental arthroplasty for isolated lateral tibiofemoral osteoarthritis with intra-articular and extra-articular deformity: a propensity score-matched analysis. Knee Surg Relat Res 34:34CrossRefPubMedPubMedCentral
22.
go back to reference Runhaar J, van Middelkoop M, Reijman M, Vroegindeweij D, Oei EH, Bierma-Zeinstra SM (2014) Malalignment: a possible target for prevention of incident knee osteoarthritis in overweight and obese women. Rheumatology (Oxford) 53:1618–1624CrossRefPubMed Runhaar J, van Middelkoop M, Reijman M, Vroegindeweij D, Oei EH, Bierma-Zeinstra SM (2014) Malalignment: a possible target for prevention of incident knee osteoarthritis in overweight and obese women. Rheumatology (Oxford) 53:1618–1624CrossRefPubMed
23.
go back to reference Salaffi F, Carotti M, Stancati A, Grassi W (2005) Health-related quality of life in older adults with symptomatic hip and knee osteoarthritis: a comparison with matched healthy controls. Aging Clin Exp Res 17:255–263CrossRefPubMed Salaffi F, Carotti M, Stancati A, Grassi W (2005) Health-related quality of life in older adults with symptomatic hip and knee osteoarthritis: a comparison with matched healthy controls. Aging Clin Exp Res 17:255–263CrossRefPubMed
24.
go back to reference Schipplein OD, Andriacchi TP (1991) Interaction between active and passive knee stabilizers during level walking. J Orthop Res 9:113–119CrossRefPubMed Schipplein OD, Andriacchi TP (1991) Interaction between active and passive knee stabilizers during level walking. J Orthop Res 9:113–119CrossRefPubMed
25.
go back to reference Schröter S, Elson DW, Ateschrang A, Ihle C, Stöckle U, Dickschas J et al (2017) Lower limb deformity analysis and the planning of an osteotomy. J Knee Surg 30:393–408CrossRefPubMed Schröter S, Elson DW, Ateschrang A, Ihle C, Stöckle U, Dickschas J et al (2017) Lower limb deformity analysis and the planning of an osteotomy. J Knee Surg 30:393–408CrossRefPubMed
26.
go back to reference Sheehy L, Felson D, Zhang Y, Niu J, Lam YM, Segal N et al (2011) Does measurement of the anatomic axis consistently predict hip-knee-ankle angle (HKA) for knee alignment studies in osteoarthritis? Analysis of long limb radiographs from the multicenter osteoarthritis (MOST) study. Osteoarthritis Cartilage 19:58–64CrossRefPubMed Sheehy L, Felson D, Zhang Y, Niu J, Lam YM, Segal N et al (2011) Does measurement of the anatomic axis consistently predict hip-knee-ankle angle (HKA) for knee alignment studies in osteoarthritis? Analysis of long limb radiographs from the multicenter osteoarthritis (MOST) study. Osteoarthritis Cartilage 19:58–64CrossRefPubMed
27.
go back to reference Sled EA, Sheehy LM, Felson DT, Costigan PA, Lam M, Cooke TD (2011) Reliability of lower limb alignment measures using an established landmark-based method with a customized computer software program. Rheumatol Int 31:71–77CrossRefPubMed Sled EA, Sheehy LM, Felson DT, Costigan PA, Lam M, Cooke TD (2011) Reliability of lower limb alignment measures using an established landmark-based method with a customized computer software program. Rheumatol Int 31:71–77CrossRefPubMed
28.
go back to reference Tack A, Preim B, Zachow S (2021) Fully automated assessment of knee alignment from full-leg X-Rays employing a “YOLOv4 and resnet landmark regression algorithm” (YARLA): data from the osteoarthritis initiative. Comput Methods Programs Biomed 205:106080CrossRefPubMed Tack A, Preim B, Zachow S (2021) Fully automated assessment of knee alignment from full-leg X-Rays employing a “YOLOv4 and resnet landmark regression algorithm” (YARLA): data from the osteoarthritis initiative. Comput Methods Programs Biomed 205:106080CrossRefPubMed
Metadata
Title
Deep learning-based landmark recognition and angle measurement of full-leg plain radiographs can be adopted to assess lower extremity alignment
Authors
Changwung Jo
Doohyun Hwang
Sunho Ko
Myung Ho Yang
Myung Chul Lee
Hyuk-Soo Han
Du Hyun Ro
Publication date
25-08-2022
Publisher
Springer Berlin Heidelberg
Published in
Knee Surgery, Sports Traumatology, Arthroscopy / Issue 4/2023
Print ISSN: 0942-2056
Electronic ISSN: 1433-7347
DOI
https://doi.org/10.1007/s00167-022-07124-x

Other articles of this Issue 4/2023

Knee Surgery, Sports Traumatology, Arthroscopy 4/2023 Go to the issue