Skip to main content
Top
Published in: Journal of Orthopaedic Surgery and Research 1/2024

Open Access 01-12-2024 | Artificial Intelligence | Research article

Evaluation of the consistency of the MRI- based AI segmentation cartilage model using the natural tibial plateau cartilage

Authors: Changjiao Sun, Hong Gao, Sha Wu, Qian Lu, Yakui Wang, Xu Cai

Published in: Journal of Orthopaedic Surgery and Research | Issue 1/2024

Login to get access

Abstract

Objective

The study aims to evaluate the accuracy of an MRI-based artificial intelligence (AI) segmentation cartilage model by comparing it to the natural tibial plateau cartilage.

Methods

This study included 33 patients (41 knees) with severe knee osteoarthritis scheduled to undergo total knee arthroplasty (TKA). All patients had a thin-section MRI before TKA. Our study is mainly divided into two parts: (i) In order to evaluate the MRI-based AI segmentation cartilage model’s 2D accuracy, the natural tibial plateau was used as gold standard. The MRI-based AI segmentation cartilage model and the natural tibial plateau were represented in binary visualization (black and white) simulated photographed images by the application of Simulation Photography Technology. Both simulated photographed images were compared to evaluate the 2D Dice similarity coefficients (DSC). (ii) In order to evaluate the MRI-based AI segmentation cartilage model’s 3D accuracy. Hand-crafted cartilage model based on knee CT was established. We used these hand-crafted CT-based knee cartilage model as gold standard to evaluate 2D and 3D consistency of between the MRI-based AI segmentation cartilage model and hand-crafted CT-based cartilage model. 3D registration technology was used for both models. Correlations between the MRI-based AI knee cartilage model and CT-based knee cartilage model were also assessed with the Pearson correlation coefficient.

Results

The AI segmentation cartilage model produced reasonably high two-dimensional DSC. The average 2D DSC between MRI-based AI cartilage model and the tibial plateau cartilage is 0.83. The average 2D DSC between the AI segmentation cartilage model and the CT-based cartilage model is 0.82. As for 3D consistency, the average 3D DSC between MRI-based AI cartilage model and CT-based cartilage model is 0.52. However, the quantification of cartilage segmentation with the AI and CT-based models showed excellent correlation (r = 0.725; P values < 0.05).

Conclusion

Our study demonstrated that our MRI-based AI cartilage model can reliably extract morphologic features such as cartilage shape and defect location of the tibial plateau cartilage. This approach could potentially benefit clinical practices such as diagnosing osteoarthritis. However, in terms of cartilage thickness and three-dimensional accuracy, MRI-based AI cartilage model underestimate the actual cartilage volume. The previous AI verification methods may not be completely accurate and should be verified with natural cartilage images. Combining multiple verification methods will improve the accuracy of the AI model.
Literature
1.
go back to reference Geng R, Li J, Yu C, Zhang C, Chen F, Chen J, et al. Knee osteoarthritis: current status and research progress in treatment (Review). Exp Ther Med. 2023;26:481.CrossRefPubMedPubMedCentral Geng R, Li J, Yu C, Zhang C, Chen F, Chen J, et al. Knee osteoarthritis: current status and research progress in treatment (Review). Exp Ther Med. 2023;26:481.CrossRefPubMedPubMedCentral
2.
go back to reference Zhang Q, Geng J, Zhang M, Kan T, Wang L, Ai S, et al. Cartilage morphometry and magnetic susceptibility measurement for knee osteoarthritis with automatic cartilage segmentation. Quant Imaging Med Surg. 2023;13:3508–21.CrossRefPubMedPubMedCentral Zhang Q, Geng J, Zhang M, Kan T, Wang L, Ai S, et al. Cartilage morphometry and magnetic susceptibility measurement for knee osteoarthritis with automatic cartilage segmentation. Quant Imaging Med Surg. 2023;13:3508–21.CrossRefPubMedPubMedCentral
3.
go back to reference Omoumi P, Mourad C, Ledoux J-B, Hilbert T. Morphological assessment of cartilage and osteoarthritis in clinical practice and research: intermediate-weighted fat-suppressed sequences and beyond. Skeletal Radiol. 2023;52:2185–98.CrossRefPubMedPubMedCentral Omoumi P, Mourad C, Ledoux J-B, Hilbert T. Morphological assessment of cartilage and osteoarthritis in clinical practice and research: intermediate-weighted fat-suppressed sequences and beyond. Skeletal Radiol. 2023;52:2185–98.CrossRefPubMedPubMedCentral
4.
go back to reference Sabah Afroze AA, Tamilselvi R, Parisa Beham MG. Machine learning based osteoarthritis detection methods in different imaging modalities: a review. Curr Med Imaging. 2023;19:1628–42.PubMed Sabah Afroze AA, Tamilselvi R, Parisa Beham MG. Machine learning based osteoarthritis detection methods in different imaging modalities: a review. Curr Med Imaging. 2023;19:1628–42.PubMed
5.
go back to reference Butler JJ, Wingo T, Kennedy JG. Presurgical and postsurgical MRI evaluation of osteochondral lesions of the foot and ankle: a primer. Foot Ankle Clin. 2023;28:603–17.CrossRefPubMed Butler JJ, Wingo T, Kennedy JG. Presurgical and postsurgical MRI evaluation of osteochondral lesions of the foot and ankle: a primer. Foot Ankle Clin. 2023;28:603–17.CrossRefPubMed
6.
go back to reference Fujiwara H, Yabuuchi H, Wada T, Kobayashi K, Hoshuyama T, Kamitani T, et al. High-resolution magnetic resonance imaging of the triangular fibrocartilage complex using compressed sensing sensitivity encoding (SENSE). Eur J Radiol. 2022;149:110191.CrossRefPubMed Fujiwara H, Yabuuchi H, Wada T, Kobayashi K, Hoshuyama T, Kamitani T, et al. High-resolution magnetic resonance imaging of the triangular fibrocartilage complex using compressed sensing sensitivity encoding (SENSE). Eur J Radiol. 2022;149:110191.CrossRefPubMed
7.
go back to reference Zibetti MVW, Menon RG, de Moura HL, Zhang X, Kijowski R, Regatte RR. Updates on compositional MRI mapping of the cartilage: emerging techniques and applications. J Magn Reson Imaging. 2023;58:44–60.CrossRefPubMedPubMedCentral Zibetti MVW, Menon RG, de Moura HL, Zhang X, Kijowski R, Regatte RR. Updates on compositional MRI mapping of the cartilage: emerging techniques and applications. J Magn Reson Imaging. 2023;58:44–60.CrossRefPubMedPubMedCentral
8.
go back to reference Kornaat PR, Ceulemans RYT, Kroon HM, Riyazi N, Kloppenburg M, Carter WO, et al. MRI assessment of knee osteoarthritis: knee osteoarthritis scoring system (KOSS)–inter-observer and intra-observer reproducibility of a compartment-based scoring system. Skeletal Radiol. 2005;34:95–102.CrossRefPubMed Kornaat PR, Ceulemans RYT, Kroon HM, Riyazi N, Kloppenburg M, Carter WO, et al. MRI assessment of knee osteoarthritis: knee osteoarthritis scoring system (KOSS)–inter-observer and intra-observer reproducibility of a compartment-based scoring system. Skeletal Radiol. 2005;34:95–102.CrossRefPubMed
9.
go back to reference Hunter DJ, Lo GH, Gale D, Grainger AJ, Guermazi A, Conaghan PG. The reliability of a new scoring system for knee osteoarthritis MRI and the validity of bone marrow lesion assessment: BLOKS (Boston Leeds Osteoarthritis Knee Score). Ann Rheum Dis. 2008;67:206–11.CrossRefPubMed Hunter DJ, Lo GH, Gale D, Grainger AJ, Guermazi A, Conaghan PG. The reliability of a new scoring system for knee osteoarthritis MRI and the validity of bone marrow lesion assessment: BLOKS (Boston Leeds Osteoarthritis Knee Score). Ann Rheum Dis. 2008;67:206–11.CrossRefPubMed
10.
go back to reference Hunter DJ, Guermazi A, Lo GH, Grainger AJ, Conaghan PG, Boudreau RM, et al. Evolution of semi-quantitative whole joint assessment of knee OA: MOAKS (MRI Osteoarthritis Knee Score). Osteoarthritis Cartilage. 2011;19:990–1002.CrossRefPubMedPubMedCentral Hunter DJ, Guermazi A, Lo GH, Grainger AJ, Conaghan PG, Boudreau RM, et al. Evolution of semi-quantitative whole joint assessment of knee OA: MOAKS (MRI Osteoarthritis Knee Score). Osteoarthritis Cartilage. 2011;19:990–1002.CrossRefPubMedPubMedCentral
12.
go back to reference Eck BL, Yang M, Elias JJ, Winalski CS, Altahawi F, Subhas N, et al. Quantitative MRI for evaluation of musculoskeletal disease: cartilage and muscle composition, joint inflammation, and biomechanics in osteoarthritis. Invest Radiol. 2023;58:60–75.CrossRefPubMed Eck BL, Yang M, Elias JJ, Winalski CS, Altahawi F, Subhas N, et al. Quantitative MRI for evaluation of musculoskeletal disease: cartilage and muscle composition, joint inflammation, and biomechanics in osteoarthritis. Invest Radiol. 2023;58:60–75.CrossRefPubMed
13.
go back to reference Bousson V, Benoist N, Guetat P, Attané G, Salvat C, Perronne L. Application of artificial intelligence to imaging interpretations in the musculoskeletal area: where are we? Where are we going? Joint Bone Spine. 2023;90:105493.CrossRefPubMed Bousson V, Benoist N, Guetat P, Attané G, Salvat C, Perronne L. Application of artificial intelligence to imaging interpretations in the musculoskeletal area: where are we? Where are we going? Joint Bone Spine. 2023;90:105493.CrossRefPubMed
14.
go back to reference Ehmig J, Engel G, Lotz J, Lehmann W, Taheri S, Schilling AF, et al. MR-imaging in osteoarthritis: current standard of practice and future outlook. Diagnostics (Basel). 2023;13:2586.CrossRefPubMed Ehmig J, Engel G, Lotz J, Lehmann W, Taheri S, Schilling AF, et al. MR-imaging in osteoarthritis: current standard of practice and future outlook. Diagnostics (Basel). 2023;13:2586.CrossRefPubMed
15.
go back to reference Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M. Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. Med Image Comput Comput Assist Interv. 2013;16:246–53.PubMed Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M. Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. Med Image Comput Comput Assist Interv. 2013;16:246–53.PubMed
16.
go back to reference Norman B, Pedoia V, Majumdar S. Use of 2D U-net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry. Radiology. 2018;288:177–85.CrossRefPubMed Norman B, Pedoia V, Majumdar S. Use of 2D U-net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry. Radiology. 2018;288:177–85.CrossRefPubMed
17.
go back to reference Liu F, Zhou Z, Jang H, Samsonov A, Zhao G, Kijowski R. Deep convolutional neural network and 3D deformable approach for tissue segmentation in musculoskeletal magnetic resonance imaging. Magn Reson Med. 2018;79:2379–91.CrossRefPubMed Liu F, Zhou Z, Jang H, Samsonov A, Zhao G, Kijowski R. Deep convolutional neural network and 3D deformable approach for tissue segmentation in musculoskeletal magnetic resonance imaging. Magn Reson Med. 2018;79:2379–91.CrossRefPubMed
19.
20.
go back to reference Ambellan F, Tack A, Ehlke M, Zachow S. Automated segmentation of knee bone and cartilage combining statistical shape knowledge and convolutional neural networks: Data from the Osteoarthritis Initiative. Med Image Anal. 2019;52:109–18.CrossRefPubMed Ambellan F, Tack A, Ehlke M, Zachow S. Automated segmentation of knee bone and cartilage combining statistical shape knowledge and convolutional neural networks: Data from the Osteoarthritis Initiative. Med Image Anal. 2019;52:109–18.CrossRefPubMed
21.
go back to reference Le Shen Lu, Qian TH, Sha Wu, Yi Yi, Yunda S, et al. A feasibility study of knee joint semantic segmentation on 3D MR images. Comput Tomogr Theory Appl. 2022;31:531–42. Le Shen Lu, Qian TH, Sha Wu, Yi Yi, Yunda S, et al. A feasibility study of knee joint semantic segmentation on 3D MR images. Comput Tomogr Theory Appl. 2022;31:531–42.
22.
go back to reference Campbell AB, Knopp MV, Kolovich GP, Wei W, Jia G, Siston RA, et al. Preoperative MRI underestimates articular cartilage defect size compared with findings at arthroscopic knee surgery. Am J Sports Med. 2013;41:590–5.CrossRefPubMed Campbell AB, Knopp MV, Kolovich GP, Wei W, Jia G, Siston RA, et al. Preoperative MRI underestimates articular cartilage defect size compared with findings at arthroscopic knee surgery. Am J Sports Med. 2013;41:590–5.CrossRefPubMed
23.
go back to reference Perry J, Kuiper JH, McCarthy HS, Jermin P, Gallacher PD, Tins B, et al. Comparison of knee articular cartilage defect size between measurements obtained on preoperative MRI versus during arthrotomy. Orthop J Sports Med. 2023;11:23259671231193380.CrossRefPubMedPubMedCentral Perry J, Kuiper JH, McCarthy HS, Jermin P, Gallacher PD, Tins B, et al. Comparison of knee articular cartilage defect size between measurements obtained on preoperative MRI versus during arthrotomy. Orthop J Sports Med. 2023;11:23259671231193380.CrossRefPubMedPubMedCentral
24.
go back to reference Chen Y, Li Y, Liu W, Wang Z, Li J, Chen C, et al. Comparison of surface microscopy coil and ankle joint special phased array coil magnetic resonance imaging in assessing preoperative osteochondral lesions of the talus. Quant Imaging Med Surg. 2023;13:4973–83.CrossRefPubMedPubMedCentral Chen Y, Li Y, Liu W, Wang Z, Li J, Chen C, et al. Comparison of surface microscopy coil and ankle joint special phased array coil magnetic resonance imaging in assessing preoperative osteochondral lesions of the talus. Quant Imaging Med Surg. 2023;13:4973–83.CrossRefPubMedPubMedCentral
25.
go back to reference Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35:1285–98.CrossRefPubMed Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35:1285–98.CrossRefPubMed
27.
go back to reference Schmidt AM, Desai AD, Watkins LE, Crowder HA, Black MS, Mazzoli V, et al. Generalizability of deep learning segmentation algorithms for automated assessment of cartilage morphology and MRI relaxometry. J Magn Reson Imaging. 2023;57:1029–39.CrossRefPubMed Schmidt AM, Desai AD, Watkins LE, Crowder HA, Black MS, Mazzoli V, et al. Generalizability of deep learning segmentation algorithms for automated assessment of cartilage morphology and MRI relaxometry. J Magn Reson Imaging. 2023;57:1029–39.CrossRefPubMed
28.
go back to reference Zhang R, Zhou X, Raithel E, Ren C, Zhang P, Li J, et al. A reproducibility study of knee cartilage volume and thickness values derived by fully automatic segmentation based on three-dimensional dual-echo in steady state data from 1.5 and 3 T magnetic resonance imaging. MAGMA. 2023. Zhang R, Zhou X, Raithel E, Ren C, Zhang P, Li J, et al. A reproducibility study of knee cartilage volume and thickness values derived by fully automatic segmentation based on three-dimensional dual-echo in steady state data from 1.5 and 3 T magnetic resonance imaging. MAGMA. 2023.
29.
go back to reference Kuiper RJA, Colaris JW, Stockmans F, van Es EM, Viergever MA, Seevinck PR, et al. Impact of bone and cartilage segmentation from CT and MRI on both bone forearm osteotomy planning. Int J Comput Assist Radiol Surg. 2023. Kuiper RJA, Colaris JW, Stockmans F, van Es EM, Viergever MA, Seevinck PR, et al. Impact of bone and cartilage segmentation from CT and MRI on both bone forearm osteotomy planning. Int J Comput Assist Radiol Surg. 2023.
30.
go back to reference Kim H, Shin K, Kim H, Lee E-S, Chung SW, Koh KH, et al. Can deep learning reduce the time and effort required for manual segmentation in 3D segmentation of MRI in rotator cuff tears? PLoS ONE. 2022;17:e0274075.CrossRefPubMedPubMedCentral Kim H, Shin K, Kim H, Lee E-S, Chung SW, Koh KH, et al. Can deep learning reduce the time and effort required for manual segmentation in 3D segmentation of MRI in rotator cuff tears? PLoS ONE. 2022;17:e0274075.CrossRefPubMedPubMedCentral
31.
go back to reference Kulseng CPS, Nainamalai V, Grøvik E, Geitung J-T, Årøen A, Gjesdal K-I. Automatic segmentation of human knee anatomy by a convolutional neural network applying a 3D MRI protocol. BMC Musculoskelet Disord. 2023;24:41.CrossRefPubMedPubMedCentral Kulseng CPS, Nainamalai V, Grøvik E, Geitung J-T, Årøen A, Gjesdal K-I. Automatic segmentation of human knee anatomy by a convolutional neural network applying a 3D MRI protocol. BMC Musculoskelet Disord. 2023;24:41.CrossRefPubMedPubMedCentral
32.
go back to reference Zou KH, Warfield SK, Bharatha A, Tempany CMC, Kaus MR, Haker SJ, et al. Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol. 2004;11:178–89.CrossRefPubMedPubMedCentral Zou KH, Warfield SK, Bharatha A, Tempany CMC, Kaus MR, Haker SJ, et al. Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol. 2004;11:178–89.CrossRefPubMedPubMedCentral
33.
go back to reference Hunter DJ, Altman RD, Cicuttini F, Crema MD, Duryea J, Eckstein F, et al. OARSI clinical trials recommendations: knee imaging in clinical trials in osteoarthritis. Osteoarthritis Cartilage. 2015;23:698–715.CrossRefPubMed Hunter DJ, Altman RD, Cicuttini F, Crema MD, Duryea J, Eckstein F, et al. OARSI clinical trials recommendations: knee imaging in clinical trials in osteoarthritis. Osteoarthritis Cartilage. 2015;23:698–715.CrossRefPubMed
34.
go back to reference Eckstein F, Charles HC, Buck RJ, Kraus VB, Remmers AE, Hudelmaier M, et al. Accuracy and precision of quantitative assessment of cartilage morphology by magnetic resonance imaging at 3.0T. Arthritis Rheum. 2005;52:3132–6. Eckstein F, Charles HC, Buck RJ, Kraus VB, Remmers AE, Hudelmaier M, et al. Accuracy and precision of quantitative assessment of cartilage morphology by magnetic resonance imaging at 3.0T. Arthritis Rheum. 2005;52:3132–6.
35.
go back to reference Latif MHA, Faye I. Automated tibiofemoral joint segmentation based on deeply supervised 2D–3D ensemble U-net: data from the osteoarthritis initiative. Artif Intell Med. 2021;122:102213.CrossRefPubMed Latif MHA, Faye I. Automated tibiofemoral joint segmentation based on deeply supervised 2D–3D ensemble U-net: data from the osteoarthritis initiative. Artif Intell Med. 2021;122:102213.CrossRefPubMed
36.
go back to reference Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15:1929–58. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15:1929–58.
Metadata
Title
Evaluation of the consistency of the MRI- based AI segmentation cartilage model using the natural tibial plateau cartilage
Authors
Changjiao Sun
Hong Gao
Sha Wu
Qian Lu
Yakui Wang
Xu Cai
Publication date
01-12-2024

Other articles of this Issue 1/2024

Journal of Orthopaedic Surgery and Research 1/2024 Go to the issue