Skip to main content
Top
Published in: Journal of Orthopaedic Surgery and Research 1/2024

Open Access 01-12-2024 | Research article

Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment

Authors: AliAsghar MohammadiNasrabadi, Gemah Moammer, Ahmed Quateen, Kunal Bhanot, John McPhee

Published in: Journal of Orthopaedic Surgery and Research | Issue 1/2024

Login to get access

Abstract

Purpose:

An efficient physics-informed deep learning approach for extracting spinopelvic measures from X-ray images is introduced and its performance is evaluated against manual annotations.

Methods:

Two datasets, comprising a total of 1470 images, were collected to evaluate the model’s performance. We propose a novel method of detecting landmarks as objects, incorporating their relationships as constraints (LanDet). Using this approach, we trained our deep learning model to extract five spine and pelvis measures: Sacrum Slope (SS), Pelvic Tilt (PT), Pelvic Incidence (PI), Lumbar Lordosis (LL), and Sagittal Vertical Axis (SVA). The results were compared to manually labelled test dataset (GT) as well as measures annotated separately by three surgeons.

Results:

The LanDet model was evaluated on the two datasets separately and on an extended dataset combining both. The final accuracy for each measure is reported in terms of Mean Absolute Error (MAE), Standard Deviation (SD), and R Pearson correlation coefficient as follows: \([SS^\circ : 3.7 (2.7), R = 0.89]\), \([PT^\circ : 1.3 (1.1), R = 0.98], [PI^\circ : 4.2 (3.1), R = 0.93], [LL^\circ : 5.1 (6.4), R=0.83], [SVA(mm): 2.1 (1.9), R = 0.96]\). To assess model reliability and compare it against surgeons, the intraclass correlation coefficient (ICC) metric is used. The model demonstrated better consistency with surgeons with all values over 0.88 compared to what was previously reported in the literature.

Conclusion:

The LanDet model exhibits competitive performance compared to existing literature. The effectiveness of the physics-informed constraint method, utilized in our landmark detection as object algorithm, is highlighted. Furthermore, we addressed the limitations of heatmap-based methods for anatomical landmark detection and tackled issues related to mis-identifying of similar or adjacent landmarks instead of intended landmark using this novel approach.
Literature
1.
go back to reference Vrtovec T, Ibragimov B. Spinopelvic measurements of sagittal balance with deep learning: systematic review and critical evaluation. Eur Spine J. 2022;31:2031–45.CrossRefPubMed Vrtovec T, Ibragimov B. Spinopelvic measurements of sagittal balance with deep learning: systematic review and critical evaluation. Eur Spine J. 2022;31:2031–45.CrossRefPubMed
2.
go back to reference Vrtovec T, Pernuš F, Likar B. A review of methods for quantitative evaluation of spinal curvature. Eur Spine J. 2009;18:593–607.CrossRefPubMed Vrtovec T, Pernuš F, Likar B. A review of methods for quantitative evaluation of spinal curvature. Eur Spine J. 2009;18:593–607.CrossRefPubMed
3.
go back to reference Amirkhani G, Farahmand F, Yazdian SM, Mirbagheri A. An extended algorithm for autonomous grasping of soft tissues during robotic surgery. Int J Med Robot Comput Assist Surg. 2020;16:1–15.CrossRef Amirkhani G, Farahmand F, Yazdian SM, Mirbagheri A. An extended algorithm for autonomous grasping of soft tissues during robotic surgery. Int J Med Robot Comput Assist Surg. 2020;16:1–15.CrossRef
4.
go back to reference Schlösser TP, et al. The odyssey of sagittal pelvic morphology during human evolution: a perspective on different hominoidae. Spine J. 2017;17:1202–6.CrossRefPubMed Schlösser TP, et al. The odyssey of sagittal pelvic morphology during human evolution: a perspective on different hominoidae. Spine J. 2017;17:1202–6.CrossRefPubMed
5.
go back to reference Korez R, Putzier M, Vrtovec T. A deep learning tool for fully automated measurements of sagittal spinopelvic balance from x-ray images: performance evaluation. Eur Spine J. 2020;29:2295–305.CrossRefPubMed Korez R, Putzier M, Vrtovec T. A deep learning tool for fully automated measurements of sagittal spinopelvic balance from x-ray images: performance evaluation. Eur Spine J. 2020;29:2295–305.CrossRefPubMed
6.
go back to reference Yamada K, et al. Accuracies in measuring spinopelvic parameters in full-spine lateral standing radiograph. Spine. 2015;40:E640–6.CrossRefPubMed Yamada K, et al. Accuracies in measuring spinopelvic parameters in full-spine lateral standing radiograph. Spine. 2015;40:E640–6.CrossRefPubMed
8.
go back to reference Mohammadi Nasrabadi A, McNally W, Moammer G, McPhee J. Automatic extraction of spinopelvic parameters using deep learning to detect landmarks as objects. Med Imaging Deep Learn. 2022. Mohammadi Nasrabadi A, McNally W, Moammer G, McPhee J. Automatic extraction of spinopelvic parameters using deep learning to detect landmarks as objects. Med Imaging Deep Learn. 2022.
9.
go back to reference Wu H, Bailey C, Rasoulinejad P, Li S. Automated comprehensive adolescent idiopathic scoliosis assessment using mvc-net. Med Image Anal. 2018;48:1–11.CrossRefPubMed Wu H, Bailey C, Rasoulinejad P, Li S. Automated comprehensive adolescent idiopathic scoliosis assessment using mvc-net. Med Image Anal. 2018;48:1–11.CrossRefPubMed
10.
go back to reference Galbusera F, et al. Fully automated radiological analysis of spinal disorders and deformities: a deep learning approach. Eur Spine J. 2019;28:951–60.CrossRefPubMed Galbusera F, et al. Fully automated radiological analysis of spinal disorders and deformities: a deep learning approach. Eur Spine J. 2019;28:951–60.CrossRefPubMed
11.
go back to reference Zhang T, et al. A novel tool to provide predictable alignment data irrespective of source and image quality acquired on mobile phones: what engineers can offer clinicians. Eur Spine J. 2020;29:387–95.CrossRefPubMed Zhang T, et al. A novel tool to provide predictable alignment data irrespective of source and image quality acquired on mobile phones: what engineers can offer clinicians. Eur Spine J. 2020;29:387–95.CrossRefPubMed
12.
go back to reference Iriondo C, et al. Institution-wide shape analysis of 3d spinal curvature and global alignment parameters. J Orthop Res. 2022;40:1896–908.CrossRefPubMed Iriondo C, et al. Institution-wide shape analysis of 3d spinal curvature and global alignment parameters. J Orthop Res. 2022;40:1896–908.CrossRefPubMed
13.
go back to reference Yeh Y-C, et al. Deep learning approach for automatic landmark detection and alignment analysis in whole-spine lateral radiographs. Sci Rep. 2021;11:1–15.CrossRef Yeh Y-C, et al. Deep learning approach for automatic landmark detection and alignment analysis in whole-spine lateral radiographs. Sci Rep. 2021;11:1–15.CrossRef
14.
15.
go back to reference Zhou S, et al. Artificial intelligence x-ray measurement technology of anatomical parameters related to lumbosacral stability. Eur J Radiol. 2022;146:110071.CrossRefPubMed Zhou S, et al. Artificial intelligence x-ray measurement technology of anatomical parameters related to lumbosacral stability. Eur J Radiol. 2022;146:110071.CrossRefPubMed
16.
go back to reference Duval-Beaupere G, Schmidt C, Cosson P. A barycentremetric study of the sagittal shape of spine and pelvis: the conditions required for an economic standing position. Ann Biomed Eng. 1992;20:451–62.CrossRefPubMed Duval-Beaupere G, Schmidt C, Cosson P. A barycentremetric study of the sagittal shape of spine and pelvis: the conditions required for an economic standing position. Ann Biomed Eng. 1992;20:451–62.CrossRefPubMed
17.
go back to reference Garbossa D, et al. Pelvic parameters and global spine balance for spine degenerative disease: the importance of containing for the well being of content. Eur Spine J. 2014;23:616–27.CrossRefPubMed Garbossa D, et al. Pelvic parameters and global spine balance for spine degenerative disease: the importance of containing for the well being of content. Eur Spine J. 2014;23:616–27.CrossRefPubMed
19.
20.
go back to reference Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016. p. 779–788. Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016. p. 779–788.
21.
go back to reference Wang C-Y. et al. Cspnet: A new backbone that can enhance learning capability of cnn. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops; 2020. p. 390–391. Wang C-Y. et al. Cspnet: A new backbone that can enhance learning capability of cnn. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops; 2020. p. 390–391.
22.
go back to reference Jocher G. et al. ultralytics/yolov5: v5. 0-yolov5-p6 1280 models, aws, supervise. ly and youtube integrations. Zenodo (2021). Jocher G. et al. ultralytics/yolov5: v5. 0-yolov5-p6 1280 models, aws, supervise. ly and youtube integrations. Zenodo (2021).
23.
go back to reference Wang C-Y, Bochkovskiy A, Liao H-Y M. Scaled-yolov4: Scaling cross stage partial network. In: Proceedings of the IEEE/cvf Conference on Computer Vision and Pattern Recognition; 2021. p. 13029–13038. Wang C-Y, Bochkovskiy A, Liao H-Y M. Scaled-yolov4: Scaling cross stage partial network. In: Proceedings of the IEEE/cvf Conference on Computer Vision and Pattern Recognition; 2021. p. 13029–13038.
24.
go back to reference Zheng Z, et al. Distance-iou loss: faster and better learning for bounding box regression. Proc AAAI Conf Artif Intell. 2020;34:12993–3000. Zheng Z, et al. Distance-iou loss: faster and better learning for bounding box regression. Proc AAAI Conf Artif Intell. 2020;34:12993–3000.
25.
26.
go back to reference Nguyen TP, Jung JW, Yoo YJ, Choi SH, Yoon J. Intelligent evaluation of global spinal alignment by a decentralized convolutional neural network. J Digit Imaging. 2022;35:213–25.CrossRefPubMedPubMedCentral Nguyen TP, Jung JW, Yoo YJ, Choi SH, Yoon J. Intelligent evaluation of global spinal alignment by a decentralized convolutional neural network. J Digit Imaging. 2022;35:213–25.CrossRefPubMedPubMedCentral
27.
go back to reference Vila-Casademunt A, et al. The reliability of sagittal pelvic parameters: the effect of lumbosacral instrumentation and measurement experience. Spine. 2015;40:E253–8.CrossRefPubMed Vila-Casademunt A, et al. The reliability of sagittal pelvic parameters: the effect of lumbosacral instrumentation and measurement experience. Spine. 2015;40:E253–8.CrossRefPubMed
Metadata
Title
Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment
Authors
AliAsghar MohammadiNasrabadi
Gemah Moammer
Ahmed Quateen
Kunal Bhanot
John McPhee
Publication date
01-12-2024
Publisher
BioMed Central
Published in
Journal of Orthopaedic Surgery and Research / Issue 1/2024
Electronic ISSN: 1749-799X
DOI
https://doi.org/10.1186/s13018-024-04654-7

Other articles of this Issue 1/2024

Journal of Orthopaedic Surgery and Research 1/2024 Go to the issue