Skip to main content
Top
Published in: BMC Oral Health 1/2023

Open Access 01-12-2023 | Computed Tomography | Research

Automatic craniomaxillofacial landmarks detection in CT images of individuals with dentomaxillofacial deformities by a two-stage deep learning model

Authors: Leran Tao, Meng Li, Xu Zhang, Mengjia Cheng, Yang Yang, Yijiao Fu, Rongbin Zhang, Dahong Qian, Hongbo Yu

Published in: BMC Oral Health | Issue 1/2023

Login to get access

Abstract

Background

Accurate cephalometric analysis plays a vital role in the diagnosis and subsequent surgical planning in orthognathic and orthodontics treatment. However, manual digitization of anatomical landmarks in computed tomography (CT) is subject to limitations such as low accuracy, poor repeatability and excessive time consumption. Furthermore, the detection of landmarks has more difficulties on individuals with dentomaxillofacial deformities than normal individuals. Therefore, this study aims to develop a deep learning model to automatically detect landmarks in CT images of patients with dentomaxillofacial deformities.

Methods

Craniomaxillofacial (CMF) CT data of 80 patients with dentomaxillofacial deformities were collected for model development. 77 anatomical landmarks digitized by experienced CMF surgeons in each CT image were set as the ground truth. 3D UX-Net, the cutting-edge medical image segmentation network, was adopted as the backbone of model architecture. Moreover, a new region division pattern for CMF structures was designed as a training strategy to optimize the utilization of computational resources and image resolution. To evaluate the performance of this model, several experiments were conducted to make comparison between the model and manual digitization approach.

Results

The training set and the validation set included 58 and 22 samples respectively. The developed model can accurately detect 77 landmarks on bone, soft tissue and teeth with a mean error of 1.81 ± 0.89 mm. Removal of region division before training significantly increased the error of prediction (2.34 ± 1.01 mm). In terms of manual digitization, the inter-observer and intra-observer variations were 1.27 ± 0.70 mm and 1.01 ± 0.74 mm respectively. In all divided regions except Teeth Region (TR), our model demonstrated equivalent performance to experienced CMF surgeons in landmarks detection (p  >  0.05).

Conclusions

The developed model demonstrated excellent performance in detecting craniomaxillofacial landmarks when considering manual digitization work of expertise as benchmark. It is also verified that the region division pattern designed in this study remarkably improved the detection accuracy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cho SM, Kim HG, Yoon SH, Chang KH, Park MS, Park YH, Choi MS. Reappraisal of neonatal Greenstick Skull Fractures caused by birth injuries: comparison of 3-Dimensional reconstructed computed tomography and simple Skull radiographs. World Neurosurg. 2018;109:E305–E12.CrossRefPubMed Cho SM, Kim HG, Yoon SH, Chang KH, Park MS, Park YH, Choi MS. Reappraisal of neonatal Greenstick Skull Fractures caused by birth injuries: comparison of 3-Dimensional reconstructed computed tomography and simple Skull radiographs. World Neurosurg. 2018;109:E305–E12.CrossRefPubMed
2.
go back to reference Arik SO, Ibragimov B, Xing L. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham Wash). 2017;4(1):014501.CrossRef Arik SO, Ibragimov B, Xing L. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham Wash). 2017;4(1):014501.CrossRef
3.
go back to reference Kunz F, Stellzig-Eisenhauer A, Zeman F, Boldt J. Artificial intelligence in orthodontics evaluation of a fully automated cephalometric analysis using a customized convolutional neural network. J Orofac Orthopedics-Fortschritte Der Kieferorthop. 2020;81(1):52–68.CrossRef Kunz F, Stellzig-Eisenhauer A, Zeman F, Boldt J. Artificial intelligence in orthodontics evaluation of a fully automated cephalometric analysis using a customized convolutional neural network. J Orofac Orthopedics-Fortschritte Der Kieferorthop. 2020;81(1):52–68.CrossRef
4.
go back to reference Lee JH, Yu HJ, Kim MJ, Kim JW, Choi J. Automated cephalometric landmark detection with confidence regions using bayesian convolutional neural networks. BMC Oral Health. 2020;20(1). Lee JH, Yu HJ, Kim MJ, Kim JW, Choi J. Automated cephalometric landmark detection with confidence regions using bayesian convolutional neural networks. BMC Oral Health. 2020;20(1).
5.
go back to reference Qian J, Luo W, Cheng M, Tao Y, Lin J, Lin H. CephaNN: a multi-head attention network for Cephalometric Landmark Detection. Ieee Access. 2020;8:112633–41.CrossRef Qian J, Luo W, Cheng M, Tao Y, Lin J, Lin H. CephaNN: a multi-head attention network for Cephalometric Landmark Detection. Ieee Access. 2020;8:112633–41.CrossRef
6.
go back to reference Dot G, Schouman T, Chang S, Rafflenbeul F, Kerbrat A, Rouch P, Gajny L. Automatic 3-Dimensional Cephalometric Landmarking via Deep Learning. J Dent Res. 2022;101(11):1380–7.CrossRefPubMed Dot G, Schouman T, Chang S, Rafflenbeul F, Kerbrat A, Rouch P, Gajny L. Automatic 3-Dimensional Cephalometric Landmarking via Deep Learning. J Dent Res. 2022;101(11):1380–7.CrossRefPubMed
7.
go back to reference Lang YK, Lian CF, Xiao DQ, Deng HN, Thung KH, Yuan P, Gateno J, Kuang TS, Alfi M, Wang D, Shen L, Xia DG, Yap JJ. Localization of Craniomaxillofacial Landmarks on CBCT images using 3D mask R-CNN and local dependency learning. IEEE Trans Med Imaging. 2022;41(10):2856–66.CrossRefPubMedPubMedCentral Lang YK, Lian CF, Xiao DQ, Deng HN, Thung KH, Yuan P, Gateno J, Kuang TS, Alfi M, Wang D, Shen L, Xia DG, Yap JJ. Localization of Craniomaxillofacial Landmarks on CBCT images using 3D mask R-CNN and local dependency learning. IEEE Trans Med Imaging. 2022;41(10):2856–66.CrossRefPubMedPubMedCentral
8.
go back to reference Cicek O, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: learning dense volumetric segmentation from sparse annotation. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 19th International Conference Proceedings: LNCS 9901. 2016:424 – 32. Cicek O, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: learning dense volumetric segmentation from sparse annotation. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 19th International Conference Proceedings: LNCS 9901. 2016:424 – 32.
9.
go back to reference Milletari F, Navab N, Ahmadi SA. V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. 4th IEEE International Conference on 3D Vision (3DV); 2016 Oct 25–28; Stanford Univ, Stanford, CA2016. Milletari F, Navab N, Ahmadi SA. V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. 4th IEEE International Conference on 3D Vision (3DV); 2016 Oct 25–28; Stanford Univ, Stanford, CA2016.
10.
go back to reference Liu Q, Deng H, Lian CF, Chen XY, Xiao DQ, Ma L, Chen X, Kuang TS, Gateno J, Yap PT, Xia JJ. SkullEngine: a multi-stage CNN Framework for Collaborative CBCT Image Segmentation and Landmark Detection. Machine learning in medical imaging MLMI. (Workshop). 2021;12966:606–14. Liu Q, Deng H, Lian CF, Chen XY, Xiao DQ, Ma L, Chen X, Kuang TS, Gateno J, Yap PT, Xia JJ. SkullEngine: a multi-stage CNN Framework for Collaborative CBCT Image Segmentation and Landmark Detection. Machine learning in medical imaging MLMI. (Workshop). 2021;12966:606–14.
11.
go back to reference Lee HH, Bao SX, Huo YK, Landman A. B. 3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation. arXiv. 2022. Lee HH, Bao SX, Huo YK, Landman A. B. 3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation. arXiv. 2022.
12.
go back to reference Liang CK, Liu SH, Liu Q, Zhang B, Li ZJ. Norms of McNamara’s cephalometric analysis on lateral view of 3D CT imaging in adults from Northeast China. J Hard Tissue Biol. 2014;23(2):249–54.CrossRef Liang CK, Liu SH, Liu Q, Zhang B, Li ZJ. Norms of McNamara’s cephalometric analysis on lateral view of 3D CT imaging in adults from Northeast China. J Hard Tissue Biol. 2014;23(2):249–54.CrossRef
13.
go back to reference Cheung LK, Chan YM, Jayaratne YSN, Lo J. Three-dimensional cephalometric norms of chinese adults in Hong Kong with balanced facial profile. Oral Surg Oral Med Oral Pathol Oral Radiol Endodontology. 2011;112(2):E56–E73.CrossRef Cheung LK, Chan YM, Jayaratne YSN, Lo J. Three-dimensional cephalometric norms of chinese adults in Hong Kong with balanced facial profile. Oral Surg Oral Med Oral Pathol Oral Radiol Endodontology. 2011;112(2):E56–E73.CrossRef
14.
go back to reference Ho CT, Denadai R, Lai HC, Lo LJ, Lin HH. Computer-aided planning in orthognathic surgery: a comparative study with the establishment of Burstone Analysis-Derived 3D norms. J Clin Med. 2019;8(12). Ho CT, Denadai R, Lai HC, Lo LJ, Lin HH. Computer-aided planning in orthognathic surgery: a comparative study with the establishment of Burstone Analysis-Derived 3D norms. J Clin Med. 2019;8(12).
15.
go back to reference Tian KY, Li QQ, Wang XX, Liu XJ, Wang X, Li ZL. Reproducibility of natural head position in normal chinese people. Am J Orthod Dentofac Orthop. 2015;148(3):503–10.CrossRef Tian KY, Li QQ, Wang XX, Liu XJ, Wang X, Li ZL. Reproducibility of natural head position in normal chinese people. Am J Orthod Dentofac Orthop. 2015;148(3):503–10.CrossRef
16.
go back to reference Liu Z, Lin YT, Cao Y, Hu H, Wei YX, Zhang Z, Lin S, Guo B. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. 18th IEEE/CVF International Conference on Computer Vision (ICCV); 2021 Oct 11–17; Electr Network2021. Liu Z, Lin YT, Cao Y, Hu H, Wei YX, Zhang Z, Lin S, Guo B. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. 18th IEEE/CVF International Conference on Computer Vision (ICCV); 2021 Oct 11–17; Electr Network2021.
17.
go back to reference Damstra J, Fourie Z, Ren YJ. Simple technique to achieve a natural position of the head for cone beam computed tomography. Br J Oral Maxillofacial Surg. 2010;48(3):236–8.CrossRef Damstra J, Fourie Z, Ren YJ. Simple technique to achieve a natural position of the head for cone beam computed tomography. Br J Oral Maxillofacial Surg. 2010;48(3):236–8.CrossRef
18.
go back to reference Kim DS, Yang HJ, Huh KH, Lee SS, Heo MS, Choi SC, Hwang SJ, Yi WJ. Three-dimensional natural head position reproduction using a single facial photograph based on the POSIT method. J Cranio-Maxillofacial Surg. 2014;42(7):1315–21.CrossRef Kim DS, Yang HJ, Huh KH, Lee SS, Heo MS, Choi SC, Hwang SJ, Yi WJ. Three-dimensional natural head position reproduction using a single facial photograph based on the POSIT method. J Cranio-Maxillofacial Surg. 2014;42(7):1315–21.CrossRef
19.
go back to reference Schatz EC, Xia JJ, Gateno J, English JD, Teichgraeber JF, Garrett FA. Development of a technique for Recording and transferring natural head position in 3 dimensions. J Craniofac Surg. 2010;21(5):1452–5.CrossRefPubMed Schatz EC, Xia JJ, Gateno J, English JD, Teichgraeber JF, Garrett FA. Development of a technique for Recording and transferring natural head position in 3 dimensions. J Craniofac Surg. 2010;21(5):1452–5.CrossRefPubMed
20.
go back to reference Payer C, Stern D, Bischof H, Urschler M. Integrating spatial configuration into heatmap regression based CNNs for landmark localization. Med Image Anal. 2019;54:207–19.CrossRefPubMed Payer C, Stern D, Bischof H, Urschler M. Integrating spatial configuration into heatmap regression based CNNs for landmark localization. Med Image Anal. 2019;54:207–19.CrossRefPubMed
Metadata
Title
Automatic craniomaxillofacial landmarks detection in CT images of individuals with dentomaxillofacial deformities by a two-stage deep learning model
Authors
Leran Tao
Meng Li
Xu Zhang
Mengjia Cheng
Yang Yang
Yijiao Fu
Rongbin Zhang
Dahong Qian
Hongbo Yu
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Oral Health / Issue 1/2023
Electronic ISSN: 1472-6831
DOI
https://doi.org/10.1186/s12903-023-03446-5

Other articles of this Issue 1/2023

BMC Oral Health 1/2023 Go to the issue