Skip to main content
Top
Published in: BMC Oral Health 1/2023

Open Access 01-12-2023 | Artificial Intelligence | Research

Evaluating the accuracy of automated cephalometric analysis based on artificial intelligence

Authors: Han Bao, Kejia Zhang, Chenhao Yu, Hu Li, Dan Cao, Huazhong Shu, Luwei Liu, Bin Yan

Published in: BMC Oral Health | Issue 1/2023

Login to get access

Abstract

Background

The purpose of this study was to evaluate the accuracy of automatic cephalometric landmark localization and measurements using cephalometric analysis via artificial intelligence (AI) compared with computer-assisted manual analysis.

Methods

Reconstructed lateral cephalograms (RLCs) from cone-beam computed tomography (CBCT) in 85 patients were selected. Computer-assisted manual analysis (Dolphin Imaging 11.9) and AI automatic analysis (Planmeca Romexis 6.2) were used to locate 19 landmarks and obtain 23 measurements. Mean radial error (MRE) and successful detection rate (SDR) values were calculated to assess the accuracy of automatic landmark digitization. Paired t tests and Bland‒Altman plots were used to compare the differences and consistencies in cephalometric measurements between manual and automatic analysis programs.

Results

The MRE for 19 cephalometric landmarks was 2.07 ± 1.35 mm with the automatic program. The average SDR within 1 mm, 2 mm, 2.5 mm, 3 and 4 mm were 18.82%, 58.58%, 71.70%, 82.04% and 91.39%, respectively. Soft tissue landmarks (1.54 ± 0.85 mm) had the most consistency, while dental landmarks (2.37 ± 1.55 mm) had the most variation. In total, 15 out of 23 measurements were within the clinically acceptable level of accuracy, 2 mm or 2°. The rates of consistency within the 95% limits of agreement were all above 90% for all measurement parameters.

Conclusion

Automatic analysis software collects cephalometric measurements almost effectively enough to be acceptable in clinical work. Nevertheless, automatic cephalometry is not capable of completely replacing manual tracing. Additional manual supervision and adjustment for automatic programs can increase accuracy and efficiency.
Appendix
Available only for authorised users
Literature
1.
go back to reference Steiner CC. The use of cephalometrics as an aid to planning and assessing orthodontic treatment. Am J Orthod. 1960;46:721–35.CrossRef Steiner CC. The use of cephalometrics as an aid to planning and assessing orthodontic treatment. Am J Orthod. 1960;46:721–35.CrossRef
2.
go back to reference Moyers RE, Bookstein FL, Guire KE. The concept of pattern in craniofacial growth. Am J Orthod. 1979;76(2):136–48.CrossRefPubMed Moyers RE, Bookstein FL, Guire KE. The concept of pattern in craniofacial growth. Am J Orthod. 1979;76(2):136–48.CrossRefPubMed
3.
go back to reference Doberschütz PH, Schwahn C, Krey KF. Cephalometric analyses for cleft patients: a statistical approach to compare the variables of Delaire’s craniofacial analysis to Bergen analysis. Clin Oral Investig. 2022;26(1):353–64.CrossRefPubMed Doberschütz PH, Schwahn C, Krey KF. Cephalometric analyses for cleft patients: a statistical approach to compare the variables of Delaire’s craniofacial analysis to Bergen analysis. Clin Oral Investig. 2022;26(1):353–64.CrossRefPubMed
4.
go back to reference Li B, Zhang Z, Lin X, et al. Sagittal cephalometric evaluation without Point Nasion: Sagittal G-Triangle analysis. J Craniofac Surg. 2022;33(2):521–5.CrossRefPubMedPubMedCentral Li B, Zhang Z, Lin X, et al. Sagittal cephalometric evaluation without Point Nasion: Sagittal G-Triangle analysis. J Craniofac Surg. 2022;33(2):521–5.CrossRefPubMedPubMedCentral
5.
go back to reference Luca L, Francesca C, Daniela G, et al. Cephalometric analysis of dental and skeletal effects of Carriere Motion 3D appliance for class II malocclusion. Am J Orthod Dentofacial Orthop. 2022;161(5):659–65.CrossRefPubMed Luca L, Francesca C, Daniela G, et al. Cephalometric analysis of dental and skeletal effects of Carriere Motion 3D appliance for class II malocclusion. Am J Orthod Dentofacial Orthop. 2022;161(5):659–65.CrossRefPubMed
6.
go back to reference Houston WJ, Maher RE, McElroy D, Sherriff M. Sources of error in measurements from cephalometric radiographs. Eur J Orthod. 1986;8(3):149–51.CrossRefPubMed Houston WJ, Maher RE, McElroy D, Sherriff M. Sources of error in measurements from cephalometric radiographs. Eur J Orthod. 1986;8(3):149–51.CrossRefPubMed
7.
go back to reference Arık S, Ibragimov B, Xing L. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham). 2017;4(1):014501.CrossRefPubMed Arık S, Ibragimov B, Xing L. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham). 2017;4(1):014501.CrossRefPubMed
8.
go back to reference Lu G, Zhang Y, Kong Y, Zhang C, Coatrieux JL, Shu H. Landmark localization for cephalometric analysis using Multiscale Image Patch-Based graph Convolutional Networks. IEEE J Biomed Health Inform. 2022;26(7):3015–24.CrossRefPubMed Lu G, Zhang Y, Kong Y, Zhang C, Coatrieux JL, Shu H. Landmark localization for cephalometric analysis using Multiscale Image Patch-Based graph Convolutional Networks. IEEE J Biomed Health Inform. 2022;26(7):3015–24.CrossRefPubMed
9.
go back to reference Le VNT, Kang J, Oh IS, Kim JG, Yang YM, Lee DW. Effectiveness of Human-Artificial intelligence collaboration in Cephalometric Landmark Detection. J Pers Med. 2022;12(3):387. Published 2022 Mar 3.CrossRefPubMedPubMedCentral Le VNT, Kang J, Oh IS, Kim JG, Yang YM, Lee DW. Effectiveness of Human-Artificial intelligence collaboration in Cephalometric Landmark Detection. J Pers Med. 2022;12(3):387. Published 2022 Mar 3.CrossRefPubMedPubMedCentral
10.
go back to reference Yao J, Zeng W, He T, et al. Automatic localization of cephalometric landmarks based on convolutional neural network. Am J Orthod Dentofacial Orthop. 2022;161(3):e250–9.CrossRefPubMed Yao J, Zeng W, He T, et al. Automatic localization of cephalometric landmarks based on convolutional neural network. Am J Orthod Dentofacial Orthop. 2022;161(3):e250–9.CrossRefPubMed
11.
go back to reference Park JH, Hwang HW, Moon JH, et al. Automated identification of cephalometric landmarks: part 1-Comparisons between the latest deep-learning methods YOLOV3 and SSD. Angle Orthod. 2019;89(6):903–9.CrossRefPubMedPubMedCentral Park JH, Hwang HW, Moon JH, et al. Automated identification of cephalometric landmarks: part 1-Comparisons between the latest deep-learning methods YOLOV3 and SSD. Angle Orthod. 2019;89(6):903–9.CrossRefPubMedPubMedCentral
12.
go back to reference Kunz F, Stellzig-Eisenhauer A, Zeman F, Boldt J. Artificial intelligence in orthodontics: evaluation of a fully automated cephalometric analysis using a customized convolutional neural network. J Orofac Orthop. 2020;81(1):52–68.CrossRefPubMed Kunz F, Stellzig-Eisenhauer A, Zeman F, Boldt J. Artificial intelligence in orthodontics: evaluation of a fully automated cephalometric analysis using a customized convolutional neural network. J Orofac Orthop. 2020;81(1):52–68.CrossRefPubMed
13.
go back to reference Hwang HW, Moon JH, Kim MG, Donatelli RE, Lee SJ. Evaluation of automated cephalometric analysis based on the latest deep learning method. Angle Orthod. 2021;91(3):329–35.CrossRefPubMedPubMedCentral Hwang HW, Moon JH, Kim MG, Donatelli RE, Lee SJ. Evaluation of automated cephalometric analysis based on the latest deep learning method. Angle Orthod. 2021;91(3):329–35.CrossRefPubMedPubMedCentral
14.
go back to reference Nishimoto S, Sotsuka Y, Kawai K, Ishise H, Kakibuchi M. Personal Computer-Based Cephalometric Landmark Detection with Deep Learning, using Cephalograms on the internet. J Craniofac Surg. 2019;30(1):91–5.CrossRefPubMed Nishimoto S, Sotsuka Y, Kawai K, Ishise H, Kakibuchi M. Personal Computer-Based Cephalometric Landmark Detection with Deep Learning, using Cephalograms on the internet. J Craniofac Surg. 2019;30(1):91–5.CrossRefPubMed
15.
go back to reference Hwang HW, Park JH, Moon JH, et al. Automated identification of cephalometric landmarks: part 2-Might it be better than human? Angle Orthod. 2020;90(1):69–76.CrossRefPubMed Hwang HW, Park JH, Moon JH, et al. Automated identification of cephalometric landmarks: part 2-Might it be better than human? Angle Orthod. 2020;90(1):69–76.CrossRefPubMed
16.
go back to reference Mahto RK, Kafle D, Giri A, et al. Evaluation of fully automated cephalometric measurements obtained from web-based artificial intelligence driven platform. BMC Oral Health. 2022;22(1):132.CrossRefPubMedPubMedCentral Mahto RK, Kafle D, Giri A, et al. Evaluation of fully automated cephalometric measurements obtained from web-based artificial intelligence driven platform. BMC Oral Health. 2022;22(1):132.CrossRefPubMedPubMedCentral
17.
go back to reference Jeon S, Lee KC. Comparison of cephalometric measurements between conventional and automatic cephalometric analysis using convolutional neural network. Prog Orthod. 2021;22(1):14.CrossRefPubMedPubMedCentral Jeon S, Lee KC. Comparison of cephalometric measurements between conventional and automatic cephalometric analysis using convolutional neural network. Prog Orthod. 2021;22(1):14.CrossRefPubMedPubMedCentral
18.
go back to reference Meriç P, Naoumova J. Web-based fully automated cephalometric analysis: comparisons between App-aided, computerized, and manual tracings. Turk J Orthod. 2020;33(3):142–9.CrossRefPubMedPubMedCentral Meriç P, Naoumova J. Web-based fully automated cephalometric analysis: comparisons between App-aided, computerized, and manual tracings. Turk J Orthod. 2020;33(3):142–9.CrossRefPubMedPubMedCentral
19.
go back to reference Alqahtani H. Evaluation of an online website-based platform for cephalometric analysis. J Stomatol Oral Maxillofac Surg. 2020;121(1):53–7.CrossRefPubMed Alqahtani H. Evaluation of an online website-based platform for cephalometric analysis. J Stomatol Oral Maxillofac Surg. 2020;121(1):53–7.CrossRefPubMed
20.
go back to reference Yassir YA, Salman AR, Nabbat SA. The accuracy and reliability of WebCeph for cephalometric analysis. J Taibah Univ Med Sci. 2021;17(1):57–66.PubMedPubMedCentral Yassir YA, Salman AR, Nabbat SA. The accuracy and reliability of WebCeph for cephalometric analysis. J Taibah Univ Med Sci. 2021;17(1):57–66.PubMedPubMedCentral
21.
go back to reference Cicchetti DV. Guidelines, Criteria, and rules of Thumb for evaluating normed and standardized Assessment Instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef Cicchetti DV. Guidelines, Criteria, and rules of Thumb for evaluating normed and standardized Assessment Instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
22.
go back to reference Chen YJ, Chen SK, Yao JC, Chang HF. The effects of differences in landmark identification on the cephalometric measurements in traditional versus digitized cephalometry. Angle Orthod. 2004;74(2):155–61.PubMed Chen YJ, Chen SK, Yao JC, Chang HF. The effects of differences in landmark identification on the cephalometric measurements in traditional versus digitized cephalometry. Angle Orthod. 2004;74(2):155–61.PubMed
23.
go back to reference Ghowsi A, Hatcher D, Suh H, et al. Automated landmark identification on cone-beam computed tomography: accuracy and reliability. Angle Orthod. 2022;92(5):642–54.CrossRefPubMedPubMedCentral Ghowsi A, Hatcher D, Suh H, et al. Automated landmark identification on cone-beam computed tomography: accuracy and reliability. Angle Orthod. 2022;92(5):642–54.CrossRefPubMedPubMedCentral
24.
go back to reference Yue W, Yin D, Li C, Wang G, Xu T. Automated 2-D cephalometric analysis on X-ray images by a model-based approach. IEEE Trans Biomed Eng. 2006;53(8):1615–23.CrossRefPubMed Yue W, Yin D, Li C, Wang G, Xu T. Automated 2-D cephalometric analysis on X-ray images by a model-based approach. IEEE Trans Biomed Eng. 2006;53(8):1615–23.CrossRefPubMed
Metadata
Title
Evaluating the accuracy of automated cephalometric analysis based on artificial intelligence
Authors
Han Bao
Kejia Zhang
Chenhao Yu
Hu Li
Dan Cao
Huazhong Shu
Luwei Liu
Bin Yan
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Oral Health / Issue 1/2023
Electronic ISSN: 1472-6831
DOI
https://doi.org/10.1186/s12903-023-02881-8

Other articles of this Issue 1/2023

BMC Oral Health 1/2023 Go to the issue