Skip to main content
Top
Published in: Oral Radiology 4/2023

Open Access 25-04-2023 | Original Article

Experimental validation of computer-vision methods for the successful detection of endodontic treatment obturation and progression from noisy radiographs

Authors: Habib Al Hasan, Farhan Hasin Saad, Saif Ahmed, Nabeel Mohammed, Taseef Hasan Farook, James Dudley

Published in: Oral Radiology | Issue 4/2023

Login to get access

Abstract

Purpose

(1) To evaluate the effects of denoising and data balancing on deep learning to detect endodontic treatment outcomes from radiographs. (2) To develop and train a deep-learning model and classifier to predict obturation quality from radiomics.

Methods

The study conformed to the STARD 2015 and MI-CLAIMS 2021 guidelines. 250 deidentified dental radiographs were collected and augmented to produce 2226 images. The dataset was classified according to endodontic treatment outcomes following a set of customized criteria. The dataset was denoised and balanced, and processed with YOLOv5s, YOLOv5x, and YOLOv7 models of real-time deep-learning computer vision. Diagnostic test parameters such as sensitivity (Sn), specificity (Sp), accuracy (Ac), precision, recall, mean average precision (mAP), and confidence were evaluated.

Results

Overall accuracy for all the deep-learning models was above 85%. Imbalanced datasets with noise removal led to YOLOv5x’s prediction accuracy to drop to 72%, while balancing and noise removal led to all three models performing at over 95% accuracy. mAP saw an improvement from 52 to 92% following balancing and denoising.

Conclusion

The current study of computer vision applied to radiomic datasets successfully classified endodontic treatment obturation and mishaps according to a custom progressive classification system and serves as a foundation to larger research on the subject matter.
Footnotes
1
Class 3 was termed ‘total endodontic failure’ which was revised prior to the submission of the manuscript.
 
Literature
1.
go back to reference Ng Y-L, Mann V, Rahbaran S, Lewsey J, Gulabivala K. Outcome of primary root canal treatment: systematic review of the literature–Part 2. influence of clinical factors. Int Endod J. 2008;41(1):6–31.PubMed Ng Y-L, Mann V, Rahbaran S, Lewsey J, Gulabivala K. Outcome of primary root canal treatment: systematic review of the literature–Part 2. influence of clinical factors. Int Endod J. 2008;41(1):6–31.PubMed
2.
go back to reference Mazzaferro Robert J, Stephen B, Janower ML. The incidence and causes of repeated radiographic examinations in a community hospital. Radiology. 1974;112(1):71–2.CrossRef Mazzaferro Robert J, Stephen B, Janower ML. The incidence and causes of repeated radiographic examinations in a community hospital. Radiology. 1974;112(1):71–2.CrossRef
3.
go back to reference Iftikhar A. Radiographic study of the problems and failures of endodontic treatment. Int J Health Sci (Qassim). 2015;9(2):111. Iftikhar A. Radiographic study of the problems and failures of endodontic treatment. Int J Health Sci (Qassim). 2015;9(2):111.
5.
go back to reference Aleš Z. Criminal justice, artificial intelligence systems, and human rights. ERA Forum, vol. 20. Berlin: Springer; 2020. p. 567–83. Aleš Z. Criminal justice, artificial intelligence systems, and human rights. ERA Forum, vol. 20. Berlin: Springer; 2020. p. 567–83.
6.
go back to reference Rabbani Golam Shams, Sultana Sharmin, Hasan Md Nazmul, Fahad Salem Quddus, Uddin Jia. Person identification using SURF features of dental radiograph. Proceedings of the 3rd International Conference on Cryptography, Security and Privacy. 2019. 196–200. Rabbani Golam Shams, Sultana Sharmin, Hasan Md Nazmul, Fahad Salem Quddus, Uddin Jia. Person identification using SURF features of dental radiograph. Proceedings of the 3rd International Conference on Cryptography, Security and Privacy. 2019. 196–200.
7.
go back to reference Enzo G, Massimo B. Introduction to artificial neural networks. Eur J Gastroenterol Hepatol. 2007;19(12):1046–54.CrossRef Enzo G, Massimo B. Introduction to artificial neural networks. Eur J Gastroenterol Hepatol. 2007;19(12):1046–54.CrossRef
8.
go back to reference Anita A, Jim K, Venkateshbabu N. Artificial intelligence in endodontics: current applications and future directions. J Endod. 2021;47(9):1352–7.CrossRef Anita A, Jim K, Venkateshbabu N. Artificial intelligence in endodontics: current applications and future directions. J Endod. 2021;47(9):1352–7.CrossRef
9.
go back to reference Cohen Jérémie F, KorevaarDaniël A, Altman Douglas G, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.CrossRefPubMedPubMedCentral Cohen Jérémie F, KorevaarDaniël A, Altman Douglas G, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.CrossRefPubMedPubMedCentral
10.
go back to reference Beau N, Giorgio Q, Beaulieu-Jones Brett K, et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat Med. 2020;26(9):1320–4.CrossRef Beau N, Giorgio Q, Beaulieu-Jones Brett K, et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat Med. 2020;26(9):1320–4.CrossRef
11.
go back to reference Anuj J. Dental quackery in India: an insight on malpractices and measures to tackle them. Br Dent J. 2019;226(4):257–9.CrossRef Anuj J. Dental quackery in India: an insight on malpractices and measures to tackle them. Br Dent J. 2019;226(4):257–9.CrossRef
12.
go back to reference Bui Hieu Minh, Lech Margaret, Cheng Eva, Neville Katrina, Burnett Ian S. Using grayscale images for object recognition with convolutional-recursive neural network. 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE). IEEE; 2016. p. 321–5. Bui Hieu Minh, Lech Margaret, Cheng Eva, Neville Katrina, Burnett Ian S. Using grayscale images for object recognition with convolutional-recursive neural network. 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE). IEEE; 2016. p. 321–5.
13.
go back to reference Shun Li, Xiaoqiang W. YOLOv5-based Defect Detection Model for Hot Rolled Strip Steel. J Phys Conf Ser, vol. 2171. Bristol: IOP Publishing; 2022. p. 012040. Shun Li, Xiaoqiang W. YOLOv5-based Defect Detection Model for Hot Rolled Strip Steel. J Phys Conf Ser, vol. 2171. Bristol: IOP Publishing; 2022. p. 012040.
14.
go back to reference Renjie Xu, Lin Haifeng Lu, Kangjie CL, Yunfei L. A forest fire detection system based on ensemble learning. Forests. 2021;12(2):217.CrossRef Renjie Xu, Lin Haifeng Lu, Kangjie CL, Yunfei L. A forest fire detection system based on ensemble learning. Forests. 2021;12(2):217.CrossRef
15.
go back to reference Yanyan Z, Jingjing S. An improved BM3D algorithm based on anisotropic diffusion equation. Math Biosci Eng. 2020;17(5):4970–89.CrossRef Yanyan Z, Jingjing S. An improved BM3D algorithm based on anisotropic diffusion equation. Math Biosci Eng. 2020;17(5):4970–89.CrossRef
16.
go back to reference Phillip C, Hang M, Nym V, Jason D, Lois H, Annette H. A review of medical image data augmentation techniques for deep learning applications. J Med Imaging Radiat Oncol. 2021;65(5):545–63.CrossRef Phillip C, Hang M, Nym V, Jason D, Lois H, Annette H. A review of medical image data augmentation techniques for deep learning applications. J Med Imaging Radiat Oncol. 2021;65(5):545–63.CrossRef
17.
go back to reference Simon W, Khaled A, Tanel L, Saud A, Martin S. Confidence score: the forgotten dimension of object detection performance evaluation. Sensors. 2021;21(13):4350.CrossRefPubMedPubMedCentral Simon W, Khaled A, Tanel L, Saud A, Martin S. Confidence score: the forgotten dimension of object detection performance evaluation. Sensors. 2021;21(13):4350.CrossRefPubMedPubMedCentral
18.
go back to reference Redmon Joseph, Divvala Santosh, Girshick Ross, Farhadi Ali. You only look once: unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. 779–88. Redmon Joseph, Divvala Santosh, Girshick Ross, Farhadi Ali. You only look once: unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. 779–88.
19.
go back to reference Doherty John, Gardiner Bryan, Kerr Emmett, Siddique Nazmul, Manvi Sunilkumar. 2022 Comparative Study of Activation Functions and Their Impact on the YOLOv5 Object Detection Model International Conference on Pattern Recognition and Artificial Intelligence. Berlin: Springer. Doherty John, Gardiner Bryan, Kerr Emmett, Siddique Nazmul, Manvi Sunilkumar. 2022 Comparative Study of Activation Functions and Their Impact on the YOLOv5 Object Detection Model International Conference on Pattern Recognition and Artificial Intelligence. Berlin: Springer.
20.
go back to reference Qisong S, Shaobo Li, Qiang B, et al. Object detection method for grasping robot based on improved YOLOv5. Micromachines (Basel). 2021;12(11):1273.CrossRef Qisong S, Shaobo Li, Qiang B, et al. Object detection method for grasping robot based on improved YOLOv5. Micromachines (Basel). 2021;12(11):1273.CrossRef
21.
go back to reference Padilla Rafael, Netto Sergio L, da Silva Eduardo A B. 2020 A survey on performance metrics for object-detection algorithms 2020 international conference on systems, signals and image processing (IWSSIP). Piscataway: IEEE. 237–42. Padilla Rafael, Netto Sergio L, da Silva Eduardo A B. 2020 A survey on performance metrics for object-detection algorithms 2020 international conference on systems, signals and image processing (IWSSIP). Piscataway: IEEE. 237–42.
22.
go back to reference Nikhil K. Stochastic gradient descent deep learning with Python. Berlin: Springer; 2017. p. 113–32. Nikhil K. Stochastic gradient descent deep learning with Python. Berlin: Springer; 2017. p. 113–32.
23.
go back to reference Langlais Robert P, Craig M. Exercises in Oral Radiology and Interpretation-E-Book. Amsterdam: Elsevier Health Sciences; 2016. Langlais Robert P, Craig M. Exercises in Oral Radiology and Interpretation-E-Book. Amsterdam: Elsevier Health Sciences; 2016.
24.
go back to reference Shwetha H, Jinlong G, Rajesh V, Stephen C. Factors affecting interpretation of dental radiographs. Dentomaxillofacial Radiol. 2023;52(2):20220279.CrossRef Shwetha H, Jinlong G, Rajesh V, Stephen C. Factors affecting interpretation of dental radiographs. Dentomaxillofacial Radiol. 2023;52(2):20220279.CrossRef
25.
go back to reference Herbst Chantal S, Falk S, Joachim K, Herbst SR. Association between patient-, tooth-and treatment-level factors and root canal treatment failure: a retrospective longitudinal and machine learning study. J Dent. 2022;117:103937.CrossRefPubMed Herbst Chantal S, Falk S, Joachim K, Herbst SR. Association between patient-, tooth-and treatment-level factors and root canal treatment failure: a retrospective longitudinal and machine learning study. J Dent. 2022;117:103937.CrossRefPubMed
26.
go back to reference Emre YA, Sadullah G, Enis S, et al. Dental enumeration and multiple treatment detection on panoramic X-rays using deep learning. Sci Rep. 2021;11(1):1–10. Emre YA, Sadullah G, Enis S, et al. Dental enumeration and multiple treatment detection on panoramic X-rays using deep learning. Sci Rep. 2021;11(1):1–10.
28.
go back to reference Bouchahma Majed, Hammouda Sana Ben, Kouki Samia, Alshemaili Mouza, Samara Khaled. 2019 An automatic dental decay treatment prediction using a deep convolutional neural network on X-ray images 2019 IEEE/ACS 16th international conference on computer systems and applications (AICCSA). IEEE. 1–4 Bouchahma Majed, Hammouda Sana Ben, Kouki Samia, Alshemaili Mouza, Samara Khaled. 2019 An automatic dental decay treatment prediction using a deep convolutional neural network on X-ray images 2019 IEEE/ACS 16th international conference on computer systems and applications (AICCSA). IEEE. 1–4
29.
go back to reference Zakariasen Kenneth L, Scott David A, Jensen JR. Endodontic recall radiographs: how reliable is our interpretation of endodontic success or failure and what factors affect our reliability? Oral Surg Oral Med Oral Pathol. 1984;57(3):343–7.CrossRef Zakariasen Kenneth L, Scott David A, Jensen JR. Endodontic recall radiographs: how reliable is our interpretation of endodontic success or failure and what factors affect our reliability? Oral Surg Oral Med Oral Pathol. 1984;57(3):343–7.CrossRef
30.
go back to reference Tawiah Clifford A, Sheng Victor S. A study on multi-label classification. Industrial Conference on Data Mining. Springer. 2013. 137–50 Tawiah Clifford A, Sheng Victor S. A study on multi-label classification. Industrial Conference on Data Mining. Springer. 2013. 137–50
31.
go back to reference Ling Charles X, Sheng VS. Cost-sensitive learning and the class imbalance problem. Encycl Mach Learning. 2008;2011:231–5. Ling Charles X, Sheng VS. Cost-sensitive learning and the class imbalance problem. Encycl Mach Learning. 2008;2011:231–5.
Metadata
Title
Experimental validation of computer-vision methods for the successful detection of endodontic treatment obturation and progression from noisy radiographs
Authors
Habib Al Hasan
Farhan Hasin Saad
Saif Ahmed
Nabeel Mohammed
Taseef Hasan Farook
James Dudley
Publication date
25-04-2023
Publisher
Springer Nature Singapore
Published in
Oral Radiology / Issue 4/2023
Print ISSN: 0911-6028
Electronic ISSN: 1613-9674
DOI
https://doi.org/10.1007/s11282-023-00685-8

Other articles of this Issue 4/2023

Oral Radiology 4/2023 Go to the issue