Skip to main content
Top
Published in: BMC Oral Health 1/2023

Open Access 01-12-2023 | Research

Comparison of 2D, 2.5D, and 3D segmentation networks for maxillary sinuses and lesions in CBCT images

Authors: Yeon-Sun Yoo, DaEl Kim, Su Yang, Se-Ryong Kang, Jo-Eun Kim, Kyung-Hoe Huh, Sam-Sun Lee, Min-Suk Heo, Won-Jin Yi

Published in: BMC Oral Health | Issue 1/2023

Login to get access

Abstract

Background

The purpose of this study was to compare the segmentation performances of the 2D, 2.5D, and 3D networks for maxillary sinuses (MSs) and lesions inside the maxillary sinus (MSL) with variations in sizes, shapes, and locations in cone beam CT (CBCT) images under the same constraint of memory capacity.

Methods

The 2D, 2.5D, and 3D networks were compared comprehensively for the segmentation of the MS and MSL in CBCT images under the same constraint of memory capacity. MSLs were obtained by subtracting the prediction of the air region of the maxillary sinus (MSA) from that of the MS.

Results

The 2.5D network showed the highest segmentation performances for the MS and MSA compared to the 2D and 3D networks. The performances of the Jaccard coefficient, Dice similarity coefficient, precision, and recall by the 2.5D network of U-net +  + reached 0.947, 0.973, 0.974, and 0.971 for the MS, respectively, and 0.787, 0.875, 0.897, and 0.858 for the MSL, respectively.

Conclusions

The 2.5D segmentation network demonstrated superior segmentation performance for various MSLs with an ensemble learning approach of combining the predictions from three orthogonal planes.
Literature
1.
go back to reference Buser D, Sennerby L, De Bruyn H. Modern implant dentistry based on osseointegration: 50 years of progress, current trends and open questions. Periodontology. 2017;73(1):7–21.CrossRef Buser D, Sennerby L, De Bruyn H. Modern implant dentistry based on osseointegration: 50 years of progress, current trends and open questions. Periodontology. 2017;73(1):7–21.CrossRef
2.
go back to reference Del Fabbro M, et al. Implant survival rates after osteotome-mediated maxillary sinus augmentation: a systematic review. Clin Implant Dent Relat Res. 2012;14:e159–68.PubMed Del Fabbro M, et al. Implant survival rates after osteotome-mediated maxillary sinus augmentation: a systematic review. Clin Implant Dent Relat Res. 2012;14:e159–68.PubMed
3.
go back to reference Amid R, et al. Effect of Schneiderian Membrane Thickening on the Maxillary Sinus Augmentation and Implantation Outcomes: A Systematic Review. J Maxillofac Oral Surg. 2021;20(4):534–44.PubMedPubMedCentralCrossRef Amid R, et al. Effect of Schneiderian Membrane Thickening on the Maxillary Sinus Augmentation and Implantation Outcomes: A Systematic Review. J Maxillofac Oral Surg. 2021;20(4):534–44.PubMedPubMedCentralCrossRef
4.
go back to reference Vaddi A, et al. Evaluation of available height, location, and patency of the ostium for sinus augmentation from an implant treatment planning perspective. Imaging Sci Dent. 2021;51(3):243–50.PubMedPubMedCentralCrossRef Vaddi A, et al. Evaluation of available height, location, and patency of the ostium for sinus augmentation from an implant treatment planning perspective. Imaging Sci Dent. 2021;51(3):243–50.PubMedPubMedCentralCrossRef
5.
go back to reference Whyte A, Boeddinghaus R. The maxillary sinus: physiology, development and imaging anatomy. Dentomaxillofacial Radiol. 2019;48(8):20190205.CrossRef Whyte A, Boeddinghaus R. The maxillary sinus: physiology, development and imaging anatomy. Dentomaxillofacial Radiol. 2019;48(8):20190205.CrossRef
6.
go back to reference Testori T, et al. Perforation Risk Assessment in Maxillary Sinus Augmentation with Lateral Wall Technique. Int J Periodontics Restorative Dent. 2020;40(3):373–80.PubMedCrossRef Testori T, et al. Perforation Risk Assessment in Maxillary Sinus Augmentation with Lateral Wall Technique. Int J Periodontics Restorative Dent. 2020;40(3):373–80.PubMedCrossRef
7.
go back to reference Peñarrocha-Oltra S, et al. Association between maxillary sinus pathology and odontogenic lesions in patients evaluated by cone beam computed tomography. A systematic review and meta-analysis. Med Oral Patol Oral Cir Bucal. 2020;25(1):e34–48.PubMedCrossRef Peñarrocha-Oltra S, et al. Association between maxillary sinus pathology and odontogenic lesions in patients evaluated by cone beam computed tomography. A systematic review and meta-analysis. Med Oral Patol Oral Cir Bucal. 2020;25(1):e34–48.PubMedCrossRef
8.
go back to reference Shetty S, et al. A study on the association between accessory maxillary ostium and maxillary sinus mucosal thickening using cone beam computed tomography. Head Face Med. 2021;17(1):1–10.CrossRef Shetty S, et al. A study on the association between accessory maxillary ostium and maxillary sinus mucosal thickening using cone beam computed tomography. Head Face Med. 2021;17(1):1–10.CrossRef
9.
go back to reference Ghatak RN, Helwany M, Ginglen JG. Anatomy, Head and Neck, Mandibular Nerve. Treasure Island (FL): StatPearls Publishing; 2022. Ghatak RN, Helwany M, Ginglen JG. Anatomy, Head and Neck, Mandibular Nerve. Treasure Island (FL): StatPearls Publishing; 2022.
10.
go back to reference Ludlow JB, et al. Dosimetry of 3 CBCT devices for oral and maxillofacial radiology: CB Mercuray, NewTom 3G and i-CAT. Dentomaxillofacial Radiol. 2006;35(4):219–26.CrossRef Ludlow JB, et al. Dosimetry of 3 CBCT devices for oral and maxillofacial radiology: CB Mercuray, NewTom 3G and i-CAT. Dentomaxillofacial Radiol. 2006;35(4):219–26.CrossRef
11.
go back to reference Scarfe WC, Farman AG, Sukovic P. Clinical applications of cone-beam computed tomography in dental practice. J Can Dental Assoc. 2006;72(1):75. Scarfe WC, Farman AG, Sukovic P. Clinical applications of cone-beam computed tomography in dental practice. J Can Dental Assoc. 2006;72(1):75.
12.
go back to reference Kang S-R, et al. Structure-preserving quality improvement of cone beam CT images using contrastive learning. Comput Biol Med. 2023;158:106803.PubMedCrossRef Kang S-R, et al. Structure-preserving quality improvement of cone beam CT images using contrastive learning. Comput Biol Med. 2023;158:106803.PubMedCrossRef
13.
go back to reference Yong T-H, et al. QCBCT-NET for direct measurement of bone mineral density from quantitative cone-beam CT: A human skull phantom study. Sci Rep. 2021;11(1):15083.PubMedPubMedCentralCrossRef Yong T-H, et al. QCBCT-NET for direct measurement of bone mineral density from quantitative cone-beam CT: A human skull phantom study. Sci Rep. 2021;11(1):15083.PubMedPubMedCentralCrossRef
14.
go back to reference Jacobs R, et al. Cone beam computed tomography in implant dentistry: recommendations for clinical use. BMC Oral Health. 2018;18(1):1–16.CrossRef Jacobs R, et al. Cone beam computed tomography in implant dentistry: recommendations for clinical use. BMC Oral Health. 2018;18(1):1–16.CrossRef
15.
go back to reference Suetens P, et al. Image segmentation: methods and applications in diagnostic radiology and nuclear medicine. Eur J Radiol. 1993;17(1):14–21.PubMedCrossRef Suetens P, et al. Image segmentation: methods and applications in diagnostic radiology and nuclear medicine. Eur J Radiol. 1993;17(1):14–21.PubMedCrossRef
16.
go back to reference Morgan N, et al. Convolutional neural network for automatic maxillary sinus segmentation on cone-beam computed tomographic images. Sci Rep. 2022;12(1):7523.PubMedPubMedCentralCrossRef Morgan N, et al. Convolutional neural network for automatic maxillary sinus segmentation on cone-beam computed tomographic images. Sci Rep. 2022;12(1):7523.PubMedPubMedCentralCrossRef
17.
go back to reference Jung S-K, et al. Deep active learning for automatic segmentation of maxillary sinus lesions using a convolutional neural network. Diagnostics. 2021;11(4):688.PubMedPubMedCentralCrossRef Jung S-K, et al. Deep active learning for automatic segmentation of maxillary sinus lesions using a convolutional neural network. Diagnostics. 2021;11(4):688.PubMedPubMedCentralCrossRef
18.
go back to reference Nogueira-Reis F, et al. Three-dimensional maxillary virtual patient creation by convolutional neural network-based segmentation on cone-beam computed tomography images. Clin Oral Invest. 2023;27(3):1133–41.CrossRef Nogueira-Reis F, et al. Three-dimensional maxillary virtual patient creation by convolutional neural network-based segmentation on cone-beam computed tomography images. Clin Oral Invest. 2023;27(3):1133–41.CrossRef
19.
go back to reference Choi H, et al. Deep learning-based fully automatic segmentation of the maxillary sinus on cone-beam computed tomographic images. Sci Rep. 2022;12(1):1–9. Choi H, et al. Deep learning-based fully automatic segmentation of the maxillary sinus on cone-beam computed tomographic images. Sci Rep. 2022;12(1):1–9.
20.
go back to reference Hung KF, et al. Automatic detection and segmentation of morphological changes of the maxillary sinus mucosa on cone-beam computed tomography images using a three-dimensional convolutional neural network. Clin Oral Invest. 2022;26(5):3987–98.CrossRef Hung KF, et al. Automatic detection and segmentation of morphological changes of the maxillary sinus mucosa on cone-beam computed tomography images using a three-dimensional convolutional neural network. Clin Oral Invest. 2022;26(5):3987–98.CrossRef
21.
go back to reference Tran D, et al. Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision. 2015. Tran D, et al. Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision. 2015.
22.
go back to reference Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Cham: Springer International Publishing; 2015. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Cham: Springer International Publishing; 2015.
23.
go back to reference Singh SP, et al. 3D Deep learning on medical images: A review. Sensors (Basel). 2020;20(18):5097. Singh SP, et al. 3D Deep learning on medical images: A review. Sensors (Basel). 2020;20(18):5097.
24.
go back to reference Çiçek Ö, et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Proceedings, Part II 19. Athens: Springer International Publishing; 2016. Çiçek Ö, et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Proceedings, Part II 19. Athens: Springer International Publishing; 2016.
25.
go back to reference Niyas S, et al. Medical image segmentation with 3D convolutional neural networks: A survey. Neurocomputing. 2022;493:397–413.CrossRef Niyas S, et al. Medical image segmentation with 3D convolutional neural networks: A survey. Neurocomputing. 2022;493:397–413.CrossRef
26.
go back to reference Milletari F, Navab N, Ahmadi SA. V-net: Fully convolutional neural networks for volumetric medical image segmentation. in 2016 fourth international conference on 3D vision (3DV). 2016. (Ieee). Milletari F, Navab N, Ahmadi SA. V-net: Fully convolutional neural networks for volumetric medical image segmentation. in 2016 fourth international conference on 3D vision (3DV). 2016. (Ieee).
27.
go back to reference Zhang Y, et al. Bridging 2D and 3D segmentation networks for computation-efficient volumetric medical image segmentation: An empirical study of 2.5D solutions. Comput Med Imaging Graph. 2022;99:102088.PubMedCrossRef Zhang Y, et al. Bridging 2D and 3D segmentation networks for computation-efficient volumetric medical image segmentation: An empirical study of 2.5D solutions. Comput Med Imaging Graph. 2022;99:102088.PubMedCrossRef
28.
go back to reference Hering A, et al. Memory-efficient 2.5D convolutional transformer networks for multi-modal deformable registration with weak label supervision applied to whole-heart CT and MRI scans. Int J Comput Assisted Radiol Surg. 2019;14(11):1901–12.CrossRef Hering A, et al. Memory-efficient 2.5D convolutional transformer networks for multi-modal deformable registration with weak label supervision applied to whole-heart CT and MRI scans. Int J Comput Assisted Radiol Surg. 2019;14(11):1901–12.CrossRef
29.
go back to reference Zheng H, et al. Improving the slice interaction of 2.5 D CNN for automatic pancreas segmentation. Med Phys. 2020;47(11):5543–54.PubMedCrossRef Zheng H, et al. Improving the slice interaction of 2.5 D CNN for automatic pancreas segmentation. Med Phys. 2020;47(11):5543–54.PubMedCrossRef
30.
go back to reference Han L, et al. Liver segmentation with 2.5D perpendicular UNets. Comput Electrical Eng. 2021;91:107118. Han L, et al. Liver segmentation with 2.5D perpendicular UNets. Comput Electrical Eng. 2021;91:107118.
31.
go back to reference Hu K, et al. A 2.5D Cancer Segmentation for MRI Images Based on U-Net. In: 2018 5th International Conference on Information Science and Control Engineering (ICISCE). 2018. p. 6–10.CrossRef Hu K, et al. A 2.5D Cancer Segmentation for MRI Images Based on U-Net. In: 2018 5th International Conference on Information Science and Control Engineering (ICISCE). 2018. p. 6–10.CrossRef
33.
go back to reference Minnema J, et al. Comparison of convolutional neural network training strategies for cone-beam CT image segmentation. Comput Methods Programs Biomed. 2021;207:106192.PubMedCrossRef Minnema J, et al. Comparison of convolutional neural network training strategies for cone-beam CT image segmentation. Comput Methods Programs Biomed. 2021;207:106192.PubMedCrossRef
34.
go back to reference Ottesen JA, et al. 2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data. Front Neuroinform. 2022;16:1056068.PubMedCrossRef Ottesen JA, et al. 2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data. Front Neuroinform. 2022;16:1056068.PubMedCrossRef
35.
go back to reference Marathe A, Walambe R, Kotecha K. Evaluating the performance of ensemble methods and voting strategies for dense 2D pedestrian detection in the wild. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021. Marathe A, Walambe R, Kotecha K. Evaluating the performance of ensemble methods and voting strategies for dense 2D pedestrian detection in the wild. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.
36.
go back to reference Dietterich TG. Ensemble methods in machine learning in multiple classifier systems: First international workshop, MCS 2000 Cagliari, Italy, June 21–23, 2000 Proceedings 1. Berlin: Springer; 2000. Dietterich TG. Ensemble methods in machine learning in multiple classifier systems: First international workshop, MCS 2000 Cagliari, Italy, June 21–23, 2000 Proceedings 1. Berlin: Springer; 2000.
37.
go back to reference Avesta A, et al. Comparing 3D, 2.5D, and 2D approaches to brain image auto-segmentation. Bioengineering (Basel). 2023;10(2):181. Avesta A, et al. Comparing 3D, 2.5D, and 2D approaches to brain image auto-segmentation. Bioengineering (Basel). 2023;10(2):181.
38.
go back to reference Crespi L, Loiacono D, Sartori P. Are 3D better than 2D Convolutional Neural Networks for Medical Imaging Semantic Segmentation? In: 2022 International Joint Conference on Neural Networks (IJCNN). 2022. IEEE. Crespi L, Loiacono D, Sartori P. Are 3D better than 2D Convolutional Neural Networks for Medical Imaging Semantic Segmentation? In: 2022 International Joint Conference on Neural Networks (IJCNN). 2022. IEEE.
39.
go back to reference Kieselmann JP, et al. Auto-segmentation of the parotid glands on MR images of head and neck cancer patients with deep learning strategies. MedRxiv. 2020;19.20248376:2020–12. Kieselmann JP, et al. Auto-segmentation of the parotid glands on MR images of head and neck cancer patients with deep learning strategies. MedRxiv. 2020;19.20248376:2020–12.
40.
go back to reference Yoganathan SA, et al. Automatic segmentation of magnetic resonance images for high-dose-rate cervical cancer brachytherapy using deep learning. Med Phys. 2022;49(3):1571–84.PubMedCrossRef Yoganathan SA, et al. Automatic segmentation of magnetic resonance images for high-dose-rate cervical cancer brachytherapy using deep learning. Med Phys. 2022;49(3):1571–84.PubMedCrossRef
42.
go back to reference Zhou Z, et al. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging. 2019;39(6):1856–67.PubMedPubMedCentralCrossRef Zhou Z, et al. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging. 2019;39(6):1856–67.PubMedPubMedCentralCrossRef
43.
go back to reference He K, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. He K, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
44.
go back to reference Huang G, et al. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. Huang G, et al. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.
45.
go back to reference Kim D, et al. SinusNet: Label-Free Segmentation of Maxillary Sinus Lesion in CBCT Images. In: Medical Imaging with Deep Learning. 2022. Kim D, et al. SinusNet: Label-Free Segmentation of Maxillary Sinus Lesion in CBCT Images. In: Medical Imaging with Deep Learning. 2022.
46.
go back to reference Jeoun B-S, et al. Canal-Net for automatic and robust 3D segmentation of mandibular canals in CBCT images using a continuity-aware contextual network. Sci Rep. 2022;12(1):13460.PubMedPubMedCentralCrossRef Jeoun B-S, et al. Canal-Net for automatic and robust 3D segmentation of mandibular canals in CBCT images using a continuity-aware contextual network. Sci Rep. 2022;12(1):13460.PubMedPubMedCentralCrossRef
47.
go back to reference Vaswani A, et al. Attention is all you need. Advances in neural information processing systems. 2017. p. 30. Vaswani A, et al. Attention is all you need. Advances in neural information processing systems. 2017. p. 30.
48.
go back to reference Hatamizadeh A, et al. Unetr: Transformers for 3d medical image segmentation. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision. 2022. Hatamizadeh A, et al. Unetr: Transformers for 3d medical image segmentation. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision. 2022.
49.
go back to reference Liu Z, et al. Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021. Liu Z, et al. Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021.
50.
go back to reference Li Z, et al. Panoptic segformer: Delving deeper into panoptic segmentation with transformers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. Li Z, et al. Panoptic segformer: Delving deeper into panoptic segmentation with transformers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022.
Metadata
Title
Comparison of 2D, 2.5D, and 3D segmentation networks for maxillary sinuses and lesions in CBCT images
Authors
Yeon-Sun Yoo
DaEl Kim
Su Yang
Se-Ryong Kang
Jo-Eun Kim
Kyung-Hoe Huh
Sam-Sun Lee
Min-Suk Heo
Won-Jin Yi
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Oral Health / Issue 1/2023
Electronic ISSN: 1472-6831
DOI
https://doi.org/10.1186/s12903-023-03607-6

Other articles of this Issue 1/2023

BMC Oral Health 1/2023 Go to the issue