Skip to main content
Top
Published in:

01-12-2022 | Magnetic Resonance Imaging | Research

Deep learning-based automated segmentation of eight brain anatomical regions using head CT images in PET/CT

Authors: Tong Wang, Haiqun Xing, Yige Li, Sicong Wang, Ling Liu, Fang Li, Hongli Jing

Published in: BMC Medical Imaging | Issue 1/2022

Login to get access

Abstract

Objective

We aim to propose a deep learning-based method of automated segmentation of eight brain anatomical regions in head computed tomography (CT) images obtained during positron emission tomography/computed tomography (PET/CT) scans. The brain regions include basal ganglia, cerebellum, hemisphere, and hippocampus, all split into left and right.

Materials and methods

We enrolled patients who underwent both PET/CT imaging (with an extra head CT scan) and magnetic resonance imaging (MRI). The segmentation of eight brain regions in CT was achieved by using convolutional neural networks (CNNs): DenseVNet and 3D U-Net. The same segmentation task in MRI was performed by using BrainSuite13, which was a public atlas label method. The mean Dice scores were used to assess the performance of the CNNs. Then, the agreement and correlation of the volumes of the eight segmented brain regions between CT and MRI methods were analyzed.

Results

18 patients were enrolled. Four of the eight brain regions obtained high mean Dice scores (> 0.90): left (0.978) and right (0.912) basal ganglia and left (0.945) and right (0.960) hemisphere. Regarding the agreement and correlation of the brain region volumes between two methods, moderate agreements were observed on the left (ICC: 0.618, 95% CI 0.242, 0.835) and right (ICC: 0.654, 95% CI 0.298, 0.853) hemisphere. Poor agreements were observed on the other regions. A moderate correlation was observed on the right hemisphere (Spearman’s rho 0.68, p = 0.0019). Lower correlations were observed on the other regions.

Conclusions

The proposed deep learning-based method performed automated segmentation of eight brain anatomical regions on head CT imaging in PET/CT. Some regions obtained high mean Dice scores and the agreement and correlation results of the segmented region volumes between two methods were moderate to poor.
Literature
1.
go back to reference Li L, et al. Deep learning for variational multimodality tumor segmentation in PET/CT. Neurocomputing. 2020;392:277–95.CrossRef Li L, et al. Deep learning for variational multimodality tumor segmentation in PET/CT. Neurocomputing. 2020;392:277–95.CrossRef
2.
go back to reference Xia Y, et al. Brain tissue segmentation in PET-CT images using probabilistic atlas and variational Bayes inference. In: 2011 annual international conference of the IEEE Engineering in Medicine and Biology Society. IEEE; 2011. Xia Y, et al. Brain tissue segmentation in PET-CT images using probabilistic atlas and variational Bayes inference. In: 2011 annual international conference of the IEEE Engineering in Medicine and Biology Society. IEEE; 2011.
3.
go back to reference Xia Y, et al. Segmentation of brain structures using PET-CT images. In: 2008 International conference on information technology and applications in biomedicine. IEEE; 2008. Xia Y, et al. Segmentation of brain structures using PET-CT images. In: 2008 International conference on information technology and applications in biomedicine. IEEE; 2008.
4.
go back to reference Xia Y, et al. Dual-modality brain PET-CT image segmentation based on adaptive use of functional and anatomical information. Comput Med Imaging Graph. 2012;36(1):47–53.CrossRef Xia Y, et al. Dual-modality brain PET-CT image segmentation based on adaptive use of functional and anatomical information. Comput Med Imaging Graph. 2012;36(1):47–53.CrossRef
5.
go back to reference Xia Y, et al. Segmentation of dual modality brain PET/CT images using the MAP-MRF model. In: 2008 IEEE 10th workshop on multimedia signal processing. IEEE; 2008. Xia Y, et al. Segmentation of dual modality brain PET/CT images using the MAP-MRF model. In: 2008 IEEE 10th workshop on multimedia signal processing. IEEE; 2008.
6.
go back to reference Zhao C, et al. Whole brain segmentation and labeling from CT using synthetic MR images. In: International workshop on machine learning in medical imaging. Cham: Springer; 2017. Zhao C, et al. Whole brain segmentation and labeling from CT using synthetic MR images. In: International workshop on machine learning in medical imaging. Cham: Springer; 2017.
7.
go back to reference Despotović I, Goossens B, Philips W. MRI segmentation of the human brain: challenges, methods, and applications. Comput Math Methods Med 2015 (2015). Despotović I, Goossens B, Philips W. MRI segmentation of the human brain: challenges, methods, and applications. Comput Math Methods Med 2015 (2015).
8.
go back to reference Išgum I, et al. Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge. Med Image Anal. 2015;20(1):135–51.CrossRef Išgum I, et al. Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge. Med Image Anal. 2015;20(1):135–51.CrossRef
9.
go back to reference Makropoulos A, et al. Automatic whole brain MRI segmentation of the developing neonatal brain. IEEE Trans Med Imaging. 2014;33(9):1818–31.CrossRef Makropoulos A, et al. Automatic whole brain MRI segmentation of the developing neonatal brain. IEEE Trans Med Imaging. 2014;33(9):1818–31.CrossRef
10.
go back to reference Shi F, et al. Neonatal brain image segmentation in longitudinal MRI studies. Neuroimage. 2010;49(1):391–400.CrossRef Shi F, et al. Neonatal brain image segmentation in longitudinal MRI studies. Neuroimage. 2010;49(1):391–400.CrossRef
11.
go back to reference Ledig C, et al. Robust whole-brain segmentation: application to traumatic brain injury. Med image Anal. 2015;21(1):40–58.CrossRef Ledig C, et al. Robust whole-brain segmentation: application to traumatic brain injury. Med image Anal. 2015;21(1):40–58.CrossRef
12.
go back to reference Wadhwa A, Bhardwaj A, Verma VS. A review on brain tumor segmentation of MRI images. Magn Reson Imaging. 2019;61:247–59.CrossRef Wadhwa A, Bhardwaj A, Verma VS. A review on brain tumor segmentation of MRI images. Magn Reson Imaging. 2019;61:247–59.CrossRef
13.
go back to reference Akkus Z, et al. Deep learning for brain MRI segmentation: state of the art and future directions. J Digit Imaging. 2017;30(4):449–59.CrossRef Akkus Z, et al. Deep learning for brain MRI segmentation: state of the art and future directions. J Digit Imaging. 2017;30(4):449–59.CrossRef
14.
go back to reference Havaei, Mohammad, et al. "Brain tumor segmentation with deep neural networks." Medical image analysis 35 (2017): 18–31. Havaei, Mohammad, et al. "Brain tumor segmentation with deep neural networks." Medical image analysis 35 (2017): 18–31.
15.
go back to reference Lenchik L, et al. Automated segmentation of tissues using CT and MRI: a systematic review. Acad Radiol. 2019;26(12):1695–706.CrossRef Lenchik L, et al. Automated segmentation of tissues using CT and MRI: a systematic review. Acad Radiol. 2019;26(12):1695–706.CrossRef
16.
go back to reference Wang L, et al. Segmentation of neonatal brain MR images using patch-driven level sets. Neuroimage. 2014;84:141–58.CrossRef Wang L, et al. Segmentation of neonatal brain MR images using patch-driven level sets. Neuroimage. 2014;84:141–58.CrossRef
17.
go back to reference Zhang W, et al. Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage. 2015;108:214–24.CrossRef Zhang W, et al. Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage. 2015;108:214–24.CrossRef
18.
go back to reference Zhang D, et al. Exploring task structure for brain tumor segmentation from multi-modality MR images. IEEE Trans Image Process. 2020;29:9032–43.CrossRef Zhang D, et al. Exploring task structure for brain tumor segmentation from multi-modality MR images. IEEE Trans Image Process. 2020;29:9032–43.CrossRef
19.
go back to reference Zhang D, et al. Cross-modality deep feature learning for brain tumor segmentation. Pattern Recognit. 2021;110:107562.CrossRef Zhang D, et al. Cross-modality deep feature learning for brain tumor segmentation. Pattern Recognit. 2021;110:107562.CrossRef
20.
go back to reference Hu Q, et al. Segmentation of brain from computed tomography head images. In: 2005 IEEE Engineering in Medicine and Biology 27th annual conference. IEEE; 2006. Hu Q, et al. Segmentation of brain from computed tomography head images. In: 2005 IEEE Engineering in Medicine and Biology 27th annual conference. IEEE; 2006.
21.
go back to reference Lee TH, Fauzi MFA, Komiya R. Segmentation of CT brain images using K-means and EM clustering. In: 2008 fifth international conference on computer graphics, imaging and visualisation. IEEE; 2008. Lee TH, Fauzi MFA, Komiya R. Segmentation of CT brain images using K-means and EM clustering. In: 2008 fifth international conference on computer graphics, imaging and visualisation. IEEE; 2008.
22.
go back to reference Manniesing R, et al. White matter and gray matter segmentation in 4D computed tomography. Sci Rep. 2017;7(1):1–11.CrossRef Manniesing R, et al. White matter and gray matter segmentation in 4D computed tomography. Sci Rep. 2017;7(1):1–11.CrossRef
23.
go back to reference Qian X, et al. An active contour model for medical image segmentation with application to brain CT image. Med Phys. 2013;40(2):021911.CrossRef Qian X, et al. An active contour model for medical image segmentation with application to brain CT image. Med Phys. 2013;40(2):021911.CrossRef
24.
go back to reference Cai JC, et al. Fully automated segmentation of head CT neuroanatomy using deep learning. Radiol Artif Intell. 2020;2(5):e190183.CrossRef Cai JC, et al. Fully automated segmentation of head CT neuroanatomy using deep learning. Radiol Artif Intell. 2020;2(5):e190183.CrossRef
25.
go back to reference Khalili N, et al. Automatic brain tissue segmentation in fetal MRI using convolutional neural networks. Magn Reson Imaging. 2019;64:77–89.CrossRef Khalili N, et al. Automatic brain tissue segmentation in fetal MRI using convolutional neural networks. Magn Reson Imaging. 2019;64:77–89.CrossRef
26.
go back to reference Rajashekar D, et al. High-resolution T2-FLAIR and non-contrast CT brain atlas of the elderly. Sci Data. 2020;7(1):1–7.CrossRef Rajashekar D, et al. High-resolution T2-FLAIR and non-contrast CT brain atlas of the elderly. Sci Data. 2020;7(1):1–7.CrossRef
27.
go back to reference Irimia A, et al. Brain segmentation from computed tomography of healthy aging and geriatric concussion at variable spatial resolutions. Front Neuroinform. 2019;13:9.CrossRef Irimia A, et al. Brain segmentation from computed tomography of healthy aging and geriatric concussion at variable spatial resolutions. Front Neuroinform. 2019;13:9.CrossRef
28.
go back to reference Willowson KP, Bailey EA, Bailey DL. A retrospective evaluation of radiation dose associated with low dose FDG protocols in whole-body PET/CT. Australas Phys Eng Sci Med. 2012;35(1):49–53.CrossRef Willowson KP, Bailey EA, Bailey DL. A retrospective evaluation of radiation dose associated with low dose FDG protocols in whole-body PET/CT. Australas Phys Eng Sci Med. 2012;35(1):49–53.CrossRef
29.
go back to reference Shattuck DW, Leahy RM. BrainSuite: an automated cortical surface identification tool. Med Image Anal. 2002;6(2):129–42.CrossRef Shattuck DW, Leahy RM. BrainSuite: an automated cortical surface identification tool. Med Image Anal. 2002;6(2):129–42.CrossRef
30.
go back to reference Shattuck DW, et al. Software tools for anatomical ROI-based connectivity analysis. In: 21st scientific meeting of International Society for Magnetic Resonance in Medicine (ISMRM), Salt Lake City, Utah; 2013. Shattuck DW, et al. Software tools for anatomical ROI-based connectivity analysis. In: 21st scientific meeting of International Society for Magnetic Resonance in Medicine (ISMRM), Salt Lake City, Utah; 2013.
31.
go back to reference Joshi AA, et al. Surface-constrained volumetric brain registration using harmonic mappings. IEEE Trans Med Imaging. 2007;26(12):1657–69.CrossRef Joshi AA, et al. Surface-constrained volumetric brain registration using harmonic mappings. IEEE Trans Med Imaging. 2007;26(12):1657–69.CrossRef
32.
go back to reference Joshi AA, Shattuck DW, Leahy RM. A method for automated cortical surface registration and labeling. In: International workshop on biomedical image registration. Berlin: Springer; 2012. Joshi AA, Shattuck DW, Leahy RM. A method for automated cortical surface registration and labeling. In: International workshop on biomedical image registration. Berlin: Springer; 2012.
34.
go back to reference Gibson E, et al. Automatic multi-organ segmentation on abdominal CT with dense V-networks. IEEE Trans Med Imaging. 2018;37(8):1822–34.CrossRef Gibson E, et al. Automatic multi-organ segmentation on abdominal CT with dense V-networks. IEEE Trans Med Imaging. 2018;37(8):1822–34.CrossRef
35.
go back to reference Çiçek Ö, et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer; 2016. Çiçek Ö, et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Cham: Springer; 2016.
36.
go back to reference Zou KH, et al. Statistical validation of image segmentation quality based on a spatial overlap index1: scientific reports. Acad Radiol. 2004;11(2):178–89.CrossRef Zou KH, et al. Statistical validation of image segmentation quality based on a spatial overlap index1: scientific reports. Acad Radiol. 2004;11(2):178–89.CrossRef
37.
go back to reference Schober P, Boer C, Schwarte LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg. 2018;126(5):1763–8.CrossRef Schober P, Boer C, Schwarte LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg. 2018;126(5):1763–8.CrossRef
38.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRef Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRef
Metadata
Title
Deep learning-based automated segmentation of eight brain anatomical regions using head CT images in PET/CT
Authors
Tong Wang
Haiqun Xing
Yige Li
Sicong Wang
Ling Liu
Fang Li
Hongli Jing
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2022
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/s12880-022-00807-4