Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 11/2020

01-11-2020 | Ultrasound | Original Article

Automatic segmentation of the carotid artery and internal jugular vein from 2D ultrasound images for 3D vascular reconstruction

Authors: Leah A. Groves, Blake VanBerlo, Natan Veinberg, Abdulrahman Alboog, Terry M. Peters, Elvis C. S. Chen

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 11/2020

Login to get access

Abstract

Purpose

In the context of analyzing neck vascular morphology, this work formulates and compares Mask R-CNN and U-Net-based algorithms to automatically segment the carotid artery (CA) and internal jugular vein (IJV) from transverse neck ultrasound (US).

Methods

US scans of the neck vasculature were collected to produce a dataset of 2439 images and their respective manual segmentations. Fourfold cross-validation was employed to train and evaluate Mask RCNN and U-Net models. The U-Net algorithm includes a post-processing step that selects the largest connected segmentation for each class. A Mask R-CNN-based vascular reconstruction pipeline was validated by performing a surface-to-surface distance comparison between US and CT reconstructions from the same patient.

Results

The average CA and IJV Dice scores produced by the Mask R-CNN across the evaluation data from all four sets were \(0.90\pm 0.08\) and \(0.88\pm 0.14\). The average Dice scores produced by the post-processed U-Net were \(0.81\pm 0.21\) and \(0.71\pm 0.23\), for the CA and IJV, respectively. The reconstruction algorithm utilizing the Mask R-CNN was capable of producing accurate 3D reconstructions with majority of US reconstruction surface points being within 2 mm of the CT equivalent.

Conclusions

On average, the Mask R-CNN produced more accurate vascular segmentations compared to U-Net. The Mask R-CNN models were used to produce 3D reconstructed vasculature with a similar accuracy to that of a manually segmented CT scan. This implementation of the Mask R-CNN network enables automatic analysis of the neck vasculature and facilitates 3D vascular reconstruction.
Literature
1.
go back to reference Abdulla W (2017) Mask R-CNN for object detection and instance segmentation on Keras and Tensorflow Abdulla W (2017) Mask R-CNN for object detection and instance segmentation on Keras and Tensorflow
2.
go back to reference Ameri G, Baxter JSH, Bainbridge D, Peters TM, Chen ECS (2018) Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg 13(4):495–505CrossRefPubMed Ameri G, Baxter JSH, Bainbridge D, Peters TM, Chen ECS (2018) Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg 13(4):495–505CrossRefPubMed
3.
go back to reference Besl PJ, McKay ND (1992) Method for registration of 3-d shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International Society for Optics and Photonics, pp 586–606 Besl PJ, McKay ND (1992) Method for registration of 3-d shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International Society for Optics and Photonics, pp 586–606
4.
go back to reference Chao A, Lai CH, Chan KC, Yeh CC, Yeh HM, Fan SZ, Sun WZ (2014) Performance of central venous catheterization by medical students: a retrospective study of students’ logbooks. BMC Med Educ 14(1):168CrossRefPubMedPubMedCentral Chao A, Lai CH, Chan KC, Yeh CC, Yeh HM, Fan SZ, Sun WZ (2014) Performance of central venous catheterization by medical students: a retrospective study of students’ logbooks. BMC Med Educ 14(1):168CrossRefPubMedPubMedCentral
5.
go back to reference Chen ECS, Peters TM, Ma B (2016) Guided ultrasound calibration: where, how, and how many calibration fiducials. Int J Comput Assist Radiol Surg 11(6):889–898CrossRefPubMed Chen ECS, Peters TM, Ma B (2016) Guided ultrasound calibration: where, how, and how many calibration fiducials. Int J Comput Assist Radiol Surg 11(6):889–898CrossRefPubMed
6.
go back to reference Couteaux V, Si-Mohamed S, Nempont O, Lefevre T, Popoff A, Pizaine G, Villain N, Bloch I, Cotten A, Boussel L (2019) Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. Diagn Interv Imaging 100(4):235–242CrossRefPubMed Couteaux V, Si-Mohamed S, Nempont O, Lefevre T, Popoff A, Pizaine G, Villain N, Bloch I, Cotten A, Boussel L (2019) Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. Diagn Interv Imaging 100(4):235–242CrossRefPubMed
7.
go back to reference Dai Z, Carver E, Liu C, Lee J, Feldman A, Zong W, Pantelic M, Elshaikh M, Wen N (2020) Segmentation of the prostatic gland and the intraprostatic lesions on multiparametic MRI using Mask R-CNN. Adv Radiat Oncol 5:473–481 Dai Z, Carver E, Liu C, Lee J, Feldman A, Zong W, Pantelic M, Elshaikh M, Wen N (2020) Segmentation of the prostatic gland and the intraprostatic lesions on multiparametic MRI using Mask R-CNN. Adv Radiat Oncol 5:473–481
8.
go back to reference Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision 2015 (ICCV 2015), pp 1440–1448 Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision 2015 (ICCV 2015), pp 1440–1448
9.
go back to reference Gordon AC, Saliken John C, Johns D, Owen Richardand Gray RR (1998) US-guided puncture of the internal jugular vein: complications and anatomic considerations. J Vasc Interv Radiol 9(2):333–338CrossRefPubMed Gordon AC, Saliken John C, Johns D, Owen Richardand Gray RR (1998) US-guided puncture of the internal jugular vein: complications and anatomic considerations. J Vasc Interv Radiol 9(2):333–338CrossRefPubMed
10.
go back to reference Groves L, Li N, Peters TM, Chen ECS (2019) Towards a mixed-reality first person point of view needle navigation system. In: Essert C, Zhou S, Yap PT, Khan A, Shen D, Liu T, Peters TM, LH Staib (eds) Medical image computing and computer assisted intervention (MICCAI 2019). Springer, Berlin, pp 245–253 Groves L, Li N, Peters TM, Chen ECS (2019) Towards a mixed-reality first person point of view needle navigation system. In: Essert C, Zhou S, Yap PT, Khan A, Shen D, Liu T, Peters TM, LH Staib (eds) Medical image computing and computer assisted intervention (MICCAI 2019). Springer, Berlin, pp 245–253
11.
go back to reference He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-CNN. In: 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988 He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-CNN. In: 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988
12.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778
13.
go back to reference Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral
14.
go back to reference Liu J, Li P (2018) A Mask R-CNN model with improved region proposal network for medical ultrasound image. In: Huang DS, Jo KH, Zhang XL (eds) Intelligent computing theories and application. Springer, Berlin, pp 26–33CrossRef Liu J, Li P (2018) A Mask R-CNN model with improved region proposal network for medical ultrasound image. In: Huang DS, Jo KH, Zhang XL (eds) Intelligent computing theories and application. Springer, Berlin, pp 26–33CrossRef
15.
go back to reference Lo A, Oehley M, Bartlett A, Adams D, Blyth P, Al-Ali S (2006) Anatomical variations of the common carotid artery bifurcation. ANZ J Surg 76(11):970–972CrossRefPubMed Lo A, Oehley M, Bartlett A, Adams D, Blyth P, Al-Ali S (2006) Anatomical variations of the common carotid artery bifurcation. ANZ J Surg 76(11):970–972CrossRefPubMed
16.
go back to reference Merritt RL, Hachadorian ME, Michaels K, Zevallos E, Mhayamaguru KM, Closser Z, Derr C (2018) The effect of head rotation on the relative vascular anatomy of the neck: implications for central venous access. J Emerg Trauma Shock 11(3):193–196PubMedPubMedCentral Merritt RL, Hachadorian ME, Michaels K, Zevallos E, Mhayamaguru KM, Closser Z, Derr C (2018) The effect of head rotation on the relative vascular anatomy of the neck: implications for central venous access. J Emerg Trauma Shock 11(3):193–196PubMedPubMedCentral
17.
go back to reference Niessen WJ, Bouma CJ, Vincken KL, Viergever MA (2000) Error metrics for quantitative evaluation of medical image segmentation. In: Klette R, Stiehl HS, Viergever MA, Vincken KL (eds) Performance characterization in computer vision. Springer, Berlin, pp 275–284 Niessen WJ, Bouma CJ, Vincken KL, Viergever MA (2000) Error metrics for quantitative evaluation of medical image segmentation. In: Klette R, Stiehl HS, Viergever MA, Vincken KL (eds) Performance characterization in computer vision. Springer, Berlin, pp 275–284
18.
go back to reference Prechelt L (2012) Early stopping—but when? In: Neural networks: tricks of the trade, 2nd ed. Springer, Berlin, pp 53–67 Prechelt L (2012) Early stopping—but when? In: Neural networks: tricks of the trade, 2nd ed. Springer, Berlin, pp 53–67
19.
go back to reference Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems, Curran Associates, Inc., pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems, Curran Associates, Inc., pp 91–99
20.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 9351. Springer, Berlin, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 9351. Springer, Berlin, pp 234–241
21.
go back to reference Saugel B, Scheeren TWL, Teboul JL (2017) Ultrasound-guided central venous catheter placement: a structured review and recommendations for clinical practice. Crit Care 21(1):225CrossRefPubMedPubMedCentral Saugel B, Scheeren TWL, Teboul JL (2017) Ultrasound-guided central venous catheter placement: a structured review and recommendations for clinical practice. Crit Care 21(1):225CrossRefPubMedPubMedCentral
23.
go back to reference Turba UC, Uflacker R, Hannegan C, Selby JB (2005) Anatomic relationship of the internaljugular vein and the common carotid artery applied to percutaneous transjugular procedures. CardioVasc Interv Radiol 28(3):303–306CrossRef Turba UC, Uflacker R, Hannegan C, Selby JB (2005) Anatomic relationship of the internaljugular vein and the common carotid artery applied to percutaneous transjugular procedures. CardioVasc Interv Radiol 28(3):303–306CrossRef
24.
go back to reference Ukwatta E, Awad J, Buchanan D, Parraga G, Fenster A (2012) Three-dimensional semi-automated segmentation of carotid atherosclerosis from three-dimensional ultrasound images. In: Medical imaging 2012: computer-aided diagnosis, vol 8315, p 83150O. International Society for Optics and Photonics Ukwatta E, Awad J, Buchanan D, Parraga G, Fenster A (2012) Three-dimensional semi-automated segmentation of carotid atherosclerosis from three-dimensional ultrasound images. In: Medical imaging 2012: computer-aided diagnosis, vol 8315, p 83150O. International Society for Optics and Photonics
25.
go back to reference Wang W, Liao X, Chen ECS, Moore J, Baxter JSH, Peters Terry M, Bainbridge D (2019) The effects of positioning on the volume/location of the internal jugular vein using 2-dimensional tracked ultrasound. J Cardiothor Vasc Anesth 34:920–925 Wang W, Liao X, Chen ECS, Moore J, Baxter JSH, Peters Terry M, Bainbridge D (2019) The effects of positioning on the volume/location of the internal jugular vein using 2-dimensional tracked ultrasound. J Cardiothor Vasc Anesth 34:920–925
27.
go back to reference Xie M, Li Y, Xue Y, Shafritz R, Rahimi SA, Ady JW, Roshan UW (2019) Vessel lumen segmentation in internal carotid artery ultrasounds with deep convolutional neural networks. In: 2019 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 2393–2398 Xie M, Li Y, Xue Y, Shafritz R, Rahimi SA, Ady JW, Roshan UW (2019) Vessel lumen segmentation in internal carotid artery ultrasounds with deep convolutional neural networks. In: 2019 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 2393–2398
28.
go back to reference Zhou R, Fenster A, Xia Y, Spence JD, Ding M (2019) Deep learning-based carotid media-adventitia and lumen-intima boundary segmentation from three-dimensional ultrasound images. Med Phys 46(7):mp.13581CrossRef Zhou R, Fenster A, Xia Y, Spence JD, Ding M (2019) Deep learning-based carotid media-adventitia and lumen-intima boundary segmentation from three-dimensional ultrasound images. Med Phys 46(7):mp.13581CrossRef
Metadata
Title
Automatic segmentation of the carotid artery and internal jugular vein from 2D ultrasound images for 3D vascular reconstruction
Authors
Leah A. Groves
Blake VanBerlo
Natan Veinberg
Abdulrahman Alboog
Terry M. Peters
Elvis C. S. Chen
Publication date
01-11-2020
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 11/2020
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02248-2

Other articles of this Issue 11/2020

International Journal of Computer Assisted Radiology and Surgery 11/2020 Go to the issue