Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 6/2019

Open Access 01-06-2019 | Ultrasound | Original Article

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention

Authors: Hongxu Yang, Caifeng Shan, Alexander F. Kolen, Peter H. N. de With

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 6/2019

Login to get access

Abstract

Purpose

Efficient image-based catheter localization in 3D US during cardiac interventions is highly desired, since it facilitates the operation procedure, reduces the patient risk and improves the outcome. Current image-based catheter localization methods are not efficient or accurate enough for real clinical use.

Methods

We propose a catheter localization method for 3D cardiac ultrasound (US). The catheter candidate voxels are first pre-selected by the Frangi vesselness filter with adaptive thresholding, after which a triplanar-based ConvNet is applied to classify the remaining voxels as catheter or not. We propose a Share-ConvNet for 3D US, which reduces the computation complexity by sharing a single ConvNet for all orthogonal slices. To boost the performance of ConvNet, we also employ two-stage training with weighted cross-entropy. Using the classified voxels, the catheter is localized by a model fitting algorithm.

Results

To validate our method, we have collected challenging ex vivo datasets. Extensive experiments show that the proposed method outperforms state-of-the-art methods and can localize the catheter with an average error of 2.1 mm in around 10 s per volume.

Conclusion

Our method can automatically localize the cardiac catheter in challenging 3D cardiac US images. The efficiency and accuracy localization of the proposed method are considered promising for catheter detection and localization during clinical interventions.
Literature
1.
go back to reference Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. In: International conference on medical image computing and computer-assisted intervention, Springer, Berlin, Heidelberg, pp 130–137 Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. In: International conference on medical image computing and computer-assisted intervention, Springer, Berlin, Heidelberg, pp 130–137
2.
go back to reference Uherčík M, Kybic J, Zhao Y, Cachard C, Liebgott H (2013) Line filtering for surgical tool localization in 3D ultrasound images. Comput Biol Med 43(12):2036–2045CrossRefPubMed Uherčík M, Kybic J, Zhao Y, Cachard C, Liebgott H (2013) Line filtering for surgical tool localization in 3D ultrasound images. Comput Biol Med 43(12):2036–2045CrossRefPubMed
3.
go back to reference Pourtaherian A, Scholten HJ, Kusters L, Zinger S, Mihajlovic N, Kolen AF, Zuo F, Ng GC, Korsten HH, de With PHN (2017) Medical instrument detection in 3-dimensional ultrasound data volumes. IEEE Trans Med Imaging 36(8):1664–1675CrossRefPubMed Pourtaherian A, Scholten HJ, Kusters L, Zinger S, Mihajlovic N, Kolen AF, Zuo F, Ng GC, Korsten HH, de With PHN (2017) Medical instrument detection in 3-dimensional ultrasound data volumes. IEEE Trans Med Imaging 36(8):1664–1675CrossRefPubMed
4.
go back to reference Yang H, Pourtaherian A, Shan C, Kolen AF, de With PHN (2018) Feature study on catheter detection in three-dimensional ultrasound. In: Medical imaging 2018: image-guided procedures, robotic interventions, and modeling, vol 10576, International Society for Optics and Photonics, p 105760V Yang H, Pourtaherian A, Shan C, Kolen AF, de With PHN (2018) Feature study on catheter detection in three-dimensional ultrasound. In: Medical imaging 2018: image-guided procedures, robotic interventions, and modeling, vol 10576, International Society for Optics and Photonics, p 105760V
5.
go back to reference Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Van Der Laak JA, Van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Van Der Laak JA, Van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed
6.
go back to reference Nie D, Zhang H, Adeli E, Liu L, Shen D (2016) 3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 212–220 Nie D, Zhang H, Adeli E, Liu L, Shen D (2016) 3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 212–220
7.
go back to reference Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5 D representation for lymph node detection using random sets of deep convolutional neural network observations. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 520–527 Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5 D representation for lymph node detection using random sets of deep convolutional neural network observations. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 520–527
8.
go back to reference Pourtaherian A, Zanjani FG, Zinger S, Mihajlovic N, Ng G, Korsten H (2017) Improving needle detection in 3D ultrasound using orthogonal-plane convolutional networks. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 610–618 Pourtaherian A, Zanjani FG, Zinger S, Mihajlovic N, Ng G, Korsten H (2017) Improving needle detection in 3D ultrasound using orthogonal-plane convolutional networks. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 610–618
9.
go back to reference Yang H, Shan C, Kolen AF, de With PHN (2018) Catheter detection in 3D ultrasound using triplanar-based convolutional neural networks. In: 2018 25th IEEE international conference on image processing (ICIP), IEEE, pp 371–375 Yang H, Shan C, Kolen AF, de With PHN (2018) Catheter detection in 3D ultrasound using triplanar-based convolutional neural networks. In: 2018 25th IEEE international conference on image processing (ICIP), IEEE, pp 371–375
10.
go back to reference Yang X, Yu L, Li S, Wang X, Wang N, Qin J, Ni D, Heng PA (2017) Towards automatic semantic segmentation in volumetric ultrasound. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 711–719 Yang X, Yu L, Li S, Wang X, Wang N, Qin J, Ni D, Heng PA (2017) Towards automatic semantic segmentation in volumetric ultrasound. In: International conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 711–719
11.
go back to reference Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, Van Riel SJ, Wille MMW, Naqibullah M, Sánchez CI, van Ginneken B (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169CrossRefPubMed Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, Van Riel SJ, Wille MMW, Naqibullah M, Sánchez CI, van Ginneken B (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169CrossRefPubMed
12.
go back to reference Yang H, Shan C, Pourtaherian A, Kolen AF, de With PHN (2019) Catheter segmentation in three-dimensional ultrasound images by feature fusion and model fitting. J Med Imaging 6(1):015001CrossRef Yang H, Shan C, Pourtaherian A, Kolen AF, de With PHN (2019) Catheter segmentation in three-dimensional ultrasound images by feature fusion and model fitting. J Med Imaging 6(1):015001CrossRef
Metadata
Title
Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention
Authors
Hongxu Yang
Caifeng Shan
Alexander F. Kolen
Peter H. N. de With
Publication date
01-06-2019
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 6/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-01960-y

Other articles of this Issue 6/2019

International Journal of Computer Assisted Radiology and Surgery 6/2019 Go to the issue