Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 7/2020

01-07-2020 | Ultrasound | Original Article

Robust real-time bone surfaces segmentation from ultrasound using a local phase tensor-guided CNN

Authors: Puyang Wang, Michael Vives, Vishal M. Patel, Ilker Hacihaliloglu

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 7/2020

Login to get access

Abstract

Purpose

Automatic bone surfaces segmentation is one of the fundamental tasks of ultrasound (US)-guided computer-assisted orthopedic surgery procedures. However, due to various US imaging artifacts, manual operation of the transducer during acquisition, and different machine settings, many existing methods cannot deal with the large variations of the bone surface responses, in the collected data, without manual parameter selection. Even for fully automatic methods, such as deep learning-based methods, the problem of dataset bias causes networks to perform poorly on the US data that are different from the training set.

Methods

In this work, an intensity-invariant convolutional neural network (CNN) architecture is proposed for robust segmentation of bone surfaces from US data obtained from two different US machines with varying acquisition settings. The proposed CNN takes US image as input and simultaneously generates two intermediate output images, denoted as local phase tensor (LPT) and global context tensor (GCT), from two branches which are invariant to intensity variations. LPT and GCT are fused to generate the final segmentation map. In the training process, the LPT network branch is supervised by precalculated ground truth without manual annotation.

Results

The proposed method is evaluated on 1227 in vivo US scans collected using two US machines, including a portable handheld ultrasound scanner, by scanning various bone surfaces from 28 volunteers. Validation of proposed method on both US machines not only shows statistically significant improvements in cross-machine segmentation of bone surfaces compared to state-of-the-art methods but also achieves a computation time of 30 milliseconds per image, \(98.5\%\) improvement over state-of-the-art.

Conclusion

The encouraging results obtained in this initial study suggest that the proposed method is promising enough for further evaluation. Future work will include extensive validation of the method on new US data collected from various machines using different acquisition settings. We will also evaluate the potential of using the segmented bone surfaces as an input to a point set-based registration method.
Literature
1.
go back to reference Hacihaliloglu I (2017) Ultrasound imaging and segmentation of bone surfaces: a review. Technology 5(02):74–80CrossRef Hacihaliloglu I (2017) Ultrasound imaging and segmentation of bone surfaces: a review. Technology 5(02):74–80CrossRef
2.
go back to reference Yamauchi M, Kawaguchi R, Sugino S, Yamakage M, Honma E, Namiki A (2009) Ultrasound-aided unilateral epidural block for single lower-extremity pain. J Anesth 23(4):605–608CrossRef Yamauchi M, Kawaguchi R, Sugino S, Yamakage M, Honma E, Namiki A (2009) Ultrasound-aided unilateral epidural block for single lower-extremity pain. J Anesth 23(4):605–608CrossRef
3.
go back to reference Seitel A, Sojoudi S, Osborn J, Rasoulian A, Nouranian S, Lessoway VA, Rohling RN, Abolmaesumi P (2016) Ultrasound-guided spine anesthesia: feasibility study of a guidance system. Ultrasound Med Biol 42(12):3043–3049CrossRef Seitel A, Sojoudi S, Osborn J, Rasoulian A, Nouranian S, Lessoway VA, Rohling RN, Abolmaesumi P (2016) Ultrasound-guided spine anesthesia: feasibility study of a guidance system. Ultrasound Med Biol 42(12):3043–3049CrossRef
4.
go back to reference Anas EMA, Seitel A, Rasoulian A, John PS, Pichora D, Darras K, Wilson D, Lessoway VA, Hacihaliloglu I, Mousavi P, Rohling R, Abolmaesumi P (2015) Bone enhancement in ultrasound using local spectrum variations for guiding percutaneous scaphoid fracture fixation procedures. Int J Comput Assist Radiol Surg 10(6):959–969CrossRef Anas EMA, Seitel A, Rasoulian A, John PS, Pichora D, Darras K, Wilson D, Lessoway VA, Hacihaliloglu I, Mousavi P, Rohling R, Abolmaesumi P (2015) Bone enhancement in ultrasound using local spectrum variations for guiding percutaneous scaphoid fracture fixation procedures. Int J Comput Assist Radiol Surg 10(6):959–969CrossRef
5.
go back to reference Wang P, Patel VM, Hacihaliloglu I (2018) Simultaneous segmentation and classification of bone surfaces from ultrasound using a multi-feature guided CNN. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 134–142 Wang P, Patel VM, Hacihaliloglu I (2018) Simultaneous segmentation and classification of bone surfaces from ultrasound using a multi-feature guided CNN. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 134–142
6.
go back to reference Alsinan AZ, Patel VM, Hacihaliloglu I (2019) Automatic segmentation of bone surfaces from ultrasound using a filter-layer-guided CNN. Int J Comput Assist Radiol Surg 14(5):775–783 CrossRef Alsinan AZ, Patel VM, Hacihaliloglu I (2019) Automatic segmentation of bone surfaces from ultrasound using a filter-layer-guided CNN. Int J Comput Assist Radiol Surg 14(5):775–783 CrossRef
7.
go back to reference Villa M, Dardenne G, Nasan M, Letissier H, Hamitouche C, Stindel E (2018) FCN-based approach for the automatic segmentation of bone surfaces in ultrasound images. Int J Comput Assist Radiol Surg 13(11):1707–1716CrossRef Villa M, Dardenne G, Nasan M, Letissier H, Hamitouche C, Stindel E (2018) FCN-based approach for the automatic segmentation of bone surfaces in ultrasound images. Int J Comput Assist Radiol Surg 13(11):1707–1716CrossRef
8.
go back to reference Schumann S (2016) State of the art of ultrasound-based registration in computer assisted orthopedic interventions. In: Zheng G, Li S (eds) Computational radiology for orthopaedic interventions. Springer, Cham, pp 271–297 CrossRef Schumann S (2016) State of the art of ultrasound-based registration in computer assisted orthopedic interventions. In: Zheng G, Li S (eds) Computational radiology for orthopaedic interventions. Springer, Cham, pp 271–297 CrossRef
9.
go back to reference Hacihaliloglu I, Guy P, Hodgson AJ, Abugharbieh R (2015) Automatic extraction of bone surfaces from 3D ultrasound images in orthopaedic trauma cases. Int J Comput Assist Radiol Surg 10(8):1279–1287CrossRef Hacihaliloglu I, Guy P, Hodgson AJ, Abugharbieh R (2015) Automatic extraction of bone surfaces from 3D ultrasound images in orthopaedic trauma cases. Int J Comput Assist Radiol Surg 10(8):1279–1287CrossRef
10.
go back to reference Baka N, Leenstra S, van Walsum T (2017) Ultrasound aided vertebral level localization for lumbar surgery. IEEE Trans Med Imaging 36(10):2138–2147CrossRef Baka N, Leenstra S, van Walsum T (2017) Ultrasound aided vertebral level localization for lumbar surgery. IEEE Trans Med Imaging 36(10):2138–2147CrossRef
11.
go back to reference Hacihaliloglu I, Rasoulian A, Rohling RN, Abolmaesumi P (2014) Local phase tensor features for 3-D ultrasound to statistical shape+ pose spine model registration. IEEE Trans Med Imaging 33(11):2167–2179CrossRef Hacihaliloglu I, Rasoulian A, Rohling RN, Abolmaesumi P (2014) Local phase tensor features for 3-D ultrasound to statistical shape+ pose spine model registration. IEEE Trans Med Imaging 33(11):2167–2179CrossRef
12.
go back to reference Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd international conference on machine learning (ICML-15), pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd international conference on machine learning (ICML-15), pp 448–456
13.
go back to reference Nair V, Hinton GE (2010) Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814 Nair V, Hinton GE (2010) Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814
14.
go back to reference Hacihaliloglu I (2017) Localization of bone surfaces from ultrasound data using local phase information and signal transmission maps. In: International workshop and challenge on computational methods and clinical applications in musculoskeletal imaging. Springer, pp 1–11 Hacihaliloglu I (2017) Localization of bone surfaces from ultrasound data using local phase information and signal transmission maps. In: International workshop and challenge on computational methods and clinical applications in musculoskeletal imaging. Springer, pp 1–11
15.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241
16.
go back to reference Kingma D, Ba J (2015) Adam: a method for stochastic optimization. In: Proceedings of the international conference on learning representations (ICLR) Kingma D, Ba J (2015) Adam: a method for stochastic optimization. In: Proceedings of the international conference on learning representations (ICLR)
17.
go back to reference Pandey P, Patel H, Guy P, Hacihaliloglu I, Hodgson AJ (2019) Preliminary planning for a multi-institutional database for ultrasound bone segmentation. EPiC Ser Health Sci 3:297–300CrossRef Pandey P, Patel H, Guy P, Hacihaliloglu I, Hodgson AJ (2019) Preliminary planning for a multi-institutional database for ultrasound bone segmentation. EPiC Ser Health Sci 3:297–300CrossRef
Metadata
Title
Robust real-time bone surfaces segmentation from ultrasound using a local phase tensor-guided CNN
Authors
Puyang Wang
Michael Vives
Vishal M. Patel
Ilker Hacihaliloglu
Publication date
01-07-2020
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 7/2020
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02184-1

Other articles of this Issue 7/2020

International Journal of Computer Assisted Radiology and Surgery 7/2020 Go to the issue