Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 6/2015

01-06-2015 | Original Article

Automatic bone detection and soft tissue aware ultrasound–CT registration for computer-aided orthopedic surgery

Authors: Wolfgang Wein, Athanasios Karamalis, Adrian Baumgartner, Nassir Navab

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 6/2015

Login to get access

Abstract

Purpose

The transfer of preoperative CT data into the tracking system coordinates within an operating room is of high interest for computer-aided orthopedic surgery. In this work, we introduce a solution for intra-operative ultrasound–CT registration of bones.

Methods

We have developed methods for fully automatic real-time bone detection in ultrasound images and global automatic registration to CT. The bone detection algorithm uses a novel bone-specific feature descriptor and was thoroughly evaluated on both in-vivo and ex-vivo data. A global optimization strategy aligns the bone surface, followed by a soft tissue aware intensity-based registration to provide higher local registration accuracy.

Results

We evaluated the system on femur, tibia and fibula anatomy in a cadaver study with human legs, where magnetically tracked bone markers were implanted to yield ground truth information. An overall median system error of \(3.7\) mm was achieved on 11 datasets.

Conclusion

Global and fully automatic registration of bones aquired with ultrasound to CT is feasible, with bone detection and tracking operating in real time for immediate feedback to the surgeon.
Literature
1.
go back to reference Barratt D, Penney G, Chan C, Slomczykowski M, Carter T, Edwards P, Hawkes D (2006) Self-calibrating 3D-ultrasound-based bone registration for minimally invasive orthopedic surgery. IEEE Trans Med Imag 25:312–323CrossRef Barratt D, Penney G, Chan C, Slomczykowski M, Carter T, Edwards P, Hawkes D (2006) Self-calibrating 3D-ultrasound-based bone registration for minimally invasive orthopedic surgery. IEEE Trans Med Imag 25:312–323CrossRef
2.
go back to reference Beitzel J, Ahmadi SA, Karamalis A, Wein W, Navab N (2012) Ultrasound bone detection using patient-specific CT prior. In: 34. International conference of the IEEE engineering in medicine and biology society (EMBC), pp 2664–2667 Beitzel J, Ahmadi SA, Karamalis A, Wein W, Navab N (2012) Ultrasound bone detection using patient-specific CT prior. In: 34. International conference of the IEEE engineering in medicine and biology society (EMBC), pp 2664–2667
3.
go back to reference Brounstein A, Hacihaliloglu I, Guy P, Hodgson A, Abugharbieh R (2011) Towards real-time 3D US to CT bone image registration using phase and curvature feature based GMM matching. In: Medical image computing and computer-assisted intervention, MICCAI, pp 235–242 Brounstein A, Hacihaliloglu I, Guy P, Hodgson A, Abugharbieh R (2011) Towards real-time 3D US to CT bone image registration using phase and curvature feature based GMM matching. In: Medical image computing and computer-assisted intervention, MICCAI, pp 235–242
4.
go back to reference Gill S, Abolmaesumi P, Fichtinger G, Boisvert J, Pichora D, Borshneck D, Mousavi P (2012) Biomechanically constrained groupwise ultrasound to CT registration of the lumbar spine. Med Image Anal 16(3):662–674CrossRefPubMed Gill S, Abolmaesumi P, Fichtinger G, Boisvert J, Pichora D, Borshneck D, Mousavi P (2012) Biomechanically constrained groupwise ultrasound to CT registration of the lumbar spine. Med Image Anal 16(3):662–674CrossRefPubMed
5.
go back to reference Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28(11):1768–1783CrossRefPubMed Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28(11):1768–1783CrossRefPubMed
6.
go back to reference Hacihaliloglu I, Abugharbieh R, Hodgson A, Rohling R (2008) Bone segmentation and fracture detection in ultrasound using 3D local phase features. In: Medical image computing and computer-assisted intervention, MICCAI, pp 287–295 Hacihaliloglu I, Abugharbieh R, Hodgson A, Rohling R (2008) Bone segmentation and fracture detection in ultrasound using 3D local phase features. In: Medical image computing and computer-assisted intervention, MICCAI, pp 287–295
7.
go back to reference Hacihaliloglu I, Brounstein A, Guy P, Hodgson A, Abugharbieh R (2012) 3D ultrasound–CT registration in orthopaedic trauma using GMM registration with optimized particle simulation-based data reduction. In: Medical image computing and computer-assisted intervention, MICCAI, pp 82–89 Hacihaliloglu I, Brounstein A, Guy P, Hodgson A, Abugharbieh R (2012) 3D ultrasound–CT registration in orthopaedic trauma using GMM registration with optimized particle simulation-based data reduction. In: Medical image computing and computer-assisted intervention, MICCAI, pp 82–89
8.
go back to reference Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady SM, Schnabel JA (2012) Mind: modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16(7):1423–1435CrossRefPubMed Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady SM, Schnabel JA (2012) Mind: modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16(7):1423–1435CrossRefPubMed
9.
go back to reference Jain AK, Taylor RH (2004) Understanding bone responses in B-mode ultrasound images and automatic bone surface extraction using a bayesian probabilistic framework. In: Proceedings of SPIE medical imaging: ultrasonic imaging and signal processing Jain AK, Taylor RH (2004) Understanding bone responses in B-mode ultrasound images and automatic bone surface extraction using a bayesian probabilistic framework. In: Proceedings of SPIE medical imaging: ultrasonic imaging and signal processing
10.
go back to reference Jesorsky O, Kirchberg K, Frischholz R (2001) Robust face detection using the hausdorff distance. In: Proceedings of third international conference on audio- and video-based biometric person authentication, pp 90–95 Jesorsky O, Kirchberg K, Frischholz R (2001) Robust face detection using the hausdorff distance. In: Proceedings of third international conference on audio- and video-based biometric person authentication, pp 90–95
11.
go back to reference Kaelo P, Ali MM (2006) Some variants of the controlled random search algorithm for global optimization. J Optim Theory Appl 130:253–264CrossRef Kaelo P, Ali MM (2006) Some variants of the controlled random search algorithm for global optimization. J Optim Theory Appl 130:253–264CrossRef
12.
go back to reference Karamalis A, Wein W, Klein T, Navab N (2012) Ultrasound confidence maps using random walks. Med Image Anal 16(6):1101–1112CrossRefPubMed Karamalis A, Wein W, Klein T, Navab N (2012) Ultrasound confidence maps using random walks. Med Image Anal 16(6):1101–1112CrossRefPubMed
13.
go back to reference Kowal J, Amstutz C, Langlotz F, Talib H, Ballester MG (2007) Automated bone contour detection in ultrasound B-mode images for minimally invasive registration in computer-assisted surgery—an in vitro evaluation. Int J Med Robot Comput Assist Surg (MRCAS) 3(4):341–348CrossRef Kowal J, Amstutz C, Langlotz F, Talib H, Ballester MG (2007) Automated bone contour detection in ultrasound B-mode images for minimally invasive registration in computer-assisted surgery—an in vitro evaluation. Int J Med Robot Comput Assist Surg (MRCAS) 3(4):341–348CrossRef
14.
go back to reference Penney G, Barratt D, Chan C, Slomczykowski M, Carter T, Edwards P, Hawkes D (2006) Cadaver validation of intensity-based ultrasound to CT registration. Med Image Anal 10:385395CrossRef Penney G, Barratt D, Chan C, Slomczykowski M, Carter T, Edwards P, Hawkes D (2006) Cadaver validation of intensity-based ultrasound to CT registration. Med Image Anal 10:385395CrossRef
15.
go back to reference Penney G, Blackall J, Hamady M, Sabharwal T, Adam A, Hawkes D (2004) Registration of freehand 3D ultrasound and magnetic resonance liver images. Med Image Anal 8(1):81–91CrossRefPubMed Penney G, Blackall J, Hamady M, Sabharwal T, Adam A, Hawkes D (2004) Registration of freehand 3D ultrasound and magnetic resonance liver images. Med Image Anal 8(1):81–91CrossRefPubMed
16.
go back to reference Roche A, Pennec X, Malandain G, Ayache N (2001) Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information. IEEE Trans Med Imag 20(10):1038–1049CrossRef Roche A, Pennec X, Malandain G, Ayache N (2001) Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information. IEEE Trans Med Imag 20(10):1038–1049CrossRef
17.
go back to reference Wachinger C, Navab N (2012) Entropy and Laplacian images: structural representations for multi-modal registration. Med Image Anal 16(1):1–17CrossRefPubMed Wachinger C, Navab N (2012) Entropy and Laplacian images: structural representations for multi-modal registration. Med Image Anal 16(1):1–17CrossRefPubMed
18.
go back to reference Wein W, Brunke S, Khamene A, Callstrom M, Navab N (2008) Automatic CT–ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12:577–585CrossRefPubMed Wein W, Brunke S, Khamene A, Callstrom M, Navab N (2008) Automatic CT–ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12:577–585CrossRefPubMed
Metadata
Title
Automatic bone detection and soft tissue aware ultrasound–CT registration for computer-aided orthopedic surgery
Authors
Wolfgang Wein
Athanasios Karamalis
Adrian Baumgartner
Nassir Navab
Publication date
01-06-2015
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 6/2015
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1208-z

Other articles of this Issue 6/2015

International Journal of Computer Assisted Radiology and Surgery 6/2015 Go to the issue

Editorial

Preface