Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 1/2017

01-01-2017 | Original Article

Robust colonoscope tracking method for colon deformations utilizing coarse-to-fine correspondence findings

Authors: Masahiro Oda, Hiroaki Kondo, Takayuki Kitasaka, Kazuhiro Furukawa, Ryoji Miyahara, Yoshiki Hirooka, Hidemi Goto, Nassir Navab, Kensaku Mori

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 1/2017

Login to get access

Abstract

Purpose

Polyps found during CT colonography can be removed by colonoscopic polypectomy. A colonoscope navigation system that navigates a physician to polyp positions while performing the colonoscopic polypectomy is required. Colonoscope tracking methods are essential for implementing colonoscope navigation systems. Previous colonoscope tracking methods have failed when the colon deforms during colonoscope insertions. This paper proposes a colonoscope tracking method that is robust against colon deformations.

Method

The proposed method generates a colon centerline from a CT volume and a curved line representing the colonoscope shape (colonoscope line) by using electromagnetic sensors. We find correspondences between points on a deformed colon centerline and colonoscope line by a landmark-based coarse correspondence finding and a length-based fine correspondence finding processes. Even if the coarse correspondence finding process fails to find some correspondences, which occurs with colon deformations, the fine correspondence finding process is able to find correct correspondences by using previously recorded line lengths.

Result

Experimental results using a colon phantom showed that the proposed method finds the colonoscope tip position with tracking errors smaller than 50 mm in most trials. A physician who specializes in gastroenterology commented that tracking errors smaller than 50 mm are acceptable. This is because polyps are observable from the colonoscope camera when positions of the colonoscope tip and polyps are closer than 50 mm.

Conclusions

We developed a colonoscope tracking method that is robust against deformations of the colon. Because the process was designed to consider colon deformations, the proposed method can track the colonoscope tip position even if the colon deforms.
Literature
1.
go back to reference Yoshida H (2005) Three-dimensional computer-aided diagnosis in CT colonography. Multidimensional Image Processing, Analysis, and Display: RSNA Categorical Course in Diagnostic Radiology Physics :237–251 Yoshida H (2005) Three-dimensional computer-aided diagnosis in CT colonography. Multidimensional Image Processing, Analysis, and Display: RSNA Categorical Course in Diagnostic Radiology Physics :237–251
2.
go back to reference Summers RM, Swift JA, Dwyer AJ, Choi R, Pickhardt PJ (2009) Normalized distance along the colon centerline: a method for correlating polyp location on ct colonography and optical colonoscopy. Am J Roentgenol 193(5):1296–1304CrossRef Summers RM, Swift JA, Dwyer AJ, Choi R, Pickhardt PJ (2009) Normalized distance along the colon centerline: a method for correlating polyp location on ct colonography and optical colonoscopy. Am J Roentgenol 193(5):1296–1304CrossRef
3.
go back to reference Peters T, Cleary K (2008) Image-guided interventions: technology and applications. Springer, GermanyCrossRef Peters T, Cleary K (2008) Image-guided interventions: technology and applications. Springer, GermanyCrossRef
4.
go back to reference Deligianni F, Chung A, Yang GZ (2005) Predictive camera tracking for bronchoscope simulation with condensation. Proc MICCAI 3749:910–916 Deligianni F, Chung A, Yang GZ (2005) Predictive camera tracking for bronchoscope simulation with condensation. Proc MICCAI 3749:910–916
5.
go back to reference Rai L, Helferty JP, Higgins WE (2008) Combined video tracking and image-video registration for continuous bronchoscopic guidance. Int J Comput Assist Radiol Surg 3:3–4 Rai L, Helferty JP, Higgins WE (2008) Combined video tracking and image-video registration for continuous bronchoscopic guidance. Int J Comput Assist Radiol Surg 3:3–4
6.
go back to reference Deguchi D, Mori K, Feuerstein M, Kitasaka T, Maurer CR Jr, Suenaga Y, Takabatake H, Mori M, Natori H (2009) Selective image similarity measure for bronchoscope tracking based on image registration. Med Image Anal 3(14):621–633CrossRef Deguchi D, Mori K, Feuerstein M, Kitasaka T, Maurer CR Jr, Suenaga Y, Takabatake H, Mori M, Natori H (2009) Selective image similarity measure for bronchoscope tracking based on image registration. Med Image Anal 3(14):621–633CrossRef
7.
go back to reference Gildea TR, Mazzone PJ, Karnak D, Meziane M, Mehta A (2006) Electromagnetic navigation diagnostic bronchoscopy: a prospective study. Am J Respir Crit Care Med 174(9):982–989CrossRefPubMedPubMedCentral Gildea TR, Mazzone PJ, Karnak D, Meziane M, Mehta A (2006) Electromagnetic navigation diagnostic bronchoscopy: a prospective study. Am J Respir Crit Care Med 174(9):982–989CrossRefPubMedPubMedCentral
8.
go back to reference Schwarz Y, Greif J, Becker H, Ernst A, Metha A (2006) Real-time electromagnetic navigation bronchoscopy to peripheral lung lesions using overlaid CT images: the first human study. Chest 129(4):988–994 Schwarz Y, Greif J, Becker H, Ernst A, Metha A (2006) Real-time electromagnetic navigation bronchoscopy to peripheral lung lesions using overlaid CT images: the first human study. Chest 129(4):988–994
9.
go back to reference Mori K, Deguchi D, Akiyama K, Kitasaka T, Mauler CR Jr, Suenaga Y, Takabatake H, Mori M, Natori H (2005) Hybrid bronchoscope tracking using a magnetic tracking sensor and image registration. Med Image Comput Comput Assist Interv (MICCAI) 3750:543–550 Mori K, Deguchi D, Akiyama K, Kitasaka T, Mauler CR Jr, Suenaga Y, Takabatake H, Mori M, Natori H (2005) Hybrid bronchoscope tracking using a magnetic tracking sensor and image registration. Med Image Comput Comput Assist Interv (MICCAI) 3750:543–550
10.
go back to reference Luo X, Wan Y, He X, Mori K (2015) Observation-driven adaptive differential evolution and its application to accurate and smooth bronchoscope three-dimensional motion tracking. Med Image Anal 24:282–296 Luo X, Wan Y, He X, Mori K (2015) Observation-driven adaptive differential evolution and its application to accurate and smooth bronchoscope three-dimensional motion tracking. Med Image Anal 24:282–296
11.
go back to reference Liu J, Subramanian KR, Yoo TS (2013) An optical flow approach to tracking colonoscopy video. Comput Med Imaging Graph 37(3):207–223CrossRefPubMed Liu J, Subramanian KR, Yoo TS (2013) An optical flow approach to tracking colonoscopy video. Comput Med Imaging Graph 37(3):207–223CrossRefPubMed
12.
go back to reference Ching LY, Moller K (2010) Non-radiological colonoscope tracking image guided colonoscopy using commercially available electromagnetic tracking system. In: IEEE conference on robotics automation and mechatronics (RAM), pp 62–67 Ching LY, Moller K (2010) Non-radiological colonoscope tracking image guided colonoscopy using commercially available electromagnetic tracking system. In: IEEE conference on robotics automation and mechatronics (RAM), pp 62–67
13.
go back to reference Fukuzawa M, Uematsu J, Kono S, Suzuki S, Sato T, Yagi N, Tsuji Y, Yagi K, Kusano C, Gotoda T, Kawai T, Moriyasu F (2015) Clinical impact of endoscopy position detection unit (UPD-3) for a non-sedated colonoscopy. World J Gastroenterol 21(16):4903–4910CrossRefPubMedPubMedCentral Fukuzawa M, Uematsu J, Kono S, Suzuki S, Sato T, Yagi N, Tsuji Y, Yagi K, Kusano C, Gotoda T, Kawai T, Moriyasu F (2015) Clinical impact of endoscopy position detection unit (UPD-3) for a non-sedated colonoscopy. World J Gastroenterol 21(16):4903–4910CrossRefPubMedPubMedCentral
14.
go back to reference Oda M, Acar B, Furukawa K, Kitasaka T, Suenaga Y, Navab N, Mori K (2013) Colonoscope tracking method based on line registration using CT images and electromagnetic sensors. Int J Comput Assist Radiol Surg 8(1):S349–S351 Oda M, Acar B, Furukawa K, Kitasaka T, Suenaga Y, Navab N, Mori K (2013) Colonoscope tracking method based on line registration using CT images and electromagnetic sensors. Int J Comput Assist Radiol Surg 8(1):S349–S351
15.
go back to reference Oda M, Kondo H, Kitasaka T, Furukawa K, Miyahara R, Hirooka Y, Goto H, Navab N, Mori K (2014) Colonoscope navigation system using colonoscope tracking method based on line registration. In: Proceedings of SPIE, pp 9036:903626-1–7 Oda M, Kondo H, Kitasaka T, Furukawa K, Miyahara R, Hirooka Y, Goto H, Navab N, Mori K (2014) Colonoscope navigation system using colonoscope tracking method based on line registration. In: Proceedings of SPIE, pp 9036:903626-1–7
16.
go back to reference Kondo H, Oda M, Furukawa K, Miyahara R, Hirooka Y, Goto H, Kitasaka T, Mori K (2014) Development of marker-free estimation method of colonoscope tip position using electromagnetic sensors and CT volumes. Int J Comput Assist Radiol Surg 9(1):S11–S12CrossRef Kondo H, Oda M, Furukawa K, Miyahara R, Hirooka Y, Goto H, Kitasaka T, Mori K (2014) Development of marker-free estimation method of colonoscope tip position using electromagnetic sensors and CT volumes. Int J Comput Assist Radiol Surg 9(1):S11–S12CrossRef
17.
go back to reference Saito T, Toriwaki J (1995) A sequential thinning algorithm for three dimensional digital pictures using the Euclidean distance transformation. In: Proceedings of 9th scandinavian conference on image analysis (SCIA), pp 507–516 Saito T, Toriwaki J (1995) A sequential thinning algorithm for three dimensional digital pictures using the Euclidean distance transformation. In: Proceedings of 9th scandinavian conference on image analysis (SCIA), pp 507–516
18.
go back to reference Oda M, Hayashi Y, Kitasaka T, Mori K, Suenaga Y (2006) A method for generating virtual unfolded view of colon using spring model. In: Proceedings of SPIE, pp 6143:61431C-1–12 Oda M, Hayashi Y, Kitasaka T, Mori K, Suenaga Y (2006) A method for generating virtual unfolded view of colon using spring model. In: Proceedings of SPIE, pp 6143:61431C-1–12
19.
go back to reference Chen ECS, Fowler SA, Hookey LC, Ellis RE (2010) Representing flexible endoscope shapes with Hermite splines. In: Proceedings of SPIE, pp 7625:76251D-1–7 Chen ECS, Fowler SA, Hookey LC, Ellis RE (2010) Representing flexible endoscope shapes with Hermite splines. In: Proceedings of SPIE, pp 7625:76251D-1–7
20.
go back to reference Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14:239–256CrossRef Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14:239–256CrossRef
Metadata
Title
Robust colonoscope tracking method for colon deformations utilizing coarse-to-fine correspondence findings
Authors
Masahiro Oda
Hiroaki Kondo
Takayuki Kitasaka
Kazuhiro Furukawa
Ryoji Miyahara
Yoshiki Hirooka
Hidemi Goto
Nassir Navab
Kensaku Mori
Publication date
01-01-2017
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 1/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1456-6

Other articles of this Issue 1/2017

International Journal of Computer Assisted Radiology and Surgery 1/2017 Go to the issue