Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 2/2018

01-02-2018 | Original Article

An automatic markerless registration method for neurosurgical robotics based on an optical camera

Authors: Fanle Meng, Fangwen Zhai, Bowei Zeng, Hui Ding, Guangzhi Wang

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 2/2018

Login to get access

Abstract

Purpose

Current markerless registration methods for neurosurgical robotics use the facial surface to match the robot space with the image space, and acquisition of the facial surface usually requires manual interaction and constrains the patient to a supine position. To overcome these drawbacks, we propose a registration method that is automatic and does not constrain patient position.

Methods

An optical camera attached to the robot end effector captures images around the patient’s head from multiple views. Then, high coverage of the head surface is reconstructed from the images through multi-view stereo vision. Since the acquired head surface point cloud contains color information, a specific mark that is manually drawn on the patient’s head prior to the capture procedure can be extracted to automatically accomplish coarse registration rather than using facial anatomic landmarks. Then, fine registration is achieved by registering the high coverage of the head surface without relying solely on the facial region, thus eliminating patient position constraints.

Results

The head surface was acquired by the camera with a good repeatability accuracy. The average target registration error of 8 different patient positions measured with targets inside a head phantom was \(1.39\pm 0.33\,\hbox {mm}\), while the mean surface registration error was \(0.35\,\hbox {mm}\).

Conclusion

The method proposed in this paper achieves automatic markerless registration in multiple patient positions and guarantees registration accuracy inside the head. This method provides a new approach for establishing the spatial relationship between the image space and the robot space.
Literature
1.
go back to reference Taylor RH, Menciassi A, Fichtinger G, Dario P (2008) Medical robotics and computer-integrated surgery. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, pp 1199–1222 Taylor RH, Menciassi A, Fichtinger G, Dario P (2008) Medical robotics and computer-integrated surgery. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, pp 1199–1222
2.
go back to reference Varma T, Eldridge P (2006) Use of the NeuroMate stereotactic robot in a frameless mode for functional neurosurgery. Int J Med Robot Comput Assist Surg 2(2):107–113CrossRef Varma T, Eldridge P (2006) Use of the NeuroMate stereotactic robot in a frameless mode for functional neurosurgery. Int J Med Robot Comput Assist Surg 2(2):107–113CrossRef
3.
go back to reference Bekelis K, Radwan TA, Desai A, Roberts DW (2012) Frameless robotically targeted stereotactic brain biopsy: feasibility, diagnostic yield, and safety: clinical article. J Neurosurg 116(5):1002–1006CrossRefPubMed Bekelis K, Radwan TA, Desai A, Roberts DW (2012) Frameless robotically targeted stereotactic brain biopsy: feasibility, diagnostic yield, and safety: clinical article. J Neurosurg 116(5):1002–1006CrossRefPubMed
4.
go back to reference Meng F, Ding H, Wang G (2014) A stereotaxic image-guided surgical robotic system for depth electrode insertion. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 6167–6170 Meng F, Ding H, Wang G (2014) A stereotaxic image-guided surgical robotic system for depth electrode insertion. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 6167–6170
5.
go back to reference Horn BK (1987) Closed-form solution of absolute orientation using unit quaternions. JOSA A 4(4):629–642CrossRef Horn BK (1987) Closed-form solution of absolute orientation using unit quaternions. JOSA A 4(4):629–642CrossRef
6.
go back to reference Joskowicz L, Shamir R, Freiman M, Shoham M, Zehavi E, Umansky F, Shoshan Y (2006) Image-guided system with miniature robot for precise positioning and targeting in keyhole neurosurgery. Comput Aided Surg 11(4):181–193CrossRefPubMed Joskowicz L, Shamir R, Freiman M, Shoham M, Zehavi E, Umansky F, Shoshan Y (2006) Image-guided system with miniature robot for precise positioning and targeting in keyhole neurosurgery. Comput Aided Surg 11(4):181–193CrossRefPubMed
7.
go back to reference Lefranc M, Capel C, Pruvot-Occean A-S, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2015) Frameless robotic stereotactic biopsies: a consecutive series of 100 cases. J Neurosurg 122(2):342–352CrossRefPubMed Lefranc M, Capel C, Pruvot-Occean A-S, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2015) Frameless robotic stereotactic biopsies: a consecutive series of 100 cases. J Neurosurg 122(2):342–352CrossRefPubMed
8.
go back to reference Shin S, Cho H, Yoon S, Park K, Kim Y, Park S, Kim L, Lee D (2015) Markerless surgical robotic system for intracerebral hemorrhage surgery. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 5272–5275 Shin S, Cho H, Yoon S, Park K, Kim Y, Park S, Kim L, Lee D (2015) Markerless surgical robotic system for intracerebral hemorrhage surgery. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 5272–5275
9.
go back to reference Raabe A, Krishnan R, Wolff R, Hermann E, Zimmermann M, Seifert V (2002) Laser surface scanning for patient registration in intracranial image-guided surgery. Neurosurgery 50(4):797–803CrossRefPubMed Raabe A, Krishnan R, Wolff R, Hermann E, Zimmermann M, Seifert V (2002) Laser surface scanning for patient registration in intracranial image-guided surgery. Neurosurgery 50(4):797–803CrossRefPubMed
10.
go back to reference Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256 Besl PJ, McKay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14(2):239–256
11.
go back to reference Medtech S (2010) Premarket notification 510 (K) submission rosa surgical device. Montpellier, France, pp 6–10 Medtech S (2010) Premarket notification 510 (K) submission rosa surgical device. Montpellier, France, pp 6–10
12.
go back to reference Shamir RR, Freiman M, Joskowicz L, Spektor S, Shoshan Y (2009) Surface-based facial scan registration in neuronavigation procedures: a clinical study: clinical article. J Neurosurg 111(6):1201–1206CrossRefPubMed Shamir RR, Freiman M, Joskowicz L, Spektor S, Shoshan Y (2009) Surface-based facial scan registration in neuronavigation procedures: a clinical study: clinical article. J Neurosurg 111(6):1201–1206CrossRefPubMed
13.
go back to reference Fan Y, Jiang D, Wang M, Song Z (2014) A new markerless patient-to-image registration method using a portable 3D scanner. Med Phys 41(10):101910-1–101910-13 Fan Y, Jiang D, Wang M, Song Z (2014) A new markerless patient-to-image registration method using a portable 3D scanner. Med Phys 41(10):101910-1–101910-13
14.
go back to reference Horaud R, Dornaika F (1995) Hand-eye calibration. Int J Robot Res 14(3):195–210CrossRef Horaud R, Dornaika F (1995) Hand-eye calibration. Int J Robot Res 14(3):195–210CrossRef
15.
go back to reference Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
16.
go back to reference Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRefPubMed Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRefPubMed
17.
go back to reference Chen Y, Medioni G (1992) Object modelling by registration of multiple range images. Image Vis Comput 10(3):145–155CrossRef Chen Y, Medioni G (1992) Object modelling by registration of multiple range images. Image Vis Comput 10(3):145–155CrossRef
18.
go back to reference Ledderose GJ, Hagedorn H, Spiegl K, Leunig A, Stelter K (2012) Image guided surgery of the lateral skull base: testing a new dental splint registration device. Comput Aided Surg 17(1):13–20CrossRefPubMed Ledderose GJ, Hagedorn H, Spiegl K, Leunig A, Stelter K (2012) Image guided surgery of the lateral skull base: testing a new dental splint registration device. Comput Aided Surg 17(1):13–20CrossRefPubMed
19.
go back to reference Lefranc M, Capel C, Pruvot AS, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2014) The impact of the reference imaging modality, registration method and intraoperative flat-panel computed tomography on the accuracy of the ROSA® stereotactic robot. Stereotact Funct Neurosurg 92(4):242–250CrossRefPubMed Lefranc M, Capel C, Pruvot AS, Fichten A, Desenclos C, Toussaint P, Le Gars D, Peltier J (2014) The impact of the reference imaging modality, registration method and intraoperative flat-panel computed tomography on the accuracy of the ROSA® stereotactic robot. Stereotact Funct Neurosurg 92(4):242–250CrossRefPubMed
20.
go back to reference Lee J-D, Huang C-H, Huang T-C, Hsieh H-Y, Lee S-T (2012) Medical augment reality using a markerless registration framework. Expert Syst Appl 39(5):5286–5294CrossRef Lee J-D, Huang C-H, Huang T-C, Hsieh H-Y, Lee S-T (2012) Medical augment reality using a markerless registration framework. Expert Syst Appl 39(5):5286–5294CrossRef
21.
go back to reference Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRefPubMed Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304CrossRefPubMed
22.
go back to reference Zeng B, Meng F, Ding H, Wang G (2017) A surgical robot with augmented reality visualization for stereoelectroencephalography electrode implantation. Int J Comput Assist Radiol Surg 12(8):1355–1368CrossRefPubMed Zeng B, Meng F, Ding H, Wang G (2017) A surgical robot with augmented reality visualization for stereoelectroencephalography electrode implantation. Int J Comput Assist Radiol Surg 12(8):1355–1368CrossRefPubMed
23.
go back to reference Deacon G, Harwood A, Holdback J, Maiwand D, Pearce M, Reid I, Street M, Taylor J (2010) The Pathfinder image-guided surgical robot. Proc Inst Mech Eng H 224(5):691–713CrossRefPubMed Deacon G, Harwood A, Holdback J, Maiwand D, Pearce M, Reid I, Street M, Taylor J (2010) The Pathfinder image-guided surgical robot. Proc Inst Mech Eng H 224(5):691–713CrossRefPubMed
24.
go back to reference Jerbic B, Nikolic G, Chudy D, Svaco M, Sekoranja B (2015) Robotic application in neurosurgery using intelligent visual and haptic interaction. Int J Simul Model 14(1):71–84 Jerbic B, Nikolic G, Chudy D, Svaco M, Sekoranja B (2015) Robotic application in neurosurgery using intelligent visual and haptic interaction. Int J Simul Model 14(1):71–84
25.
go back to reference Wei J, Wang T, Liu D (2011) A vision guided hybrid robotic prototype system for stereotactic surgery. Int J Med Robot Comput Assisted Surg 7(4):475–481CrossRef Wei J, Wang T, Liu D (2011) A vision guided hybrid robotic prototype system for stereotactic surgery. Int J Med Robot Comput Assisted Surg 7(4):475–481CrossRef
26.
go back to reference Meng C, Wang T, Chou W, Luan S, Zhang Y, Tian Z (2004) Remote surgery case: robot-assisted teleneurosurgery. In: 2004 IEEE international conference on robotics and automation, 2004. Proceedings. ICRA’04. IEEE, pp 819–823 Meng C, Wang T, Chou W, Luan S, Zhang Y, Tian Z (2004) Remote surgery case: robot-assisted teleneurosurgery. In: 2004 IEEE international conference on robotics and automation, 2004. Proceedings. ICRA’04. IEEE, pp 819–823
Metadata
Title
An automatic markerless registration method for neurosurgical robotics based on an optical camera
Authors
Fanle Meng
Fangwen Zhai
Bowei Zeng
Hui Ding
Guangzhi Wang
Publication date
01-02-2018
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 2/2018
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1675-5

Other articles of this Issue 2/2018

International Journal of Computer Assisted Radiology and Surgery 2/2018 Go to the issue