Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 5/2019

01-05-2019 | Laser | Original Article

Robotic laser osteotomy through penscriptive structured light visual servoing

Authors: Jamil Jivraj, Ryan Deorajh, Phillips Lai, Chaoliang Chen, Nhu Nguyen, Joel Ramjist, Victor X. D. Yang

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 5/2019

Login to get access

Abstract

Purpose

Planning osteotomies is a task that surgeons do as part of standard surgical workflow. This task, however, becomes more difficult and less intuitive when a robot is tasked with performing the osteotomy. In this study, we aim to provide a new method for surgeons to allow for highly intuitive trajectory planning, similar to the way an attending surgeon would instruct a junior.

Methods

Planning an osteotomy, especially during a craniotomy, is performed intraoperatively using a sterile surgical pen or pencil directly on the exposed bone surface. This paper presents a new method for generating osteotomy trajectories for a multi-DOF robotic manipulator using the same method and relaying the penscribed cut path to the manipulator as a three-dimensional trajectory. The penscribed cut path is acquired using structured light imaging, and detection, segmentation, optimization and orientation generation of the Cartesian trajectory are done autonomously after minimal user input.

Results

A 7-DOF manipulator (KUKA IIWA) is able to follow fully penscribed trajectories with sub-millimeter accuracy in the target plane and perpendicular to it (0.46 mm and 0.36 mm absolute mean error, respectively).

Conclusions

The robot is able to precisely follow cut paths drawn by the surgeon directly onto the exposed boney surface of the skull. We demonstrate through this study that current surgical workflow does not have to be drastically modified to introduce robotic technology in the operating room. We show that it is possible to guide a robot to perform an osteotomy in much the same way a senior surgeon would show a trainee by using a simple surgical pen or pencil.
Literature
1.
go back to reference Giraud JY, Villemin S, Darmana R, Cahuzac JP, Autefage A, Morucci JP (1991) Bone cutting. Clin Phys Physiol Meas 12(1):1CrossRefPubMed Giraud JY, Villemin S, Darmana R, Cahuzac JP, Autefage A, Morucci JP (1991) Bone cutting. Clin Phys Physiol Meas 12(1):1CrossRefPubMed
3.
go back to reference Vadera S, Chan A, Low T, Gill A, Morenkova A, Phiellip NM, Hermanowicz N, Hsu FP (2017) Frameless stereotactic robot-assisted subthalamic nucleus deep brain stimulation: case report. World Neurosurg 97:762-e11CrossRef Vadera S, Chan A, Low T, Gill A, Morenkova A, Phiellip NM, Hermanowicz N, Hsu FP (2017) Frameless stereotactic robot-assisted subthalamic nucleus deep brain stimulation: case report. World Neurosurg 97:762-e11CrossRef
4.
go back to reference Giger A, Jud C, Cattin P (2017) Respiratory motion compensation for the robot-guided laser osteotome. Int J Comput Assist Radiol Surg 12(10):1751–1762CrossRefPubMed Giger A, Jud C, Cattin P (2017) Respiratory motion compensation for the robot-guided laser osteotome. Int J Comput Assist Radiol Surg 12(10):1751–1762CrossRefPubMed
5.
go back to reference Burgner J (2010) Robot assisted laser osteotomy. KIT Scientific Publishing, Karlsruhe Burgner J (2010) Robot assisted laser osteotomy. KIT Scientific Publishing, Karlsruhe
6.
go back to reference Baek KW, Deibel W, Martinov D, Griessen M, Bruno A, Zeilhofer HF, Cattin P, Juergens P (2015) Clinical applicability of robot-guided contact-free laser osteotomy in cranio-maxillo-facial surgery: in-vitro simulation and in-vivo surgery in minipig mandibles. J Oral Maxillofac Surg 53(10):976–981CrossRef Baek KW, Deibel W, Martinov D, Griessen M, Bruno A, Zeilhofer HF, Cattin P, Juergens P (2015) Clinical applicability of robot-guided contact-free laser osteotomy in cranio-maxillo-facial surgery: in-vitro simulation and in-vivo surgery in minipig mandibles. J Oral Maxillofac Surg 53(10):976–981CrossRef
7.
go back to reference Deibel W, Schneider A, Augello M, Bruno AE, Juergens P, Cattin P (2015) A compact, efficient and light weight laser head for CARLO®: integration, performance and benefits. In: Novel optical systems design and optimization XVIII, vol 9579, International Society for Optics and Photonics Deibel W, Schneider A, Augello M, Bruno AE, Juergens P, Cattin P (2015) A compact, efficient and light weight laser head for CARLO®: integration, performance and benefits. In: Novel optical systems design and optimization XVIII, vol 9579, International Society for Optics and Photonics
8.
go back to reference Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) Results of CO2 robotic laser oseotomy in surgery with motion compensation. In: Photonic therapeutics and diagnostics VI, vol 7548, International Society for Optics and Photonics Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) Results of CO2 robotic laser oseotomy in surgery with motion compensation. In: Photonic therapeutics and diagnostics VI, vol 7548, International Society for Optics and Photonics
9.
go back to reference Xu D, andLinkun Wang ZJ, Tan M (2004) Features extraction for structured light image of welding seam with arc and splash disturbance. In: 8th International conference on control, automation, robotics and vision, Kunming, China, pp 1559–1563 Xu D, andLinkun Wang ZJ, Tan M (2004) Features extraction for structured light image of welding seam with arc and splash disturbance. In: 8th International conference on control, automation, robotics and vision, Kunming, China, pp 1559–1563
10.
go back to reference Xu D, Wang L, Tan M (2004) Image processing and visual control method for arc welding robot. In: International conference on robotics and biomimetics, Shenyang, pp 727–732 Xu D, Wang L, Tan M (2004) Image processing and visual control method for arc welding robot. In: International conference on robotics and biomimetics, Shenyang, pp 727–732
11.
go back to reference Xu D, Tan M, Li Y (2006) Visual control system for robotic welding. In: Industrial robotics theory modelling control, Pro Literatur Verlag, Austria Xu D, Tan M, Li Y (2006) Visual control system for robotic welding. In: Industrial robotics theory modelling control, Pro Literatur Verlag, Austria
12.
go back to reference Xu D, Tan M, Zhao X, Tu Z (2004) Seam tracking and visual control for robotic arc welding based on structured light stereovision. Int J Autom Comput 1:63–75CrossRef Xu D, Tan M, Zhao X, Tu Z (2004) Seam tracking and visual control for robotic arc welding based on structured light stereovision. Int J Autom Comput 1:63–75CrossRef
13.
go back to reference Yu Z, He Y, Xu Y, Chen H (2018) Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet. Int J Adv Manuf Technol 95(9–12):4449–4458CrossRef Yu Z, He Y, Xu Y, Chen H (2018) Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet. Int J Adv Manuf Technol 95(9–12):4449–4458CrossRef
14.
go back to reference Ye Z, Fang G, Chen S, Zou JJ (2012) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67:1987–1996CrossRef Ye Z, Fang G, Chen S, Zou JJ (2012) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67:1987–1996CrossRef
15.
go back to reference Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9):1413–1425CrossRef Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9):1413–1425CrossRef
16.
go back to reference Guha D, Gupta S, Fehlings MG, Yang V (2017) Optical topographic imaging for spinal intraoperative three-dimensional navigation in minimally invasive approaches: initial preclinical experience. Spine J 17(10):S254CrossRef Guha D, Gupta S, Fehlings MG, Yang V (2017) Optical topographic imaging for spinal intraoperative three-dimensional navigation in minimally invasive approaches: initial preclinical experience. Spine J 17(10):S254CrossRef
17.
go back to reference Sciavicco L, Siciliano B (2000) Modelling and control of robot manipulators, 2nd edn. Springer, BerlinCrossRef Sciavicco L, Siciliano B (2000) Modelling and control of robot manipulators, 2nd edn. Springer, BerlinCrossRef
18.
go back to reference Boomgaard RVD, Balen RV (1992) Computer vision, methods for fast morphological image transforms using bitmapped images. Gr Image Process Gr Models Image Process 54(3):254–258 Boomgaard RVD, Balen RV (1992) Computer vision, methods for fast morphological image transforms using bitmapped images. Gr Image Process Gr Models Image Process 54(3):254–258
19.
go back to reference Sobel I, Feldman G (1968) A \(3\times 3\) isotropic gradient operator for image processing. In: A talk at the Stanford artificial project, pp 271–272 Sobel I, Feldman G (1968) A \(3\times 3\) isotropic gradient operator for image processing. In: A talk at the Stanford artificial project, pp 271–272
20.
go back to reference Zill D, Cullen M (2006) Advanced engineering mathematics, 3rd edn. Jones & Bartlett Learning, Burlington Zill D, Cullen M (2006) Advanced engineering mathematics, 3rd edn. Jones & Bartlett Learning, Burlington
21.
go back to reference Jolliffe I (2002) Principal component analysis, series: Springer series in statistics, 2nd edn. Springer, New York Jolliffe I (2002) Principal component analysis, series: Springer series in statistics, 2nd edn. Springer, New York
22.
go back to reference Wiles A, Thompson D, Frantz D (2004) Accuracy assessment and interpretation for optical tracking systems. In: Proceedings of SPIE medical imaging 2004: visualization, image-guided procedures and display (SPIE), vol 5367, pp 421–432 Wiles A, Thompson D, Frantz D (2004) Accuracy assessment and interpretation for optical tracking systems. In: Proceedings of SPIE medical imaging 2004: visualization, image-guided procedures and display (SPIE), vol 5367, pp 421–432
23.
go back to reference Elfring R, de la Fuente M, Radermarcher K (2010) Assessment of optical localizer accuracy for computer aided surgery systems. Comput Aided Surg 15(1–3):1–12CrossRefPubMed Elfring R, de la Fuente M, Radermarcher K (2010) Assessment of optical localizer accuracy for computer aided surgery systems. Comput Aided Surg 15(1–3):1–12CrossRefPubMed
24.
go back to reference Dillon NP (2014) Preliminary testing of a compact bone-attached robot for otologic surgery. In: Medical imaging 2014: image-guided procedures, robotic interventions, and modeling, vol 9036, International Society for Optics and Photonics Dillon NP (2014) Preliminary testing of a compact bone-attached robot for otologic surgery. In: Medical imaging 2014: image-guided procedures, robotic interventions, and modeling, vol 9036, International Society for Optics and Photonics
25.
go back to reference Dillion NP, Balachandran R, Fitzpatrick JM, Siebold MA, Labadie RF, Wanna GB, Withrow TJ, Webster RJ (2015) A compact, bone-attached robot for mastoidectomy. J Med Devices 9(3):031003CrossRef Dillion NP, Balachandran R, Fitzpatrick JM, Siebold MA, Labadie RF, Wanna GB, Withrow TJ, Webster RJ (2015) A compact, bone-attached robot for mastoidectomy. J Med Devices 9(3):031003CrossRef
26.
go back to reference Gerber N, Bell B, Gavaghan K, Weisstanner C, Caversaccio M, Weber S (2014) Surgical planning tool for robotically assisted hearing aid implantation. Int J Comput Assist Radiol Surg 9(1):11–20CrossRefPubMed Gerber N, Bell B, Gavaghan K, Weisstanner C, Caversaccio M, Weber S (2014) Surgical planning tool for robotically assisted hearing aid implantation. Int J Comput Assist Radiol Surg 9(1):11–20CrossRefPubMed
27.
go back to reference Zagzoog N, Yang VX (2018) State of robotic mastoidectomy: literature review. World Neurosurg 116:347–351CrossRefPubMed Zagzoog N, Yang VX (2018) State of robotic mastoidectomy: literature review. World Neurosurg 116:347–351CrossRefPubMed
Metadata
Title
Robotic laser osteotomy through penscriptive structured light visual servoing
Authors
Jamil Jivraj
Ryan Deorajh
Phillips Lai
Chaoliang Chen
Nhu Nguyen
Joel Ramjist
Victor X. D. Yang
Publication date
01-05-2019
Publisher
Springer International Publishing
Keyword
Laser
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 5/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-01905-x

Other articles of this Issue 5/2019

International Journal of Computer Assisted Radiology and Surgery 5/2019 Go to the issue