Skip to main content
Top
Published in: Langenbeck's Archives of Surgery 3/2015

01-04-2015 | How-I-Do-It article

Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy

Authors: Patrick Pessaux, Michele Diana, Luc Soler, Tullio Piardi, Didier Mutter, Jacques Marescaux

Published in: Langenbeck's Archives of Surgery | Issue 3/2015

Login to get access

Abstract

Background

Augmented reality (AR) in surgery consists in the fusion of synthetic computer-generated images (3D virtual model) obtained from medical imaging preoperative workup and real-time patient images in order to visualize unapparent anatomical details. The 3D model could be used for a preoperative planning of the procedure. The potential of AR navigation as a tool to improve safety of the surgical dissection is outlined for robotic hepatectomy.

Materials and methods

Three patients underwent a fully robotic and AR-assisted hepatic segmentectomy. The 3D virtual anatomical model was obtained using a thoracoabdominal CT scan with a customary software (VR-RENDER®, IRCAD). The model was then processed using a VR-RENDER® plug-in application, the Virtual Surgical Planning (VSP®, IRCAD), to delineate surgical resection planes including the elective ligature of vascular structures. Deformations associated with pneumoperitoneum were also simulated. The virtual model was superimposed to the operative field. A computer scientist manually registered virtual and real images using a video mixer (MX 70; Panasonic, Secaucus, NJ) in real time.

Results

Two totally robotic AR segmentectomy V and one segmentectomy VI were performed. AR allowed for the precise and safe recognition of all major vascular structures during the procedure. Total time required to obtain AR was 8 min (range 6–10 min). Each registration (alignment of the vascular anatomy) required a few seconds. Hepatic pedicle clamping was never performed. At the end of the procedure, the remnant liver was correctly vascularized. Resection margins were negative in all cases. The postoperative period was uneventful without perioperative transfusion.

Conclusions

AR is a valuable navigation tool which may enhance the ability to achieve safe surgical resection during robotic hepatectomy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Haidegger T, Sandor J, Benyo Z (2011) Surgery in space: the future of robotic telesurgery. Surg Endosc 25:681–690CrossRefPubMed Haidegger T, Sandor J, Benyo Z (2011) Surgery in space: the future of robotic telesurgery. Surg Endosc 25:681–690CrossRefPubMed
2.
go back to reference Marescaux J, Leroy J, Gagner M, Rubino F, Mutter D, Vix M, Butner SE, Smith MK (2001) Transatlantic robot-assisted telesurgery. Nature 413:379–380CrossRefPubMed Marescaux J, Leroy J, Gagner M, Rubino F, Mutter D, Vix M, Butner SE, Smith MK (2001) Transatlantic robot-assisted telesurgery. Nature 413:379–380CrossRefPubMed
3.
go back to reference Nicolau S, Soler L, Mutter D, Marescaux J (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20:189–201CrossRefPubMed Nicolau S, Soler L, Mutter D, Marescaux J (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20:189–201CrossRefPubMed
4.
go back to reference D’Agostino J, Diana M, Soler L, Vix M, Marescaux J (2012) 3D virtual neck exploration prior to parathyroidectomy. N Engl J Med D’Agostino J, Diana M, Soler L, Vix M, Marescaux J (2012) 3D virtual neck exploration prior to parathyroidectomy. N Engl J Med
5.
go back to reference Marescaux J, Clement JM, Tassetti V, Koehl C, Cotin S, Russier Y, Mutter D, Delingette H, Ayache N (1998) Virtual reality applied to hepatic surgery simulation: the next revolution. Ann Surg 228:627–634CrossRefPubMedCentralPubMed Marescaux J, Clement JM, Tassetti V, Koehl C, Cotin S, Russier Y, Mutter D, Delingette H, Ayache N (1998) Virtual reality applied to hepatic surgery simulation: the next revolution. Ann Surg 228:627–634CrossRefPubMedCentralPubMed
6.
go back to reference Gauss T, Merckx P, Brasher C, Kavafyan J, Le Bihan E, Aussilhou B, Belghiti J, Mantz J. (2013) Deviation from a preoperative surgical and anesthetic care plan is associated with increased risk of adverse intraoperative events in major abdominal surgery. Langenbecks Arch Surg 398:277–85 Gauss T, Merckx P, Brasher C, Kavafyan J, Le Bihan E, Aussilhou B, Belghiti J, Mantz J. (2013) Deviation from a preoperative surgical and anesthetic care plan is associated with increased risk of adverse intraoperative events in major abdominal surgery. Langenbecks Arch Surg 398:277–85
7.
go back to reference Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreatol Sci 18:506–509CrossRef Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreatol Sci 18:506–509CrossRef
8.
go back to reference Diana M, Pessaux P, Marescaux J (2014) New technologies for single-site robotic surgery in hepato-biliary-pancreatic surgery. J Hepatobiliary Pancreatol Sci 21:34–42CrossRef Diana M, Pessaux P, Marescaux J (2014) New technologies for single-site robotic surgery in hepato-biliary-pancreatic surgery. J Hepatobiliary Pancreatol Sci 21:34–42CrossRef
9.
go back to reference Bano J, Hostettler A, Nicolau SA, Cotin S, Doignon C, Wu HS, Huang MH, Soler L, Marescaux J (2012) Simulation of pneumoperitoneum for laparoscopic surgery planning. Med Image Comput Comput Assist Interv 15:91–98PubMed Bano J, Hostettler A, Nicolau SA, Cotin S, Doignon C, Wu HS, Huang MH, Soler L, Marescaux J (2012) Simulation of pneumoperitoneum for laparoscopic surgery planning. Med Image Comput Comput Assist Interv 15:91–98PubMed
10.
go back to reference D’Agostino J, Diana M, Vix M, Soler L, Marescaux J (2012) Three-dimensional virtual neck exploration before parathyroidectomy. N Engl J Med 367:1072–1073CrossRefPubMed D’Agostino J, Diana M, Vix M, Soler L, Marescaux J (2012) Three-dimensional virtual neck exploration before parathyroidectomy. N Engl J Med 367:1072–1073CrossRefPubMed
11.
go back to reference D’Agostino J, Wall J, Soler L, Vix M, Duh QY, Marescaux J (2013) Virtual neck exploration for parathyroid adenomas: a first step toward minimally invasive image-guided surgery. JAMA Surg 148:232–238, discussion 238CrossRefPubMed D’Agostino J, Wall J, Soler L, Vix M, Duh QY, Marescaux J (2013) Virtual neck exploration for parathyroid adenomas: a first step toward minimally invasive image-guided surgery. JAMA Surg 148:232–238, discussion 238CrossRefPubMed
12.
go back to reference Nam WH, Kang DG, Lee D, Lee JY, Ra JB (2012) Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching. Phys Med Biol 57:69–91CrossRefPubMed Nam WH, Kang DG, Lee D, Lee JY, Ra JB (2012) Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching. Phys Med Biol 57:69–91CrossRefPubMed
13.
go back to reference Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985CrossRefPubMed Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985CrossRefPubMed
14.
go back to reference Hostettler A, Nicolau SA, Remond Y, Marescaux J, Soler L (2010) A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 103:169–184CrossRefPubMed Hostettler A, Nicolau SA, Remond Y, Marescaux J, Soler L (2010) A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 103:169–184CrossRefPubMed
Metadata
Title
Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy
Authors
Patrick Pessaux
Michele Diana
Luc Soler
Tullio Piardi
Didier Mutter
Jacques Marescaux
Publication date
01-04-2015
Publisher
Springer Berlin Heidelberg
Published in
Langenbeck's Archives of Surgery / Issue 3/2015
Print ISSN: 1435-2443
Electronic ISSN: 1435-2451
DOI
https://doi.org/10.1007/s00423-014-1256-9

Other articles of this Issue 3/2015

Langenbeck's Archives of Surgery 3/2015 Go to the issue