Top

Published in:

01-12-2020 | Laparoscopy | New Technology

A case series study of augmented reality in laparoscopic liver resection with a deformable preoperative model

Authors: Le Roy Bertrand, Mourad Abdallah, Yamid Espinel, Lilian Calvet, Bruno Pereira, Erol Ozgur, Denis Pezet, Emmanuel Buc, Adrien Bartoli

Published in: Surgical Endoscopy | Issue 12/2020

Abstract

Background

Previous work in augmented reality (AR) guidance in monocular laparoscopic hepatectomy requires the surgeon to manually overlay a rigid preoperative model onto a laparoscopy image. This may be fairly inaccurate because of significant liver deformation. We have proposed a technique which overlays a deformable preoperative model semi-automatically onto a laparoscopic image using a new software called Hepataug. The aim of this study is to show the feasibility of Hepataug to perform AR with a deformable model in laparoscopic hepatectomy.

Methods

We ran Hepataug during the procedures, as well as the usual means of laparoscopic ultrasonography (LUS) and visual inspection of the preoperative CT or MRI. The primary objective was to assess the feasibility of Hepataug, in terms of minimal disruption of the surgical workflow. The secondary objective was to assess the potential benefit of Hepataug, by subjective comparison with LUS.

Results

From July 2017 to March 2019, 17 consecutive patients were included in this study. AR was feasible in all procedures, with good correlation with LUS. However, for 2 patients, LUS did not reveal the location of the tumors. Hepataug gave a prediction of the tumor locations, which was confirmed and refined by careful inspection of the preoperative CT or MRI.

Conclusion

Hepataug showed a minimal disruption of the surgical workflow and can thus be feasibly used in real hepatectomy procedures. Thanks to its new mechanism of semi-automatic deformable alignment, Hepataug also showed a good agreement with LUS and visual CT or MRI inspection in subsurface tumor localization. Importantly, Hepataug yields reproducible results. It is easy to use and could be deployed in any existing operating room. Nevertheless, comparative prospective studies are needed to study its efficacy.

Muhe E (1991) Laparoscopic cholecystectomy. Z Gastroenterol Verh 26:204–206PubMed

Cheung TT, Poon RT, Yuen WK, Chok KS, Jenkins CR, Chan SC et al (2013) Long-term survival analysis of pure laparoscopic versus open hepatectomy for hepatocellular carcinoma in patients with cirrhosis: a single-center experience. Ann Surg 257(3):506–511CrossRefPubMed

Fuks D, Cauchy F, Ftériche S, Nomi T, Schwarz L, Dokmak S, Scatton O, Fusco G, Belghiti J, Gayet B, Soubrane O (2016) Laparoscopy decreases pulmonary complications in patients undergoing major liver resection: a propensity score analysis. Ann Surg 263(2):353–361CrossRefPubMed

Buell JF, Cherqui D, Geller DA, O'Rourke N, Iannitti D, Dagher I et al (2009) The international position on laparoscopic liver surgery: the Louisville Statement, 2008. Ann Surg 250(5):825–830CrossRefPubMed

Yamamoto M, Kobayashi T, Oshita A, Abe T, Kohashi T, Onoe T et al (2019) Laparoscopic versus open limited liver resection for hepatocellular carcinoma with liver cirrhosis: a propensity score matching study with the Hiroshima Surgical study group of Clinical Oncology (HiSCO). Surg Endosc. https://doi.org/10.1007/s00464-019-07302-yCrossRefPubMed

Özgür E, Koo B, Le Roy B, Buc E, Bartoli A (2018) Preoperative liver registration for augmented monocular laparoscopy using backward-forward biomechanical simulation. Int J Comput Assist Radiol Surg 13(10):1629–1640CrossRefPubMed

Bourdel N, Collins T, Pizarro D, Debize C, Grémeau AS, Bartoli A et al (2017) Use of augmented reality in laparoscopic gynecology to visualize myomas. Fertil Steril 107(3):737–739. https://doi.org/10.1016/j.fertnstert.2016.12.016CrossRefPubMed

Espinel Y, Özgür E, Calvet L, Le Roy B, Buc E, Bartoli A (2020) Combining Visual Cues with Interactions for 3D–2D Registration in Liver Laparoscopy. Ann Biomed Eng. https://doi.org/10.1007/s10439-020-02479-zCrossRefPubMed

Pessaux P, Diana M, Soler L, Piardi T, Mutter D, Marescaux J (2014) Robotic duodenopancreatectomy assisted with augmented reality and real-time fluorescence guidance. Surg Endosc 28(8):2493–2498. https://doi.org/10.1007/s00464-014-3465-2CrossRefPubMed

10.

Marescaux J, Rubino F, Arenas M, Mutter D, Soler L (2004) Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 292(18):2214–2215PubMed

11.

Pessaux P, Diana M, Soler L, Piardi T, Mutter D, Marescaux J (2015) Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy. Langenbecks Arch Surg 400(3):381–385CrossRefPubMed

12.

Nicolau S, Soler L, Mutter D, Marescaux J (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20(3):189–201CrossRefPubMed

13.

Mutter D, Soler L, Marescaux J (2010) Recent advances in liver imaging. Expert Rev Gastroenterol Hepatol 4(5):613–621. https://doi.org/10.1586/egh.10.57CrossRef

14.

Ntourakis D, Memeo R, Soler L, Marescaux J, Mutter D, Pessaux P (2016) Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience. World J Surg 40(2):419–426CrossRefPubMed

15.

Phutane P, Buc E, Poirot K, Ozgur E, Pezet D, Bartoli A, Le Roy B (2018) Preliminary trial of augmented reality performed on a laparoscopic left hepatectomy. Surg Endosc 32(1):514–515. https://doi.org/10.1007/s00464-017-5733-4CrossRefPubMed

16.

Le Roy B, Ozgur E, Koo B, Buc E, Bartoli A (2019) Augmented reality guidance in laparoscopic hepatectomy with deformable semi-automatic computed tomography alignment (with video). J Visc Surg 156(3):261–262. https://doi.org/10.1016/j.jviscsurg.2019.01.009CrossRefPubMed

17.

Paulus CJ, Haouchine N, Kong SH, Soares RV, Cazier D, Cotin S (2017) Handling topological changes during elastic registration: application to augmented reality in laparoscopic surgery. Int J Comput Assist Radiol Surg 12(3):461–470. https://doi.org/10.1007/s11548-016-1502-4CrossRefPubMed

18.

Clements LW, Collins JA, Weis JA, Simpson AL, Kingham TP, Jarnagin WR, Miga MI (2017) Deformation correction for image guided liver surgery: an intraoperative fidelity assessment. Surgery 162(3):537–547. https://doi.org/10.1016/j.surg.2017.04.020CrossRefPubMed

19.

Ferrari V, Viglialoro RM, Nicoli P, Cutolo F, Condino S, Carbone M et al (2016) Augmented reality visualization of deformable tubular structures for surgical simulation. Int J Med Robot 12(2):231–240CrossRefPubMed

20.

Bernhardt S, Nicolau SA, Agnus V, Soler L, Doignon C, Marescaux J (2016) Automatic localization of endoscope in intraoperative CT image: a simple approach to augmented reality guidance in laparoscopic surgery. Med Image Anal 30:130–143. https://doi.org/10.1016/j.media.2016.01.008CrossRefPubMed

21.

Plantefève R, Peterlik I, Haouchine N, Cotin S (2016) Patient-specific biomechanical modeling for guidance during minimally-invasive hepatic surgery. Ann Biomed Eng 44(1):139–153. https://doi.org/10.1007/s10439-015-1419-zCrossRefPubMed

Title: A case series study of augmented reality in laparoscopic liver resection with a deformable preoperative model
Authors: Le Roy Bertrand
Mourad Abdallah
Yamid Espinel
Lilian Calvet
Bruno Pereira
Erol Ozgur
Denis Pezet
Emmanuel Buc
Adrien Bartoli
Publication date: 01-12-2020
Publisher: Springer US
Keywords: Laparoscopy
Liver Resection
Liver Resection
Published in: Surgical Endoscopy / Issue 12/2020
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI: https://doi.org/10.1007/s00464-020-07815-x

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

A case series study of augmented reality in laparoscopic liver resection with a deformable preoperative model

Abstract

Background

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 12/2020

Size-dependent differences in the proximal remnant stomach: how much does a small remnant stomach after subtotal gastrectomy work?

Efficacy of artificial pneumothorax under two-lung ventilation in video-assisted thoracoscopic surgery for esophageal cancer

The COVID-19 reset: lessons from the pandemic on Burnout and the Practice of Surgery

What affects the prognosis of NOMI patients? Analysis of clinical data and CT findings

Anatomical study of the left colic artery in laparoscopic-assisted colorectal surgery

Investigating the effects of drainage by hemovac drain on shoulder pain after female laparoscopic surgery and comparison with deep breathing technique: a randomized clinical trial study