Skip to main content
Top
Published in: Journal of Gastrointestinal Surgery 10/2020

01-10-2020 | Liver Surgery | Original Article

Efficiency, Accuracy and Clinical Applicability of a New Image-Guided Surgery System in 3D Laparoscopic Liver Surgery

Authors: Gian Andrea Prevost, Benjamin Eigl, Iwan Paolucci, Tobias Rudolph, Matthias Peterhans, Stefan Weber, Guido Beldi, Daniel Candinas, Anja Lachenmayer

Published in: Journal of Gastrointestinal Surgery | Issue 10/2020

Login to get access

Abstract

Background

To investigate efficiency, accuracy and clinical benefit of a new augmented reality system for 3D laparoscopic liver surgery.

Methods

All patients who received laparoscopic liver resection by a new image-guided surgery system with augmented 3D-imaging in a university hospital were included for analysis. Digitally processed preoperative cross-sectional imaging was merged with the laparoscopic image. Intraoperative efficiency of the procedure was measured as time needed to achieve sufficient registration accuracy. Technical accuracy was reported as fiducial registration error (FRE). Clinical benefit was assessed trough a questionnaire, reporting measures in a 5-point Likert scale format ranging from 1 (high) to 5 (low).

Results

From January to March 2018, ten laparoscopic liver resections of a total of 18 lesions were performed using the novel augmented reality system. Median time for registration was 8:50 min (range 1:31–23:56). The mean FRE was reduced from 14.0 mm (SD 5.0) in the first registration attempt to 9.2 mm (SD 2.8) in the last attempt. The questionnaire revealed the ease of use of the system (1.2, SD 0.4) and the benefit for resection of vanishing lesions (1.0, SD 0.0) as convincing positive aspects, whereas image registration accuracy for resection guidance was consistently judged as too inaccurate.

Conclusions

Augmented reality in 3D laparoscopic liver surgery with landmark-based registration technique is feasible with only little impact on the intraoperative workflow. The benefit for detecting particularly vanishing lesions is high. For an additional benefit during the resection process, registration accuracy has to be improved and non-rigid registration algorithms will be required to address intraoperative anatomical deformation.
Literature
1.
go back to reference Fretland AA, Dagenborg VJ, Bjornelv GMW, Kazaryan AM, Kristiansen R, Fagerland MW, Hausken J, Tonnessen TI, Abildgaard A, Barkhatov L, Yaqub S, Rosok BI, Bjornbeth BA, Andersen MH, Flatmark K, Aas E, Edwin B (2018) Laparoscopic Versus Open Resection for Colorectal Liver Metastases: The OSLO-COMET Randomized Controlled Trial. Ann Surg 267:199–207CrossRef Fretland AA, Dagenborg VJ, Bjornelv GMW, Kazaryan AM, Kristiansen R, Fagerland MW, Hausken J, Tonnessen TI, Abildgaard A, Barkhatov L, Yaqub S, Rosok BI, Bjornbeth BA, Andersen MH, Flatmark K, Aas E, Edwin B (2018) Laparoscopic Versus Open Resection for Colorectal Liver Metastases: The OSLO-COMET Randomized Controlled Trial. Ann Surg 267:199–207CrossRef
2.
go back to reference Wottawa CR, Cohen JR, Fan RE, Bisley JW, Culjat MO, Grundfest WS, Dutson EP (2013) The role of tactile feedback in grip force during laparoscopic training tasks. Surgical endoscopy 27:1111–1118CrossRef Wottawa CR, Cohen JR, Fan RE, Bisley JW, Culjat MO, Grundfest WS, Dutson EP (2013) The role of tactile feedback in grip force during laparoscopic training tasks. Surgical endoscopy 27:1111–1118CrossRef
3.
go back to reference Lin CJ, Cheng CF, Chen HJ, Wu KY (2017) Training Performance of Laparoscopic Surgery in Two- and Three-Dimensional Displays. Surgical innovation 24:162–170CrossRef Lin CJ, Cheng CF, Chen HJ, Wu KY (2017) Training Performance of Laparoscopic Surgery in Two- and Three-Dimensional Displays. Surgical innovation 24:162–170CrossRef
4.
go back to reference Tamadazte B, Fiard G, Long JA, Cinquin P, Voros S (2013) Enhanced vision system for laparoscopic surgery. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference 2013:5702–5705 Tamadazte B, Fiard G, Long JA, Cinquin P, Voros S (2013) Enhanced vision system for laparoscopic surgery. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference 2013:5702–5705
5.
go back to reference Sakata S, Grove PM, Hill A, Watson MO, Stevenson ARL (2017) Impact of simulated three-dimensional perception on precision of depth judgements, technical performance and perceived workload in laparoscopy. The British journal of surgery 104:1097–1106CrossRef Sakata S, Grove PM, Hill A, Watson MO, Stevenson ARL (2017) Impact of simulated three-dimensional perception on precision of depth judgements, technical performance and perceived workload in laparoscopy. The British journal of surgery 104:1097–1106CrossRef
6.
go back to reference Velayutham V, Fuks D, Nomi T, Kawaguchi Y, Gayet B (2016) 3D visualization reduces operating time when compared to high-definition 2D in laparoscopic liver resection: a case-matched study. Surgical endoscopy 30:147–153CrossRef Velayutham V, Fuks D, Nomi T, Kawaguchi Y, Gayet B (2016) 3D visualization reduces operating time when compared to high-definition 2D in laparoscopic liver resection: a case-matched study. Surgical endoscopy 30:147–153CrossRef
7.
go back to reference Kawai T, Goumard C, Jeune F, Komatsu S, Soubrane O, Scatton O (2018) 3D vision and maintenance of stable pneumoperitoneum: a new step in the development of laparoscopic right hepatectomy. Surgical endoscopy 32:3706–3712CrossRef Kawai T, Goumard C, Jeune F, Komatsu S, Soubrane O, Scatton O (2018) 3D vision and maintenance of stable pneumoperitoneum: a new step in the development of laparoscopic right hepatectomy. Surgical endoscopy 32:3706–3712CrossRef
8.
go back to reference Bernhardt S, Nicolau SA, Soler L, Doignon C (2017) The status of augmented reality in laparoscopic surgery as of 2016. Medical image analysis 37:66–90CrossRef Bernhardt S, Nicolau SA, Soler L, Doignon C (2017) The status of augmented reality in laparoscopic surgery as of 2016. Medical image analysis 37:66–90CrossRef
9.
go back to reference Buchs NC, Volonte F, Pugin F, Toso C, Fusaglia M, Gavaghan K, Majno PE, Peterhans M, Weber S, Morel P (2013) Augmented environments for the targeting of hepatic lesions during image-guided robotic liver surgery. The Journal of surgical research 184:825–831CrossRef Buchs NC, Volonte F, Pugin F, Toso C, Fusaglia M, Gavaghan K, Majno PE, Peterhans M, Weber S, Morel P (2013) Augmented environments for the targeting of hepatic lesions during image-guided robotic liver surgery. The Journal of surgical research 184:825–831CrossRef
10.
go back to reference Soler L, Nicolau S, Pessaux P, Mutter D, Marescaux J (2014) Real-time 3D image reconstruction guidance in liver resection surgery. Hepatobiliary surgery and nutrition 3:73–81PubMedPubMedCentral Soler L, Nicolau S, Pessaux P, Mutter D, Marescaux J (2014) Real-time 3D image reconstruction guidance in liver resection surgery. Hepatobiliary surgery and nutrition 3:73–81PubMedPubMedCentral
11.
go back to reference Pessaux P, Diana M, Soler L, Piardi T, Mutter D, Marescaux J (2015) Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy. Langenbeck's archives of surgery 400:381–385CrossRef Pessaux P, Diana M, Soler L, Piardi T, Mutter D, Marescaux J (2015) Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy. Langenbeck's archives of surgery 400:381–385CrossRef
12.
go back to reference Su LM, Vagvolgyi BP, Agarwal R, Reiley CE, Taylor RH, Hager GD (2009) Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. Urology 73:896–900CrossRef Su LM, Vagvolgyi BP, Agarwal R, Reiley CE, Taylor RH, Hager GD (2009) Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. Urology 73:896–900CrossRef
14.
go back to reference Herline AJ, Herring JL, Stefansic JD, Chapman WC, Galloway RL, Jr., Dawant BM (2000) Surface registration for use in interactive, image-guided liver surgery. Computer aided surgery : official journal of the International Society for Computer Aided Surgery 5:11–17 Herline AJ, Herring JL, Stefansic JD, Chapman WC, Galloway RL, Jr., Dawant BM (2000) Surface registration for use in interactive, image-guided liver surgery. Computer aided surgery : official journal of the International Society for Computer Aided Surgery 5:11–17
15.
go back to reference Peterhans M, vom Berg A, Dagon B, Inderbitzin D, Baur C, Candinas D, Weber S (2010) A navigation system for open liver surgery: design, workflow and first clinical applications. The International Journal of Medical Robotics and Computer Assisted Surgery 7:7–16CrossRef Peterhans M, vom Berg A, Dagon B, Inderbitzin D, Baur C, Candinas D, Weber S (2010) A navigation system for open liver surgery: design, workflow and first clinical applications. The International Journal of Medical Robotics and Computer Assisted Surgery 7:7–16CrossRef
16.
go back to reference Banz VM, Muller PC, Tinguely P, Inderbitzin D, Ribes D, Peterhans M, Candinas D, Weber S (2016) Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery. Langenbeck's archives of surgery 401:495–502CrossRef Banz VM, Muller PC, Tinguely P, Inderbitzin D, Ribes D, Peterhans M, Candinas D, Weber S (2016) Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery. Langenbeck's archives of surgery 401:495–502CrossRef
17.
go back to reference Tinguely P, Fusaglia M, Freedman J, Banz V, Weber S, Candinas D, Nilsson H (2017) Laparoscopic image-based navigation for microwave ablation of liver tumors-A multi-center study. Surgical endoscopy 31:4315–4324CrossRef Tinguely P, Fusaglia M, Freedman J, Banz V, Weber S, Candinas D, Nilsson H (2017) Laparoscopic image-based navigation for microwave ablation of liver tumors-A multi-center study. Surgical endoscopy 31:4315–4324CrossRef
18.
go back to reference Fitzpatrick JM, West JB, Maurer CR (1998) Predicting error in rigid-body point-based registration. IEEE transactions on medical imaging 17:694–702CrossRef Fitzpatrick JM, West JB, Maurer CR (1998) Predicting error in rigid-body point-based registration. IEEE transactions on medical imaging 17:694–702CrossRef
19.
go back to reference Widmann G, Stoffner R, Sieb M, Bale R (2009) Target registration and target positioning errors in computer-assisted neurosurgery: proposal for a standardized reporting of error assessment. The international journal of medical robotics + computer assisted surgery : MRCAS 5:355–365CrossRef Widmann G, Stoffner R, Sieb M, Bale R (2009) Target registration and target positioning errors in computer-assisted neurosurgery: proposal for a standardized reporting of error assessment. The international journal of medical robotics + computer assisted surgery : MRCAS 5:355–365CrossRef
20.
go back to reference Dindo D, Demartines N, Clavien P-A (2004) Classification of Surgical Complications. Annals of Surgery 240:205–213CrossRef Dindo D, Demartines N, Clavien P-A (2004) Classification of Surgical Complications. Annals of Surgery 240:205–213CrossRef
21.
go back to reference Rahbari NN, Garden OJ, Padbury R, Maddern G, Koch M, Hugh TJ, Fan ST, Nimura Y, Figueras J, Vauthey JN, Rees M, Adam R, Dematteo RP, Greig P, Usatoff V, Banting S, Nagino M, Capussotti L, Yokoyama Y, Brooke-Smith M, Crawford M, Christophi C, Makuuchi M, Buchler MW, Weitz J (2011) Post-hepatectomy haemorrhage: a definition and grading by the International Study Group of Liver Surgery (ISGLS). HPB : the official journal of the International Hepato Pancreato Biliary Association 13:528–535CrossRef Rahbari NN, Garden OJ, Padbury R, Maddern G, Koch M, Hugh TJ, Fan ST, Nimura Y, Figueras J, Vauthey JN, Rees M, Adam R, Dematteo RP, Greig P, Usatoff V, Banting S, Nagino M, Capussotti L, Yokoyama Y, Brooke-Smith M, Crawford M, Christophi C, Makuuchi M, Buchler MW, Weitz J (2011) Post-hepatectomy haemorrhage: a definition and grading by the International Study Group of Liver Surgery (ISGLS). HPB : the official journal of the International Hepato Pancreato Biliary Association 13:528–535CrossRef
22.
go back to reference Thompson S, Schneider C, Bosi M, Gurusamy K, Ourselin S, Davidson B, Hawkes D, Clarkson MJ (2018) In vivo estimation of target registration errors during augmented reality laparoscopic surgery. International journal of computer assisted radiology and surgery 13:865–874CrossRef Thompson S, Schneider C, Bosi M, Gurusamy K, Ourselin S, Davidson B, Hawkes D, Clarkson MJ (2018) In vivo estimation of target registration errors during augmented reality laparoscopic surgery. International journal of computer assisted radiology and surgery 13:865–874CrossRef
23.
go back to reference Collins JA, Weis JA, Heiselman JS, Clements LW, Simpson AL, Jarnagin WR, Miga MI (2017) Improving Registration Robustness for Image-Guided Liver Surgery in a Novel Human-to-Phantom Data Framework. IEEE transactions on medical imaging 36:1502–1510CrossRef Collins JA, Weis JA, Heiselman JS, Clements LW, Simpson AL, Jarnagin WR, Miga MI (2017) Improving Registration Robustness for Image-Guided Liver Surgery in a Novel Human-to-Phantom Data Framework. IEEE transactions on medical imaging 36:1502–1510CrossRef
24.
go back to reference Ntourakis D, Memeo R, Soler L, Marescaux J, Mutter D, Pessaux P (2016) Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience. World journal of surgery 40:419–426CrossRef Ntourakis D, Memeo R, Soler L, Marescaux J, Mutter D, Pessaux P (2016) Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience. World journal of surgery 40:419–426CrossRef
25.
go back to reference Huber T, Baumgart J, Peterhans M, Weber S, Heinrich S, Lang H (2016) Computer-assisted 3D-navigated laparoscopic resection of a vanished colorectal liver metastasis after chemotherapy. Zeitschrift fur Gastroenterologie 54:40–43CrossRef Huber T, Baumgart J, Peterhans M, Weber S, Heinrich S, Lang H (2016) Computer-assisted 3D-navigated laparoscopic resection of a vanished colorectal liver metastasis after chemotherapy. Zeitschrift fur Gastroenterologie 54:40–43CrossRef
26.
go back to reference Kang X, Azizian M, Wilson E, Wu K, Martin AD, Kane TD, Peters CA, Cleary K, Shekhar R (2014) Stereoscopic augmented reality for laparoscopic surgery. Surgical endoscopy 28:2227–2235CrossRef Kang X, Azizian M, Wilson E, Wu K, Martin AD, Kane TD, Peters CA, Cleary K, Shekhar R (2014) Stereoscopic augmented reality for laparoscopic surgery. Surgical endoscopy 28:2227–2235CrossRef
27.
go back to reference Kenngott HG, Wagner M, Gondan M, Nickel F, Nolden M, Fetzer A, Weitz J, Fischer L, Speidel S, Meinzer HP, Bockler D, Buchler MW, Muller-Stich BP (2014) Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging. Surgical endoscopy 28:933–940CrossRef Kenngott HG, Wagner M, Gondan M, Nickel F, Nolden M, Fetzer A, Weitz J, Fischer L, Speidel S, Meinzer HP, Bockler D, Buchler MW, Muller-Stich BP (2014) Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging. Surgical endoscopy 28:933–940CrossRef
28.
go back to reference Kleemann M, Deichmann S, Esnaashari H, Besirevic A, Shahin O, Bruch HP, Laubert T (2012) Laparoscopic navigated liver resection: technical aspects and clinical practice in benign liver tumors. Case reports in surgery 2012:265918CrossRef Kleemann M, Deichmann S, Esnaashari H, Besirevic A, Shahin O, Bruch HP, Laubert T (2012) Laparoscopic navigated liver resection: technical aspects and clinical practice in benign liver tumors. Case reports in surgery 2012:265918CrossRef
29.
go back to reference Hayashi Y, Igami T, Hirose T, Nagino M, Mori K (2015) Development and clinical application of surgical navigation system for laparoscopic hepatectomy. SPIE Medical Imaging, SPIE, pp 6 Hayashi Y, Igami T, Hirose T, Nagino M, Mori K (2015) Development and clinical application of surgical navigation system for laparoscopic hepatectomy. SPIE Medical Imaging, SPIE, pp 6
30.
go back to reference Margonis GA, Sergentanis TN, Ntanasis-Stathopoulos I, Andreatos N, Tzanninis IG, Sasaki K, Psaltopoulou T, Wang J, Buettner S, Papalois Alpha E, He J, Wolfgang CL, Pawlik TM, Weiss MJ (2018) Impact of Surgical Margin Width on Recurrence and Overall Survival Following R0 Hepatic Resection of Colorectal Metastases: A Systematic Review and Meta-analysis. Ann Surg 267:1047–1055CrossRef Margonis GA, Sergentanis TN, Ntanasis-Stathopoulos I, Andreatos N, Tzanninis IG, Sasaki K, Psaltopoulou T, Wang J, Buettner S, Papalois Alpha E, He J, Wolfgang CL, Pawlik TM, Weiss MJ (2018) Impact of Surgical Margin Width on Recurrence and Overall Survival Following R0 Hepatic Resection of Colorectal Metastases: A Systematic Review and Meta-analysis. Ann Surg 267:1047–1055CrossRef
Metadata
Title
Efficiency, Accuracy and Clinical Applicability of a New Image-Guided Surgery System in 3D Laparoscopic Liver Surgery
Authors
Gian Andrea Prevost
Benjamin Eigl
Iwan Paolucci
Tobias Rudolph
Matthias Peterhans
Stefan Weber
Guido Beldi
Daniel Candinas
Anja Lachenmayer
Publication date
01-10-2020
Publisher
Springer US
Published in
Journal of Gastrointestinal Surgery / Issue 10/2020
Print ISSN: 1091-255X
Electronic ISSN: 1873-4626
DOI
https://doi.org/10.1007/s11605-019-04395-7

Other articles of this Issue 10/2020

Journal of Gastrointestinal Surgery 10/2020 Go to the issue