Skip to main content
Top

30-04-2024 | Minimally Invasive Surgery | Short communication

LARLUS: laparoscopic augmented reality from laparoscopic ultrasound

Authors: Mohammad Mahdi Kalantari, Erol Ozgur, Mohammad Alkhatib, Emmanuel Buc, Bertrand Le Roy, Richard Modrzejewski, Youcef Mezouar, Adrien Bartoli

Published in: International Journal of Computer Assisted Radiology and Surgery

Login to get access

Abstract

Purpose

This research endeavors to improve tumor localization in minimally invasive surgeries, a challenging task primarily attributable to the absence of tactile feedback and limited visibility. The conventional solution uses laparoscopic ultrasound (LUS) which has a long learning curve and is operator-dependent.

Methods

The proposed approach involves augmenting LUS images onto laparoscopic images to improve the surgeon’s ability to estimate tumor and internal organ anatomy. This augmentation relies on LUS pose estimation and filtering.

Results

Experiments conducted with clinical data exhibit successful outcomes in both the registration and augmentation of LUS images onto laparoscopic images. Additionally, noteworthy results are observed in filtering, leading to reduced flickering in augmentations.

Conclusion

The outcomes reveal promising results, suggesting the potential of LUS augmentation in surgical images to assist surgeons and serve as a training tool. We have used the LUS probe’s shaft to disambiguate the rotational symmetry. However, in the long run, it would be desirable to find more convenient solutions.
Literature
1.
go back to reference Pelanis E, Teatini A, Eigl B, Regensburger A, Alzaga A, Kumar RP, Rudolph T, Aghayan DL, Riediger C, Kvarnström N, Elle OJ, Edwin B (2021) Evaluation of a novel navigation platform for laparoscopic liver surgery with organ deformation compensation using injected fiducials. Med Image Anal 69:101946CrossRefPubMed Pelanis E, Teatini A, Eigl B, Regensburger A, Alzaga A, Kumar RP, Rudolph T, Aghayan DL, Riediger C, Kvarnström N, Elle OJ, Edwin B (2021) Evaluation of a novel navigation platform for laparoscopic liver surgery with organ deformation compensation using injected fiducials. Med Image Anal 69:101946CrossRefPubMed
2.
go back to reference Rabbani N, Calvet L, Espinel Y, Le Roy B, Ribeiro M, Buc A, Bartoli A (2022) A methodology and clinical dataset with ground-truth to evaluate registration accuracy quantitatively in computer-assisted laparoscopic liver resection. Comput Methods Biomech Biomed Eng Imaging Visual 10(4):441–450CrossRef Rabbani N, Calvet L, Espinel Y, Le Roy B, Ribeiro M, Buc A, Bartoli A (2022) A methodology and clinical dataset with ground-truth to evaluate registration accuracy quantitatively in computer-assisted laparoscopic liver resection. Comput Methods Biomech Biomed Eng Imaging Visual 10(4):441–450CrossRef
3.
go back to reference Espinel Y, Ozgur E, Calvet L, Le Roy B, Buc E, Bartoli A (2020) Combining visual cues with interactions for 3d–2d registration in liver laparoscopy. Ann Biomed Eng 48(6):1712–1727CrossRefPubMed Espinel Y, Ozgur E, Calvet L, Le Roy B, Buc E, Bartoli A (2020) Combining visual cues with interactions for 3d–2d registration in liver laparoscopy. Ann Biomed Eng 48(6):1712–1727CrossRefPubMed
4.
go back to reference Kalantari MM, Ozgur E, Alkhatib M, Buc E, Le Roy B, Modrzejewski R, Mezouar Y, Bartoli A (2024) Markerless ultrasound probe pose estimation in mini-invasive surgery. In: IEEE international conference on robotics and automation, ICRA Kalantari MM, Ozgur E, Alkhatib M, Buc E, Le Roy B, Modrzejewski R, Mezouar Y, Bartoli A (2024) Markerless ultrasound probe pose estimation in mini-invasive surgery. In: IEEE international conference on robotics and automation, ICRA
Metadata
Title
LARLUS: laparoscopic augmented reality from laparoscopic ultrasound
Authors
Mohammad Mahdi Kalantari
Erol Ozgur
Mohammad Alkhatib
Emmanuel Buc
Bertrand Le Roy
Richard Modrzejewski
Youcef Mezouar
Adrien Bartoli
Publication date
30-04-2024
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-024-03134-x