Skip to main content
Top
Published in: Surgical Endoscopy 2/2017

01-02-2017 | New Technology

A hands-free region-of-interest selection interface for solo surgery with a wide-angle endoscope: preclinical proof of concept

Authors: Kyunghwa Jung, Hyunseok Choi, Hanpyo Hong, Arnold Adikrishna, In-Ho Jeon, Jaesung Hong

Published in: Surgical Endoscopy | Issue 2/2017

Login to get access

Abstract

Background

A hands-free region-of-interest (ROI) selection interface is proposed for solo surgery using a wide-angle endoscope. A wide-angle endoscope provides images with a larger field of view than a conventional endoscope. With an appropriate selection interface for a ROI, surgeons can also obtain a detailed local view as if they moved a conventional endoscope in a specific position and direction.

Methods

To manipulate the endoscope without releasing the surgical instrument in hand, a mini-camera is attached to the instrument, and the images taken by the attached camera are analyzed. When a surgeon moves the instrument, the instrument orientation is calculated by an image processing. Surgeons can select the ROI with this instrument movement after switching from ‘task mode’ to ‘selection mode.’ The accelerated KAZE algorithm is used to track the features of the camera images once the instrument is moved. Both the wide-angle and detailed local views are displayed simultaneously, and a surgeon can move the local view area by moving the mini-camera attached to the surgical instrument.

Results

Local view selection for a solo surgery was performed without releasing the instrument. The accuracy of camera pose estimation was not significantly different between camera resolutions, but it was significantly different between background camera images with different numbers of features (P < 0.01). The success rate of ROI selection diminished as the number of separated regions increased. However, separated regions up to 12 with a region size of 160 × 160 pixels were selected with no failure. Surgical tasks on a phantom model and a cadaver were attempted to verify the feasibility in a clinical environment.

Conclusions

Hands-free endoscope manipulation without releasing the instruments in hand was achieved. The proposed method requires only a small, low-cost camera and an image processing. The technique enables surgeons to perform solo surgeries without a camera assistant.
Literature
1.
go back to reference Rahman MN, Mishra R (2011) The camera-holding robotic device in laparoscopy surgery. World J Laparosc Surg 4:132–135CrossRef Rahman MN, Mishra R (2011) The camera-holding robotic device in laparoscopy surgery. World J Laparosc Surg 4:132–135CrossRef
2.
3.
go back to reference Gilbert J (2009) The EndoAssist™ robotic camera holder as an aid to the introduction of laparoscopic colorectal surgery. Ann R Coll Surg Engl 91:389–393CrossRefPubMedPubMedCentral Gilbert J (2009) The EndoAssist™ robotic camera holder as an aid to the introduction of laparoscopic colorectal surgery. Ann R Coll Surg Engl 91:389–393CrossRefPubMedPubMedCentral
4.
go back to reference Buess G, Arezzo A, Schurr M, Ulmer F, Fisher H, Gumb L, Testa T, Nobman C (2000) A new remote-controlled endoscope positioning system for endoscopic solo surgery. Surg Endosc 14:395–399CrossRefPubMed Buess G, Arezzo A, Schurr M, Ulmer F, Fisher H, Gumb L, Testa T, Nobman C (2000) A new remote-controlled endoscope positioning system for endoscopic solo surgery. Surg Endosc 14:395–399CrossRefPubMed
5.
go back to reference Yasunaga T, Hashizume M, Kobayashi E, Tanoue K, Akahoshi T, Konishi K, Yamaguchi S, Kinjo N, Tomikawa M, Muragaki Y (2003) Remote-controlled laparoscope manipulator system, Naviot™, for endoscopic surgery. International Congress series. Elsevier, Amsterdam, pp 678–683 Yasunaga T, Hashizume M, Kobayashi E, Tanoue K, Akahoshi T, Konishi K, Yamaguchi S, Kinjo N, Tomikawa M, Muragaki Y (2003) Remote-controlled laparoscope manipulator system, Naviot™, for endoscopic surgery. International Congress series. Elsevier, Amsterdam, pp 678–683
6.
go back to reference Kobayashi E, Masamune K, Sakuma I, Dohi T (2000) A wide-angle view endoscope system using wedge prisms. In: Medical image computing and computer-assisted intervention—MICCAI 2000, Springer, pp 661–668 Kobayashi E, Masamune K, Sakuma I, Dohi T (2000) A wide-angle view endoscope system using wedge prisms. In: Medical image computing and computer-assisted intervention—MICCAI 2000, Springer, pp 661–668
7.
go back to reference Tamadazte B, Agustinos A, Cinquin P, Fiard G, Voros S (2015) Multi-view vision system for laparoscopy surgery. Int J Comput Assist Radiol Surg 10:195–203CrossRefPubMed Tamadazte B, Agustinos A, Cinquin P, Fiard G, Voros S (2015) Multi-view vision system for laparoscopy surgery. Int J Comput Assist Radiol Surg 10:195–203CrossRefPubMed
8.
go back to reference Cao A, Darin Ellis R, Composto A, Pandya AK, Klein MD (2006) Supplemental wide field-of-view monitor improves performance in surgical telerobotic movement time. Int J Med Robot Comput Assist Surg 2:364–369CrossRef Cao A, Darin Ellis R, Composto A, Pandya AK, Klein MD (2006) Supplemental wide field-of-view monitor improves performance in surgical telerobotic movement time. Int J Med Robot Comput Assist Surg 2:364–369CrossRef
9.
go back to reference Jung K, Kang D-J, Kekatpure AL, Adikrishna A, Hong J, Jeon I-H (2016) A new wide-angle arthroscopic system: a comparative study with a conventional 30° arthroscopic system. Knee Surg Sports Traumatol Arthrosc 24:1722–1729CrossRefPubMed Jung K, Kang D-J, Kekatpure AL, Adikrishna A, Hong J, Jeon I-H (2016) A new wide-angle arthroscopic system: a comparative study with a conventional 30° arthroscopic system. Knee Surg Sports Traumatol Arthrosc 24:1722–1729CrossRefPubMed
10.
go back to reference Sekiya T, Ito E, Kanai M, Matsumoto M (2006) Development of a dual-view endoscope system. In: Biomedical optics 2006, International Society for Optics and Photonics, pp 60800E-1–60800E-10 Sekiya T, Ito E, Kanai M, Matsumoto M (2006) Development of a dual-view endoscope system. In: Biomedical optics 2006, International Society for Optics and Photonics, pp 60800E-1–60800E-10
11.
go back to reference Tsunezuka H, Kato D, Terauchi K, Shimomura M, Ichise K, Ito K, Nishikawa A, Shimada J (2011) Analysis of surgeon’s line of sight using an optical tracking system with a multifaceted marker device. Int J Comput Assist Radiol Surg 6:803–809CrossRefPubMed Tsunezuka H, Kato D, Terauchi K, Shimomura M, Ichise K, Ito K, Nishikawa A, Shimada J (2011) Analysis of surgeon’s line of sight using an optical tracking system with a multifaceted marker device. Int J Comput Assist Radiol Surg 6:803–809CrossRefPubMed
12.
go back to reference Singh H, Karar V, Kumar N, Saini SS (2013) Performance comparison: optical and magnetic head tracking. Int J IT Eng Appl Sci Res 2:27–32 Singh H, Karar V, Kumar N, Saini SS (2013) Performance comparison: optical and magnetic head tracking. Int J IT Eng Appl Sci Res 2:27–32
13.
go back to reference Alcantarilla PF, Solutions T (2011) Fast explicit diffusion for accelerated features in nonlinear scale spaces. IEEE Trans Pattern Anal Mach Intell 34:1281–1298 Alcantarilla PF, Solutions T (2011) Fast explicit diffusion for accelerated features in nonlinear scale spaces. IEEE Trans Pattern Anal Mach Intell 34:1281–1298
14.
go back to reference Alcantarilla PF, Bartoli A, Davison AJ (2012) KAZE features. In: Computer vision—ECCV 2012, Springer, pp 214–227 Alcantarilla PF, Bartoli A, Davison AJ (2012) KAZE features. In: Computer vision—ECCV 2012, Springer, pp 214–227
15.
go back to reference Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef
16.
go back to reference Luong Q-T, Faugeras OD (1996) The fundamental matrix: theory, algorithms, and stability analysis. Int J Comput Vis 17:43–75CrossRef Luong Q-T, Faugeras OD (1996) The fundamental matrix: theory, algorithms, and stability analysis. Int J Comput Vis 17:43–75CrossRef
17.
go back to reference Perrin M, Fletcher A (2004) Laparoscopic abdominal surgery. Contin Educ Anaesth Crit Care Pain 4:107–110CrossRef Perrin M, Fletcher A (2004) Laparoscopic abdominal surgery. Contin Educ Anaesth Crit Care Pain 4:107–110CrossRef
18.
go back to reference Tan W, Liu H, Dong Z, Zhang G, Bao H (2013) Robust monocular SLAM in dynamic environments. In: Mixed and augmented reality (ISMAR), 2013 IEEE international symposium on, IEEE, pp 209–218 Tan W, Liu H, Dong Z, Zhang G, Bao H (2013) Robust monocular SLAM in dynamic environments. In: Mixed and augmented reality (ISMAR), 2013 IEEE international symposium on, IEEE, pp 209–218
Metadata
Title
A hands-free region-of-interest selection interface for solo surgery with a wide-angle endoscope: preclinical proof of concept
Authors
Kyunghwa Jung
Hyunseok Choi
Hanpyo Hong
Arnold Adikrishna
In-Ho Jeon
Jaesung Hong
Publication date
01-02-2017
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 2/2017
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-016-5013-8

Other articles of this Issue 2/2017

Surgical Endoscopy 2/2017 Go to the issue