Skip to main content
Top
Published in: Surgical Endoscopy 8/2015

01-08-2015

A novel augmented reality simulator for skills assessment in minimal invasive surgery

Authors: Vasileios Lahanas, Constantinos Loukas, Nikolaos Smailis, Evangelos Georgiou

Published in: Surgical Endoscopy | Issue 8/2015

Login to get access

Abstract

Introduction

Over the past decade, simulation-based training has come to the foreground as an efficient method for training and assessment of surgical skills in minimal invasive surgery. Box-trainers and virtual reality (VR) simulators have been introduced in the teaching curricula and have substituted to some extent the traditional model of training based on animals or cadavers. Augmented reality (AR) is a new technology that allows blending of VR elements and real objects within a real-world scene. In this paper, we present a novel AR simulator for assessment of basic laparoscopic skills.

Methods

The components of the proposed system include: a box-trainer, a camera and a set of laparoscopic tools equipped with custom-made sensors that allow interaction with VR training elements. Three AR tasks were developed, focusing on basic skills such as perception of depth of field, hand-eye coordination and bimanual operation. The construct validity of the system was evaluated via a comparison between two experience groups: novices with no experience in laparoscopic surgery and experienced surgeons. The observed metrics included task execution time, tool pathlength and two task-specific errors. The study also included a feedback questionnaire requiring participants to evaluate the face-validity of the system.

Results

Between-group comparison demonstrated highly significant differences (<0.01) in all performance metrics and tasks denoting the simulator’s construct validity. Qualitative analysis on the instruments’ trajectories highlighted differences between novices and experts regarding smoothness and economy of motion. Subjects’ ratings on the feedback questionnaire highlighted the face-validity of the training system.

Conclusions

The results highlight the potential of the proposed simulator to discriminate groups with different expertise providing a proof of concept for the potential use of AR as a core technology for laparoscopic simulation training.
Literature
6.
go back to reference Okuda Y, Bryson EO, DeMaria S Jr, Jacobson L, Quinones J, Shen B, Levine AI (2009) The utility of simulation in medical education: what is the evidence? Mt Sinai J Med 76(4):330–343. doi:10.1002/msj.20127 PubMedCrossRef Okuda Y, Bryson EO, DeMaria S Jr, Jacobson L, Quinones J, Shen B, Levine AI (2009) The utility of simulation in medical education: what is the evidence? Mt Sinai J Med 76(4):330–343. doi:10.​1002/​msj.​20127 PubMedCrossRef
7.
go back to reference Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193(6):774–783. doi:10.1016/j.amjsurg.2007.01.022 PubMedCrossRef Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193(6):774–783. doi:10.​1016/​j.​amjsurg.​2007.​01.​022 PubMedCrossRef
8.
go back to reference Hanna L (2010) Simulated surgery: the virtual reality of surgical training. Surgery (Oxford) 28(9):463–468CrossRef Hanna L (2010) Simulated surgery: the virtual reality of surgical training. Surgery (Oxford) 28(9):463–468CrossRef
10.
go back to reference De Paolis LT (2012) Serious game for laparoscopic suturing training. In: CISIS’12 proceedings of the 2012 sixth international conference on complex, intelligent and software intensive systems, 4–6 July 2012. pp 481–485. doi:10.1109/cisis.2012.175 De Paolis LT (2012) Serious game for laparoscopic suturing training. In: CISIS’12 proceedings of the 2012 sixth international conference on complex, intelligent and software intensive systems, 4–6 July 2012. pp 481–485. doi:10.​1109/​cisis.​2012.​175
11.
go back to reference Gor M, McCloy R, Stone R, Smith A (2003) Virtual reality laparoscopic simulator for assessment in gynaecology. BJOG 110(2):181–187PubMedCrossRef Gor M, McCloy R, Stone R, Smith A (2003) Virtual reality laparoscopic simulator for assessment in gynaecology. BJOG 110(2):181–187PubMedCrossRef
12.
go back to reference Lahanas V, Loukas C, Nikiteas N, Dimitroulis D, Georgiou E (2011) Psychomotor skills assessment in laparoscopic surgery using augmented reality scenarios. In: The 17th international conference on digital signal processing (DSP), 2011 , 6–8 July 2011, pp 1–6. doi:10.1109/icdsp.2011.6004893 Lahanas V, Loukas C, Nikiteas N, Dimitroulis D, Georgiou E (2011) Psychomotor skills assessment in laparoscopic surgery using augmented reality scenarios. In: The 17th international conference on digital signal processing (DSP), 2011 , 6–8 July 2011, pp 1–6. doi:10.​1109/​icdsp.​2011.​6004893
14.
go back to reference Lewandowski WA (2006) return on investment (ROI) model to measure and evaluate medical simulation using a systematic results-based approach. In: Medicine meets virtual reality, pp 24–27 Lewandowski WA (2006) return on investment (ROI) model to measure and evaluate medical simulation using a systematic results-based approach. In: Medicine meets virtual reality, pp 24–27
15.
go back to reference Nolle S, Klinker G (2006) Augmented reality as a comparison tool in automotive industry. In: IEEE/ACM international symposium on mixed and augmented reality, 2006 (ISMAR 2006), 22–25 Oct 2006, pp 249–250. doi:10.1109/ismar.2006.297829 Nolle S, Klinker G (2006) Augmented reality as a comparison tool in automotive industry. In: IEEE/ACM international symposium on mixed and augmented reality, 2006 (ISMAR 2006), 22–25 Oct 2006, pp 249–250. doi:10.​1109/​ismar.​2006.​297829
16.
go back to reference Vlahakis V, Karigiannis J, Tsotros M, Gounaris M, Almeida L, Stricker D, Gleue T, Christou IT, Carlucci R, Ioannidis N (2001) Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites. Paper presented at the proceedings of the 2001 conference on virtual reality, archeology, and cultural heritage, Glyfada, Greece Vlahakis V, Karigiannis J, Tsotros M, Gounaris M, Almeida L, Stricker D, Gleue T, Christou IT, Carlucci R, Ioannidis N (2001) Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites. Paper presented at the proceedings of the 2001 conference on virtual reality, archeology, and cultural heritage, Glyfada, Greece
17.
go back to reference Haritos T, Macchiarella ND (2005) A mobile application of augmented reality for aerospace maintenance training. In: Proceedings of the 24th digital avionics systems conference, 2005 (DASC 2005), 30 Oct–3 Nov 2005, pp vol 1,5.B.3–5.1-9 Vol. 1. doi:10.1109/dasc.2005.1563376 Haritos T, Macchiarella ND (2005) A mobile application of augmented reality for aerospace maintenance training. In: Proceedings of the 24th digital avionics systems conference, 2005 (DASC 2005), 30 Oct–3 Nov 2005, pp vol 1,5.B.3–5.1-9 Vol. 1. doi:10.​1109/​dasc.​2005.​1563376
18.
go back to reference van Krevelen DWF, Poelman R (2010) A survey of augmented reality technologies, applications and limitations. Int J Virtual Real 9(2):1–20 van Krevelen DWF, Poelman R (2010) A survey of augmented reality technologies, applications and limitations. Int J Virtual Real 9(2):1–20
20.
go back to reference Azuma RT (1997) A survey of augmented reality. Presence: Teleoper Virtual Environ 6(4):355–385 Azuma RT (1997) A survey of augmented reality. Presence: Teleoper Virtual Environ 6(4):355–385
22.
go back to reference Fuchs H, Livingston MA, Raskar R, Colucci Dn, Keller K, State A, Crawford JR, Rademacher P, Drake SH, Meyer AA (1998) Augmented reality visualization for laparoscopic surgery. Paper presented at the proceedings of the first international conference on medical image computing and computer-assisted intervention Fuchs H, Livingston MA, Raskar R, Colucci Dn, Keller K, State A, Crawford JR, Rademacher P, Drake SH, Meyer AA (1998) Augmented reality visualization for laparoscopic surgery. Paper presented at the proceedings of the first international conference on medical image computing and computer-assisted intervention
23.
go back to reference Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepato Biliary Pancreat Sci 18(4):506–509. doi:10.1007/s00534-011-0385-6 CrossRef Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepato Biliary Pancreat Sci 18(4):506–509. doi:10.​1007/​s00534-011-0385-6 CrossRef
24.
go back to reference Pagador JB, Sanchez LF, Sanchez JA, Bustos P, Moreno J, Sanchez-Margallo FM (2011) Augmented reality haptic (ARH): an approach of electromagnetic tracking in minimally invasive surgery. Int J Comput Assist Radiol Surg 6(2):257–263. doi:10.1007/s11548-010-0501-0 PubMedCrossRef Pagador JB, Sanchez LF, Sanchez JA, Bustos P, Moreno J, Sanchez-Margallo FM (2011) Augmented reality haptic (ARH): an approach of electromagnetic tracking in minimally invasive surgery. Int J Comput Assist Radiol Surg 6(2):257–263. doi:10.​1007/​s11548-010-0501-0 PubMedCrossRef
25.
go back to reference Weiss CR, Marker DR, Fischer GS, Fichtinger G, Machado AJ, Carrino JA (2011) Augmented reality visualization using image overlay for MR-guided interventions: system description, feasibility, and initial evaluation in a spine phantom. Am J Roentgenol 196(3):W305–W307. doi:10.2214/AJR.10.5038 CrossRef Weiss CR, Marker DR, Fischer GS, Fichtinger G, Machado AJ, Carrino JA (2011) Augmented reality visualization using image overlay for MR-guided interventions: system description, feasibility, and initial evaluation in a spine phantom. Am J Roentgenol 196(3):W305–W307. doi:10.​2214/​AJR.​10.​5038 CrossRef
26.
go back to reference Loukas C, Lahanas V, Georgiou E (2013) An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training. Int J Med Robot Comput Surg 9(4):e34–e51CrossRef Loukas C, Lahanas V, Georgiou E (2013) An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training. Int J Med Robot Comput Surg 9(4):e34–e51CrossRef
31.
go back to reference Maithel S, Sierra R, Korndorffer J, Neumann P, Dawson S, Callery M, Jones D, Scott D (2006) Construct and face validity of MIST-VR, Endotower, and CELTS. Surg Endosc 20(1):104–112PubMedCrossRef Maithel S, Sierra R, Korndorffer J, Neumann P, Dawson S, Callery M, Jones D, Scott D (2006) Construct and face validity of MIST-VR, Endotower, and CELTS. Surg Endosc 20(1):104–112PubMedCrossRef
32.
go back to reference Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191(1):28–32PubMedCrossRef Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191(1):28–32PubMedCrossRef
33.
go back to reference Panait L, Akkary E, Bell RL, Roberts KE, Dudrick SJ, Duffy AJ (2009) The role of haptic feedback in laparoscopic simulation training. J Surg Res 156(2):312–316PubMedCrossRef Panait L, Akkary E, Bell RL, Roberts KE, Dudrick SJ, Duffy AJ (2009) The role of haptic feedback in laparoscopic simulation training. J Surg Res 156(2):312–316PubMedCrossRef
34.
go back to reference Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236(4):458PubMedCentralPubMedCrossRef Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236(4):458PubMedCentralPubMedCrossRef
Metadata
Title
A novel augmented reality simulator for skills assessment in minimal invasive surgery
Authors
Vasileios Lahanas
Constantinos Loukas
Nikolaos Smailis
Evangelos Georgiou
Publication date
01-08-2015
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 8/2015
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-014-3930-y

Other articles of this Issue 8/2015

Surgical Endoscopy 8/2015 Go to the issue