Skip to main content
Top
Published in: Surgical Endoscopy 5/2014

01-05-2014

Validation of a virtual reality-based robotic surgical skills curriculum

Authors: Michael Connolly, Johnathan Seligman, Andrew Kastenmeier, Matthew Goldblatt, Jon C. Gould

Published in: Surgical Endoscopy | Issue 5/2014

Login to get access

Abstract

Background

The clinical application of robotic-assisted surgery (RAS) is rapidly increasing. The da Vinci Surgical System™ is currently the only commercially available RAS system. The skills necessary to perform robotic surgery are unique from those required for open and laparoscopic surgery. A validated laparoscopic surgical skills curriculum (fundamentals of laparoscopic surgery or FLS™) has transformed the way surgeons acquire laparoscopic skills. There is a need for a similar skills training and assessment tool specific for robotic surgery. Based on previously published data and expert opinion, we developed a robotic skills curriculum. We sought to evaluate this curriculum for evidence of construct validity (ability to discriminate between users of different skill levels).

Methods

Four experienced surgeons (>20 RAS) and 20 novice surgeons (first-year medical students with no surgical or RAS experience) were evaluated. The curriculum comprised five tasks utilizing the da Vinci™ Skills Simulator (Pick and Place, Camera Targeting 2, Peg Board 2, Matchboard 2, and Suture Sponge 3). After an orientation to the robot and a period of acclimation in the simulator, all subjects completed three consecutive repetitions of each task. Computer-derived performance metrics included time, economy of motion, master work space, instrument collisions, excessive force, distance of instruments out of view, drops, missed targets, and overall scores (a composite of all metrics).

Results

Experienced surgeons significantly outperformed novice surgeons in most metrics. Statistically significant differences were detected for each task in regards to mean overall scores and mean time (seconds) to completion.

Conclusions

The curriculum we propose is a valid method of assessing and distinguishing robotic surgical skill levels on the da Vinci Si™ Surgical System. Further study is needed to establish proficiency levels and to demonstrate that training on the simulator with the proposed curriculum leads to improved robotic surgical performance in the operating room.
Literature
1.
go back to reference Kenngott HG, Fischer L, Nickel F, Rom J, Rassweiler J, Müller-Stich BP (2012) Status of robotic assistance—a less traumatic and more accurate minimally invasive surgery? Langenbecks Arch Surg 397(3):333–341PubMedCrossRef Kenngott HG, Fischer L, Nickel F, Rom J, Rassweiler J, Müller-Stich BP (2012) Status of robotic assistance—a less traumatic and more accurate minimally invasive surgery? Langenbecks Arch Surg 397(3):333–341PubMedCrossRef
2.
go back to reference Annual report 2010 (2011) Intuitive Surgical Inc Annual report 2010 (2011) Intuitive Surgical Inc
3.
go back to reference Okrainec A, Soper NJ, Swanstrom LL, Fried GM (2011) Trends and results of the first 5 years of fundamentals of laparoscopic surgery (FLS) certification testing. Surg Endosc 25(4):1192–1198PubMedCrossRef Okrainec A, Soper NJ, Swanstrom LL, Fried GM (2011) Trends and results of the first 5 years of fundamentals of laparoscopic surgery (FLS) certification testing. Surg Endosc 25(4):1192–1198PubMedCrossRef
4.
go back to reference Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186:1019–1025PubMedCrossRef Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186:1019–1025PubMedCrossRef
5.
go back to reference Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-trainer, a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292PubMedCrossRef Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-trainer, a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292PubMedCrossRef
6.
go back to reference Lyons C, Goldfarb D, Jones SL, Badhiwala N, Miles B, Link R, Dunkin BJ (2013) Which skills really matter? Proving face, content, and construct validity for a commercial robotic simulator. Surg Endosc 27(6):2020–2030PubMedCrossRef Lyons C, Goldfarb D, Jones SL, Badhiwala N, Miles B, Link R, Dunkin BJ (2013) Which skills really matter? Proving face, content, and construct validity for a commercial robotic simulator. Surg Endosc 27(6):2020–2030PubMedCrossRef
7.
go back to reference Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef
8.
go back to reference Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463PubMedCentralPubMedCrossRef Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463PubMedCentralPubMedCrossRef
9.
go back to reference Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room: a randomized controlled trial. Am J Surg 199(1):115–120PubMedCrossRef Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room: a randomized controlled trial. Am J Surg 199(1):115–120PubMedCrossRef
10.
go back to reference Beyer L, De Troyer J, Mancini J, Bladou F, Berdah SV, Karsenty G (2011) Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. Am J Surg 202(3):265–272PubMedCrossRef Beyer L, De Troyer J, Mancini J, Bladou F, Berdah SV, Karsenty G (2011) Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. Am J Surg 202(3):265–272PubMedCrossRef
11.
go back to reference Anderson E, Chang DC, Parsons JK, Talamini MA (2012) The first national examination of outcomes and trends in robotic surgery in the United States. J Am Coll Surg 215(1):107–114PubMedCrossRef Anderson E, Chang DC, Parsons JK, Talamini MA (2012) The first national examination of outcomes and trends in robotic surgery in the United States. J Am Coll Surg 215(1):107–114PubMedCrossRef
12.
go back to reference Gurusamy KS, Samraj K, Fusai G, Davidson BR (2009) Robot assistant for laparoscopic cholecystectomy. Cochrane Database Syst Rev 21(1):CD006578 Gurusamy KS, Samraj K, Fusai G, Davidson BR (2009) Robot assistant for laparoscopic cholecystectomy. Cochrane Database Syst Rev 21(1):CD006578
13.
go back to reference Maeso S, Reza M, Mayol JA, Blasco JA, Guerra M, Andradas E, Plana MN (2010) Efficacy of the da Vinci surgical system in abdominal surgery compared with that of laparoscopy: a systematic review and meta-analysis. Ann Surg 252:254–262PubMedCrossRef Maeso S, Reza M, Mayol JA, Blasco JA, Guerra M, Andradas E, Plana MN (2010) Efficacy of the da Vinci surgical system in abdominal surgery compared with that of laparoscopy: a systematic review and meta-analysis. Ann Surg 252:254–262PubMedCrossRef
16.
go back to reference Perrenot C, Perez M, Nguyen T, Jehl J, Felblinger J, Bresler L, Hubert J (2012) The virtual reality simulator dV-trainer is a valid assessment tool for robotic surgical skills. Surg Endosc 26:2587–2593PubMedCrossRef Perrenot C, Perez M, Nguyen T, Jehl J, Felblinger J, Bresler L, Hubert J (2012) The virtual reality simulator dV-trainer is a valid assessment tool for robotic surgical skills. Surg Endosc 26:2587–2593PubMedCrossRef
17.
go back to reference Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-trainer: a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292PubMedCrossRef Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-trainer: a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292PubMedCrossRef
18.
go back to reference Sethi AS, Peine WJ, Mohammadi Y, Sundaram CP (2009) Validation of a novel virtual reality robotic simulator. J Endourol 23(3):503–508PubMedCrossRef Sethi AS, Peine WJ, Mohammadi Y, Sundaram CP (2009) Validation of a novel virtual reality robotic simulator. J Endourol 23(3):503–508PubMedCrossRef
19.
go back to reference Lendvay TS, Casale P, Sweet R, Peters C (2008) VR robotic surgery: randomized blinded study of the dV-trainer robotic simulator. Stud Health Technol Inform 132:242–244PubMed Lendvay TS, Casale P, Sweet R, Peters C (2008) VR robotic surgery: randomized blinded study of the dV-trainer robotic simulator. Stud Health Technol Inform 132:242–244PubMed
Metadata
Title
Validation of a virtual reality-based robotic surgical skills curriculum
Authors
Michael Connolly
Johnathan Seligman
Andrew Kastenmeier
Matthew Goldblatt
Jon C. Gould
Publication date
01-05-2014
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 5/2014
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-3373-x

Other articles of this Issue 5/2014

Surgical Endoscopy 5/2014 Go to the issue