Skip to main content
Top
Published in: Surgical Endoscopy 3/2018

01-03-2018

A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination

Authors: Daniel A. Hashimoto, Emil Petrusa, Roy Phitayakorn, Christina Valle, Brenna Casey, Denise Gee

Published in: Surgical Endoscopy | Issue 3/2018

Login to get access

Abstract

Introduction

The fundamentals of endoscopic surgery (FES) examination is a national test of knowledge and skill in flexible gastrointestinal endoscopy. The skill portion of the examination involves five tasks that assesses the following skills: scope navigation, loop reduction, mucosal inspection, retroflexion, and targeting. This project aimed to assess the efficacy of a proficiency-based virtual reality (VR) curriculum in preparing residents for the FES skills exam.

Methods

Experienced (>100 career colonoscopies) and inexperienced endoscopists (<50 career colonoscopies) were recruited to participate. Six VR modules were identified as reflecting the skills tested in the exam. All participants were asked to perform each of the selected modules twice, and median performance was compared between the two groups. Inexperienced endoscopists were subsequently randomized in matched pairs into a repetition (10 repetitions of each task) or proficiency curriculum. After completion of the respective curriculum, FES scores and pass rates were compared to national data and historical institutional control data (endoscopy-rotation training alone).

Results

Five experienced endoscopists and twenty-three inexperienced endoscopists participated. Construct valid metrics were identified for six modules and proficiency benchmarks were set at the median performance of experienced endoscopists. FES scores of inexperienced endoscopists in the proficiency group had significantly higher FES scores (530 ± 86) versus historical control (386.7 ± 92.2, p = 0.0003) and higher pass rate (proficiency: 100%, historical control 61.5%, p = 0.01).

Conclusion

Trainee engagement in a VR curriculum yields superior FES performance compared to an endoscopy rotation alone. Compared to the 2012–2016 national resident pass rate of 80, 100% of trainees in a proficiency-based curriculum passed the FES manual skills examination.
Literature
1.
go back to reference ACGME (2008) ACGME program requirements of graduate medical education in surgery. Accreditation Council for Graduate Medical Education, Chicago ACGME (2008) ACGME program requirements of graduate medical education in surgery. Accreditation Council for Graduate Medical Education, Chicago
2.
go back to reference Aggarwal R, Grantcharov TP, Darzi A (2007) Framework for systematic training and assessment of technical skills. J Am Coll Surg 204:697–705CrossRefPubMed Aggarwal R, Grantcharov TP, Darzi A (2007) Framework for systematic training and assessment of technical skills. J Am Coll Surg 204:697–705CrossRefPubMed
3.
go back to reference Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMed Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMed
4.
go back to reference Koch AD, Buzink SN, Heemskerk J, Botden SM, Veenendaal R, Jakimowicz JJ, Schoon EJ (2008) Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 22:158–162CrossRefPubMed Koch AD, Buzink SN, Heemskerk J, Botden SM, Veenendaal R, Jakimowicz JJ, Schoon EJ (2008) Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 22:158–162CrossRefPubMed
5.
go back to reference Phitayakorn R, Marks JM, Reynolds HL, Delaney CP (2009) Expert benchmark for the GI Mentor II. Surg Endosc 23:611–614CrossRefPubMed Phitayakorn R, Marks JM, Reynolds HL, Delaney CP (2009) Expert benchmark for the GI Mentor II. Surg Endosc 23:611–614CrossRefPubMed
6.
go back to reference ABS (2014) Flexible endoscopy curriculum for general surgery residents. American Board of Surgery, Philadelphia ABS (2014) Flexible endoscopy curriculum for general surgery residents. American Board of Surgery, Philadelphia
7.
go back to reference Hashimoto DA, Sirimanna P, Gomez ED, Beyer-Berjot L, Ericsson KA, Willians NN, Darzi A, Aggarwal R (2015) Deliberate practice enhances the quality of laparoscopic surgical performance in a randomized controlled trial: from arrested development to expert performance. Surg Endosc 29:3154–3162CrossRefPubMed Hashimoto DA, Sirimanna P, Gomez ED, Beyer-Berjot L, Ericsson KA, Willians NN, Darzi A, Aggarwal R (2015) Deliberate practice enhances the quality of laparoscopic surgical performance in a randomized controlled trial: from arrested development to expert performance. Surg Endosc 29:3154–3162CrossRefPubMed
8.
go back to reference Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMed Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMed
9.
go back to reference Stefanidis D, Acker CE, Greene FL (2010) Performance goals on simulators boost resident motivation and skills laboratory attendance. J Surg Educ 67:66–70CrossRefPubMed Stefanidis D, Acker CE, Greene FL (2010) Performance goals on simulators boost resident motivation and skills laboratory attendance. J Surg Educ 67:66–70CrossRefPubMed
10.
go back to reference Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based Fundamentals of Laparoscopic Surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMed Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based Fundamentals of Laparoscopic Surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMed
11.
go back to reference Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199:115–120CrossRefPubMed Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199:115–120CrossRefPubMed
12.
go back to reference Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H, Greenwald D, Gress F, Grosman I, Hawes R, Mullin G, Schnoll-Sussman F, Starpoli A, Stevens P, Tenner S, Villanueva G (2006) Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc 64:361–368CrossRefPubMed Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H, Greenwald D, Gress F, Grosman I, Hawes R, Mullin G, Schnoll-Sussman F, Starpoli A, Stevens P, Tenner S, Villanueva G (2006) Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc 64:361–368CrossRefPubMed
13.
go back to reference Crochet P, Aggarwal R, Dubb SS, Ziprin P, Rajaretnam N, Grantcharov T, Ericsson KA, Darzi A (2011) Deliberate practice on a virtual reality laparoscopic simulator enhances the quality of surgical technical skills. Ann Surg 253:1216–1222CrossRefPubMed Crochet P, Aggarwal R, Dubb SS, Ziprin P, Rajaretnam N, Grantcharov T, Ericsson KA, Darzi A (2011) Deliberate practice on a virtual reality laparoscopic simulator enhances the quality of surgical technical skills. Ann Surg 253:1216–1222CrossRefPubMed
14.
go back to reference Committee F (2017) FES Test Centers. Society of American Gastrointestinal and Endoscopic Surgeons Committee F (2017) FES Test Centers. Society of American Gastrointestinal and Endoscopic Surgeons
15.
go back to reference Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FES manual skills test. Surg Endosc 28:3081–3085CrossRefPubMed Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FES manual skills test. Surg Endosc 28:3081–3085CrossRefPubMed
16.
go back to reference Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM (2010) Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 24:1834–1841CrossRefPubMed Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM (2010) Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 24:1834–1841CrossRefPubMed
Metadata
Title
A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination
Authors
Daniel A. Hashimoto
Emil Petrusa
Roy Phitayakorn
Christina Valle
Brenna Casey
Denise Gee
Publication date
01-03-2018
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 3/2018
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-017-5821-5

Other articles of this Issue 3/2018

Surgical Endoscopy 3/2018 Go to the issue