Skip to main content
Top
Published in: Surgical Endoscopy 11/2007

01-11-2007

FLS simulator performance predicts intraoperative laparoscopic skill

Authors: A. L. McCluney, M. C. Vassiliou, P. A. Kaneva, J. Cao, D. D. Stanbridge, L. S. Feldman, G. M. Fried

Published in: Surgical Endoscopy | Issue 11/2007

Login to get access

Abstract

Introduction

Simulators are being used more and more for teaching and testing laparoscopic skills. However, it has yet to be firmly established that simulator performance reflects operative laparoscopic skill. The study reported here was designed to test the hypothesis that laparoscopic simulator performance predicts intraoperative laparoscopic skill.

Methods

A review of our prospectively maintained database identified 40 subjects who underwent Fundamentals of Lapraoscopic Surgery (FLS) skills testing and objective intraoperative assessments within the same 6-month period. Subjects consisted of 22 novice (postgraduate year [PGY] 1–2), 10 intermediate (PGY 3–4), and 8 experienced (PGY 5, fellows, and attendings) laparoscopic surgeons. Laparoscopic performance was objectively assessed in the operating room using the previously validated Global Operative Assessment of Laparoscopic Skill (GOALS). Analysis of variance (ANOVA) was used to compare mean FLS scores and mean GOALS scores across experience levels. The relationship between individual FLS scores and GOALS scores was assessed with linear regression analysis. A multivariate analysis evaluated FLS score and surgeon experience as predictors of intraoperative GOALS score. A receiver-operator curve (ROC) was constructed in order to define an FLS cutoff score that predicts intraoperative performance at or above the level of experienced surgeons. Significance was defined as p < 0.05.

Results

Mean FLS scores and mean GOALS scores increased with increasing experience. Individual FLS scores correlated significantly with intraoperative GOALS scores (0.77, p < 0.001). Multivariate analysis confirmed that FLS score is an independent predictor of intraoperative GOALS scores. The ROC identified an FLS cutoff score of 70 with optimal sensitivity (91%) and specificity (86%) for predicting a GOALS score at or above the level of experienced surgeons.

Conclusions

In this study sample, FLS simulator scores were independently predictive of intraoperative laparoscopic performance as measured by GOALS. More precisely, an FLS cutoff score of 70 optimized sensitivity and specificity for expert intraoperative performance. A larger prospective study is justified to validate these findings.
Literature
1.
go back to reference Andreatta PB, Woodrum DT, Birkmeyer JD, Yellamanchilli RK, Doherty GM, Gauger PG, Minter RM (2006) Laparoscopic skills are improve with LapMentor Training. Ann Surg 243:854–863PubMedCrossRef Andreatta PB, Woodrum DT, Birkmeyer JD, Yellamanchilli RK, Doherty GM, Gauger PG, Minter RM (2006) Laparoscopic skills are improve with LapMentor Training. Ann Surg 243:854–863PubMedCrossRef
2.
go back to reference Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120PubMedCrossRef Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120PubMedCrossRef
3.
go back to reference Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge DD, Fried GM (2004) Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. J Am Coll Surg 198:105–110PubMedCrossRef Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge DD, Fried GM (2004) Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. J Am Coll Surg 198:105–110PubMedCrossRef
4.
go back to reference Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: ready for widespread use? Surgery 135:28–42PubMedCrossRef Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: ready for widespread use? Surgery 135:28–42PubMedCrossRef
5.
go back to reference Fraser SA, Klasssen DR, Feldman LS, Ghitulescu GA, Stanbridge DD, Fried GM (2004) Setting the pass-fail score for the MISTELS system. Surg Endosc 17:964–967CrossRef Fraser SA, Klasssen DR, Feldman LS, Ghitulescu GA, Stanbridge DD, Fried GM (2004) Setting the pass-fail score for the MISTELS system. Surg Endosc 17:964–967CrossRef
6.
go back to reference Fried GM, Derossis AM, Bothwell J, Sigman HH (1999) Comparison of laparoscopic performance in vivo with performance measured in a laproscopic simulator. Surg Endosc 14:1077–1081CrossRef Fried GM, Derossis AM, Bothwell J, Sigman HH (1999) Comparison of laparoscopic performance in vivo with performance measured in a laproscopic simulator. Surg Endosc 14:1077–1081CrossRef
7.
go back to reference Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge DD, Ghitulescu G, Andrew C (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 40:518–528CrossRef Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge DD, Ghitulescu G, Andrew C (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 40:518–528CrossRef
8.
go back to reference Grantcharov TP, Kristiansen VB, Bendx J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef Grantcharov TP, Kristiansen VB, Bendx J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef
9.
go back to reference Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using Global Operative Assessment of Laparoscopic Skills. J Am Coll Surg 204:308–313PubMedCrossRef Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using Global Operative Assessment of Laparoscopic Skills. J Am Coll Surg 204:308–313PubMedCrossRef
10.
go back to reference Hytlander A, Liljegren E, Rhodin PH, Lonroth H (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc 16:1324–1328CrossRef Hytlander A, Liljegren E, Rhodin PH, Lonroth H (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc 16:1324–1328CrossRef
11.
go back to reference Korndorffer JR, Dunne B, Sierra R, Stefanidis D, Touchard CL, Scott DJ (2005) Simulator training for laparoscopic suturing using performance goals translates to the operating room. J Am Coll Surg 201:23–29PubMedCrossRef Korndorffer JR, Dunne B, Sierra R, Stefanidis D, Touchard CL, Scott DJ (2005) Simulator training for laparoscopic suturing using performance goals translates to the operating room. J Am Coll Surg 201:23–29PubMedCrossRef
12.
go back to reference Korndorffer JR, Stefanidis D, Scott DJ (2006) Lapraoscopic skills laboratories: current assessment and a call for resident training standards. Am J Surg 191:17–22PubMedCrossRef Korndorffer JR, Stefanidis D, Scott DJ (2006) Lapraoscopic skills laboratories: current assessment and a call for resident training standards. Am J Surg 191:17–22PubMedCrossRef
13.
go back to reference Pandey VA, Wolfe JHN, Liapis CD, Bergqvist D, European Board of Vascular Surgery (2006) The examination assessment of technical competence in vascular surgery. Br J Surg 93:1132–1138PubMedCrossRef Pandey VA, Wolfe JHN, Liapis CD, Bergqvist D, European Board of Vascular Surgery (2006) The examination assessment of technical competence in vascular surgery. Br J Surg 93:1132–1138PubMedCrossRef
14.
go back to reference Peters JH, Fried GM, Swanstrom LL, Soper NJ, Silli LF, Schirmer B, Hoffman K, SAGES FLS Commitee (2004) Development and validation of a comprehensive program of education and assessment of basic fundamentals of laparoscopic surgery. Surgery 135:21–27PubMedCrossRef Peters JH, Fried GM, Swanstrom LL, Soper NJ, Silli LF, Schirmer B, Hoffman K, SAGES FLS Commitee (2004) Development and validation of a comprehensive program of education and assessment of basic fundamentals of laparoscopic surgery. Surgery 135:21–27PubMedCrossRef
15.
go back to reference Reznick RK, MacRae H (2006) Teaching surgical skills—changes in the wind. N Engl J Med 355:2664–2669PubMedCrossRef Reznick RK, MacRae H (2006) Teaching surgical skills—changes in the wind. N Engl J Med 355:2664–2669PubMedCrossRef
16.
go back to reference Scott DJ, Bergen PC, Rege RV, Laycock R, Tesfay ST, Valentine RJ, Euhus DM, Jeyarajah DR, Thompson WM, Jones DB (2000) Laparoscopic training on bench models: better and more cost effective than operating room experience. Surgery 198:105–110 Scott DJ, Bergen PC, Rege RV, Laycock R, Tesfay ST, Valentine RJ, Euhus DM, Jeyarajah DR, Thompson WM, Jones DB (2000) Laparoscopic training on bench models: better and more cost effective than operating room experience. Surgery 198:105–110
17.
go back to reference Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance. Ann Surg 236:458–463PubMedCrossRef Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance. Ann Surg 236:458–463PubMedCrossRef
18.
go back to reference Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge DD, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge DD, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef
19.
go back to reference Youngblood PL, Srivastava S, Curet M, Heinrichs WL, Dev P, Wren SM (2005) Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance. J Am Coll Surg 200:546–551PubMedCrossRef Youngblood PL, Srivastava S, Curet M, Heinrichs WL, Dev P, Wren SM (2005) Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance. J Am Coll Surg 200:546–551PubMedCrossRef
Metadata
Title
FLS simulator performance predicts intraoperative laparoscopic skill
Authors
A. L. McCluney
M. C. Vassiliou
P. A. Kaneva
J. Cao
D. D. Stanbridge
L. S. Feldman
G. M. Fried
Publication date
01-11-2007
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 11/2007
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-007-9451-1

Other articles of this Issue 11/2007

Surgical Endoscopy 11/2007 Go to the issue