Skip to main content
Top
Published in: Surgical Endoscopy 4/2014

01-04-2014

Evaluation of surgical fellows’ laparoscopic performance using Global Operative Assessment of Laparoscopic Skills (GOALS)

Authors: Nancy J. Hogle, Yi Liu, R. Todd Ogden, Dennis L. Fowler

Published in: Surgical Endoscopy | Issue 4/2014

Login to get access

Abstract

Background

The acquisition of technical skills is one of the fundamental goals of postgraduate surgical training; however, validation and utilization of objective tools to assess the technical skills of trainees remains elusive. The objectives of this project are to develop models to identify predictive factors for fellow performance, validate the Global Operative Assessment of Laparoscopic Skills (GOALS) as an assessment tool for laparoscopic skills, and to define the learning curve for complex laparoscopic gastrointestinal surgery.

Methods

Using previously recorded data from a centralized database of the Fellowship Council, we analyzed the voluntarily submitted performance scores of surgical fellows for three complex laparoscopic gastrointestinal operations: Roux-en-Y gastric bypass, LapBand placement, and Nissen fundoplication. We analyzed previous experience with complex cases, previous experience with the same type of case, case difficulty, and time of year in the fellowship as potential predictors of performance. Performance scores throughout the fellowship year were graphed to create learning curves for overall performance and each of five domains of performance.

Results

Ninety-eight performance assessments were submitted for 31 unique fellows. Overall performance (p < 0.01), bimanual dexterity (p < 0.01), efficiency (p < 0.01), and autonomy (p < 0.01) all improved significantly throughout the course of the fellowship year. Performance in the domains of depth perception and tissue handling improved, but the improvement did not reach statistical significance. Three predictor variables were significantly related to performance scores.

Conclusions

This study documents that GOALS is able to differentiate novice fellows from graduating fellows and established construct validity. Models developed and tested confirmed that previous experience, case difficulty, and length of time as a fellow impacted performance.
Literature
1.
go back to reference Barnes RW (1987) Surgical handicraft: teaching and learning surgical skills. Am J Surg 153(5):422–427PubMedCrossRef Barnes RW (1987) Surgical handicraft: teaching and learning surgical skills. Am J Surg 153(5):422–427PubMedCrossRef
2.
go back to reference Grober ED, Jewett MA (2006) The concept and trajectory of “operative competence” in surgical training. Can J Surg 49(4):238–240PubMedCentralPubMed Grober ED, Jewett MA (2006) The concept and trajectory of “operative competence” in surgical training. Can J Surg 49(4):238–240PubMedCentralPubMed
3.
go back to reference Moulton CA, Dubrowski A, Macrae H, Graham B, Grober E, Reznick R (2006) Teaching surgical skills: what kind of practice makes perfect? A randomized, controlled trial. Ann Surg 244(3):400–409PubMedCentralPubMed Moulton CA, Dubrowski A, Macrae H, Graham B, Grober E, Reznick R (2006) Teaching surgical skills: what kind of practice makes perfect? A randomized, controlled trial. Ann Surg 244(3):400–409PubMedCentralPubMed
5.
go back to reference Buth J, Harris PL, Maurer PC, Nachbur B, van Urk H (2000) Harmonization of vascular surgical training in Europe. A task for the European Board of Vascular Surgery (EBVS). Cardiovasc Surg 8(2):98–103PubMedCrossRef Buth J, Harris PL, Maurer PC, Nachbur B, van Urk H (2000) Harmonization of vascular surgical training in Europe. A task for the European Board of Vascular Surgery (EBVS). Cardiovasc Surg 8(2):98–103PubMedCrossRef
6.
go back to reference Darzi A, Datta V, Mackay S (2001) The challenge of objective assessment of surgical skill. Am J Surg 181(6):484–486PubMedCrossRef Darzi A, Datta V, Mackay S (2001) The challenge of objective assessment of surgical skill. Am J Surg 181(6):484–486PubMedCrossRef
8.
go back to reference Mackay S, Datta V, Chang A, Shah J, Kneebone R, Darzi A (2003) Multiple objective measures of skill (MOMS): a new approach to the assessment of technical ability in surgical trainees. Ann Surg 238(2):291–300PubMedCentralPubMed Mackay S, Datta V, Chang A, Shah J, Kneebone R, Darzi A (2003) Multiple objective measures of skill (MOMS): a new approach to the assessment of technical ability in surgical trainees. Ann Surg 238(2):291–300PubMedCentralPubMed
9.
go back to reference MacRae H, Regehr G, Leadbetter W, Reznick RK (2000) A comprehensive examination for senior surgical residents. Am J Surg 179(3):190–193PubMedCrossRef MacRae H, Regehr G, Leadbetter W, Reznick RK (2000) A comprehensive examination for senior surgical residents. Am J Surg 179(3):190–193PubMedCrossRef
10.
go back to reference MacRae HM, Cohen R, Regehr G, Reznick R, Burnstein M (1997) A new assessment tool: the patient assessment and management examination. Surgery 122(2):335–343 (discussion 343–334)PubMedCrossRef MacRae HM, Cohen R, Regehr G, Reznick R, Burnstein M (1997) A new assessment tool: the patient assessment and management examination. Surgery 122(2):335–343 (discussion 343–334)PubMedCrossRef
11.
go back to reference Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278PubMedCrossRef Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278PubMedCrossRef
12.
go back to reference Pandey V, Jackson M, Bicknell C, Yapanis M, Darzi A, Wolfe J (2003) Assessing competence in vascular surgery: a pilot study. Br J Surg 90(S1):113 Pandey V, Jackson M, Bicknell C, Yapanis M, Darzi A, Wolfe J (2003) Assessing competence in vascular surgery: a pilot study. Br J Surg 90(S1):113
14.
go back to reference Satava RM, Cuschieri A, Hamdorf J (2003) Metrics for objective assessment. Surg Endosc 17(2):220–226PubMedCrossRef Satava RM, Cuschieri A, Hamdorf J (2003) Metrics for objective assessment. Surg Endosc 17(2):220–226PubMedCrossRef
16.
go back to reference Vassiliou MC, Feldman LS, Andrew CG et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190(1):107–113PubMedCrossRef Vassiliou MC, Feldman LS, Andrew CG et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190(1):107–113PubMedCrossRef
17.
go back to reference Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using Global Operative Assessment of Laparoscopic Skills. J Am Coll Surg 204(2):308–313PubMedCrossRef Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using Global Operative Assessment of Laparoscopic Skills. J Am Coll Surg 204(2):308–313PubMedCrossRef
18.
go back to reference Chang L, Hogle NJ, Moore BB et al (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14(2):122–126PubMedCrossRef Chang L, Hogle NJ, Moore BB et al (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14(2):122–126PubMedCrossRef
19.
go back to reference Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the Global Operative Assessment of Laparoscopic Skills-Groin Hernia (GOALS-GH). Am J Surg 201(1):54–61PubMedCrossRef Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the Global Operative Assessment of Laparoscopic Skills-Groin Hernia (GOALS-GH). Am J Surg 201(1):54–61PubMedCrossRef
20.
go back to reference Ghaderi I, Vaillancourt M, Sroka G et al (2011) Evaluation of surgical performance during laparoscopic incisional hernia repair: a multicenter study. Surg Endosc 25(8):2555–2563PubMedCrossRef Ghaderi I, Vaillancourt M, Sroka G et al (2011) Evaluation of surgical performance during laparoscopic incisional hernia repair: a multicenter study. Surg Endosc 25(8):2555–2563PubMedCrossRef
21.
go back to reference Vaillancourt M, Ghaderi I, Kaneva P et al (2011) GOALS-incisional hernia: a valid assessment of simulated laparoscopic incisional hernia repair. Surg Innov 18(1):48–54PubMedCrossRef Vaillancourt M, Ghaderi I, Kaneva P et al (2011) GOALS-incisional hernia: a valid assessment of simulated laparoscopic incisional hernia repair. Surg Innov 18(1):48–54PubMedCrossRef
22.
go back to reference Schwarz GE (1978) Estimating the dimension of a model. Ann Stat 6(2):461–464CrossRef Schwarz GE (1978) Estimating the dimension of a model. Ann Stat 6(2):461–464CrossRef
Metadata
Title
Evaluation of surgical fellows’ laparoscopic performance using Global Operative Assessment of Laparoscopic Skills (GOALS)
Authors
Nancy J. Hogle
Yi Liu
R. Todd Ogden
Dennis L. Fowler
Publication date
01-04-2014
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 4/2014
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-3324-6

Other articles of this Issue 4/2014

Surgical Endoscopy 4/2014 Go to the issue