Skip to main content
Top
Published in: Surgical Endoscopy 7/2009

01-07-2009

Validation of laparoscopic surgical skills training outside the operating room: a long road

Authors: N. J. Hogle, L. Chang, V. E. M. Strong, A. O. U. Welcome, M. Sinaan, R. Bailey, D. L. Fowler

Published in: Surgical Endoscopy | Issue 7/2009

Login to get access

Abstract

Background

Surgical skills training outside the operating room is beneficial. The best methods have yet to be identified. The authors aimed to document the predictive validity of simulation training in three different studies.

Methods

Study 1 was a prospective, randomized, multicenter trial comparing performance in the operating room after training on a laparoscopic simulator and after no training. The Global Operative Assessment of Laparoscopic Skills (GOALS) was used to evaluate operative performance. Study 2 retrospectively reviewed the operative performance of junior residents before and after implementation of a laparoscopic skills training curriculum. Operative time was the variable used to determine resident improvement. Study 3 was a prospective, randomized trial evaluating intern operative performance of laparoscopic cholecystectomy in a porcine model before and after training on a simulator. Operative performance was assessed using GOALS.

Results

All three studies failed to demonstrate predictive validity. With GOALS used as the assessment tool, no difference was found between trained and untrained residents in studies 1 and 3. In study 2, the trained group took significantly longer to complete a laparoscopic cholecystectomy than the untrained group.

Conclusions

No correlation was found between the three types of training outside the operating room, and no improved operative performance was observed. Possible explanations include too few subjects, training introduced too late in the learning curve, and training criteria that were too easy. Additionally, simulator training focuses on precision, which may actually increase task time. Awareness of these issues can improve the design of future studies.
Literature
1.
go back to reference Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15:1080–1084CrossRefPubMed Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15:1080–1084CrossRefPubMed
2.
3.
go back to reference Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30:617–620CrossRefPubMed Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30:617–620CrossRefPubMed
4.
go back to reference Halstead W (1906) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275 Halstead W (1906) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275
5.
go back to reference Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements in 2005 Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements in 2005
6.
go back to reference Fried GM (1994) General surgery residency training: a time for change? Can J Surg 37:261–262PubMed Fried GM (1994) General surgery residency training: a time for change? Can J Surg 37:261–262PubMed
7.
go back to reference Fried GM (2006) Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin North Am 16:425–434CrossRef Fried GM (2006) Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin North Am 16:425–434CrossRef
8.
go back to reference Bass BL (2007) Fundamental changes in general surgery residency training. Am Surg 73:109–113PubMed Bass BL (2007) Fundamental changes in general surgery residency training. Am Surg 73:109–113PubMed
9.
go back to reference Rogers DA, Elstein AS, Bordage G (2001) Improving continuing medical education for surgical techniques: applying the lessons learned in the first decade of minimal access surgery. Ann Surg 233:159–166CrossRefPubMed Rogers DA, Elstein AS, Bordage G (2001) Improving continuing medical education for surgical techniques: applying the lessons learned in the first decade of minimal access surgery. Ann Surg 233:159–166CrossRefPubMed
10.
go back to reference Stefanidis D, Korndorffer JR Jr, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205:307–313CrossRefPubMed Stefanidis D, Korndorffer JR Jr, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205:307–313CrossRefPubMed
11.
go back to reference Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed
12.
go back to reference Ahlberg G, Heikkinen T, Iselius L, Leijonmarck CE, Rutqvist J, Arvidsson D (2002) Does training in a virtual reality simulator improve surgical performance? Surg Endosc 16:126–129CrossRefPubMed Ahlberg G, Heikkinen T, Iselius L, Leijonmarck CE, Rutqvist J, Arvidsson D (2002) Does training in a virtual reality simulator improve surgical performance? Surg Endosc 16:126–129CrossRefPubMed
13.
go back to reference Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR). Endoscopy 31:310–313CrossRefPubMed Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR). Endoscopy 31:310–313CrossRefPubMed
14.
go back to reference Kolkman W, Van de Put MA, Van den Hout WB, Trimbos JB, Jansen FW (2007) Implementation of the laparoscopic simulator in a gynecological residency curriculum. Surg Endosc 21:1363–1368CrossRefPubMed Kolkman W, Van de Put MA, Van den Hout WB, Trimbos JB, Jansen FW (2007) Implementation of the laparoscopic simulator in a gynecological residency curriculum. Surg Endosc 21:1363–1368CrossRefPubMed
15.
go back to reference Rosser JC Jr, Rosser LE, Savalgi RS (1998) Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. Arch Surg 133:657–661CrossRefPubMed Rosser JC Jr, Rosser LE, Savalgi RS (1998) Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. Arch Surg 133:657–661CrossRefPubMed
16.
go back to reference Stovall DW, Fernandez AS, Cohen SA (2006) Laparoscopy training in United States obstetric and gynecology residency programs. J Soc Laparoendosc Surg 10:11–15 Stovall DW, Fernandez AS, Cohen SA (2006) Laparoscopy training in United States obstetric and gynecology residency programs. J Soc Laparoendosc Surg 10:11–15
17.
go back to reference Chaer RA, Derubertis BG, Lin SC, Bush HL, Karwowski JK, Birk D, Morrissey NJ, Faries PL, McKinsey JF, Kent KC (2006) Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244:343–352PubMed Chaer RA, Derubertis BG, Lin SC, Bush HL, Karwowski JK, Birk D, Morrissey NJ, Faries PL, McKinsey JF, Kent KC (2006) Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244:343–352PubMed
18.
go back to reference Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMed Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMed
19.
go back to reference Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed
20.
go back to reference Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454CrossRefPubMed Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454CrossRefPubMed
21.
go back to reference Boyd KB, Olivier J, Salameh JR (2006) Surgical residents’ perception of simulation training. Am Surg 72:521–524PubMed Boyd KB, Olivier J, Salameh JR (2006) Surgical residents’ perception of simulation training. Am Surg 72:521–524PubMed
22.
go back to reference Seymour NE (2008) VR to OR: a review of the evidence that virtual reality simulation improves operating room performance. World J Surg 32:182–188CrossRefPubMed Seymour NE (2008) VR to OR: a review of the evidence that virtual reality simulation improves operating room performance. World J Surg 32:182–188CrossRefPubMed
23.
go back to reference Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, Committee SF (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27CrossRefPubMed Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, Committee SF (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27CrossRefPubMed
24.
go back to reference Lentz GM, Mandel LS, Goff BA (2005) A six-year study of surgical teaching and skills evaluation for obstetric/gynecologic residents in porcine and inanimate surgical models. Am J Obstet Gynecol 193:2056–2061CrossRefPubMed Lentz GM, Mandel LS, Goff BA (2005) A six-year study of surgical teaching and skills evaluation for obstetric/gynecologic residents in porcine and inanimate surgical models. Am J Obstet Gynecol 193:2056–2061CrossRefPubMed
25.
go back to reference Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager AM, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338 discussion 1338–1340CrossRefPubMed Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager AM, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338 discussion 1338–1340CrossRefPubMed
26.
go back to reference Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120CrossRefPubMed Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120CrossRefPubMed
27.
go back to reference Adrales GL, Chu UB, Hoskins JD, Witzke DB, Park AE (2004) Development of a valid, cost-effective laparoscopic training program. Am J Surg 187:157–163CrossRefPubMed Adrales GL, Chu UB, Hoskins JD, Witzke DB, Park AE (2004) Development of a valid, cost-effective laparoscopic training program. Am J Surg 187:157–163CrossRefPubMed
28.
go back to reference Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296PubMed Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296PubMed
29.
go back to reference Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783CrossRefPubMed Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783CrossRefPubMed
30.
go back to reference Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230CrossRefPubMed Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230CrossRefPubMed
31.
go back to reference Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387CrossRef Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387CrossRef
32.
go back to reference Duffy A, Hogle N, McCarthy H, Lew J, Egan A, Christos P, Fowler D (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed Duffy A, Hogle N, McCarthy H, Lew J, Egan A, Christos P, Fowler D (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed
33.
go back to reference Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32CrossRefPubMed Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32CrossRefPubMed
34.
go back to reference van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417CrossRefPubMed van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417CrossRefPubMed
35.
go back to reference Chang L, Hogle NJ, Moore BB, Graham MJ, Sinanan MN, Bailey R, Fowler DL (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14:122–126CrossRefPubMed Chang L, Hogle NJ, Moore BB, Graham MJ, Sinanan MN, Bailey R, Fowler DL (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14:122–126CrossRefPubMed
36.
go back to reference Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779CrossRefPubMed Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779CrossRefPubMed
37.
go back to reference Brunner WC, Korndorffer JR Jr, Sierra R, Massarweh NN, Dunne JB, Yau CL, Scott DJ (2004) Laparoscopic virtual reality training: are 30 repetitions enough? J Surg Res 122:50–156CrossRef Brunner WC, Korndorffer JR Jr, Sierra R, Massarweh NN, Dunne JB, Yau CL, Scott DJ (2004) Laparoscopic virtual reality training: are 30 repetitions enough? J Surg Res 122:50–156CrossRef
Metadata
Title
Validation of laparoscopic surgical skills training outside the operating room: a long road
Authors
N. J. Hogle
L. Chang
V. E. M. Strong
A. O. U. Welcome
M. Sinaan
R. Bailey
D. L. Fowler
Publication date
01-07-2009
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 7/2009
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-009-0379-5

Other articles of this Issue 7/2009

Surgical Endoscopy 7/2009 Go to the issue