Skip to main content
Top
Published in: Surgical Endoscopy 1/2009

01-01-2009

Simulation in laparoscopic surgery: a concurrent validity study for FLS

Authors: George Xeroulis, Adam Dubrowski, Ken Leslie

Published in: Surgical Endoscopy | Issue 1/2009

Login to get access

Abstract

Background

Current assessments using the fundamentals of laparoscopic surgery (FLS) tasks are labour intensive and depend heavily on expert raters. Hand motion analysis may offer an alternative method of objective evaluation of FLS performance.

Purpose

The aim of this study was to assess whether a correlation exists between the expert rated assessments of the FLS tasks and computer-based assessment of motion efficiency using the Imperial College surgical assessment device (ICSAD).

Methods

We recruited 26 volunteer subjects who were stratified into three experience groups: juniors (PGY1–3) (N = 13), seniors (PGY4,5) (N = 7) and staff surgeons (N = 6). All subjects performed four FLS tasks: (1) peg transfer, (2) pattern cut, (3) endoloop and (4) intracorporeal suturing. Performance was assessed by both standard FLS expert rating and motion analysis using ICSAD. Group differences were analyzed using the Kruskal–Wallis test, and Spearman coefficient analyses were employed to compare FLS and ICSAD scores.

Results

FLS expert-derived scores discriminated effectively between experience groups for all tasks (p < 0.05). Motion efficiency scores discriminated between experience groups for tasks 1, 3 and 4 for number of movements (p < 0.05), tasks 1 and 4 for total distance (p < 0.05) and tasks 1, 2, 3 and 4 for total time (p < 0.005). There was a significant correlation between total FLS expert scores and the motion efficiency metrics of total distance, number of movements and total time (Spearman coefficient and p values of 0.81, < 0.001; 0.76; < 0.001; and 0.93, < 0.001, respectively).

Conclusion

There is a high correlation between FLS standard scoring and motion efficiency metrics. The use of ICSAD for the objective assessment of FLS tasks may in the future offer an adjunctive method of evaluation. ICSAD metrics are potentially less labour intensive due to the instant and fully automated computerized scoring that it provides.
Literature
1.
go back to reference Feldman LS, Sherman V, Fried GM (2004) Using simulation to assess laparoscopic competence: ready for widespread use? Surgery 135:28–42PubMedCrossRef Feldman LS, Sherman V, Fried GM (2004) Using simulation to assess laparoscopic competence: ready for widespread use? Surgery 135:28–42PubMedCrossRef
2.
go back to reference Fried GM (2004) Simulators for laparoscopic surgery: a coming of age. Asian J Surg 27:1–3PubMed Fried GM (2004) Simulators for laparoscopic surgery: a coming of age. Asian J Surg 27:1–3PubMed
3.
go back to reference Fried GM, Feldman LS, Vasiliou MC, Fraser SA, Stanbridge D, Ghitulescu G, Andrew C (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 243(3):518–528CrossRef Fried GM, Feldman LS, Vasiliou MC, Fraser SA, Stanbridge D, Ghitulescu G, Andrew C (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 243(3):518–528CrossRef
5.
go back to reference McCluney AL, Cao J, Polyhronopoulos GN, Stanbridge DD, Feldman LS, Fried GM (2007) Automated ProMIS Simulator metrics predict readiness for FLS certification SAGES 2007 Education/Outcomes - P279 McCluney AL, Cao J, Polyhronopoulos GN, Stanbridge DD, Feldman LS, Fried GM (2007) Automated ProMIS Simulator metrics predict readiness for FLS certification SAGES 2007 Education/Outcomes - P279
6.
go back to reference Datta V, Mackay S, Mandalia M, Darzi A (2001) The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 193:479–485PubMedCrossRef Datta V, Mackay S, Mandalia M, Darzi A (2001) The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 193:479–485PubMedCrossRef
7.
go back to reference Xeroulis GJ, Park J, Moulton C, Reznick RK, Leblanc V, Dubrowski A (2007) Teaching basic surgical skills: a randomized trial comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 141(4):442–449. Epub 2007 Jan 25PubMedCrossRef Xeroulis GJ, Park J, Moulton C, Reznick RK, Leblanc V, Dubrowski A (2007) Teaching basic surgical skills: a randomized trial comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 141(4):442–449. Epub 2007 Jan 25PubMedCrossRef
8.
go back to reference Brydges R, Classen R, Larmer J, Xeroulis G, Dubrowski A (2006) Computer assisted assessment of one-handed knot tying skills at varying complexity levels: construct validity study. Am J Surg 192(1):109–113PubMedCrossRef Brydges R, Classen R, Larmer J, Xeroulis G, Dubrowski A (2006) Computer assisted assessment of one-handed knot tying skills at varying complexity levels: construct validity study. Am J Surg 192(1):109–113PubMedCrossRef
9.
go back to reference Datta V, Chang A, Mackay S, Darzi A (2002) The relationship between motion analysis and surgical technical assessments. Am J Surg 184:70–73PubMedCrossRef Datta V, Chang A, Mackay S, Darzi A (2002) The relationship between motion analysis and surgical technical assessments. Am J Surg 184:70–73PubMedCrossRef
10.
go back to reference Taffinder NJ, Smith S, Mair J (1999) Can a computer measure surgical precision? Reliability, validity and feasibility of the ICSAD. Surg Endosc 13(suppl 1):81 Taffinder NJ, Smith S, Mair J (1999) Can a computer measure surgical precision? Reliability, validity and feasibility of the ICSAD. Surg Endosc 13(suppl 1):81
11.
go back to reference Taffinder N, Smith S, Huber J, Russell RC, Darzi A (1999) The effects of a second generation 3D endoscope on the laparoscopic precision of novices and experienced surgeons. Surg Endosc 13:1087–1092PubMedCrossRef Taffinder N, Smith S, Huber J, Russell RC, Darzi A (1999) The effects of a second generation 3D endoscope on the laparoscopic precision of novices and experienced surgeons. Surg Endosc 13:1087–1092PubMedCrossRef
12.
go back to reference Aggarwal R, Moorthy K, Darzi A (2004) Laparoscopic skills training and assessment. Br J Surg 91:1549–1558PubMedCrossRef Aggarwal R, Moorthy K, Darzi A (2004) Laparoscopic skills training and assessment. Br J Surg 91:1549–1558PubMedCrossRef
13.
go back to reference Aggarwal R, Hance J, Darzi A (2004) Surgical education and training in the new millennium. Surg Endosc 18:1409–1410PubMedCrossRef Aggarwal R, Hance J, Darzi A (2004) Surgical education and training in the new millennium. Surg Endosc 18:1409–1410PubMedCrossRef
14.
go back to reference Porte MC, Xeroulis G, Reznick RK, Dubrowski A (2007) Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. Am J Surg 193(1):105–110PubMedCrossRef Porte MC, Xeroulis G, Reznick RK, Dubrowski A (2007) Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. Am J Surg 193(1):105–110PubMedCrossRef
15.
go back to reference Jowett NT, LeBlanc V, Xeroulis G, MacRae H, Dubrowski A (2007) Self-assessment of surgical skill learning with computer-based video training and the impact on self-directed training. Am J Surg 193(2):237–242PubMedCrossRef Jowett NT, LeBlanc V, Xeroulis G, MacRae H, Dubrowski A (2007) Self-assessment of surgical skill learning with computer-based video training and the impact on self-directed training. Am J Surg 193(2):237–242PubMedCrossRef
16.
go back to reference Fitts PM, Posner MI (1967) Learning and skilled performance in human performance. Brock-Cole, Belmont Fitts PM, Posner MI (1967) Learning and skilled performance in human performance. Brock-Cole, Belmont
17.
go back to reference McCluney AL, Feldman LS, Fried GM (2006) Validation of the ProMIS hybrid simulator using a standard set of laparoscopic tasks. SAGES 2006 Education/Outcomes-P237 McCluney AL, Feldman LS, Fried GM (2006) Validation of the ProMIS hybrid simulator using a standard set of laparoscopic tasks. SAGES 2006 Education/Outcomes-P237
18.
go back to reference Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW (2007) Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc 21(8):1441–1445PubMedCrossRef Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW (2007) Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc 21(8):1441–1445PubMedCrossRef
19.
go back to reference Rogers DA, Regehr G, Yeh KA, Howdieshell TR (1998) Computer-assisted learning versus a lecture and feedback seminar for teaching a basic surgical technical skill. Am J Surg 175:508–510PubMedCrossRef Rogers DA, Regehr G, Yeh KA, Howdieshell TR (1998) Computer-assisted learning versus a lecture and feedback seminar for teaching a basic surgical technical skill. Am J Surg 175:508–510PubMedCrossRef
20.
go back to reference Custers EJ, Regehr G, McCulloch W, Peniston C, Reznick R (1999) The effects of modeling on learning a simple surgical procedure: see one, do one or see many, do one? Adv Health Sci Educ Theory Pract 4:123–143PubMedCrossRef Custers EJ, Regehr G, McCulloch W, Peniston C, Reznick R (1999) The effects of modeling on learning a simple surgical procedure: see one, do one or see many, do one? Adv Health Sci Educ Theory Pract 4:123–143PubMedCrossRef
21.
go back to reference Smith CD, Farrell TM, McNatt SS, Metreveli RE (2001) Assessing laparoscopic manipulative skills. Am J Surg 181:547–550PubMedCrossRef Smith CD, Farrell TM, McNatt SS, Metreveli RE (2001) Assessing laparoscopic manipulative skills. Am J Surg 181:547–550PubMedCrossRef
22.
go back to reference Moulton CA, Dubrowski A, Macrae H, Graham B, Grober E, Reznick R (2006) Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Ann Surg 244(3):400–409PubMed Moulton CA, Dubrowski A, Macrae H, Graham B, Grober E, Reznick R (2006) Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Ann Surg 244(3):400–409PubMed
24.
go back to reference Dosis A, Aggarwal R, Bello F, Moorthy K, Munz Y, Gillies D, Darzi A (2005) Synchronized video and motion analysis for the assessment of procedures in the operating theater. Arch Surg 140:293–299PubMedCrossRef Dosis A, Aggarwal R, Bello F, Moorthy K, Munz Y, Gillies D, Darzi A (2005) Synchronized video and motion analysis for the assessment of procedures in the operating theater. Arch Surg 140:293–299PubMedCrossRef
Metadata
Title
Simulation in laparoscopic surgery: a concurrent validity study for FLS
Authors
George Xeroulis
Adam Dubrowski
Ken Leslie
Publication date
01-01-2009
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 1/2009
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-008-0120-9

Other articles of this Issue 1/2009

Surgical Endoscopy 1/2009 Go to the issue