Skip to main content
Top
Published in: Surgical Endoscopy 9/2019

01-09-2019

Computerized model for objectively evaluating cutting performance using a laparoscopic box trainer simulator

Authors: Amir Handelman, Shani Schnaider, Adva Schwartz-Ossad, Refael Barkan, Ronnie Tepper

Published in: Surgical Endoscopy | Issue 9/2019

Login to get access

Abstract

Background

Laparoscopic box trainer simulator has recently become a tool for assessment of physicians’ surgical and laparoscopic skills, and training using such a simulator has been incorporated into the curricula of surgery syllabus. With the increased use of box trainer simulators, there is a great need for obtaining reliable and objective evaluations of the trainees’ performances. Here, we introduce an automated tool for assessing laparoscopic cutting performance by using image-processing algorithms.

Methods

Twenty-seven interns specializing in the fields of gynecology, urology and general surgery participated in 4–6 training sessions, in which each trainee cut a circular patch positioned inside a low-cost laparoscopic box trainer simulator. The trainees’ performances were analyzed using software that we developed. The analysis of the trainees’ performances was based upon quantitative measurements of the following four parameters obtained in each training session: standard deviation, circle-cutout area, skewness, and number of peaks. We believe that high performance in terms of a combination of the four parameters provides a reliable measure of good laparoscopic skills, and therefore we developed the software so as to generate, for each session, a score of a trainee’s laparoscopic circle-cutout performance that results from achievements related to the four parameters in combination.

Results

On average, the total score of experienced interns was higher than the total score of inexperienced interns. Also, some improvement from session-to-session in the scores of novice trainees was detected.

Conclusions

Our proposed scoring system, which is based on various image-processing algorithms, can evaluate cutting performances of trainees and classify residents by their experience. This allows each trainee to improve his/her performance by analyzing errors indicated by our software.
Appendix
Available only for authorised users
Literature
2.
go back to reference Csikesz NG, Singla A, Murphy MM, Tseng JF, Shah SA (2010) Surgeon volume metrics in laparoscopic cholecystectomy. Dig Dis Sci 55(8):2398–2405CrossRefPubMed Csikesz NG, Singla A, Murphy MM, Tseng JF, Shah SA (2010) Surgeon volume metrics in laparoscopic cholecystectomy. Dig Dis Sci 55(8):2398–2405CrossRefPubMed
4.
go back to reference Sooriakumaran P, Srivastava A, Shariat SF, Stricker PD, Ahlering T, Eden CG, Wiklund PN, Sanchez-Salas R, Mottrie A, Lee D, Neal DE, Ghavamian R, Nyirady P, Nilsson A, Carlsson S, Xylinas E, Loidl W, Seitz C, Schramek P, Roehrborn C, Cathelineau X, Skarecky D, Shaw G, Warren A, Delprado WJ, Haynes AM, Steyerberg E, Roobol MJ, Tewari AK (2014) A multinational, multi-institutional study comparing positive surgical margin rates among 22393 open, laparoscopic, and robot-assisted radical prostatectomy patients. Eur Urol 66(3):450–456CrossRefPubMed Sooriakumaran P, Srivastava A, Shariat SF, Stricker PD, Ahlering T, Eden CG, Wiklund PN, Sanchez-Salas R, Mottrie A, Lee D, Neal DE, Ghavamian R, Nyirady P, Nilsson A, Carlsson S, Xylinas E, Loidl W, Seitz C, Schramek P, Roehrborn C, Cathelineau X, Skarecky D, Shaw G, Warren A, Delprado WJ, Haynes AM, Steyerberg E, Roobol MJ, Tewari AK (2014) A multinational, multi-institutional study comparing positive surgical margin rates among 22393 open, laparoscopic, and robot-assisted radical prostatectomy patients. Eur Urol 66(3):450–456CrossRefPubMed
5.
go back to reference Hidlebaugh DA, Vulgaropulos S, Orr RK (1997) Treating adnexal masses. Operative laparoscopy vs. laparotomy. J Reprod Med 42(9):551–558PubMed Hidlebaugh DA, Vulgaropulos S, Orr RK (1997) Treating adnexal masses. Operative laparoscopy vs. laparotomy. J Reprod Med 42(9):551–558PubMed
6.
go back to reference Magrina JF (2002) Complications of laparoscopic surgery. Clin Obstet Gynecol 45(2):469–480CrossRef Magrina JF (2002) Complications of laparoscopic surgery. Clin Obstet Gynecol 45(2):469–480CrossRef
7.
go back to reference Trottier DC, Martel G, Boushey RP (2009) Complications in laparoscopic intestinal surgery: prevention and management. Minerva Chir 64:339–354PubMed Trottier DC, Martel G, Boushey RP (2009) Complications in laparoscopic intestinal surgery: prevention and management. Minerva Chir 64:339–354PubMed
8.
go back to reference Munz Y, Kumar BD, Moorthy K, Bann S, Darzi A (2004) Laparoscopic virtual reality and box trainers: is one superior to the other? Surg Endosc 18:485–494CrossRefPubMed Munz Y, Kumar BD, Moorthy K, Bann S, Darzi A (2004) Laparoscopic virtual reality and box trainers: is one superior to the other? Surg Endosc 18:485–494CrossRefPubMed
10.
go back to reference van Empel PJ, van der Veer WM, van Rijssen LB, Cuesta MA, Scheele F, Bonjer HJ, Meijerink WJ (2010) Mapping the maze of minimally invasive surgery simulators. J Lap Adv Surg Tech A 22:51–60CrossRef van Empel PJ, van der Veer WM, van Rijssen LB, Cuesta MA, Scheele F, Bonjer HJ, Meijerink WJ (2010) Mapping the maze of minimally invasive surgery simulators. J Lap Adv Surg Tech A 22:51–60CrossRef
11.
go back to reference Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, SAGES FLS Committee (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27CrossRefPubMed Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, SAGES FLS Committee (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27CrossRefPubMed
13.
go back to reference Scott DJ, Ritter EM, Tesfay ST, Pimentel EA, Nagji A, Fried GM (2008) Certification pass rate of 100% for fundamentals of laparoscopic surgery skills after proficiency-based training. Surg Endosc 22:1887CrossRefPubMed Scott DJ, Ritter EM, Tesfay ST, Pimentel EA, Nagji A, Fried GM (2008) Certification pass rate of 100% for fundamentals of laparoscopic surgery skills after proficiency-based training. Surg Endosc 22:1887CrossRefPubMed
14.
go back to reference Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. AM J Surg 199(1):115–120CrossRefPubMed Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. AM J Surg 199(1):115–120CrossRefPubMed
15.
go back to reference Beyer L, Troyer JD, Mancini J, Bladou F, Berdah SV, Karsenty G (2011) Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. AM J Surg 202(3):265–272CrossRefPubMed Beyer L, Troyer JD, Mancini J, Bladou F, Berdah SV, Karsenty G (2011) Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. AM J Surg 202(3):265–272CrossRefPubMed
16.
go back to reference De Win G, Van Bruwaene S, Kulkarni J, Van Calster B, Aggarwal R, Allen C, Lissens A, De Ridder D, Miserez M (2016) An evidence-based laparoscopic simulation curriculum shortens the clinical learning curve and reduces surgical adverse events. Adv Med Edu Prac 7:357–370CrossRef De Win G, Van Bruwaene S, Kulkarni J, Van Calster B, Aggarwal R, Allen C, Lissens A, De Ridder D, Miserez M (2016) An evidence-based laparoscopic simulation curriculum shortens the clinical learning curve and reduces surgical adverse events. Adv Med Edu Prac 7:357–370CrossRef
17.
go back to reference McCluney AL, Vassiliou MC, Kaneva PA, Cao J, Stanbridge DD, Feldman LS, Fried GM (2007) FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc 21(11):1991–1995CrossRefPubMed McCluney AL, Vassiliou MC, Kaneva PA, Cao J, Stanbridge DD, Feldman LS, Fried GM (2007) FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc 21(11):1991–1995CrossRefPubMed
18.
go back to reference Wong J, Bhattacharya G, Vance SJ, Bistolarides P, Merchant AM (2013) Construction and validation of a low-cost laparoscopic simulator for surgical education. J Surg Educ 70(4):443–450CrossRefPubMed Wong J, Bhattacharya G, Vance SJ, Bistolarides P, Merchant AM (2013) Construction and validation of a low-cost laparoscopic simulator for surgical education. J Surg Educ 70(4):443–450CrossRefPubMed
19.
go back to reference Shepherd G, von Delft D, Truck J, Kubiak R, Ashour K, Grant H (2016) A simple scoring system to train surgeons in basic laparoscopic skills. Pediatr Surg Int 32(3):245–252CrossRefPubMed Shepherd G, von Delft D, Truck J, Kubiak R, Ashour K, Grant H (2016) A simple scoring system to train surgeons in basic laparoscopic skills. Pediatr Surg Int 32(3):245–252CrossRefPubMed
20.
go back to reference Nataraja RM, Ade-Ajayi N, Curry JI (2006) Surgical skills training in the laparoscopic era: the use of a helping hand. Pediatr Surg Int 22:1015–1020CrossRefPubMed Nataraja RM, Ade-Ajayi N, Curry JI (2006) Surgical skills training in the laparoscopic era: the use of a helping hand. Pediatr Surg Int 22:1015–1020CrossRefPubMed
21.
go back to reference Van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRef Van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRef
22.
go back to reference Brackmann MW, Andreatta P, McLean K, Reynolds RK (2016) Development of a novel simulation model for assessment of laparoscopic camera navigation. Surg Endosc. 31:3033–3039CrossRefPubMed Brackmann MW, Andreatta P, McLean K, Reynolds RK (2016) Development of a novel simulation model for assessment of laparoscopic camera navigation. Surg Endosc. 31:3033–3039CrossRefPubMed
23.
go back to reference Chmarra MK, Klein S, de Winter JCF, Jansen FW, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24(5):1031–1039CrossRefPubMed Chmarra MK, Klein S, de Winter JCF, Jansen FW, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24(5):1031–1039CrossRefPubMed
24.
go back to reference Ghasemloonia A, Maddahi Y, Zareinia K, Lama S, Dort JC, Sutherland GR (2017) Surgical skill assessment using motion quality and smoothness. J Surg Educ 74(2):295–305CrossRef Ghasemloonia A, Maddahi Y, Zareinia K, Lama S, Dort JC, Sutherland GR (2017) Surgical skill assessment using motion quality and smoothness. J Surg Educ 74(2):295–305CrossRef
25.
go back to reference Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondré K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113CrossRef Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondré K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113CrossRef
26.
go back to reference Gonzalez RC (2007) Digital image processing, 3rd edn. Pearson International Edition, New Delhi Gonzalez RC (2007) Digital image processing, 3rd edn. Pearson International Edition, New Delhi
27.
go back to reference Jain R, Kasturi R, Schunck BG (1995) Machine Vision. McGraw-Hill, New York Jain R, Kasturi R, Schunck BG (1995) Machine Vision. McGraw-Hill, New York
28.
go back to reference Jolliffe IT (2002) Principal component analysis, 2nd edn. Springer, New York Jolliffe IT (2002) Principal component analysis, 2nd edn. Springer, New York
Metadata
Title
Computerized model for objectively evaluating cutting performance using a laparoscopic box trainer simulator
Authors
Amir Handelman
Shani Schnaider
Adva Schwartz-Ossad
Refael Barkan
Ronnie Tepper
Publication date
01-09-2019
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 9/2019
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-018-6598-x

Other articles of this Issue 9/2019

Surgical Endoscopy 9/2019 Go to the issue