Skip to main content
Top
Published in: Obesity Surgery 7/2021

01-07-2021 | Sleeve Gastrectomy | Original Contributions

Video-Rated Performance Assessment of Simulated Laparoscopic Sleeve Gastrectomy: Validation of a Sleeve Gastrectomy Rating Scale

Authors: Ruth E. Blackham, Jeffrey M. Hamdorf

Published in: Obesity Surgery | Issue 7/2021

Login to get access

Abstract

Purpose

The global rise in obesity has been accompanied by widespread uptake of the procedure of laparoscopic sleeve gastrectomy. Despite this, the key components for performance assessment have not been standardized for this procedure. The aim of this study was to develop and demonstrate the validity of a Sleeve Objective Structured Assessment of Technical Skill (SOSATS) scale for learning the procedure of laparoscopic sleeve gastrectomy (LSG).

Materials and Methods

The SOSATS evaluation tool was based upon critical steps of the LSG procedure. Both the SOSATS and the Global Rating Scale (GRS) component of the Objective Structured Assessment of Technical Skill (OSATS) tools were utilized in a prospective single-blinded observational study design of 26 video recordings of surgeons performing sleeve gastrectomies using a novel simulation. The surgeons were allocated into “novice” or “experienced” groups dependent on case-volume criteria. Surgical performance was assessed using both the GRS and SOSATS scales by blinded assessors of the video recordings.

Results

Face and content validity were demonstrated for key components of the simulated model. An overall positive correlation was established inferring concurrent validity between the accepted OSATS Global Rating Scale against the SOSATS procedural scale. Construct validity was established for a number of areas of the SOSATS scale.

Conclusion

The SOSATS scale is shown to exhibit construct and concurrent validity in the simulated setting for the procedure of sleeve gastrectomy. Utilizing this scale to review surgical performance is potentially feasible and reliable but would require further research prior to use in high-stakes assessment processes such as credentialing.

Graphical Abstract

Literature
1.
go back to reference Angrisani L, Santonicola A, Iovino P, et al. IFSO Worldwide Survey 2016: Primary, endoluminal, and revisional procedures. Obes Surg. 2018;28(12):3783–94.CrossRef Angrisani L, Santonicola A, Iovino P, et al. IFSO Worldwide Survey 2016: Primary, endoluminal, and revisional procedures. Obes Surg. 2018;28(12):3783–94.CrossRef
2.
go back to reference Bonrath EM, Weiner S, Birk D, et al. Training in bariatric surgery: a National Survey of German Bariatric Surgeons. Obes Surg. 2020;30(1):56–62.CrossRef Bonrath EM, Weiner S, Birk D, et al. Training in bariatric surgery: a National Survey of German Bariatric Surgeons. Obes Surg. 2020;30(1):56–62.CrossRef
3.
go back to reference Blencowe NS, Parsons BA, Hollowood AD. Effects of changing work patterns on general surgical training over the last decade. Postgrad Med J. 2011;87(1034):795–9.CrossRef Blencowe NS, Parsons BA, Hollowood AD. Effects of changing work patterns on general surgical training over the last decade. Postgrad Med J. 2011;87(1034):795–9.CrossRef
4.
go back to reference Tunitsky-Bitton E, King CR, Ridgeway B, et al. Development and validation of a laparoscopic sacrocolpopexy simulation model for surgical training. J Minim Invasive Gynecol. 2014;21(4):612–8.CrossRef Tunitsky-Bitton E, King CR, Ridgeway B, et al. Development and validation of a laparoscopic sacrocolpopexy simulation model for surgical training. J Minim Invasive Gynecol. 2014;21(4):612–8.CrossRef
5.
go back to reference Major P, Wysocki M, Dworak J, et al. Analysis of laparoscopic sleeve gastrectomy learning curve and its influence on procedure safety and perioperative complications. Obes Surg. 2018;28(6):1672–80.CrossRef Major P, Wysocki M, Dworak J, et al. Analysis of laparoscopic sleeve gastrectomy learning curve and its influence on procedure safety and perioperative complications. Obes Surg. 2018;28(6):1672–80.CrossRef
6.
go back to reference Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273–8.PubMed Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273–8.PubMed
7.
go back to reference Higgins M, Madan C, Patel R. Development and decay of procedural skills in surgery: a systematic review of the effectiveness of simulation-based medical education interventions. Surgeon. 2020. Higgins M, Madan C, Patel R. Development and decay of procedural skills in surgery: a systematic review of the effectiveness of simulation-based medical education interventions. Surgeon. 2020.
8.
go back to reference Breimer GE, Haji FA, Hoving EW, et al. Development and content validation of performance assessments for endoscopic third ventriculostomy. Childs Nerv Syst. 2015;31(8):1247–59.CrossRef Breimer GE, Haji FA, Hoving EW, et al. Development and content validation of performance assessments for endoscopic third ventriculostomy. Childs Nerv Syst. 2015;31(8):1247–59.CrossRef
9.
go back to reference Hussein N, Lim A, Honjo O, et al. Development and validation of a procedure-specific assessment tool for hands-on surgical training in congenital heart surgery. J Thorac Cardiovasc Surg. 2020;160(1):229–40. e1CrossRef Hussein N, Lim A, Honjo O, et al. Development and validation of a procedure-specific assessment tool for hands-on surgical training in congenital heart surgery. J Thorac Cardiovasc Surg. 2020;160(1):229–40. e1CrossRef
10.
go back to reference Strom M, Lonn L, Konge L, et al. Assessment of EVAR competence: validity of a Novel Rating Scale (EVARATE) in a simulated setting. Eur J Vasc Endovasc Surg. 2018;56(1):137–44.CrossRef Strom M, Lonn L, Konge L, et al. Assessment of EVAR competence: validity of a Novel Rating Scale (EVARATE) in a simulated setting. Eur J Vasc Endovasc Surg. 2018;56(1):137–44.CrossRef
11.
go back to reference Freeman ML. Training and competence in gastrointestinal endoscopy. Rev Gastroenterol Disord. 2001;1(2):73–86.PubMed Freeman ML. Training and competence in gastrointestinal endoscopy. Rev Gastroenterol Disord. 2001;1(2):73–86.PubMed
12.
13.
go back to reference Fried GM. FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg. 2008;12(2):210–2.CrossRef Fried GM. FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg. 2008;12(2):210–2.CrossRef
14.
go back to reference Vaidya A, Aydin A, Ridgley J, et al. Current status of technical skills assessment tools in surgery: a systematic review. J Surg Res. 2020;246:342–78.CrossRef Vaidya A, Aydin A, Ridgley J, et al. Current status of technical skills assessment tools in surgery: a systematic review. J Surg Res. 2020;246:342–78.CrossRef
15.
go back to reference Uemura M, Tomikawa M, Miao T, et al. Feasibility of an AI-based measure of the hand motions of expert and novice surgeons. Comput Math Methods Med. 2018;2018:9873273.CrossRef Uemura M, Tomikawa M, Miao T, et al. Feasibility of an AI-based measure of the hand motions of expert and novice surgeons. Comput Math Methods Med. 2018;2018:9873273.CrossRef
16.
go back to reference Kowalewski KF, Garrow CR, Schmidt MW, et al. Sensor-based machine learning for workflow detection and as key to detect expert level in laparoscopic suturing and knot-tying. Surg Endosc. 2019;33(11):3732–40.CrossRef Kowalewski KF, Garrow CR, Schmidt MW, et al. Sensor-based machine learning for workflow detection and as key to detect expert level in laparoscopic suturing and knot-tying. Surg Endosc. 2019;33(11):3732–40.CrossRef
17.
go back to reference Ghani KR, Miller DC, Linsell S, et al. Measuring to improve: peer and crowd-sourced assessments of technical skill with robot-assisted radical prostatectomy. Eur Urol. 2016;69(4):547–50.CrossRef Ghani KR, Miller DC, Linsell S, et al. Measuring to improve: peer and crowd-sourced assessments of technical skill with robot-assisted radical prostatectomy. Eur Urol. 2016;69(4):547–50.CrossRef
18.
go back to reference Conti SL, Brubaker W, Chung BI, et al. Crowdsourced assessment of ureteroscopy with laser lithotripsy video feed does not correlate with trainee experience. J Endourol. 2019;33(1):42–9.CrossRef Conti SL, Brubaker W, Chung BI, et al. Crowdsourced assessment of ureteroscopy with laser lithotripsy video feed does not correlate with trainee experience. J Endourol. 2019;33(1):42–9.CrossRef
Metadata
Title
Video-Rated Performance Assessment of Simulated Laparoscopic Sleeve Gastrectomy: Validation of a Sleeve Gastrectomy Rating Scale
Authors
Ruth E. Blackham
Jeffrey M. Hamdorf
Publication date
01-07-2021
Publisher
Springer US
Published in
Obesity Surgery / Issue 7/2021
Print ISSN: 0960-8923
Electronic ISSN: 1708-0428
DOI
https://doi.org/10.1007/s11695-021-05422-w

Other articles of this Issue 7/2021

Obesity Surgery 7/2021 Go to the issue