Skip to main content
Top
Published in: Obesity Surgery 4/2024

Open Access 24-02-2024 | Bariatric Surgery | Original Contributions

A New Procedure-Based Assessment of Operative Skills in Gastric Bypass Surgery, Evaluated by Video Fragment Rating

Authors: Mirjam A. Kaijser, Gabrielle H. van Ramshorst, Bart A. van Wagensveld, Nic J. G. M. Veeger, Jean-Pierre E. N. Pierie, Expert panel of Dutch and Belgian Bariatric Surgeons

Published in: Obesity Surgery | Issue 4/2024

Login to get access

Abstract

Purpose

Feedback on technical and procedural skills is essential during the training of residents and fellows. The aim of this study was to assess the performance of a newly created instrument for the assessment of operative skills using laparoscopic Roux-en-Y gastric bypass (LRYGB) video fragments.

Materials and Methods

A new procedure-based assessment (PBA) was created by combining LRYGB key steps with a 5-point independence scale. LRYGB performed by residents and surgeons with different levels of expertise were video recorded. Fragments of the pouch creation, gastro-jejunostomy and jejunojejunostomy, were review by 12 expert bariatric surgeons and the operative skills assessed with the PBA, Objective Structured Assessment of Technical Skill (OSATS), and the Bariatric OSATS (BOSATS). The PBA was compared to the OSATS and BOSATS. Mean scores for all items of the different assessments were summarized and compared using a T-test.

Results

The scores of the procedural steps were combined and compared for all levels. The mean scores for beginner, intermediate, and expert level were 2.71, 3.70, and 3.90 for the PBA; for the OSATS 1.84, 2.86, and 3.44; and for the BOSATS 2.78, 3.56, and 4.19. Each of these assessments differentiated between the three skill levels (all p < 0.05).

Conclusion

The PBA discriminates well between different levels of operative skills. Similar patterns were found for the OSATS and BOSATS, showing that the randomly selected video fragments are representative samples for assessing skill level. Future research will demonstrate whether these results can be extrapolated to clinical training, and which scores allow for procedure certification.

Graphical Abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Buchwald H, Avidor Y, Braunwald E, et al. Bariatric surgery: a systematic review and meta-analysis. JAMA Surg. 2004;292:1724–37.CrossRef Buchwald H, Avidor Y, Braunwald E, et al. Bariatric surgery: a systematic review and meta-analysis. JAMA Surg. 2004;292:1724–37.CrossRef
2.
go back to reference Colquitt JL, Pickett K, Loveman E, Frampton GK. Surgery for weight loss in adults. In: Colquitt JL, editor. Cochrane Database Syst Rev Chichester: John Wiley & Sons, Ltd; 2014. Colquitt JL, Pickett K, Loveman E, Frampton GK. Surgery for weight loss in adults. In: Colquitt JL, editor. Cochrane Database Syst Rev Chichester: John Wiley & Sons, Ltd; 2014.
3.
go back to reference Flum D, Dellinger E. Impact of gastric bypass operation on survival: a population-based analysis. J Am Coll Surg. 2004;199:543–51.CrossRefPubMed Flum D, Dellinger E. Impact of gastric bypass operation on survival: a population-based analysis. J Am Coll Surg. 2004;199:543–51.CrossRefPubMed
4.
go back to reference Park DJ, An S, Park YS, et al. Bariatric surgery versus medical therapy in Korean obese patients: prospective multicenter nonrandomized controlled trial (KOBESS trial). Ann Surg Treat Res. 2021;101:197–205.CrossRefPubMedPubMedCentral Park DJ, An S, Park YS, et al. Bariatric surgery versus medical therapy in Korean obese patients: prospective multicenter nonrandomized controlled trial (KOBESS trial). Ann Surg Treat Res. 2021;101:197–205.CrossRefPubMedPubMedCentral
5.
go back to reference Schirmer BD, Schauer PR, Flum DR, et al. Bariatric surgery training: getting your ticket punched. J Gastrointest Surg. 2007;11:807–12.CrossRefPubMed Schirmer BD, Schauer PR, Flum DR, et al. Bariatric surgery training: getting your ticket punched. J Gastrointest Surg. 2007;11:807–12.CrossRefPubMed
6.
go back to reference Schauer P, Ikramuddin S, Hamad G, et al. The learning curve for laparoscopic Roux-en-Y gastric bypass is 100 cases. Surg Endosc Other Interv Tech. 2003;17:212–5. Schauer P, Ikramuddin S, Hamad G, et al. The learning curve for laparoscopic Roux-en-Y gastric bypass is 100 cases. Surg Endosc Other Interv Tech. 2003;17:212–5.
7.
go back to reference Zevin B, Aggarwal R, Grantcharov TP. Simulation-based training and learning curves in laparoscopic Roux-en-Y gastric bypass. Br J Surg. 2012;99:887–95. Zevin B, Aggarwal R, Grantcharov TP. Simulation-based training and learning curves in laparoscopic Roux-en-Y gastric bypass. Br J Surg. 2012;99:887–95.
8.
go back to reference Wehrtmann FS, de la Garza JR, Kowalewski KF, et al. Learning curves of laparoscopic Roux-en-Y gastric bypass and sleeve gastrectomy in bariatric surgery: a systematic review and introduction of a standardization. Obes Surg. 2020;30:640–56.CrossRefPubMed Wehrtmann FS, de la Garza JR, Kowalewski KF, et al. Learning curves of laparoscopic Roux-en-Y gastric bypass and sleeve gastrectomy in bariatric surgery: a systematic review and introduction of a standardization. Obes Surg. 2020;30:640–56.CrossRefPubMed
9.
go back to reference Krell RW, Birkmeyer NJO, Reames BN, et al. Effects of resident involvement on complication rates after laparoscopic gastric bypass. J Am Coll Surg. 2014;218:253–60. Krell RW, Birkmeyer NJO, Reames BN, et al. Effects of resident involvement on complication rates after laparoscopic gastric bypass. J Am Coll Surg. 2014;218:253–60.
10.
go back to reference Edwards MA, Terhaar H, Spaulding A. Resident first assistance in bariatric surgery: do patients pay a price? Surg Obes Relat Dis. 2022;1–9. Edwards MA, Terhaar H, Spaulding A. Resident first assistance in bariatric surgery: do patients pay a price? Surg Obes Relat Dis. 2022;1–9.
11.
go back to reference Beyer-Berjot L, Palter V, Grantcharov T, et al. Advanced training in laparoscopic abdominal surgery: a systematic review. Surgery. 2014;156:676–88. Beyer-Berjot L, Palter V, Grantcharov T, et al. Advanced training in laparoscopic abdominal surgery: a systematic review. Surgery. 2014;156:676–88.
12.
go back to reference Moulton C-AE, Dubrowski A, MacRae H, et al. Teaching surgical skills: what kind of practice makes perfect? Ann Surg. 2006;244:400–9. Moulton C-AE, Dubrowski A, MacRae H, et al. Teaching surgical skills: what kind of practice makes perfect? Ann Surg. 2006;244:400–9.
13.
go back to reference Ahmed K, Miskovic D, Darzi A, et al. Observational tools for assessment of procedural skills: a systematic review. Am J Surg. 2011;202:469–80 Ahmed K, Miskovic D, Darzi A, et al. Observational tools for assessment of procedural skills: a systematic review. Am J Surg. 2011;202:469–80
14.
go back to reference Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.PubMed Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.PubMed
15.
go back to reference Hopmans CJ, Den Hoed PT, Van Der Laan L, et al. Assessment of surgery residents’ operative skills in the operating theater using a modified objective structured assessment of technical skills (OSATS): a prospective multicenter study. Surgery. 2014;156:1078–88. Hopmans CJ, Den Hoed PT, Van Der Laan L, et al. Assessment of surgery residents’ operative skills in the operating theater using a modified objective structured assessment of technical skills (OSATS): a prospective multicenter study. Surgery. 2014;156:1078–88.
16.
go back to reference Van Hove PD, Tuijthof GJM, Verdaasdonk EGG, et al. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87.CrossRefPubMed Van Hove PD, Tuijthof GJM, Verdaasdonk EGG, et al. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87.CrossRefPubMed
17.
go back to reference Vassiliou MC, Feldman LS, Andrew CG, et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg. 2005;190:107–13.CrossRefPubMed Vassiliou MC, Feldman LS, Andrew CG, et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg. 2005;190:107–13.CrossRefPubMed
18.
go back to reference van Ramshorst GH, Kaijser MA, Pierie JPEN, et al. Resident training in bariatric surgery—a national survey in the Netherlands. Obes Surg. 2017;27:2974–80.CrossRefPubMedPubMedCentral van Ramshorst GH, Kaijser MA, Pierie JPEN, et al. Resident training in bariatric surgery—a national survey in the Netherlands. Obes Surg. 2017;27:2974–80.CrossRefPubMedPubMedCentral
19.
go back to reference Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39:1176–7.CrossRefPubMed Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39:1176–7.CrossRefPubMed
20.
go back to reference Glarner CE, McDonald RJ, Smith AB, et al. Utilizing a novel tool for the comprehensive assessment of resident operative performance. J Surg Educ. 2013;70:813–20. Glarner CE, McDonald RJ, Smith AB, et al. Utilizing a novel tool for the comprehensive assessment of resident operative performance. J Surg Educ. 2013;70:813–20.
21.
go back to reference Kramp KH, van Det MJ, Veeger NJGM, et al. Validity, reliability and support for implementation of independence-scaled procedural assessment in laparoscopic surgery. Surg Endosc. 2016;30:2288–300. Kramp KH, van Det MJ, Veeger NJGM, et al. Validity, reliability and support for implementation of independence-scaled procedural assessment in laparoscopic surgery. Surg Endosc. 2016;30:2288–300.
22.
go back to reference Peyre SE, Peyre CG, Hagen JA, et al. Laparoscopic Nissen fundoplication assessment: task analysis as a model for the development of a procedural checklist. Surg Endosc. 2009;23:1227–32.CrossRefPubMed Peyre SE, Peyre CG, Hagen JA, et al. Laparoscopic Nissen fundoplication assessment: task analysis as a model for the development of a procedural checklist. Surg Endosc. 2009;23:1227–32.CrossRefPubMed
23.
go back to reference Zevin B, Bonrath EM, Aggarwal R, et al. Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg. 2013;216:955–65.e8. Zevin B, Bonrath EM, Aggarwal R, et al. Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg. 2013;216:955–65.e8.
24.
go back to reference Kaijser MA, van Ramshorst GH, Emous M, et al. A Delphi consensus of the crucial steps in gastric bypass and sleeve gastrectomy procedures in the Netherlands. Obes Surg. 2018;28:2634–43. Kaijser MA, van Ramshorst GH, Emous M, et al. A Delphi consensus of the crucial steps in gastric bypass and sleeve gastrectomy procedures in the Netherlands. Obes Surg. 2018;28:2634–43.
26.
go back to reference Strating WJ, van Acker GJ, Brand PL, et al. Beoordeling klinische en chirurgische vaardigheden. Minder overeenstemming tussen beoordelaars bij gebruik 'Korte klinische beoordeling' dan bij 'Objective structured assessment of technical skills' [Assessment clinical and surgical competency. Less agreement among assessors by using 'Short clinical assessment' than with 'Objective structured assessment of technical skills']. Ned Tijdschr Geneeskd. 2009;153(7):274–80. Dutch. Strating WJ, van Acker GJ, Brand PL, et al. Beoordeling klinische en chirurgische vaardigheden. Minder overeenstemming tussen beoordelaars bij gebruik 'Korte klinische beoordeling' dan bij 'Objective structured assessment of technical skills' [Assessment clinical and surgical competency. Less agreement among assessors by using 'Short clinical assessment' than with 'Objective structured assessment of technical skills']. Ned Tijdschr Geneeskd. 2009;153(7):274–80. Dutch.
27.
go back to reference Beard JD, Marriott J, Purdie H, et al. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess. 2011;15:3–112. Beard JD, Marriott J, Purdie H, et al. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess. 2011;15:3–112.
28.
go back to reference van Zwieten TH, Okkema S, Kramp KH, et al. Procedure-based assessment for laparoscopic cholecystectomy can replace global rating scales. Minim Invasive Ther Allied Technol. 2021:1–7. van Zwieten TH, Okkema S, Kramp KH, et al. Procedure-based assessment for laparoscopic cholecystectomy can replace global rating scales. Minim Invasive Ther Allied Technol. 2021:1–7.
29.
go back to reference Vassiliou MC, Feldman LS, Fraser SA, et al. Evaluating intraoperative laparoscopic skill: direct observation versus blinded videotaped performances. Surg Innov. 2007;14:211–6.CrossRefPubMed Vassiliou MC, Feldman LS, Fraser SA, et al. Evaluating intraoperative laparoscopic skill: direct observation versus blinded videotaped performances. Surg Innov. 2007;14:211–6.CrossRefPubMed
30.
go back to reference Chang L, Hogle NJ, Moore BB, et al. Reliable assessment of laparoscopic. Surg Innov. 2007;14:122–6.CrossRefPubMed Chang L, Hogle NJ, Moore BB, et al. Reliable assessment of laparoscopic. Surg Innov. 2007;14:122–6.CrossRefPubMed
31.
go back to reference Sommer T, Larsen JF, Raundahl U. Eliminating learning curve-related morbidity in fast track laparoscopic Roux-en-Y gastric bypass. J Laparoendosc Adv Surg Tech. 2011;21:307–12.CrossRef Sommer T, Larsen JF, Raundahl U. Eliminating learning curve-related morbidity in fast track laparoscopic Roux-en-Y gastric bypass. J Laparoendosc Adv Surg Tech. 2011;21:307–12.CrossRef
Metadata
Title
A New Procedure-Based Assessment of Operative Skills in Gastric Bypass Surgery, Evaluated by Video Fragment Rating
Authors
Mirjam A. Kaijser
Gabrielle H. van Ramshorst
Bart A. van Wagensveld
Nic J. G. M. Veeger
Jean-Pierre E. N. Pierie
Expert panel of Dutch and Belgian Bariatric Surgeons
Publication date
24-02-2024
Publisher
Springer US
Published in
Obesity Surgery / Issue 4/2024
Print ISSN: 0960-8923
Electronic ISSN: 1708-0428
DOI
https://doi.org/10.1007/s11695-023-07020-4

Other articles of this Issue 4/2024

Obesity Surgery 4/2024 Go to the issue