Skip to main content
Top
Published in: Surgical Endoscopy 12/2019

01-12-2019 | Gastrectomy

Development of a novel tool to assess skills in laparoscopic gastrectomy using the Delphi method: the Japanese operative rating scale for laparoscopic distal gastrectomy (JORS-LDG)

Authors: Yo Kurashima, Yusuke Watanabe, Naoki Hiki, Saseem Poudel, Hidehiko Kitagami, Yuma Ebihara, Soichi Murakami, Toshiaki Shichinohe, Satoshi Hirano

Published in: Surgical Endoscopy | Issue 12/2019

Login to get access

Abstract

Background

Assessment of the performance of laparoscopic gastrectomy is yet unreported, likely because of the complexity of the procedure. We aimed to develop a tool to assess the skills required for laparoscopic distal gastrectomy (LDG) through cognitive task analysis (CTA) and expert consensus using the Delphi method.

Methods

CTA involved the listing of the knowledge and criteria required for completing each step of LDG as subtasks based on interviews by experts and novices and text book, instructional video, and procedural review. The Delphi evaluation method involved anonymous online surveys, conducted to merge the opinions of experts in laparoscopic gastrectomy. The experts were asked to rate (from 1 to 5) the importance of subtasks for skill evaluation and training for LDG using a Likert scale. Consensus among expert viewpoints was determined by the internal consistency of each item using Cronbach’s approach.

Results

Essential subtasks drafted for the assessment of LDG performance were determined based on the CTA. Thirty-one LDG experts participated in the online-survey with a response rate over 90%. A consensus was achieved after 2 rounds of surveys with a Cronbach alpha of 0.86, and 34 subtasks of LDG were selected. We finally created the Japanese Operative Rating Scale for Laparoscopic Distal Gastrectomy (JORS-LDG) based on the 34 subtasks.

Conclusions

We developed the JORS-LDG using CTA and the Delphi method.
Literature
1.
go back to reference Derevianko AY, Schwaitzberg SD, Tsuda S, Barrios L, Brooks DC, Callery MP, Fobert D, Irias N, Rattner DW, Jones DB (2010) Malpractice carrier underwrites fundamentals of laparoscopic surgery training and testing: a benchmark for patient safety. Surg Endosc 24:616–623CrossRef Derevianko AY, Schwaitzberg SD, Tsuda S, Barrios L, Brooks DC, Callery MP, Fobert D, Irias N, Rattner DW, Jones DB (2010) Malpractice carrier underwrites fundamentals of laparoscopic surgery training and testing: a benchmark for patient safety. Surg Endosc 24:616–623CrossRef
2.
go back to reference Hafford ML, Van Sickle KR, Willis RE, Wilson TD, Gugliuzza K, Brown KM, Scott DJ (2013) Ensuring competency: are fundamentals of laparoscopic surgery training and certification necessary for practicing surgeons and operating room personnel? Surg Endosc 27:118–126CrossRef Hafford ML, Van Sickle KR, Willis RE, Wilson TD, Gugliuzza K, Brown KM, Scott DJ (2013) Ensuring competency: are fundamentals of laparoscopic surgery training and certification necessary for practicing surgeons and operating room personnel? Surg Endosc 27:118–126CrossRef
3.
go back to reference Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the global operative assessment of laparoscopic skills-groin hernia (GOALS-GH). Am J Surg 201:54–61CrossRef Kurashima Y, Feldman LS, Al-Sabah S, Kaneva PA, Fried GM, Vassiliou MC (2011) A tool for training and evaluation of laparoscopic inguinal hernia repair: the global operative assessment of laparoscopic skills-groin hernia (GOALS-GH). Am J Surg 201:54–61CrossRef
4.
go back to reference Poudel S, Kurashima Y, Kawarada Y, Watanabe Y, Murakami Y, Matsumura Y, Kato H, Miyazaki K, Shichinohe T, Hirano S (2016) Development and validation of a checklist for assessing recorded performance of laparoscopic inguinal hernia repair. Am J Surg 212:468–474CrossRef Poudel S, Kurashima Y, Kawarada Y, Watanabe Y, Murakami Y, Matsumura Y, Kato H, Miyazaki K, Shichinohe T, Hirano S (2016) Development and validation of a checklist for assessing recorded performance of laparoscopic inguinal hernia repair. Am J Surg 212:468–474CrossRef
5.
go back to reference Palter VN, Grantcharov TP (2012) A prospective study demonstrating the reliability and validity of two procedure-specific evaluation tools to assess operative competence in laparoscopic colorectal surgery. Surg Endosc 26:2489–2503CrossRef Palter VN, Grantcharov TP (2012) A prospective study demonstrating the reliability and validity of two procedure-specific evaluation tools to assess operative competence in laparoscopic colorectal surgery. Surg Endosc 26:2489–2503CrossRef
6.
go back to reference Zevin B, Bonrath EM, Aggarwal R, Dedy NJ, Ahmed N, Grantcharov TP (2013) Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg 216:955–965CrossRef Zevin B, Bonrath EM, Aggarwal R, Dedy NJ, Ahmed N, Grantcharov TP (2013) Development, feasibility, validity, and reliability of a scale for objective assessment of operative performance in laparoscopic gastric bypass surgery. J Am Coll Surg 216:955–965CrossRef
7.
go back to reference Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, Jemal A (2012) Global cancer statistics. CA Cancer J Clin 65:87–108CrossRef Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, Jemal A (2012) Global cancer statistics. CA Cancer J Clin 65:87–108CrossRef
8.
go back to reference Fock KM, Ang TL (2010) Epidemiology of Helicobacter pylori infection and gastric cancer in Asia. J Gastro Hepatol 25:479–486CrossRef Fock KM, Ang TL (2010) Epidemiology of Helicobacter pylori infection and gastric cancer in Asia. J Gastro Hepatol 25:479–486CrossRef
9.
go back to reference Japanese Gastric Cancer Association (2017) Japanese gastric cancer treatment guidelines 2014 (ver.). Gastric Cancer 20:1–19CrossRef Japanese Gastric Cancer Association (2017) Japanese gastric cancer treatment guidelines 2014 (ver.). Gastric Cancer 20:1–19CrossRef
10.
go back to reference Mori T, Kimura T, Kitajima M (2010) Skill accreditation system for laparoscopic gastroenterologic surgeons in Japan. Minim Invasive Ther Allied Technol 19:18–23CrossRef Mori T, Kimura T, Kitajima M (2010) Skill accreditation system for laparoscopic gastroenterologic surgeons in Japan. Minim Invasive Ther Allied Technol 19:18–23CrossRef
11.
go back to reference Singh P, Aggarwal R, Zevin B, Grantcharov T, Darzi A (2014) A global Delphi consensus study on defining and measuring quality in surgical training. J Am Coll Surg 219:346–353.e7CrossRef Singh P, Aggarwal R, Zevin B, Grantcharov T, Darzi A (2014) A global Delphi consensus study on defining and measuring quality in surgical training. J Am Coll Surg 219:346–353.e7CrossRef
12.
go back to reference Fink A, Kosecoff J, Chassin M, Brook RH (1984) Consensus methods: characteristics and guidelines for use. Am J Public Health 74:979–983CrossRef Fink A, Kosecoff J, Chassin M, Brook RH (1984) Consensus methods: characteristics and guidelines for use. Am J Public Health 74:979–983CrossRef
13.
go back to reference Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, Marteau T (1999) Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy 4:236–248CrossRef Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, Marteau T (1999) Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy 4:236–248CrossRef
14.
go back to reference Stefanidis D, Montero P, Urbach DR, Qureshi A, Perry K, Bachman SL, Madan A, Petersen R, Pryor AD (2014) SAGES research agenda in gastrointestinal and endoscopic surgery: updated results of a Delphi study. Surg Endosc 28:2763–2771CrossRef Stefanidis D, Montero P, Urbach DR, Qureshi A, Perry K, Bachman SL, Madan A, Petersen R, Pryor AD (2014) SAGES research agenda in gastrointestinal and endoscopic surgery: updated results of a Delphi study. Surg Endosc 28:2763–2771CrossRef
15.
go back to reference Francis N, Kazaryan AM, Pietrabissa A, Goitein D, Yiannakopoulou E, Agresta F, Khatkov I, Schulze S, Arulampalam T, Tomulescu V, Kim YW, Targarona EM, Zaninotto G (2017) A research agenda for the European Association for Endoscopic Surgeons (EAES). Surg Endosc 31:2042–2049CrossRef Francis N, Kazaryan AM, Pietrabissa A, Goitein D, Yiannakopoulou E, Agresta F, Khatkov I, Schulze S, Arulampalam T, Tomulescu V, Kim YW, Targarona EM, Zaninotto G (2017) A research agenda for the European Association for Endoscopic Surgeons (EAES). Surg Endosc 31:2042–2049CrossRef
16.
go back to reference Pucher PH, Brunt LM, Fanelli RD, Asbun HJ, Aggarwal R (2015) SAGES expert Delphi consensus: critical factors for safe surgical practice in laparoscopic cholecystectomy. Surg Endosc 29:3074–3085CrossRef Pucher PH, Brunt LM, Fanelli RD, Asbun HJ, Aggarwal R (2015) SAGES expert Delphi consensus: critical factors for safe surgical practice in laparoscopic cholecystectomy. Surg Endosc 29:3074–3085CrossRef
17.
go back to reference Palter VN, MacRae HM, Grantcharov TP (2011) Development of an objective evaluation tool to assess technical skill in laparoscopic colorectal surgery: a Delphi methodology. Am J Surg 201:251–259CrossRef Palter VN, MacRae HM, Grantcharov TP (2011) Development of an objective evaluation tool to assess technical skill in laparoscopic colorectal surgery: a Delphi methodology. Am J Surg 201:251–259CrossRef
18.
go back to reference Dijkstra FA, Bosker RJ, Veeger NJ, van Det MJ, Pierie JP (2015) Procedural key steps in laparoscopic colorectal surgery, consensus through Delphi methodology. Surg Endosc 29:2620–2627CrossRef Dijkstra FA, Bosker RJ, Veeger NJ, van Det MJ, Pierie JP (2015) Procedural key steps in laparoscopic colorectal surgery, consensus through Delphi methodology. Surg Endosc 29:2620–2627CrossRef
19.
go back to reference Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJO (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442CrossRef Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJO (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442CrossRef
20.
go back to reference Mackenzie H, Ni M, Miskovic D, Motson RW, Gudgeon M, Khan Z, Longman R, Coleman MG, Hanna GB (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for laparoscopic colorectal surgery. Br J Surg 102:991–997CrossRef Mackenzie H, Ni M, Miskovic D, Motson RW, Gudgeon M, Khan Z, Longman R, Coleman MG, Hanna GB (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for laparoscopic colorectal surgery. Br J Surg 102:991–997CrossRef
21.
go back to reference Scally CP, Varban OA, Carlin AM, Birkmeyer JD, Dimick JB (2016) Video ratings of surgical skill and late outcomes of bariatric surgery. JAMA Surg 151:e160428CrossRef Scally CP, Varban OA, Carlin AM, Birkmeyer JD, Dimick JB (2016) Video ratings of surgical skill and late outcomes of bariatric surgery. JAMA Surg 151:e160428CrossRef
Metadata
Title
Development of a novel tool to assess skills in laparoscopic gastrectomy using the Delphi method: the Japanese operative rating scale for laparoscopic distal gastrectomy (JORS-LDG)
Authors
Yo Kurashima
Yusuke Watanabe
Naoki Hiki
Saseem Poudel
Hidehiko Kitagami
Yuma Ebihara
Soichi Murakami
Toshiaki Shichinohe
Satoshi Hirano
Publication date
01-12-2019
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 12/2019
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-019-06681-6

Other articles of this Issue 12/2019

Surgical Endoscopy 12/2019 Go to the issue