Skip to main content
Top
Published in: Surgical Endoscopy 3/2021

Open Access 01-03-2021 | Minimally Invasive Surgery

Development and validation of a recommended checklist for assessment of surgical videos quality: the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) video assessment tool

Authors: Valerio Celentano, Neil Smart, Ronan A. Cahill, Antonino Spinelli, Mariano Cesare Giglio, John McGrath, Andreas Obermair, Gianluca Pellino, Hirotoshi Hasegawa, Pawanindra Lal, Laura Lorenzon, Nicola De Angelis, Luigi Boni, Sharmila Gupta, John P. Griffith, Austin G. Acheson, Tom D. Cecil, Mark G. Coleman

Published in: Surgical Endoscopy | Issue 3/2021

Login to get access

Abstract

Introduction

There has been a constant increase in the number of published surgical videos with preference for open-access sources, but the proportion of videos undergoing peer-review prior to publication has markedly decreased, raising questions over quality of the educational content presented. The aim of this study was the development and validation of a standard framework for the appraisal of surgical videos submitted for presentation and publication, the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) video assessment tool.

Methods

An international committee identified items for inclusion in the LAP-VEGaS video assessment tool and finalised the marking score utilising Delphi methodology. The tool was finally validated by anonymous evaluation of selected videos by a group of validators not involved in the tool development.

Results

9 items were included in the LAP-VEGaS video assessment tool, with every item scoring from 0 (item not presented in the video) to 2 (item extensively presented in the video), with a total marking score ranging from 0 to 18. The LAP-VEGaS video assessment tool resulted highly accurate in identifying and selecting videos for acceptance for conference presentation and publication, with high level of internal consistency and generalisability.

Conclusions

We propose that peer review in adherence to the LAP-VEGaS video assessment tool could enhance the overall quality of published video outputs.

Graphic Abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Abdelsattar JM, Pandian TK, Finnesgard EJ et al (2015) Do you see what I see? How we use video as an adjunct to general surgery resident education. J Surg Educ 72(6):e145–e150CrossRef Abdelsattar JM, Pandian TK, Finnesgard EJ et al (2015) Do you see what I see? How we use video as an adjunct to general surgery resident education. J Surg Educ 72(6):e145–e150CrossRef
2.
go back to reference Gorin MA, Kava BR, Leveillee RJ (2011) Video demonstrations as an intraoperative teaching aid for surgical assistants. Eur Urol 59(2):306–307CrossRef Gorin MA, Kava BR, Leveillee RJ (2011) Video demonstrations as an intraoperative teaching aid for surgical assistants. Eur Urol 59(2):306–307CrossRef
3.
go back to reference Rocco B, Grasso AAC, De Lorenzis E et al (2018) Live surgery: highly educational or harmful? World J Urol 36(2):171–175CrossRef Rocco B, Grasso AAC, De Lorenzis E et al (2018) Live surgery: highly educational or harmful? World J Urol 36(2):171–175CrossRef
4.
go back to reference Celentano V, Browning M, Hitchins C et al (2017) Training value of laparoscopic colorectal videos on the World Wide Web: a pilot study on the educational quality of laparoscopic right hemicolectomy videos. Surg Endosc 31(11):4496–4504CrossRef Celentano V, Browning M, Hitchins C et al (2017) Training value of laparoscopic colorectal videos on the World Wide Web: a pilot study on the educational quality of laparoscopic right hemicolectomy videos. Surg Endosc 31(11):4496–4504CrossRef
5.
go back to reference Stahel PF, Moore EE (2014) Peer review for biomedical publications: we can improve the system. BMC Med 12:179CrossRef Stahel PF, Moore EE (2014) Peer review for biomedical publications: we can improve the system. BMC Med 12:179CrossRef
6.
go back to reference Celentano V, Smart N, Cahill RA et al (2018) Use of laparoscopic videos amongst surgical trainees in the United Kingdom. Surgeon 17:334CrossRef Celentano V, Smart N, Cahill RA et al (2018) Use of laparoscopic videos amongst surgical trainees in the United Kingdom. Surgeon 17:334CrossRef
7.
go back to reference Celentano V, Smart N, Cahill R et al (2018) LAP-VEGaS practice guidelines for reporting of educational videos in laparoscopic surgery: a joint trainers and trainees consensus statement. Ann Surg 268(6):920–926CrossRef Celentano V, Smart N, Cahill R et al (2018) LAP-VEGaS practice guidelines for reporting of educational videos in laparoscopic surgery: a joint trainers and trainees consensus statement. Ann Surg 268(6):920–926CrossRef
8.
go back to reference Coleman M, Rockall T (2013) Teaching of laparoscopic surgery colorectal. The Lapco model. Cir Esp 91:279–280CrossRef Coleman M, Rockall T (2013) Teaching of laparoscopic surgery colorectal. The Lapco model. Cir Esp 91:279–280CrossRef
9.
go back to reference Miskovic D, Wyles SM, Carter F et al (2011) Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program. Surg Endosc 25(4):1136–1142CrossRef Miskovic D, Wyles SM, Carter F et al (2011) Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program. Surg Endosc 25(4):1136–1142CrossRef
10.
go back to reference Mackenzie H, Ni M, Miskovic D et al (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for Laparoscopic Colorectal Surgery. Br J Surg 102(8):991–997CrossRef Mackenzie H, Ni M, Miskovic D et al (2015) Clinical validity of consultant technical skills assessment in the English National Training Programme for Laparoscopic Colorectal Surgery. Br J Surg 102(8):991–997CrossRef
11.
go back to reference Miskovic D, Ni M, Wyles SM et al (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482CrossRef Miskovic D, Ni M, Wyles SM et al (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482CrossRef
12.
go back to reference Linstone HA, Turoff M (1975) The Delphi Method Techniques and Applications. Addison-Wesley Publishing Company, Reading Linstone HA, Turoff M (1975) The Delphi Method Techniques and Applications. Addison-Wesley Publishing Company, Reading
13.
go back to reference Varela-Ruiz M, Díaz-Bravo L, García-Durán R (2012) Description and uses of the Delphi method for research in the healthcare area. Inv Ed Med 1(2):90–95 Varela-Ruiz M, Díaz-Bravo L, García-Durán R (2012) Description and uses of the Delphi method for research in the healthcare area. Inv Ed Med 1(2):90–95
14.
go back to reference Swets JA (1988) Measuring the accuracy of diagnostic systems. Science 240(4857):1285–1293CrossRef Swets JA (1988) Measuring the accuracy of diagnostic systems. Science 240(4857):1285–1293CrossRef
15.
17.
go back to reference Langerman A, Grantcharov TP (2017) Are we ready for our close-up? Why and how we must embrace video in the OR. Ann Surg 266(6):934–936CrossRef Langerman A, Grantcharov TP (2017) Are we ready for our close-up? Why and how we must embrace video in the OR. Ann Surg 266(6):934–936CrossRef
19.
go back to reference Simera DG, Altman DM et al (2008) Guidelines for reporting health research: the EQUATOR Network's survey of guideline authors. PLoS Med 5(6):e139CrossRef Simera DG, Altman DM et al (2008) Guidelines for reporting health research: the EQUATOR Network's survey of guideline authors. PLoS Med 5(6):e139CrossRef
20.
go back to reference Moher D, Hopewell S, Schulz KF et al (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:c869CrossRef Moher D, Hopewell S, Schulz KF et al (2010) CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:c869CrossRef
21.
go back to reference von Elm E, Altman DG, Egger M et al (2007) The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370:1453–1457CrossRef von Elm E, Altman DG, Egger M et al (2007) The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370:1453–1457CrossRef
22.
go back to reference Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. J Clin Epidemiol 62:e1–34CrossRef Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. J Clin Epidemiol 62:e1–34CrossRef
23.
go back to reference Ritter EM (2018) Invited editorial LAP-VEGaS practice guidelines for video-based education in surgery: content is just the beginning. Ann Surg 268(6):927–929CrossRef Ritter EM (2018) Invited editorial LAP-VEGaS practice guidelines for video-based education in surgery: content is just the beginning. Ann Surg 268(6):927–929CrossRef
24.
go back to reference Sgarbura O, Vasilescu C (2010) The decisive role of the patient-side surgeon in robotic surgery. Surg Endosc 24:3149–3155CrossRef Sgarbura O, Vasilescu C (2010) The decisive role of the patient-side surgeon in robotic surgery. Surg Endosc 24:3149–3155CrossRef
25.
go back to reference Mahendran B, Caiazzo A et al (2019) Transanal total mesorectal excision (TaTME): are we doing it for the right indication? An assessment of the external validity of published online video resources. Int J Colorectal Dis 34(10):1823–1826CrossRef Mahendran B, Caiazzo A et al (2019) Transanal total mesorectal excision (TaTME): are we doing it for the right indication? An assessment of the external validity of published online video resources. Int J Colorectal Dis 34(10):1823–1826CrossRef
26.
go back to reference Mahid SS, Qadan M, Hornung CA, Galandiuk S (2008) Assessment of publication bias for the surgeon scientist. Br J Surg 95(8):943–949CrossRef Mahid SS, Qadan M, Hornung CA, Galandiuk S (2008) Assessment of publication bias for the surgeon scientist. Br J Surg 95(8):943–949CrossRef
27.
go back to reference Dickersin K, Min YI, Meinert CL (1992) Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA 267:374–378CrossRef Dickersin K, Min YI, Meinert CL (1992) Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA 267:374–378CrossRef
Metadata
Title
Development and validation of a recommended checklist for assessment of surgical videos quality: the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) video assessment tool
Authors
Valerio Celentano
Neil Smart
Ronan A. Cahill
Antonino Spinelli
Mariano Cesare Giglio
John McGrath
Andreas Obermair
Gianluca Pellino
Hirotoshi Hasegawa
Pawanindra Lal
Laura Lorenzon
Nicola De Angelis
Luigi Boni
Sharmila Gupta
John P. Griffith
Austin G. Acheson
Tom D. Cecil
Mark G. Coleman
Publication date
01-03-2021
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 3/2021
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-020-07517-4

Other articles of this Issue 3/2021

Surgical Endoscopy 3/2021 Go to the issue