Top

Published in:

11-09-2023 | Artificial Intelligence | 2023 SAGES Oral

What is the educational value and clinical utility of artificial intelligence for intraoperative and postoperative video analysis? A survey of surgeons and trainees

Authors: M. Saif Hameed, Simon Laplante, Caterina Masino, Muhammad Uzair Khalid, Haochi Zhang, Sergey Protserov, Jaryd Hunter, Pouria Mashouri, Andras B. Fecso, Michael Brudno, Amin Madani

Published in: Surgical Endoscopy | Issue 12/2023

Abstract

Introduction

Surgical complications often occur due to lapses in judgment and decision-making. Advances in artificial intelligence (AI) have made it possible to train algorithms that identify anatomy and interpret the surgical field. These algorithms can potentially be used for intraoperative decision-support and postoperative video analysis and feedback. Despite the very early success of proof-of-concept algorithms, it remains unknown whether this innovation meets the needs of end-users or how best to deploy it. This study explores users’ opinion on the value, usability and design for adapting AI in operating rooms.

Methods

A device-agnostic web-accessible software was developed to provide AI inference either (1) intraoperatively on a live video stream (synchronous mode), or (2) on an uploaded video or image file (asynchronous mode) postoperatively for feedback. A validated AI model (GoNoGoNet), which identifies safe and dangerous zones of dissection during laparoscopic cholecystectomy, was used as the use case. Surgeons and trainees performing laparoscopic cholecystectomy interacted with the AI platform and completed a 5-point Likert scale survey to evaluate the educational value, usability and design of the platform.

Results

Twenty participants (11 surgeons and 9 trainees) evaluated the platform intraoperatively (n = 10) and postoperatively (n = 11). The majority agreed or strongly agreed that AI is an effective adjunct to surgical training (81%; neutral = 10%), effective for providing real-time feedback (70%; neutral = 20%), postoperative feedback (73%; neutral = 27%), and capable of improving surgeon confidence (67%; neutral = 29%). Only 40% (neutral = 50%) and 57% (neutral = 43%) believe that the tool is effective in improving intraoperative decisions and performance, or beneficial for patient care, respectively. Overall, 38% (neutral = 43%) reported they would use this platform consistently if available. The majority agreed or strongly agreed that the platform was easy to use (81%; neutral = 14%) and has acceptable resolution (62%; neutral = 24%), while 30% (neutral = 20%) reported that it disrupted the OR workflow, and 20% (neutral = 0%) reported significant time lag. All respondents reported that such a system should be available “on-demand” to turn on/off at their discretion.

Conclusions

Most found AI to be a useful tool for providing support and feedback to surgeons, despite several implementation obstacles. The study findings will inform the future design and usability of this technology in order to optimize its clinical impact and adoption by end-users.

Available only for authorised users

WHO (2009) WHO Guidelines for safe surgery 2009: safe surgery saves lives. WHO Guidelines approved by the Guidelines Review Committee. WHO, Geneva

Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG et al (1991) Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 324(6):370–6CrossRefPubMed

Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J et al (2004) The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 170(11):1678–1686CrossRefPubMedPubMedCentral

Forster AJ, Asmis TR, Clark HD, Al Saied G, Code CC, Caughey SC et al (2004) Ottawa Hospital Patient Safety Study: incidence and timing of adverse events in patients admitted to a Canadian teaching hospital. CMAJ 170(8):1235–1240CrossRefPubMedPubMedCentral

Khalid MU, Laplante S, Madani A (2022) Machines with vision for intraoperative guidance during gastrointestinal cancer surgery. Front Med (Lausanne) 9:1025382CrossRefPubMed

Jumah F, Raju B, Nagaraj A, Shinde R, Lescott C, Sun H et al (2022) Uncharted waters of machine and deep learning for surgical phase recognition in neurosurgery. World Neurosurg 160:4–12CrossRefPubMed

Hashimoto DA, Rosman G, Witkowski ER, Stafford C, Navarette-Welton AJ, Rattner DW et al (2019) Computer vision analysis of intraoperative video: automated recognition of operative steps in laparoscopic sleeve gastrectomy. Ann Surg 270(3):414–421CrossRefPubMed

Safi S, Thiessen T, Schmailzl KJ (2018) Acceptance and resistance of new digital technologies in medicine: qualitative study. JMIR Res Protoc 7(12):e11072CrossRefPubMedPubMedCentral

Guerrero DT, Asaad M, Rajesh A, Hassan A, Butler CE (2023) Advancing surgical education: the use of artificial intelligence in surgical training. Am Surg 89(1):49–54CrossRefPubMed

10.

Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S et al (2022) Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med 28(5):924–933CrossRefPubMed

11.

Laplante S, Namazi B, Kiani P, Hashimoto DA, Alseidi A, Pasten M et al (2023) Validation of an artificial intelligence platform for the guidance of safe laparoscopic cholecystectomy. Surg Endosc 37(3):2260–2268CrossRefPubMed

12.

Madani A, Namazi B, Altieri MS, Hashimoto DA, Rivera AM, Pucher PH et al (2022) Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy. Ann Surg 276(2):363–369CrossRefPubMed

13.

Madani A, Zhang H, Mashouri P, Hunter J, Protserov S, Masino C, Laplante S, Hashimoto D, Mascagni P, Alseidi A, Brudno M (2022) Bringing surgical artificial intelligence to end-users: development of a platform for live intraoperative inference. In: CLINICCAI 2022—second conference on clinical translation of medical image computing and computer assisted intervention, Singapore, 18–22 Sept 2022

14.

Madani A, Vassiliou MC, Watanabe Y, Al-Halabi B, Al-Rowais MS, Deckelbaum DL et al (2017) What are the principles that guide behaviors in the operating room?: creating a framework to define and measure performance. Ann Surg 265(2):255–267CrossRefPubMed

15.

Childers CP, Maggard-Gibbons M (2018) Estimation of the acquisition and operating costs for robotic surgery. JAMA 320(8):835–836CrossRefPubMedCentral

16.

Ismail I, Wolff S, Gronfier A, Mutter D, Swanstrom LL (2015) A cost evaluation methodology for surgical technologies. Surg Endosc 29(8):2423–2432CrossRefPubMed

17.

Nuijten M (2022) Pricing Zolgensma—the world’s most expensive drug. J Mark Access Health Policy 10(1):2022353CrossRefPubMed

18.

Shukla V, Seoane-Vazquez E, Fawaz S, Brown L, Rodriguez-Monguio R (2019) The landscape of cellular and gene therapy products: authorization, discontinuations, and cost. Hum Gene Ther Clin Dev 30(3):102–113CrossRefPubMed

19.

Simons DJ (2000) Attentional capture and inattentional blindness. Trends Cogn Sci 4(4):147–155CrossRefPubMed

20.

Wirtzfeld DA (2009) The history of women in surgery. Can J Surg 52(4):317–320PubMedPubMedCentral

21.

Lim WH, Wong C, Jain SR, Ng CH, Tai CH, Devi MK et al (2021) The unspoken reality of gender bias in surgery: a qualitative systematic review. PLoS ONE 16(2):e0246420CrossRefPubMedPubMedCentral

Title: What is the educational value and clinical utility of artificial intelligence for intraoperative and postoperative video analysis? A survey of surgeons and trainees
Authors: M. Saif Hameed
Simon Laplante
Caterina Masino
Muhammad Uzair Khalid
Haochi Zhang
Sergey Protserov
Jaryd Hunter
Pouria Mashouri
Andras B. Fecso
Michael Brudno
Amin Madani
Publication date: 11-09-2023
Publisher: Springer US
Keywords: Artificial Intelligence
Cholecystectomy
Published in: Surgical Endoscopy / Issue 12/2023
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI: https://doi.org/10.1007/s00464-023-10377-3

Keynote webinar | Spotlight on medication adherence

Springer Medicine

What is the educational value and clinical utility of artificial intelligence for intraoperative and postoperative video analysis? A survey of surgeons and trainees

Abstract

Introduction

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Introduction

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 12/2023

The INCH-trial: a multicenter randomized controlled trial comparing short- and long-term outcomes of open and laparoscopic surgery for incisional hernia repair

Long-term follow-up of a cohort with post sleeve gastrectomy leaks: results of endoscopic treatment and salvage surgery

Remote teaching system for robotic surgery and its validation: results of a randomized controlled study

Safety and feasibility of destination care for bariatric surgery: a single institution retrospective study

Rural versus urban commuting patients with stage III colon cancer: is there a difference in treatment and outcome?

Dye-free visualisation of intestinal perfusion using laser speckle contrast imaging in laparoscopic surgery: a prospective, observational multi-centre study