Skip to main content
Top
Published in: Surgical Endoscopy 8/2022

28-06-2022

Real-time vascular anatomical image navigation for laparoscopic surgery: experimental study

Authors: Daichi Kitaguchi, Nobuyoshi Takeshita, Hiroki Matsuzaki, Takahiro Igaki, Hiro Hasegawa, Shigehiro Kojima, Kensaku Mori, Masaaki Ito

Published in: Surgical Endoscopy | Issue 8/2022

Login to get access

Abstract

Background

Recognition of the inferior mesenteric artery (IMA) during colorectal cancer surgery is crucial to avoid intraoperative hemorrhage and define the appropriate lymph node dissection line. This retrospective feasibility study aimed to develop an IMA anatomical recognition model for laparoscopic colorectal resection using deep learning, and to evaluate its recognition accuracy and real-time performance.

Methods

A complete multi-institutional surgical video database, LapSig300 was used for this study. Intraoperative videos of 60 patients who underwent laparoscopic sigmoid colon resection or high anterior resection were randomly extracted from the database and included. Deep learning-based semantic segmentation accuracy and real-time performance of the developed IMA recognition model were evaluated using Dice similarity coefficient (DSC) and frames per second (FPS), respectively.

Results

In a fivefold cross-validation conducted using 1200 annotated images for the IMA semantic segmentation task, the mean DSC value was 0.798 (± 0.0161 SD) and the maximum DSC was 0.816. The proposed deep learning model operated at a speed of over 12 FPS.

Conclusion

To the best of our knowledge, this is the first study to evaluate the feasibility of real-time vascular anatomical navigation during laparoscopic colorectal surgery using a deep learning-based semantic segmentation approach. This experimental study was conducted to confirm the feasibility of our model; therefore, its safety and usefulness were not verified in clinical practice. However, the proposed deep learning model demonstrated a relatively high accuracy in recognizing IMA in intraoperative images. The proposed approach has potential application in image navigation systems for unfixed soft tissues and organs during various laparoscopic surgeries.

Graphical abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Arnold M, Sierra MS, Laversanne M, Soerjomataram I, Jema A, Bray F (2017) Global patterns and trends in colorectal cancer incidence and mortality. Gut 66:683–691CrossRef Arnold M, Sierra MS, Laversanne M, Soerjomataram I, Jema A, Bray F (2017) Global patterns and trends in colorectal cancer incidence and mortality. Gut 66:683–691CrossRef
2.
go back to reference Siegel RL, Miller KD, Jemal A (2016) Cancer statistics, 2016. CA Cancer J Clin 66(1):7–30CrossRef Siegel RL, Miller KD, Jemal A (2016) Cancer statistics, 2016. CA Cancer J Clin 66(1):7–30CrossRef
3.
go back to reference Jackson TD, Kaplan GG, Arena G, Page JH, Rogers SO Jr (2007) Laparoscopic versus open resection for colorectal cancer: a metaanalysis of oncologic outcomes. J Am Coll Surg 204:439–446CrossRef Jackson TD, Kaplan GG, Arena G, Page JH, Rogers SO Jr (2007) Laparoscopic versus open resection for colorectal cancer: a metaanalysis of oncologic outcomes. J Am Coll Surg 204:439–446CrossRef
4.
go back to reference Bonnor RM, Ludwig KA (2005) Laparoscopic colectomy for colon cancer: comparable to conventional oncologic surgery? Clin Colon Rectal Surg 18:174–181CrossRef Bonnor RM, Ludwig KA (2005) Laparoscopic colectomy for colon cancer: comparable to conventional oncologic surgery? Clin Colon Rectal Surg 18:174–181CrossRef
5.
go back to reference Clinical Outcomes of Surgical Therapy Study Group, Nelson H, Sargent DJ et al (2004) A comparison of laparoscopically assisted and open colectomy for colon cancer. N Engl J Med 350:2050–2059CrossRef Clinical Outcomes of Surgical Therapy Study Group, Nelson H, Sargent DJ et al (2004) A comparison of laparoscopically assisted and open colectomy for colon cancer. N Engl J Med 350:2050–2059CrossRef
6.
go back to reference Veldkamp R, Kuhry E, Hop WC, Jeekel J, Kazemier G, Bonjer JH, Haglind E, Påhlman L, Cuesta MA, Msika S, Morino M, Lacy AM (2005) Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial. Lancet Oncol 6:477–484CrossRef Veldkamp R, Kuhry E, Hop WC, Jeekel J, Kazemier G, Bonjer JH, Haglind E, Påhlman L, Cuesta MA, Msika S, Morino M, Lacy AM (2005) Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial. Lancet Oncol 6:477–484CrossRef
7.
go back to reference Colon Cancer Laparoscopic or Open Resection Study Group, Buunen M, Veldkamp R et al (2009) Survival after laparoscopic surgery versus open surgery for colon cancer: long-term outcome of a randomised clinical trial. Lancet Oncol 10:44–52 Colon Cancer Laparoscopic or Open Resection Study Group, Buunen M, Veldkamp R et al (2009) Survival after laparoscopic surgery versus open surgery for colon cancer: long-term outcome of a randomised clinical trial. Lancet Oncol 10:44–52
8.
go back to reference Guillou PJ, Quirke P, Thorpe H, Walker J, Jayne DG, Smith AHM, Heath RM, Brown JM (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial. Lancet 365:1718–1726CrossRef Guillou PJ, Quirke P, Thorpe H, Walker J, Jayne DG, Smith AHM, Heath RM, Brown JM (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial. Lancet 365:1718–1726CrossRef
9.
go back to reference Jayne DG, Thorpe HC, Copeland J, Quirke P, Brown JM, Guillou PJ (2010) Five-year follow-up of the Medical Research Council CLASICC Trial of laparoscopically assisted versus open surgery for colorectal cancer. Br J Surg 97:1638–1645CrossRef Jayne DG, Thorpe HC, Copeland J, Quirke P, Brown JM, Guillou PJ (2010) Five-year follow-up of the Medical Research Council CLASICC Trial of laparoscopically assisted versus open surgery for colorectal cancer. Br J Surg 97:1638–1645CrossRef
10.
go back to reference Jayne DG, Guillou PJ, Thorpe H, Quirke P, Copeland J, Smith AMH, Heath RM, Brown JM (2007) Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC Trial Group. J Clin Oncol 25:3061–3068CrossRef Jayne DG, Guillou PJ, Thorpe H, Quirke P, Copeland J, Smith AMH, Heath RM, Brown JM (2007) Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC Trial Group. J Clin Oncol 25:3061–3068CrossRef
11.
go back to reference Simillis C, Lal N, Thoukididou SN, Kontovounisios C, Smith JJ, Hompes R, Adamina M, Tekkis PP (2019) Open versus laparoscopic versus robotic versus transanal mesorectal excision for rectal cancer: a systematic review and network meta-analysis. Ann Surg 270:59–68CrossRef Simillis C, Lal N, Thoukididou SN, Kontovounisios C, Smith JJ, Hompes R, Adamina M, Tekkis PP (2019) Open versus laparoscopic versus robotic versus transanal mesorectal excision for rectal cancer: a systematic review and network meta-analysis. Ann Surg 270:59–68CrossRef
12.
go back to reference Park SS, Park B, Park EY, Park SC, Kim MJ, Sohn DK, Oh JH (2020) Outcomes of high versus low ligation of the inferior mesenteric artery with lymph node dissection for distal sigmoid colon or rectal cancer. Surg Today 50:560–568CrossRef Park SS, Park B, Park EY, Park SC, Kim MJ, Sohn DK, Oh JH (2020) Outcomes of high versus low ligation of the inferior mesenteric artery with lymph node dissection for distal sigmoid colon or rectal cancer. Surg Today 50:560–568CrossRef
13.
go back to reference Planellas P, Salvador H, Farrés R, Gómez N, Julià D, Gil J, Pujadas M, Marinello F, Cornejo L, Codina A (2019) A randomized clinical trial comparing the initial vascular approach to the inferior mesenteric vein versus the inferior mesenteric artery in laparoscopic surgery of rectal cancer and sigmoid colon cancer. Surg Endosc 33:1310–1318CrossRef Planellas P, Salvador H, Farrés R, Gómez N, Julià D, Gil J, Pujadas M, Marinello F, Cornejo L, Codina A (2019) A randomized clinical trial comparing the initial vascular approach to the inferior mesenteric vein versus the inferior mesenteric artery in laparoscopic surgery of rectal cancer and sigmoid colon cancer. Surg Endosc 33:1310–1318CrossRef
14.
go back to reference Kenngott HG, Wagner M, Nickel F, Wekerle AL, Preukschas A, Apitz M, Schulte T, Rempel R, Mietkowski P, Wagner F, Termer A, Müller-Stich BP (2015) Computer-assisted abdominal surgery: new technologies. Langenbecks Arch Surg 400:273–281CrossRef Kenngott HG, Wagner M, Nickel F, Wekerle AL, Preukschas A, Apitz M, Schulte T, Rempel R, Mietkowski P, Wagner F, Termer A, Müller-Stich BP (2015) Computer-assisted abdominal surgery: new technologies. Langenbecks Arch Surg 400:273–281CrossRef
15.
go back to reference Kwak JM, Romagnolo L, Wijsmuller A, Gonzalez C, Agnus V, Lucchesi FR, Melani A, Marescaux J, Dallemagne B (2019) Stereotactic pelvic navigation with augmented reality for transanal total mesorectal excision. Dis Colon Rectum 62:123–129CrossRef Kwak JM, Romagnolo L, Wijsmuller A, Gonzalez C, Agnus V, Lucchesi FR, Melani A, Marescaux J, Dallemagne B (2019) Stereotactic pelvic navigation with augmented reality for transanal total mesorectal excision. Dis Colon Rectum 62:123–129CrossRef
16.
go back to reference Okada T, Kawada K, Sumii A, Itatan Y, Hida K, Hasegawa S, Sakai Y (2020) Stereotactic navigation for rectal surgery: comparison of 3-dimensional C-arm-based registration to paired-point registration. Dis Colon Rectum 63:693–700CrossRef Okada T, Kawada K, Sumii A, Itatan Y, Hida K, Hasegawa S, Sakai Y (2020) Stereotactic navigation for rectal surgery: comparison of 3-dimensional C-arm-based registration to paired-point registration. Dis Colon Rectum 63:693–700CrossRef
17.
go back to reference Hashimoto DA, Rosman G, Rus D, Meireles OR (2018) Artificial intelligence in surgery: promises and perils. Ann Surg 268:70–76CrossRef Hashimoto DA, Rosman G, Rus D, Meireles OR (2018) Artificial intelligence in surgery: promises and perils. Ann Surg 268:70–76CrossRef
18.
go back to reference Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651CrossRef Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651CrossRef
19.
go back to reference Kitaguchi D, Takeshita N, Matsuzaki H, Oda T, Watanabe M, Mori K, Kobayashi E, Ito M (2020) Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: experimental research. Int J Surg 79:88–94CrossRef Kitaguchi D, Takeshita N, Matsuzaki H, Oda T, Watanabe M, Mori K, Kobayashi E, Ito M (2020) Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: experimental research. Int J Surg 79:88–94CrossRef
20.
go back to reference Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder–decoder with atrous separable convolution for semantic image segmentation. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision—ECCV 2018, 2018. Lecture notes in computer science, vol 11211. Springer, Cham, pp 833–851 Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder–decoder with atrous separable convolution for semantic image segmentation. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision—ECCV 2018, 2018. Lecture notes in computer science, vol 11211. Springer, Cham, pp 833–851
21.
go back to reference Zhang H, Wu C, Zhang Z, Zhu Y, Lin H, Zhang Z, Sun Y, He T, Mueller J, Manmatha R, Li M, Smola A (2020) ResNeSt: split-attention networks, Dec 30, 2020. arXiv:2004.08955v2 [cs.CV] Zhang H, Wu C, Zhang Z, Zhu Y, Lin H, Zhang Z, Sun Y, He T, Mueller J, Manmatha R, Li M, Smola A (2020) ResNeSt: split-attention networks, Dec 30, 2020. arXiv:​2004.​08955v2 [cs.CV]
22.
go back to reference Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252CrossRef Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252CrossRef
23.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370:1453–1457CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370:1453–1457CrossRef
24.
go back to reference Atallah S, Martin-Perez B, Larach S (2015) Image-guided real-time navigation for transanal total mesorectal excision: a pilot study. Tech Coloproctol 19:679–684CrossRef Atallah S, Martin-Perez B, Larach S (2015) Image-guided real-time navigation for transanal total mesorectal excision: a pilot study. Tech Coloproctol 19:679–684CrossRef
25.
go back to reference Golfinos JG, Fitzpatrick BC, Smith LR, Spetzler RF (1995) Clinical use of a frameless stereotactic arm: results of 325 cases. J Neurol Surg 83:197–205 Golfinos JG, Fitzpatrick BC, Smith LR, Spetzler RF (1995) Clinical use of a frameless stereotactic arm: results of 325 cases. J Neurol Surg 83:197–205
26.
go back to reference Wirtz CR, Albert FK, Schwaderer M, Heuer C, Staubert A, Tronnier VM, Knauth M, Kunze S (2000) The benefit of neuronavigation for neurosurgery analyzed by its impact on glioblastoma surgery. Neurol Res 22:354–360CrossRef Wirtz CR, Albert FK, Schwaderer M, Heuer C, Staubert A, Tronnier VM, Knauth M, Kunze S (2000) The benefit of neuronavigation for neurosurgery analyzed by its impact on glioblastoma surgery. Neurol Res 22:354–360CrossRef
27.
go back to reference Helm PA, Teichman R, Hartmann SL, Simon D (2015) Spinal navigation and imaging: history, trends, and future. IEEE Trans Med Imaging 34:1738–1746CrossRef Helm PA, Teichman R, Hartmann SL, Simon D (2015) Spinal navigation and imaging: history, trends, and future. IEEE Trans Med Imaging 34:1738–1746CrossRef
28.
go back to reference van der List JP, Chawla H, Joskowicz L, Pearle AD (2016) Current state of computer navigation and robotics in unicompartmental and total knee arthroplasty: a systematic review with meta-analysis. Knee Surg Sports Traumatol Arthrosc 24:3482–3495CrossRef van der List JP, Chawla H, Joskowicz L, Pearle AD (2016) Current state of computer navigation and robotics in unicompartmental and total knee arthroplasty: a systematic review with meta-analysis. Knee Surg Sports Traumatol Arthrosc 24:3482–3495CrossRef
29.
go back to reference Eggers G, Mühling J, Marmulla R (2006) Image-to-patient registration techniques in head surgery. Int J Oral Maxillofac Surg 35:1081–1095CrossRef Eggers G, Mühling J, Marmulla R (2006) Image-to-patient registration techniques in head surgery. Int J Oral Maxillofac Surg 35:1081–1095CrossRef
30.
go back to reference Bernhardt S, Nicolau SA, Soler L, Doignon C (2017) The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal 37:66–90CrossRef Bernhardt S, Nicolau SA, Soler L, Doignon C (2017) The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal 37:66–90CrossRef
31.
go back to reference Zhang X, Wang J, Wang T, Ji X, Shen Y, Sun Z, Zhang X (2019) A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy. Int J Comput Assist Radiol Surg 14:1285–1294CrossRef Zhang X, Wang J, Wang T, Ji X, Shen Y, Sun Z, Zhang X (2019) A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy. Int J Comput Assist Radiol Surg 14:1285–1294CrossRef
Metadata
Title
Real-time vascular anatomical image navigation for laparoscopic surgery: experimental study
Authors
Daichi Kitaguchi
Nobuyoshi Takeshita
Hiroki Matsuzaki
Takahiro Igaki
Hiro Hasegawa
Shigehiro Kojima
Kensaku Mori
Masaaki Ito
Publication date
28-06-2022
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 8/2022
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-022-09384-7

Other articles of this Issue 8/2022

Surgical Endoscopy 8/2022 Go to the issue