Skip to main content
Top
Published in: Surgical Endoscopy 5/2019

Open Access 01-05-2019

Surgical phase modelling in minimal invasive surgery

Authors: F. C. Meeuwsen, F. van Luyn, M. D. Blikkendaal, F. W. Jansen, J. J. van den Dobbelsteen

Published in: Surgical Endoscopy | Issue 5/2019

Login to get access

Abstract

Background

Surgical Process Modelling (SPM) offers the possibility to automatically gain insight in the surgical workflow, with the potential to improve OR logistics and surgical care. Most studies have focussed on phase recognition modelling of the laparoscopic cholecystectomy, because of its standard and frequent execution. To demonstrate the broad applicability of SPM, more diverse and complex procedures need to be studied. The aim of this study is to investigate the accuracy in which we can recognise and extract surgical phases in laparoscopic hysterectomies (LHs) with inherent variability in procedure time. To show the applicability of the approach, the model was used to automatically predict surgical end-times.

Methods

A dataset of 40 video-recorded LHs was manually annotated for instrument use and divided into ten surgical phases. The use of instruments provided the feature input for building a Random Forest surgical phase recognition model that was trained to automatically recognise surgical phases. Tenfold cross-validation was performed to optimise the model for predicting the surgical end-time throughout the procedure.

Results

Average surgery time is 128 ± 27 min. Large variability within specific phases is seen. Overall, the Random Forest model reaches an accuracy of 77% recognising the current phase in the procedure. Six of the phases are predicted accurately over 80% of their duration. When predicting the surgical end-time, on average an error of 16 ± 13 min is reached throughout the procedure.

Conclusions

This study demonstrates an intra-operative approach to recognise surgical phases in 40 laparoscopic hysterectomy cases based on instrument usage data. The model is capable of automatic detection of surgical phases for generation of a solid prediction of the surgical end-time.
Literature
2.
3.
go back to reference Silber JH, Rosenbaum PR, Zhang X, Even-Shoshan O (2007) Influence of patient and hospital characteristics on anesthesia time in medicare patients undergoing general and orthopedic surgery. Anesthesiology 106:356CrossRefPubMed Silber JH, Rosenbaum PR, Zhang X, Even-Shoshan O (2007) Influence of patient and hospital characteristics on anesthesia time in medicare patients undergoing general and orthopedic surgery. Anesthesiology 106:356CrossRefPubMed
4.
go back to reference Eijkemans MJ, van Houdenhoven M, Nguyen T, Boersma E, Steyerberg EW, Kazemier G (2010) Predicting the unpredictable: a new prediction model for operating room times using individual characteristics and the surgeon’s estimate. Anesthesiology 112:41CrossRefPubMed Eijkemans MJ, van Houdenhoven M, Nguyen T, Boersma E, Steyerberg EW, Kazemier G (2010) Predicting the unpredictable: a new prediction model for operating room times using individual characteristics and the surgeon’s estimate. Anesthesiology 112:41CrossRefPubMed
5.
go back to reference Zhou J, Dexter F, Macario A, Lubarsky DA (1999) Relying solely on historical surgical times to estimate accurately future surgical times is unlikely to reduce the average length of time cases finish late. J Clin Anesthesia 11:601CrossRef Zhou J, Dexter F, Macario A, Lubarsky DA (1999) Relying solely on historical surgical times to estimate accurately future surgical times is unlikely to reduce the average length of time cases finish late. J Clin Anesthesia 11:601CrossRef
6.
go back to reference Katić D, Julliard C, Wekerle AL, Kenngott H, Müller-Stich BP, Dillmann R, Speidel S, Jannin P, Gibaud B (2015) Lapontospm: an ontology for laparoscopic surgeries and its application to surgical phase recognition. Int J Comput Assist Radiol Surg 10:1427CrossRefPubMed Katić D, Julliard C, Wekerle AL, Kenngott H, Müller-Stich BP, Dillmann R, Speidel S, Jannin P, Gibaud B (2015) Lapontospm: an ontology for laparoscopic surgeries and its application to surgical phase recognition. Int J Comput Assist Radiol Surg 10:1427CrossRefPubMed
7.
go back to reference Padoy N, Blum T, Feussner H, Berger MO, Navab N (2008) On-line recognition of surgical activity for monitoring in the operating room. In: AAAI, pp 1718–1724 Padoy N, Blum T, Feussner H, Berger MO, Navab N (2008) On-line recognition of surgical activity for monitoring in the operating room. In: AAAI, pp 1718–1724
8.
go back to reference Ahmadi SA, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2006) Recovery of surgical workflow without explicit models. In: Medical image computing and computer-assisted intervention—MICCAI 2006. Springer, New York, pp 420–428CrossRef Ahmadi SA, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2006) Recovery of surgical workflow without explicit models. In: Medical image computing and computer-assisted intervention—MICCAI 2006. Springer, New York, pp 420–428CrossRef
10.
go back to reference Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. Information Processing in Computer-Assisted Interventions Lecture Notes in Computer Science, pp 148–157. https://doi.org/10.1007/978-3-319-07521-1_16 Stauder R, Okur A, Peter L, Schneider A, Kranzfelder M, Feussner H, Navab N (2014) Random forests for phase detection in surgical workflow analysis. Information Processing in Computer-Assisted Interventions Lecture Notes in Computer Science, pp 148–157. https://​doi.​org/​10.​1007/​978-3-319-07521-1_​16
14.
go back to reference R Core Team (2016) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna R Core Team (2016) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna
15.
go back to reference RStudio Team, RStudio (2016) Integrated development environment for R. RStudio, Inc., Boston RStudio Team, RStudio (2016) Integrated development environment for R. RStudio, Inc., Boston
17.
go back to reference Liaw A, Wiener M (2002) Classification and regression by randomforest. R News 2:18 Liaw A, Wiener M (2002) Classification and regression by randomforest. R News 2:18
20.
go back to reference Gomes C, Almada-Lobo B, Borges J, Soares C (2012), Integrating data mining and optimization techniques on surgery scheduling. In: Advanced data mining and applications. Springer, New York, pp 589–602 Gomes C, Almada-Lobo B, Borges J, Soares C (2012), Integrating data mining and optimization techniques on surgery scheduling. In: Advanced data mining and applications. Springer, New York, pp 589–602
21.
go back to reference Nakamura R, Aizawa T, Muragaki Y, Maruyama T, Iseki H (2013) Method for end time prediction of brain tumor resections using analysis of surgical navigation information and tumor size characteristics. In: World Congress on medical physics and biomedical engineering, May 26–31, 2012, Beijing, China. Springer, New York, pp 1452–1455 Nakamura R, Aizawa T, Muragaki Y, Maruyama T, Iseki H (2013) Method for end time prediction of brain tumor resections using analysis of surgical navigation information and tumor size characteristics. In: World Congress on medical physics and biomedical engineering, May 26–31, 2012, Beijing, China. Springer, New York, pp 1452–1455
24.
go back to reference Miyawaki F, Tsunoi T, Namiki H, Yaginuma T, Yoshimitsu K, Hashimoto D, Fukui Y (2009) Development of automatic acquisition system of surgical-instrument informantion in endoscopic and laparoscopic surgey. In: 2009 4th IEEE conference on industrial electronics and applications. https://doi.org/10.1109/iciea.2009.5138763 Miyawaki F, Tsunoi T, Namiki H, Yaginuma T, Yoshimitsu K, Hashimoto D, Fukui Y (2009) Development of automatic acquisition system of surgical-instrument informantion in endoscopic and laparoscopic surgey. In: 2009 4th IEEE conference on industrial electronics and applications. https://​doi.​org/​10.​1109/​iciea.​2009.​5138763
Metadata
Title
Surgical phase modelling in minimal invasive surgery
Authors
F. C. Meeuwsen
F. van Luyn
M. D. Blikkendaal
F. W. Jansen
J. J. van den Dobbelsteen
Publication date
01-05-2019
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 5/2019
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-018-6417-4

Other articles of this Issue 5/2019

Surgical Endoscopy 5/2019 Go to the issue