Skip to main content
Top
Published in: Journal of Cardiothoracic Surgery 1/2024

Open Access 14-02-2024 | Heart Surgery | Review

Enhancing surgical performance in cardiothoracic surgery with innovations from computer vision and artificial intelligence: a narrative review

Authors: Merryn D. Constable, Hubert P. H. Shum, Stephen Clark

Published in: Journal of Cardiothoracic Surgery | Issue 1/2024

Login to get access

Abstract

When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial. This narrative review synthesises work on technical and non-technical surgical skills, collaborative task performance, and pose estimation to illustrate new opportunities to advance cardiothoracic surgical performance with innovations from computer vision and artificial intelligence. These technological innovations are critically evaluated in terms of the benefits they could offer the cardiothoracic surgical community, and any barriers to the uptake of the technology are elaborated upon. Like some other specialities, cardiothoracic surgery has relatively few opportunities to benefit from tools with data capture technology embedded within them (as is possible with robotic-assisted laparoscopic surgery, for example). In such cases, pose estimation techniques that allow for movement tracking across a conventional operating field without using specialist equipment or markers offer considerable potential. With video data from either simulated or real surgical procedures, these tools can (1) provide insight into the development of expertise and surgical performance over a surgeon’s career, (2) provide feedback to trainee surgeons regarding areas for improvement, (3) provide the opportunity to investigate what aspects of skill may be linked to patient outcomes which can (4) inform the aspects of surgical skill which should be focused on within training or mentoring programmes. Classifier or assessment algorithms that use artificial intelligence to ‘learn’ what expertise is from expert surgical evaluators could further assist educators in determining if trainees meet competency thresholds. With collaborative efforts between surgical teams, medical institutions, computer scientists and researchers to ensure this technology is developed with usability and ethics in mind, the developed feedback tools could improve cardiothoracic surgical practice in a data-driven way.
Footnotes
1
Some theoretical conceptualisations of surgical skill consider cognitive skills to be distinct from non-technical skills [1].
 
2
Electromagnetic tracking [54] avoids issues of visual occlusion but in addition to the requirement of markers it requires that there be no magnetic interference present. Varieties of tracking techniques, and their suitability for given tasks have been summarised elsewhere [55].
 
Literature
18.
go back to reference Jeannerod M. Motor Cognition: What Actions Tell the Self. OUP Oxford; 2006. Jeannerod M. Motor Cognition: What Actions Tell the Self. OUP Oxford; 2006.
36.
go back to reference Strachan JWA, Curioni A, Constable MD, Charbonneu M. A methodology for distinguishing copying and reconstruction in cultural transmission episodes. 42nd Annual Meeting of the Cognitive, 2020. Strachan JWA, Curioni A, Constable MD, Charbonneu M. A methodology for distinguishing copying and reconstruction in cultural transmission episodes. 42nd Annual Meeting of the Cognitive, 2020.
41.
47.
go back to reference Insafutdinov E, Pishchulin L, Andres B, Andriluka M, Schiele B, DeeperCut:. A deeper, stronger, and faster multi-person pose estimation model. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision – ECCV 2016. Cham: Springer International Publishing; 2016. pp. 34–50. https://doi.org/10.1007/978-3-319-46466-4_3.CrossRef Insafutdinov E, Pishchulin L, Andres B, Andriluka M, Schiele B, DeeperCut:. A deeper, stronger, and faster multi-person pose estimation model. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision – ECCV 2016. Cham: Springer International Publishing; 2016. pp. 34–50. https://​doi.​org/​10.​1007/​978-3-319-46466-4_​3.CrossRef
50.
go back to reference Kurmann T, Marquez Neila P, Du X, Fua P, Stoyanov D, Wolf S, et al. Simultaneous Recognition and Pose Estimation of Instruments in minimally invasive surgery. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins DL, Duchesne S, editors. Medical Image Computing and Computer-assisted Intervention – MICCAI 2017. Cham: Springer International Publishing; 2017. pp. 505–13. https://doi.org/10.1007/978-3-319-66185-8_57.CrossRef Kurmann T, Marquez Neila P, Du X, Fua P, Stoyanov D, Wolf S, et al. Simultaneous Recognition and Pose Estimation of Instruments in minimally invasive surgery. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins DL, Duchesne S, editors. Medical Image Computing and Computer-assisted Intervention – MICCAI 2017. Cham: Springer International Publishing; 2017. pp. 505–13. https://​doi.​org/​10.​1007/​978-3-319-66185-8_​57.CrossRef
51.
59.
60.
go back to reference Ismail Fawaz H, Forestier G, Weber J, Idoumghar L, Muller P-A. Evaluating Surgical skills from Kinematic Data using Convolutional neural networks. In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G, editors. Medical Image Computing and Computer assisted intervention – MICCAI 2018. Cham: Springer International Publishing; 2018. pp. 214–21. https://doi.org/10.1007/978-3-030-00937-3_25.CrossRef Ismail Fawaz H, Forestier G, Weber J, Idoumghar L, Muller P-A. Evaluating Surgical skills from Kinematic Data using Convolutional neural networks. In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G, editors. Medical Image Computing and Computer assisted intervention – MICCAI 2018. Cham: Springer International Publishing; 2018. pp. 214–21. https://​doi.​org/​10.​1007/​978-3-030-00937-3_​25.CrossRef
63.
go back to reference Holstein K, Wortman Vaughan J, Daumé H, Dudik M, Wallach H. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: Association for Computing Machinery; 2019, p. 1–16. https://doi.org/10.1145/3290605.3300830. Holstein K, Wortman Vaughan J, Daumé H, Dudik M, Wallach H. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, New York, NY, USA: Association for Computing Machinery; 2019, p. 1–16. https://​doi.​org/​10.​1145/​3290605.​3300830.
Metadata
Title
Enhancing surgical performance in cardiothoracic surgery with innovations from computer vision and artificial intelligence: a narrative review
Authors
Merryn D. Constable
Hubert P. H. Shum
Stephen Clark
Publication date
14-02-2024
Publisher
BioMed Central
Published in
Journal of Cardiothoracic Surgery / Issue 1/2024
Electronic ISSN: 1749-8090
DOI
https://doi.org/10.1186/s13019-024-02558-5

Other articles of this Issue 1/2024

Journal of Cardiothoracic Surgery 1/2024 Go to the issue