Skip to main content
Top
Published in: Surgical Endoscopy 4/2024

Open Access 11-03-2024 | Review Article

Assessment and application of non-technical skills in robotic-assisted surgery: a systematic review

Authors: Vimaladhithan Mahendran, Laura Turpin, Matthew Boal, Nader K. Francis

Published in: Surgical Endoscopy | Issue 4/2024

Login to get access

Abstract

Background

Undeniably, robotic-assisted surgery (RAS) has become very popular in recent decades, but it has introduced challenges to the workflow of the surgical team. Non-technical skills (NTS) have received less emphasis than technical skills in training and assessment. The systematic review aimed to update the evidence on the role of NTS in robotic surgery, specifically focusing on evaluating assessment tools and their utilisation in training and surgical education in robotic surgery.

Methods

A systematic literature search of PubMed, PsycINFO, MEDLINE, and EMBASE was conducted to identify primary articles on NTS in RAS. Messick’s validity framework and the Modified Medical Education Research Study Quality Instrument were utilised to evaluate the quality of the validity evidence of the abstracted articles.

Results

Seventeen studies were eligible for the final analysis. Communication, environmental factors, anticipation and teamwork were key NTS for RAS. Team-related factors such as ambient noise and chatter, inconveniences due to repeated requests during the procedure and constraints due to poor design of the operating room may harm patient safety during RAS. Three novel rater-based scoring systems and one sensor-based method for assessing NTS in RAS were identified. Anticipation by the team to predict and execute the next move before an explicit verbal command improved the surgeon’s situational awareness.

Conclusion

This systematic review highlighted the paucity of reporting on non-technical skills in robotic surgery with only three bespoke objective assessment tools being identified. Communication, environmental factors, anticipation, and teamwork are the key non-technical skills reported in robotic surgery, and further research is required to investigate their benefits to improve patient safety during robotic surgery.
Literature
1.
go back to reference Koukourikis P, Rha KH (2021) Robotic surgical systems in urology: What is currently available? Investig Clin Urol 62(1):14CrossRefPubMed Koukourikis P, Rha KH (2021) Robotic surgical systems in urology: What is currently available? Investig Clin Urol 62(1):14CrossRefPubMed
2.
go back to reference Kanji F, Catchpole K, Choi E, Alfred M, Cohen K, Shouhed D, Anger J, Cohen T (2021) Work-system interventions in robotic-assisted surgery: a systematic review exploring the gap between challenges and solutions. Surg Endosc 35:1976–1989CrossRefPubMed Kanji F, Catchpole K, Choi E, Alfred M, Cohen K, Shouhed D, Anger J, Cohen T (2021) Work-system interventions in robotic-assisted surgery: a systematic review exploring the gap between challenges and solutions. Surg Endosc 35:1976–1989CrossRefPubMed
3.
go back to reference Randell R, Honey S, Alvarado N, Pearman A, Greenhalgh J, Long A, Gardner P, Gill A, Jayne D, Dowding D (2016) Embedding robotic surgery into routine practice and impacts on communication and decision making: a review of the experience of surgical teams. Cogn Technol Work 18:423–437CrossRef Randell R, Honey S, Alvarado N, Pearman A, Greenhalgh J, Long A, Gardner P, Gill A, Jayne D, Dowding D (2016) Embedding robotic surgery into routine practice and impacts on communication and decision making: a review of the experience of surgical teams. Cogn Technol Work 18:423–437CrossRef
4.
go back to reference Kohn LT, Kohn LT, Corrigan JM, Donaldson MS et al (eds) (2000) To Err is human: building a safer health system. National Academies Press, US Kohn LT, Kohn LT, Corrigan JM, Donaldson MS et al (eds) (2000) To Err is human: building a safer health system. National Academies Press, US
5.
go back to reference Gawande AA, Zinner MJ, Studdert DM, Brennan TA (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133(6):614–621CrossRefPubMed Gawande AA, Zinner MJ, Studdert DM, Brennan TA (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133(6):614–621CrossRefPubMed
6.
go back to reference Flin RH, O’Connor P, Crichton M (2008) Safety at the sharp end: a guide to non-technical skills. Ashgate Publishing, London Flin RH, O’Connor P, Crichton M (2008) Safety at the sharp end: a guide to non-technical skills. Ashgate Publishing, London
7.
go back to reference Chen R, Rodrigues Armijo P, Robotic KC, Task Force SAGES, Siu KC, Oleynikov D (2020) A comprehensive review of robotic surgery curriculum and training for residents, fellows, and postgraduate surgical education. Surg Endosc 34(1):361–367CrossRefPubMed Chen R, Rodrigues Armijo P, Robotic KC, Task Force SAGES, Siu KC, Oleynikov D (2020) A comprehensive review of robotic surgery curriculum and training for residents, fellows, and postgraduate surgical education. Surg Endosc 34(1):361–367CrossRefPubMed
8.
go back to reference Kwong JC, Lee JY, Goldenberg MG (2019) Understanding and assessing nontechnical skills in robotic urological surgery: a systematic review and synthesis of the validity evidence. J Surg Educ 76(1):193–200CrossRefPubMed Kwong JC, Lee JY, Goldenberg MG (2019) Understanding and assessing nontechnical skills in robotic urological surgery: a systematic review and synthesis of the validity evidence. J Surg Educ 76(1):193–200CrossRefPubMed
9.
go back to reference Gjeraa K, Spanager L, Konge L, Petersen RH, Østergaard D (2016) Non-technical skills in minimally invasive surgery teams: a systematic review. Surg Endosc 30:5185–5199CrossRefPubMed Gjeraa K, Spanager L, Konge L, Petersen RH, Østergaard D (2016) Non-technical skills in minimally invasive surgery teams: a systematic review. Surg Endosc 30:5185–5199CrossRefPubMed
10.
go back to reference Cha JS, Yu D (2022) Objective measures of surgeon non-technical skills in surgery: a scoping review. Hum Factors 64(1):42–73CrossRefPubMed Cha JS, Yu D (2022) Objective measures of surgeon non-technical skills in surgery: a scoping review. Hum Factors 64(1):42–73CrossRefPubMed
11.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 151(4):264–269CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 151(4):264–269CrossRefPubMed
13.
go back to reference Howick J, Chalmers I, Glasziou P, Greenhalgh T, Heneghan C, Liberati A, Moschetti I, Phillips B, Thornton H (2011) The 2011 Oxford CEBM evidence levels of evidence (introductory document). Oxford Center for Evidence Based Medicine Howick J, Chalmers I, Glasziou P, Greenhalgh T, Heneghan C, Liberati A, Moschetti I, Phillips B, Thornton H (2011) The 2011 Oxford CEBM evidence levels of evidence (introductory document). Oxford Center for Evidence Based Medicine
14.
go back to reference Al Asmri M, Haque MS, Parle J (2023) A Modified Medical Education Research Study Quality Instrument (MMERSQI) developed by Delphi consensus. BMC Med Educ 23(1):1–8CrossRef Al Asmri M, Haque MS, Parle J (2023) A Modified Medical Education Research Study Quality Instrument (MMERSQI) developed by Delphi consensus. BMC Med Educ 23(1):1–8CrossRef
15.
go back to reference Messick S (1994) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. ETS Research Report Series 1994(2):i–28CrossRef Messick S (1994) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. ETS Research Report Series 1994(2):i–28CrossRef
16.
go back to reference Klein MI, Lio CH, Grant R, Carswell CM, Strup S (2009) A mental workload study on the 2d and 3d viewing conditions of the da Vinci surgical robot. Proc Human Factors Ergonom Soc Annu Meet 53(18):1186–1190CrossRef Klein MI, Lio CH, Grant R, Carswell CM, Strup S (2009) A mental workload study on the 2d and 3d viewing conditions of the da Vinci surgical robot. Proc Human Factors Ergonom Soc Annu Meet 53(18):1186–1190CrossRef
17.
go back to reference Ahmed Y, Lone Z, Hussein AA, Feng Y, Khan H, Broad S, Kannappan R, Skowronski A, Cole A, Wang D, Stone K (2019) Do surgeon non-technical skills correlate with teamwork-related outcomes during robot-assisted surgery? BMJ Lead 3:69–74CrossRef Ahmed Y, Lone Z, Hussein AA, Feng Y, Khan H, Broad S, Kannappan R, Skowronski A, Cole A, Wang D, Stone K (2019) Do surgeon non-technical skills correlate with teamwork-related outcomes during robot-assisted surgery? BMJ Lead 3:69–74CrossRef
18.
go back to reference Sexton K, Johnson A, Gotsch A, Hussein AA, Cavuoto L, Guru KA (2018) Anticipation, teamwork and cognitive load: chasing efficiency during robot-assisted surgery. BMJ Qual Saf 27(2):148–154CrossRefPubMed Sexton K, Johnson A, Gotsch A, Hussein AA, Cavuoto L, Guru KA (2018) Anticipation, teamwork and cognitive load: chasing efficiency during robot-assisted surgery. BMJ Qual Saf 27(2):148–154CrossRefPubMed
19.
go back to reference AlJamal YN, Baloul MS, Mathis KL, Dozois EJ, Kelley SR (2021) Evaluating non-operative robotic skills in colorectal surgical training. J Surg Res 260:391–398CrossRefPubMed AlJamal YN, Baloul MS, Mathis KL, Dozois EJ, Kelley SR (2021) Evaluating non-operative robotic skills in colorectal surgical training. J Surg Res 260:391–398CrossRefPubMed
21.
go back to reference Hart SG (2006) NASA-task load index (NASA-TLX); 20 years later. Proc Human Factors and Ergonom Soc Annu Meet 50(9):904–908CrossRef Hart SG (2006) NASA-task load index (NASA-TLX); 20 years later. Proc Human Factors and Ergonom Soc Annu Meet 50(9):904–908CrossRef
22.
go back to reference Boles DB, Bursk JH, Phillips JB, Perdelwitz JR (2007) Predicting dual-task performance with the Multiple Resources Questionnaire (MRQ). Hum Factors 49(1):32–45CrossRefPubMed Boles DB, Bursk JH, Phillips JB, Perdelwitz JR (2007) Predicting dual-task performance with the Multiple Resources Questionnaire (MRQ). Hum Factors 49(1):32–45CrossRefPubMed
23.
go back to reference Tiferes J, Hussein AA, Bisantz A, Kozlowski JD, Sharif MA, Winder NM, Ahmad N, Allers J, Cavuoto L, Guru KA (2016) The loud surgeon behind the console: understanding team activities during robot-assisted surgery. J Surg Educ 73(3):504–512CrossRefPubMed Tiferes J, Hussein AA, Bisantz A, Kozlowski JD, Sharif MA, Winder NM, Ahmad N, Allers J, Cavuoto L, Guru KA (2016) The loud surgeon behind the console: understanding team activities during robot-assisted surgery. J Surg Educ 73(3):504–512CrossRefPubMed
26.
go back to reference Zattoni F, Guttilla A, Crestani A, De Gobbi A, Cattaneo F, Moschini M, Vianello F, Valotto C, Dal Moro F, Zattoni F (2015) The value of open conversion simulations during robot-assisted radical prostatectomy: implications for robotic training curricula. J Endourol 29(11):1282–1288CrossRefPubMed Zattoni F, Guttilla A, Crestani A, De Gobbi A, Cattaneo F, Moschini M, Vianello F, Valotto C, Dal Moro F, Zattoni F (2015) The value of open conversion simulations during robot-assisted radical prostatectomy: implications for robotic training curricula. J Endourol 29(11):1282–1288CrossRefPubMed
27.
go back to reference Melnyk R, Saba P, Holler T, Cameron K, Mithal P, Rappold P, Wu G, Cubillos J, Rashid H, Joseph JV, Ghazi AE (2022) Design and implementation of an emergency undocking curriculum for robotic surgery. Simul Healthc 17(2):78–87CrossRefPubMed Melnyk R, Saba P, Holler T, Cameron K, Mithal P, Rappold P, Wu G, Cubillos J, Rashid H, Joseph JV, Ghazi AE (2022) Design and implementation of an emergency undocking curriculum for robotic surgery. Simul Healthc 17(2):78–87CrossRefPubMed
28.
go back to reference Raison N, Wood T, Brunckhorst O, Abe T, Ross T, Challacombe B, Khan MS, Novara G, Buffi N, Van Der Poel H, McIlhenny C (2017) Development and validation of a tool for non-technical skills evaluation in robotic surgery—the ICARS system. Surg Endosc 31:5403–5410CrossRefPubMed Raison N, Wood T, Brunckhorst O, Abe T, Ross T, Challacombe B, Khan MS, Novara G, Buffi N, Van Der Poel H, McIlhenny C (2017) Development and validation of a tool for non-technical skills evaluation in robotic surgery—the ICARS system. Surg Endosc 31:5403–5410CrossRefPubMed
29.
go back to reference Schreyer J, Koch A, Herlemann A, Becker A, Schlenker B, Catchpole K, Weigl M (2022) RAS-NOTECHS: validity and reliability of a tool for measuring non-technical skills in robotic-assisted surgery settings. Surg Endosc 36:1916–1926CrossRefPubMed Schreyer J, Koch A, Herlemann A, Becker A, Schlenker B, Catchpole K, Weigl M (2022) RAS-NOTECHS: validity and reliability of a tool for measuring non-technical skills in robotic-assisted surgery settings. Surg Endosc 36:1916–1926CrossRefPubMed
30.
go back to reference Manuguerra A, Mazeaud C, Hubert N, Eschwège P, Roumiguié M, Salleron J, Hubert J (2021) Non-technical skills in robotic surgery and impact on near-miss events: a multi-center study. Surg Endosc 35:5062–5071CrossRefPubMed Manuguerra A, Mazeaud C, Hubert N, Eschwège P, Roumiguié M, Salleron J, Hubert J (2021) Non-technical skills in robotic surgery and impact on near-miss events: a multi-center study. Surg Endosc 35:5062–5071CrossRefPubMed
32.
go back to reference Szold A, Bergamaschi R, Broeders I, Dankelman J, Forgione A, Langø T, Melzer A, Mintz Y, Morales-Conde S, Rhodes M, Satava R (2015) European Association of Endoscopic Surgeons (EAES) consensus statement on the use of robotics in general surgery. Surg Endosc 29:253–288CrossRefPubMed Szold A, Bergamaschi R, Broeders I, Dankelman J, Forgione A, Langø T, Melzer A, Mintz Y, Morales-Conde S, Rhodes M, Satava R (2015) European Association of Endoscopic Surgeons (EAES) consensus statement on the use of robotics in general surgery. Surg Endosc 29:253–288CrossRefPubMed
33.
go back to reference Zattoni F, Morlacco A, Cattaneo F, Soligo M, Meggiato L, Modonutti D, Valotto C, Dal Moro F, Zattoni F (2017) Development of a surgical safety training program and checklist for conversion during robotic partial nephrectomies. Urology 109:38–43CrossRefPubMed Zattoni F, Morlacco A, Cattaneo F, Soligo M, Meggiato L, Modonutti D, Valotto C, Dal Moro F, Zattoni F (2017) Development of a surgical safety training program and checklist for conversion during robotic partial nephrectomies. Urology 109:38–43CrossRefPubMed
34.
35.
go back to reference Myklebust MV, Storheim H, Hartvik M, Dysvik E (2020) Anesthesia professionals’ perspectives of teamwork during robotic-assisted surgery. AORN J 111(1):87–96CrossRefPubMed Myklebust MV, Storheim H, Hartvik M, Dysvik E (2020) Anesthesia professionals’ perspectives of teamwork during robotic-assisted surgery. AORN J 111(1):87–96CrossRefPubMed
36.
go back to reference Raison N, Ahmed K, Abe T, Brunckhorst O, Novara G, Buffi N, McIlhenny C, van der Poel H, van Hemelrijck M, Gavazzi A, Dasgupta P (2018) Cognitive training for technical and non-technical skills in robotic surgery: a randomised controlled trial. BJU Int 122(6):1075–1081CrossRefPubMed Raison N, Ahmed K, Abe T, Brunckhorst O, Novara G, Buffi N, McIlhenny C, van der Poel H, van Hemelrijck M, Gavazzi A, Dasgupta P (2018) Cognitive training for technical and non-technical skills in robotic surgery: a randomised controlled trial. BJU Int 122(6):1075–1081CrossRefPubMed
Metadata
Title
Assessment and application of non-technical skills in robotic-assisted surgery: a systematic review
Authors
Vimaladhithan Mahendran
Laura Turpin
Matthew Boal
Nader K. Francis
Publication date
11-03-2024
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 4/2024
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-024-10713-1

Other articles of this Issue 4/2024

Surgical Endoscopy 4/2024 Go to the issue