Top

Surgical Endoscopy

Published in:

01-07-2014

Development of force-based metrics for skills assessment in minimally invasive surgery

Authors: Ana Luisa Trejos, Rajni V. Patel, Richard A. Malthaner, Christopher M. Schlachta

Published in: Surgical Endoscopy | Issue 7/2014

Abstract

Background

The loss of haptic information that results from the reduced-access conditions present in minimally invasive surgery (MIS) may compromise the safety of the procedures. This limitation must be overcome through training. However, current methods for determining the skill level of trainees do not measure critical elements of skill attainment. This study aimed to evaluate the usefulness of force information for the assessment of skill during MIS.

Methods

To achieve the study goal, experiments were performed using a set of sensorized instruments capable of measuring instrument position and tissue interaction forces. Several force-based metrics were developed as well as metrics that combine force and position information.

Results

The results show that experience level has a strong correlation with the new force-based metrics presented in this article. In particular, the integral and the derivative of the forces or the metrics that combine force and position provide the strongest correlations.

Conclusions

This study showed that force-based metrics are better indications of performance than metrics based on task completion time or position information alone. The proposed metrics can be automatically computed, are completely objective, and measure important aspects of performance.

Wulf G, Shea C, Lewthwaite R (2010) Motor skill learning and performance: a review of influential factors. Med Educ 44:75–84PubMedCrossRef

Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge D, Fried GM (2004) Relationship between objective assessment of technical skills and subjective in-training evaluation in surgical residents. J Am Coll Surg 198:105–110PubMedCrossRef

Cavallo F, Megali G, Sinigaglia S, Tonet O, Dario P (2006) A biomedical analysis of a surgeon’s gesture in a laparoscopic virtual scenario. In: Westwood JD, Haluck RS, Hoffman HM, Mogel GT, Phillips R, Robb RA, Vosburgh KG (eds) Medicine meets virtual reality. Studies in health technology and informatics, vol 119. IOS Press, Long Beach, pp 79–84

Dayan AB, Ziv A, Berkenstadt H, Munz Y (2008) A simple, low-cost platform for basic laparoscopic skills training. Surg Innov 15:136–142PubMedCrossRef

Schreuder HWR, Oei G, Maas M, Borleffs JCC, Schijven MP (2011) Implementation of simulation in surgical practice: minimally invasive surgery has taken the lead: the Dutch experience. Med Teach 33:105–115PubMedCrossRef

Khan MS, Bann SD, Darzi A, Butler PEM (2003) Assessing surgical skill. Plast Reconstr Surg 112:1886–1889PubMedCrossRef

Elliott D, Hansen S, Lyons J, Grierson LEM, Bennett SJ, Hayes SJ (2010) Goal-directed aiming: two components but multiple processes. Psychol Bull 136:1023–1044PubMedCrossRef

Elliott D, Helsen WF, Chua R (2001) A century later: Woodworth’s (1899) two-component model of goal-directed aiming. Psychol Bull 127:342–357PubMedCrossRef

Elliott D, Grierson LEM, Hayes SJ, Lyons J, Elliott D (2011) Action representations in perception, motor control, and learning: implications for medical education. Med Educ 45:119–131PubMedCrossRef

10.

Choi Y, Qi F, Gordon J, Schweighofer N (2008) Performance-based adaptive schedules enhance motor learning. J Mot Behav 40:273–280PubMedCrossRef

11.

Reiley C, Lin H, Yuh D, Hager G (2011) Review of methods for objective surgical skill evaluation. Surg Endosc 25:356–366PubMedCrossRef

12.

Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager A-MA, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338PubMedCrossRef

13.

Lammers RL, Davenport M, Korley F, Griswold-Theodorson S, Fitch MT, Narang AT, Evans LV, Gross A, Rodriguez E, Dodge KL, Hamann CJ, Robey WC (2008) Teaching and assessing procedural skills using simulation: metrics and methodology. Acad Emerg Med 15:1079–1087PubMedCrossRef

14.

Moody L, Baber C, Arvanitis TN, Elliott M (2003) Objective metrics for the evaluation of simple surgical skills in real and virtual domains. Presence Teleoper Virtual Environ 12:207–221CrossRef

15.

Datta V, Mandalia M, Mackay S, Chang A, Cheshire N, Darzi A (2002) Relationship between skill and outcome in the laboratory-based model. Surgery 131:318–323PubMedCrossRef

16.

Dubrowski A, Sidhu R, Park J, Carnahan H (2005) Quantification of motion characteristics and forces applied to tissues during suturing. Am J Surg 190:131–136PubMedCrossRef

17.

Beyer L, Troyer JD, Mancini J, Bladou F, Berdah SV, Karsenty G (2011) Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. Am J Surg 202:265–272PubMedCrossRef

18.

Derossis AM, Fried GM, Abrahamowicz M, Sigman HH, Barkun JS, Meakins JL (1998) Development of a model for training and evaluations of laparoscopic skills. Am J Surg 175:482–487PubMedCrossRef

19.

Bann S, Kwok K-F, Lo C-Y, Darzi A, Wong J (2003) Objective assessment of technical skills of surgical trainees in Hong Kong. Br J Surg 90:1294–1299PubMedCrossRef

20.

Cotin S, Stylopoulos N, Ottensmeyer M, Neumann P, Bardsley R, Dawson S (2005) Surgical training system for laparoscopic procedures. US Patent US2005/0 142 525 A1, 30 June

21.

Oropesa I, Lamata P, Sanchez-Gonzalez P, Pagador J, Garcia M, Sanchez-Margallo F, Gomez E (2011) Virtual reality simulators for objective evaluation on laparoscopic surgery: current trends and benefits. In: Kim J (ed) Virtual reality. Intech Open Access Publisher, Rijeka, pp 349–374

22.

Cao C, Zhou M, Jones D, Schwaitzberg S (2007) Can surgeons think and operate with haptics at the same time? J Gastrointest Surg 11:1564–1569PubMedCrossRef

23.

Datta V, Mackay S, Mandalia M, Darzi A (2001) The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 193:479–485PubMedCrossRef

24.

Rosen J, Hannaford B (2001) Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills”. IEEE Trans Biomed Eng 48:579–591PubMedCrossRef

25.

Boyle E, Al-Akash M, Gallagher AG, Traynor O, Hill ADK, Neary PC (2011) Optimising surgical training: use of feedback to reduce errors during a simulated surgical procedure. Postgrad Med J 87:524–528PubMedCrossRef

26.

Takada K, Yashiro K, Takagi M (2006) Reliability and sensitivity of jerk-cost measurement for evaluating irregularity of chewing jaw movements. Physiol Meas 27:609–622PubMedCrossRef

27.

Megali G, Sinigaglia S, Tonet O, Dario P (2006) Modelling and evaluation of surgical performance using hidden Markov models. IEEE Trans Biomed Eng 53:1911–1919PubMedCrossRef

28.

Loukas CG, Georgiou E (2011) Multivariate autoregressive modeling of hand kinematics for laparoscopic skills assessment of surgical trainees. IEEE Trans Biomed Eng 58:3289–3297. http://dblp.uni-trier.de/db/journals/tbe/tbe58.html#LoukasG11

29.

Rohrer B, Fasoli S, Krebs H, Hughes R, Volpe B, Frontera W, Stein J, Hogan N (2002) Movement smoothness changes during stroke recovery. J Neurosci 22:8297–8304PubMed

30.

Cristancho S, Hodgson A, Panton O, Meneghetti A, Warnock G, Qayumi K (2009) Intraoperative monitoring of laparoscopic skill development based on quantitative measures. Surg Endosc 23:2181–2190PubMedCrossRef

31.

Hwang H, Lim J, Kinnaird C, Nagy A, Panton O, Hodgson A, Qayumi K (2006) Correlating motor performance with surgical error in laparoscopic cholecystectomy. Surg Endosc 20:651–655PubMedCrossRef

32.

Hogan N, Sternad D (2009) Sensitivity of smoothness measures to movement duration, amplitude, and arrests. J Mot Behav 41:529–534PubMedCentralPubMedCrossRef

33.

Tang B, Hanna G, Cuschieri A (2005) Analysis of errors enacted by surgical trainees during skills training courses. Surgery 138:14–20PubMedCrossRef

34.

Stylopoulos N, Vosburgh KG (2007) Assessing technical skill in surgery and endoscopy: a set of metrics and an algorithm (C-PASS) to assess skills in surgical and endoscopic procedures. Surg Innov 14:113–121PubMedCrossRef

35.

Trejos AL, Patel RV, Naish MD, Malthaner RA, Schlachta CM (2013) The application of force sensing to skills assessment in minimally invasive surgery. IEEE International Conference on Robotics and Automation, Karlsruhe, 6–10 May

36.

Trejos AL, Patel RV, Naish MD, Schlachta CM (2009) A sensorized instrument for skills assessment and training in minimally invasive surgery. ASME J Med Devices 3:041 002-1–041 002-12CrossRef

37.

Trejos AL (2012) A sensorized instrument for minimally invasive surgery for the measurement of forces during training and surgery: development and applications. PhD Dissertation, Department of Electrical and Computer Engineering, The University of Western Ontario, Canada

38.

Stefanidis D, Hope WW, Korndorffer JR, Markley S, Scott DJ (2010) Initial laparoscopic basic skills training shortens the learning curve of laparoscopic suturing and is cost-effective. J Am Coll Surg 210:436–440PubMedCrossRef

Title: Development of force-based metrics for skills assessment in minimally invasive surgery
Authors: Ana Luisa Trejos
Rajni V. Patel
Richard A. Malthaner
Christopher M. Schlachta
Publication date: 01-07-2014
Publisher: Springer US
Published in: Surgical Endoscopy / Issue 7/2014
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI: https://doi.org/10.1007/s00464-014-3442-9

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Development of force-based metrics for skills assessment in minimally invasive surgery

Abstract

Background

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 7/2014

Integration of open and laparoscopic approaches for rectal cancer resection: oncologic and short-term outcomes

Safety of elective laparoscopic cholecystectomy in patients on dialysis: an analysis of the ACS NSQIP database

Fundoplication versus medical management of gastroesophageal reflux disease: systematic review and meta-analysis

Stereoscopic augmented reality for laparoscopic surgery

Perioperative characterization of anastomotic doughnuts with high-resolution probe-based confocal laser endomicroscopy in colorectal cancer surgery: a feasibility study

Clinical outcomes of second-look endoscopy after gastric endoscopic submucosal dissection: predictive factors with high risks of bleeding