Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 1/2019

01-01-2019 | Original Article

Conditions for reliable grip force and jaw angle estimation of da Vinci surgical tools

Authors: Trevor K. Stephens, John J. O’Neill, Nathan J. Kong, Mark V. Mazzeo, Jack E. Norfleet, Robert M. Sweet, Timothy M. Kowalewski

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 1/2019

Login to get access

Abstract

Purpose

This work presents an estimation technique as well as corresponding conditions which are necessary to produce an accurate estimate of grip force and jaw angle on a da Vinci surgical tool using back-end sensors alone.

Methods

This work utilizes an artificial neural network as the regression estimator on a dataset acquired from custom hardware on the proximal and distal ends. Through a series of experiments, we test the effect of estimation accuracy due to change in operating frequency, using the opposite jaw, and using different tools. A case study is then presented comparing our estimation technique with direct measurements of material response curves on two synthetic tissue surrogates.

Results

We establish the following criteria as necessary to produce an accurate estimate: operate within training frequency bounds, use the same side jaw, and use the same tool. Under these criteria, an average root mean square error of 1.04 mN m in grip force and 0.17 degrees in jaw angle is achieved. Additionally, applying these criteria in the case study resulted in direct measurements which fell within the 95% confidence bands of our estimation technique.

Conclusion

Our estimation technique, along with important training criteria, is presented herein to further improve the literature pertaining to grip force estimation. We propose the training criteria to begin establishing bounds on the applicability of estimation techniques used for grip force estimation for eventual translation into clinical practice.
Footnotes
Literature
1.
go back to reference Anooshahpour F, Polushin IG, Patel RV (2014) Quasi-static modeling of the da Vinci instrument. In: International conference on intelligent robots and systems (IROS). IEEE, pp 1308–1313 Anooshahpour F, Polushin IG, Patel RV (2014) Quasi-static modeling of the da Vinci instrument. In: International conference on intelligent robots and systems (IROS). IEEE, pp 1308–1313
2.
go back to reference Barocas V, Tenorio LM, Devine K, Lee J, Sweet R, Norfleet J, Mazzeo M (2016) A paradigm for materials design for surgical simulators, with specific application to the pleura and needle decompression. J Med Dev 10(3):030934CrossRef Barocas V, Tenorio LM, Devine K, Lee J, Sweet R, Norfleet J, Mazzeo M (2016) A paradigm for materials design for surgical simulators, with specific application to the pleura and needle decompression. J Med Dev 10(3):030934CrossRef
3.
go back to reference Basdogan C, De S, Kim J, Muniyandi M, Kim H, Srinivasan MA (2004) Haptics in minimally invasive surgical simulation and training. IEEE Comput Graph Appl 24(2):56–64CrossRefPubMed Basdogan C, De S, Kim J, Muniyandi M, Kim H, Srinivasan MA (2004) Haptics in minimally invasive surgical simulation and training. IEEE Comput Graph Appl 24(2):56–64CrossRefPubMed
4.
go back to reference De S, Rosen J, Dagan A, Hannaford B, Swanson P, Sinanan M (2007) Assessment of tissue damage due to mechanical stresses. Int J Robot Res 26(11–12):1159–1171CrossRef De S, Rosen J, Dagan A, Hannaford B, Swanson P, Sinanan M (2007) Assessment of tissue damage due to mechanical stresses. Int J Robot Res 26(11–12):1159–1171CrossRef
5.
go back to reference Dockter R, O’Neill J, Stephens T, Kowalewski T (2016) Feasibility of tissue classification via da Vinci endowrist surgical tool. In: Hamlyn symposium on medical robotics, pp 64–65 Dockter R, O’Neill J, Stephens T, Kowalewski T (2016) Feasibility of tissue classification via da Vinci endowrist surgical tool. In: Hamlyn symposium on medical robotics, pp 64–65
6.
go back to reference Egorov V, Tsyuryupa S, Kanilo S, Kogit M, Sarvazyan A (2008) Soft tissue elastometer. Med Eng Phys 30(2):206–212CrossRefPubMed Egorov V, Tsyuryupa S, Kanilo S, Kogit M, Sarvazyan A (2008) Soft tissue elastometer. Med Eng Phys 30(2):206–212CrossRefPubMed
7.
go back to reference Foresee FD, Hagan MT (1997) Gauss–Newton approximation to Bayesian learning. IEEE Int Conf Neural Netw 3:1930–1935 Foresee FD, Hagan MT (1997) Gauss–Newton approximation to Bayesian learning. IEEE Int Conf Neural Netw 3:1930–1935
8.
go back to reference Hecht-Nielsen R (1987) Kolmogorov’s mapping neural network existence theorem. In: Proceedings of the international conference on neural networks. IEEE Press, pp 11–14 Hecht-Nielsen R (1987) Kolmogorov’s mapping neural network existence theorem. In: Proceedings of the international conference on neural networks. IEEE Press, pp 11–14
11.
go back to reference Kehoe B, Kahn G, Mahler J, Kim J, Lee A, Lee A, Nakagawa K, Patil S, Boyd WD, Abbeel P, Goldberg K (2014) Autonomous multilateral debridement with the raven surgical robot. In: International conference on robotics and automation (ICRA). IEEE, pp 1432–1439 Kehoe B, Kahn G, Mahler J, Kim J, Lee A, Lee A, Nakagawa K, Patil S, Boyd WD, Abbeel P, Goldberg K (2014) Autonomous multilateral debridement with the raven surgical robot. In: International conference on robotics and automation (ICRA). IEEE, pp 1432–1439
12.
go back to reference Kim U, Lee DH, Yoon WJ, Hannaford B, Choi HR (2015) Force sensor integrated surgical forceps for minimally invasive robotic surgery. IEEE Trans Robot 31(5):1214–1224CrossRef Kim U, Lee DH, Yoon WJ, Hannaford B, Choi HR (2015) Force sensor integrated surgical forceps for minimally invasive robotic surgery. IEEE Trans Robot 31(5):1214–1224CrossRef
13.
go back to reference Kim U, Kim YB, Seok DY, So J, Choi HR (2016) A new type of surgical forceps integrated with three-axial force sensor for minimally invasive robotic surgery. In: 2016 13th international conference on ubiquitous robots and ambient intelligence (URAI). IEEE, pp 135–137 Kim U, Kim YB, Seok DY, So J, Choi HR (2016) A new type of surgical forceps integrated with three-axial force sensor for minimally invasive robotic surgery. In: 2016 13th international conference on ubiquitous robots and ambient intelligence (URAI). IEEE, pp 135–137
14.
go back to reference Kong NJ, Stephens TK, ONeill JJ, Kowalewski TM (2017) Design of a portable dynamic calibration instrument for da Vinci Si tools. In: 2017 design of medical devices conference. American Society of Mechanical Engineers, pp V001T11A023–V001T11A023 Kong NJ, Stephens TK, ONeill JJ, Kowalewski TM (2017) Design of a portable dynamic calibration instrument for da Vinci Si tools. In: 2017 design of medical devices conference. American Society of Mechanical Engineers, pp V001T11A023–V001T11A023
15.
go back to reference Kong NJ, Stephens TK, Kowalewski TM (2018) Da Vinci tool torque mapping over 50,000 grasps and its implications on grip force estimation accuracy. In: 2018 international symposium on medical robotics (ISMR). IEEE, pp 1–6 Kong NJ, Stephens TK, Kowalewski TM (2018) Da Vinci tool torque mapping over 50,000 grasps and its implications on grip force estimation accuracy. In: 2018 international symposium on medical robotics (ISMR). IEEE, pp 1–6
16.
go back to reference Kowalewski TM, Sweet R, Lendvay TS, Menhadji A, Averch T, Box G, Brand T, Ferrandino M, Kaouk J, Knudsen B, Landman J, Lee B, Schwartz B, McDougall E (2016) Validation of the aua blus tasks. J Urol 195(4):998–1005CrossRefPubMed Kowalewski TM, Sweet R, Lendvay TS, Menhadji A, Averch T, Box G, Brand T, Ferrandino M, Kaouk J, Knudsen B, Landman J, Lee B, Schwartz B, McDougall E (2016) Validation of the aua blus tasks. J Urol 195(4):998–1005CrossRefPubMed
18.
go back to reference Lee C, Park YH, Yoon C, Noh S, Lee C, Kim Y, Kim HC, Kim HH, Kim S (2015) A grip force model for the da vinci end-effector to predict a compensation force. Med Biol Eng Comput 53(3):253–261CrossRefPubMed Lee C, Park YH, Yoon C, Noh S, Lee C, Kim Y, Kim HC, Kim HH, Kim S (2015) A grip force model for the da vinci end-effector to predict a compensation force. Med Biol Eng Comput 53(3):253–261CrossRefPubMed
19.
go back to reference Li Y, Hannaford B (2017) Gaussian process regression for sensorless grip force estimation of cable-driven elongated surgical instruments. IEEE Robot Autom Lett 2(3):1312–1319CrossRefPubMedPubMedCentral Li Y, Hannaford B (2017) Gaussian process regression for sensorless grip force estimation of cable-driven elongated surgical instruments. IEEE Robot Autom Lett 2(3):1312–1319CrossRefPubMedPubMedCentral
20.
go back to reference Li Y, Miyasaka M, Haghighipanah M, Cheng L, Hannaford B (2016) Dynamic modeling of cable driven elongated surgical instruments for sensorless grip force estimation. In: International conference on robotics and automation (ICRA). IEEE, pp 4128–4134 Li Y, Miyasaka M, Haghighipanah M, Cheng L, Hannaford B (2016) Dynamic modeling of cable driven elongated surgical instruments for sensorless grip force estimation. In: International conference on robotics and automation (ICRA). IEEE, pp 4128–4134
21.
go back to reference MacKay DJ (1992) A practical Bayesian framework for backpropagation networks. Neural Comput 4(3):448–472CrossRef MacKay DJ (1992) A practical Bayesian framework for backpropagation networks. Neural Comput 4(3):448–472CrossRef
22.
go back to reference Mucksavage P, Kerbl DC, Pick DL, Lee JY, McDougall EM, Louie MK (2011) Differences in grip forces among various robotic instruments and da Vinci surgical platforms. J Endourol 25(3):523–528CrossRefPubMed Mucksavage P, Kerbl DC, Pick DL, Lee JY, McDougall EM, Louie MK (2011) Differences in grip forces among various robotic instruments and da Vinci surgical platforms. J Endourol 25(3):523–528CrossRefPubMed
23.
go back to reference Nakai A, Kuwana K, Saito K, Dohi T, Kumagai A, Shimoyama I (2017) Mems 6-axis force-torque sensor attached to the tip of grasping forceps for identification of tumor in thoracoscopic surgery. In: 2017 IEEE 30th international conference on micro electro mechanical systems (MEMS). IEEE, pp 546–548 Nakai A, Kuwana K, Saito K, Dohi T, Kumagai A, Shimoyama I (2017) Mems 6-axis force-torque sensor attached to the tip of grasping forceps for identification of tumor in thoracoscopic surgery. In: 2017 IEEE 30th international conference on micro electro mechanical systems (MEMS). IEEE, pp 546–548
24.
go back to reference Puangmali P, Althoefer K, Seneviratne LD, Murphy D, Dasgupta P (2008) State-of-the-art in force and tactile sensing for minimally invasive surgery. IEEE Sens J 8(4):371–381CrossRef Puangmali P, Althoefer K, Seneviratne LD, Murphy D, Dasgupta P (2008) State-of-the-art in force and tactile sensing for minimally invasive surgery. IEEE Sens J 8(4):371–381CrossRef
25.
go back to reference Shademan A, Decker RS, Opfermann JD, Leonard S, Krieger A, Kim PC (2016) Supervised autonomous robotic soft tissue surgery. Sci Transl Med 8(337):337ra64CrossRefPubMed Shademan A, Decker RS, Opfermann JD, Leonard S, Krieger A, Kim PC (2016) Supervised autonomous robotic soft tissue surgery. Sci Transl Med 8(337):337ra64CrossRefPubMed
26.
go back to reference Stephens T, Kong N, Dockter R, O’Neill J, Sweet R, Kowalewski T (2018) Blended shared control utilizing online identification: regulating grasping forces of a surrogate surgical grasper. Int J Comput Assist Radiol Surg 13(6):769–776CrossRefPubMed Stephens T, Kong N, Dockter R, O’Neill J, Sweet R, Kowalewski T (2018) Blended shared control utilizing online identification: regulating grasping forces of a surrogate surgical grasper. Int J Comput Assist Radiol Surg 13(6):769–776CrossRefPubMed
27.
go back to reference Stephens TK, Meier ZC, Sweet RM, Kowalewski TM (2015) Tissue identification through back end sensing on da Vinci endowrist surgical tool. J Med Dev Tech Brief 9(3):030939 Stephens TK, Meier ZC, Sweet RM, Kowalewski TM (2015) Tissue identification through back end sensing on da Vinci endowrist surgical tool. J Med Dev Tech Brief 9(3):030939
28.
go back to reference Yamamoto T, Vagvolgyi B, Balaji K, Whitcomb LL, Okamura AM (2009) Tissue property estimation and graphical display for teleoperated robot-assisted surgery. In: International conference on robotics and automation (ICRA). IEEE, pp 4239–4245 Yamamoto T, Vagvolgyi B, Balaji K, Whitcomb LL, Okamura AM (2009) Tissue property estimation and graphical display for teleoperated robot-assisted surgery. In: International conference on robotics and automation (ICRA). IEEE, pp 4239–4245
Metadata
Title
Conditions for reliable grip force and jaw angle estimation of da Vinci surgical tools
Authors
Trevor K. Stephens
John J. O’Neill
Nathan J. Kong
Mark V. Mazzeo
Jack E. Norfleet
Robert M. Sweet
Timothy M. Kowalewski
Publication date
01-01-2019
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 1/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1866-8

Other articles of this Issue 1/2019

International Journal of Computer Assisted Radiology and Surgery 1/2019 Go to the issue