Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2015

01-03-2015 | Review Article

OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems

Authors: Sebastian Tauscher, Junichi Tokuda, Günter Schreiber, Thomas Neff, Nobuhiko Hata, Tobias Ortmaier

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2015

Login to get access

Abstract

Purpose

   The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon.

Methods

A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the “KUKA Sunrise. Connectivity SmartServo” package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control.

Results

Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately \(270\,s\) (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured.

Conclusion

Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.
Literature
1.
go back to reference Lemke HU, Vannier MW (2006) The operating room and the need for an IT infrastructure and standards. Int J Comput Assist Radiol Surg 1:117–121CrossRef Lemke HU, Vannier MW (2006) The operating room and the need for an IT infrastructure and standards. Int J Comput Assist Radiol Surg 1:117–121CrossRef
2.
go back to reference Tauscher S, Neff T, Ortmaier T (2013) Interface concept for the integration of a robot into an image-guided therapy system. In: Proceedings of the 27th International Congress on Computer Assisted Radiology and Surgery (CARS 2013) Tauscher S, Neff T, Ortmaier T (2013) Interface concept for the integration of a robot into an image-guided therapy system. In: Proceedings of the 27th International Congress on Computer Assisted Radiology and Surgery (CARS 2013)
3.
go back to reference Schreiber G, Stemmer A, Bischoff R (2010) The fast research interface for the KUKA lightweight robot. IEEE Conference on Robotics and Automation (ICRA) Schreiber G, Stemmer A, Bischoff R (2010) The fast research interface for the KUKA lightweight robot. IEEE Conference on Robotics and Automation (ICRA)
4.
go back to reference Bzostek A, Kumar R, Hata N, Schorr O, Kikinis R, Taylor RH (2000) Distributed modular computer-integrated surgical robotic systems: implementation using modular software and networked systems. In: Medical image computing and computer-assisted intervention-MICCAI 2000. Springer, Berlin, pp 969–978 Bzostek A, Kumar R, Hata N, Schorr O, Kikinis R, Taylor RH (2000) Distributed modular computer-integrated surgical robotic systems: implementation using modular software and networked systems. In: Medical image computing and computer-assisted intervention-MICCAI 2000. Springer, Berlin, pp 969–978
6.
go back to reference Xia T, Baird C, Jallo G, Hayes K, Nakajima N, Hata N, Kazanzides P (2008) An integrated system for planning, navigation and robotic assistance for skull base surgery. Int J Med Robot Comput Assist Surg 4(4):321–330CrossRef Xia T, Baird C, Jallo G, Hayes K, Nakajima N, Hata N, Kazanzides P (2008) An integrated system for planning, navigation and robotic assistance for skull base surgery. Int J Med Robot Comput Assist Surg 4(4):321–330CrossRef
7.
go back to reference Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef
8.
go back to reference Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S et al (2012) 3D Slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30(9):41–1323CrossRef Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S et al (2012) 3D Slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30(9):41–1323CrossRef
9.
go back to reference Egger J, Tokuda J, Chauvin L, Freisleben B, Nimsky C, Kapur T, Wells W (2012) Integration of the OpenIGTLink Network Protocol for image-guided therapy with the medical platform MeVisLab. Int J Med Robot Comput Assist Surg 8:282–290CrossRef Egger J, Tokuda J, Chauvin L, Freisleben B, Nimsky C, Kapur T, Wells W (2012) Integration of the OpenIGTLink Network Protocol for image-guided therapy with the medical platform MeVisLab. Int J Med Robot Comput Assist Surg 8:282–290CrossRef
10.
go back to reference Elhawary H, Liu H, Patel P, Norton I, Rigolo L, Papademetris X et al (2011) Intraoperative real-time querying of white matter tracts during frameless stereotactic neuronavigation. Neurosurgery 68(2):16–506CrossRef Elhawary H, Liu H, Patel P, Norton I, Rigolo L, Papademetris X et al (2011) Intraoperative real-time querying of white matter tracts during frameless stereotactic neuronavigation. Neurosurgery 68(2):16–506CrossRef
11.
go back to reference Tokuda J, Pan L, Lorenz CH, Jolesz FA, Tempany CM, Hata N (2012) Smartphone interface for interactive MRI, Computer Assisted Radiology and Surgery (CARS 2012). In: 26th International Congress and Exhibition, June 27–30, Pisa, Italy Tokuda J, Pan L, Lorenz CH, Jolesz FA, Tempany CM, Hata N (2012) Smartphone interface for interactive MRI, Computer Assisted Radiology and Surgery (CARS 2012). In: 26th International Congress and Exhibition, June 27–30, Pisa, Italy
12.
go back to reference Tokuda J, Fischer GS, DiMaio SP, Gobbi DG, Csoma C, Mewes PW, Fichtinger G, Tempany CM, Hata N (2010) Integrated navigation and control software system for MRI-guided robotic prostate interventions. Comput Med Imaging Graph 34(1):3–8CrossRefPubMed Tokuda J, Fischer GS, DiMaio SP, Gobbi DG, Csoma C, Mewes PW, Fichtinger G, Tempany CM, Hata N (2010) Integrated navigation and control software system for MRI-guided robotic prostate interventions. Comput Med Imaging Graph 34(1):3–8CrossRefPubMed
13.
go back to reference Enquobahrie A, Cheng P, Gary K et al (2007) The image-guided surgery toolkit IGSTK: an open source C++ software toolkit. J Digit Imag 20(Suppl 1):21–33, 28CrossRef Enquobahrie A, Cheng P, Gary K et al (2007) The image-guided surgery toolkit IGSTK: an open source C++ software toolkit. J Digit Imag 20(Suppl 1):21–33, 28CrossRef
14.
go back to reference Bartha L, Lasso A, Pinter C, Ungi T, Keri Z, Fichtinger G. (2013) Open-source surface mesh-based ultrasound-guided spinal intervention simulator. Int J Comput Assist Radiol Surg 8(6):1043–1051 Bartha L, Lasso A, Pinter C, Ungi T, Keri Z, Fichtinger G. (2013) Open-source surface mesh-based ultrasound-guided spinal intervention simulator. Int J Comput Assist Radiol Surg 8(6):1043–1051
15.
go back to reference Tavares DM, de Paula Caurin GA (2010) Proposal for a device proxy using XIRP. In Industry Applications (INDUSCON), 2010 9th IEEE/IAS International Conference on, pp 1–6 Tavares DM, de Paula Caurin GA (2010) Proposal for a device proxy using XIRP. In Industry Applications (INDUSCON), 2010 9th IEEE/IAS International Conference on, pp 1–6
16.
go back to reference Mönnich H, Wörn H, Stein D (2012) OP sense-A robotic research platform for telemanipulated and automatic computer assisted surgery. In: Advanced Motion Control (AMC), 12th International Workshop on IEEE, pp 1–6 Mönnich H, Wörn H, Stein D (2012) OP sense-A robotic research platform for telemanipulated and automatic computer assisted surgery. In: Advanced Motion Control (AMC), 12th International Workshop on IEEE, pp 1–6
17.
go back to reference Jakopec M, Rodriguez y Baena F, Harris SJ, Gomes P, Cobb J, Davies BL (2003) The hands-on orthopaedic robot. Robotics and Automation. IEEE Trans 19(5):902–911 Jakopec M, Rodriguez y Baena F, Harris SJ, Gomes P, Cobb J, Davies BL (2003) The hands-on orthopaedic robot. Robotics and Automation. IEEE Trans 19(5):902–911
18.
go back to reference Vlissides J, Helm R, Johnson R, Gamma E (1995) Design patterns: elements of reusable object-oriented software. Addison-Wesley, Reading Vlissides J, Helm R, Johnson R, Gamma E (1995) Design patterns: elements of reusable object-oriented software. Addison-Wesley, Reading
Metadata
Title
OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems
Authors
Sebastian Tauscher
Junichi Tokuda
Günter Schreiber
Thomas Neff
Nobuhiko Hata
Tobias Ortmaier
Publication date
01-03-2015
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2015
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-014-1081-1

Other articles of this Issue 3/2015

International Journal of Computer Assisted Radiology and Surgery 3/2015 Go to the issue