Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2020

01-03-2020 | Ultrasound | Original Article

Development of a robot-assisted ultrasound-guided radiation therapy (USgRT)

Authors: Peter Karl Seitz, Beatrice Baumann, Wibke Johnen, Cord Lissek, Johanna Seidel, Rolf Bendl

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2020

Login to get access

Abstract

Purpose

Radiation treatment is improved by the use of image-guided workflows. This work pursues the approach of using ultrasound (US) as a real-time imaging modality. The primary focus of this study is to develop and test a breathing and motion control for a robotic-guided US transducer. All control functions of the robot and the US image processing were then integrated into one software platform enabling US-guided radiation therapy.

Methods

The robot (KUKA LBR iiwa 7 R800) and the US image processing workflows were integrated into the Medical Interaction Toolkit (MITK) (Nolden et al. in Int J Comput Assist Radiol Surg 8(4):607–620, 2013). The positions of the US probe were tracked with an optical tracking system. As a main function of robot positioning control, a highly sensitive breathing and motion compensation method was developed using KUKA’s robotic application programming interface. The resulting autonomous robot motions were tested by the use of defined breathing patterns with two volunteers. Furthermore, a filter pipeline for 3D US image processing with MITK was developed. Thus, image registration of US images and previously acquired planning image data was enabled.

Results

The implemented breathing and motion compensation feature was successful with the addition of the remote rotating, translating capability of the US probe. Desired force applied to the US probe, and thus to the patient, is stable and enables a continuous US imaging. The developed filter pipeline for image processing facilitates registration and display of planning data and US image data in one graphical user interface.

Conclusion

A stable and robust method for motion compensation for robot-assisted US imaging was developed and tested successfully. This is a first step toward the safe use of autonomous robot motions in interaction with patients. Furthermore, main software components were integrated into a single platform and used with the purpose of ultrasound-guided radiation therapy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer H-P, Wolf I (2013) The Medical Imaging Interaction Toolkit: challenges and advances. Int J Comput Assist Radiol Surg 8(4):607–620CrossRef Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer H-P, Wolf I (2013) The Medical Imaging Interaction Toolkit: challenges and advances. Int J Comput Assist Radiol Surg 8(4):607–620CrossRef
2.
go back to reference Verellen D, De Ridder M, Storme G (2008) A (short) history of image-guided radiotherapy. Radiother Oncol 86(1):4–13CrossRef Verellen D, De Ridder M, Storme G (2008) A (short) history of image-guided radiotherapy. Radiother Oncol 86(1):4–13CrossRef
3.
go back to reference Kuban DA, Dong L, Cheung R, Strom E, De Crevoisier R (2005) Ultrasound-based localization. Semin Radiat Oncol 15(3):180–191CrossRef Kuban DA, Dong L, Cheung R, Strom E, De Crevoisier R (2005) Ultrasound-based localization. Semin Radiat Oncol 15(3):180–191CrossRef
4.
go back to reference Chandra A, Dong L, Huang E, Kuban DA, O’Neill L, Rosen I, Pollack A (2003) Experience of ultrasound-based daily prostate localization. Int J Radiat Oncol 56(2):436–447CrossRef Chandra A, Dong L, Huang E, Kuban DA, O’Neill L, Rosen I, Pollack A (2003) Experience of ultrasound-based daily prostate localization. Int J Radiat Oncol 56(2):436–447CrossRef
5.
go back to reference Langen KM, Pouliot J, Anezinos C, Aubin M, Gottschalk AR, Hsu I-C, Lowther D, Liu Y-M, Shinohara K, Verhey LJ, Weinberg V, Roach M (2003) Evaluation of ultrasound-based prostate localization for image-guided radiotherapy. Int J Radiat Oncol Biol Phys 57(3):635–644CrossRef Langen KM, Pouliot J, Anezinos C, Aubin M, Gottschalk AR, Hsu I-C, Lowther D, Liu Y-M, Shinohara K, Verhey LJ, Weinberg V, Roach M (2003) Evaluation of ultrasound-based prostate localization for image-guided radiotherapy. Int J Radiat Oncol Biol Phys 57(3):635–644CrossRef
6.
go back to reference Hsu A, Miller NR, Evans PM, Bamber JC, Webb S (2005) Feasibility of using ultrasound for real-time tracking during radiotherapy. Med Phys 32(6 Part 1):1500–1512CrossRef Hsu A, Miller NR, Evans PM, Bamber JC, Webb S (2005) Feasibility of using ultrasound for real-time tracking during radiotherapy. Med Phys 32(6 Part 1):1500–1512CrossRef
7.
go back to reference Schlosser J, Salisbury K, Hristov D (2010) Telerobotic system concept for real-time soft-tissue imaging during radiotherapy beam delivery. Med Phys 37(12):6357–6367CrossRef Schlosser J, Salisbury K, Hristov D (2010) Telerobotic system concept for real-time soft-tissue imaging during radiotherapy beam delivery. Med Phys 37(12):6357–6367CrossRef
8.
go back to reference Salcudean SE, Bell G, Bachmann S, Zhu WH, Abolmaesumi P, Lawrence PD (1999) Robot-assisted diagnostic ultrasound – design and feasibility experiments. In: Medical image computing and computer-assisted intervention – MICCAI’99: Second International Conference, Cambridge, UK, September 19-22, 1999. Proceedings, C. Taylor and A. Colchester, Eds. Springer, Berlin, pp 1062–1071CrossRef Salcudean SE, Bell G, Bachmann S, Zhu WH, Abolmaesumi P, Lawrence PD (1999) Robot-assisted diagnostic ultrasound – design and feasibility experiments. In: Medical image computing and computer-assisted intervention – MICCAI’99: Second International Conference, Cambridge, UK, September 19-22, 1999. Proceedings, C. Taylor and A. Colchester, Eds. Springer, Berlin, pp 1062–1071CrossRef
9.
go back to reference Tutkun Şen H, Lediju Bell MA, Iordachita I, Wong J, Kazanzides P (2013) A cooperatively controlled robot for ultrasound monitoring of radiation therapy. In: IEEE/RSJ Int Conf Intell Robot Syst, pp 3071–3076 Tutkun Şen H, Lediju Bell MA, Iordachita I, Wong J, Kazanzides P (2013) A cooperatively controlled robot for ultrasound monitoring of radiation therapy. In: IEEE/RSJ Int Conf Intell Robot Syst, pp 3071–3076
10.
go back to reference Western C, Hristov D, Schlosser J (2015) Ultrasound imaging in radiation therapy: from interfractional to intrafractional guidance. Cureus 7(6):e280PubMedPubMedCentral Western C, Hristov D, Schlosser J (2015) Ultrasound imaging in radiation therapy: from interfractional to intrafractional guidance. Cureus 7(6):e280PubMedPubMedCentral
11.
go back to reference Gerlach S, Kuhlemann I, Jauer P, Bruder R, Ernst F, Fürweger C, Schlaefer A (2017) Robotic ultrasound-guided SBRT of the prostate: feasibility with respect to plan quality. Int J Comput Assist Radiol Surg 12(1):149–159CrossRef Gerlach S, Kuhlemann I, Jauer P, Bruder R, Ernst F, Fürweger C, Schlaefer A (2017) Robotic ultrasound-guided SBRT of the prostate: feasibility with respect to plan quality. Int J Comput Assist Radiol Surg 12(1):149–159CrossRef
12.
go back to reference Graumann C, Fuerst B, Hennersperger C, Bork F, Navab N (2016) Robotic ultrasound trajectory planning for volume of interest coverage. In: 2016 IEEE international conference on robotics and automation (ICRA), 2016, pp 736–741 Graumann C, Fuerst B, Hennersperger C, Bork F, Navab N (2016) Robotic ultrasound trajectory planning for volume of interest coverage. In: 2016 IEEE international conference on robotics and automation (ICRA), 2016, pp 736–741
13.
go back to reference Teather RJ, Pavlovych A, Stuerzlinger W, MacKenzie IS (2009) Effects of tracking technology, latency, and spatial jitter on object movement. In: 3DUI—IEEE symposium on 3D user interfaces 2009, Proceedings Teather RJ, Pavlovych A, Stuerzlinger W, MacKenzie IS (2009) Effects of tracking technology, latency, and spatial jitter on object movement. In: 3DUI—IEEE symposium on 3D user interfaces 2009, Proceedings
14.
go back to reference März K, Franz AM, Seitel A, Winterstein A, Bendl R, Zelzer S, Nolden M, Meinzer H-P, Maier-Hein L (2014) MITK-US: real-time ultrasound support within MITK. Int J Comput Assist Radiol Surg 9(3):411–420CrossRef März K, Franz AM, Seitel A, Winterstein A, Bendl R, Zelzer S, Nolden M, Meinzer H-P, Maier-Hein L (2014) MITK-US: real-time ultrasound support within MITK. Int J Comput Assist Radiol Surg 9(3):411–420CrossRef
15.
go back to reference Virga S, Göbl R, Baust M, Navab N, Hennersperger C (2018) Use the force: deformation correction in robotic 3D ultrasound. Int J Comput Assist Radiol Surg 13(5):619–627CrossRef Virga S, Göbl R, Baust M, Navab N, Hennersperger C (2018) Use the force: deformation correction in robotic 3D ultrasound. Int J Comput Assist Radiol Surg 13(5):619–627CrossRef
16.
go back to reference Franz AM, Seitel A, Servatius M, Zöllner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer H-P, Kauczor H-U, Meinzer H-P, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: SPIE, vol 8316 Franz AM, Seitel A, Servatius M, Zöllner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer H-P, Kauczor H-U, Meinzer H-P, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: SPIE, vol 8316
17.
go back to reference Tauscher S, Tokuda J, Schreiber G, Neff T, Hata N, Ortmaier T (2015) OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems. Int J Comput Assist Radiol Surg 10(3):285–292CrossRef Tauscher S, Tokuda J, Schreiber G, Neff T, Hata N, Ortmaier T (2015) OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems. Int J Comput Assist Radiol Surg 10(3):285–292CrossRef
18.
go back to reference Klemm M, Kirchner T, Gröhl J, Cheray D, Nolden M, Seitel A, Hoppe H, Maier-Hein L, Franz AM (2017) MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions. Int J Comput Assist Radiol Surg 12(3):351–361CrossRef Klemm M, Kirchner T, Gröhl J, Cheray D, Nolden M, Seitel A, Hoppe H, Maier-Hein L, Franz AM (2017) MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions. Int J Comput Assist Radiol Surg 12(3):351–361CrossRef
19.
go back to reference Solberg OV, Lindseth F, Torp H, Blake RE, Hernes TAN (2007) Freehand 3D ultrasound reconstruction algorithms—a review. Ultrasound Med Biol 33(7):991–1009CrossRef Solberg OV, Lindseth F, Torp H, Blake RE, Hernes TAN (2007) Freehand 3D ultrasound reconstruction algorithms—a review. Ultrasound Med Biol 33(7):991–1009CrossRef
20.
go back to reference Conti F, Park J, Khatib O (2010) Interface design and control strategies for a robot assisted ultrasonic examination system. In: Proc Int symposium on experimental robotics Conti F, Park J, Khatib O (2010) Interface design and control strategies for a robot assisted ultrasonic examination system. In: Proc Int symposium on experimental robotics
Metadata
Title
Development of a robot-assisted ultrasound-guided radiation therapy (USgRT)
Authors
Peter Karl Seitz
Beatrice Baumann
Wibke Johnen
Cord Lissek
Johanna Seidel
Rolf Bendl
Publication date
01-03-2020
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2020
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02104-y

Other articles of this Issue 3/2020

International Journal of Computer Assisted Radiology and Surgery 3/2020 Go to the issue