Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2024

09-12-2023 | Silicone | Original Article

Online advance respiration prediction model for percutaneous puncture robotics

Authors: Yanping Lin, Jin Guo, Xu Yang, Wangjie Xu, Zhaojun Li

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2024

Login to get access

Abstract

Purpose

Surgical robots have significant research value and clinical significance in the field of percutaneous punctures. There have been numerous studies on ultrasound-guided percutaneous surgical robots; however, addressing the respiratory compensation problem of deep punctures remains a significant obstacle. Herein we propose a robotic system for percutaneous puncture with respiratory compensation.

Methods

We proposed an online advance respiratory prediction model based on Bidirectional Gate Recurrent Unit (Bi-GRU) for the respiratory prediction requirements of surgical robot systems. By analyzing the main factors governing the accuracy of the respiratory motion prediction models, various parameters of the online advance prediction model were optimized. Subsequently, we integrated and developed ultrasound-guided percutaneous puncture robot software and a hardware platform to implement respiratory compensation, thus verifying the effectiveness and reliability of various key technologies in the system.

Results

The proposed respiratory prediction model has a significantly reduced update time, with an average root mean square error (RMSE) of less than 0.4 mm. This represents a reduction of ~ 20% compared to the online training long short-term memory(LSTM). By conducting puncture experiments based on a respiratory phantom, the average puncture error was 2.71 ± 0.65 mm and the average single-round puncture time was 65.00 ± 6.67 s.

Conclusion

Herein we proposed and optimized an online training respiratory prediction network model based on Bi-GRU. The stability and reliability of this system are verified by conducting puncture experiments on a respiratory phantom.
Literature
1.
go back to reference Hanley J, Debois MM, Mah D, Mageras GS, Raben A, Rosenzweig K, Mychalczak B, Schwartz LH, Gloeggler PJ, Lutz W, Ling CC, Leibel SA, Fuks Z, Kutcher GJ (1999) Deep inspiration breath-hold technique for lung tumors: the potential value of target immobilization and reduced lung density in dose escalation. Int Radiat Oncol Biol Phys 45(3):603–611CrossRef Hanley J, Debois MM, Mah D, Mageras GS, Raben A, Rosenzweig K, Mychalczak B, Schwartz LH, Gloeggler PJ, Lutz W, Ling CC, Leibel SA, Fuks Z, Kutcher GJ (1999) Deep inspiration breath-hold technique for lung tumors: the potential value of target immobilization and reduced lung density in dose escalation. Int Radiat Oncol Biol Phys 45(3):603–611CrossRef
2.
go back to reference Zhou FG, Wang HX, Yu XG, Yan D (2007) Respiratory motion analysis based on image tracking. Chin J Biomed Eng 26(5):652–657 Zhou FG, Wang HX, Yu XG, Yan D (2007) Respiratory motion analysis based on image tracking. Chin J Biomed Eng 26(5):652–657
3.
go back to reference Zhou Y, Thiruvalluvan K, Krzeminski L, Moore WH, Xu ZG, Liang ZR (2013) CT-guided robotic needle biopsy of lung nodules with respiratory motion-experimental system and preliminary test. Int J Med Robot 9(3):317–330CrossRefPubMed Zhou Y, Thiruvalluvan K, Krzeminski L, Moore WH, Xu ZG, Liang ZR (2013) CT-guided robotic needle biopsy of lung nodules with respiratory motion-experimental system and preliminary test. Int J Med Robot 9(3):317–330CrossRefPubMed
4.
go back to reference Karar ME (2018) A simulation study of adaptive force controller for medical robotic liver ultrasound guidance. Arab J Sci Eng 43:4229–4238ADSCrossRef Karar ME (2018) A simulation study of adaptive force controller for medical robotic liver ultrasound guidance. Arab J Sci Eng 43:4229–4238ADSCrossRef
5.
go back to reference Kim YJ, Seo JH, Kim HR, Kim KG (2017) Impedance and admittance control for respiratory-motion compensation during robotic needle insertion-a preliminary test. Int J Med Robot 13(4):493–500CrossRef Kim YJ, Seo JH, Kim HR, Kim KG (2017) Impedance and admittance control for respiratory-motion compensation during robotic needle insertion-a preliminary test. Int J Med Robot 13(4):493–500CrossRef
6.
go back to reference Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R (2020) Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 15(3):491–501CrossRefPubMed Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R (2020) Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 15(3):491–501CrossRefPubMed
7.
go back to reference Ramrath L, Schlaefer A, Ernst F, Dieterich S, Schweikard A (2007). Prediction of respiratory motion with a multi-frequency based Extended Kalman Filter. In: Proceedings of the 21st International Conference and Exhibition on Computer Assisted Radiology and Surgery (CARS’07), 21: 56–58. Ramrath L, Schlaefer A, Ernst F, Dieterich S, Schweikard A (2007). Prediction of respiratory motion with a multi-frequency based Extended Kalman Filter. In: Proceedings of the 21st International Conference and Exhibition on Computer Assisted Radiology and Surgery (CARS’07), 21: 56–58.
8.
go back to reference Hong S-M, Bukhari W (2014) Real-time prediction of respiratory motion using a cascade structure of an extended Kalman filter and support vector regression. Phys Med Biol 59(13):3555–3573CrossRefPubMed Hong S-M, Bukhari W (2014) Real-time prediction of respiratory motion using a cascade structure of an extended Kalman filter and support vector regression. Phys Med Biol 59(13):3555–3573CrossRefPubMed
9.
go back to reference Dürichen R, Blanck O, Dieterich S, Ernst F, Schweikard A (2012) Evaluation of a wavelet-based least mean square algorithm for prediction of respiratory movements. The SRS/SBRT Scientific Meeting 2012:S7–S8 Dürichen R, Blanck O, Dieterich S, Ernst F, Schweikard A (2012) Evaluation of a wavelet-based least mean square algorithm for prediction of respiratory movements. The SRS/SBRT Scientific Meeting 2012:S7–S8
10.
go back to reference Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175CrossRef Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175CrossRef
11.
go back to reference Wu H, Sharp GC, Salzberg B, Kaeli D, Shirato H, Jiang SB (2004) A finite state model for respiratory motion analysis in image guided radiation therapy. Phys Med Biol 49(23):5357–5372CrossRefPubMed Wu H, Sharp GC, Salzberg B, Kaeli D, Shirato H, Jiang SB (2004) A finite state model for respiratory motion analysis in image guided radiation therapy. Phys Med Biol 49(23):5357–5372CrossRefPubMed
12.
go back to reference Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput 31(7):1235–1270MathSciNetCrossRefPubMed
13.
go back to reference Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681ADSCrossRef Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673–2681ADSCrossRef
14.
go back to reference Chung J, Gulcehre C, Cho K, Bengio Y (2015) Gated feedback recurrent neural networks. In: Proceedings of the 32nd International Conference on Machine Learning. PMLR, pp 2067–2075 Chung J, Gulcehre C, Cho K, Bengio Y (2015) Gated feedback recurrent neural networks. In: Proceedings of the 32nd International Conference on Machine Learning. PMLR, pp 2067–2075
15.
go back to reference Chen L, Bai L, Li GJ, Quan H, Bai S (2021) Research on real-time motion monitoring accuracy of optical surface imaging system. Chinese J Med Phys 38(9):1053–1056 Chen L, Bai L, Li GJ, Quan H, Bai S (2021) Research on real-time motion monitoring accuracy of optical surface imaging system. Chinese J Med Phys 38(9):1053–1056
16.
go back to reference Dürichen R, Wissel T, Ernst F, Schweikard A (2013) Respiratory motion compensation with relevance vector machines. Med Image Comput Comput Assist Interv 16(2):108–115PubMed Dürichen R, Wissel T, Ernst F, Schweikard A (2013) Respiratory motion compensation with relevance vector machines. Med Image Comput Comput Assist Interv 16(2):108–115PubMed
17.
go back to reference Lombardo E, Rabe M, Xiong Y, Nierer L, Cusumano D, Placidi L, Boldrini L, Corradini S, Niyazi M, Belka C, Riboldi M, Kurz C, Landry G (2022) Offline and online LSTM networks for respiratory motion prediction in MR-guided radiotherapy. Phys Med Biol 67(9):095006CrossRef Lombardo E, Rabe M, Xiong Y, Nierer L, Cusumano D, Placidi L, Boldrini L, Corradini S, Niyazi M, Belka C, Riboldi M, Kurz C, Landry G (2022) Offline and online LSTM networks for respiratory motion prediction in MR-guided radiotherapy. Phys Med Biol 67(9):095006CrossRef
18.
go back to reference Greff K, Srivastava RK, Koutník J, Steunebrink BR, Schmidhuber J (2016) LSTM: a search space odyssey. IEEE Trans Neural Netw Learn Syst 28(10):2222–2232MathSciNetCrossRefPubMed Greff K, Srivastava RK, Koutník J, Steunebrink BR, Schmidhuber J (2016) LSTM: a search space odyssey. IEEE Trans Neural Netw Learn Syst 28(10):2222–2232MathSciNetCrossRefPubMed
19.
go back to reference Lin H, Shi CY, Wang B, Chan MF, Tang XL, Ji W (2019) Towards real-time respiratory motion prediction based on long short-term memory neural networks. Phys Med Biol 64(8):1361–1372CrossRef Lin H, Shi CY, Wang B, Chan MF, Tang XL, Ji W (2019) Towards real-time respiratory motion prediction based on long short-term memory neural networks. Phys Med Biol 64(8):1361–1372CrossRef
20.
go back to reference Lin YP, Chen SH, Xu WJ, Zhu XX, Cao QX (2023) Robotic system for accurate percutaneous puncture guided by 3D–2D ultrasound. Int J Comput Assist Radiol Surg 18(2):217–225CrossRefPubMed Lin YP, Chen SH, Xu WJ, Zhu XX, Cao QX (2023) Robotic system for accurate percutaneous puncture guided by 3D–2D ultrasound. Int J Comput Assist Radiol Surg 18(2):217–225CrossRefPubMed
21.
go back to reference Chen SH, Wang F, Lin YP, Shi QS, Wang YL (2021) Ultrasound-guided needle insertion robotic system for percutaneous puncture. Int J Comput Assist Radiol Surg 16(3):475–484CrossRefPubMed Chen SH, Wang F, Lin YP, Shi QS, Wang YL (2021) Ultrasound-guided needle insertion robotic system for percutaneous puncture. Int J Comput Assist Radiol Surg 16(3):475–484CrossRefPubMed
22.
go back to reference Wang G, Li Z, Li G et al (2021) Real-time liver tracking algorithm based on LSTM and SVR networks for use in surface-guided radiation therapy. Radiat Oncol 16(1):1–12MathSciNetCrossRef Wang G, Li Z, Li G et al (2021) Real-time liver tracking algorithm based on LSTM and SVR networks for use in surface-guided radiation therapy. Radiat Oncol 16(1):1–12MathSciNetCrossRef
23.
go back to reference Wang R, Liang X, Zhu X et al (2018) A feasibility of respiration prediction based on deep Bi-LSTM for real-time tumor tracking. IEEE Access 6:51262–51268CrossRef Wang R, Liang X, Zhu X et al (2018) A feasibility of respiration prediction based on deep Bi-LSTM for real-time tumor tracking. IEEE Access 6:51262–51268CrossRef
Metadata
Title
Online advance respiration prediction model for percutaneous puncture robotics
Authors
Yanping Lin
Jin Guo
Xu Yang
Wangjie Xu
Zhaojun Li
Publication date
09-12-2023
Publisher
Springer International Publishing
Keyword
Silicone
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2024
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-03041-7

Other articles of this Issue 3/2024

International Journal of Computer Assisted Radiology and Surgery 3/2024 Go to the issue