Skip to main content
Top
Published in: Journal of Medical Systems 6/2016

Open Access 01-06-2016 | Patient Facing Systems

The adaptation of GDL motion recognition system to sport and rehabilitation techniques analysis

Authors: Tomasz Hachaj, Marek R. Ogiela

Published in: Journal of Medical Systems | Issue 6/2016

Login to get access

Abstract

The main novelty of this paper is presenting the adaptation of Gesture Description Language (GDL) methodology to sport and rehabilitation data analysis and classification. In this paper we showed that Lua language can be successfully used for adaptation of the GDL classifier to those tasks. The newly applied scripting language allows easily extension and integration of classifier with other software technologies and applications. The obtained execution speed allows using the methodology in the real-time motion capture data processing where capturing frequency differs from 100 Hz to even 500 Hz depending on number of features or classes to be calculated and recognized. Due to this fact the proposed methodology can be used to the high-end motion capture system. We anticipate that using novel, efficient and effective method will highly help both sport trainers and physiotherapist in they practice. The proposed approach can be directly applied to motion capture data kinematics analysis (evaluation of motion without regard to the forces that cause that motion). The ability to apply pattern recognition methods for GDL description can be utilized in virtual reality environment and used for sport training or rehabilitation treatment.
Literature
2.
go back to reference Zhang, Q., Song, X., Shibasaki, R., and Zhao, H., Unsupervised skeleton extraction and motion capture from 3D deformable matching. Neurocomputing 100(16):170–182, 2013.CrossRef Zhang, Q., Song, X., Shibasaki, R., and Zhao, H., Unsupervised skeleton extraction and motion capture from 3D deformable matching. Neurocomputing 100(16):170–182, 2013.CrossRef
3.
go back to reference Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A., Real-time human pose recognition in parts from single depth images, CVPR ‘11 Proceedings of the 2011 I.E. Conference on Computer Vision and Pattern Recognition, pp. 1297–1304, IEEE Computer Society Washington, DC, USA, 2011. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A., Real-time human pose recognition in parts from single depth images, CVPR ‘11 Proceedings of the 2011 I.E. Conference on Computer Vision and Pattern Recognition, pp. 1297–1304, IEEE Computer Society Washington, DC, USA, 2011.
4.
go back to reference Schwarz, L. A., Mkhitaryan, A., Mateus, D., and Navab, N., Human skeleton tracking from depth data using geodesic distances and optical flow. Image Vis. Comput. 30:217–226, 2012.CrossRef Schwarz, L. A., Mkhitaryan, A., Mateus, D., and Navab, N., Human skeleton tracking from depth data using geodesic distances and optical flow. Image Vis. Comput. 30:217–226, 2012.CrossRef
5.
go back to reference Gupta, S., Jaafar, J., Fatimah, W., and Ahmad, W., Static hand gesture recognition using local gabor filter. Proc. Eng. 41:827–832, 2012.CrossRef Gupta, S., Jaafar, J., Fatimah, W., and Ahmad, W., Static hand gesture recognition using local gabor filter. Proc. Eng. 41:827–832, 2012.CrossRef
6.
go back to reference Arulkarthick, V. J., and Sangeetha, D., Sign language recognition using K-means clustered haar-like, features and a stochastic context free grammar. Eur. J. Sci. Arulkarthick, V. J., and Sangeetha, D., Sign language recognition using K-means clustered haar-like, features and a stochastic context free grammar. Eur. J. Sci.
7.
go back to reference Taubert, N., Löffler, M., Ludolph, N., Christensen, A., Endres, D., and Giese, M. A., A virtual reality setup for controllable, stylized real-time interactions between humans and avatars with sparse gaussian process dynamical models. Proceedings of the ACM Symposium on Applied Perception, pp. 41–44, 2013. Taubert, N., Löffler, M., Ludolph, N., Christensen, A., Endres, D., and Giese, M. A., A virtual reality setup for controllable, stylized real-time interactions between humans and avatars with sparse gaussian process dynamical models. Proceedings of the ACM Symposium on Applied Perception, pp. 41–44, 2013.
8.
go back to reference Vieira, W. A., Lewiner, T., Schwartz, W. R., and Campos M. F. M., Distance matrices as invariant features for classifying MoCap data, Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 2934–2937. IEEE, 2012. Vieira, W. A., Lewiner, T., Schwartz, W. R., and Campos M. F. M., Distance matrices as invariant features for classifying MoCap data, Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 2934–2937. IEEE, 2012.
9.
go back to reference Miranda, L., Vieira, T., Martinez, D., Lewiner, T., Vieira, A. W., and Campos, M. F. M., Online gesture recognition from pose kernel learning and decision forests. Pattern Recogn. Lett. 39(1):65–73, 2014.CrossRef Miranda, L., Vieira, T., Martinez, D., Lewiner, T., Vieira, A. W., and Campos, M. F. M., Online gesture recognition from pose kernel learning and decision forests. Pattern Recogn. Lett. 39(1):65–73, 2014.CrossRef
10.
go back to reference Li, Z., Wei, Z., Yue, Y., Wang, H., Jia, W., Burke, L. E., Baranowski, T., and Sun, M., An adaptive hidden Markov model for activity recognition based on a wearable multi-sensor device. J. Med. Syst. 39(5):57, 2015. doi:10.1007/s10916-015-0239-x.CrossRefPubMed Li, Z., Wei, Z., Yue, Y., Wang, H., Jia, W., Burke, L. E., Baranowski, T., and Sun, M., An adaptive hidden Markov model for activity recognition based on a wearable multi-sensor device. J. Med. Syst. 39(5):57, 2015. doi:10.​1007/​s10916-015-0239-x.CrossRefPubMed
11.
go back to reference Rajanna, V., Vo, P., Barth, J., Mjelde, M., Grey, T., Oduola, C., and Hammond, T., KinoHaptics: An automated, wearable, Haptic assisted, physio-therapeutic system for post-surgery rehabilitation and self-care. J. Med. Syst. 40(3):60, 2016. doi:10.1007/s10916-015-0391-3.CrossRefPubMed Rajanna, V., Vo, P., Barth, J., Mjelde, M., Grey, T., Oduola, C., and Hammond, T., KinoHaptics: An automated, wearable, Haptic assisted, physio-therapeutic system for post-surgery rehabilitation and self-care. J. Med. Syst. 40(3):60, 2016. doi:10.​1007/​s10916-015-0391-3.CrossRefPubMed
12.
go back to reference Cholewa, M., and Głomb, P., Estimation of the number of states for gesture recognition with Hidden Markov Models based on the number of critical points in time sequence. Pattern Recogn. Lett. 34(5):574–579, 2013.CrossRef Cholewa, M., and Głomb, P., Estimation of the number of states for gesture recognition with Hidden Markov Models based on the number of critical points in time sequence. Pattern Recogn. Lett. 34(5):574–579, 2013.CrossRef
13.
go back to reference Kang, J., Zhong, K., Qin, S., Wang, H., and Wright, D., Instant 3D design concept generation and visualization by real-time hand gesture recognition. Comput. Ind. 64(7):785–797, 2013.CrossRef Kang, J., Zhong, K., Qin, S., Wang, H., and Wright, D., Instant 3D design concept generation and visualization by real-time hand gesture recognition. Comput. Ind. 64(7):785–797, 2013.CrossRef
14.
go back to reference López-Méndez, A., and Casas, J. R., Model-based recognition of human actions by trajectory matching in phase spaces. Image Vis. Comput. 30:808–816, 2012.CrossRef López-Méndez, A., and Casas, J. R., Model-based recognition of human actions by trajectory matching in phase spaces. Image Vis. Comput. 30:808–816, 2012.CrossRef
15.
go back to reference Zhu, F., Shao, L., and Lin, M., Multi-view action recognition using local similarity random forests and sensor fusion. Pattern Recogn. Lett. 34:20–24, 2013.CrossRef Zhu, F., Shao, L., and Lin, M., Multi-view action recognition using local similarity random forests and sensor fusion. Pattern Recogn. Lett. 34:20–24, 2013.CrossRef
16.
go back to reference Gamage, N., Chow Kuang, Y., Akmeliawati, R., and Demidenko, S., Gaussian process dynamical models for hand gesture interpretation in sign language. Pattern Recogn. Lett. 32:2009–2014, 2011.CrossRef Gamage, N., Chow Kuang, Y., Akmeliawati, R., and Demidenko, S., Gaussian process dynamical models for hand gesture interpretation in sign language. Pattern Recogn. Lett. 32:2009–2014, 2011.CrossRef
17.
go back to reference Glowacz, A., Diagnostics of synchronous motor based on analysis of acoustic signals with the use of line spectral frequencies and K-nearest neighbor classifier. Arch. Acoust. 39(2):189–194, 2014. doi:10.2478/aoa-2014-0022. Glowacz, A., Diagnostics of synchronous motor based on analysis of acoustic signals with the use of line spectral frequencies and K-nearest neighbor classifier. Arch. Acoust. 39(2):189–194, 2014. doi:10.​2478/​aoa-2014-0022.
18.
go back to reference Glowacz, A., Glowacz, A., and Glowacz, Z., Recognition of thermal images of direct current motor with application of area perimeter vector and Bayes classifier, measurement science review. 15(3): 119–126, ISSN (Online) 1335–8871. doi: 10.1515/msr-2015-0018, 2015. Glowacz, A., Glowacz, A., and Glowacz, Z., Recognition of thermal images of direct current motor with application of area perimeter vector and Bayes classifier, measurement science review. 15(3): 119–126, ISSN (Online) 1335–8871. doi: 10.​1515/​msr-2015-0018, 2015.
19.
go back to reference Du, Y., Chen, F., Xu, W., and Zhang, W., Activity recognition through multi-scale motion detail analysis. Neurocomputing 71:3561–3574, 2008.CrossRef Du, Y., Chen, F., Xu, W., and Zhang, W., Activity recognition through multi-scale motion detail analysis. Neurocomputing 71:3561–3574, 2008.CrossRef
20.
go back to reference Suma, E. A., Krum, D. M., Lange, B., Koenig, S., Rizzo, A., and Bolas, M., Adapting user interfaces for gestural interaction with the flexible action and articulated skeleton toolkit. Comput. Graph. 37(3):193–201, 2013.CrossRef Suma, E. A., Krum, D. M., Lange, B., Koenig, S., Rizzo, A., and Bolas, M., Adapting user interfaces for gestural interaction with the flexible action and articulated skeleton toolkit. Comput. Graph. 37(3):193–201, 2013.CrossRef
21.
go back to reference Bickerstaffe, A., Lane, A., Meyer, B., and Marriott, K., Developing domain-specific gesture recognizers for smart diagram environments, graphics recognition. Recent advances and new opportunities. Lect. Notes Comput. Sci 5046:145–156, 2008.CrossRef Bickerstaffe, A., Lane, A., Meyer, B., and Marriott, K., Developing domain-specific gesture recognizers for smart diagram environments, graphics recognition. Recent advances and new opportunities. Lect. Notes Comput. Sci 5046:145–156, 2008.CrossRef
23.
go back to reference Hachaj, T., and Ogiela, M. R., Computer karate trainer in tasks of personal and homeland security defense. In: Cuzzocrea, A., et al. (Eds.), CD-ARES 2013 Workshops, LNCS 8128, pp. 430–441, 2013. Hachaj, T., and Ogiela, M. R., Computer karate trainer in tasks of personal and homeland security defense. In: Cuzzocrea, A., et al. (Eds.), CD-ARES 2013 Workshops, LNCS 8128, pp. 430–441, 2013.
24.
go back to reference Hachaj, T., Ogiela, M. R., and Piekarczyk, M., Real-time recognition of selected karate techniques using GDL approach, image processing and communications challenges 5. Adv. Intell. Syst. Comput. 233:99–106, 2014.CrossRef Hachaj, T., Ogiela, M. R., and Piekarczyk, M., Real-time recognition of selected karate techniques using GDL approach, image processing and communications challenges 5. Adv. Intell. Syst. Comput. 233:99–106, 2014.CrossRef
26.
go back to reference Hachaj, T., Ogiela, M. R., and Koptyra, K., Application of assistive computer vision methods to Oyama karate techniques recognition. Symmetry 7(4):1670–1698, 2015. doi:10.3390/sym7041670.CrossRef Hachaj, T., Ogiela, M. R., and Koptyra, K., Application of assistive computer vision methods to Oyama karate techniques recognition. Symmetry 7(4):1670–1698, 2015. doi:10.​3390/​sym7041670.CrossRef
28.
go back to reference Hachaj, T., and Ogiela, M. R., Recognition of body movements patterns for immersive virtual reality system interface, 2014 Ninth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 978-1-4799-4171-1/14, IEEE Computer Society Order Number E5391 ISBN-13: 978-1-4799-4171-1, pp. 290–294. doi 10.1109/3PGCIC.2014.79, 2014. Hachaj, T., and Ogiela, M. R., Recognition of body movements patterns for immersive virtual reality system interface, 2014 Ninth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 978-1-4799-4171-1/14, IEEE Computer Society Order Number E5391 ISBN-13: 978-1-4799-4171-1, pp. 290–294. doi 10.​1109/​3PGCIC.​2014.​79, 2014.
29.
go back to reference Hachaj, T., Ogiela, M. R., and Koptyra, K., Effectiveness comparison of Kinect and Kinect 2 for recognition of Oyama karate techniques, NBiS 2015 - The 18-th International Conference on Network-Based Information Systems (NBiS 2015), September 2–4, Taipei, Taiwan, pp. 332–337. doi 10.1109/NBiS.2015.51, ISBN: 978-1-4799-9942-2/15. Hachaj, T., Ogiela, M. R., and Koptyra, K., Effectiveness comparison of Kinect and Kinect 2 for recognition of Oyama karate techniques, NBiS 2015 - The 18-th International Conference on Network-Based Information Systems (NBiS 2015), September 2–4, Taipei, Taiwan, pp. 332–337. doi 10.​1109/​NBiS.​2015.​51, ISBN: 978-1-4799-9942-2/15.
30.
go back to reference Hachaj, T., Ogiela, M. R., and Koptyra, K., Human actions modelling and recognition in low-dimensional feature space, BWCCA 2015, 10th International Conference on Broadband and Wireless Computing, Communication and Applications, November 4–6, 2015, Krakow, Poland, pp. 247–254. doi 10.1109/BWCCA.2015.15, 2015. Hachaj, T., Ogiela, M. R., and Koptyra, K., Human actions modelling and recognition in low-dimensional feature space, BWCCA 2015, 10th International Conference on Broadband and Wireless Computing, Communication and Applications, November 4–6, 2015, Krakow, Poland, pp. 247–254. doi 10.​1109/​BWCCA.​2015.​15, 2015.
31.
go back to reference Hachaj, T., Ogiela, M. R., and Koptyra, K., Application of hidden Markov models and gesture description language classifiers to Oyama karate techniques recognition, Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS), 2015 9th International Conference on, 8–10 July 2015, Blumenau, pp. 160–165, ISBN 978-1-4799-8872-3. doi: 10.1109/IMIS.2015.26, 2015. Hachaj, T., Ogiela, M. R., and Koptyra, K., Application of hidden Markov models and gesture description language classifiers to Oyama karate techniques recognition, Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS), 2015 9th International Conference on, 8–10 July 2015, Blumenau, pp. 160–165, ISBN 978-1-4799-8872-3. doi: 10.​1109/​IMIS.​2015.​26, 2015.
32.
33.
go back to reference De la Torre-Díez, I., Antón-Rodríguez, M., Díaz-Pernas, F. J., and Perozo-Rondón, F. J., Comparison of response times of a mobile-web EHRs system using PHP and JSP languages. J. Med. Syst. 36(6):3945–3953, 2012. doi:10.1007/s10916-012-9866-7.CrossRefPubMed De la Torre-Díez, I., Antón-Rodríguez, M., Díaz-Pernas, F. J., and Perozo-Rondón, F. J., Comparison of response times of a mobile-web EHRs system using PHP and JSP languages. J. Med. Syst. 36(6):3945–3953, 2012. doi:10.​1007/​s10916-012-9866-7.CrossRefPubMed
36.
go back to reference Collobert, R., Kavukcuoglu, K., and Farabet, C., Implementing neural networks efficiently, neural networks: tricks of the trade, Volume 7700 of the series Lecture Notes in Computer Science, pp. 537–557, DOI: 10.1007/978-3-642-35289-8_28. Collobert, R., Kavukcuoglu, K., and Farabet, C., Implementing neural networks efficiently, neural networks: tricks of the trade, Volume 7700 of the series Lecture Notes in Computer Science, pp. 537–557, DOI: 10.​1007/​978-3-642-35289-8_​28.
37.
go back to reference Cacho, N., Batista, T., and Fernandes, F., A Lua-based AOP infrastructure. J. Braz. Comput. Soc. 11(3):7–20, 2005.CrossRef Cacho, N., Batista, T., and Fernandes, F., A Lua-based AOP infrastructure. J. Braz. Comput. Soc. 11(3):7–20, 2005.CrossRef
38.
go back to reference Maia, R., Cerqueira, R., Sieckenius de Souza, C., and Guisasola-Gorham, T., A qualitative human-centric evaluation of flexibility in middleware implementations. Empir. Softw. Eng. 17(3):166–199, 2012.CrossRef Maia, R., Cerqueira, R., Sieckenius de Souza, C., and Guisasola-Gorham, T., A qualitative human-centric evaluation of flexibility in middleware implementations. Empir. Softw. Eng. 17(3):166–199, 2012.CrossRef
39.
go back to reference Soares, L. F. G., Rodrigues, R. F., Cerqueira, R., and Barbosa, S. D. J., Variable and state handling in NCL. Multimed. Tools Appl. 50(3):465–489, 2010.CrossRef Soares, L. F. G., Rodrigues, R. F., Cerqueira, R., and Barbosa, S. D. J., Variable and state handling in NCL. Multimed. Tools Appl. 50(3):465–489, 2010.CrossRef
40.
go back to reference Niemüller, T., Ferrein, A., and Lakemeyer, G., A Lua-based behavior engine for controlling the humanoid robot nao, RoboCup 2009: Robot Soccer World Cup XIII, Volume 5949 of the series Lecture Notes in Computer Science, pp. 240–251. DOI: 10.1007/978-3-642-11876-0_21. Niemüller, T., Ferrein, A., and Lakemeyer, G., A Lua-based behavior engine for controlling the humanoid robot nao, RoboCup 2009: Robot Soccer World Cup XIII, Volume 5949 of the series Lecture Notes in Computer Science, pp. 240–251. DOI: 10.​1007/​978-3-642-11876-0_​21.
41.
go back to reference Codd-Downey, R., Jenkin, M., Ansell, M., Ng, H. -K., and Jasiobedzki, P., Simulating the C2SM ‘Fast’ robot, simulation, modeling, and programming for autonomous robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 26–37. DOI: 10.1007/978-3-642-17319-6_6. Codd-Downey, R., Jenkin, M., Ansell, M., Ng, H. -K., and Jasiobedzki, P., Simulating the C2SM ‘Fast’ robot, simulation, modeling, and programming for autonomous robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 26–37. DOI: 10.​1007/​978-3-642-17319-6_​6.
42.
go back to reference Freese, M., Singh, S., Ozaki, F., and Matsuhira, N., Virtual robot experimentation platform V-REP: a versatile 3D robot simulator, simulation, modeling, and programming for autonomous robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 51–62. DOI: 10.1007/978-3-642-17319-6_8. Freese, M., Singh, S., Ozaki, F., and Matsuhira, N., Virtual robot experimentation platform V-REP: a versatile 3D robot simulator, simulation, modeling, and programming for autonomous robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 51–62. DOI: 10.​1007/​978-3-642-17319-6_​8.
43.
go back to reference Ferrein, A., and Steinbauer, G., On the way to high-level programming for resource-limited embedded systems with Golog, Simulation, Modeling, and Programming for Autonomous Robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 229–240. doi: 10.1007/978-3-642-17319-6_23. Ferrein, A., and Steinbauer, G., On the way to high-level programming for resource-limited embedded systems with Golog, Simulation, Modeling, and Programming for Autonomous Robots, Volume 6472 of the series Lecture Notes in Computer Science, pp. 229–240. doi: 10.​1007/​978-3-642-17319-6_​23.
46.
go back to reference Smith, W., and Wakefield, G., Computational audiovisual composition using Lua, Transdisciplinary Digital Art. Sound, Vision and the New Screen, Volume 7 of the series Communications in Computer and Information Science, pp. 213–228. doi: 10.1007/978-3-540-79486-8_19, 2008. Smith, W., and Wakefield, G., Computational audiovisual composition using Lua, Transdisciplinary Digital Art. Sound, Vision and the New Screen, Volume 7 of the series Communications in Computer and Information Science, pp. 213–228. doi: 10.​1007/​978-3-540-79486-8_​19, 2008.
47.
go back to reference Ierusalimschy, R., Programming with multiple paradigms in lua, functional and constraint logic programming, Volume 5979 of the series Lecture Notes in Computer Science, pp. 1–12. doi: 10.1007/978-3-642-11999-6_1. Ierusalimschy, R., Programming with multiple paradigms in lua, functional and constraint logic programming, Volume 5979 of the series Lecture Notes in Computer Science, pp. 1–12. doi: 10.​1007/​978-3-642-11999-6_​1.
48.
go back to reference Karduna, A. R., Introduction to biomechanical analysis. In: Oatis, C. A., (Ed.), Kinesiology: The Mechanics And Pathomechanics Of Human Movement. Published by Lippincott Williams & Wilkins (2004-06-01) ISBN 10: 0781755131 / ISBN 13: 9780781755139. Karduna, A. R., Introduction to biomechanical analysis. In: Oatis, C. A., (Ed.), Kinesiology: The Mechanics And Pathomechanics Of Human Movement. Published by Lippincott Williams & Wilkins (2004-06-01) ISBN 10: 0781755131 / ISBN 13: 9780781755139.
50.
go back to reference Ullah, S., Higgins, H., Braem, B., Latre, B., Blondia, C., Moerman, I., Saleem, S., Rahman, Z., and Kwak, K. S., A comprehensive survey of wireless body area networks: on PHY, MAC, and network layers solutions. J. Med. Syst. 36(3):1065–1094, 2012. doi:10.1007/s10916-010-9571-3.CrossRefPubMed Ullah, S., Higgins, H., Braem, B., Latre, B., Blondia, C., Moerman, I., Saleem, S., Rahman, Z., and Kwak, K. S., A comprehensive survey of wireless body area networks: on PHY, MAC, and network layers solutions. J. Med. Syst. 36(3):1065–1094, 2012. doi:10.​1007/​s10916-010-9571-3.CrossRefPubMed
Metadata
Title
The adaptation of GDL motion recognition system to sport and rehabilitation techniques analysis
Authors
Tomasz Hachaj
Marek R. Ogiela
Publication date
01-06-2016
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 6/2016
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-016-0493-6

Other articles of this Issue 6/2016

Journal of Medical Systems 6/2016 Go to the issue