Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2019

Open Access 01-12-2019 | Research

Coordination of reach-to-grasp in physical and haptic-free virtual environments

Authors: Mariusz P. Furmanek, Luis F. Schettino, Mathew Yarossi, Sofia Kirkman, Sergei V. Adamovich, Eugene Tunik

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2019

Login to get access

Abstract

Background

Virtual reality (VR) offers unprecedented opportunity as a scientific tool to study visuomotor interactions, training, and rehabilitation applications. However, it remains unclear if haptic-free hand-object interactions in a virtual environment (VE) may differ from those performed in the physical environment (PE). We therefore sought to establish if the coordination structure between the transport and grasp components remain similar whether a reach-to-grasp movement is performed in PE and VE.

Method

Reach-to-grasp kinematics were examined in 13 healthy right-handed young adults. Subjects were instructed to reach-to-grasp-to-lift three differently sized rectangular objects located at three different distances from the starting position. Object size and location were matched between the two environments. Contact with the virtual objects was based on a custom collision detection algorithm. Differences between the environments were evaluated by comparing movement kinematics of the transport and grasp components.

Results

Correlation coefficients, and the slope of the regression lines, between the reach and grasp components were similar for the two environments. Likewise, the kinematic profiles of the transport velocity and grasp aperture were strongly correlated across the two environments. A rmANOVA further identified some similarities and differences in the movement kinematics between the two environments - most prominently that the closure phase of reach-to-grasp movement was prolonged when movements were performed in VE.

Conclusions

Reach-to-grasp movement patterns performed in a VE showed both similarities and specific differences compared to those performed in PE. Additionally, we demonstrate a novel approach for parsing the reach-to-grasp movement into three phases- initiation, shaping, closure- based on established kinematic variables, and demonstrate that the differences in performance between the environments are attributed to the closure phase. We discuss this in the context of how collision detection parameters may modify hand-object interactions in VE. Our study shows that haptic-free VE may be a useful platform to study reach-to-grasp movements, with potential implications for haptic-free VR in neurorehabilitation.
Literature
1.
go back to reference Seth A, Vance JM, Oliver JH. Virtual reality for assembly methods prototyping: a review. Virtual Reality. 2010;15(1):5–20.CrossRef Seth A, Vance JM, Oliver JH. Virtual reality for assembly methods prototyping: a review. Virtual Reality. 2010;15(1):5–20.CrossRef
2.
go back to reference Li L, Yu F, Shi D, Shi J, Tian Z, Yang J, Wang X, Jiang Q. Application of virtual reality technology in clinical medicine. Am J Transl Res. 2017(9, 9):3867–80. Li L, Yu F, Shi D, Shi J, Tian Z, Yang J, Wang X, Jiang Q. Application of virtual reality technology in clinical medicine. Am J Transl Res. 2017(9, 9):3867–80.
3.
go back to reference Holden MK. Virtual environments for motor rehabilitation: review. CyberPsychol Behav. 2005;8(3):187–211.CrossRef Holden MK. Virtual environments for motor rehabilitation: review. CyberPsychol Behav. 2005;8(3):187–211.CrossRef
4.
go back to reference Rose T, Nam CS, Chen KB. Immersion of virtual reality for rehabilitation - review. Appl Ergon. 2018;69:153–61.CrossRef Rose T, Nam CS, Chen KB. Immersion of virtual reality for rehabilitation - review. Appl Ergon. 2018;69:153–61.CrossRef
5.
go back to reference Adamovich SV, Merians AS, Boian R, Lewis JA, Tremaine M, Burdea GS, Recce M, Poizner H. A virtual reality-based exercise system for hand rehabilitation post-stroke. Presence-Teleop Virt. 2005;14(2):161–74.CrossRef Adamovich SV, Merians AS, Boian R, Lewis JA, Tremaine M, Burdea GS, Recce M, Poizner H. A virtual reality-based exercise system for hand rehabilitation post-stroke. Presence-Teleop Virt. 2005;14(2):161–74.CrossRef
6.
go back to reference Fluet GG, Merians AS, Qiu QY, Davidow A, Adamovich SV. Comparing integrated training of the hand and arm with isolated training of the same effectors in persons with stroke using haptically rendered virtual environments, a randomized clinical trial. J Neuroeng Rehabil. 2014;11.CrossRef Fluet GG, Merians AS, Qiu QY, Davidow A, Adamovich SV. Comparing integrated training of the hand and arm with isolated training of the same effectors in persons with stroke using haptically rendered virtual environments, a randomized clinical trial. J Neuroeng Rehabil. 2014;11.CrossRef
7.
go back to reference Merians AS, Tunik E, Adamovich SV. Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. Stud Health Technol Inform. 2009;145:109–25.PubMedPubMedCentral Merians AS, Tunik E, Adamovich SV. Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. Stud Health Technol Inform. 2009;145:109–25.PubMedPubMedCentral
8.
go back to reference Burdea GC. Haptics issues in virtual environments. Computer Graphics International. 2000, Proceedings;(2000):295–302. Burdea GC. Haptics issues in virtual environments. Computer Graphics International. 2000, Proceedings;(2000):295–302.
9.
go back to reference Borst CW, Volz RA. Evaluation of a haptic mixed reality system for interactions with a virtual control panel. Presence-Teleop Virt. 2005;14(6):677–96.CrossRef Borst CW, Volz RA. Evaluation of a haptic mixed reality system for interactions with a virtual control panel. Presence-Teleop Virt. 2005;14(6):677–96.CrossRef
10.
go back to reference Smeragliuolo AH, Hill NJ, Disla L, Putrino D. Validation of the leap motion controller using markered motion capture technology. J Biomech. 2016;49(9):1742–50.CrossRef Smeragliuolo AH, Hill NJ, Disla L, Putrino D. Validation of the leap motion controller using markered motion capture technology. J Biomech. 2016;49(9):1742–50.CrossRef
11.
go back to reference Adamovich SV, Fluet GG, Tunik E, Merians AS. Sensorimotor training in virtual reality: a review. NeuroRehabilitation. 2009;25(1):29–44.PubMedPubMedCentral Adamovich SV, Fluet GG, Tunik E, Merians AS. Sensorimotor training in virtual reality: a review. NeuroRehabilitation. 2009;25(1):29–44.PubMedPubMedCentral
12.
go back to reference Pallesen H, Andersen MB, Hansen GM, Lundquist CB, Brunner I. Patients' and health Professionals' experiences of using virtual reality Technology for Upper Limb Training after stroke: a qualitative substudy. Rehab Res Pract. 2018. Pallesen H, Andersen MB, Hansen GM, Lundquist CB, Brunner I. Patients' and health Professionals' experiences of using virtual reality Technology for Upper Limb Training after stroke: a qualitative substudy. Rehab Res Pract. 2018.
13.
go back to reference Magdalon EC, Michaelsen SM, Quevedo AA, Levin MF. Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment. Acta Psychol. 2011;138(1):126–34.CrossRef Magdalon EC, Michaelsen SM, Quevedo AA, Levin MF. Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment. Acta Psychol. 2011;138(1):126–34.CrossRef
14.
go back to reference Levin MF, Magdalon EC, Michaelsen SM, Quevedo AA. Quality of grasping and the role of haptics in a 3-D immersive virtual reality environment in individuals with stroke. IEEE Trans Neural Syst Rehabil Eng. 2015;23(6):1047–55.CrossRef Levin MF, Magdalon EC, Michaelsen SM, Quevedo AA. Quality of grasping and the role of haptics in a 3-D immersive virtual reality environment in individuals with stroke. IEEE Trans Neural Syst Rehabil Eng. 2015;23(6):1047–55.CrossRef
15.
go back to reference Jeannerod M: Attention and performance, IX. 1981, Erlbaum, Hillsdale, NJ:153–169. Jeannerod M: Attention and performance, IX. 1981, Erlbaum, Hillsdale, NJ:153–169.
16.
go back to reference Jeannerod M. The timing of natural Prehension movements. J Motor Behav. 1984;16(3):235–54.CrossRef Jeannerod M. The timing of natural Prehension movements. J Motor Behav. 1984;16(3):235–54.CrossRef
17.
go back to reference Gentilucci M, Chieffi S, Scarpa M, Castiello U. Temporal coupling between transport and grasp components during prehension movements: effects of visual perturbation. Behav Brain Res. 1992;47(1):71–82.CrossRef Gentilucci M, Chieffi S, Scarpa M, Castiello U. Temporal coupling between transport and grasp components during prehension movements: effects of visual perturbation. Behav Brain Res. 1992;47(1):71–82.CrossRef
18.
go back to reference Marteniuk RG, Leavitt JL, Mackenzie CL, Athenes S. Functional-relationships between grasp and transport components in a Prehension task. Hum Movement Sci. 1990;9(2):149–76.CrossRef Marteniuk RG, Leavitt JL, Mackenzie CL, Athenes S. Functional-relationships between grasp and transport components in a Prehension task. Hum Movement Sci. 1990;9(2):149–76.CrossRef
19.
go back to reference Castiello U. The neuroscience of grasping. Nat Rev Neurosci. 2005;6(9):726–36.CrossRef Castiello U. The neuroscience of grasping. Nat Rev Neurosci. 2005;6(9):726–36.CrossRef
20.
go back to reference van Vliet PM, Sheridan MR. Coordination between reaching and grasping in patients with hemiparesis and healthy subjects. Arch Phys Med Rehabil. 2007;88(10):1325–31.CrossRef van Vliet PM, Sheridan MR. Coordination between reaching and grasping in patients with hemiparesis and healthy subjects. Arch Phys Med Rehabil. 2007;88(10):1325–31.CrossRef
21.
go back to reference Paulignan Y, MacKenzie C, Marteniuk R, Jeannerod M. Selective perturbation of visual input during prehension movements. 1. The effects of changing object position. Exp Brain Res. 1991;83(3):502–12.CrossRef Paulignan Y, MacKenzie C, Marteniuk R, Jeannerod M. Selective perturbation of visual input during prehension movements. 1. The effects of changing object position. Exp Brain Res. 1991;83(3):502–12.CrossRef
22.
go back to reference Davare M, Parikh PJ, Santello M. Sensorimotor uncertainty modulates corticospinal excitability during skilled object manipulation. J Neurophysiol. 2019. Davare M, Parikh PJ, Santello M. Sensorimotor uncertainty modulates corticospinal excitability during skilled object manipulation. J Neurophysiol. 2019.
23.
go back to reference Shibata D, Santello M. Role of digit placement control in sensorimotor transformations for dexterous manipulation. J Neurophysiol. 2017;118(5):2935–43.CrossRef Shibata D, Santello M. Role of digit placement control in sensorimotor transformations for dexterous manipulation. J Neurophysiol. 2017;118(5):2935–43.CrossRef
24.
go back to reference Rizzo AS, Kim GJ. A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence-Teleop Virt. 2005;14(2):119–46.CrossRef Rizzo AS, Kim GJ. A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence-Teleop Virt. 2005;14(2):119–46.CrossRef
25.
go back to reference Viau A, Feldman AG, McFadyen BJ, Levin MF. Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil. 2004;1(1):11.CrossRef Viau A, Feldman AG, McFadyen BJ, Levin MF. Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil. 2004;1(1):11.CrossRef
26.
go back to reference Knaut LA, Subramanian SK, McFadyen BJ, Bourbonnais D, Levin MF. Kinematics of pointing movements made in a virtual versus a physical 3-dimensional environment in healthy and stroke subjects. Arch Phys Med Rehabil. 2009;90(5):793–802.CrossRef Knaut LA, Subramanian SK, McFadyen BJ, Bourbonnais D, Levin MF. Kinematics of pointing movements made in a virtual versus a physical 3-dimensional environment in healthy and stroke subjects. Arch Phys Med Rehabil. 2009;90(5):793–802.CrossRef
27.
go back to reference Saling M, Mescheriakov S, Molokanova E, Stelmach GE, Berger M. Grip reorganization during wrist transport: the influence of an altered aperture. Exp Brain Res. 1996;108(3):493–500.CrossRef Saling M, Mescheriakov S, Molokanova E, Stelmach GE, Berger M. Grip reorganization during wrist transport: the influence of an altered aperture. Exp Brain Res. 1996;108(3):493–500.CrossRef
28.
go back to reference Haggard P, Wing A. Coordination of hand aperture with the spatial path of hand transport. Exp Brain Res. 1998;118(2):286–92.CrossRef Haggard P, Wing A. Coordination of hand aperture with the spatial path of hand transport. Exp Brain Res. 1998;118(2):286–92.CrossRef
29.
go back to reference Robert MT, Levin MF. Validation of reaching in a virtual environment in typically developing children and children with mild unilateral cerebral palsy. Dev Med Child Neurol. 2018;60(4):382–90.CrossRef Robert MT, Levin MF. Validation of reaching in a virtual environment in typically developing children and children with mild unilateral cerebral palsy. Dev Med Child Neurol. 2018;60(4):382–90.CrossRef
30.
go back to reference Rand MK, Lemay M, Squire LM, Shimansky YP, Stelmach GE. Role of vision in aperture closure control during reach-to-grasp movements. Exp Brain Res. 2007;181(3):447–60.CrossRef Rand MK, Lemay M, Squire LM, Shimansky YP, Stelmach GE. Role of vision in aperture closure control during reach-to-grasp movements. Exp Brain Res. 2007;181(3):447–60.CrossRef
31.
go back to reference Fu Q, Ushani A, Jentoft L, Howe RD, Santella M. Human reach-to-grasp compensation with object pose uncertainty. Conf Proc IEEE Eng Med Biol Soc. 2013;2013:6893–6.PubMed Fu Q, Ushani A, Jentoft L, Howe RD, Santella M. Human reach-to-grasp compensation with object pose uncertainty. Conf Proc IEEE Eng Med Biol Soc. 2013;2013:6893–6.PubMed
32.
go back to reference Youn J, Wohn K: Realtime collision detection for virtual reality applications. In: Proceedings of IEEE virtual reality annual international symposium: 18–22 sept. 1993 1993; 1993: 415–421. Youn J, Wohn K: Realtime collision detection for virtual reality applications. In: Proceedings of IEEE virtual reality annual international symposium: 18–22 sept. 1993 1993; 1993: 415–421.
33.
go back to reference Fu QS, Santello M: Towards a complete description of grasping kinematics: a framework for quantifying human grasping and manipulation. 2011 Annual International Conference of the Ieee Engineering in Medicine and Biology Society (Embc) 2011:8247–8250. Fu QS, Santello M: Towards a complete description of grasping kinematics: a framework for quantifying human grasping and manipulation. 2011 Annual International Conference of the Ieee Engineering in Medicine and Biology Society (Embc) 2011:8247–8250.
34.
go back to reference Prachyabrued M, Borst CW. Visual feedback for virtual grasping. In: 2014 IEEE symposium on 3D user interfaces (3DUI): 29–30 march 2014 2014; 2014. p. 19–26.CrossRef Prachyabrued M, Borst CW. Visual feedback for virtual grasping. In: 2014 IEEE symposium on 3D user interfaces (3DUI): 29–30 march 2014 2014; 2014. p. 19–26.CrossRef
35.
go back to reference Bozzacchi C, Volcic R, Domini F. Effect of visual and haptic feedback on grasping movements. J Neurophysiol. 2014;112(12):3189–96.CrossRef Bozzacchi C, Volcic R, Domini F. Effect of visual and haptic feedback on grasping movements. J Neurophysiol. 2014;112(12):3189–96.CrossRef
36.
go back to reference Fu Q, Zhang W, Santello M. Anticipatory planning and control of grasp positions and forces for dexterous two-digit manipulation. J Neurosci. 2010;30(27):9117–26.CrossRef Fu Q, Zhang W, Santello M. Anticipatory planning and control of grasp positions and forces for dexterous two-digit manipulation. J Neurosci. 2010;30(27):9117–26.CrossRef
Metadata
Title
Coordination of reach-to-grasp in physical and haptic-free virtual environments
Authors
Mariusz P. Furmanek
Luis F. Schettino
Mathew Yarossi
Sofia Kirkman
Sergei V. Adamovich
Eugene Tunik
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2019
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-019-0525-9

Other articles of this Issue 1/2019

Journal of NeuroEngineering and Rehabilitation 1/2019 Go to the issue