Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2020

01-12-2020 | Research

Virtual reality-based action observation facilitates the acquisition of body-powered prosthetic control skills

Authors: Manabu Yoshimura, Hiroshi Kurumadani, Junya Hirata, Hiroshi Osaka, Katsutoshi Senoo, Shota Date, Akio Ueda, Yosuke Ishii, Seiji Kinoshita, Kozo Hanayama, Toru Sunagawa

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2020

Login to get access

Abstract

Background

Regular body-powered (BP) prosthesis training facilitates the acquisition of skills through repeated practice but requires adequate time and motivation. Therefore, auxiliary tools such as indirect training may improve the training experience and speed of skill acquisition. In this study, we examined the effects of action observation (AO) using virtual reality (VR) as an auxiliary tool. We used two modalities during AO: three-dimensional (3D) VR and two-dimensional (2D) computer tablet devices (Tablet). Each modality was tested from first- and third-person perspectives.

Methods

We studied 40 healthy right-handed participants wearing a BP prosthesis simulator on their non-dominant hands. The participants were divided into five groups based on combinations of the different modalities and perspectives: first-person perspective on VR (VR1), third-person perspective on VR (VR3), first-person perspective on a tablet (Tablet1), third-person perspective on a tablet (Tablet3), and a control group (Control). The intervention groups observed and imitated the video image of prosthesis operation for 10 min in each of two sessions. We evaluated the level of immersion during AO using the visual analogue scale. Prosthetic control skills were evaluated using the Box and Block Test (BBT) and a bowknot task (BKT).

Results

In the BBT, there were no significant differences in the amount of change in the skills between the five groups. In contrast, the relative changes in the BKT prosthetic control skills in VR1 (p < 0.001, d = 3.09) and VR3 (p < 0.001, d = 2.16) were significantly higher than those in the control group. Additionally, the immersion scores of VR1 (p < 0.05, d = 1.45) and VR3 (p < 0.05, d = 1.18) were higher than those of Tablet3. There was a significant negative correlation between the immersion scores and the relative change in the BKT scores (Spearman’s rs = − 0.47, p < 0.01).

Conclusions

Using the BKT of bilateral manual dexterity, VR-based AO significantly improved short-term prosthetic control acquisition. Additionally, it appeared that the higher the immersion score was, the shorter the execution time of the BKT task. Our findings suggest that VR-based AO training may be effective in acquiring bilateral BP prosthetic control, which requires more 3D-based operation.
Literature
1.
go back to reference Biddiss E, Beaton D, Chau T. Consumer design priorities for upper limb prosthetics. Disabil Rehabil Assist Technol. 2007;2(6):346–57.PubMedCrossRef Biddiss E, Beaton D, Chau T. Consumer design priorities for upper limb prosthetics. Disabil Rehabil Assist Technol. 2007;2(6):346–57.PubMedCrossRef
2.
go back to reference Datta D, Selvarajah K, Davey N. Functional outcome of patients with proximal upper limb deficiency--acquired and congenital. Clin Rehabil. 2004;18(2):172–7.PubMedCrossRef Datta D, Selvarajah K, Davey N. Functional outcome of patients with proximal upper limb deficiency--acquired and congenital. Clin Rehabil. 2004;18(2):172–7.PubMedCrossRef
3.
go back to reference Biddiss EA, Chau TT. Upper limb prosthesis use and abandonment: a survey of the last 25 years. Prosthetics Orthot Int. 2007;31(3):236–57.CrossRef Biddiss EA, Chau TT. Upper limb prosthesis use and abandonment: a survey of the last 25 years. Prosthetics Orthot Int. 2007;31(3):236–57.CrossRef
4.
go back to reference Kejlaa GH. Consumer concerns and the functional value of prostheses to upper limb amputees. Prosthetics Orthot Int. 1993;17(3):157–63.CrossRef Kejlaa GH. Consumer concerns and the functional value of prostheses to upper limb amputees. Prosthetics Orthot Int. 1993;17(3):157–63.CrossRef
5.
go back to reference Huinink LHB, Bouwsema H, Plettenburg DH, van der Sluis CK, Bongers RM. Learning to use a body-powered prosthesis: changes in functionality and kinematics. J Neuroeng Rehabil. 2016;13:90.PubMedPubMedCentralCrossRef Huinink LHB, Bouwsema H, Plettenburg DH, van der Sluis CK, Bongers RM. Learning to use a body-powered prosthesis: changes in functionality and kinematics. J Neuroeng Rehabil. 2016;13:90.PubMedPubMedCentralCrossRef
6.
go back to reference Bouwsema H, Van der Sluis CK, Bongers RM. Changes in performance over time while learning to use a myoelectric prosthesis. J Neuroeng Rehabil. 2014;11:16.PubMedPubMedCentralCrossRef Bouwsema H, Van der Sluis CK, Bongers RM. Changes in performance over time while learning to use a myoelectric prosthesis. J Neuroeng Rehabil. 2014;11:16.PubMedPubMedCentralCrossRef
8.
go back to reference Ertelt D, Small S, Solodkin A, Dettmers C, Buccino G. Action observation has a positive impact on rehabilitation of motor deficits after stroke. Neuroimage. 2007;36(Suppl 2):164–73.CrossRef Ertelt D, Small S, Solodkin A, Dettmers C, Buccino G. Action observation has a positive impact on rehabilitation of motor deficits after stroke. Neuroimage. 2007;36(Suppl 2):164–73.CrossRef
9.
go back to reference Buccino G, Arisi D, Gough P, Aprile D, Fazzi E. Improving upper limb motor functions through action observation treatment: a pilot study in children with cerebral palsy. Dev Med Child Neurol. 2012;54(9):822–8.PubMedCrossRef Buccino G, Arisi D, Gough P, Aprile D, Fazzi E. Improving upper limb motor functions through action observation treatment: a pilot study in children with cerebral palsy. Dev Med Child Neurol. 2012;54(9):822–8.PubMedCrossRef
10.
go back to reference Pelosin E, Avanzino A, Bove M, Stramesi P, Nieuwboer A, Abbruzzese G. Action observation improves freezing of gait in patients with Parkinson's disease. Neurorehabil Neural Repair. 2010;24(8):746–52.PubMedCrossRef Pelosin E, Avanzino A, Bove M, Stramesi P, Nieuwboer A, Abbruzzese G. Action observation improves freezing of gait in patients with Parkinson's disease. Neurorehabil Neural Repair. 2010;24(8):746–52.PubMedCrossRef
11.
go back to reference Bellelli G, Buccino G, Bernardini B, Padovani A, Trabucchi M. Action observation treatment improves recovery of postsurgical orthopedic patients: evidence for a top-down effect? Arch Phys MedRehabil. 2010;91(10):1489–94.CrossRef Bellelli G, Buccino G, Bernardini B, Padovani A, Trabucchi M. Action observation treatment improves recovery of postsurgical orthopedic patients: evidence for a top-down effect? Arch Phys MedRehabil. 2010;91(10):1489–94.CrossRef
12.
go back to reference Cusack WF, Cope M, Nathanson S, Pirouz N, Wheaton LA. Neural Activation Differences in Amputees During Imitation of Intact Versus Amputee Movements. Front Hum Neurosci. 2012;29;6:182. Cusack WF, Cope M, Nathanson S, Pirouz N, Wheaton LA. Neural Activation Differences in Amputees During Imitation of Intact Versus Amputee Movements. Front Hum Neurosci. 2012;29;6:182.
14.
go back to reference Turolla A, Dam M, Ventura L, Tonin P, Agostini M, Zucconi C, Kiper P, Prion L. Virtual reality for the rehabilitation of the upper limb motor function after stroke: a prospective controlled trial. J Neuroeng Rehabil. 2013;10:85.PubMedPubMedCentralCrossRef Turolla A, Dam M, Ventura L, Tonin P, Agostini M, Zucconi C, Kiper P, Prion L. Virtual reality for the rehabilitation of the upper limb motor function after stroke: a prospective controlled trial. J Neuroeng Rehabil. 2013;10:85.PubMedPubMedCentralCrossRef
15.
go back to reference Kiper P, Szczudlik A, Agostini M, Opara J, Nowobilski R, Ventura L, Tonin P, Turolla A. Virtual reality for upper limb rehabilitation in subacute and chronic stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2018;99(5):834–42.PubMedCrossRef Kiper P, Szczudlik A, Agostini M, Opara J, Nowobilski R, Ventura L, Tonin P, Turolla A. Virtual reality for upper limb rehabilitation in subacute and chronic stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2018;99(5):834–42.PubMedCrossRef
16.
go back to reference Cikajlo I, Potisk KP. Advantages of using 3D virtual reality based training in persons with Parkinson's disease: a parallel study. J Neuroeng Rehabil. 2019;16:119.PubMedPubMedCentralCrossRef Cikajlo I, Potisk KP. Advantages of using 3D virtual reality based training in persons with Parkinson's disease: a parallel study. J Neuroeng Rehabil. 2019;16:119.PubMedPubMedCentralCrossRef
17.
go back to reference Perez-Marcos D, Bieler-Aeschlimann M, Serino A. Virtual reality as a vehicle to empower motor-cognitive Neurorehabilitation. Front Psychol. 2018;2(9):2120.CrossRef Perez-Marcos D, Bieler-Aeschlimann M, Serino A. Virtual reality as a vehicle to empower motor-cognitive Neurorehabilitation. Front Psychol. 2018;2(9):2120.CrossRef
18.
go back to reference Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9(1):97–113.PubMedCrossRef Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9(1):97–113.PubMedCrossRef
19.
go back to reference Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms for the box and block test of manual dexterity. Am J Occup Ther. 1985;39(6):386–91.PubMedCrossRef Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms for the box and block test of manual dexterity. Am J Occup Ther. 1985;39(6):386–91.PubMedCrossRef
20.
go back to reference Desrosiers J, Bravo G, Hebert R, Dutil E, Mercier L. Validation of the box and block test as a measure of dexterity of elderly people: reliability, validity, and norms studies. Arch Phys Med Rehabil. 1994;75(7):751–5.PubMedCrossRef Desrosiers J, Bravo G, Hebert R, Dutil E, Mercier L. Validation of the box and block test as a measure of dexterity of elderly people: reliability, validity, and norms studies. Arch Phys Med Rehabil. 1994;75(7):751–5.PubMedCrossRef
21.
go back to reference Crosbie J, Lennon S, Mcneill M, Mcdonough S. Virtual reality in the rehabilitation of the upper limb after stroke: the user's perspective. CyberPsychol Behav. 2006;9(2):137–41.PubMedCrossRef Crosbie J, Lennon S, Mcneill M, Mcdonough S. Virtual reality in the rehabilitation of the upper limb after stroke: the user's perspective. CyberPsychol Behav. 2006;9(2):137–41.PubMedCrossRef
22.
go back to reference Lohse KR, Boyd LA, Hodges NJ. Engaging environments enhance motor skill learning in a computer gaming task. J Mot Behav. 2016;48(2):172–82.PubMedCrossRef Lohse KR, Boyd LA, Hodges NJ. Engaging environments enhance motor skill learning in a computer gaming task. J Mot Behav. 2016;48(2):172–82.PubMedCrossRef
23.
go back to reference Rohrbach N, Chicklis E, Levac DE. What is the impact of user affect on motor learning in virtual environments after stroke? A scoping review J Neuroeng Rehabil. 2019;16:79.PubMedCrossRef Rohrbach N, Chicklis E, Levac DE. What is the impact of user affect on motor learning in virtual environments after stroke? A scoping review J Neuroeng Rehabil. 2019;16:79.PubMedCrossRef
24.
go back to reference Lewis GN, Woods C, Rosie JA, McPherson KM. Virtual reality games for rehabilitation of people with stroke: perspectives from the users. Disabil Rehabil Assist Technol. 2011;6(5):453–63.PubMedCrossRef Lewis GN, Woods C, Rosie JA, McPherson KM. Virtual reality games for rehabilitation of people with stroke: perspectives from the users. Disabil Rehabil Assist Technol. 2011;6(5):453–63.PubMedCrossRef
25.
go back to reference Levin MF, Weiss PL, Keshner EA. Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Phys Ther. 2015;95(3):415–25.PubMedCrossRef Levin MF, Weiss PL, Keshner EA. Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Phys Ther. 2015;95(3):415–25.PubMedCrossRef
26.
go back to reference Jackson PL, Meltzoff AN, Decety J. Neural circuits involved in imitation and perspective-taking. Neuroimage. 2006:15;31(1):429–39. Jackson PL, Meltzoff AN, Decety J. Neural circuits involved in imitation and perspective-taking. Neuroimage. 2006:15;31(1):429–39.
27.
go back to reference Hotz-Boendermaker S, Funk M, Summers P, Brugger P, Kollias SS. Preservation of motor programs in paraplegics as demonstrated by attempted and imagined foot movements. Neuroimage. 2008:1;39(1):383–94. Hotz-Boendermaker S, Funk M, Summers P, Brugger P, Kollias SS. Preservation of motor programs in paraplegics as demonstrated by attempted and imagined foot movements. Neuroimage. 2008:1;39(1):383–94.
28.
go back to reference Villiger M, Estévez N, Hepp-Reymond MC, Kiper D, Hotz-Boendermaker S. Enhanced activation of motor execution networks using action observation combined with imagination of lower limb movements. PLoS One. 2013;28:8(8). Villiger M, Estévez N, Hepp-Reymond MC, Kiper D, Hotz-Boendermaker S. Enhanced activation of motor execution networks using action observation combined with imagination of lower limb movements. PLoS One. 2013;28:8(8).
29.
go back to reference Kyberd PJ. The influence of control format and hand design in single axis myoelectric hands: assessment of functionality of prosthetic hands using the Southampton hand assessment procedure. Prosthetics Orthot Int. 2011;35(3):285–93.CrossRef Kyberd PJ. The influence of control format and hand design in single axis myoelectric hands: assessment of functionality of prosthetic hands using the Southampton hand assessment procedure. Prosthetics Orthot Int. 2011;35(3):285–93.CrossRef
30.
go back to reference Resnik L, Borgia M. Reliability and validity of outcome measures for upper limb amputation. J Prosthet Orthot. 2012;24(4):192–201.CrossRef Resnik L, Borgia M. Reliability and validity of outcome measures for upper limb amputation. J Prosthet Orthot. 2012;24(4):192–201.CrossRef
31.
go back to reference Haverkate L, Smit G, Plettenburg DH. Assessment of body-powered upper limb prostheses by able-bodied subjects, using the box and blocks test and the nine-hole peg test. Prosthetics Orthot Int. 2016;40(1):109–16.CrossRef Haverkate L, Smit G, Plettenburg DH. Assessment of body-powered upper limb prostheses by able-bodied subjects, using the box and blocks test and the nine-hole peg test. Prosthetics Orthot Int. 2016;40(1):109–16.CrossRef
32.
go back to reference Bloomer C, Wang S, Kontson K. Creating a standardized, quantitative training protocol for upper limb bypasss prostheses. Phys Med Rehabil Res. 2018;3(6):1–8.PubMedPubMedCentralCrossRef Bloomer C, Wang S, Kontson K. Creating a standardized, quantitative training protocol for upper limb bypasss prostheses. Phys Med Rehabil Res. 2018;3(6):1–8.PubMedPubMedCentralCrossRef
33.
go back to reference Gokeler A, Bisschop M, Myer GD, Benjaminse A, Otten E. Immersive virtual reality improves movement patterns in patients after ACL reconstruction: implications for enhanced criteria-based return-to-sport rehabilitation. Knee Surg Sports Traumatol Arthrosc. 2016;24(7):2280–6.PubMedCrossRef Gokeler A, Bisschop M, Myer GD, Benjaminse A, Otten E. Immersive virtual reality improves movement patterns in patients after ACL reconstruction: implications for enhanced criteria-based return-to-sport rehabilitation. Knee Surg Sports Traumatol Arthrosc. 2016;24(7):2280–6.PubMedCrossRef
34.
go back to reference Cummings JJ, Bailenson JN. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychol. 2016;19(2):271–309.CrossRef Cummings JJ, Bailenson JN. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychol. 2016;19(2):271–309.CrossRef
35.
go back to reference Shu Y, Huang YZ, Chang SH, Chen MY. Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Reality. 2019;23:437–46.CrossRef Shu Y, Huang YZ, Chang SH, Chen MY. Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Reality. 2019;23:437–46.CrossRef
36.
go back to reference Chadwell A, Kenney L, Granat MH, Thies S. Upper limb activity in myoelectric prosthesis users is biased towards the intact limb and appears unrelated to goal-directed task performance. Sci Rep. 2018;8(1):11084.PubMedPubMedCentralCrossRef Chadwell A, Kenney L, Granat MH, Thies S. Upper limb activity in myoelectric prosthesis users is biased towards the intact limb and appears unrelated to goal-directed task performance. Sci Rep. 2018;8(1):11084.PubMedPubMedCentralCrossRef
37.
go back to reference Cusack WF, Patterson R, Thach S, Kistenberg RS, Wheaton LA. Motor performance benefits of matched limb imitation in prosthesis users. Exp Brain Res. 2014;232(7):2143–54.PubMedCrossRef Cusack WF, Patterson R, Thach S, Kistenberg RS, Wheaton LA. Motor performance benefits of matched limb imitation in prosthesis users. Exp Brain Res. 2014;232(7):2143–54.PubMedCrossRef
Metadata
Title
Virtual reality-based action observation facilitates the acquisition of body-powered prosthetic control skills
Authors
Manabu Yoshimura
Hiroshi Kurumadani
Junya Hirata
Hiroshi Osaka
Katsutoshi Senoo
Shota Date
Akio Ueda
Yosuke Ishii
Seiji Kinoshita
Kozo Hanayama
Toru Sunagawa
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2020
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-020-00743-w

Other articles of this Issue 1/2020

Journal of NeuroEngineering and Rehabilitation 1/2020 Go to the issue