Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2014

Open Access 01-12-2014 | Methodology

Manipulation of visual biofeedback during gait with a time delayed adaptive Virtual Mirror Box

Authors: Gabor J Barton, Alan R De Asha, Edwin CP van Loon, Thomas Geijtenbeek, Mark A Robinson

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2014

Login to get access

Abstract

Background

A mirror placed in the mid-sagittal plane of the body has been used to reduce phantom limb pain and improve movement function in medical conditions characterised by asymmetrical movement control. The mirrored illusion of unimpaired limb movement during gait might enhance the effect, but a physical mirror is only capable of showing parallel movement of limbs in real time typically while sitting. We aimed to overcome the limitations of physical mirrors by developing and evaluating a Virtual Mirror Box which delays the mirrored image of limbs during gait to ensure temporal congruency with the impaired physical limb.

Methods

An application was developed in the CAREN system’s D-Flow software which mirrors selected limbs recorded by real-time motion capture to the contralateral side. To achieve phase shifted movement of limbs during gait, the mirrored virtual limbs are also delayed by a continuously calculated amount derived from past gait events. In order to accommodate non-normal proportions and offsets of pathological gait, the movements are morphed so that the physical and virtual contact events match on the mirrored side. Our method was tested with a trans-femoral amputee walking on a treadmill using his artificial limb. Joint angles of the elbow and knee were compared between the intact and mirrored side using cross correlation, root mean squared difference and correlation coefficients.

Results

The time delayed adaptive virtual mirror box produced a symmetrical looking gait of the avatar coupled with a reduction of the difference between the intact and virtual knee and elbow angles (10.86° and 5.34° reduced to 4.99° and 2.54° respectively). Dynamic morphing of the delay caused a non-significant change of toe-off events when compared to delaying by 50% of the previous gait cycle, as opposed to the initial contact events which showed a practically negligible but statistically significant increase (p < 0.05).

Conclusions

Adding an adaptive time delay to the Virtual Mirror Box has extended its use to treadmill gait, for the first time. Dynamic morphing resulted in a compromise between mirrored movement of the intact side and gait events of the virtual limbs matched with physical events of the impaired side. Asymmetrical but repeatable gait is expected to provide even more faithful mirroring.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ramachandran VS, Rogers-Ramachandran D: Synaesthesia in phantom limbs induced with mirrors. Proc Biol Sci 1996,263(1369):377-386. 10.1098/rspb.1996.0058CrossRefPubMed Ramachandran VS, Rogers-Ramachandran D: Synaesthesia in phantom limbs induced with mirrors. Proc Biol Sci 1996,263(1369):377-386. 10.1098/rspb.1996.0058CrossRefPubMed
2.
go back to reference Brodie EE, Whyte A, Waller B: Increased motor control of a phantom leg in humans results from the visual feedback of a virtual leg. Neurosci Lett 2003,341(2):167-169. 10.1016/S0304-3940(03)00160-5CrossRefPubMed Brodie EE, Whyte A, Waller B: Increased motor control of a phantom leg in humans results from the visual feedback of a virtual leg. Neurosci Lett 2003,341(2):167-169. 10.1016/S0304-3940(03)00160-5CrossRefPubMed
3.
go back to reference Ramachandran VS: Plasticity and functional recovery in neurology. Clin Med 2005, 5: 368-373. 10.7861/clinmedicine.5-4-368CrossRef Ramachandran VS: Plasticity and functional recovery in neurology. Clin Med 2005, 5: 368-373. 10.7861/clinmedicine.5-4-368CrossRef
4.
go back to reference Chan BL, Witt R, Charrow AP, Magee A, Howard R, Pasquina PF, Heilman KM, Tsao JW: Mirror therapy for phantom limb pain. N Engl J Med 2007, 357: 2206-2007. 10.1056/NEJMc071927CrossRefPubMed Chan BL, Witt R, Charrow AP, Magee A, Howard R, Pasquina PF, Heilman KM, Tsao JW: Mirror therapy for phantom limb pain. N Engl J Med 2007, 357: 2206-2007. 10.1056/NEJMc071927CrossRefPubMed
5.
go back to reference Brodie EE, Whyte A, Niven CA: Analgesia through the looking-glass? A randomized controlled trial investigating the effect of viewing a 'virtual' limb upon phantom limb pain, sensation and movement. Eur J Pain 2007,11(4):428-436. 10.1016/j.ejpain.2006.06.002CrossRefPubMed Brodie EE, Whyte A, Niven CA: Analgesia through the looking-glass? A randomized controlled trial investigating the effect of viewing a 'virtual' limb upon phantom limb pain, sensation and movement. Eur J Pain 2007,11(4):428-436. 10.1016/j.ejpain.2006.06.002CrossRefPubMed
6.
go back to reference Altschuler EL, Wisdom SB, Stone L, Foster C, Galasko D, Llewellyn DM, Ramachandran VS: Rehabilitation of hemiparesis after stroke with a mirror. Lancet 1999, 353: 2035-2036. 10.1016/S0140-6736(99)00920-4CrossRefPubMed Altschuler EL, Wisdom SB, Stone L, Foster C, Galasko D, Llewellyn DM, Ramachandran VS: Rehabilitation of hemiparesis after stroke with a mirror. Lancet 1999, 353: 2035-2036. 10.1016/S0140-6736(99)00920-4CrossRefPubMed
7.
go back to reference Yavuzer G, Selles R, Sezer N, Sütbeyaz S, Bussmann JB, Köseoğlu F, Atay MB, Stam HJ: Mirror therapy improves hand function in subacute stroke: a randomized controlled trial. Arch Phys Med Rehabil 2008,89(3):393-398. 10.1016/j.apmr.2007.08.162CrossRefPubMed Yavuzer G, Selles R, Sezer N, Sütbeyaz S, Bussmann JB, Köseoğlu F, Atay MB, Stam HJ: Mirror therapy improves hand function in subacute stroke: a randomized controlled trial. Arch Phys Med Rehabil 2008,89(3):393-398. 10.1016/j.apmr.2007.08.162CrossRefPubMed
8.
go back to reference Ezendam D, Bongers RM, Jannink MJ: Systematic review of the effectiveness of mirror therapy in upper extremity function. Disabil Rehabil 2009,31(26):2135-49. 10.3109/09638280902887768CrossRefPubMed Ezendam D, Bongers RM, Jannink MJ: Systematic review of the effectiveness of mirror therapy in upper extremity function. Disabil Rehabil 2009,31(26):2135-49. 10.3109/09638280902887768CrossRefPubMed
9.
go back to reference Feltham MG, Ledebt A, Bennett SJ, Deconinck FJ, Verheul MH, Savelsbergh GJ: The "mirror box" illusion: effect of visual information on bimanual coordination in children with spastic hemiparetic cerebral palsy. Motor Control 2010,14(1):68-82.PubMed Feltham MG, Ledebt A, Bennett SJ, Deconinck FJ, Verheul MH, Savelsbergh GJ: The "mirror box" illusion: effect of visual information on bimanual coordination in children with spastic hemiparetic cerebral palsy. Motor Control 2010,14(1):68-82.PubMed
10.
go back to reference Moseley GL: Using visual illusion to reduce at-level neuropathic pain in paraplegia. Pain 2007, 130: 294-298. 10.1016/j.pain.2007.01.007CrossRefPubMed Moseley GL: Using visual illusion to reduce at-level neuropathic pain in paraplegia. Pain 2007, 130: 294-298. 10.1016/j.pain.2007.01.007CrossRefPubMed
11.
go back to reference Mercier C, Sirigu A: Training with virtual visual feedback to alleviate phantom limb pain. Neurorehabil Neural Repair 2009,23(6):587-594. 10.1177/1545968308328717CrossRefPubMed Mercier C, Sirigu A: Training with virtual visual feedback to alleviate phantom limb pain. Neurorehabil Neural Repair 2009,23(6):587-594. 10.1177/1545968308328717CrossRefPubMed
12.
go back to reference Murray CD, Patchick E, Pettifer S, Caillette F, Howard T: Immersive virtual reality as a rehabilitative technology for phantom limb experience: a protocol. Cyberpsychol Behav 2006,9(2):167-170. 10.1089/cpb.2006.9.167CrossRefPubMed Murray CD, Patchick E, Pettifer S, Caillette F, Howard T: Immersive virtual reality as a rehabilitative technology for phantom limb experience: a protocol. Cyberpsychol Behav 2006,9(2):167-170. 10.1089/cpb.2006.9.167CrossRefPubMed
13.
go back to reference O'Neill K, de Paor A, MacLachlan M, McDarby G: An Investigation into the Performance of a Virtual Mirror Box for the Treatment of Phantom Limb Pain in Amputees using Augmented Reality Technology. In Human-Computer-Interaction International. Conference Proceedings. London: Lawrence Erlbaum Associates Inc; 2003. O'Neill K, de Paor A, MacLachlan M, McDarby G: An Investigation into the Performance of a Virtual Mirror Box for the Treatment of Phantom Limb Pain in Amputees using Augmented Reality Technology. In Human-Computer-Interaction International. Conference Proceedings. London: Lawrence Erlbaum Associates Inc; 2003.
14.
go back to reference Whyte AS, Niven CA: Variation in phantom limb pain: results of a diary study. J Pain Symptom Manage 2001,22(5):947-953. 10.1016/S0885-3924(01)00356-6CrossRefPubMed Whyte AS, Niven CA: Variation in phantom limb pain: results of a diary study. J Pain Symptom Manage 2001,22(5):947-953. 10.1016/S0885-3924(01)00356-6CrossRefPubMed
15.
go back to reference van den Bogert AJ, Geijtenbeek T, Even-Zohar O, Steenbrink F, Hardin EC: A real-time system for biomechanical analysis of human movement and muscle function. Med Biol Eng Comput in press van den Bogert AJ, Geijtenbeek T, Even-Zohar O, Steenbrink F, Hardin EC: A real-time system for biomechanical analysis of human movement and muscle function. Med Biol Eng Comput in press
16.
go back to reference Geijtenbeek T, Steenbrink F, Otten E, Even-Zohar O: D-Flow: Immersive Virtual Reality and Real-Time Feedback for Rehabilitation. In Proceedings of the 10th ACM International Conference on Virtual Reality Continuum and Its Applications in Industry, 11-12 December 2011. New York: ACM; 2011:201-208. Geijtenbeek T, Steenbrink F, Otten E, Even-Zohar O: D-Flow: Immersive Virtual Reality and Real-Time Feedback for Rehabilitation. In Proceedings of the 10th ACM International Conference on Virtual Reality Continuum and Its Applications in Industry, 11-12 December 2011. New York: ACM; 2011:201-208.
17.
go back to reference Hreljac A, Marshall RN: Algorithms to determine event timing during normal walking using kinematic data. J Biomech 2000, 33: 783-786. 10.1016/S0021-9290(00)00014-2CrossRefPubMed Hreljac A, Marshall RN: Algorithms to determine event timing during normal walking using kinematic data. J Biomech 2000, 33: 783-786. 10.1016/S0021-9290(00)00014-2CrossRefPubMed
18.
go back to reference O’Connor CM, Thorpe SK, O’Malley MJ, Vaughan CL: Automatic detection of gait events using kinematic data. Gait Posture 2007, 25: 469-474. 10.1016/j.gaitpost.2006.05.016CrossRefPubMed O’Connor CM, Thorpe SK, O’Malley MJ, Vaughan CL: Automatic detection of gait events using kinematic data. Gait Posture 2007, 25: 469-474. 10.1016/j.gaitpost.2006.05.016CrossRefPubMed
19.
go back to reference Miller A: Gait event detection using a multilayer neural network. Gait Posture 2009, 29: 542-545. 10.1016/j.gaitpost.2008.12.003CrossRefPubMed Miller A: Gait event detection using a multilayer neural network. Gait Posture 2009, 29: 542-545. 10.1016/j.gaitpost.2008.12.003CrossRefPubMed
20.
go back to reference De Asha AR, Robinson MA, Barton GJ: A marker based kinematic method of identifying initial contact during gait. Gait Posture 2012,36(3):650-652. 10.1016/j.gaitpost.2012.04.016CrossRefPubMed De Asha AR, Robinson MA, Barton GJ: A marker based kinematic method of identifying initial contact during gait. Gait Posture 2012,36(3):650-652. 10.1016/j.gaitpost.2012.04.016CrossRefPubMed
21.
go back to reference Zeni JA Jr, Richards JG, Higginson JS: Two simple methods for determining gait events during treadmill and overground walking using kinematic data. Gait Posture 2008, 27: 710-714. 10.1016/j.gaitpost.2007.07.007CrossRefPubMedPubMedCentral Zeni JA Jr, Richards JG, Higginson JS: Two simple methods for determining gait events during treadmill and overground walking using kinematic data. Gait Posture 2008, 27: 710-714. 10.1016/j.gaitpost.2007.07.007CrossRefPubMedPubMedCentral
22.
go back to reference Levine D, Richards J, Whittle MW: Whittle’s Gait Analysis. Churchill Livingstone: Elsevier; 2012. Levine D, Richards J, Whittle MW: Whittle’s Gait Analysis. Churchill Livingstone: Elsevier; 2012.
23.
go back to reference Barton GJ, De Asha AR, Geijtenbeek T, Robinson MA: Development of a Virtual Mirror Box for spatial and temporal manipulation of visual feedback on body movement during gait: A technical evaluation [abstract]. Gait Posture 2011,36(S1):76. Barton GJ, De Asha AR, Geijtenbeek T, Robinson MA: Development of a Virtual Mirror Box for spatial and temporal manipulation of visual feedback on body movement during gait: A technical evaluation [abstract]. Gait Posture 2011,36(S1):76.
24.
go back to reference Ustinova KI, Perkins J, Szostakowski L, Tamkei LS, Leonard WA: Effect of viewing angle on arm reaching while standing in a virtual environment: Potential for virtual rehabilitation. Acta Psychologica 2010, 133: 180-190. 10.1016/j.actpsy.2009.11.006CrossRefPubMed Ustinova KI, Perkins J, Szostakowski L, Tamkei LS, Leonard WA: Effect of viewing angle on arm reaching while standing in a virtual environment: Potential for virtual rehabilitation. Acta Psychologica 2010, 133: 180-190. 10.1016/j.actpsy.2009.11.006CrossRefPubMed
Metadata
Title
Manipulation of visual biofeedback during gait with a time delayed adaptive Virtual Mirror Box
Authors
Gabor J Barton
Alan R De Asha
Edwin CP van Loon
Thomas Geijtenbeek
Mark A Robinson
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2014
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/1743-0003-11-101

Other articles of this Issue 1/2014

Journal of NeuroEngineering and Rehabilitation 1/2014 Go to the issue