Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2018

Open Access 01-12-2018 | Research

The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis

Authors: Marko Markovic, Meike A. Schweisfurth, Leonard F. Engels, Tashina Bentz, Daniela Wüstefeld, Dario Farina, Strahinja Dosen

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2018

Login to get access

Abstract

Background

To effectively replace the human hand, a prosthesis should seamlessly respond to user intentions but also convey sensory information back to the user. Restoration of sensory feedback is rated highly by the prosthesis users, and feedback is critical for grasping in able-bodied subjects. Nonetheless, the benefits of feedback in prosthetics are still debated. The lack of consensus is likely due to the complex nature of sensory feedback during prosthesis control, so that its effectiveness depends on multiple factors (e.g., task complexity, user learning).

Methods

We evaluated the impact of these factors with a longitudinal assessment in six amputee subjects, using a clinical setup (socket, embedded control) and a range of tasks (box and blocks, block turn, clothespin and cups relocation). To provide feedback, we have proposed a novel vibrotactile stimulation scheme capable of transmitting multiple variables from a multifunction prosthesis. The subjects wore a bracelet with four by two uniformly placed vibro-tactors providing information on contact, prosthesis state (active function), and grasping force. The subjects also completed a questionnaire for the subjective evaluation of the feedback.

Results

The tests demonstrated that feedback was beneficial only in the complex tasks (block turn, clothespin and cups relocation), and that the training had an important, task-dependent impact. In the clothespin relocation and block turn tasks, training allowed the subjects to establish successful feedforward control, and therefore, the feedback became redundant. In the cups relocation task, however, the subjects needed some training to learn how to properly exploit the feedback. The subjective evaluation of the feedback was consistently positive, regardless of the objective benefits. These results underline the multifaceted nature of closed-loop prosthesis control as, depending on the context, the same feedback interface can have different impact on performance. Finally, even if the closed-loop control does not improve the performance, it could be beneficial as it seems to improve the subjective experience.

Conclusions

Therefore, in this study we demonstrate, for the first time, the relevance of an advanced, multi-variable feedback interface for dexterous, multi-functional prosthesis control in a clinically relevant setting.
Appendix
Available only for authorised users
Literature
1.
go back to reference Svensson P, Wijk U, Björkman A, Antfolk C. A review of invasive and non-invasive sensory feedback in upper limb prostheses. Expert Rev. Med. Devices [Internet]. Taylor & Francis; 2017;14. Available from: https://www.tandfonline.com/doi/full/10.1080/17434440.2017.1332989 Svensson P, Wijk U, Björkman A, Antfolk C. A review of invasive and non-invasive sensory feedback in upper limb prostheses. Expert Rev. Med. Devices [Internet]. Taylor & Francis; 2017;14. Available from: https://​www.​tandfonline.​com/​doi/​full/​10.​1080/​17434440.​2017.​1332989
4.
go back to reference Schmidl H. The importance of information feedback in prostheses for the upper limbs. Prosthetics Orthot Int. 1977;1:21–4. Schmidl H. The importance of information feedback in prostheses for the upper limbs. Prosthetics Orthot Int. 1977;1:21–4.
5.
go back to reference Castellini C, Artemiadis P, Wininger M, Ajoudani A, Alimusaj M, Bicchi A, et al. Proceedings of the first workshop on peripheral machine interfaces: going beyond traditional surface electromyography. Front Neurorobot. 2014;8:1–17.CrossRef Castellini C, Artemiadis P, Wininger M, Ajoudani A, Alimusaj M, Bicchi A, et al. Proceedings of the first workshop on peripheral machine interfaces: going beyond traditional surface electromyography. Front Neurorobot. 2014;8:1–17.CrossRef
6.
go back to reference Biddiss EA, Beaton D, Chau TT. Consumer design priorities for upper limb prosthetics. Disabil Rehabil Assist Technol [Internet]. Taylor & Francis; 2007;2:346–357. Available from: http://www.tandfonline.com/doi/abs/10.1080/17483100701714733 Biddiss EA, Beaton D, Chau TT. Consumer design priorities for upper limb prosthetics. Disabil Rehabil Assist Technol [Internet]. Taylor & Francis; 2007;2:346–357. Available from: http://​www.​tandfonline.​com/​doi/​abs/​10.​1080/​1748310070171473​3
8.
go back to reference Peerdeman B, Boere D, Witteveen H, Huis in `tveld R, Hermens H, Stramigioli S, et al. myoelectric forearm prostheses: state of the art from a user-centered perspective. J Rehabil Res Dev US Department of Veterans Affairs; 2011;48:719–737. Peerdeman B, Boere D, Witteveen H, Huis in `tveld R, Hermens H, Stramigioli S, et al. myoelectric forearm prostheses: state of the art from a user-centered perspective. J Rehabil Res Dev US Department of Veterans Affairs; 2011;48:719–737.
9.
go back to reference Lewis S, Russold MF, Dietl H, Kaniusas E. User demands for sensory feedback in upper extremity prostheses. MeMeA 2012 - 2012. IEEE Symp Med Meas Appl Proc. 2012:188–91. Lewis S, Russold MF, Dietl H, Kaniusas E. User demands for sensory feedback in upper extremity prostheses. MeMeA 2012 - 2012. IEEE Symp Med Meas Appl Proc. 2012:188–91.
12.
go back to reference Johansson RS, Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp Brain Res. 1984;56:550–64.CrossRefPubMed Johansson RS, Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp Brain Res. 1984;56:550–64.CrossRefPubMed
13.
go back to reference Childress DS. Closed-loop control in prosthetic systems: historical perspective. Ann Biomed Eng. 1980;8:293–303.CrossRefPubMed Childress DS. Closed-loop control in prosthetic systems: historical perspective. Ann Biomed Eng. 1980;8:293–303.CrossRefPubMed
14.
go back to reference Gonzelman J, Ellis H, Clayton O. Prosthetic device sensory attachment. US; 1953. Gonzelman J, Ellis H, Clayton O. Prosthetic device sensory attachment. US; 1953.
15.
go back to reference Ninu A, Dosen S, Muceli S, Rattay F, Dietl H, Farina D. Closed-loop control of grasping with a myoelectric hand prosthesis: which are the relevant feedback variables for force control? IEEE Trans. Neural Syst. Rehabil. Eng. 2014;22(5):1041–52. Ninu A, Dosen S, Muceli S, Rattay F, Dietl H, Farina D. Closed-loop control of grasping with a myoelectric hand prosthesis: which are the relevant feedback variables for force control? IEEE Trans. Neural Syst. Rehabil. Eng. 2014;22(5):1041–52.
17.
go back to reference Dosen S, Markovic M, Strbac M, Perovic M, Kojic V, Bijelic G, et al. Multichannel Electrotactile feedback with spatial and mixed coding for closed-loop control of grasping force in hand prostheses. IEEE trans. Neural Syst. Rehabil. Eng IEEE. 2016;25:183–95.CrossRef Dosen S, Markovic M, Strbac M, Perovic M, Kojic V, Bijelic G, et al. Multichannel Electrotactile feedback with spatial and mixed coding for closed-loop control of grasping force in hand prostheses. IEEE trans. Neural Syst. Rehabil. Eng IEEE. 2016;25:183–95.CrossRef
18.
go back to reference Erwin A, Sup FC. A haptic feedback scheme to accurately position a virtual wrist prosthesis using a three-node Tactor Array. PLoS One. 2015;10 Erwin A, Sup FC. A haptic feedback scheme to accurately position a virtual wrist prosthesis using a three-node Tactor Array. PLoS One. 2015;10
19.
go back to reference Witteveen HJB, Rietman HS, Veltink PH. Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users. Prosthetics Orthot Int. 2015;39:204–12.CrossRef Witteveen HJB, Rietman HS, Veltink PH. Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users. Prosthetics Orthot Int. 2015;39:204–12.CrossRef
20.
go back to reference Damian DD, Arita AH, Martinez H, Pfeifer R. Slip speed feedback for grip force control. IEEE Trans Biomed Eng. 2012;59:2200–10.CrossRefPubMed Damian DD, Arita AH, Martinez H, Pfeifer R. Slip speed feedback for grip force control. IEEE Trans Biomed Eng. 2012;59:2200–10.CrossRefPubMed
21.
go back to reference Walker JM, Blank AA, Shewokis PA, Omalley MK. Tactile feedback of object slip facilitates virtual object manipulation. IEEE Trans Haptics. 2015;8:454–66.CrossRefPubMed Walker JM, Blank AA, Shewokis PA, Omalley MK. Tactile feedback of object slip facilitates virtual object manipulation. IEEE Trans Haptics. 2015;8:454–66.CrossRefPubMed
22.
go back to reference Chatterjee A, Chaubey P, Martin J, Thakor N. Testing a prosthetic haptic feedback simulator with an interactive force matching task. JPO J Prosthetics Orthot. 2008;20:27–34.CrossRef Chatterjee A, Chaubey P, Martin J, Thakor N. Testing a prosthetic haptic feedback simulator with an interactive force matching task. JPO J Prosthetics Orthot. 2008;20:27–34.CrossRef
23.
go back to reference Zafar M, Van Doren CL. Effectiveness of supplemental grasp-force feedback in the presence of vision. Med Biol Eng Comput. 2000;38:267–74.CrossRefPubMed Zafar M, Van Doren CL. Effectiveness of supplemental grasp-force feedback in the presence of vision. Med Biol Eng Comput. 2000;38:267–74.CrossRefPubMed
24.
go back to reference Clemente F, D’Alonzo M, Controzzi M, Edin B, Non-invasive CC. Temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses. IEEE Trans. Neural Syst. Rehabil. Eng. 2015:1–1. Clemente F, D’Alonzo M, Controzzi M, Edin B, Non-invasive CC. Temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses. IEEE Trans. Neural Syst. Rehabil. Eng. 2015:1–1.
25.
go back to reference Cipriani C, Zaccone F, Micera S, Carrozza MC. On the shared control of an EMG-controlled prosthetic hand: analysis of user-prosthesis interaction. IEEE trans. Robot. IEEE. 2008;24:170–84. Cipriani C, Zaccone F, Micera S, Carrozza MC. On the shared control of an EMG-controlled prosthetic hand: analysis of user-prosthesis interaction. IEEE trans. Robot. IEEE. 2008;24:170–84.
27.
go back to reference Chatterjee A, Chaubey P, Martin J, Thakor N V. Quantifying prosthesis control improvements using a vibrotactile representation of grip force. 2008 IEEE Reg. 5 Conf. 2008; Chatterjee A, Chaubey P, Martin J, Thakor N V. Quantifying prosthesis control improvements using a vibrotactile representation of grip force. 2008 IEEE Reg. 5 Conf. 2008;
28.
go back to reference Bouwsema H, Van Der Sluis CK, Bongers RM. Effect of feedback during virtual training of grip force control with a myoelectric prosthesis. PLoS One. 2014;9 Bouwsema H, Van Der Sluis CK, Bongers RM. Effect of feedback during virtual training of grip force control with a myoelectric prosthesis. PLoS One. 2014;9
29.
go back to reference Raveh E, Friedman J, Portnoy S. Visuomotor behaviors and performance in a dual-task paradigm with and without vibrotactile feedback when using a myoelectric controlled hand. Assist Technol. 2017:1–7. Raveh E, Friedman J, Portnoy S. Visuomotor behaviors and performance in a dual-task paradigm with and without vibrotactile feedback when using a myoelectric controlled hand. Assist Technol. 2017:1–7.
30.
go back to reference Johansson RS, Cole KJ. Sensory-motor coordination during grasping and manipulative actions. Curr Opin Neurobiol. 1992;2:815–23.CrossRefPubMed Johansson RS, Cole KJ. Sensory-motor coordination during grasping and manipulative actions. Curr Opin Neurobiol. 1992;2:815–23.CrossRefPubMed
31.
go back to reference Saunders I, Vijayakumar S. The role of feed-forward and feedback processes for closed-loop prosthesis control. J Neuroeng Rehabil BioMed Central Ltd. 2011;8:60.CrossRef Saunders I, Vijayakumar S. The role of feed-forward and feedback processes for closed-loop prosthesis control. J Neuroeng Rehabil BioMed Central Ltd. 2011;8:60.CrossRef
32.
go back to reference Rothwell JC, Traub MM, Day BL, Obeso JA, Thomas PK, Marsden CD. Manual motor performance in a deafferented man. Brain. 1982:515–42. Rothwell JC, Traub MM, Day BL, Obeso JA, Thomas PK, Marsden CD. Manual motor performance in a deafferented man. Brain. 1982:515–42.
33.
go back to reference Davidson PR, Wolpert DM. Widespread access to predictive models in the motor system: a short review. J Neural Eng. 2005;2:S313–9.CrossRefPubMed Davidson PR, Wolpert DM. Widespread access to predictive models in the motor system: a short review. J Neural Eng. 2005;2:S313–9.CrossRefPubMed
34.
go back to reference Lum PS, Black I, Holley RJ, Barth J, Dromerick AW. Internal models of upper limb prosthesis users when grasping and lifting a fragile object with their prosthetic limb. Exp Brain Res. 2014; Lum PS, Black I, Holley RJ, Barth J, Dromerick AW. Internal models of upper limb prosthesis users when grasping and lifting a fragile object with their prosthetic limb. Exp Brain Res. 2014;
35.
go back to reference Dosen S, Markovic M, Wille N, Henkel M, Koppe M, Ninu A, et al. Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping. Exp. brain res. Springer Berlin Heidelberg; 2015;233:1855–1865. Dosen S, Markovic M, Wille N, Henkel M, Koppe M, Ninu A, et al. Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping. Exp. brain res. Springer Berlin Heidelberg; 2015;233:1855–1865.
36.
go back to reference Johnson RE, Kording KP, Hargrove LJ, Sensinger JW. Adaptation to random and systematic errors: comparison of amputee and non-amputee control interfaces with varying levels of process noise. PLoS One. 2017;12:1–19. Johnson RE, Kording KP, Hargrove LJ, Sensinger JW. Adaptation to random and systematic errors: comparison of amputee and non-amputee control interfaces with varying levels of process noise. PLoS One. 2017;12:1–19.
37.
go back to reference Johnson RE, Kording KP, Hargrove LJ, Sensinger JW. Does EMG control lead to distinct motor adaptation? Front Neurosci. 2014;8:1–6.CrossRef Johnson RE, Kording KP, Hargrove LJ, Sensinger JW. Does EMG control lead to distinct motor adaptation? Front Neurosci. 2014;8:1–6.CrossRef
38.
go back to reference Strbac M, Isakovic M, Belic M, Popovic I, Simanic I, Farina D, et al. Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees. IEEE Trans. Neural Syst. Rehabil. Eng. [Internet]. 2017;4320:1. Available from: http://ieeexplore.ieee.org/document/7940016/ Strbac M, Isakovic M, Belic M, Popovic I, Simanic I, Farina D, et al. Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees. IEEE Trans. Neural Syst. Rehabil. Eng. [Internet]. 2017;4320:1. Available from: http://​ieeexplore.​ieee.​org/​document/​7940016/​
39.
go back to reference Scott RN, Parker PA. Myoelectric Prostheses : State of the Art. J. Med. Eng. Technol. [Internet]. 1988;12:143–151. Available from: http://www.tandfonline.com/doi/abs/10.3109/03091908809030173?needAccess=true&journalCode=ijmt20 Scott RN, Parker PA. Myoelectric Prostheses : State of the Art. J. Med. Eng. Technol. [Internet]. 1988;12:143–151. Available from: http://​www.​tandfonline.​com/​doi/​abs/​10.​3109/​0309190880903017​3?​needAccess=​true&​journalCode=​ijmt20
42.
go back to reference Stepp CE, Matsuoka Y. Object manipulation improvements due to single session training outweigh the differences among stimulation sites during vibrotactile feedback. IEEE Trans Neural Syst Rehabil Eng. 2011;19:677–85.CrossRefPubMedPubMedCentral Stepp CE, Matsuoka Y. Object manipulation improvements due to single session training outweigh the differences among stimulation sites during vibrotactile feedback. IEEE Trans Neural Syst Rehabil Eng. 2011;19:677–85.CrossRefPubMedPubMedCentral
44.
go back to reference Panarese A, Edin BB, Vecchi F, Carrozza MC, Johansson RS. Humans can integrate force feedback to toes in their sensorimotor control of a robotic hand. IEEE Trans. Neural Syst. Rehabil. Eng. 2009;17:560–7.CrossRefPubMed Panarese A, Edin BB, Vecchi F, Carrozza MC, Johansson RS. Humans can integrate force feedback to toes in their sensorimotor control of a robotic hand. IEEE Trans. Neural Syst. Rehabil. Eng. 2009;17:560–7.CrossRefPubMed
45.
go back to reference Verrillo RT. Vibration sensation in humans. Music percept. An Interdiscip. J University of California Press. 1992;9:281–302. Verrillo RT. Vibration sensation in humans. Music percept. An Interdiscip. J University of California Press. 1992;9:281–302.
47.
go back to reference Clemente F, D’Alonzo M, Controzzi M, Edin B, Non-invasive CC. Temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses. IEEE Trans Neural Syst Rehabil Eng. 2015;4320 Clemente F, D’Alonzo M, Controzzi M, Edin B, Non-invasive CC. Temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses. IEEE Trans Neural Syst Rehabil Eng. 2015;4320
48.
go back to reference Shannon GF. A comparison of alternative means of providing sensory feedback on upper limb prostheses. Med Biol Eng. 1976;14:289–94.CrossRefPubMed Shannon GF. A comparison of alternative means of providing sensory feedback on upper limb prostheses. Med Biol Eng. 1976;14:289–94.CrossRefPubMed
49.
go back to reference Dosen S, Markovic M, Hartmann C, Farina D. Sensory feedback in prosthetics: a standardized test bench for closed-loop control. IEEE trans. Neural Syst. Rehabil. Eng. IEEE. 2015;23:267–76. Dosen S, Markovic M, Hartmann C, Farina D. Sensory feedback in prosthetics: a standardized test bench for closed-loop control. IEEE trans. Neural Syst. Rehabil. Eng. IEEE. 2015;23:267–76.
50.
go back to reference Cromwell FS. Occupational therapist’s manual for basic skills assessment or primary pre-vocational evaluation [internet]. Pasadena: Fair Oaks Print. Co.; 1960. Available from: https://openlibrary.org/books/OL14678039M/Occupational_therapist%27s_manual_for_basic_skills_assessment_or_primary_pre-vocational_evaluation. Cromwell FS. Occupational therapist’s manual for basic skills assessment or primary pre-vocational evaluation [internet]. Pasadena: Fair Oaks Print. Co.; 1960. Available from: https://​openlibrary.​org/​books/​OL14678039M/​Occupational_​therapist%27s_manual_for_basic_skills_assessment_or_primary_pre-vocational_evaluation.
51.
go back to reference Amsuess S, Gobel P, Graimann B, Farina DA. Multi-class proportional Myocontrol algorithm for upper limb prosthesis control: validation in real-life scenarios on amputees. IEEE Trans. Neural Syst. Rehabil. Eng. 2014;23:827–36.CrossRefPubMed Amsuess S, Gobel P, Graimann B, Farina DA. Multi-class proportional Myocontrol algorithm for upper limb prosthesis control: validation in real-life scenarios on amputees. IEEE Trans. Neural Syst. Rehabil. Eng. 2014;23:827–36.CrossRefPubMed
52.
go back to reference Kuiken TA, Dumanian GA, Lipschutz RD, Miller LA, Stubblefield KA. The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee. Prosthet. Orthot. Int. [Internet]. 2004 [cited 2016 Jan 6];28:245–253. Available from: http://www.ncbi.nlm.nih.gov/pubmed/15658637 Kuiken TA, Dumanian GA, Lipschutz RD, Miller LA, Stubblefield KA. The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee. Prosthet. Orthot. Int. [Internet]. 2004 [cited 2016 Jan 6];28:245–253. Available from: http://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​15658637
53.
go back to reference Markovic M, Karnal H, Graimann B, Farina D, Dosen SGLIMPSE. Google glass interface for sensory feedback in myoelectric hand prostheses. J Neural Eng IOP Publishing. 2017;14:36007.CrossRef Markovic M, Karnal H, Graimann B, Farina D, Dosen SGLIMPSE. Google glass interface for sensory feedback in myoelectric hand prostheses. J Neural Eng IOP Publishing. 2017;14:36007.CrossRef
54.
go back to reference Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv. Psychol. Elsevier; 1988. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv. Psychol. Elsevier; 1988.
55.
go back to reference Patel GK, Dosen S, Castellini C. Farina D. Multichannel electrotactile feedback for simultaneous and proportional myoelectric control. J. Neural Eng. IOP Publishing. 2016;13:56015.CrossRef Patel GK, Dosen S, Castellini C. Farina D. Multichannel electrotactile feedback for simultaneous and proportional myoelectric control. J. Neural Eng. IOP Publishing. 2016;13:56015.CrossRef
56.
go back to reference Giummarra MJ, Gibson SJ, Georgiou-Karistianis N, Bradshaw JL. Mechanisms underlying embodiment, disembodiment and loss of embodiment. Neurosci Biobehav Rev. 2008;32:143–60.CrossRefPubMed Giummarra MJ, Gibson SJ, Georgiou-Karistianis N, Bradshaw JL. Mechanisms underlying embodiment, disembodiment and loss of embodiment. Neurosci Biobehav Rev. 2008;32:143–60.CrossRefPubMed
Metadata
Title
The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis
Authors
Marko Markovic
Meike A. Schweisfurth
Leonard F. Engels
Tashina Bentz
Daniela Wüstefeld
Dario Farina
Strahinja Dosen
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2018
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-018-0371-1

Other articles of this Issue 1/2018

Journal of NeuroEngineering and Rehabilitation 1/2018 Go to the issue