Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2014

Open Access 01-12-2014 | Research

A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure

Authors: Sophie M Wurth, Levi J Hargrove

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2014

Login to get access

Abstract

Background

Pattern recognition (PR) based strategies for the control of myoelectric upper limb prostheses are generally evaluated through offline classification accuracy, which is an admittedly useful metric, but insufficient to discuss functional performance in real time. Existing functional tests are extensive to set up and most fail to provide a challenging, objective framework to assess the strategy performance in real time.

Methods

Nine able-bodied and two amputee subjects gave informed consent and participated in the local Institutional Review Board approved study. We designed a two-dimensional target acquisition task, based on the principles of Fitts’ law for human motor control. Subjects were prompted to steer a cursor from the screen center of into a series of subsequently appearing targets of different difficulties. Three cursor control systems were tested, corresponding to three electromyography-based prosthetic control strategies: 1) amplitude-based direct control (the clinical standard of care), 2) sequential PR control, and 3) simultaneous PR control, allowing for a concurrent activation of two degrees of freedom (DOF). We computed throughput (bits/second), path efficiency (%), reaction time (second), and overshoot (%)) and used general linear models to assess significant differences between the strategies for each metric.

Results

We validated the proposed methodology by achieving very high coefficients of determination for Fitts’ law. Both PR strategies significantly outperformed direct control in two-DOF targets and were more intuitive to operate. In one-DOF targets, the simultaneous approach was the least precise. The direct control was efficient in one-DOF targets but cumbersome to operate in two-DOF targets through a switch-depended sequential cursor control.

Conclusions

We designed a test, capable of comprehensively describing prosthetic control strategies in real time. When implemented on control subjects, the test was able to capture statistically significant differences (p < 0.05) in control strategies when considering throughputs, path efficiencies and reaction times. Of particular note, we found statistically significant (p < 0.01) improvements in throughputs and path efficiencies with simultaneous PR when compared to direct control or sequential PR. Amputees could readily achieve the task; however a limited number of subjects was tested and a statistical analysis was not performed with that population.
Literature
1.
go back to reference Belter JT, Segil JL, Dollar AM, Weir RF: Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. J Rehabil Res Dev 2013, 50: 599-618. 10.1682/JRRD.2011.10.0188CrossRefPubMed Belter JT, Segil JL, Dollar AM, Weir RF: Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review. J Rehabil Res Dev 2013, 50: 599-618. 10.1682/JRRD.2011.10.0188CrossRefPubMed
2.
go back to reference Scheme E, Englehart K: Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. J Rehabil Res Dev 2011, 48: 643-659. 10.1682/JRRD.2010.09.0177CrossRefPubMed Scheme E, Englehart K: Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. J Rehabil Res Dev 2011, 48: 643-659. 10.1682/JRRD.2010.09.0177CrossRefPubMed
3.
go back to reference Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, Englehart KB: Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA 2009, 301: 619-628. 10.1001/jama.2009.116CrossRefPubMedPubMedCentral Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, Englehart KB: Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA 2009, 301: 619-628. 10.1001/jama.2009.116CrossRefPubMedPubMedCentral
4.
go back to reference Parker PA, Scott R: Myoelectric control of prostheses. Crit Rev Biomed Eng 1985, 13: 283-310. Parker PA, Scott R: Myoelectric control of prostheses. Crit Rev Biomed Eng 1985, 13: 283-310.
5.
go back to reference Williams TW III: Practical methods for controlling powered upper-extremity prostheses. Assist Technol 1990, 2: 3-18. 10.1080/10400435.1990.10132142CrossRefPubMed Williams TW III: Practical methods for controlling powered upper-extremity prostheses. Assist Technol 1990, 2: 3-18. 10.1080/10400435.1990.10132142CrossRefPubMed
6.
go back to reference Dorcas D, Scott R: A three-state myo-electric control. Med Biol Eng 1966, 4: 367-370. 10.1007/BF02476154CrossRefPubMed Dorcas D, Scott R: A three-state myo-electric control. Med Biol Eng 1966, 4: 367-370. 10.1007/BF02476154CrossRefPubMed
7.
go back to reference Graupe D, Salahi J, Kohn KH: Multifunctional prosthesis and orthosis control via microcomputer identification of temporal pattern differences in single-site myoelectric signals. J Biomed Eng 1982, 4: 17-22. 10.1016/0141-5425(82)90021-8CrossRefPubMed Graupe D, Salahi J, Kohn KH: Multifunctional prosthesis and orthosis control via microcomputer identification of temporal pattern differences in single-site myoelectric signals. J Biomed Eng 1982, 4: 17-22. 10.1016/0141-5425(82)90021-8CrossRefPubMed
8.
go back to reference Zecca M, Micera S, Carrozza M, Dario P: Control of multifunctional prosthetic hands by processing the electromyographic signal. Crit Rev ™ in Biomed Eng 2002, 30: 459-485. 10.1615/CritRevBiomedEng.v30.i456.80CrossRef Zecca M, Micera S, Carrozza M, Dario P: Control of multifunctional prosthetic hands by processing the electromyographic signal. Crit Rev ™ in Biomed Eng 2002, 30: 459-485. 10.1615/CritRevBiomedEng.v30.i456.80CrossRef
9.
go back to reference Parker P, Englehart K, Hudgins B: Myoelectric signal processing for control of powered limb prostheses. J Electromyogr Kinesiol 2006, 16: 541-548. 10.1016/j.jelekin.2006.08.006CrossRefPubMed Parker P, Englehart K, Hudgins B: Myoelectric signal processing for control of powered limb prostheses. J Electromyogr Kinesiol 2006, 16: 541-548. 10.1016/j.jelekin.2006.08.006CrossRefPubMed
10.
go back to reference Englehart K, Hudgins B: A robust, real-time control scheme for multifunction myoelectric control. Biomed Eng, IEEE Trans on 2003, 50: 848-854. 10.1109/TBME.2003.813539CrossRef Englehart K, Hudgins B: A robust, real-time control scheme for multifunction myoelectric control. Biomed Eng, IEEE Trans on 2003, 50: 848-854. 10.1109/TBME.2003.813539CrossRef
11.
go back to reference Ajiboye AB, Weir RF: A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. Neural Syst Rehabil Eng, IEEE Trans on 2005, 13: 280-291. 10.1109/TNSRE.2005.847357CrossRef Ajiboye AB, Weir RF: A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. Neural Syst Rehabil Eng, IEEE Trans on 2005, 13: 280-291. 10.1109/TNSRE.2005.847357CrossRef
12.
go back to reference Kuiken T, Dumanian G, Lipschutz R, Miller L, Stubblefield K: The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee. Prosthetics Orthot Int 2004, 28: 245-253. Kuiken T, Dumanian G, Lipschutz R, Miller L, Stubblefield K: The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee. Prosthetics Orthot Int 2004, 28: 245-253.
13.
go back to reference Kamavuako EN, Englehart KB, Jensen W, Farina D: Simultaneous and proportional force estimation in multiple degrees of freedom from intramuscular EMG. Biomedl Eng, IEEE Trans on 2012, 59: 1804-1807.CrossRef Kamavuako EN, Englehart KB, Jensen W, Farina D: Simultaneous and proportional force estimation in multiple degrees of freedom from intramuscular EMG. Biomedl Eng, IEEE Trans on 2012, 59: 1804-1807.CrossRef
14.
go back to reference Muceli S, Farina D: Simultaneous and proportional estimation of hand kinematics from EMG during mirrored movements at multiple degrees-of-freedom. Neural Sys Rehabil Eng, IEEE Trans on 2012, 20: 371-378.CrossRef Muceli S, Farina D: Simultaneous and proportional estimation of hand kinematics from EMG during mirrored movements at multiple degrees-of-freedom. Neural Sys Rehabil Eng, IEEE Trans on 2012, 20: 371-378.CrossRef
15.
go back to reference Cipriani C, Antfolk C, Controzzi M, Lundborg G, Rosén B, Carrozza MC, Sebelius F: Online myoelectric control of a dexterous hand prosthesis by transradial amputees. Neural Syst Rehabil Eng, IEEE Trans on 2011, 19: 260-270.CrossRef Cipriani C, Antfolk C, Controzzi M, Lundborg G, Rosén B, Carrozza MC, Sebelius F: Online myoelectric control of a dexterous hand prosthesis by transradial amputees. Neural Syst Rehabil Eng, IEEE Trans on 2011, 19: 260-270.CrossRef
16.
go back to reference Young AJ, Smith LH, Rouse EJ, Hargrove LJ: Classification of simultaneous movements using surface EMG pattern recognition. Biomed Eng, IEEE Trans on 2013, 60: 1250-1258.CrossRef Young AJ, Smith LH, Rouse EJ, Hargrove LJ: Classification of simultaneous movements using surface EMG pattern recognition. Biomed Eng, IEEE Trans on 2013, 60: 1250-1258.CrossRef
17.
go back to reference Baker JJ, Scheme E, Englehart K, Hutchinson DT, Greger B: Continuous detection and decoding of dexterous finger flexions with implantable myoelectric sensors. Neural Syst Rehabil Eng, IEEE Trans on 2010, 18: 424-432.CrossRef Baker JJ, Scheme E, Englehart K, Hutchinson DT, Greger B: Continuous detection and decoding of dexterous finger flexions with implantable myoelectric sensors. Neural Syst Rehabil Eng, IEEE Trans on 2010, 18: 424-432.CrossRef
18.
go back to reference Jiang N, Rehbaum H, Vujaklija I, Graimann B, Farina D: Intuitive, Online, simultaneous and proportional myoelectric control over two degrees of freedom in upper limb amputees. Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 501-510.CrossRef Jiang N, Rehbaum H, Vujaklija I, Graimann B, Farina D: Intuitive, Online, simultaneous and proportional myoelectric control over two degrees of freedom in upper limb amputees. Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 501-510.CrossRef
19.
go back to reference Jiang N, Vujaklija I, Rehbaum H, Graimann B, Farina D: Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 549-558.CrossRef Jiang N, Vujaklija I, Rehbaum H, Graimann B, Farina D: Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 549-558.CrossRef
20.
go back to reference Young AJ, Smith LH, Rouse EJ, Hargrove LJ: A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements. J Neuroeng Rehabil 2014, 11: 34-44. 10.1186/1743-0003-11-34CrossRef Young AJ, Smith LH, Rouse EJ, Hargrove LJ: A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements. J Neuroeng Rehabil 2014, 11: 34-44. 10.1186/1743-0003-11-34CrossRef
21.
go back to reference Hargrove LJ, Englehart K, Hudgins B: A comparison of surface and intramuscular myoelectric signal classification. Biomed Eng, IEEE Trans on 2007, 54: 847-853.CrossRef Hargrove LJ, Englehart K, Hudgins B: A comparison of surface and intramuscular myoelectric signal classification. Biomed Eng, IEEE Trans on 2007, 54: 847-853.CrossRef
22.
go back to reference Simon AM, Hargrove LJ, Lock BA, Kuiken TA: Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. J Rehabil Res Dev 2011, 48: 619-627. 10.1682/JRRD.2010.08.0149CrossRefPubMedPubMedCentral Simon AM, Hargrove LJ, Lock BA, Kuiken TA: Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. J Rehabil Res Dev 2011, 48: 619-627. 10.1682/JRRD.2010.08.0149CrossRefPubMedPubMedCentral
23.
go back to reference Fitts PM: The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol 1954, 47: 381-391.CrossRefPubMed Fitts PM: The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol 1954, 47: 381-391.CrossRefPubMed
24.
go back to reference Soukoreff RW, MacKenzie IS: Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. Int J Human-Computer Studies 2004, 61: 751-789. 10.1016/j.ijhcs.2004.09.001CrossRef Soukoreff RW, MacKenzie IS: Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. Int J Human-Computer Studies 2004, 61: 751-789. 10.1016/j.ijhcs.2004.09.001CrossRef
25.
go back to reference Williams MR, Kirsch RF: Evaluation of head orientation and neck muscle EMG signals as command inputs to a human–computer interface for individuals with high tetraplegia. Neural Syst Rehabil Eng, IEEE Trans on 2008, 16: 485-496.CrossRef Williams MR, Kirsch RF: Evaluation of head orientation and neck muscle EMG signals as command inputs to a human–computer interface for individuals with high tetraplegia. Neural Syst Rehabil Eng, IEEE Trans on 2008, 16: 485-496.CrossRef
26.
go back to reference Scheme EJ, Englehart KB: Validation of a selective ensemble-based classification scheme for myoelectric control using a three-dimensional Fitts’ law test. Neural Syst Rehabil Eng, IEEE Trans on 2013, 21: 616-623.CrossRef Scheme EJ, Englehart KB: Validation of a selective ensemble-based classification scheme for myoelectric control using a three-dimensional Fitts’ law test. Neural Syst Rehabil Eng, IEEE Trans on 2013, 21: 616-623.CrossRef
27.
go back to reference Young AJ, Hargrove LJ, Kuiken TA: Improving myoelectric pattern recognition robustness to electrode shift by changing interelectrode distance and electrode configuration. Biomed Eng, IEEE Trans on 2012, 59: 645-652.CrossRef Young AJ, Hargrove LJ, Kuiken TA: Improving myoelectric pattern recognition robustness to electrode shift by changing interelectrode distance and electrode configuration. Biomed Eng, IEEE Trans on 2012, 59: 645-652.CrossRef
28.
go back to reference Hudgins B, Parker P, Scott RN: A new strategy for multifunction myoelectric control. Biomed Eng, IEEE Trans on 1993, 40: 82-94. 10.1109/10.204774CrossRef Hudgins B, Parker P, Scott RN: A new strategy for multifunction myoelectric control. Biomed Eng, IEEE Trans on 1993, 40: 82-94. 10.1109/10.204774CrossRef
29.
go back to reference Graupe D, Salahi J, Zhang D: Stochastic analysis of myoelectric temporal signatures for multifunctional single-site activation of prostheses and orthoses. J Biomed Eng 1985, 7: 18-29. 10.1016/0141-5425(85)90004-4CrossRefPubMed Graupe D, Salahi J, Zhang D: Stochastic analysis of myoelectric temporal signatures for multifunctional single-site activation of prostheses and orthoses. J Biomed Eng 1985, 7: 18-29. 10.1016/0141-5425(85)90004-4CrossRefPubMed
30.
go back to reference Smith LH, Hargrove LJ, Lock BA, Kuiken TA: Determining the optimal window length for pattern recognition-based myoelectric control: Balancing the competing effects of classification error and controller delay. Neural Syst Rehabil Eng, IEEE Trans on 2011, 19: 186-192.CrossRef Smith LH, Hargrove LJ, Lock BA, Kuiken TA: Determining the optimal window length for pattern recognition-based myoelectric control: Balancing the competing effects of classification error and controller delay. Neural Syst Rehabil Eng, IEEE Trans on 2011, 19: 186-192.CrossRef
31.
go back to reference Scheme E, Lock B, Hargrove L, Hill W, Kuraganti U, Englehart K: Motion Normalized Proportional Control for Improved Pattern Recognition Based Myoelectric Control. Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 149-157.CrossRef Scheme E, Lock B, Hargrove L, Hill W, Kuraganti U, Englehart K: Motion Normalized Proportional Control for Improved Pattern Recognition Based Myoelectric Control. Neural Syst Rehabil Eng, IEEE Trans on 2013, 22: 149-157.CrossRef
32.
go back to reference Simon AM, Hargrove LJ, Lock BA, Kuiken TA: A decision-based velocity ramp for minimizing the effect of misclassifications during real-time pattern recognition control. Biomed Eng, IEEE Trans on 2011, 58: 2360-2368.CrossRef Simon AM, Hargrove LJ, Lock BA, Kuiken TA: A decision-based velocity ramp for minimizing the effect of misclassifications during real-time pattern recognition control. Biomed Eng, IEEE Trans on 2011, 58: 2360-2368.CrossRef
33.
go back to reference Wurth SM, Hargrove LJ: Real-time comparison of conventional direct control and pattern recognition myoelectric control in a two-dimensional Fitts’ law style test. In Eng Med Biol Soc (EMBC), 2013 35th Annual Int Conf the IEEE 2013, 3630-3633.CrossRef Wurth SM, Hargrove LJ: Real-time comparison of conventional direct control and pattern recognition myoelectric control in a two-dimensional Fitts’ law style test. In Eng Med Biol Soc (EMBC), 2013 35th Annual Int Conf the IEEE 2013, 3630-3633.CrossRef
Metadata
Title
A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure
Authors
Sophie M Wurth
Levi J Hargrove
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2014
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/1743-0003-11-91

Other articles of this Issue 1/2014

Journal of NeuroEngineering and Rehabilitation 1/2014 Go to the issue