Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2015

Open Access 01-12-2015 | Research

A real-time, practical sensor fault-tolerant module for robust EMG pattern recognition

Authors: Xiaorong Zhang, He Huang

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2015

Login to get access

Abstract

Background

Unreliability of surface EMG recordings over time is a challenge for applying the EMG pattern recognition (PR)-controlled prostheses in clinical practice. Our previous study proposed a sensor fault-tolerant module (SFTM) by utilizing redundant information in multiple EMG signals. The SFTM consists of multiple sensor fault detectors and a self-recovery mechanism that can identify anomaly in EMG signals and remove the recordings of the disturbed signals from the input of the pattern classifier to recover the PR performance. While the proposed SFTM has shown great promise, the previous design is impractical. A practical SFTM has to be fast enough, lightweight, automatic, and robust under different conditions with or without disturbances.

Methods

This paper presented a real-time, practical SFTM towards robust EMG PR. A novel fast LDA retraining algorithm and a fully automatic sensor fault detector based on outlier detection were developed, which allowed the SFTM to promptly detect disturbances and recover the PR performance immediately. These components of SFTM were then integrated with the EMG PR module and tested on five able-bodied subjects and a transradial amputee in real-time for classifying multiple hand and wrist motions under different conditions with different disturbance types and levels.

Results

The proposed fast LDA retraining algorithm significantly shortened the retraining time from nearly 1 s to less than 4 ms when tested on the embedded system prototype, which demonstrated the feasibility of a nearly “zero-delay” SFTM that is imperceptible to the users. The results of the real-time tests suggested that the SFTM was able to handle different types of disturbances investigated in this study and significantly improve the classification performance when one or multiple EMG signals were disturbed. In addition, the SFTM could also maintain the system’s classification performance when there was no disturbance.

Conclusions

This paper presented a real-time, lightweight, and automatic SFTM, which paved the way for reliable and robust EMG PR for prosthesis control.
Literature
1.
go back to reference Hudgins B, Parker P, Scott RN. A new strategy for multifunction myoelectric control. IEEE Trans Biomed Eng. 1993;40:82–94.CrossRefPubMed Hudgins B, Parker P, Scott RN. A new strategy for multifunction myoelectric control. IEEE Trans Biomed Eng. 1993;40:82–94.CrossRefPubMed
2.
go back to reference Englehart K, Hudgins B, Parker PA, Stevenson M. Classification of the myoelectric signal using time-frequency based representations. Med Eng Phys. 1999;21:431–8.CrossRefPubMed Englehart K, Hudgins B, Parker PA, Stevenson M. Classification of the myoelectric signal using time-frequency based representations. Med Eng Phys. 1999;21:431–8.CrossRefPubMed
3.
go back to reference Englehart K, Hudgins B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Trans Biomed Eng. 2003;50:848–54.CrossRefPubMed Englehart K, Hudgins B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Trans Biomed Eng. 2003;50:848–54.CrossRefPubMed
4.
go back to reference Ajiboye AB, Weir RF. A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. IEEE Trans Neural Syst Rehabil Eng. 2005;13:280–91.CrossRefPubMed Ajiboye AB, Weir RF. A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. IEEE Trans Neural Syst Rehabil Eng. 2005;13:280–91.CrossRefPubMed
5.
go back to reference Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, et al. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. J Am Med Assoc. 2009;301:619–28.CrossRef Kuiken TA, Li G, Lock BA, Lipschutz RD, Miller LA, Stubblefield KA, et al. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. J Am Med Assoc. 2009;301:619–28.CrossRef
6.
7.
go back to reference Parker P, Englehart K, Hudgins B. Myoelectric signal processing for control of powered limb prostheses. J Eectromyography Kinesiol. 2006;16:541–610.CrossRef Parker P, Englehart K, Hudgins B. Myoelectric signal processing for control of powered limb prostheses. J Eectromyography Kinesiol. 2006;16:541–610.CrossRef
8.
go back to reference Hargrove LJ, Englehart K, Hudgins B. A comparison of surface and intramuscular myoelectric signal classification. IEEE Trans Biomed Eng. 2007;54:847–53.CrossRefPubMed Hargrove LJ, Englehart K, Hudgins B. A comparison of surface and intramuscular myoelectric signal classification. IEEE Trans Biomed Eng. 2007;54:847–53.CrossRefPubMed
9.
go back to reference Sensinger JW, Lock BA, Kuiken TA. Adaptive pattern recognition of myoelectric signals: exploration of conceptual framework and practical algorithms. IEEE Trans Neural Syst Rehabil Eng. 2009;17:270–8.CrossRefPubMedCentralPubMed Sensinger JW, Lock BA, Kuiken TA. Adaptive pattern recognition of myoelectric signals: exploration of conceptual framework and practical algorithms. IEEE Trans Neural Syst Rehabil Eng. 2009;17:270–8.CrossRefPubMedCentralPubMed
10.
go back to reference De Luca CJ, Donald Gilmore L, Kuznetsov M, Roy SH. Filtering the surface EMG signal: movement artifact and baseline noise contamination. J Biomech. 2010;43:1573–9.CrossRefPubMed De Luca CJ, Donald Gilmore L, Kuznetsov M, Roy SH. Filtering the surface EMG signal: movement artifact and baseline noise contamination. J Biomech. 2010;43:1573–9.CrossRefPubMed
11.
go back to reference Chowdhury RH, Reaz MB, Ali MABM, Bakar AA, Chellappan K, Chang TG. Surface electromyography signal processing and classification techniques. Sensors. 2013;13:12431–66.CrossRefPubMedCentralPubMed Chowdhury RH, Reaz MB, Ali MABM, Bakar AA, Chellappan K, Chang TG. Surface electromyography signal processing and classification techniques. Sensors. 2013;13:12431–66.CrossRefPubMedCentralPubMed
12.
go back to reference Hargrove L, Englehart K, Hudgins B. A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control. Biomed Signal Process Control. 2008;3:175–80.CrossRef Hargrove L, Englehart K, Hudgins B. A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control. Biomed Signal Process Control. 2008;3:175–80.CrossRef
13.
go back to reference Young AJ, Hargrove LJ, Kuiken TA. The effects of electrode size and orientation on the sensitivity of myoelectric pattern recognition systems to electrode shift. IEEE Trans Biomed Eng. 2011;58:2537–44.CrossRefPubMedCentralPubMed Young AJ, Hargrove LJ, Kuiken TA. The effects of electrode size and orientation on the sensitivity of myoelectric pattern recognition systems to electrode shift. IEEE Trans Biomed Eng. 2011;58:2537–44.CrossRefPubMedCentralPubMed
14.
go back to reference Young AJ, Hargrove LJ, Kuiken TA. Improving myoelectric pattern recognition robustness to electrode shift by changing interelectrode distance and electrode configuration. IEEE Trans Biomed Eng. 2012;59:645–52.CrossRefPubMedCentralPubMed Young AJ, Hargrove LJ, Kuiken TA. Improving myoelectric pattern recognition robustness to electrode shift by changing interelectrode distance and electrode configuration. IEEE Trans Biomed Eng. 2012;59:645–52.CrossRefPubMedCentralPubMed
15.
go back to reference Muceli S, Jiang N, Farina D. Extracting signals robust to electrode number and shift for online simultaneous and proportional myoelectric control by factorization algorithms. IEEE Trans Neural Syst Rehabil Eng. 2013;22:623–33.CrossRefPubMed Muceli S, Jiang N, Farina D. Extracting signals robust to electrode number and shift for online simultaneous and proportional myoelectric control by factorization algorithms. IEEE Trans Neural Syst Rehabil Eng. 2013;22:623–33.CrossRefPubMed
16.
go back to reference Tommasi T, Orabona F, Castellini C, Caputo B. Improving control of dexterous hand prostheses using adaptive learning. IEEE Trans Robotics. 2013;29:207–19.CrossRef Tommasi T, Orabona F, Castellini C, Caputo B. Improving control of dexterous hand prostheses using adaptive learning. IEEE Trans Robotics. 2013;29:207–19.CrossRef
17.
go back to reference Chen X, Zhang D, Zhu X. Application of a self-enhancing classification method to electromyography pattern recognition for multifunctional prosthesis control. J Neuroeng Rehabil. 2013;10:44.CrossRefPubMedCentralPubMed Chen X, Zhang D, Zhu X. Application of a self-enhancing classification method to electromyography pattern recognition for multifunctional prosthesis control. J Neuroeng Rehabil. 2013;10:44.CrossRefPubMedCentralPubMed
18.
go back to reference López NM, di Sciascio F, Soria CM, Valentinuzzi ME. Robust EMG sensing system based on data fusion for myoelectric control of a robotic arm. Biomed Eng Online. 2009;8:5.CrossRefPubMedCentralPubMed López NM, di Sciascio F, Soria CM, Valentinuzzi ME. Robust EMG sensing system based on data fusion for myoelectric control of a robotic arm. Biomed Eng Online. 2009;8:5.CrossRefPubMedCentralPubMed
19.
20.
go back to reference Hahne JM, Graimann B, Muller K. Spatial filtering for robust myoelectric control. IEEE Trans Biomed Eng. 2012;59:1436–43.CrossRefPubMed Hahne JM, Graimann B, Muller K. Spatial filtering for robust myoelectric control. IEEE Trans Biomed Eng. 2012;59:1436–43.CrossRefPubMed
21.
go back to reference Geng Y, Zhou P, Li G. Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees. J Neuroeng Rehabil. 2012;9:74.CrossRefPubMedCentralPubMed Geng Y, Zhou P, Li G. Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees. J Neuroeng Rehabil. 2012;9:74.CrossRefPubMedCentralPubMed
22.
go back to reference Simon AM, Hargrove LJ, Lock BA, Kuiken TA. A decision-based velocity ramp for minimizing the effect of misclassifications during real-time pattern recognition control. IEEE Trans Biomed Eng. 2011;58:2360–8.CrossRef Simon AM, Hargrove LJ, Lock BA, Kuiken TA. A decision-based velocity ramp for minimizing the effect of misclassifications during real-time pattern recognition control. IEEE Trans Biomed Eng. 2011;58:2360–8.CrossRef
23.
go back to reference Amsuss S, Gobel P, Jiang N, Graimann B, Paredes L, Farina D. Self-correcting pattern recognition system of surface EMG signals for upper limb prosthesis control. IEEE Trans Biomed Eng. 2014;61:1167–76.CrossRefPubMed Amsuss S, Gobel P, Jiang N, Graimann B, Paredes L, Farina D. Self-correcting pattern recognition system of surface EMG signals for upper limb prosthesis control. IEEE Trans Biomed Eng. 2014;61:1167–76.CrossRefPubMed
25.
go back to reference Zhang X, Liu Y, Zhang F, Ren J, Sun YL, Yang Q, et al. On design and implementation of neural-machine interface for artificial legs. IEEE Trans Ind Inform. 2012;8:418–29.CrossRef Zhang X, Liu Y, Zhang F, Ren J, Sun YL, Yang Q, et al. On design and implementation of neural-machine interface for artificial legs. IEEE Trans Ind Inform. 2012;8:418–29.CrossRef
26.
go back to reference Liu Y, Zhang F, Sun Y, Huang H. Trust sensor interface for improving reliability of EMG-based user intent recognition. In: Proceedings of the 33rd Annual International Conference of the IEEE EMBS: August 30 - September 3, 2011; Boston. 2011. p. 7516–20. Liu Y, Zhang F, Sun Y, Huang H. Trust sensor interface for improving reliability of EMG-based user intent recognition. In: Proceedings of the 33rd Annual International Conference of the IEEE EMBS: August 30 - September 3, 2011; Boston. 2011. p. 7516–20.
27.
go back to reference Zhang X, Huang H, Yang Q. Real-time implementation of a self-recovery EMG pattern recognition interface for artificial arms. In: Proceedings of the 35th Annual International Conference of the IEEE EMBS: July 3–7, 2013; Osaka. 2013. p. 5926–9. Zhang X, Huang H, Yang Q. Real-time implementation of a self-recovery EMG pattern recognition interface for artificial arms. In: Proceedings of the 35th Annual International Conference of the IEEE EMBS: July 3–7, 2013; Osaka. 2013. p. 5926–9.
28.
go back to reference Mahalanobis PC. On the generalized distance in statistics. In: Proceedings of the National Institute of Sciences: April 16, 1936; Calcutta, vol. 2. 1936. p. 49–55. Mahalanobis PC. On the generalized distance in statistics. In: Proceedings of the National Institute of Sciences: April 16, 1936; Calcutta, vol. 2. 1936. p. 49–55.
29.
go back to reference Shyu M-L, Chen S-C, Sarinnapakorn K, Chang L. A novel anomaly detection scheme based on principal component classifier. In: Proceedings of the IEEE Foundations and New Directions of Data Mining Workshop, in conjunction with ICDM’03: November 19–22, 2003; Melbourne. 2003. p. 171–9. Shyu M-L, Chen S-C, Sarinnapakorn K, Chang L. A novel anomaly detection scheme based on principal component classifier. In: Proceedings of the IEEE Foundations and New Directions of Data Mining Workshop, in conjunction with ICDM’03: November 19–22, 2003; Melbourne. 2003. p. 171–9.
30.
go back to reference Perotto A, Delagi EF. Anatomical guide for the electromyographer: the limbs and trunk. Springfield, IL: Charles C Thomas Publisher; 2005. Perotto A, Delagi EF. Anatomical guide for the electromyographer: the limbs and trunk. Springfield, IL: Charles C Thomas Publisher; 2005.
31.
go back to reference Farrell TR, Weir RF. A comparison of the effects of electrode implantation and targeting on pattern classification accuracy for prosthesis control. IEEE Trans Biomed Eng. 2008;55:2198–211.CrossRefPubMedCentralPubMed Farrell TR, Weir RF. A comparison of the effects of electrode implantation and targeting on pattern classification accuracy for prosthesis control. IEEE Trans Biomed Eng. 2008;55:2198–211.CrossRefPubMedCentralPubMed
32.
go back to reference Smith LH, Hargrove LJ, Lock BA, Kuiken TA. Determining the optimal window length for pattern recognition-based myoelectric control: balancing the competing effects of classification error and controller delay. IEEE Trans Neural Syst Rehab Eng. 2011;19:186–92.CrossRef Smith LH, Hargrove LJ, Lock BA, Kuiken TA. Determining the optimal window length for pattern recognition-based myoelectric control: balancing the competing effects of classification error and controller delay. IEEE Trans Neural Syst Rehab Eng. 2011;19:186–92.CrossRef
33.
go back to reference Marateb HR, Rojas-Martínez M, Mansourian M, Merletti R, Villanueva MAM. Outlier detection in high-density surface electromyographic signals. Med Biol Eng Comput. 2012;50:79–89.CrossRefPubMed Marateb HR, Rojas-Martínez M, Mansourian M, Merletti R, Villanueva MAM. Outlier detection in high-density surface electromyographic signals. Med Biol Eng Comput. 2012;50:79–89.CrossRefPubMed
34.
go back to reference Phinyomark A, Limsakul C, Phukpattaranont P. A novel feature extraction for robust EMG pattern recognition. J Comput. 2009;1:71–80. Phinyomark A, Limsakul C, Phukpattaranont P. A novel feature extraction for robust EMG pattern recognition. J Comput. 2009;1:71–80.
35.
go back to reference Wilk MB, Gnanadesikan R. Probability plotting methods for the analysis for the analysis of data. Biometrika. 1968;55:1–17.PubMed Wilk MB, Gnanadesikan R. Probability plotting methods for the analysis for the analysis of data. Biometrika. 1968;55:1–17.PubMed
36.
go back to reference Stålberg E, Bischoff C, Falck B. Outliers, a way to detect abnormality in quantitative EMG. Muscle Nerve. 1994;17:392–9.CrossRefPubMed Stålberg E, Bischoff C, Falck B. Outliers, a way to detect abnormality in quantitative EMG. Muscle Nerve. 1994;17:392–9.CrossRefPubMed
37.
go back to reference Laurikkala J, Juhola M, Kentala E, Lavrac N, Miksch S, Kavsek B. Informal identification of outliers in medical data. In: The 5th International Workshop on Intelligent Data Analysis in Medicine and Pharmacology, August, 2000; Berlin. 2000. p. 20–4. Laurikkala J, Juhola M, Kentala E, Lavrac N, Miksch S, Kavsek B. Informal identification of outliers in medical data. In: The 5th International Workshop on Intelligent Data Analysis in Medicine and Pharmacology, August, 2000; Berlin. 2000. p. 20–4.
38.
go back to reference Yamagiwa S, Sawahata H, Ishida M, Kawano T. Micro-electrode arrays for multi-channel motor unit EMG recording. In: Proceedings of the IEEE 27th International Conference on Micro Electro Mechanical Systems: January 26–20, 2014; San Francisco. 2014. p. 857–60.CrossRef Yamagiwa S, Sawahata H, Ishida M, Kawano T. Micro-electrode arrays for multi-channel motor unit EMG recording. In: Proceedings of the IEEE 27th International Conference on Micro Electro Mechanical Systems: January 26–20, 2014; San Francisco. 2014. p. 857–60.CrossRef
39.
go back to reference Someya T, Sekitani T. Bionic skins using flexible organic devices. In: Proceedings of the IEEE 27th International Conference on Micro Electro Mechanical Systems: January 26–20, 2014; San Francisco. 2014. p. 68–71.CrossRef Someya T, Sekitani T. Bionic skins using flexible organic devices. In: Proceedings of the IEEE 27th International Conference on Micro Electro Mechanical Systems: January 26–20, 2014; San Francisco. 2014. p. 68–71.CrossRef
40.
go back to reference Ison M, Artemiadis P. The role of muscle synergies in myoelectric control: trends and challenges for simultaneous multifunction control. J Neural Eng. 2014;11:051001.CrossRefPubMed Ison M, Artemiadis P. The role of muscle synergies in myoelectric control: trends and challenges for simultaneous multifunction control. J Neural Eng. 2014;11:051001.CrossRefPubMed
41.
go back to reference Matsubara T, Morimoto J. Bilinear modeling of EMG signals to extract user-independent features for multiuser myoelectric interface. IEEE Trans Biomed Eng. 2013;60:2205–13.CrossRefPubMed Matsubara T, Morimoto J. Bilinear modeling of EMG signals to extract user-independent features for multiuser myoelectric interface. IEEE Trans Biomed Eng. 2013;60:2205–13.CrossRefPubMed
42.
go back to reference Khushaba RN. Correlation Analysis of Electromyogram (EMG) signals for multi-user myoelectric interfaces. IEEE Trans Neural Syst Rehab Eng. 2014;22:745–55.CrossRef Khushaba RN. Correlation Analysis of Electromyogram (EMG) signals for multi-user myoelectric interfaces. IEEE Trans Neural Syst Rehab Eng. 2014;22:745–55.CrossRef
43.
go back to reference Gibson AE, Ison MR, Artemiadis P. User-independent hand motion classification with electromyography. In: Proceedings of the ASME 2013 Dynamic Systems and Control Conference: October 21–23, 2013; Palo Alto. 2013. p. DSCC2013-3832. Gibson AE, Ison MR, Artemiadis P. User-independent hand motion classification with electromyography. In: Proceedings of the ASME 2013 Dynamic Systems and Control Conference: October 21–23, 2013; Palo Alto. 2013. p. DSCC2013-3832.
44.
go back to reference Simon AM, Hargrove LJ, Lock BA, Kuiken T. Target achievement control test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. J Rehab Res Dev. 2011;48:619–28.CrossRef Simon AM, Hargrove LJ, Lock BA, Kuiken T. Target achievement control test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. J Rehab Res Dev. 2011;48:619–28.CrossRef
45.
go back to reference Hargrove LJ, Simon AM, Lipschutz RD, Finucane SB, Kuiken TA. Real-time myoelectric control of knee and ankle motions for transfemoral amputees. J Am Med Assoc. 2011;305:1542–4.CrossRef Hargrove LJ, Simon AM, Lipschutz RD, Finucane SB, Kuiken TA. Real-time myoelectric control of knee and ankle motions for transfemoral amputees. J Am Med Assoc. 2011;305:1542–4.CrossRef
Metadata
Title
A real-time, practical sensor fault-tolerant module for robust EMG pattern recognition
Authors
Xiaorong Zhang
He Huang
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2015
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-015-0011-y

Other articles of this Issue 1/2015

Journal of NeuroEngineering and Rehabilitation 1/2015 Go to the issue