Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2007

Open Access 01-12-2007 | Research

A brain-computer interface with vibrotactile biofeedback for haptic information

Authors: Aniruddha Chatterjee, Vikram Aggarwal, Ander Ramos, Soumyadipta Acharya, Nitish V Thakor

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2007

Login to get access

Abstract

Background

It has been suggested that Brain-Computer Interfaces (BCI) may one day be suitable for controlling a neuroprosthesis. For closed-loop operation of BCI, a tactile feedback channel that is compatible with neuroprosthetic applications is desired. Operation of an EEG-based BCI using only vibrotactile feedback, a commonly used method to convey haptic senses of contact and pressure, is demonstrated with a high level of accuracy.

Methods

A Mu-rhythm based BCI using a motor imagery paradigm was used to control the position of a virtual cursor. The cursor position was shown visually as well as transmitted haptically by modulating the intensity of a vibrotactile stimulus to the upper limb. A total of six subjects operated the BCI in a two-stage targeting task, receiving only vibrotactile biofeedback of performance. The location of the vibration was also systematically varied between the left and right arms to investigate location-dependent effects on performance.

Results and Conclusion

Subjects are able to control the BCI using only vibrotactile feedback with an average accuracy of 56% and as high as 72%. These accuracies are significantly higher than the 15% predicted by random chance if the subject had no voluntary control of their Mu-rhythm. The results of this study demonstrate that vibrotactile feedback is an effective biofeedback modality to operate a BCI using motor imagery. In addition, the study shows that placement of the vibrotactile stimulation on the biceps ipsilateral or contralateral to the motor imagery introduces a significant bias in the BCI accuracy. This bias is consistent with a drop in performance generated by stimulation of the contralateral limb. Users demonstrated the capability to overcome this bias with training.
Appendix
Available only for authorised users
Literature
1.
go back to reference Trejo LJ, Rosipal R, Matthews B: Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 225-229. 10.1109/TNSRE.2006.875578CrossRefPubMed Trejo LJ, Rosipal R, Matthews B: Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 225-229. 10.1109/TNSRE.2006.875578CrossRefPubMed
2.
go back to reference Vaughan TM, McFarland DJ, Schalk G, Sarnacki WA, Krusienski DJ, Sellers EW, Wolpaw JR: The Wadsworth BCI Research and Development Program: at home with BCI. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 229-233. 10.1109/TNSRE.2006.875577CrossRefPubMed Vaughan TM, McFarland DJ, Schalk G, Sarnacki WA, Krusienski DJ, Sellers EW, Wolpaw JR: The Wadsworth BCI Research and Development Program: at home with BCI. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 229-233. 10.1109/TNSRE.2006.875577CrossRefPubMed
3.
go back to reference Vaughan TM, Wolpaw JR: The Third International Meeting on Brain-Computer Interface Technology: making a difference. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 126-127. 10.1109/TNSRE.2006.875577CrossRefPubMed Vaughan TM, Wolpaw JR: The Third International Meeting on Brain-Computer Interface Technology: making a difference. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 126-127. 10.1109/TNSRE.2006.875577CrossRefPubMed
4.
go back to reference Birbaumer N, Kubler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, Iversen I, Kotchoubey B, Neumann N, Flor H: The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 2000, 8: 190-193. 10.1109/86.847812CrossRefPubMed Birbaumer N, Kubler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, Iversen I, Kotchoubey B, Neumann N, Flor H: The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 2000, 8: 190-193. 10.1109/86.847812CrossRefPubMed
5.
go back to reference Blankertz B, Dornhege G, Krauledat M, Muller KR, Kunzmann V, Losch F, Curio G: The Berlin Brain-Computer Interface: EEG-based communication without subject training. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 147-152. 10.1109/TNSRE.2006.875557CrossRefPubMed Blankertz B, Dornhege G, Krauledat M, Muller KR, Kunzmann V, Losch F, Curio G: The Berlin Brain-Computer Interface: EEG-based communication without subject training. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 147-152. 10.1109/TNSRE.2006.875557CrossRefPubMed
6.
go back to reference Atkins DJ, Heard DCY, Donovan WH: Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities. J Prosth Orth 1996, 8: 2-11. 10.1097/00008526-199600810-00003CrossRef Atkins DJ, Heard DCY, Donovan WH: Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities. J Prosth Orth 1996, 8: 2-11. 10.1097/00008526-199600810-00003CrossRef
7.
go back to reference Nelson VS, Flood KM, Bryant PR, Huang ME, Pasquina PF, Roberts TL: Limb deficiency and prosthetic management. 1. Decision making in prosthetic prescription and management. Arch Phys Med Rehabil 2006, 87: S3-9. 10.1016/j.apmr.2005.11.022CrossRefPubMed Nelson VS, Flood KM, Bryant PR, Huang ME, Pasquina PF, Roberts TL: Limb deficiency and prosthetic management. 1. Decision making in prosthetic prescription and management. Arch Phys Med Rehabil 2006, 87: S3-9. 10.1016/j.apmr.2005.11.022CrossRefPubMed
8.
go back to reference Roeschlein RA, Domholdt E: Factors related to successful upper extremity prosthetic use. Prosthet Orthot Int 1989, 13: 14-18.PubMed Roeschlein RA, Domholdt E: Factors related to successful upper extremity prosthetic use. Prosthet Orthot Int 1989, 13: 14-18.PubMed
9.
go back to reference Abbott A: Neuroprosthetics: in search of the sixth sense. Nature 2006, 442: 125-127. 10.1038/442125aCrossRefPubMed Abbott A: Neuroprosthetics: in search of the sixth sense. Nature 2006, 442: 125-127. 10.1038/442125aCrossRefPubMed
10.
go back to reference Schwartz AB, Cui XT, Weber DJ, Moran DW: Brain-controlled interfaces: movement restoration with neural prosthetics. Neuron 2006, 52: 205-220. 10.1016/j.neuron.2006.09.019CrossRefPubMed Schwartz AB, Cui XT, Weber DJ, Moran DW: Brain-controlled interfaces: movement restoration with neural prosthetics. Neuron 2006, 52: 205-220. 10.1016/j.neuron.2006.09.019CrossRefPubMed
11.
go back to reference Taylor DM, Tillery SI, Schwartz AB: Direct cortical control of 3D neuroprosthetic devices. Science 2002, 296: 1829-1832. 10.1126/science.1070291CrossRefPubMed Taylor DM, Tillery SI, Schwartz AB: Direct cortical control of 3D neuroprosthetic devices. Science 2002, 296: 1829-1832. 10.1126/science.1070291CrossRefPubMed
12.
go back to reference Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP: Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006, 442: 164-171. 10.1038/nature04970CrossRefPubMed Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP: Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006, 442: 164-171. 10.1038/nature04970CrossRefPubMed
13.
go back to reference Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, Dimitrov DF, Patil PG, Henriquez CS, Nicolelis MA: Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol 2003, 1: E42. 10.1371/journal.pbio.0000042PubMedCentralCrossRefPubMed Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, Dimitrov DF, Patil PG, Henriquez CS, Nicolelis MA: Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol 2003, 1: E42. 10.1371/journal.pbio.0000042PubMedCentralCrossRefPubMed
14.
go back to reference Kaczmarek KA, Webster JG, Bach-y-Rita P, Tompkins WJ: Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Trans Biomed Eng 1991, 38: 1-16. 10.1109/10.68204CrossRefPubMed Kaczmarek KA, Webster JG, Bach-y-Rita P, Tompkins WJ: Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Trans Biomed Eng 1991, 38: 1-16. 10.1109/10.68204CrossRefPubMed
15.
go back to reference Benali KM, Hafez M, Alexandre JM, Kheddar A: Tactile Interfaces: A State of the Art Survey: 24-26 March 2004; Paris, France. ; 2004. Benali KM, Hafez M, Alexandre JM, Kheddar A: Tactile Interfaces: A State of the Art Survey: 24-26 March 2004; Paris, France. ; 2004.
16.
go back to reference Shannon GF: Sensory feedback for artificial limbs. Med Prog Technol 1979, 6: 73-79.PubMed Shannon GF: Sensory feedback for artificial limbs. Med Prog Technol 1979, 6: 73-79.PubMed
17.
go back to reference Shannon GF: A comparison of alternative means of providing sensory feedback on upper limb prostheses. Med Biol Eng 1976, 14: 289-294. 10.1007/BF02478123CrossRefPubMed Shannon GF: A comparison of alternative means of providing sensory feedback on upper limb prostheses. Med Biol Eng 1976, 14: 289-294. 10.1007/BF02478123CrossRefPubMed
18.
go back to reference Meek SG, Jacobsen SC, Goulding PP: Extended physiologic taction: design and evaluation of a proportional force feedback system. J Rehabil Res Dev 1989, 26: 53-62.PubMed Meek SG, Jacobsen SC, Goulding PP: Extended physiologic taction: design and evaluation of a proportional force feedback system. J Rehabil Res Dev 1989, 26: 53-62.PubMed
19.
go back to reference Patterson PE, Katz JA: Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. J Rehabil Res Dev 1992, 29: 1-8.CrossRefPubMed Patterson PE, Katz JA: Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. J Rehabil Res Dev 1992, 29: 1-8.CrossRefPubMed
20.
go back to reference Pylatiuk C, Kargov A, Schulz S: Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands. Journal of Prosthetics and Orthotics 2006, 18: 57-61. 10.1097/00008526-200604000-00007CrossRef Pylatiuk C, Kargov A, Schulz S: Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands. Journal of Prosthetics and Orthotics 2006, 18: 57-61. 10.1097/00008526-200604000-00007CrossRef
21.
go back to reference Wolpaw JR, McFarland DJ: Multichannel EEG-based brain-computer communication. Electroencephalogr Clin Neurophysiol 1994, 90: 444-449. 10.1016/0013-4694(94)90135-XCrossRefPubMed Wolpaw JR, McFarland DJ: Multichannel EEG-based brain-computer communication. Electroencephalogr Clin Neurophysiol 1994, 90: 444-449. 10.1016/0013-4694(94)90135-XCrossRefPubMed
22.
go back to reference Pineda JA, Silverman DS, Vankov A, Hestenes J: Learning to control brain rhythms: making a brain-computer interface possible. IEEE Trans Neural Syst Rehabil Eng 2003, 11: 181-184. 10.1109/TNSRE.2003.814445CrossRefPubMed Pineda JA, Silverman DS, Vankov A, Hestenes J: Learning to control brain rhythms: making a brain-computer interface possible. IEEE Trans Neural Syst Rehabil Eng 2003, 11: 181-184. 10.1109/TNSRE.2003.814445CrossRefPubMed
23.
go back to reference Wolpaw JR, McFarland DJ: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc Natl Acad Sci U S A 2004, 101: 17849-17854. 10.1073/pnas.0403504101PubMedCentralCrossRefPubMed Wolpaw JR, McFarland DJ: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc Natl Acad Sci U S A 2004, 101: 17849-17854. 10.1073/pnas.0403504101PubMedCentralCrossRefPubMed
24.
go back to reference Guger C, Ramoser H, Pfurtscheller G: Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). IEEE Trans Rehabil Eng 2000, 8: 447-456. 10.1109/86.895947CrossRefPubMed Guger C, Ramoser H, Pfurtscheller G: Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). IEEE Trans Rehabil Eng 2000, 8: 447-456. 10.1109/86.895947CrossRefPubMed
25.
go back to reference Ramoser H, Muller-Gerking J, Pfurtscheller G: Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans Rehabil Eng 2000, 8: 441-446. 10.1109/86.895946CrossRefPubMed Ramoser H, Muller-Gerking J, Pfurtscheller G: Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans Rehabil Eng 2000, 8: 441-446. 10.1109/86.895946CrossRefPubMed
26.
go back to reference Bos R, deWaele S, Broersen PMT: Autoregressive spectral estimation by application of the Burg algorithm to irregularly sampled data. IEEE Trans Instrum Meas 2002, 51: 1289. 10.1109/TIM.2002.808031CrossRef Bos R, deWaele S, Broersen PMT: Autoregressive spectral estimation by application of the Burg algorithm to irregularly sampled data. IEEE Trans Instrum Meas 2002, 51: 1289. 10.1109/TIM.2002.808031CrossRef
27.
go back to reference Krusienski DJ, McFarland DJ, Wolpaw JR: An evaluation of autoregressive spectral estimation model order for brain-computer interface applications: Aug 30 - Sept 3; New York City, USA. ; 2006:1323-1326. Krusienski DJ, McFarland DJ, Wolpaw JR: An evaluation of autoregressive spectral estimation model order for brain-computer interface applications: Aug 30 - Sept 3; New York City, USA. ; 2006:1323-1326.
28.
go back to reference Burg JP: Proc. 37th Meeting Soc. Exploration Geophys. 1967. Burg JP: Proc. 37th Meeting Soc. Exploration Geophys. 1967.
29.
go back to reference Cholewiak RW, Collins AA: Vibrotactile localization on the arm: effects of place, space, and age. Percept Psychophys 2003, 65: 1058-1077.CrossRefPubMed Cholewiak RW, Collins AA: Vibrotactile localization on the arm: effects of place, space, and age. Percept Psychophys 2003, 65: 1058-1077.CrossRefPubMed
30.
go back to reference Mountcastle VB, LaMotte RH, Carli G: Detection thresholds for stimuli in humans and monkeys: comparison with threshold events in mechanoreceptive afferent nerve fibers innervating the monkey hand. J Neurophysiol 1972, 35: 122-136.PubMed Mountcastle VB, LaMotte RH, Carli G: Detection thresholds for stimuli in humans and monkeys: comparison with threshold events in mechanoreceptive afferent nerve fibers innervating the monkey hand. J Neurophysiol 1972, 35: 122-136.PubMed
31.
go back to reference Delorme A, Makeig S: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics. Journal of Neuroscience Methods 2004, 134: 9-21. 10.1016/j.jneumeth.2003.10.009CrossRefPubMed Delorme A, Makeig S: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics. Journal of Neuroscience Methods 2004, 134: 9-21. 10.1016/j.jneumeth.2003.10.009CrossRefPubMed
32.
go back to reference McFarland DJ, Sarnacki WA, Wolpaw JR: Brain-computer interface (BCI) operation: optimizing information transfer rates. Biol Psychol 2003, 63: 237-251. 10.1016/S0301-0511(03)00073-5CrossRefPubMed McFarland DJ, Sarnacki WA, Wolpaw JR: Brain-computer interface (BCI) operation: optimizing information transfer rates. Biol Psychol 2003, 63: 237-251. 10.1016/S0301-0511(03)00073-5CrossRefPubMed
33.
go back to reference Sellers EW, Krusienski DJ, McFarland DJ, Vaughan TM, Wolpaw JR: A P300 event-related potential brain-computer interface (BCI): the effects of matrix size and inter stimulus interval on performance. Biol Psychol 2006, 73: 242-252. 10.1016/j.biopsycho.2006.04.007CrossRefPubMed Sellers EW, Krusienski DJ, McFarland DJ, Vaughan TM, Wolpaw JR: A P300 event-related potential brain-computer interface (BCI): the effects of matrix size and inter stimulus interval on performance. Biol Psychol 2006, 73: 242-252. 10.1016/j.biopsycho.2006.04.007CrossRefPubMed
34.
go back to reference Kronegg J, Voloshynovskiy S, Pun T: Analysis of bit-rate definitions for Brain-Computer Interfaces: June 20-23; Las Vegas, Nevada. ; 2005. Kronegg J, Voloshynovskiy S, Pun T: Analysis of bit-rate definitions for Brain-Computer Interfaces: June 20-23; Las Vegas, Nevada. ; 2005.
35.
go back to reference Feygin D, Keehner M, Tendick R: Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill: 3/24/2002 - 3/25/2002; Orlando, FL, USA. ; 2002:40-47. Feygin D, Keehner M, Tendick R: Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill: 3/24/2002 - 3/25/2002; Orlando, FL, USA. ; 2002:40-47.
36.
go back to reference Ernst M, Banks M: Does vision always dominate haptics: ; University of Southern California. ; 2001. Ernst M, Banks M: Does vision always dominate haptics: ; University of Southern California. ; 2001.
37.
go back to reference Molchan SE, Sunderland T, McIntosh AR, Herscovitch P, Schreurs BG: A functional anatomical study of associative learning in humans. Proc Natl Acad Sci U S A 1994, 91: 8122-8126. 10.1073/pnas.91.17.8122PubMedCentralCrossRefPubMed Molchan SE, Sunderland T, McIntosh AR, Herscovitch P, Schreurs BG: A functional anatomical study of associative learning in humans. Proc Natl Acad Sci U S A 1994, 91: 8122-8126. 10.1073/pnas.91.17.8122PubMedCentralCrossRefPubMed
38.
go back to reference Sykacek P, Roberts S, Stokes M, Curran E, Gibbs M, Pickup L: Probabilistic methods in BCI research. IEEE Trans Neural Syst Rehabil Eng 2003, 11: 192-195. 10.1109/TNSRE.2003.814447CrossRefPubMed Sykacek P, Roberts S, Stokes M, Curran E, Gibbs M, Pickup L: Probabilistic methods in BCI research. IEEE Trans Neural Syst Rehabil Eng 2003, 11: 192-195. 10.1109/TNSRE.2003.814447CrossRefPubMed
Metadata
Title
A brain-computer interface with vibrotactile biofeedback for haptic information
Authors
Aniruddha Chatterjee
Vikram Aggarwal
Ander Ramos
Soumyadipta Acharya
Nitish V Thakor
Publication date
01-12-2007
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2007
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/1743-0003-4-40

Other articles of this Issue 1/2007

Journal of NeuroEngineering and Rehabilitation 1/2007 Go to the issue