Skip to main content
Top
Published in: Brain Topography 2/2010

Open Access 01-06-2010 | Original Paper

Towards a Cure for BCI Illiteracy

Authors: Carmen Vidaurre, Benjamin Blankertz

Published in: Brain Topography | Issue 2/2010

Login to get access

Abstract

Brain–Computer Interfaces (BCIs) allow a user to control a computer application by brain activity as acquired, e.g., by EEG. One of the biggest challenges in BCI research is to understand and solve the problem of “BCI Illiteracy”, which is that BCI control does not work for a non-negligible portion of users (estimated 15 to 30%). Here, we investigate the illiteracy problem in BCI systems which are based on the modulation of sensorimotor rhythms. In this paper, a sophisticated adaptation scheme is presented which guides the user from an initial subject-independent classifier that operates on simple features to a subject-optimized state-of-the-art classifier within one session while the user interacts the whole time with the same feedback application. While initial runs use supervised adaptation methods for robust co-adaptive learning of user and machine, final runs use unsupervised adaptation and therefore provide an unbiased measure of BCI performance. Using this approach, which does not involve any offline calibration measurement, good performance was obtained by good BCI participants (also one novice) after 3–6 min of adaptation. More importantly, the use of machine learning techniques allowed users who were unable to achieve successful feedback before to gain significant control over the BCI system. In particular, one participant had no peak of the sensory motor idle rhythm in the beginning of the experiment, but could develop such peak during the course of the session (and use voluntary modulation of its amplitude to control the feedback application).
Literature
go back to reference Blankertz B, Dornhege G, Krauledat M, Müller KR, Curio G (2007) The non-invasive Berlin Brain–Computer Interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550CrossRefPubMed Blankertz B, Dornhege G, Krauledat M, Müller KR, Curio G (2007) The non-invasive Berlin Brain–Computer Interface: fast acquisition of effective performance in untrained subjects. NeuroImage 37(2):539–550CrossRefPubMed
go back to reference Blankertz B, Losch F, Krauledat M, Dornhege G, Curio G, Müller KR (2008a) The Berlin Brain–Computer Interface: accurate performance from first-session in BCI-naive subjects. IEEE Trans Biomed Eng 55(10):2452–2462CrossRefPubMed Blankertz B, Losch F, Krauledat M, Dornhege G, Curio G, Müller KR (2008a) The Berlin Brain–Computer Interface: accurate performance from first-session in BCI-naive subjects. IEEE Trans Biomed Eng 55(10):2452–2462CrossRefPubMed
go back to reference Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR (2008b) Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process Mag 25(1):41–56CrossRef Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR (2008b) Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process Mag 25(1):41–56CrossRef
go back to reference Blankertz B, Tangermann M, Vidaurre C, Dickhaus T, Sannelli C, Popescu F, Fazli S, Danóczy M, Curio G, Müller KR (2009) The Berlin Brain–Computer Interface. In: Allison B, Graimann B, Pfurtscheller G (eds) Non-invasive and invasive brain–computer interfaces. Springer, The Frontiers Collection (in press) Blankertz B, Tangermann M, Vidaurre C, Dickhaus T, Sannelli C, Popescu F, Fazli S, Danóczy M, Curio G, Müller KR (2009) The Berlin Brain–Computer Interface. In: Allison B, Graimann B, Pfurtscheller G (eds) Non-invasive and invasive brain–computer interfaces. Springer, The Frontiers Collection (in press)
go back to reference Dickhaus T, Sannelli C, Müller KR, Curio G, Blankertz B (2009) Predicting BCI performance to study BCI illiteracy. BMC Neurosci 10(Suppl 1): P84 Dickhaus T, Sannelli C, Müller KR, Curio G, Blankertz B (2009) Predicting BCI performance to study BCI illiteracy. BMC Neurosci 10(Suppl 1): P84
go back to reference Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multi-class paradigms. IEEE Trans Biomed Eng 51(6):993–1002CrossRefPubMed Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multi-class paradigms. IEEE Trans Biomed Eng 51(6):993–1002CrossRefPubMed
go back to reference Dornhege G, Millán J del R, Hinterberger T, McFarland D, Müller KR (eds) (2007) Toward brain–computer interfacing. MIT Press, Cambridge, MA Dornhege G, Millán J del R, Hinterberger T, McFarland D, Müller KR (eds) (2007) Toward brain–computer interfacing. MIT Press, Cambridge, MA
go back to reference Kübler A, Kotchoubey B, Kaiser J, Wolpaw J, Birbaumer N (2001) Brain–computer communication: unlocking the locked in. Psychol Bull 127(3):358–375CrossRefPubMed Kübler A, Kotchoubey B, Kaiser J, Wolpaw J, Birbaumer N (2001) Brain–computer communication: unlocking the locked in. Psychol Bull 127(3):358–375CrossRefPubMed
go back to reference Kübler A, Neumann N, Wilhelm B, Hinterberger T, Birbaumer N (2004) Predictability of brain–computer communication. J Psychophysiol 18:121–129CrossRef Kübler A, Neumann N, Wilhelm B, Hinterberger T, Birbaumer N (2004) Predictability of brain–computer communication. J Psychophysiol 18:121–129CrossRef
go back to reference Ledoit O, Wolf M (2004) Honey, I shrunk the sample covariance matrix. J Portfolio Manag 30:110–119CrossRef Ledoit O, Wolf M (2004) Honey, I shrunk the sample covariance matrix. J Portfolio Manag 30:110–119CrossRef
go back to reference Millán J del R, Renkens F, Mouriño J, Gerstner W (2004) Brain-actuated interaction. Artif Intell 159:241–259CrossRef Millán J del R, Renkens F, Mouriño J, Gerstner W (2004) Brain-actuated interaction. Artif Intell 159:241–259CrossRef
go back to reference Müller KR, Anderson CW, Birch GE (2003) Linear and non-linear methods for brain–computer interfaces. IEEE Trans Neural Sys Rehab Eng 11(2):165–169CrossRef Müller KR, Anderson CW, Birch GE (2003) Linear and non-linear methods for brain–computer interfaces. IEEE Trans Neural Sys Rehab Eng 11(2):165–169CrossRef
go back to reference Müller KR, Tangermann M, Dornhege G, Krauledat M, Curio G, Blankertz B (2008) Machine learning for real-time single-trial analysis: from brain–computer interfacing mental state monitoring. J Neurosci Methods 167:82–90CrossRefPubMed Müller KR, Tangermann M, Dornhege G, Krauledat M, Curio G, Blankertz B (2008) Machine learning for real-time single-trial analysis: from brain–computer interfacing mental state monitoring. J Neurosci Methods 167:82–90CrossRefPubMed
go back to reference Pfurtscheller G, Neuper C, Birbaumer N (2005) Human brain–computer interface. In: Riehle A, Vaadia E (eds) Motor cortex in voluntary movements, Chap. 14. CRC Press, New York, pp 367–401 Pfurtscheller G, Neuper C, Birbaumer N (2005) Human brain–computer interface. In: Riehle A, Vaadia E (eds) Motor cortex in voluntary movements, Chap. 14. CRC Press, New York, pp 367–401
go back to reference Shenoy P, Krauledat M, Blankertz B, Rao RPN, Müller KR (2006) Towards adaptive classification for BCI. J Neural Eng 3(1):R13–R23CrossRefPubMed Shenoy P, Krauledat M, Blankertz B, Rao RPN, Müller KR (2006) Towards adaptive classification for BCI. J Neural Eng 3(1):R13–R23CrossRefPubMed
go back to reference Sugiyama M, Krauledat M, Müller KR (2007) Covariate shift adaptation by importance weighted cross validation. J Mach Learn Res 8:1027–1061 Sugiyama M, Krauledat M, Müller KR (2007) Covariate shift adaptation by importance weighted cross validation. J Mach Learn Res 8:1027–1061
go back to reference Vidaurre C, Schlögl A, Scherer R, Cabeza R, Pfurtscheller G (2006) A fully on-line adaptive BCI. IEEE Trans on Biomed Eng 53:1214–1219CrossRef Vidaurre C, Schlögl A, Scherer R, Cabeza R, Pfurtscheller G (2006) A fully on-line adaptive BCI. IEEE Trans on Biomed Eng 53:1214–1219CrossRef
go back to reference Vidaurre C, Schlögl A, Scherer R, Cabeza R, Pfurtscheller G (2007) Study of on-line adaptive discriminant analysis for EEG-based brain computer interfaces. IEEE Trans Biomed Eng 54:550–556CrossRefPubMed Vidaurre C, Schlögl A, Scherer R, Cabeza R, Pfurtscheller G (2007) Study of on-line adaptive discriminant analysis for EEG-based brain computer interfaces. IEEE Trans Biomed Eng 54:550–556CrossRefPubMed
go back to reference Vidaurre C, Schlögl A, Blankertz B, Kawanabe M, Müller KR (2008) Unsupervised adaptation of the LDA classifier for brain–computer interfaces. In: Proceedings of the 4th international brain–computer interface workshop and training course 2008, Verlag der Technischen Universität Graz, pp 122–127 Vidaurre C, Schlögl A, Blankertz B, Kawanabe M, Müller KR (2008) Unsupervised adaptation of the LDA classifier for brain–computer interfaces. In: Proceedings of the 4th international brain–computer interface workshop and training course 2008, Verlag der Technischen Universität Graz, pp 122–127
go back to reference Vidaurre C, Krämer N, Blankertz B, Schlögl A (2009) Time domain parameters as a feature for EEG-based brain–computer interfaces. Neural Netw 22:1313–1319CrossRefPubMed Vidaurre C, Krämer N, Blankertz B, Schlögl A (2009) Time domain parameters as a feature for EEG-based brain–computer interfaces. Neural Netw 22:1313–1319CrossRefPubMed
go back to reference Vidaurre C, Sannelli C, Müller KR, Blankertz B (in prep) Machine learning co-adaptive learning: towards a cure for BCI illiteracy Vidaurre C, Sannelli C, Müller KR, Blankertz B (in prep) Machine learning co-adaptive learning: towards a cure for BCI illiteracy
go back to reference von Bünau P, Meinecke FC, Kiraly FC, Müller KR (2009) Finding stationary subspaces in multivariate time series. Phys Rev Lett 103(21):214101 von Bünau P, Meinecke FC, Kiraly FC, Müller KR (2009) Finding stationary subspaces in multivariate time series. Phys Rev Lett 103(21):214101
go back to reference Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM (2002) Brain–computer interfaces for communication and control. Clin Neurophysiol 113:767–791CrossRefPubMed Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM (2002) Brain–computer interfaces for communication and control. Clin Neurophysiol 113:767–791CrossRefPubMed
Metadata
Title
Towards a Cure for BCI Illiteracy
Authors
Carmen Vidaurre
Benjamin Blankertz
Publication date
01-06-2010
Publisher
Springer US
Published in
Brain Topography / Issue 2/2010
Print ISSN: 0896-0267
Electronic ISSN: 1573-6792
DOI
https://doi.org/10.1007/s10548-009-0121-6

Other articles of this Issue 2/2010

Brain Topography 2/2010 Go to the issue