Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Journal of NeuroEngineering and Rehabilitation
Published in: Journal of NeuroEngineering and Rehabilitation 1/2013

Open Access 01-12-2013 | Research

Detection of motor execution using a hybrid fNIRS-biosignal BCI: a feasibility study

Authors: Raphael Zimmermann, Laura Marchal-Crespo, Janis Edelmann, Olivier Lambercy, Marie-Christine Fluet, Robert Riener, Martin Wolf, Roger Gassert

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2013

Login to get access

Abstract

Background

Brain-computer interfaces (BCIs) were recently recognized as a method to promote neuroplastic effects in motor rehabilitation. The core of a BCI is a decoding stage by which signals from the brain are classified into different brain-states. The goal of this paper was to test the feasibility of a single trial classifier to detect motor execution based on signals from cortical motor regions, measured by functional near-infrared spectroscopy (fNIRS), and the response of the autonomic nervous system. An approach that allowed for individually tuned classifier topologies was opted for. This promises to be a first step towards a novel form of active movement therapy that could be operated and controlled by paretic patients.

Methods

Seven healthy subjects performed repetitions of an isometric finger pinching task, while changes in oxy- and deoxyhemoglobin concentrations were measured in the contralateral primary motor cortex and ventral premotor cortex using fNIRS. Simultaneously, heart rate, breathing rate, blood pressure and skin conductance response were measured. Hidden Markov models (HMM) were used to classify between active isometric pinching phases and rest. The classification performance (accuracy, sensitivity and specificity) was assessed for two types of input data: (i) fNIRS-signals only and (ii) fNIRS- and biosignals combined.

Results

fNIRS data were classified with an average accuracy of 79.4%, which increased significantly to 88.5% when biosignals were also included (p=0.02). Comparable increases were observed for the sensitivity (from 78.3% to 87.2%, p=0.008) and specificity (from 80.5% to 89.9%, p=0.062).

Conclusions

This study showed, for the first time, promising classification results with hemodynamic fNIRS data obtained from motor regions and simultaneously acquired biosignals. Combining fNIRS data with biosignals has a beneficial effect, opening new avenues for the development of brain-body-computer interfaces for rehabilitation applications. Further research is required to identify the contribution of each modality to the decoding capability of the subject’s hemodynamic and physiological state.
Appendix
Available only for authorised users
Literature
1.
Buch E, Weber C, Cohen LG, Braun C, Dimyan MA, Ard T, Mellinger J, Caria A, Soekadar S, Fourkas A, Birbaumer N: Think to move: A neuromagnetic Brain-Computer Interface (BCI) system for chronic stroke. Stroke 2008, 39: 910-917. 10.1161/STROKEAHA.107.505313CrossRefPubMed
2.
Hogan N, Krebs HI, Rohrer B, Palazzolo JJ, Dipietro L, Fasoli SE, Stein J, Hughes R, Frontera WR, Lynch D, Volpe BT: Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J Rehabil Res Dev 2006, 43: 605-618. 10.1682/JRRD.2005.06.0103CrossRefPubMed
3.
Wang W, Collinger JL, Perez MA, Tyler-Kabara EC, Cohen LG, Birbaumer N, Brose SW, Schwartz AB, Boninger ML, Weber DJ: Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. Phys Med Rehabil Clin North Am 2010, 21: 157-178. 10.1016/j.pmr.2009.07.003CrossRef
4.
Ward TE, Soraghan CJ, Matthews F, Markham C: A concept for extending the applicability of constraint-induced movement therapy through motor cortex activity feedback using a neural prosthesis. Comput Intell Neurosci 2007, 2007: 51363.PubMedCentralCrossRef
5.
Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB: Cortical control of a prosthetic arm for self-feeding. Nature 2008, 453: 1098-1101. 10.1038/nature06996CrossRefPubMed
6.
Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP: Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006, 442: 164-171. 10.1038/nature04970CrossRefPubMed
7.
Leuthardt EC, Schalk G, Wolpaw JR, Ojemann JG, Moran DW: A brain-computer interface using electrocorticographic signals in humans. J Neural Eng 2004, 1: 63. 10.1088/1741-2560/1/2/001CrossRefPubMed
8.
Yanagisawa T, Hirata M, Saitoh Y, Goto T, Kishima H, Fukuma R, Yokoi H, Kamitani Y, Yoshimine T: Real-time control of a prosthetic hand using human electrocorticography signals. J Neurosurgery 2011, 114: 1715-1722. 10.3171/2011.1.JNS101421CrossRef
9.
Sitaram R, Caria A, Birbaumer N: Hemodynamic brain-computer interfaces for communication and rehabilitation. Neural Netw 2009, 22: 1320-1328. 10.1016/j.neunet.2009.05.009CrossRefPubMed
10.
Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM: Brain-computer interfaces for communication and control. Clin Neurophysiol 2002, 113: 767-791. 10.1016/S1388-2457(02)00057-3CrossRefPubMed
11.
Coyle S, Ward T, Markham C, McDarby G: On the suitability of near-infrared (NIR) systems for next-generation brain–computer interfaces. Physiol Meas 2004, 25: 815-822. 10.1088/0967-3334/25/4/003CrossRefPubMed
12.
Weiskopf N, Mathiak K, Bock S, Scharnowski F, Veit R, Grodd W, Goebel R, Birbaumer N: Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI). Biomed Eng, IEEE Trans on 2004, 51: 966-970. 10.1109/TBME.2004.827063CrossRef
13.
Pasley BN, Freeman RD: Neurovascular coupling. Scholarpedia 2008, 3: 5340. 10.4249/scholarpedia.5340CrossRef
14.
Wolf M, Ferrari M, Quaresima V: Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. J Biomed Opt 2007, 12: 062104. 10.1117/1.2804899CrossRefPubMed
15.
Muehlemann T, Haensse D, Wolf M: Wireless miniaturized in-vivo near infrared imaging. Opt Express 2008, 16: 10323-10330. 10.1364/OE.16.010323CrossRefPubMed
16.
Sitaram R, Hoshi Y, Guan C: Near infrared spectroscopy based brain-computer interface. In Proc. SPIE 5852, Third International Conference on Experimental Mechanics and Third Conference of the Asian Committee on Experimental Mechanics 434: June 03, 2005. Edited by: Quan C, Chau FS, Asundi A, Wong BS, Lim CT. Bellingham, WA, USA: SPIE; 2005:434-442.
17.
Matthews F, Pearlmutter B, Ward T, Soraghan C, Markham C: Hemodynamics for brain-computer interfaces. Signal Process Mag, IEEE 2008, 25: 87-94.CrossRef
18.
Sitaram R, Zhang H, Guan C, Thulasidis M, Hoshi Y, Ishikawa A, Shimizu K, Birbaumer N: Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. NeuroImage 2007, 34: 1416-1427. 10.1016/j.neuroimage.2006.11.005CrossRefPubMed
19.
Coyle SM, Ward TE, Markham CM: Brain-computer interface using a simplified functional near-infrared spectroscopy system. J Neural Eng 2007, 4: 219. 10.1088/1741-2560/4/3/007CrossRefPubMed
20.
Power SD, Falk TH, Chau T: Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy. J Neural Eng 2010, 7: 026002. 10.1088/1741-2560/7/2/026002CrossRef
21.
Bauernfeind G, Leeb R, Wriessnegger SC, Pfurtscheller G: Development, set-up and first results for a one-channel near-infrared spectroscopy system. Biomed Eng 2008, 53: 36-43. 10.1515/BMT.2008.005CrossRef
22.
Falk T, Guirgis M, Power S, Chau T: Taking NIRS-BCIs outside the lab: towards achieving robustness against environment noise. Neural Syst Rehabil Eng, IEEE Trans on 2011, 19: 136-146.CrossRef
23.
Luu S, Chau T: Decoding subjective preference from single-trial near-infrared spectroscopy signals. J Neural Eng 2009, 6: 016003. 10.1088/1741-2560/6/1/016003CrossRefPubMed
24.
Tai K, Chau T: Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface. J Neuroeng Rehabil 2009, 6: 39. 10.1186/1743-0003-6-39PubMedCentralCrossRefPubMed
25.
Holper L, Wolf M: Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study. J Neuroeng Rehabil 2011, 8: 34. 10.1186/1743-0003-8-34PubMedCentralCrossRefPubMed
26.
Abibullaev B, Kang WS, Lee SH, An J: Recognition of brain hemodynamic mental response for brain computer interface. In International Conference on Control, Automation and Systems (ICCAS). Seoul, South Korea: Institute of Electrical and Electronics Engineers; 2010:2238-2243.
27.
Takahashi S, Nakamura H, Tsunashima H: Multichannel temporal data classification of motor imagination using fNIRS. In International Conference on Control, Automation and Systems (ICCAS). Seoul, South Korea: Institute of Electrical and Electronics Engineers; 2010:2443-2447.
28.
Coyle S, Ward T, Markham C: Physiological noise in near-infrared spectroscopy: implications for optical brain computer interfacing. In Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. San Francisco, CA, USA: Institute of Electrical and Electronics Engineers; 2004:4540-4543.CrossRef
29.
Trajkovic I, Scholkmann F, Wolf M: Estimating and validating the interbeat intervals of the heart using near-infrared spectroscopy on the human forehead. J Biomed Opt 2011, 16: 087002. 10.1117/1.3606560CrossRefPubMed
30.
Elwell CE, Owen-Reece H, Cope M, Edwards AD, Wyatt JS, Reynolds EOR, Delpy DT: Measurement of changes in cerebral haemodynamics during inspiration and expiration using near infrared spectroscopy. Adv Exp Med Biol 1994, 345: 619-626. 10.1007/978-1-4615-2468-7_82CrossRefPubMed
31.
Julien C: The enigma of Mayer waves: Facts and models. Cardiovasc Res 2006, 70: 12-21. 10.1016/j.cardiores.2005.11.008CrossRefPubMed
32.
Elwell CE, Springett R, Hillmann E, Delpy DT: Oscillations in cerebral haemodynamics – implications for functional activation studies. Adv Exp Med Biol 1999, 471: 57-65. 10.1007/978-1-4615-4717-4_8CrossRefPubMed
33.
Obrig H, Neufang M, Wenzel R, Kohl M, Steinbrink J, Einhupl K, Villringer A: Spontaneous low frequency oscillations of cerebral hemodynamics and metabolism in human adults. NeuroImage 2000, 12: 623-639. 10.1006/nimg.2000.0657CrossRefPubMed
34.
Zimmermann R, Marchal-Crespo L, Lambercy O, Fluet MC, Riener R, Wolf M, Gassert R: Towards a BCI for sensorimotor training: Initial results from simultaneous fNIRS and biosignal recordings. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Boston, MA, USA: Institute of Electrical and Electronics Engineers; 2011:6339-6343.
35.
Pfurtscheller G, Allison BZ, Brunner C, Bauernfeind G, Solis-Escalante T, Scherer R, Zander TO, Mueller-Putz G, Neuper C, Birbaumer N: The hybrid BCI. Front Neurosci 2010, 4: 30.PubMed
36.
Uozumi T, Tamagawa A, Hashimoto T, Tsuji S: Motor hand representation in cortical area 44. Neurology 2004, 62: 757-761. 10.1212/01.WNL.0000113731.75479.25CrossRefPubMed
37.
Chouinard PA, Paus T: The primary motor and premotor areas of the human cerebral cortex. Neuroscientist 2006, 12: 143-152. 10.1177/1073858405284255CrossRefPubMed
38.
Cacioppo JT, Tassinary LG, Berntson G: Handbook of Psychophysiology. New York: Cambridge University Press; 2007.CrossRef
39.
Malmivuo J, Plonsey R: The electrodermal response. In Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields. New York: Oxford University Press; 1995-1995.
40.
Josephs O, Henson RNA: Event-related functional magnetic resonance imaging: modelling, inference and optimization. Philos Trans R Soc London, Ser B: Biol Sci 1999,354(1387):1215-1228. 10.1098/rstb.1999.0475CrossRef
41.
Scholkmann F, Spichtig S, Muehlemann T, Wolf M: How to detect and reduce movement artifacts in near-infrared imaging using standard deviation and spline interpolation. Physiol Meas 2010, 31: 649-662. 10.1088/0967-3334/31/5/004CrossRefPubMed
42.
Villringer A, Chance B: Non-invasive optical spectroscopy and imaging of human brain function. Trends in Neurosciences 1997, 20: 435-442. 10.1016/S0166-2236(97)01132-6CrossRefPubMed
43.
Duncan A, Meek JH, Clemence M, Elwell CE, Tyszczuk L, Cope M, Delpy D: Optical pathlength measurements on adult head, calf and forearm and the head of the newborn infant using phase resolved optical spectroscopy. Phys Med Biol 1995, 40: 295-304. 10.1088/0031-9155/40/2/007CrossRefPubMed
44.
Wray S, Cope M, Delpy DT, Wyatt JS, Reynolds EO: Characterization of the near infrared absorption spectra of cytochrome aa3 and haemoglobin for the non-invasive monitoring of cerebral oxygenation. Biochim Biophys Acta 1988, 933: 184-192. 10.1016/0005-2728(88)90069-2CrossRefPubMed
45.
Tachtsidis I, Leung TS, Devoto L, Delpy DT, Elwell CE: Measurement of frontal lobe functional activation and related systemic effects: A near-infrared spectroscopy investigation. Adv Exp Med Biol 2008, 614: 397-403. 10.1007/978-0-387-74911-2_44CrossRefPubMed
46.
47.
Task Force of the European Society of Cardiology the North American Society of Pacing Electrophysiology: Heart rate variability : standards of measurement, physiological interpretation, and clinical Use. Circulation 1996, 93: 1043-1065. 10.1161/01.CIR.93.5.1043CrossRef
48.
Rabiner L: A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 1989, 77: 257-286. 10.1109/5.18626CrossRef
49.
Utsugi K, Obata A, Sato H, Katsura T, Sagara K, Maki A, Koizumi H: Development of an optical brain-machine interface. In Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Lyon, France: Institute of Electrical and Electronics Engineers; 2007:5338-5341.
50.
Nambu I, Osu R, Sato Ma, Ando S, Kawato M, Naito E: Single-trial reconstruction of finger-pinch forces from human motor-cortical activation measured by near-infrared spectroscopy (NIRS). NeuroImage 2009, 47: 628-637. 10.1016/j.neuroimage.2009.04.050CrossRefPubMed
51.
52.
Kübler A, Mushahwar V, Hochberg L, Donoghue J: BCI meeting 2005-workshop on clinical issues and applications. Neural Syst Rehabil Eng, IEEE Trans 2006, 14: 131-134. 10.1109/TNSRE.2006.875585CrossRef
53.
Sellers E, Kübler A, Donchin E: Brain-computer interface research at the university of south Florida cognitive psychophysiology laboratory: the P300 speller. Neural Syst Rehabil Eng, IEEE Trans 2006, 14: 221-224. 10.1109/TNSRE.2006.875580CrossRef
54.
Sharma N, Pomeroy VM, Baron JC: Motor imagery. A backdoor to the motor system after stroke? Stroke 2006, 37: 1941-1952. 10.1161/01.STR.0000226902.43357.fcCrossRefPubMed
55.
De Vries S, Mulder T: Motor imagery and stroke rehabilitation: a critical discussion. J Rehabil Med 2007, 39: 5-13. 10.2340/16501977-0020CrossRefPubMed
56.
Zimmermann-Schlatter A, Schuster C, Puhan M, Siekierka E, Steurer J: Efficacy of motor imagery in post-stroke rehabilitation: a systematic review. J Neuroeng Rehabil 2008, 5: 8. 10.1186/1743-0003-5-8PubMedCentralCrossRefPubMed
57.
Marchal-Crespo L, Zimmermann R, Lambercy O, Edelmann J, Fluet MC, Wolf M, Gassert R, Riener R: Motor execution detection based on autonomic nervous system responses. Physiol Meas 2013, 34: 35-51. 10.1088/0967-3334/34/1/35CrossRefPubMed
58.
Kanoh S, Murayama Ym, Miyamoto Ki, Yoshinobu T, Kawashima R: A NIRS-based brain-computer interface system during motor imagery: System development and online feedback training. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Minneapolis, MN, USA: Institute of Electrical and Electronics Engineers; 2009:594-597.
59.
Gomez-Rodriguez M, Peters J, Hill J, Schoelkopf B, Gharabaghi A, Grosse-Wentrup M: Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery. J Neural Eng 2011, 8: 036005. 10.1088/1741-2560/8/3/036005CrossRefPubMed
60.
61.
Wolf M, Morren G, Haensse D, Karen T, Wolf U, Fauchère J, Bucher H: Near infrared spectroscopy to study the brain: an overview. Opto-Electronics Rev 2008, 16: 413-419. 10.2478/s11772-008-0042-zCrossRef
62.
Buxton RB, Uludag K, Dubowitz DJ, Liu TT: Modeling the hemodynamic response to brain activation. NeuroImage 2004,23(Suppl 1):220-233.CrossRef
63.
Cramer SC, Sur M, Dobkin BH, O’Brien C, Sanger TD, Trojanowski JQ, Rumsey JM, Hicks R, Cameron J, Chen D, Chen WG, Cohen LG, deCharms C, Duffy CJ, Eden GF, Fetz EE, Filart R, Freund M, Grant SJ, Haber S, Kalivas PW, Kolb B, Kramer AF, Lynch M, Mayberg HS, McQuillen PS, Nitkin R, Pascual-Leone A, Reuter-Lorenz P, Schiff N, Sharma A, Shekim L, Stryker M, Sullivan EV, Vinogradov S: Harnessing neuroplasticity for clinical applications. Brain 2011, 134: 1591-1609. 10.1093/brain/awr039PubMedCentralCrossRefPubMed
64.
Sacco K, Cauda F, D’Agata F, Duca S, Zettin M, Virgilio R, Nascimbeni A, Belforte G, Eula G, Gastaldi L, Appendino S, Geminiani GC: A combined robotic and cognitive training for locomotor rehabilitation: Evidences of cerebral functional reorganization in two chronic traumatic brain injured patients. Front Human Neurosci 2011, 5: 146.CrossRef
Metadata
Title
Detection of motor execution using a hybrid fNIRS-biosignal BCI: a feasibility study
Authors
Raphael Zimmermann
Laura Marchal-Crespo
Janis Edelmann
Olivier Lambercy
Marie-Christine Fluet
Robert Riener
Martin Wolf
Roger Gassert
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2013
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/1743-0003-10-4

Other articles of this Issue 1/2013

Journal of NeuroEngineering and Rehabilitation 1/2013 Go to the issue

Research

Walking speed related joint kinetic alterations in trans-tibial amputees: impact of hydraulic 'ankle’ damping

Research

Operation of a brain-computer interface walking simulator for individuals with spinal cord injury

Editorial

Guest Editorial: From neuroscience to neuro-rehabilitation: transferring basic neuroscientific principles from laboratory to bedside

Research

Adaptive training algorithm for robot-assisted upper-arm rehabilitation, applicable to individualised and therapeutic human-robot interaction

Research

Femoral anteversion and tibial torsion only explain 25% of variance in regression analysis of foot progression angle in children with diplegic cerebral palsy

Research

A neuroprosthesis for tremor management through the control of muscle co-contraction