Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2009

Open Access 01-12-2009 | Research

Infrared thermography as an access pathway for individuals with severe motor impairments

Authors: Negar Memarian, Anastasios N Venetsanopoulos, Tom Chau

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2009

Login to get access

Abstract

Background

People with severe motor impairments often require an alternative access pathway, such as a binary switch, to communicate and to interact with their environment. A wide range of access pathways have been developed from simple mechanical switches to sophisticated physiological ones. In this manuscript we report the inaugural investigation of infrared thermography as a non-invasive and non-contact access pathway by which individuals with disabilities can interact and perhaps eventually communicate.

Methods

Our method exploits the local temperature changes associated with mouth opening/closing to enable a highly sensitive and specific binary switch. Ten participants (two with severe disabilities) provided examples of mouth opening and closing. Thermographic videos of each participant were recorded with an infrared thermal camera and processed using a computerized algorithm. The algorithm detected a mouth open-close pattern using a combination of adaptive thermal intensity filtering, motion tracking and morphological analysis.

Results

High detection sensitivity and low error rate were achieved for the majority of the participants (mean sensitivity of all participants: 88.5% ± 11.3; mean specificity of all participants: 99.4% ± 0.7). The algorithm performance was robust against participant motion and changes in the background scene.

Conclusion

Our findings suggest that further research on the infrared thermographic access pathway is warranted. Flexible camera location, convenience of use and robustness to ambient lighting levels, changes in background scene and extraneous body movements make this a potential new access modality that can be used night or day in unconstrained environments.
Appendix
Available only for authorised users
Literature
1.
go back to reference Tai K, Blain S, Chau T: A review of emerging access technologies for individuals with severe motor impairments. Assistive Technology 2008, 20: 204-219.CrossRefPubMed Tai K, Blain S, Chau T: A review of emerging access technologies for individuals with severe motor impairments. Assistive Technology 2008, 20: 204-219.CrossRefPubMed
2.
go back to reference Sellers EW, Kubler A, Donchin E: Brain-computer interface research at the university of South Florida cognitive psychophysiology laboratory: the P300 speller. IEEE Transactions on Neurological Systems and Rehabilitation Engineering (Special Issue on Brain-Computer Inerfaces) 2006,14(2):221-224.CrossRef Sellers EW, Kubler A, Donchin E: Brain-computer interface research at the university of South Florida cognitive psychophysiology laboratory: the P300 speller. IEEE Transactions on Neurological Systems and Rehabilitation Engineering (Special Issue on Brain-Computer Inerfaces) 2006,14(2):221-224.CrossRef
3.
go back to reference Piccione F, Giorgi F, Tonin P, Priftis K, Giove S, Silvoni S, Palmas G, Beverina F: P300-based brain computer interface: Reliability and performance in healthy and paralyzed participants. Clinical Neurophysiology 2006,117(3):531-537.CrossRefPubMed Piccione F, Giorgi F, Tonin P, Priftis K, Giove S, Silvoni S, Palmas G, Beverina F: P300-based brain computer interface: Reliability and performance in healthy and paralyzed participants. Clinical Neurophysiology 2006,117(3):531-537.CrossRefPubMed
4.
go back to reference Coyle SM, Ward TE, Markham CM: Brain-computer interface using a simplified functional near-infrared spectroscopy system. J Neural Eng 2007, 4: 219-226.CrossRefPubMed Coyle SM, Ward TE, Markham CM: Brain-computer interface using a simplified functional near-infrared spectroscopy system. J Neural Eng 2007, 4: 219-226.CrossRefPubMed
5.
go back to reference Sitaram R, Zhang H, Guan C, Thulasidas M, Hoshi Y, Ishikawa A, Shimizu K, Birbaumer N: Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. NeuroImage 2007, 34: 1416-1427.CrossRefPubMed Sitaram R, Zhang H, Guan C, Thulasidas M, Hoshi Y, Ishikawa A, Shimizu K, Birbaumer N: Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. NeuroImage 2007, 34: 1416-1427.CrossRefPubMed
6.
go back to reference Naito M, Michioka Y, Ozawa K, Ito Y, Kiguchi M, Kanazawa T: A communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light. IEICE Transactions on Information and Systems, E90D(7) 2007, 1028-1037. Naito M, Michioka Y, Ozawa K, Ito Y, Kiguchi M, Kanazawa T: A communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light. IEICE Transactions on Information and Systems, E90D(7) 2007, 1028-1037.
7.
go back to reference Blain S, Mihailidis A, Chau T: Assessing the potential of electrodermal activity as an alternative access pathway. Medical engineering & physics 2008,30(4):498-505.CrossRef Blain S, Mihailidis A, Chau T: Assessing the potential of electrodermal activity as an alternative access pathway. Medical engineering & physics 2008,30(4):498-505.CrossRef
8.
go back to reference Tsukahara R, Aoki H: Skin potential response in letter recognition task as an alternative communication channel for individuals with severe motor disability. Clinical Neurophysiology 2002, 113: 1723-1733.CrossRefPubMed Tsukahara R, Aoki H: Skin potential response in letter recognition task as an alternative communication channel for individuals with severe motor disability. Clinical Neurophysiology 2002, 113: 1723-1733.CrossRefPubMed
9.
go back to reference Jones BF: A reappraisal of the use of infrared thermal image analysis in medicine. IEEE Transactions on Medical Imaging 1998,17(6):1019-1027.CrossRefPubMed Jones BF: A reappraisal of the use of infrared thermal image analysis in medicine. IEEE Transactions on Medical Imaging 1998,17(6):1019-1027.CrossRefPubMed
10.
go back to reference Lupo J, Balcerak R: The physical basis of thermal imaging. Proc. 22nd Annual Conf. IEEE Engineering in Medicine and Biology Society. Chicago 2000. Lupo J, Balcerak R: The physical basis of thermal imaging. Proc. 22nd Annual Conf. IEEE Engineering in Medicine and Biology Society. Chicago 2000.
11.
go back to reference Jones BF, Plassmann P: Digital infrared thermal imaging of human skin. IEEE Eng Med Biol Mag 2002, 21: 41-48.CrossRefPubMed Jones BF, Plassmann P: Digital infrared thermal imaging of human skin. IEEE Eng Med Biol Mag 2002, 21: 41-48.CrossRefPubMed
12.
go back to reference Qi H, Diakides NA: Thermal Infrared Imaging in Early Breast Cancer Detection – A Survey of Recent Research. Proceedings of the 25' Annual International Conference of the IEEE EMBS. Cancun, Mexico 2003, 17-21. Qi H, Diakides NA: Thermal Infrared Imaging in Early Breast Cancer Detection – A Survey of Recent Research. Proceedings of the 25' Annual International Conference of the IEEE EMBS. Cancun, Mexico 2003, 17-21.
13.
go back to reference Gautherie M: Atlas of breast themogmphy with specific guidelines for eramination and interpretation. Milan, Italy, PAPUSA; 1989. Gautherie M: Atlas of breast themogmphy with specific guidelines for eramination and interpretation. Milan, Italy, PAPUSA; 1989.
14.
go back to reference Okada Y, Kawamata T, Kawashima A, Hori T: Intraoperative application of thermography in extracranial-intracranial bypass surgery. Neurosurgery 2007,60(4 Suppl 2):362-365.PubMed Okada Y, Kawamata T, Kawashima A, Hori T: Intraoperative application of thermography in extracranial-intracranial bypass surgery. Neurosurgery 2007,60(4 Suppl 2):362-365.PubMed
15.
go back to reference Watson JC, Gorbach AM, Pluta RM, Rak R, Heiss JD, Oldfield EH: Real-time detection of vascular occlusion and reperfusion of the brain during surgery by using infrared imaging. J Neurosurg 2002, 96: 918-923.CrossRefPubMed Watson JC, Gorbach AM, Pluta RM, Rak R, Heiss JD, Oldfield EH: Real-time detection of vascular occlusion and reperfusion of the brain during surgery by using infrared imaging. J Neurosurg 2002, 96: 918-923.CrossRefPubMed
16.
go back to reference Madjid M, Willerson JT, Casscells SW: Intracoronary thermography for detection of high-risk vulnerable plaques. J Am Coll Cardiol 2006,47(8 Suppl):C80-C85.CrossRefPubMed Madjid M, Willerson JT, Casscells SW: Intracoronary thermography for detection of high-risk vulnerable plaques. J Am Coll Cardiol 2006,47(8 Suppl):C80-C85.CrossRefPubMed
17.
go back to reference Ring F, Harding R: Infrared thermal imaging in peripheral vascular diseases. World Congress on Medical Physics and Biomedical Engineering. Chicago 2000. Ring F, Harding R: Infrared thermal imaging in peripheral vascular diseases. World Congress on Medical Physics and Biomedical Engineering. Chicago 2000.
18.
go back to reference Spalding SJ, Kwoh CK, Boudreau R, Enama J, Lunich J, Huber D, Denes L, Hirsch R: Three-dimensional and thermal surface imaging produces reliable measures of joint shape and temperature: a potential tool for quantifying arthritis. Arthritis Research & Therapy 2008, 10: R10.CrossRef Spalding SJ, Kwoh CK, Boudreau R, Enama J, Lunich J, Huber D, Denes L, Hirsch R: Three-dimensional and thermal surface imaging produces reliable measures of joint shape and temperature: a potential tool for quantifying arthritis. Arthritis Research & Therapy 2008, 10: R10.CrossRef
19.
go back to reference Herry CL, Frize M: Quantitative assessment of pain-related thermal dysfunction through clinical digital infrared thermal imaging. BioMedical Engineering OnLine 2004, 3: 19.PubMedCentralCrossRefPubMed Herry CL, Frize M: Quantitative assessment of pain-related thermal dysfunction through clinical digital infrared thermal imaging. BioMedical Engineering OnLine 2004, 3: 19.PubMedCentralCrossRefPubMed
20.
go back to reference Rose AD, Kanade V: Thermal imaging study comparing phacoemulsification with the sovereign with WhiteStar System to the legacy with AdvanTec and NeoSoniX System. American Journal of Ophthalmology 2006,141(2):322-326.CrossRefPubMed Rose AD, Kanade V: Thermal imaging study comparing phacoemulsification with the sovereign with WhiteStar System to the legacy with AdvanTec and NeoSoniX System. American Journal of Ophthalmology 2006,141(2):322-326.CrossRefPubMed
21.
go back to reference Murthy R, Pavlidis I: Non-contact measurement of breathing function. IEEE Engineering in Medicine and Biology Magazine 2006,25(3):57-67.CrossRefPubMed Murthy R, Pavlidis I: Non-contact measurement of breathing function. IEEE Engineering in Medicine and Biology Magazine 2006,25(3):57-67.CrossRefPubMed
22.
go back to reference Morimoto T, Takada K, Huiya H, Yasuda Y, Sakuda M: Changes in facial skin temperature associated with chewing efforts in man: a thermographic evaluation. Archs oral Biol 1991,36(9):665-760.CrossRef Morimoto T, Takada K, Huiya H, Yasuda Y, Sakuda M: Changes in facial skin temperature associated with chewing efforts in man: a thermographic evaluation. Archs oral Biol 1991,36(9):665-760.CrossRef
23.
go back to reference Tu J, Tao H, Huang T: Face as mouse through visual face tracking. Computer Vision and Image Understanding 2007, 108: 35-40.CrossRef Tu J, Tao H, Huang T: Face as mouse through visual face tracking. Computer Vision and Image Understanding 2007, 108: 35-40.CrossRef
24.
26.
go back to reference Zaproudina N, Varmavuo V, Airaksinen O, Narhi M: Reproducibility of infrared thermography measurements in healthy individuals. Physiological Measurement 2008,29(4):515-524.CrossRefPubMed Zaproudina N, Varmavuo V, Airaksinen O, Narhi M: Reproducibility of infrared thermography measurements in healthy individuals. Physiological Measurement 2008,29(4):515-524.CrossRefPubMed
27.
go back to reference Otsu N: A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics 1979, 9: 62-66.CrossRef Otsu N: A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics 1979, 9: 62-66.CrossRef
28.
go back to reference Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB. New Jersey: Pearson Prentice Hall; 2004. Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB. New Jersey: Pearson Prentice Hall; 2004.
29.
go back to reference Barron JL, Fleet DJ, Beauchemin SS, Burkitt TA: Performance of optical flow techniques. Proceedings of IEEE Computer Society Conference on Computer Vision and Patter Recognition (CVPR): 1992; Los Alamitos, CA 1996, 236-242. Barron JL, Fleet DJ, Beauchemin SS, Burkitt TA: Performance of optical flow techniques. Proceedings of IEEE Computer Society Conference on Computer Vision and Patter Recognition (CVPR): 1992; Los Alamitos, CA 1996, 236-242.
30.
go back to reference Uematsu S: Symmetry of skin temperature comparing one side of the body to the other. Thermology 1986, 1: 4-7. Uematsu S: Symmetry of skin temperature comparing one side of the body to the other. Thermology 1986, 1: 4-7.
31.
go back to reference Bailar JC, Meyer EA, Pool R, Editors: Assessment of the NIOSH head-and-face anthropometric survey of U.S. respirator users. The National Academic Press; 2007. Bailar JC, Meyer EA, Pool R, Editors: Assessment of the NIOSH head-and-face anthropometric survey of U.S. respirator users. The National Academic Press; 2007.
32.
go back to reference DeCarlo D, Metaxas D, Stone M: An anthropometric face model using variational techniques. Proceedings SIGGRAPH; 1998; Orlando, FL 1998, 67-74. DeCarlo D, Metaxas D, Stone M: An anthropometric face model using variational techniques. Proceedings SIGGRAPH; 1998; Orlando, FL 1998, 67-74.
33.
go back to reference Moriyamashi T, Tagucihi H, Mishima Y: Relation between the brain waves, face temperature and blood pressure using nonintrusive blood pressure monitor and the environments. Proceedings of the 35th SICE Annual Conference. International Session Papers: July 24–26 1996; Tottori, Japan 1996, 1205-1208.CrossRef Moriyamashi T, Tagucihi H, Mishima Y: Relation between the brain waves, face temperature and blood pressure using nonintrusive blood pressure monitor and the environments. Proceedings of the 35th SICE Annual Conference. International Session Papers: July 24–26 1996; Tottori, Japan 1996, 1205-1208.CrossRef
34.
go back to reference MobIR® M4 Thermal Camera User Manual. China: Wuhan Guide Infrared Technology Co., Ltd. Wuhan; 2005. MobIR® M4 Thermal Camera User Manual. China: Wuhan Guide Infrared Technology Co., Ltd. Wuhan; 2005.
35.
go back to reference Wang J, Sung E: Facial feature extraction in an infrared image by proxy with a visible face image. IEEE Transactions on Instrumentation and Measurement 2007,56(4):2057-2066.CrossRef Wang J, Sung E: Facial feature extraction in an infrared image by proxy with a visible face image. IEEE Transactions on Instrumentation and Measurement 2007,56(4):2057-2066.CrossRef
Metadata
Title
Infrared thermography as an access pathway for individuals with severe motor impairments
Authors
Negar Memarian
Anastasios N Venetsanopoulos
Tom Chau
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2009
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/1743-0003-6-11

Other articles of this Issue 1/2009

Journal of NeuroEngineering and Rehabilitation 1/2009 Go to the issue