Skip to main content
Top
Published in: BMC Medical Imaging 1/2019

Open Access 01-12-2019 | Facial Palsy | Technical advance

paraFaceTest: an ensemble of regression tree-based facial features extraction for efficient facial paralysis classification

Authors: Jocelyn Barbosa, Woo-Keun Seo, Jaewoo Kang

Published in: BMC Medical Imaging | Issue 1/2019

Login to get access

Abstract

Background

Facial paralysis (FP) is a neuromotor dysfunction that losses voluntary muscles movement in one side of the human face. As the face is the basic means of social interactions and emotional expressions among humans, individuals afflicted can often be introverted and may develop psychological distress, which can be even more severe than the physical disability. This paper addresses the problem of objective facial paralysis evaluation.

Methods

We present a novel approach for objective facial paralysis evaluation and classification, which is crucial for deciding the medical treatment scheme. For FP classification, in particular, we proposed a method based on the ensemble of regression trees to efficiently extract facial salient points and detect iris or sclera boundaries. We also employ 2nd degree polynomial of parabolic function to improve Daugman’s algorithm for detecting occluded iris boundaries, thereby allowing us to efficiently get the area of the iris. The symmetry score of each face is measured by calculating the ratio of both iris area and the distances between the key points in both sides of the face. We build a model by employing hybrid classifier that discriminates healthy from unhealthy subjects and performs FP classification.

Results

Objective analysis was conducted to evaluate the performance of the proposed method. As we explore the effect of data augmentation using publicly available datasets of facial expressions, experiments reveal that the proposed approach demonstrates efficiency.

Conclusions

Extraction of iris and facial salient points on images based on ensemble of regression trees along with our hybrid classifier (classification tree plus regularized logistic regression) provides a more improved way of addressing FP classification problem. It addresses the common limiting factor introduced in the previous works, i.e. having the greater sensitivity to subjects exposed to peculiar facial images, whereby improper identification of initial evolving curve for facial feature segmentation results to inaccurate facial feature extraction. Leveraging ensemble of regression trees provides accurate salient points extraction, which is crucial for revealing the significant difference between the healthy and the palsy side when performing different facial expressions.
Literature
1.
go back to reference Baugh R, Ishii G, RSchwartz S, Drumheller CM, Burkholder R, Deckard N, Dawson C, Driscoll C, BoydGillespie M. Clinical practice guideline bellspalsy. Otolaryngol-Head Neck Surg. 2013; 149:1–27.CrossRef Baugh R, Ishii G, RSchwartz S, Drumheller CM, Burkholder R, Deckard N, Dawson C, Driscoll C, BoydGillespie M. Clinical practice guideline bellspalsy. Otolaryngol-Head Neck Surg. 2013; 149:1–27.CrossRef
2.
go back to reference Peitersen E. Bell’s palsy: the spontaneous course of 2,500 peripheral facialnerve palsies of different etiologies. Acta OtoLaryngol. 2002; 122(7):4–30.CrossRef Peitersen E. Bell’s palsy: the spontaneous course of 2,500 peripheral facialnerve palsies of different etiologies. Acta OtoLaryngol. 2002; 122(7):4–30.CrossRef
3.
go back to reference Kanerva M. Peripheral facial palsy grading, etiology, and melkersson–rosenthal syndrome. PhD thesis. Finland: University of Helsinki; 2008. Kanerva M. Peripheral facial palsy grading, etiology, and melkersson–rosenthal syndrome. PhD thesis. Finland: University of Helsinki; 2008.
4.
go back to reference Barbosa J, Lee K, Lee S, Lodhi B, Cho J, Seo W, Kang J. Efficient quantitative assessment of facial paralysis using iris segmentation and active contour-based key points detection with hybrid classifier. BMC Med Imaging. 2016; 16:23–40.CrossRef Barbosa J, Lee K, Lee S, Lodhi B, Cho J, Seo W, Kang J. Efficient quantitative assessment of facial paralysis using iris segmentation and active contour-based key points detection with hybrid classifier. BMC Med Imaging. 2016; 16:23–40.CrossRef
5.
go back to reference May M. Anatomy for the clinician In: May M, Schaitkin B, editors. The Facial Nerve, May’s Second Edition. 2nd. New York: Thieme, New York: 2000. p. 19–56. May M. Anatomy for the clinician In: May M, Schaitkin B, editors. The Facial Nerve, May’s Second Edition. 2nd. New York: Thieme, New York: 2000. p. 19–56.
6.
go back to reference Wachtman GS, Liu Y, Zhao T, Cohn J, Schmidt K, Henkelmann TC, VanSwearingen JM, Manders EK. Measurement of asymmetry in persons with facial paralysis. In: Combined Annu Conf. Robert H. Ivy. Ohio Valley: Societies of Plastic and Reconstructive Surgeons: 2002. Wachtman GS, Liu Y, Zhao T, Cohn J, Schmidt K, Henkelmann TC, VanSwearingen JM, Manders EK. Measurement of asymmetry in persons with facial paralysis. In: Combined Annu Conf. Robert H. Ivy. Ohio Valley: Societies of Plastic and Reconstructive Surgeons: 2002.
7.
go back to reference Liu Y, Schmidt K, Cohn J, Mitra S. Facial asymmetry quantification for expression invariant human identification. Comput Vis Image Underst J. 2003; 91:138–59.CrossRef Liu Y, Schmidt K, Cohn J, Mitra S. Facial asymmetry quantification for expression invariant human identification. Comput Vis Image Underst J. 2003; 91:138–59.CrossRef
8.
go back to reference He S, Soraghan J, O’Reilly B, Xing D. Quantitative analysis of facial paralysis using local binary patterns in biomedical videos. IEEE Trans Biomed Eng. 2009; 56:1864–70.CrossRef He S, Soraghan J, O’Reilly B, Xing D. Quantitative analysis of facial paralysis using local binary patterns in biomedical videos. IEEE Trans Biomed Eng. 2009; 56:1864–70.CrossRef
9.
go back to reference Wang S, Li H, Qi F, Zhao Y. Objective facial paralysis grading based on pface and eigenflow. Med Biol Eng Comput. 2004; 42:598–603.CrossRef Wang S, Li H, Qi F, Zhao Y. Objective facial paralysis grading based on pface and eigenflow. Med Biol Eng Comput. 2004; 42:598–603.CrossRef
10.
go back to reference Anguraj K, Padma S. Analysis of facial paralysis disease using image processing technique. Int J Comput Appl(0975 – 8887). 2012; 54:1–4. Anguraj K, Padma S. Analysis of facial paralysis disease using image processing technique. Int J Comput Appl(0975 – 8887). 2012; 54:1–4.
11.
go back to reference Dong J, Ma L, Li W, Wang S, Liu L, Lin Y, Jian M. An approach for quantitative evaluation of the degree of facial paralysis based on salient point detection. In: International Symposium on Intelligent Information Technology Application Workshops. New York City: IEEE: 2008. Dong J, Ma L, Li W, Wang S, Liu L, Lin Y, Jian M. An approach for quantitative evaluation of the degree of facial paralysis based on salient point detection. In: International Symposium on Intelligent Information Technology Application Workshops. New York City: IEEE: 2008.
12.
go back to reference Liu L, Cheng G, Dong J, Qu H. Evaluation of facial paralysis degree based on regions In: IEEE Computer Science Society Washington U.DC (ed.), editor. Third International Conference onKnowledge Discovery and Data Mining. Washington, DC: IEEE Computer Science Society: 2010. p. 514–7. Liu L, Cheng G, Dong J, Qu H. Evaluation of facial paralysis degree based on regions In: IEEE Computer Science Society Washington U.DC (ed.), editor. Third International Conference onKnowledge Discovery and Data Mining. Washington, DC: IEEE Computer Science Society: 2010. p. 514–7.
13.
go back to reference Liu L, Cheng G, Dong J, Qu H. Evaluation of facial paralysis degree based on regions. In: Proceedings of the 2010 Third International Conference onKnowledge Discovery and Data Mining. Washington, DC: IEEE Computer ScienceSociety: 2010. p. 514–7. Liu L, Cheng G, Dong J, Qu H. Evaluation of facial paralysis degree based on regions. In: Proceedings of the 2010 Third International Conference onKnowledge Discovery and Data Mining. Washington, DC: IEEE Computer ScienceSociety: 2010. p. 514–7.
14.
go back to reference Otsu N. A threshold selection method from gray-level histogram. IEEE Trans Syst, Man Cybern. 1979; 9:62–6.CrossRef Otsu N. A threshold selection method from gray-level histogram. IEEE Trans Syst, Man Cybern. 1979; 9:62–6.CrossRef
15.
go back to reference Kazemi V, Sullivan J. One millisecond face alignment with an ensemble of regression trees. In: Proc. IEEE Conf Comput Vis Pattern Recog. New York City: IEEE: 2014. p. 1867–1874. Kazemi V, Sullivan J. One millisecond face alignment with an ensemble of regression trees. In: Proc. IEEE Conf Comput Vis Pattern Recog. New York City: IEEE: 2014. p. 1867–1874.
16.
go back to reference Samsudin W, Sundaraj K. Image processing on facial paralysis for facial rehabilitation system: A review. In: IEEE International Conference on Control System, Computing and Engineering. Malaysia: IEEE: 2012. p. 259–63. Samsudin W, Sundaraj K. Image processing on facial paralysis for facial rehabilitation system: A review. In: IEEE International Conference on Control System, Computing and Engineering. Malaysia: IEEE: 2012. p. 259–63.
17.
go back to reference Fasel B, Luttin J. Automatic facial expression analysis: Survey. Pattern Recog. 2003; 36:259–75.CrossRef Fasel B, Luttin J. Automatic facial expression analysis: Survey. Pattern Recog. 2003; 36:259–75.CrossRef
18.
go back to reference Ngo T, Seo M, Chen Y, Matsushiro N. Quantitative assessment of facial paralysis using local binary patterns and gabor filters. In: Proceedings of the 5th International Symposium on Information and Communication Technology (SoICT). New York: ACM: 2014. p. 155–61. Ngo T, Seo M, Chen Y, Matsushiro N. Quantitative assessment of facial paralysis using local binary patterns and gabor filters. In: Proceedings of the 5th International Symposium on Information and Communication Technology (SoICT). New York: ACM: 2014. p. 155–61.
19.
go back to reference Déniz O, Bueno J, Salido F, De la Torre F. Face recognition using histograms of oriented gradients. Pattern Recog Lett. 2011; 32:1598–603.CrossRef Déniz O, Bueno J, Salido F, De la Torre F. Face recognition using histograms of oriented gradients. Pattern Recog Lett. 2011; 32:1598–603.CrossRef
20.
go back to reference Daugman J. How iris recognition works. New York City: IEEE: 2004. p. 21–30. vol. 14, IEEE Trans Circ Syst Vi Technol. Daugman J. How iris recognition works. New York City: IEEE: 2004. p. 21–30. vol. 14, IEEE Trans Circ Syst Vi Technol.
21.
go back to reference Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: Proc IEEE Conf Computer Vision and Pattern Recognition. New York City: IEEE: 2005. Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: Proc IEEE Conf Computer Vision and Pattern Recognition. New York City: IEEE: 2005.
22.
go back to reference Lyons M, Budynek J, Akamatsu S. Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell. 1999; 21(12):57–62.CrossRef Lyons M, Budynek J, Akamatsu S. Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell. 1999; 21(12):57–62.CrossRef
23.
go back to reference Lyons M, Akamatsu S, Kamachi M, Gyoba J. Coding facial expressions with gabor wavelets. In: Third IEEE Conf. Face and Gesture Recognition. IEEE: 1998. p. 200–5. Lyons M, Akamatsu S, Kamachi M, Gyoba J. Coding facial expressions with gabor wavelets. In: Third IEEE Conf. Face and Gesture Recognition. IEEE: 1998. p. 200–5.
24.
go back to reference Proenca H, Alexandre L. Ubiris: A noisy iris image database. In: Proceed. of ICIAP 2005 - Intern. Confer. on Image Analysis and Processing. United States: Springer Link: 2005. p. 970–977. Proenca H, Alexandre L. Ubiris: A noisy iris image database. In: Proceed. of ICIAP 2005 - Intern. Confer. on Image Analysis and Processing. United States: Springer Link: 2005. p. 970–977.
Metadata
Title
paraFaceTest: an ensemble of regression tree-based facial features extraction for efficient facial paralysis classification
Authors
Jocelyn Barbosa
Woo-Keun Seo
Jaewoo Kang
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Facial Palsy
Published in
BMC Medical Imaging / Issue 1/2019
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/s12880-019-0330-8

Other articles of this Issue 1/2019

BMC Medical Imaging 1/2019 Go to the issue