Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2020

01-12-2020 | Dementia | Research

Assessment of Parkinsonian gait in older adults with dementia via human pose tracking in video data

Authors: Andrea Sabo, Sina Mehdizadeh, Kimberley-Dale Ng, Andrea Iaboni, Babak Taati

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2020

Login to get access

Abstract

Background

Parkinsonism is common in people with dementia, and is associated with neurodegenerative and vascular changes in the brain, or with exposure to antipsychotic or other dopamine antagonist medications. The detection of parkinsonian changes to gait may provide an opportunity to intervene and address reversible causes. In this study, we investigate the use of a vision-based system as an unobtrusive means to assess severity of parkinsonism in gait.

Methods

Videos of walking bouts of natural gait were collected in a specialized dementia unit using a Microsoft Kinect sensor and onboard color camera, and were processed to extract sixteen 3D and eight 2D gait features. Univariate regression to gait quality, as rated on the Unified Parkinson’s Disease Rating Scale (UPDRS) and Simpson-Angus Scale (SAS), was used to identify gait features significantly correlated to these clinical scores for inclusion in multivariate models. Multivariate ordinal logistic regression was subsequently performed and the relative contribution of each gait feature for regression to UPDRS-gait and SAS-gait scores was assessed.

Results

Four hundred one walking bouts from 14 older adults with dementia were included in the analysis. Multivariate ordinal logistic regression models incorporating selected 2D or 3D gait features attained similar accuracies: the UPDRS-gait regression models achieved accuracies of 61.4 and 62.1% for 2D and 3D features, respectively. Similarly, the SAS-gait models achieved accuracies of 47.4 and 48.5% with 2D or 3D gait features, respectively.

Conclusions

Gait features extracted from both 2D and 3D videos are correlated to UPDRS-gait and SAS-gait scores of parkinsonism severity in gait. Vision-based systems have the potential to be used as tools for longitudinal monitoring of parkinsonism in residential settings.
Appendix
Available only for authorised users
Literature
1.
go back to reference Allan LM, Ballard CG, Burn DJ, Kenny RA. Prevalence and severity of gait disorders in Alzheimer’s and non-Alzheimer’s dementias. J Am Geriatr Soc. Wiley Online Library. 2005;53:1681–7.CrossRef Allan LM, Ballard CG, Burn DJ, Kenny RA. Prevalence and severity of gait disorders in Alzheimer’s and non-Alzheimer’s dementias. J Am Geriatr Soc. Wiley Online Library. 2005;53:1681–7.CrossRef
2.
go back to reference Caligiuri M, Jeste D, Lacro J. Antipsychotic-induced movement disorders in the elderly. Drugs Aging. 2000;17:363–84.CrossRef Caligiuri M, Jeste D, Lacro J. Antipsychotic-induced movement disorders in the elderly. Drugs Aging. 2000;17:363–84.CrossRef
3.
go back to reference Rochon PA, Stukel TA, Sykora K, Gill S, Garfinkel S, Anderson GM, et al. Atypical antipsychotics and parkinsonism. Archives of internal medicine. Am Med Assoc. 2005;165:1882–8. Rochon PA, Stukel TA, Sykora K, Gill S, Garfinkel S, Anderson GM, et al. Atypical antipsychotics and parkinsonism. Archives of internal medicine. Am Med Assoc. 2005;165:1882–8.
4.
go back to reference Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. Wiley Online Library. 2008;23:2129–70.CrossRef Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. Wiley Online Library. 2008;23:2129–70.CrossRef
5.
go back to reference Simpson GM, Angus JWS. A rating scale for extrapyramidal side effects. Acta Psychiatr Scand. Wiley Online Library. 1970;45:11–9.CrossRef Simpson GM, Angus JWS. A rating scale for extrapyramidal side effects. Acta Psychiatr Scand. Wiley Online Library. 1970;45:11–9.CrossRef
8.
go back to reference De Lima ALS, Hahn T, Evers LJW, De Vries NM, Cohen E, Afek M, et al. Feasibility of large-scale deployment of multiple wearable sensors in Parkinson’s disease. PLoS One. Public Library of Science. 2017;12:e0189161.CrossRef De Lima ALS, Hahn T, Evers LJW, De Vries NM, Cohen E, Afek M, et al. Feasibility of large-scale deployment of multiple wearable sensors in Parkinson’s disease. PLoS One. Public Library of Science. 2017;12:e0189161.CrossRef
9.
go back to reference Caramia C, Torricelli D, Schmid M, Muñoz-Gonzalez A, Gonzalez-Vargas J, Grandas F, et al. IMU-based classification of Parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J Biomed Health Inform. IEEE. 2018;22:1765–74.CrossRef Caramia C, Torricelli D, Schmid M, Muñoz-Gonzalez A, Gonzalez-Vargas J, Grandas F, et al. IMU-based classification of Parkinson’s disease from gait: a sensitivity analysis on sensor location and feature selection. IEEE J Biomed Health Inform. IEEE. 2018;22:1765–74.CrossRef
10.
go back to reference Eltoukhy M. Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson’s disease. Med Eng Phys. Butterworth-Heinemann. 2017;44:1–7.CrossRef Eltoukhy M. Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson’s disease. Med Eng Phys. Butterworth-Heinemann. 2017;44:1–7.CrossRef
12.
go back to reference Galna B, Barry G, Jackson D, Mhiripiri D, Olivier P, Rochester L. Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson’s disease. Gait Posture. Elsevier. 2014;39:1062–8.CrossRef Galna B, Barry G, Jackson D, Mhiripiri D, Olivier P, Rochester L. Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson’s disease. Gait Posture. Elsevier. 2014;39:1062–8.CrossRef
13.
go back to reference Dranca L, de Abetxuko Ruiz de Mendarozketa L, Goñi A, Illarramendi A, Gomez IN, Alvarado MD, et al. Using Kinect to classify Parkinson’s disease stages related to severity of gait impairment. BMC Bioinformatics. Springer. 2018;19:471.CrossRef Dranca L, de Abetxuko Ruiz de Mendarozketa L, Goñi A, Illarramendi A, Gomez IN, Alvarado MD, et al. Using Kinect to classify Parkinson’s disease stages related to severity of gait impairment. BMC Bioinformatics. Springer. 2018;19:471.CrossRef
14.
go back to reference Jiao J, Yuan L, Tang W, Deng Z, Wu Q. A post-rectification approach of depth images of Kinect v2 for 3D reconstruction of indoor scenes. ISPRS Int J Geo Inform. Multidisciplinary Digital Publishing Institute. 2017;6:349.CrossRef Jiao J, Yuan L, Tang W, Deng Z, Wu Q. A post-rectification approach of depth images of Kinect v2 for 3D reconstruction of indoor scenes. ISPRS Int J Geo Inform. Multidisciplinary Digital Publishing Institute. 2017;6:349.CrossRef
15.
go back to reference Moon S, Park Y, Ko DW, Suh IH. Multiple kinect sensor fusion for human skeleton tracking using Kalman filtering. Int J Adv Robotic Syst. SAGE Publications Sage UK: London, England. 2016;13:65.CrossRef Moon S, Park Y, Ko DW, Suh IH. Multiple kinect sensor fusion for human skeleton tracking using Kalman filtering. Int J Adv Robotic Syst. SAGE Publications Sage UK: London, England. 2016;13:65.CrossRef
18.
go back to reference Wei SE, Ramakrishna V, Kanade T, Sheikh Y. Convolutional pose machines. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE Computer Society; 2016. p. 4724–32. Wei SE, Ramakrishna V, Kanade T, Sheikh Y. Convolutional pose machines. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE Computer Society; 2016. p. 4724–32.
19.
go back to reference Yan S, Xiong Y, Lin D. Spatial temporal graph convolutional networks for skeleton-based action recognition. Thirty-second AAAI conference on artificial intelligence; 2018. Yan S, Xiong Y, Lin D. Spatial temporal graph convolutional networks for skeleton-based action recognition. Thirty-second AAAI conference on artificial intelligence; 2018.
20.
go back to reference Li MH, Mestre TA, Fox SH, Taati B. Vision-based assessment of parkinsonism and levodopa-induced dyskinesia with pose estimation. J Neuroeng Rehabil. BioMed Central. 2018;15:97.CrossRef Li MH, Mestre TA, Fox SH, Taati B. Vision-based assessment of parkinsonism and levodopa-induced dyskinesia with pose estimation. J Neuroeng Rehabil. BioMed Central. 2018;15:97.CrossRef
21.
go back to reference Li MH, Mestre TA, Fox SH, Taati B. Automated assessment of levodopa-induced dyskinesia: evaluating the responsiveness of video-based features. Parkinsonism Relat Disord. The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, Oxon, England: Elsevier Sci Ltd. 2018;53:42–5.CrossRef Li MH, Mestre TA, Fox SH, Taati B. Automated assessment of levodopa-induced dyskinesia: evaluating the responsiveness of video-based features. Parkinsonism Relat Disord. The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, Oxon, England: Elsevier Sci Ltd. 2018;53:42–5.CrossRef
24.
go back to reference Cao Z, Simon T, Wei S-E, Sheikh Y. Realtime multi-person 2d pose estimation using part affinity fields, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2017. p. 7291–9. Cao Z, Simon T, Wei S-E, Sheikh Y. Realtime multi-person 2d pose estimation using part affinity fields, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2017. p. 7291–9.
25.
go back to reference Dolatabadi E, Taati B, Mihailidis A. Automated classification of pathological gait after stroke using ubiquitous sensing technology, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Orlando: IEEE; 2016. p. 6150–3. Dolatabadi E, Taati B, Mihailidis A. Automated classification of pathological gait after stroke using ubiquitous sensing technology, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Orlando: IEEE; 2016. p. 6150–3.
29.
go back to reference Ng K-DRB. Vision based human pose estimation for gait assessment of older adults with dementia. ProQuest Dissertations and Theses. 2019. Ng K-DRB. Vision based human pose estimation for gait assessment of older adults with dementia. ProQuest Dissertations and Theses. 2019.
31.
go back to reference Roiz Rde M, EWA C, Pazinatto MM, Reis JG, Cliquet A Jr, Barasnevicius-Quagliato E. Gait analysis comparing Parkinson’s disease with healthy elderly subjects. Arq Neuropsiquiatr. SciELO Brasil. 2010;68:81–6.CrossRef Roiz Rde M, EWA C, Pazinatto MM, Reis JG, Cliquet A Jr, Barasnevicius-Quagliato E. Gait analysis comparing Parkinson’s disease with healthy elderly subjects. Arq Neuropsiquiatr. SciELO Brasil. 2010;68:81–6.CrossRef
32.
go back to reference Mirelman A, Bonato P, Camicioli R, Ellis TD, Giladi N, Hamilton JL, et al. Gait impairments in Parkinson’s disease. Lancet Neurol. Elsevier. 2019;18(7):697–708.CrossRef Mirelman A, Bonato P, Camicioli R, Ellis TD, Giladi N, Hamilton JL, et al. Gait impairments in Parkinson’s disease. Lancet Neurol. Elsevier. 2019;18(7):697–708.CrossRef
34.
go back to reference Post B, Merkus MP, de Bie RMA, de Haan RJ, Speelman JD. Unified Parkinson’s disease rating scale motor examination: are ratings of nurses, residents in neurology, and movement disorders specialists interchangeable? Mov Disord. 2005;20:1577–84. John Wiley & Sons, Ltd. Available from. https://doi.org/10.1002/mds.20640.CrossRefPubMed Post B, Merkus MP, de Bie RMA, de Haan RJ, Speelman JD. Unified Parkinson’s disease rating scale motor examination: are ratings of nurses, residents in neurology, and movement disorders specialists interchangeable? Mov Disord. 2005;20:1577–84. John Wiley & Sons, Ltd. Available from. https://​doi.​org/​10.​1002/​mds.​20640.CrossRefPubMed
Metadata
Title
Assessment of Parkinsonian gait in older adults with dementia via human pose tracking in video data
Authors
Andrea Sabo
Sina Mehdizadeh
Kimberley-Dale Ng
Andrea Iaboni
Babak Taati
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2020
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-020-00728-9

Other articles of this Issue 1/2020

Journal of NeuroEngineering and Rehabilitation 1/2020 Go to the issue