Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 5/2024

Open Access 18-01-2024 | Tremor | Original Article

Pose-based tremor type and level analysis for Parkinson’s disease from video

Authors: Haozheng Zhang, Edmond S. L. Ho, Francis Xiatian Zhang, Silvia Del Din, Hubert P. H. Shum

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 5/2024

Login to get access

Abstract

Purpose

Current methods for diagnosis of PD rely on clinical examination. The accuracy of diagnosis ranges between 73 and 84%, and is influenced by the experience of the clinical assessor. Hence, an automatic, effective and interpretable supporting system for PD symptom identification would support clinicians in making more robust PD diagnostic decisions.

Methods

We propose to analyze Parkinson’s tremor (PT) to support the analysis of PD, since PT is one of the most typical symptoms of PD with broad generalizability. To realize the idea, we present SPA-PTA, a deep learning-based PT classification and severity estimation system that takes consumer-grade videos of front-facing humans as input. The core of the system is a novel attention module with a lightweight pyramidal channel-squeezing–fusion architecture that effectively extracts relevant PT information and filters noise. It enhances modeling performance while improving system interpretability.

Results

We validate our system via individual-based leave-one-out cross-validation on two tasks: the PT classification task and the tremor severity rating estimation task. Our system presents a 91.3% accuracy and 80.0% F1-score in classifying PT with non-PT class, while providing a 76.4% accuracy and 76.7% F1-score in more complex multiclass tremor rating classification task.

Conclusion

Our system offers a cost-effective PT classification and tremor severity estimation results as warning signs of PD for undiagnosed patients with PT symptoms. In addition, it provides a potential solution for supporting PD diagnosis in regions with limited clinical resources.
Literature
1.
go back to reference Chopade P, Chopade N, Zhao Z, Mitragotri S, Liao R, Chandran Suja V (2023) Alzheimer’s and Parkinson’s disease therapies in the clinic. Bioeng Transl Med 8(1):10367CrossRef Chopade P, Chopade N, Zhao Z, Mitragotri S, Liao R, Chandran Suja V (2023) Alzheimer’s and Parkinson’s disease therapies in the clinic. Bioeng Transl Med 8(1):10367CrossRef
2.
go back to reference Mhyre TR, Boyd JT, Hamill RW (2012) Parkinson’s disease. Sub-cellular Biochem 65:389–455CrossRef Mhyre TR, Boyd JT, Hamill RW (2012) Parkinson’s disease. Sub-cellular Biochem 65:389–455CrossRef
3.
go back to reference Mostafa SA, Mustapha A, Mohammed MA, Hamed RI, Arunkumar N, Ghani M, Jaber MM, Khaleefah SH (2019) Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease. Cognit Syst Res 54:90–99CrossRef Mostafa SA, Mustapha A, Mohammed MA, Hamed RI, Arunkumar N, Ghani M, Jaber MM, Khaleefah SH (2019) Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease. Cognit Syst Res 54:90–99CrossRef
4.
go back to reference Rizzo G, Copetti M, Arcuti S, Martino D, Fontana A, Logroscino G (2016) Accuracy of clinical diagnosis of Parkinson disease: a systematic review and meta-analysis. Neurology 86(6):566–576CrossRefPubMed Rizzo G, Copetti M, Arcuti S, Martino D, Fontana A, Logroscino G (2016) Accuracy of clinical diagnosis of Parkinson disease: a systematic review and meta-analysis. Neurology 86(6):566–576CrossRefPubMed
6.
go back to reference Wang W, Lee J, Harrou F, Sun Y (2020) Early detection of Parkinson’s disease using deep learning and machine learning. IEEE Access 8:147635–147646CrossRef Wang W, Lee J, Harrou F, Sun Y (2020) Early detection of Parkinson’s disease using deep learning and machine learning. IEEE Access 8:147635–147646CrossRef
7.
go back to reference Vásquez-Correa JC, Arias-Vergara T, Orozco-Arroyave JR, Eskofier B, Klucken J, Nöth E (2018) Multimodal assessment of Parkinson’s disease: a deep learning approach. IEEE J Biomed Health Inform 23(4):1618–1630CrossRefPubMed Vásquez-Correa JC, Arias-Vergara T, Orozco-Arroyave JR, Eskofier B, Klucken J, Nöth E (2018) Multimodal assessment of Parkinson’s disease: a deep learning approach. IEEE J Biomed Health Inform 23(4):1618–1630CrossRefPubMed
8.
go back to reference Hausdorff JM (2009) Gait dynamics in Parkinson’s disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. Chaos 19(2):026113CrossRefPubMedPubMedCentral Hausdorff JM (2009) Gait dynamics in Parkinson’s disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. Chaos 19(2):026113CrossRefPubMedPubMedCentral
10.
go back to reference Hssayeni MD, Jimenez-Shahed J, Burack M, Ghoraani B (2019) Wearable sensors for estimation of parkinsonian tremor severity during free body movements. Sensors 19(19):4215CrossRefPubMedPubMedCentral Hssayeni MD, Jimenez-Shahed J, Burack M, Ghoraani B (2019) Wearable sensors for estimation of parkinsonian tremor severity during free body movements. Sensors 19(19):4215CrossRefPubMedPubMedCentral
11.
go back to reference Zhang H, Ho ESL, Zhang X, Shum HPH (2022) Pose-based tremor classification for Parkinson’s disease diagnosis from video. In: MICCAI Zhang H, Ho ESL, Zhang X, Shum HPH (2022) Pose-based tremor classification for Parkinson’s disease diagnosis from video. In: MICCAI
12.
go back to reference Fang H, Li J, Tang H, Xu C, Zhu H, Xiu Y, Li Y-L, Lu C (2022) Alphapose: whole-body regional multi-person pose estimation and tracking in real-time. IEEE Trans Pattern Anal Mach Intell 45:1–17 Fang H, Li J, Tang H, Xu C, Zhu H, Xiu Y, Li Y-L, Lu C (2022) Alphapose: whole-body regional multi-person pose estimation and tracking in real-time. IEEE Trans Pattern Anal Mach Intell 45:1–17
13.
go back to reference Liu W, Lin X, Chen X, Wang Q, Wang X, Yang B, Cai N, Chen R, Chen G, Lin Y (2023) Vision-based estimation of MDS-UPDRS scores for quantifying Parkinson’s disease tremor severity. MIA 85:102754 Liu W, Lin X, Chen X, Wang Q, Wang X, Yang B, Cai N, Chen R, Chen G, Lin Y (2023) Vision-based estimation of MDS-UPDRS scores for quantifying Parkinson’s disease tremor severity. MIA 85:102754
14.
go back to reference Nyquist H (1928) Certain topics in telegraph transmission theory. Trans Am Inst Electr Eng 47(2):617–644CrossRef Nyquist H (1928) Certain topics in telegraph transmission theory. Trans Am Inst Electr Eng 47(2):617–644CrossRef
15.
go back to reference Delval A, Rambour M, Tard C, Dujardin K, Devos D, Bleuse S, Defebvre L, Moreau C (2016) Freezing/festination during motor tasks in early-stage Parkinson’s disease: a prospective study. Mov Disord 31(12):1837–1845CrossRefPubMed Delval A, Rambour M, Tard C, Dujardin K, Devos D, Bleuse S, Defebvre L, Moreau C (2016) Freezing/festination during motor tasks in early-stage Parkinson’s disease: a prospective study. Mov Disord 31(12):1837–1845CrossRefPubMed
16.
go back to reference Wang J, Yan S, Xiong Y, Lin D (2020) Motion guided 3d pose estimation from videos. In: ECCV, pp 764–780 Wang J, Yan S, Xiong Y, Lin D (2020) Motion guided 3d pose estimation from videos. In: ECCV, pp 764–780
17.
go back to reference Sveinbjornsdottir S (2016) The clinical symptoms of Parkinson’s disease. J Neurochem 139:318–324CrossRefPubMed Sveinbjornsdottir S (2016) The clinical symptoms of Parkinson’s disease. J Neurochem 139:318–324CrossRefPubMed
18.
go back to reference Yan S, Xiong Y, Lin D (2018) Spatial temporal graph convolutional networks for skeleton-based action recognition. In: AAAI, vol 32 Yan S, Xiong Y, Lin D (2018) Spatial temporal graph convolutional networks for skeleton-based action recognition. In: AAAI, vol 32
19.
go back to reference Zhang W, Wang Y, You Z, Cao M, Huang P, Shan J, Yang Z, CUI B (2022) Information gain propagation: a new way to graph active learning with soft labels. In: ICLR Zhang W, Wang Y, You Z, Cao M, Huang P, Shan J, Yang Z, CUI B (2022) Information gain propagation: a new way to graph active learning with soft labels. In: ICLR
20.
go back to reference Fahn S (2003) Description of Parkinson’s disease as a clinical syndrome. Ann N Y Acad Sci 991(1):1–14CrossRefPubMed Fahn S (2003) Description of Parkinson’s disease as a clinical syndrome. Ann N Y Acad Sci 991(1):1–14CrossRefPubMed
21.
go back to reference Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR
22.
go back to reference Ci H, Ma X, Wang C, Wang Y (2020) Locally connected network for monocular 3d human pose estimation. IEEE Trans Pattern Anal Mach Intel 44(3):1429–1442CrossRef Ci H, Ma X, Wang C, Wang Y (2020) Locally connected network for monocular 3d human pose estimation. IEEE Trans Pattern Anal Mach Intel 44(3):1429–1442CrossRef
23.
go back to reference Lin T, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: ICCV, pp 2980–2988 Lin T, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: ICCV, pp 2980–2988
24.
go back to reference Pintea SL, Zheng J, Li X, Bank P, van Hilten JJ, van Gemert JC (2018) Hand-tremor frequency estimation in videos. In: ECCV Pintea SL, Zheng J, Li X, Bank P, van Hilten JJ, van Gemert JC (2018) Hand-tremor frequency estimation in videos. In: ECCV
25.
go back to reference Bain PG, Findley LJ, Atchison P, Behari M, Vidailhet M, Gresty M, Rothwell JC, Thompson PD, Marsden CD (1993) Assessing tremor severity. J Neurol Neurosurg Psychiatry 56(8):868–873CrossRefPubMedPubMedCentral Bain PG, Findley LJ, Atchison P, Behari M, Vidailhet M, Gresty M, Rothwell JC, Thompson PD, Marsden CD (1993) Assessing tremor severity. J Neurol Neurosurg Psychiatry 56(8):868–873CrossRefPubMedPubMedCentral
26.
go back to reference Lu M, Zhao Q, Poston KL, Sullivan EV, Pfefferbaum A, Shahid M, Katz M, Kouhsari LM, Schulman K, Milstein A (2021) Quantifying Parkinson’s disease motor severity under uncertainty using MDS-UPDRS videos. Med Image Anal 73:102179CrossRefPubMedPubMedCentral Lu M, Zhao Q, Poston KL, Sullivan EV, Pfefferbaum A, Shahid M, Katz M, Kouhsari LM, Schulman K, Milstein A (2021) Quantifying Parkinson’s disease motor severity under uncertainty using MDS-UPDRS videos. Med Image Anal 73:102179CrossRefPubMedPubMedCentral
27.
go back to reference Wang X, Garg S, Tran SN, Bai Q, Alty J (2021) Hand tremor detection in videos with cluttered background using neural network based approaches. Health Inf Sci Syst 9(30):1–14 Wang X, Garg S, Tran SN, Bai Q, Alty J (2021) Hand tremor detection in videos with cluttered background using neural network based approaches. Health Inf Sci Syst 9(30):1–14
Metadata
Title
Pose-based tremor type and level analysis for Parkinson’s disease from video
Authors
Haozheng Zhang
Edmond S. L. Ho
Francis Xiatian Zhang
Silvia Del Din
Hubert P. H. Shum
Publication date
18-01-2024
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 5/2024
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-03052-4

Other articles of this Issue 5/2024

International Journal of Computer Assisted Radiology and Surgery 5/2024 Go to the issue