Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2020

Open Access 01-12-2020 | Research

Validity and reliability of an accelerometer-based assessgame to quantify upper limb selective voluntary motor control

Authors: Jeffrey W. Keller, Annina Fahr, Julia Balzer, Jan Lieber, Hubertus J. A. van Hedel

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2020

Login to get access

Abstract

Introduction

Current clinical assessments measure selective voluntary motor control (SVMC) on an ordinal scale. We introduce a playful, interval-scaled method to assess SVMC in children with brain lesions and evaluate its validity and reliability.

Methods

Thirty-one neurologically intact children (median [1st-3rd quartile]: 11.6 years [8.5–13.9]) and 33 patients (12.2 years [8.8–14.9]) affected by upper motor neuron lesions with mild to moderate impairments participated. Using accelerometers, they played a movement tracking game (assessgame) with isolated joint movements (shoulder, elbow, lower arm [pro−/supination], wrist, and fingers), yielding an accuracy score. Involuntary movements were recorded simultaneously and resulted in an involuntary movement score. Both scores were normalized to the performance of 33 neurologically intact adults (32.5 years [27.9; 38.3]), which represented physiological movement patterns.
We correlated the assessgame outcomes with the Manual Ability Classification System, Selective Control of the Upper Extremity Scale, and a therapist rating of involuntary movements. Furthermore, a robust ANCOVA was performed with age as covariate, comparing patients to their healthy peers at the age levels of 7.5, 9, 10.5, 12, and 15 years.
Intraclass correlation coefficients and smallest real differences indicated relative and absolute reliability.

Results

Correlations (Kendall/Spearman) for the accuracy score were τ = 0.29 (p = 0.035; Manual Ability Classification System), ρ = − 0.37 (p = 0.035; Selective Control of the Upper Extremity Scale), and ρ = 0.64 (p < 0.001; therapist rating). Correlations for the involuntary movement metric were τ = 0.37 (p = 0.008), ρ = − 0.55 (p = 0.001), and ρ = 0.79 (p < 0.001), respectively. The robust ANCOVAs revealed that patients performed significantly poorer than their healthy peers in both outcomes and at all age levels except for the dominant/less affected arm, where the youngest age group did not differ significantly. Robust intraclass correlation coefficients and smallest real differences were 0.80 and 1.02 (46% of median patient score) for the accuracy and 0.92 and 2.55 (58%) for involuntary movements, respectively.

Conclusion

While this novel assessgame is valid, the reliability might need to be improved. Further studies are needed to determine whether the assessgame is sensitive enough to detect changes in SVMC after a surgical or therapeutic intervention.
Literature
1.
go back to reference Sanger TD, Chen D, Delgado MR, Gaebler-Spira D, Hallett M, Mink JW. Definition and classification of negative motor signs in childhood. Pediatrics. 2006;118(5):2159–67.PubMedCrossRef Sanger TD, Chen D, Delgado MR, Gaebler-Spira D, Hallett M, Mink JW. Definition and classification of negative motor signs in childhood. Pediatrics. 2006;118(5):2159–67.PubMedCrossRef
2.
go back to reference Kerr Graham H, Selber P. Musculoskeletal aspects of cerebral palsy. J Bone Jt Surg. 2003;85(2):157–66.CrossRef Kerr Graham H, Selber P. Musculoskeletal aspects of cerebral palsy. J Bone Jt Surg. 2003;85(2):157–66.CrossRef
3.
go back to reference Sahrmann SA, Norton BJ. The relationship of voluntary movement of spasticity in the upper motor neuron syndrome. Ann Neurol. 1977;2(6):460–5.PubMedCrossRef Sahrmann SA, Norton BJ. The relationship of voluntary movement of spasticity in the upper motor neuron syndrome. Ann Neurol. 1977;2(6):460–5.PubMedCrossRef
4.
go back to reference Voorman JM, Dallmeijer AJ, Knol DL, Lankhorst GJ, Becher JG. Prospective longitudinal study of gross motor function in children with cerebral palsy. Arch Phys Med Rehabil. 2007;88(7):871–6.PubMedCrossRef Voorman JM, Dallmeijer AJ, Knol DL, Lankhorst GJ, Becher JG. Prospective longitudinal study of gross motor function in children with cerebral palsy. Arch Phys Med Rehabil. 2007;88(7):871–6.PubMedCrossRef
5.
go back to reference Østensjø S, Carlberg E, Vølestad N. Motor impairments in young children with cerebral palsy: relationship to gross motor function and everyday activities. Dev Med Child Neurol. 2004;46(9):580–9.PubMedCrossRef Østensjø S, Carlberg E, Vølestad N. Motor impairments in young children with cerebral palsy: relationship to gross motor function and everyday activities. Dev Med Child Neurol. 2004;46(9):580–9.PubMedCrossRef
6.
go back to reference Gasser T, Rousson V, Caflisch J, Jenni OG. Development of motor speed and associated movements from 5 to 18 years. Dev Med Child Neurol. 2010;52(3):256–63..PubMedCrossRef Gasser T, Rousson V, Caflisch J, Jenni OG. Development of motor speed and associated movements from 5 to 18 years. Dev Med Child Neurol. 2010;52(3):256–63..PubMedCrossRef
7.
go back to reference Addamo PK, Farrow M, Bradshaw JL, Moss S, Georgiou-Karistianis N. The effect of attending to motor overflow on its voluntary inhibition in young and older adults. Brain Cogn. 2010;74(3):358–64.PubMedCrossRef Addamo PK, Farrow M, Bradshaw JL, Moss S, Georgiou-Karistianis N. The effect of attending to motor overflow on its voluntary inhibition in young and older adults. Brain Cogn. 2010;74(3):358–64.PubMedCrossRef
8.
go back to reference Addamo PK, Farrow M, Hoy KE, Bradshaw JL, Georgiou-Karistianis N. The effects of age and attention on motor overflow production-a review. Brain Res Rev. 2007;54(1):189–204.PubMedCrossRef Addamo PK, Farrow M, Hoy KE, Bradshaw JL, Georgiou-Karistianis N. The effects of age and attention on motor overflow production-a review. Brain Res Rev. 2007;54(1):189–204.PubMedCrossRef
9.
go back to reference Adler C, Berweck S, Lidzba K, Becher T, Staudt M. Mirror movements in unilateral spastic cerebral palsy: specific negative impact on bimanual activities of daily living. Eur J Paediatr Neurol. 2015;19(5):504–9.PubMedCrossRef Adler C, Berweck S, Lidzba K, Becher T, Staudt M. Mirror movements in unilateral spastic cerebral palsy: specific negative impact on bimanual activities of daily living. Eur J Paediatr Neurol. 2015;19(5):504–9.PubMedCrossRef
10.
go back to reference Machado LR, Heathcock J, Carvalho RP, Pereira ND, Tudella E. Kinematic characteristics of arm and trunk when drinking from a glass in children with and without cerebral palsy. Clin Biomech. 2019;63(June 2018):201–6.CrossRef Machado LR, Heathcock J, Carvalho RP, Pereira ND, Tudella E. Kinematic characteristics of arm and trunk when drinking from a glass in children with and without cerebral palsy. Clin Biomech. 2019;63(June 2018):201–6.CrossRef
11.
go back to reference Gordon AM. What does selective motor control of the upper extremity in cerebral palsy tell us? Dev Med Child Neurol. 2016;58(6):536–7.PubMedCrossRef Gordon AM. What does selective motor control of the upper extremity in cerebral palsy tell us? Dev Med Child Neurol. 2016;58(6):536–7.PubMedCrossRef
12.
go back to reference Wagner LV, Davids JR, Hardin JW. Selective control of the upper extremity scale: validation of a clinical assessment tool for children with hemiplegic cerebral palsy. Dev Med Child Neurol. 2016;58(6):612–7.PubMedCrossRef Wagner LV, Davids JR, Hardin JW. Selective control of the upper extremity scale: validation of a clinical assessment tool for children with hemiplegic cerebral palsy. Dev Med Child Neurol. 2016;58(6):612–7.PubMedCrossRef
13.
go back to reference Koerte I, Eftimov L, Laubender RP, Esslinger O, Schroeder AS, Ertl-Wagner B, et al. Mirror movements in healthy humans across the lifespan: effects of development and ageing. Dev Med Child Neurol. 2010;52(12):1106–12.PubMedCrossRef Koerte I, Eftimov L, Laubender RP, Esslinger O, Schroeder AS, Ertl-Wagner B, et al. Mirror movements in healthy humans across the lifespan: effects of development and ageing. Dev Med Child Neurol. 2010;52(12):1106–12.PubMedCrossRef
14.
go back to reference Jaspers E, Klingels K, Simon-Martinez C, Feys H, Woolley DG, Wenderoth N. GriFT: a device for quantifying physiological and pathological mirror movements in children. IEEE Trans Biomed Eng. 2018;65(4):857–65.PubMedCrossRef Jaspers E, Klingels K, Simon-Martinez C, Feys H, Woolley DG, Wenderoth N. GriFT: a device for quantifying physiological and pathological mirror movements in children. IEEE Trans Biomed Eng. 2018;65(4):857–65.PubMedCrossRef
17.
go back to reference Eliasson A-C, Krumlinde-Sundholm L, Rösblad B, Beckung E, Arner M, Ohrvall A-M, et al. The manual ability classification system (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. Dev Med Child Neurol. 2006;48(7):549–54.PubMedCrossRef Eliasson A-C, Krumlinde-Sundholm L, Rösblad B, Beckung E, Arner M, Ohrvall A-M, et al. The manual ability classification system (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. Dev Med Child Neurol. 2006;48(7):549–54.PubMedCrossRef
24.
go back to reference Mair P, Wilcox R. Robust statistical methods in R using the WRS2 package. Behav Res Methods. 2019;52:464–88. Mair P, Wilcox R. Robust statistical methods in R using the WRS2 package. Behav Res Methods. 2019;52:464–88.
25.
26.
go back to reference Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987;82(397):171–85.CrossRef Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987;82(397):171–85.CrossRef
27.
go back to reference Kakebeeke TH, Knaier E, Chaouch A, Caflisch J, Rousson V, Largo RH, et al. Neuromotor development in children. Part 4: new norms from 3 to 18 years. Dev Med Child Neurol. 2018;60(8):810–9.PubMedCrossRef Kakebeeke TH, Knaier E, Chaouch A, Caflisch J, Rousson V, Largo RH, et al. Neuromotor development in children. Part 4: new norms from 3 to 18 years. Dev Med Child Neurol. 2018;60(8):810–9.PubMedCrossRef
28.
go back to reference Baliz Y, Armatas C, Farrow M, Hoy KE, Fitzgerald PB, Bradshaw JL, et al. The influence of attention and age on the occurrence of mirror movements. J Int Neuropsychol Soc. 2005;11(7):855–62.PubMedCrossRef Baliz Y, Armatas C, Farrow M, Hoy KE, Fitzgerald PB, Bradshaw JL, et al. The influence of attention and age on the occurrence of mirror movements. J Int Neuropsychol Soc. 2005;11(7):855–62.PubMedCrossRef
29.
go back to reference Lazarus JC, Todor JI. The role of attention in the regulation of associated movement in children. Dev Med Child Neurol. 1991;33(1):32–9.PubMedCrossRef Lazarus JC, Todor JI. The role of attention in the regulation of associated movement in children. Dev Med Child Neurol. 1991;33(1):32–9.PubMedCrossRef
30.
go back to reference Kuhtz-Buschbeck JP, Sundholm LK, Eliasson AC, Forssberg H. Quantitative assessment of mirror movements in children and adolescents with hemiplegic cerebral palsy. Dev Med Child Neurol. 2000;42(11):728–36.PubMedCrossRef Kuhtz-Buschbeck JP, Sundholm LK, Eliasson AC, Forssberg H. Quantitative assessment of mirror movements in children and adolescents with hemiplegic cerebral palsy. Dev Med Child Neurol. 2000;42(11):728–36.PubMedCrossRef
32.
go back to reference Nilsson S, Enskär K, Hallqvist C, Kokinsky E. Active and passive distraction in children undergoing wound dressings. J Pediatr Nurs. 2013;28(2):158–66.PubMedCrossRef Nilsson S, Enskär K, Hallqvist C, Kokinsky E. Active and passive distraction in children undergoing wound dressings. J Pediatr Nurs. 2013;28(2):158–66.PubMedCrossRef
33.
go back to reference Klingels K, Feys H. Do mirror movements relate to hand function and timing of the brain lesion in children with unilateral cerebral palsy? Dev Med Child Neurol. 2016;58(7):735–42.PubMedCrossRef Klingels K, Feys H. Do mirror movements relate to hand function and timing of the brain lesion in children with unilateral cerebral palsy? Dev Med Child Neurol. 2016;58(7):735–42.PubMedCrossRef
34.
go back to reference Chen YT, Li S, Magat E, Zhou P, Li S. Motor overflow and spasticity in chronic stroke share a common pathophysiological process: analysis of within-limb and between-limb EMG-EMG coherence. Front Neurol. 2018;9:795.PubMedPubMedCentralCrossRef Chen YT, Li S, Magat E, Zhou P, Li S. Motor overflow and spasticity in chronic stroke share a common pathophysiological process: analysis of within-limb and between-limb EMG-EMG coherence. Front Neurol. 2018;9:795.PubMedPubMedCentralCrossRef
35.
go back to reference Sukal-Moulton T, Krosschell KJ, Gaebler-Spira DJ, Dewald JPA. Motor impairments related to brain injury timing in early hemiparesis. Part ii: abnormal upper extremity joint torque synergies. Neurorehabil Neural Repair. 2014;28(1):24–35.PubMedCrossRef Sukal-Moulton T, Krosschell KJ, Gaebler-Spira DJ, Dewald JPA. Motor impairments related to brain injury timing in early hemiparesis. Part ii: abnormal upper extremity joint torque synergies. Neurorehabil Neural Repair. 2014;28(1):24–35.PubMedCrossRef
36.
go back to reference Larson JCG, Mostofsky SH, Goldberg MC, Cutting LE, Denckla MB, Mahone EM. Effects of gender and age on motor exam in typically developing children. Dev Neuropsychol. 2007;32(1):543–62.PubMedCrossRef Larson JCG, Mostofsky SH, Goldberg MC, Cutting LE, Denckla MB, Mahone EM. Effects of gender and age on motor exam in typically developing children. Dev Neuropsychol. 2007;32(1):543–62.PubMedCrossRef
37.
go back to reference Fietzek UM, Heinen F, Berweck S, Maute S, Hufschmidt A, Schulte-Mönting J, et al. Development of the corticospinal system and hand motor function: central conduction times and motor performance tests. Dev Med Child Neurol. 2000;42(4):220–7.PubMedCrossRef Fietzek UM, Heinen F, Berweck S, Maute S, Hufschmidt A, Schulte-Mönting J, et al. Development of the corticospinal system and hand motor function: central conduction times and motor performance tests. Dev Med Child Neurol. 2000;42(4):220–7.PubMedCrossRef
38.
go back to reference Rosenbaum PL, Walter SD, Hanna SE, Palisano RJ, Russell DJ, Raina P, et al. Prognosis for gross motor function in cerebral palsy: creation of motor development curves. J Am Med Assoc. 2002;288(11):1357–63.CrossRef Rosenbaum PL, Walter SD, Hanna SE, Palisano RJ, Russell DJ, Raina P, et al. Prognosis for gross motor function in cerebral palsy: creation of motor development curves. J Am Med Assoc. 2002;288(11):1357–63.CrossRef
39.
go back to reference Fowler EG, Staudt LA, Greenberg MB, Oppenheim WL. Selective control assessment of the lower extremity (SCALE): development, validation, and interrater reliability of a clinical tool for patients with cerebral palsy. Dev Med Child Neurol. 2009;51(8):607–14.PubMedCrossRef Fowler EG, Staudt LA, Greenberg MB, Oppenheim WL. Selective control assessment of the lower extremity (SCALE): development, validation, and interrater reliability of a clinical tool for patients with cerebral palsy. Dev Med Child Neurol. 2009;51(8):607–14.PubMedCrossRef
40.
go back to reference Balzer J, Marsico P, Mitteregger E, Van der Linden ML, Mercer TH, Van Hedel HJA. Construct validity and reliability of the selective control assessment of the lower extremity in children with cerebral palsy. Dev Med Child Neurol. 2016;58(2):167–72.PubMedCrossRef Balzer J, Marsico P, Mitteregger E, Van der Linden ML, Mercer TH, Van Hedel HJA. Construct validity and reliability of the selective control assessment of the lower extremity in children with cerebral palsy. Dev Med Child Neurol. 2016;58(2):167–72.PubMedCrossRef
Metadata
Title
Validity and reliability of an accelerometer-based assessgame to quantify upper limb selective voluntary motor control
Authors
Jeffrey W. Keller
Annina Fahr
Julia Balzer
Jan Lieber
Hubertus J. A. van Hedel
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2020
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-020-00717-y

Other articles of this Issue 1/2020

Journal of NeuroEngineering and Rehabilitation 1/2020 Go to the issue