Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2016

Open Access 01-12-2016 | Research

Instrumental indices for upper limb function assessment in stroke patients: a validation study

Authors: Maria Longhi, Andrea Merlo, Paolo Prati, Meris Giacobbi, Davide Mazzoli

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2016

Login to get access

Abstract

Background

Robotic exoskeletons are increasingly being used in objective and quantitative assessment of upper limb (UL) movements. A set of instrumental indices computed during robot-assisted reaching tasks with the Armeo®Spring has been proven to assess UL functionality. The aim of this study was to test the construct validity of this indices-based UL assessment when used with patients who have had a stroke.

Methods

Forty-four 45- to 79-year-old stroke patients with a Wolf Motor Function Test ability score (WMFT-FAS) ranging from 10 to 75 and a Motricity Index (MI) ranging from 14 to 33 at shoulder and elbow were enrolled, thus covering a wide range of impairments. Residual UL function was assessed by both the WMFT-FAS and the WMFT-TIME, as well as by a set of 9 numerical indices assessing movement accuracy, velocity and smoothness computed from a 3D endpoint trajectory obtained during the “Vertical Capture” task of the Armeo®Spring device. To explore which variables better represented motor control deficits, the Mann-Whitney U Test was used to compare patients’ indices to those obtained from 25 healthy individuals. To explore the inner relationships between indices and construct validity in assessing accuracy, velocity and smoothness, a factor analysis was carried out. To verify the indices concurrent validity, they were compared to both WMFT-FAS and WMFT-TIME by the Spearman’s correlation coefficient.

Results

Seven indices of stroke subjects were significantly different from those of healthy controls, with effect sizes in the range 0.35–0.74. Factor analysis confirmed that specific subsets of indices belonged to the domains of accuracy, velocity and smoothness (discriminant validity). One accuracy index, both velocity indices and two smoothness indices were significantly correlated with WMFT-FAS and WMFT-TIME (|rho| = 0.31–0.50) (concurrent validity). One index for each of the assessed movement domains was proven to have construct validity (discriminant and concurrent) and was selected. Moreover, the indices were able to detect differences in accuracy, velocity and/or smoothness in patients with the same WMFT level.

Conclusions

The proposed index-based UL assessment can be used to integrate and support clinical evaluation of UL function in stroke patients.
Literature
1.
go back to reference Nakayama H, Jorgensen HS, Raaschou HO, Olsen TS. Recovery of upper extremity function in stroke patients: the Copenhagen Stroke Study. Arch Phys Med Rehabil. 1994;75:394–8.CrossRefPubMed Nakayama H, Jorgensen HS, Raaschou HO, Olsen TS. Recovery of upper extremity function in stroke patients: the Copenhagen Stroke Study. Arch Phys Med Rehabil. 1994;75:394–8.CrossRefPubMed
2.
go back to reference Jørgensen HS, Nakayama H, Raaschou HO, Vive-Larsen J, Støier M, Olsen TS. Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen stroke study. Arch Phys Med Rehabil. 1995;76:406–12.CrossRefPubMed Jørgensen HS, Nakayama H, Raaschou HO, Vive-Larsen J, Støier M, Olsen TS. Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen stroke study. Arch Phys Med Rehabil. 1995;76:406–12.CrossRefPubMed
3.
go back to reference Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient: 1. a method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31.PubMed Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient: 1. a method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31.PubMed
4.
go back to reference Van Wijck FM, Pandyan AD, Johnson GR, Barnes MP. Assessing motor deficits in neurological rehabilitation: Patterns of instrument usage. Neurorehabil Neural Repair. 2001;15(1):23–30.CrossRefPubMed Van Wijck FM, Pandyan AD, Johnson GR, Barnes MP. Assessing motor deficits in neurological rehabilitation: Patterns of instrument usage. Neurorehabil Neural Repair. 2001;15(1):23–30.CrossRefPubMed
5.
go back to reference McCrea PH, Eng JJ, Hodgson AJ. Biomechanics of reaching: Clinical implications for individuals with acquired brain injury. Disabil Rehabil. 2002;24(10):534–41.CrossRefPubMedPubMedCentral McCrea PH, Eng JJ, Hodgson AJ. Biomechanics of reaching: Clinical implications for individuals with acquired brain injury. Disabil Rehabil. 2002;24(10):534–41.CrossRefPubMedPubMedCentral
6.
go back to reference Alon G, McBride K. Persons with C5 or C6 tetraplegia achieve selected functional gains using a neuroprosthesis. Arch Phys Med Rehabil. 2003;84(1):119–24.CrossRefPubMed Alon G, McBride K. Persons with C5 or C6 tetraplegia achieve selected functional gains using a neuroprosthesis. Arch Phys Med Rehabil. 2003;84(1):119–24.CrossRefPubMed
7.
go back to reference Wolf SL, Lecraw DE, Barton LA, Jann BB. Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients. Exp Neurol. 1989;104(2):125–32.CrossRefPubMed Wolf SL, Lecraw DE, Barton LA, Jann BB. Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients. Exp Neurol. 1989;104(2):125–32.CrossRefPubMed
8.
go back to reference Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing the Wolf Motor Function Test as an outcome measure for research in patients after stroke. Stroke. 2001;32(7):1635–9.CrossRefPubMed Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing the Wolf Motor Function Test as an outcome measure for research in patients after stroke. Stroke. 2001;32(7):1635–9.CrossRefPubMed
9.
go back to reference Shaw SE, Morris DM, Uswatte G, McKay S, Meythaler JM, Taub E. Constraint-induced movement therapy for recovery of upper-limb function following traumatic brain injury. JRRD. 2005;42(6):769–78.CrossRef Shaw SE, Morris DM, Uswatte G, McKay S, Meythaler JM, Taub E. Constraint-induced movement therapy for recovery of upper-limb function following traumatic brain injury. JRRD. 2005;42(6):769–78.CrossRef
11.
go back to reference Sivan M, O’Connor RJ, Makower S. Systematic review of outcome measures used in the evaluation of robot-assisted upper limb exercise in stroke. J Rehabil Med. 2011;43:181–9.CrossRefPubMed Sivan M, O’Connor RJ, Makower S. Systematic review of outcome measures used in the evaluation of robot-assisted upper limb exercise in stroke. J Rehabil Med. 2011;43:181–9.CrossRefPubMed
12.
go back to reference Morris DM, Uswatte G, Crago JE, Cook EW, Taub E. The reliability of the Wolf motor function test for assessing upper extremity function after stroke. Arch Phys Med Rehabil. 2001;82(6):750–5.CrossRefPubMed Morris DM, Uswatte G, Crago JE, Cook EW, Taub E. The reliability of the Wolf motor function test for assessing upper extremity function after stroke. Arch Phys Med Rehabil. 2001;82(6):750–5.CrossRefPubMed
13.
go back to reference Nijland R, van Wegen E, Verbunt J, van Wij R, van Kordelaar J, Kwakkel G. A comparison of two validated tests for upper limb function after stroke: The Wolf Motor Function Test and the Action Research Arm Test. J Rehabil Med. 2010;42:694–6.CrossRefPubMed Nijland R, van Wegen E, Verbunt J, van Wij R, van Kordelaar J, Kwakkel G. A comparison of two validated tests for upper limb function after stroke: The Wolf Motor Function Test and the Action Research Arm Test. J Rehabil Med. 2010;42:694–6.CrossRefPubMed
14.
go back to reference Edwards DF, Lang CE, Wagner JM, Birkenmeier R, Dromerick AW. An evaluation of the Wolf Motor Function Test in motor trials early after stroke. Arch Phys Med Rehabil. 2012;93(4):660–8.CrossRefPubMed Edwards DF, Lang CE, Wagner JM, Birkenmeier R, Dromerick AW. An evaluation of the Wolf Motor Function Test in motor trials early after stroke. Arch Phys Med Rehabil. 2012;93(4):660–8.CrossRefPubMed
15.
go back to reference Gladstone DJ, Danells CJ, Black SE. The Fugl-Meyer assessment of motor recovery after stroke: A critical review of its measurement properties. Neurorehabil Neural Repair. 2002;16(3):232–40.CrossRefPubMed Gladstone DJ, Danells CJ, Black SE. The Fugl-Meyer assessment of motor recovery after stroke: A critical review of its measurement properties. Neurorehabil Neural Repair. 2002;16(3):232–40.CrossRefPubMed
16.
go back to reference Subramanian SK, Yamanaka J, Chilingaryan G, Levin MF. Validity of movement pattern kinematics as measures of arm motor impairment post stroke. Stroke. 2010;41(10):2303–8.CrossRefPubMed Subramanian SK, Yamanaka J, Chilingaryan G, Levin MF. Validity of movement pattern kinematics as measures of arm motor impairment post stroke. Stroke. 2010;41(10):2303–8.CrossRefPubMed
17.
go back to reference Alt Murphy M, Willén C, Sunnerhagen KS. Movement kinematics during a drinking task are associated with the activity capacity level after stroke. Neurorehabil Neural Repair. 2012;26(9):1106–15.CrossRefPubMed Alt Murphy M, Willén C, Sunnerhagen KS. Movement kinematics during a drinking task are associated with the activity capacity level after stroke. Neurorehabil Neural Repair. 2012;26(9):1106–15.CrossRefPubMed
18.
go back to reference Wu CY, Liing RJ, Chen HC, Chen CL, Lin KC. Arm and trunk movement kinematics during seated reaching within and beyond arm’s length in people with stroke: a validity study. Phys Ther. 2014;94(6):845–56.CrossRefPubMed Wu CY, Liing RJ, Chen HC, Chen CL, Lin KC. Arm and trunk movement kinematics during seated reaching within and beyond arm’s length in people with stroke: a validity study. Phys Ther. 2014;94(6):845–56.CrossRefPubMed
19.
go back to reference Oujamaa L, Relave I, Froger J, Mottet D, Pelissier JY. Rehabilitation of arm function after stroke. Literature review. Ann Phys Rehabil Med. 2009;52:269–93.CrossRefPubMed Oujamaa L, Relave I, Froger J, Mottet D, Pelissier JY. Rehabilitation of arm function after stroke. Literature review. Ann Phys Rehabil Med. 2009;52:269–93.CrossRefPubMed
20.
go back to reference Norouzi-Gheidari N, Archambault PS, Fung J. Effects of robot-assisted therapy on stroke rehabilitation in upper limbs: systematic review and meta-analysis of the literature. J Rehabil Res Dev. 2012;49(4):479–96.CrossRefPubMed Norouzi-Gheidari N, Archambault PS, Fung J. Effects of robot-assisted therapy on stroke rehabilitation in upper limbs: systematic review and meta-analysis of the literature. J Rehabil Res Dev. 2012;49(4):479–96.CrossRefPubMed
21.
go back to reference Prange GB, Jannink MJ, Groothuis-Oudshoorn CG, Hermens HJ, Ijzerman MJ. Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev. 2006;43(2):171–84.CrossRefPubMed Prange GB, Jannink MJ, Groothuis-Oudshoorn CG, Hermens HJ, Ijzerman MJ. Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev. 2006;43(2):171–84.CrossRefPubMed
22.
go back to reference Maciejasz P, Eschweiler J, Gerlach-Hahn K, Jansen-Troy A, Leonhardt S. A survey on robotic devices for upper limb rehabilitation. J Neuroeng Rehabil. 2014;11:13.CrossRef Maciejasz P, Eschweiler J, Gerlach-Hahn K, Jansen-Troy A, Leonhardt S. A survey on robotic devices for upper limb rehabilitation. J Neuroeng Rehabil. 2014;11:13.CrossRef
23.
go back to reference Kwakkel G, Kollen BJ, Krebs HI. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair. 2008;22(2):111–21.CrossRefPubMed Kwakkel G, Kollen BJ, Krebs HI. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair. 2008;22(2):111–21.CrossRefPubMed
24.
go back to reference Bosecker C, Dipietro L, Volpe B, Krebs HI. Kinematic robot-based evaluation scales and clinical counterparts to measure upper limb motor performance in patients with chronic stroke. Neurorehabil Neural Repair. 2010;24(1):62–9.CrossRefPubMed Bosecker C, Dipietro L, Volpe B, Krebs HI. Kinematic robot-based evaluation scales and clinical counterparts to measure upper limb motor performance in patients with chronic stroke. Neurorehabil Neural Repair. 2010;24(1):62–9.CrossRefPubMed
25.
go back to reference Einav O, Geva D, Yoeli D, Kerzhner M, Mauritz KH. Development and validation of the first robotic scale for the clinical assessment of upper extremity motor impairments in stroke patients. Top Stroke Rehabil. 2011;18 Suppl 1:587–98.CrossRefPubMed Einav O, Geva D, Yoeli D, Kerzhner M, Mauritz KH. Development and validation of the first robotic scale for the clinical assessment of upper extremity motor impairments in stroke patients. Top Stroke Rehabil. 2011;18 Suppl 1:587–98.CrossRefPubMed
26.
go back to reference Krebs HI, Krams M, Agrafiotis DK, DiBernardo A, Chavez JC, Littman GS, et al. Robotic measurement of arm movements after stroke establishes biomarkers of motor recovery. Stroke. 2014;45:200–4.CrossRefPubMed Krebs HI, Krams M, Agrafiotis DK, DiBernardo A, Chavez JC, Littman GS, et al. Robotic measurement of arm movements after stroke establishes biomarkers of motor recovery. Stroke. 2014;45:200–4.CrossRefPubMed
27.
go back to reference Otaka E, Otaka Y, Kasuga S, Nishimoto A, Yamazaki K, Kawakami MJ, et al. Clinical usefulness and validity of robotic measures of reaching movement in hemiparetic stroke patients. J Neuroeng Rehabil. 2015;12:66.CrossRefPubMedPubMedCentral Otaka E, Otaka Y, Kasuga S, Nishimoto A, Yamazaki K, Kawakami MJ, et al. Clinical usefulness and validity of robotic measures of reaching movement in hemiparetic stroke patients. J Neuroeng Rehabil. 2015;12:66.CrossRefPubMedPubMedCentral
28.
go back to reference Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci. 2002;22(18):8297–304.PubMed Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci. 2002;22(18):8297–304.PubMed
29.
go back to reference Nordin N, Xie SQ, Wünsche B. Assessment of movement quality in robot-assisted upper limb rehabilitation after stroke: a review. J Neuroeng Rehabil. 2014;11:137.CrossRefPubMedPubMedCentral Nordin N, Xie SQ, Wünsche B. Assessment of movement quality in robot-assisted upper limb rehabilitation after stroke: a review. J Neuroeng Rehabil. 2014;11:137.CrossRefPubMedPubMedCentral
30.
go back to reference Merlo A, Longhi M, Giannotti E, Prati P, Giacobbi M, Ruscelli E, et al. Upper limb evaluation with robotic exoskeleton. Normative values for indices of accuracy, speed and smoothness. NeuroRehabilitation. 2013;33(4):523–30.PubMed Merlo A, Longhi M, Giannotti E, Prati P, Giacobbi M, Ruscelli E, et al. Upper limb evaluation with robotic exoskeleton. Normative values for indices of accuracy, speed and smoothness. NeuroRehabilitation. 2013;33(4):523–30.PubMed
31.
go back to reference Lang CE, Bland MD. Assessment of upper extremity impairment, function and activity after stroke: foundations for clinical decision making. J Hand Ther. 2013;26(2):104–15.CrossRefPubMed Lang CE, Bland MD. Assessment of upper extremity impairment, function and activity after stroke: foundations for clinical decision making. J Hand Ther. 2013;26(2):104–15.CrossRefPubMed
32.
go back to reference Zackowski KM, Dromerick AW, Sahrmann SA, Thach WT, Bastian AJ. How do strength, sensation, spasticity and joint individuation relate to the reaching deficits of people with chronic hemiparesis? Brain. 2004;127(5):1035–46.CrossRefPubMed Zackowski KM, Dromerick AW, Sahrmann SA, Thach WT, Bastian AJ. How do strength, sensation, spasticity and joint individuation relate to the reaching deficits of people with chronic hemiparesis? Brain. 2004;127(5):1035–46.CrossRefPubMed
33.
go back to reference Statistical BA, Analysis F, Methods R. Theory and Applications. New York: Wiley; 1994. Statistical BA, Analysis F, Methods R. Theory and Applications. New York: Wiley; 1994.
34.
go back to reference Cerny CA, Kaiser HF. A study of a measure of sampling adequacy for factor-analytic correlation matrices. Multivariate Behav Res. 1977;12(1):43–7.CrossRefPubMed Cerny CA, Kaiser HF. A study of a measure of sampling adequacy for factor-analytic correlation matrices. Multivariate Behav Res. 1977;12(1):43–7.CrossRefPubMed
35.
go back to reference Guilford JP. Fundamental statistics in psychology and education. New York: McGraw Hill; 1956. Guilford JP. Fundamental statistics in psychology and education. New York: McGraw Hill; 1956.
36.
go back to reference Coderre A, Zeid AA, Dukelow SP, Demmer MJ, Moore KD, Bretzke H, et al. Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil Neural Repair. 2010;24:528–41.CrossRefPubMed Coderre A, Zeid AA, Dukelow SP, Demmer MJ, Moore KD, Bretzke H, et al. Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil Neural Repair. 2010;24:528–41.CrossRefPubMed
37.
go back to reference Panarese A, Colombo R, Sterpi I, Pisano F, Micera S. Tracking motor improvement at the subtask level during robot-aided neurorehabilitation of stroke patients. Neurorehabil Neural Repair. 2012;26(7):822–33.CrossRefPubMed Panarese A, Colombo R, Sterpi I, Pisano F, Micera S. Tracking motor improvement at the subtask level during robot-aided neurorehabilitation of stroke patients. Neurorehabil Neural Repair. 2012;26(7):822–33.CrossRefPubMed
38.
go back to reference Bosecker C, Dipietro L, Krebs HI, Volpe B. Kinematic robot-based evaluation scales and clinical counterparts to measure upper limb motor performance in patients with chronic stroke. J Neurorehabil Neural Repair. 2010;24(1):62–9.CrossRef Bosecker C, Dipietro L, Krebs HI, Volpe B. Kinematic robot-based evaluation scales and clinical counterparts to measure upper limb motor performance in patients with chronic stroke. J Neurorehabil Neural Repair. 2010;24(1):62–9.CrossRef
39.
go back to reference Levin MF, Kleim JA, Wolf SL. What do motor “recovery” and “compensation” mean in patients following stroke? Neurorehabil Neural Repair. 2008;23(4):313–9.CrossRefPubMed Levin MF, Kleim JA, Wolf SL. What do motor “recovery” and “compensation” mean in patients following stroke? Neurorehabil Neural Repair. 2008;23(4):313–9.CrossRefPubMed
40.
go back to reference Archambault P, Pigeon P, Feldman AG, Levin MF. Recruitment and sequencing of different degrees of freedom during pointing movements involving the trunk in healthy and hemiparetic subjects. Exp Brain Res. 1999;126:55–67.CrossRefPubMed Archambault P, Pigeon P, Feldman AG, Levin MF. Recruitment and sequencing of different degrees of freedom during pointing movements involving the trunk in healthy and hemiparetic subjects. Exp Brain Res. 1999;126:55–67.CrossRefPubMed
41.
go back to reference Wu CY, Chuang LL, Lin KC, Chen HC, Tsay PK. Randomized trial of distributed constraint-induced therapy versus bilateral arm training for the rehabilitation of upper-limb motor control and function after stroke. Neurorehabil Neural Repair. 2011;25:130–9.CrossRefPubMed Wu CY, Chuang LL, Lin KC, Chen HC, Tsay PK. Randomized trial of distributed constraint-induced therapy versus bilateral arm training for the rehabilitation of upper-limb motor control and function after stroke. Neurorehabil Neural Repair. 2011;25:130–9.CrossRefPubMed
42.
go back to reference Michaelsen SM, Dannenbaum R, Levin MF. Task-specific training with trunk restraint on arm recovery in stroke: randomized control trial. Stroke. 2006;37:186–92.CrossRefPubMed Michaelsen SM, Dannenbaum R, Levin MF. Task-specific training with trunk restraint on arm recovery in stroke: randomized control trial. Stroke. 2006;37:186–92.CrossRefPubMed
43.
go back to reference Gracies JM. Pathophysiology of spastic paresis. II: Emergence of muscle overactivity. Muscle Nerve. 2005;31(5):552–71.CrossRefPubMed Gracies JM. Pathophysiology of spastic paresis. II: Emergence of muscle overactivity. Muscle Nerve. 2005;31(5):552–71.CrossRefPubMed
44.
go back to reference Kahn LE, Zygman ML, Rymer WZ, Reinkensmeyer DJ. Robot-assisted reaching exercise promotes arm movement recovery in chronic hemiparetic stroke: a randomized controlled pilot study. J Neuroeng Rehabil. 2006;3:12.CrossRefPubMedPubMedCentral Kahn LE, Zygman ML, Rymer WZ, Reinkensmeyer DJ. Robot-assisted reaching exercise promotes arm movement recovery in chronic hemiparetic stroke: a randomized controlled pilot study. J Neuroeng Rehabil. 2006;3:12.CrossRefPubMedPubMedCentral
45.
go back to reference Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, et al. Assessing mechanisms of recovery during robot-aided neurorehabilitation of the upper limb. Neurorehabil Neural Repair. 2008;22:50–63.CrossRefPubMed Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, et al. Assessing mechanisms of recovery during robot-aided neurorehabilitation of the upper limb. Neurorehabil Neural Repair. 2008;22:50–63.CrossRefPubMed
46.
go back to reference Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, et al. Robotic techniques for upper limb evaluation and rehabilitation of stroke patients. IEEE Trans Neural Syst Rehabil Eng. 2005;13(3):311–24.CrossRefPubMed Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, et al. Robotic techniques for upper limb evaluation and rehabilitation of stroke patients. IEEE Trans Neural Syst Rehabil Eng. 2005;13(3):311–24.CrossRefPubMed
Metadata
Title
Instrumental indices for upper limb function assessment in stroke patients: a validation study
Authors
Maria Longhi
Andrea Merlo
Paolo Prati
Meris Giacobbi
Davide Mazzoli
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2016
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-016-0163-4

Other articles of this Issue 1/2016

Journal of NeuroEngineering and Rehabilitation 1/2016 Go to the issue