Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2015

Open Access 01-12-2015 | Research Article

Reliability and validity of a vertical numerical rating scale supplemented with a faces rating scale in measuring fatigue after stroke

Authors: Li-ling Chuang, Keh-chung Lin, An-lun Hsu, Ching-yi Wu, Ku-chou Chang, Yen-chen Li, You-lin Chen

Published in: Health and Quality of Life Outcomes | Issue 1/2015

Login to get access

Abstract

Background

Poststroke fatigue is a persistent and distressing symptom among stroke survivors. In this study, we investigated the reliability and validity of a vertical numerical rating scale supplemented with a faces rating scale (NRS-FRS) in measuring poststroke fatigue.

Methods

The fatigue intensity of 106 individuals with stroke was measured twice, 1 week apart, using a vertical NRS-FRS to measure test-retest reliability. The intraclass correlation coefficient, a relative reliability index, was calculated to examine the degree of consistency and agreement between the two test occasions. Absolute reliability indices, including the standard error of measurement, minimal detectable change, and Bland-Altman limits of agreement, were used to quantify measurement errors and determine systematic biases of the two test occasions. We also administered the vertical NRS concurrently as a comparator measure for assessing fatigue in 50 consecutive patients with stroke who were recruited later in the study period. The Spearman rank correlation coefficient (ρ) was used to examine the concurrent validity of the NRS-FRS. Discriminant validity was assessed by means of receiver operating characteristic curves, sensitivity, and specificity.

Results

The intraclass correlation coefficient was 0.95 for the NRS-FRS. The standard error of measurement and the minimal detectable change at the 95 % confidence interval of the NRS-FRS were 0.50 and 1.39, respectively. The Bland-Altman analyses showed no significant systematic bias between the repeated measurements. A narrow range of the limits of agreement was shown on the Bland-Altman plot, indicating the NRS-FRS had high stability and low variation between the two test occasions. The correlations between the NRS-FRS and NRS were good at test (ρ = 0.85) and retest (ρ = 0.84). Compared with the NRS cutoff value of ≥1, sensitivity with the NRS-FRS at test and retest was 94 and 92 % and specificity was 79 and 90 %, respectively.

Conclusions

This study provides further evidence of the reliability and validity of the NRS-FRS in measuring fatigue intensity in patients with stroke. The NRS-FRS had high sensitivity and specificity. The NRS-FRS may be a reliable and valid measure for clinicians and researchers to assess fatigue and determine whether a real change has occurred in groups and at the individual level of patients with stroke.
Literature
1.
go back to reference Staub F, Bogousslavsky J. Fatigue after stroke: a major but neglected issue. Cerebrovasc Dis. 2001;12:75–81.PubMedCrossRef Staub F, Bogousslavsky J. Fatigue after stroke: a major but neglected issue. Cerebrovasc Dis. 2001;12:75–81.PubMedCrossRef
2.
3.
go back to reference Glader EL, Stegmayr B, Asplund K. Poststroke fatigue: a 2-year follow-up study of stroke patients in Sweden. Stroke. 2002;33:1327–33.PubMedCrossRef Glader EL, Stegmayr B, Asplund K. Poststroke fatigue: a 2-year follow-up study of stroke patients in Sweden. Stroke. 2002;33:1327–33.PubMedCrossRef
4.
go back to reference Lerdal A, Bakken LN, Kouwenhoven SE, Pedersen G, Kirkevold M, Finset A, et al. Poststroke fatigue–a review. J Pain Symptom Manag. 2009;38:928–49.CrossRef Lerdal A, Bakken LN, Kouwenhoven SE, Pedersen G, Kirkevold M, Finset A, et al. Poststroke fatigue–a review. J Pain Symptom Manag. 2009;38:928–49.CrossRef
5.
go back to reference Choi-Kwon S, Kim JS. Poststroke fatigue: an emerging, critical issue in stroke medicine. Int J Stroke. 2011;6:328–36.PubMedCrossRef Choi-Kwon S, Kim JS. Poststroke fatigue: an emerging, critical issue in stroke medicine. Int J Stroke. 2011;6:328–36.PubMedCrossRef
7.
go back to reference Tang WK, Lu JY, Mok V, Ungvari GS, Wong KS. Is fatigue associated with suicidality in stroke? Arch Phys Med Rehabil. 2011;92:1336–8.PubMedCrossRef Tang WK, Lu JY, Mok V, Ungvari GS, Wong KS. Is fatigue associated with suicidality in stroke? Arch Phys Med Rehabil. 2011;92:1336–8.PubMedCrossRef
9.
go back to reference Tseng BY, Billinger SA, Gajewski BJ, Kluding PM. Exertion fatigue and chronic fatigue are two distinct constructs in people post-stroke. Stroke. 2010;41:2908–12.PubMedCentralPubMedCrossRef Tseng BY, Billinger SA, Gajewski BJ, Kluding PM. Exertion fatigue and chronic fatigue are two distinct constructs in people post-stroke. Stroke. 2010;41:2908–12.PubMedCentralPubMedCrossRef
10.
go back to reference Choi-Kwon S, Han SW, Kwon SU, Kim JS. Poststroke fatigue: characteristics and related factors. Cerebrovasc Dis. 2005;19:84–90.PubMedCrossRef Choi-Kwon S, Han SW, Kwon SU, Kim JS. Poststroke fatigue: characteristics and related factors. Cerebrovasc Dis. 2005;19:84–90.PubMedCrossRef
11.
go back to reference Aaronson LS, Teel CS, Cassmeyer V, Neuberger GB, Pallikkathayil L, Pierce J, et al. Defining and measuring fatigue. Image J Nurs Sch. 1999;31:45–50.PubMedCrossRef Aaronson LS, Teel CS, Cassmeyer V, Neuberger GB, Pallikkathayil L, Pierce J, et al. Defining and measuring fatigue. Image J Nurs Sch. 1999;31:45–50.PubMedCrossRef
12.
go back to reference Tseng BY, Gajewski BJ, Kluding PM. Reliability, responsiveness, and validity of the visual analog fatigue scale to measure exertion fatigue in people with chronic stroke: a preliminary study. Stroke Res Treat. 2010;2010:412964.PubMedCentralPubMed Tseng BY, Gajewski BJ, Kluding PM. Reliability, responsiveness, and validity of the visual analog fatigue scale to measure exertion fatigue in people with chronic stroke: a preliminary study. Stroke Res Treat. 2010;2010:412964.PubMedCentralPubMed
13.
go back to reference Lynch J, Mead G, Greig C, Young A, Lewis S, Sharpe M. Fatigue after stroke: the development and evaluation of a case definition. J Psychosom Res. 2007;63:539–44.PubMedCrossRef Lynch J, Mead G, Greig C, Young A, Lewis S, Sharpe M. Fatigue after stroke: the development and evaluation of a case definition. J Psychosom Res. 2007;63:539–44.PubMedCrossRef
14.
go back to reference Shahid A, Shen J, Shapiro CM. Measurements of sleepiness and fatigue. J Psychosom Res. 2010;69:81–9.PubMedCrossRef Shahid A, Shen J, Shapiro CM. Measurements of sleepiness and fatigue. J Psychosom Res. 2010;69:81–9.PubMedCrossRef
15.
go back to reference Winward C, Sackley C, Metha Z, Rothwell PM. A population-based study of the prevalence of fatigue after transient ischemic attack and minor stroke. Stroke. 2009;40:757–61.PubMedCrossRef Winward C, Sackley C, Metha Z, Rothwell PM. A population-based study of the prevalence of fatigue after transient ischemic attack and minor stroke. Stroke. 2009;40:757–61.PubMedCrossRef
16.
go back to reference Mead G, Lynch J, Greig C, Young A, Lewis S, Sharpe M. Evaluation of fatigue scales in stroke patients. Stroke. 2007;38:2090–5.PubMedCrossRef Mead G, Lynch J, Greig C, Young A, Lewis S, Sharpe M. Evaluation of fatigue scales in stroke patients. Stroke. 2007;38:2090–5.PubMedCrossRef
17.
go back to reference Lee KA, Hicks G, Nino-Murcia G. Validity and reliability of a scale to assess fatigue. Psychiatry Res. 1991;36:291–8.PubMedCrossRef Lee KA, Hicks G, Nino-Murcia G. Validity and reliability of a scale to assess fatigue. Psychiatry Res. 1991;36:291–8.PubMedCrossRef
18.
go back to reference Tseng BY, Kluding P. The relationship between fatigue, aerobic fitness, and motor control in people with chronic stroke: a pilot study. J Geriatr Phys Ther. 2009;32:97–102.PubMedCentralPubMedCrossRef Tseng BY, Kluding P. The relationship between fatigue, aerobic fitness, and motor control in people with chronic stroke: a pilot study. J Geriatr Phys Ther. 2009;32:97–102.PubMedCentralPubMedCrossRef
19.
go back to reference Underwood J, Clark PC, Blanton S, Aycock DM, Wolf SL. Pain, fatigue, and intensity of practice in people with stroke who are receiving constraint-induced movement therapy. Phys Ther. 2006;86:1241–50.PubMedCrossRef Underwood J, Clark PC, Blanton S, Aycock DM, Wolf SL. Pain, fatigue, and intensity of practice in people with stroke who are receiving constraint-induced movement therapy. Phys Ther. 2006;86:1241–50.PubMedCrossRef
20.
go back to reference Kuppuswamy A, Clark EV, Turner IF, Rothwell JC, Ward NS. Post-stroke fatigue: a deficit in corticomotor excitability? Brain. 2015;138:136–48.PubMedCrossRef Kuppuswamy A, Clark EV, Turner IF, Rothwell JC, Ward NS. Post-stroke fatigue: a deficit in corticomotor excitability? Brain. 2015;138:136–48.PubMedCrossRef
21.
go back to reference Kim E, Lovera J, Schaben L, Melara J, Bourdette D, Whitham R. Novel method for measurement of fatigue in multiple sclerosis: real-time digital fatigue score. J Rehabil Res Dev. 2010;47:477–84.PubMedCrossRef Kim E, Lovera J, Schaben L, Melara J, Bourdette D, Whitham R. Novel method for measurement of fatigue in multiple sclerosis: real-time digital fatigue score. J Rehabil Res Dev. 2010;47:477–84.PubMedCrossRef
22.
go back to reference Whitehead L. The measurement of fatigue in chronic illness: a systematic review of unidimensional and multidimensional fatigue measures. J Pain Symptom Manag. 2009;37:107–28.CrossRef Whitehead L. The measurement of fatigue in chronic illness: a systematic review of unidimensional and multidimensional fatigue measures. J Pain Symptom Manag. 2009;37:107–28.CrossRef
23.
go back to reference Price CI, Curless RH, Rodgers H. Can stroke patients use visual analogue scales? Stroke. 1999;30:1357–61.PubMedCrossRef Price CI, Curless RH, Rodgers H. Can stroke patients use visual analogue scales? Stroke. 1999;30:1357–61.PubMedCrossRef
24.
go back to reference Benaim C, Froger J, Cazottes C, Gueben D, Porte M, Desnuelle C, et al. Use of the Faces Pain Scale by left and right hemispheric stroke patients. Pain. 2007;128:52–8.PubMedCrossRef Benaim C, Froger J, Cazottes C, Gueben D, Porte M, Desnuelle C, et al. Use of the Faces Pain Scale by left and right hemispheric stroke patients. Pain. 2007;128:52–8.PubMedCrossRef
25.
go back to reference Doventas A, Karadag B, Curgunlu A, Bilici A, Sut N, Erdincler DS, et al. Replicability and reliability of pain assessment forms in geriatrics. Arch Gerontol Geriatr. 2011;53:e55–60.PubMedCrossRef Doventas A, Karadag B, Curgunlu A, Bilici A, Sut N, Erdincler DS, et al. Replicability and reliability of pain assessment forms in geriatrics. Arch Gerontol Geriatr. 2011;53:e55–60.PubMedCrossRef
26.
go back to reference Alschuler KN, Jensen MP, Sullivan-Singh SJ, Borson S, Smith AE, Molton IR. The association of age, pain, and fatigue with physical functioning and depressive symptoms in persons with spinal cord injury. J Spinal Cord Med. 2013;36:483–91.PubMedCentralPubMedCrossRef Alschuler KN, Jensen MP, Sullivan-Singh SJ, Borson S, Smith AE, Molton IR. The association of age, pain, and fatigue with physical functioning and depressive symptoms in persons with spinal cord injury. J Spinal Cord Med. 2013;36:483–91.PubMedCentralPubMedCrossRef
27.
go back to reference Salaffi F, Sarzi-Puttini P, Girolimetti R, Gasparini S, Atzeni F, Grassi W. Development and validation of the self-administered Fibromyalgia Assessment Status: a disease-specific composite measure for evaluating treatment effect. Arthritis Res Ther. 2009;11:R125.PubMedCentralPubMedCrossRef Salaffi F, Sarzi-Puttini P, Girolimetti R, Gasparini S, Atzeni F, Grassi W. Development and validation of the self-administered Fibromyalgia Assessment Status: a disease-specific composite measure for evaluating treatment effect. Arthritis Res Ther. 2009;11:R125.PubMedCentralPubMedCrossRef
28.
go back to reference Schwartz AL, Meek PM, Nail LM, Fargo J, Lundquist M, Donofrio M, et al. Measurement of fatigue. Determining minimally important clinical differences. J Clin Epidemiol. 2002;55:239–44.PubMedCrossRef Schwartz AL, Meek PM, Nail LM, Fargo J, Lundquist M, Donofrio M, et al. Measurement of fatigue. Determining minimally important clinical differences. J Clin Epidemiol. 2002;55:239–44.PubMedCrossRef
29.
go back to reference Minnock P, Kirwan J, Bresnihan B. Fatigue is a reliable, sensitive and unique outcome measure in rheumatoid arthritis. Rheumatology (Oxford). 2009;48:1533–6.CrossRef Minnock P, Kirwan J, Bresnihan B. Fatigue is a reliable, sensitive and unique outcome measure in rheumatoid arthritis. Rheumatology (Oxford). 2009;48:1533–6.CrossRef
30.
go back to reference Nicklin J, Cramp F, Kirwan J, Greenwood R, Urban M, Hewlett S. Measuring fatigue in rheumatoid arthritis: a cross-sectional study to evaluate the Bristol Rheumatoid Arthritis Fatigue Multi-Dimensional questionnaire, visual analog scales, and numerical rating scales. Arthritis Care Res. 2010;62:1559–68.CrossRef Nicklin J, Cramp F, Kirwan J, Greenwood R, Urban M, Hewlett S. Measuring fatigue in rheumatoid arthritis: a cross-sectional study to evaluate the Bristol Rheumatoid Arthritis Fatigue Multi-Dimensional questionnaire, visual analog scales, and numerical rating scales. Arthritis Care Res. 2010;62:1559–68.CrossRef
31.
go back to reference Jaywant SS, Pai AV. A comparative study of pain measurement scales in acute burn patients. Indian J Occup Ther. 2003;XXXV:13–7. Jaywant SS, Pai AV. A comparative study of pain measurement scales in acute burn patients. Indian J Occup Ther. 2003;XXXV:13–7.
32.
go back to reference Kim EJ, Buschmann MT. Reliability and validity of the Faces Pain Scale with older adults. Int J Nurs Stud. 2006;43:447–56.PubMedCrossRef Kim EJ, Buschmann MT. Reliability and validity of the Faces Pain Scale with older adults. Int J Nurs Stud. 2006;43:447–56.PubMedCrossRef
33.
go back to reference Dogan SK, Ay S, Evcik D, Kurtais Y, Gokmen Oztuna D. The utility of Faces Pain Scale in a chronic musculoskeletal pain model. Pain Med. 2012;13:125–30.PubMedCrossRef Dogan SK, Ay S, Evcik D, Kurtais Y, Gokmen Oztuna D. The utility of Faces Pain Scale in a chronic musculoskeletal pain model. Pain Med. 2012;13:125–30.PubMedCrossRef
34.
go back to reference Chuang LL, Wu CY, Lin KC, Hsieh CJ. Relative and absolute reliability of a vertical numerical pain rating scale supplemented with a faces pain scale after stroke. Phys Ther. 2014;94:129–38.PubMedCrossRef Chuang LL, Wu CY, Lin KC, Hsieh CJ. Relative and absolute reliability of a vertical numerical pain rating scale supplemented with a faces pain scale after stroke. Phys Ther. 2014;94:129–38.PubMedCrossRef
35.
go back to reference Park JY, Chun MH, Kang SH, Lee JA, Kim BR, Shin MJ. Functional outcome in poststroke patients with or without fatigue. Am J Phys Med Rehabil. 2009;88:554–8.PubMedCrossRef Park JY, Chun MH, Kang SH, Lee JA, Kim BR, Shin MJ. Functional outcome in poststroke patients with or without fatigue. Am J Phys Med Rehabil. 2009;88:554–8.PubMedCrossRef
36.
go back to reference Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.PubMedCrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.PubMedCrossRef
37.
go back to reference Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 3rd ed. Upper Saddle River, NJ: Pearson/Prentice Hall; 2009. Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 3rd ed. Upper Saddle River, NJ: Pearson/Prentice Hall; 2009.
38.
go back to reference Haley SM, Fragala-Pinkham MA. Interpreting change scores of tests and measures used in physical therapy. Phys Ther. 2006;86:735–43.PubMed Haley SM, Fragala-Pinkham MA. Interpreting change scores of tests and measures used in physical therapy. Phys Ther. 2006;86:735–43.PubMed
39.
go back to reference Schuck P, Zwingmann C. The ‘smallest real difference’ as a measure of sensitivity to change: a critical analysis. Int J Rehabil Res. 2003;26:85–91.PubMedCrossRef Schuck P, Zwingmann C. The ‘smallest real difference’ as a measure of sensitivity to change: a critical analysis. Int J Rehabil Res. 2003;26:85–91.PubMedCrossRef
40.
go back to reference Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.PubMedCrossRef Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.PubMedCrossRef
41.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.PubMedCrossRef Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.PubMedCrossRef
42.
go back to reference Bruton A, Conway JH, Holgate ST. Reliability: what is it, and how is it measured? Physiotherapy. 2000;86:94–9.CrossRef Bruton A, Conway JH, Holgate ST. Reliability: what is it, and how is it measured? Physiotherapy. 2000;86:94–9.CrossRef
43.
go back to reference Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek AL. Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res. 2001;10:571–8.PubMedCrossRef Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek AL. Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res. 2001;10:571–8.PubMedCrossRef
44.
45.
go back to reference Lexell JE, Downham DY. How to assess the reliability of measurements in rehabilitation. Am J Phys Med Rehabil. 2005;84:719–23.PubMedCrossRef Lexell JE, Downham DY. How to assess the reliability of measurements in rehabilitation. Am J Phys Med Rehabil. 2005;84:719–23.PubMedCrossRef
46.
go back to reference Koopman FS, Brehm MA, Heerkens YF, Nollet F, Beelen A. Measuring fatigue in polio survivors: content comparison and reliability of the fatigue severity scale and the checklist individual strength. J Rehabil Med. 2014;46:761–7.PubMedCrossRef Koopman FS, Brehm MA, Heerkens YF, Nollet F, Beelen A. Measuring fatigue in polio survivors: content comparison and reliability of the fatigue severity scale and the checklist individual strength. J Rehabil Med. 2014;46:761–7.PubMedCrossRef
47.
go back to reference Naegeli AN, Flood E, Tucker J, Devlen J, Edson-Heredia E. The patient experience with fatigue and content validity of a measure to assess fatigue severity: qualitative research in patients with ankylosing spondylitis (AS). Health Qual Life Outcomes. 2013;11:192.PubMedCentralPubMedCrossRef Naegeli AN, Flood E, Tucker J, Devlen J, Edson-Heredia E. The patient experience with fatigue and content validity of a measure to assess fatigue severity: qualitative research in patients with ankylosing spondylitis (AS). Health Qual Life Outcomes. 2013;11:192.PubMedCentralPubMedCrossRef
48.
go back to reference Michael KM, Allen JK, Macko RF. Fatigue after stroke: relationship to mobility, fitness, ambulatory activity, social support, and falls efficacy. Rehabil Nurs. 2006;31:210–7.PubMedCrossRef Michael KM, Allen JK, Macko RF. Fatigue after stroke: relationship to mobility, fitness, ambulatory activity, social support, and falls efficacy. Rehabil Nurs. 2006;31:210–7.PubMedCrossRef
49.
go back to reference Schepers VP, Visser-Meily AM, Ketelaar M, Lindeman E. Poststroke fatigue: course and its relation to personal and stroke-related factors. Arch Phys Med Rehabil. 2006;87:184–8.PubMedCrossRef Schepers VP, Visser-Meily AM, Ketelaar M, Lindeman E. Poststroke fatigue: course and its relation to personal and stroke-related factors. Arch Phys Med Rehabil. 2006;87:184–8.PubMedCrossRef
50.
go back to reference Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, Wright D, et al. Development of a fatigue scale. J Psychosom Res. 1993;37:147–53.PubMedCrossRef Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, Wright D, et al. Development of a fatigue scale. J Psychosom Res. 1993;37:147–53.PubMedCrossRef
51.
go back to reference Mendoza TR, Wang XS, Cleeland CS, Morrissey M, Johnson BA, Wendt JK, et al. The rapid assessment of fatigue severity in cancer patients: use of the Brief Fatigue Inventory. Cancer. 1999;85:1186–96.PubMedCrossRef Mendoza TR, Wang XS, Cleeland CS, Morrissey M, Johnson BA, Wendt JK, et al. The rapid assessment of fatigue severity in cancer patients: use of the Brief Fatigue Inventory. Cancer. 1999;85:1186–96.PubMedCrossRef
Metadata
Title
Reliability and validity of a vertical numerical rating scale supplemented with a faces rating scale in measuring fatigue after stroke
Authors
Li-ling Chuang
Keh-chung Lin
An-lun Hsu
Ching-yi Wu
Ku-chou Chang
Yen-chen Li
You-lin Chen
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2015
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-015-0290-9

Other articles of this Issue 1/2015

Health and Quality of Life Outcomes 1/2015 Go to the issue