Skip to main content
Top
Published in: Journal of Occupational Rehabilitation 4/2021

Open Access 01-12-2021 | Stroke

Measurement Properties of the Full and Brief Version of the Work Rehabilitation Questionnaire in Persons with Physical Disabilities

Authors: Ellen H. Roels, Michiel F. Reneman, Marcel W. M. Post

Published in: Journal of Occupational Rehabilitation | Issue 4/2021

Login to get access

Abstract

Purpose The Work Rehabilitation Questionnaire (WORQ) is a self-report vocational rehabilitation assessment. A comprehensive (WORQ-FULL) and a brief version (WORQ-BRIEF) are available. The purpose of this study was to investigate measurement properties of both versions in persons with physical disabilities. Methods Cross sectional and test–retest design. Adults with physical disabilities in vocational rehabilitation were included. Internal consistency (Cronbach’s alpha), test–retest reliability (intra-class correlation; ICC), agreement between sessions (Bland–Altman Plots), criterion validity (ICC and agreement with Bland–Altman Plots between WORQ-FULL and WORQ-BRIEF) and convergent validity with the Work Ability Index -Single item (WAS) and the EuroQOL 5D-5L were analyzed. Results Out of the 91 individuals who agreed to participate, 74 (81%) returned questionnaire T1 and 49 (54%) participants returned questionnaire T2 within the maximum time interval (= 27 days). At T2, 28 (57%) participants reported no medical changes compared to T1. Median age was 49 (IQR 40–60), 57% were male, 47% had experienced a stroke and 27% a spinal cord injury (n = 49). Internal consistency was good: 0.95/0.95/0.94 for the WORQ-FULL and 0.88/0.89/0.85 for the WORQ-BRIEF (n = 74/n = 48/n = 28, respectively). Test–retest reliabilitywas good: ICC = 0.86/0.85 for the WORQ-FULL and ICC = 0.87/0.86 for the WORQ-BRIEF (n = 49/ n = 28). Bland Altman plots suggested a higher score at T1. As for criterion validity of the WORQ-FULL versus the WORQ-BRIEF, ICC was good (ICC = 0.84; n = 74), however Bland Altman plots indicated potential bias. Correlations with the WAS/EuroQOL 5D-5L were variable: r = -0.24/r = -0.57 (WORQ-FULL) and r = -0.28/-0.65 (WORQ-BRIEF). Conclusions The WORQ showed good internal consistency and test–retest reliability. Agreement demonstrated large score differences are needed to indicate change beyond random chance at individual level, whereas small changes are sufficient at group level. Criterion validity of the WORQ-FULL versus the WORQ-BRIEF was supported, however, agreement demonstrated moderate to large score differences are needed to indicate change beyond random chance at individual level, whereas small changes are sufficient at group level. This indicates the WORQ-FULL and WORQ-BRIEF are better not used interchangeably. Correlation analyses provided better insight in the validity of the WORQ. Convergent validity was supported for the WORQ-BRIEF with the EuroQoL 5D-5L (r = -0.65).
Literature
1.
go back to reference Roels EH, Aertgeerts B, Ramaekers D, Peers K. Hospital- and community-based interventions enhancing (re)employment for people with spinal cord injury: a systematic review. Spinal Cord [Internet]. 2016;54(1):2–7.CrossRef Roels EH, Aertgeerts B, Ramaekers D, Peers K. Hospital- and community-based interventions enhancing (re)employment for people with spinal cord injury: a systematic review. Spinal Cord [Internet]. 2016;54(1):2–7.CrossRef
2.
go back to reference DeVivo MJ. Causes and costs of spinal cord injury in the United States. Spinal Cord. 2013;35(12):809–813.CrossRef DeVivo MJ. Causes and costs of spinal cord injury in the United States. Spinal Cord. 2013;35(12):809–813.CrossRef
3.
go back to reference Harris C. Return to work after stroke: a nursing state of the science. Stroke. 2014;45(9):e174–e176.CrossRef Harris C. Return to work after stroke: a nursing state of the science. Stroke. 2014;45(9):e174–e176.CrossRef
4.
go back to reference Cancelliere C, Donovan J, Stochkendahl MJ, Biscardi M, Ammendolia C, Myburgh C, et al. Factors affecting return to work after injury or illness: best evidence synthesis of systematic reviews. Chiropractic Manual Ther. 2016;24(1):1–23.CrossRef Cancelliere C, Donovan J, Stochkendahl MJ, Biscardi M, Ammendolia C, Myburgh C, et al. Factors affecting return to work after injury or illness: best evidence synthesis of systematic reviews. Chiropractic Manual Ther. 2016;24(1):1–23.CrossRef
5.
go back to reference Ottomanelli L, Lind L. Review of critical factors related to employment after spinal cord injury: implications for research and vocational services. J Spinal Cord Med. 2009;32(5):503–531.CrossRef Ottomanelli L, Lind L. Review of critical factors related to employment after spinal cord injury: implications for research and vocational services. J Spinal Cord Med. 2009;32(5):503–531.CrossRef
6.
go back to reference Duong P, Sauvé-Schenk K, Egan MY, Meyer MJMT. Operational definitions and estimates of return-to-work after stroke: a systematic review and meta-analysis. Arch Phys Med Rehabil. 2018;100(6):1140–1152.CrossRef Duong P, Sauvé-Schenk K, Egan MY, Meyer MJMT. Operational definitions and estimates of return-to-work after stroke: a systematic review and meta-analysis. Arch Phys Med Rehabil. 2018;100(6):1140–1152.CrossRef
7.
go back to reference Escorpizo, Reuben, Finger ME, Reneman MF. Handbook of return to work. Schultz IZ, Gatchel RJ, editor. New York: Springer. 2016. 99–118. Escorpizo, Reuben, Finger ME, Reneman MF. Handbook of return to work. Schultz IZ, Gatchel RJ, editor. New York: Springer. 2016. 99–118.
8.
go back to reference World Health Organisation. International Classification of Functioning, Disability and Health: ICF. Geneva: Worl Health Organisation; 2001. World Health Organisation. International Classification of Functioning, Disability and Health: ICF. Geneva: Worl Health Organisation; 2001.
9.
go back to reference Finger M, Escorpizo R, Glässel A, Gmünder H, Lückenkemper M, Chan C, et al. ICF Core Set for vocational rehabilitation: results of an international consensus conference. Disabil Rehabil. 2012;34(5):429–438.CrossRef Finger M, Escorpizo R, Glässel A, Gmünder H, Lückenkemper M, Chan C, et al. ICF Core Set for vocational rehabilitation: results of an international consensus conference. Disabil Rehabil. 2012;34(5):429–438.CrossRef
10.
go back to reference Finger ME, Escorpizo R, Bostan C, De Bie R. Work rehabilitation questionnaire (WORQ): Development and preliminary psychometric evidence of an icf-based questionnaire for vocational rehabilitation. J Occup Rehabil. 2014;24(3):498–510.PubMed Finger ME, Escorpizo R, Bostan C, De Bie R. Work rehabilitation questionnaire (WORQ): Development and preliminary psychometric evidence of an icf-based questionnaire for vocational rehabilitation. J Occup Rehabil. 2014;24(3):498–510.PubMed
11.
go back to reference Selb M, Finger ME, Escorpizo R. Applying the Work Rehabilitation Questionnaire WORQ: A case illustrating its use in evaluating functioning of a person after a traumatic brain injury in an interprofessional vocational rehabilitation setting. Handbook of vocational rehabilitation and disability evaluation: Application and implementation of the ICF. 2015. Selb M, Finger ME, Escorpizo R. Applying the Work Rehabilitation Questionnaire WORQ: A case illustrating its use in evaluating functioning of a person after a traumatic brain injury in an interprofessional vocational rehabilitation setting. Handbook of vocational rehabilitation and disability evaluation: Application and implementation of the ICF. 2015.
12.
go back to reference Portmann Bergamaschi R, Escorpizo R, Staubli S, Finger ME. Content validity of the Work Rehabilitation Questionnaire-Self-Report Version WORQ-SELF in a subgroup of spinal cord injury patients. Spinal Cord. 2014;52(3):225–230.CrossRef Portmann Bergamaschi R, Escorpizo R, Staubli S, Finger ME. Content validity of the Work Rehabilitation Questionnaire-Self-Report Version WORQ-SELF in a subgroup of spinal cord injury patients. Spinal Cord. 2014;52(3):225–230.CrossRef
14.
go back to reference Finger ME, Wicki-Roten V, Leger B, Escorpizo R. Cross-cultural adaptation of the WORK Rehabilitation Questionnaire (WORQ) to French: a valid and reliable instrument to assess work functioning. J Occup Rehabil. 2018;29(2):350–360.CrossRef Finger ME, Wicki-Roten V, Leger B, Escorpizo R. Cross-cultural adaptation of the WORK Rehabilitation Questionnaire (WORQ) to French: a valid and reliable instrument to assess work functioning. J Occup Rehabil. 2018;29(2):350–360.CrossRef
15.
go back to reference Vermeulen K, Woestyn M, Oostra K, Geers S, Ryngaert K, Van De Velde K, et al. Cross-cultural adaptation and psychometric evaluation of the Dutch Version of the Work Rehabilitation Questionnaire (WORQ-VL). J Occup Rehabil. 2018;29(3):514–525.CrossRef Vermeulen K, Woestyn M, Oostra K, Geers S, Ryngaert K, Van De Velde K, et al. Cross-cultural adaptation and psychometric evaluation of the Dutch Version of the Work Rehabilitation Questionnaire (WORQ-VL). J Occup Rehabil. 2018;29(3):514–525.CrossRef
16.
go back to reference Husmann A, Escorpizo R, Finger ME. Examining work-related functioning in a physical therapy outpatient clinic: validity and reliability of the Work Rehabilitation Questionnaire (WORQ). J Occup Rehabil. 2020;30:156–166.CrossRef Husmann A, Escorpizo R, Finger ME. Examining work-related functioning in a physical therapy outpatient clinic: validity and reliability of the Work Rehabilitation Questionnaire (WORQ). J Occup Rehabil. 2020;30:156–166.CrossRef
17.
go back to reference Finger ME, Escorpizo R, Tennant A. Measuring work-related functioning using the work rehabilitation questionnaire (WORQ). Int J Environ Res Public Health. 2019;16(15):1–15.CrossRef Finger ME, Escorpizo R, Tennant A. Measuring work-related functioning using the work rehabilitation questionnaire (WORQ). Int J Environ Res Public Health. 2019;16(15):1–15.CrossRef
18.
go back to reference Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRef Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRef
19.
20.
go back to reference Ahlstrom L, Grimby-Ekman A, Hagberg M, Dellve L. The Work Ability Index and single-item question: associations with sick leave, symptoms, and health—a prospective study of women on long-term sick leave. Scand J Work Environ Heal. 2010;36(5):404–412.CrossRef Ahlstrom L, Grimby-Ekman A, Hagberg M, Dellve L. The Work Ability Index and single-item question: associations with sick leave, symptoms, and health—a prospective study of women on long-term sick leave. Scand J Work Environ Heal. 2010;36(5):404–412.CrossRef
21.
go back to reference Roelen CAM, Van Rhenen W, Groothoff JW, van der Klink JJL, Twisk JWR, Heymans MW. Work ability as prognostic risk marker of disability pension: single-item work ability score versus multi-item work ability index. Scand J Work Environ Heal. 2014;40(4):428–431.CrossRef Roelen CAM, Van Rhenen W, Groothoff JW, van der Klink JJL, Twisk JWR, Heymans MW. Work ability as prognostic risk marker of disability pension: single-item work ability score versus multi-item work ability index. Scand J Work Environ Heal. 2014;40(4):428–431.CrossRef
22.
go back to reference Hunger M, Sabariego C, Stollenwerk B, Cieza A, Leidl R. Validity, reliability and responsiveness of the EQ-5D in German stroke patients undergoing rehabilitation. Qual Life Res. 2012;21(7):1205–1216.CrossRef Hunger M, Sabariego C, Stollenwerk B, Cieza A, Leidl R. Validity, reliability and responsiveness of the EQ-5D in German stroke patients undergoing rehabilitation. Qual Life Res. 2012;21(7):1205–1216.CrossRef
24.
go back to reference Devlin NJ, Brooks R. EQ-5D and the EuroQol Group: past, present and future. Appl Health Econ Health Policy. 2017;15(2):127–137.CrossRef Devlin NJ, Brooks R. EQ-5D and the EuroQol Group: past, present and future. Appl Health Econ Health Policy. 2017;15(2):127–137.CrossRef
25.
go back to reference Buchholz I, Janssen MF, Kohlmann T, Feng YS. A systematic review of studies comparing the measurement properties of the three-level and five-level versions of the EQ-5D. Pharmacoeconomics. 2018;36(6):645–661.CrossRef Buchholz I, Janssen MF, Kohlmann T, Feng YS. A systematic review of studies comparing the measurement properties of the three-level and five-level versions of the EQ-5D. Pharmacoeconomics. 2018;36(6):645–661.CrossRef
27.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–163.CrossRef Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–163.CrossRef
28.
go back to reference Hays R, Anderson R, Revicki D. Assessing reliability and validity of measurement in clinical trials. In: Quality of life assessment in clinical trials. 1998. Hays R, Anderson R, Revicki D. Assessing reliability and validity of measurement in clinical trials. In: Quality of life assessment in clinical trials. 1998.
29.
go back to reference Post MWM, Forchheimer MB, Charlifue S, D’Andréa Greve JM, New PW, Tate DG. Reproducibility of the international spinal cord injury quality of life basic data set: an international psychometric study. Spinal Cord. 2019;57(11):992–998.CrossRef Post MWM, Forchheimer MB, Charlifue S, D’Andréa Greve JM, New PW, Tate DG. Reproducibility of the international spinal cord injury quality of life basic data set: an international psychometric study. Spinal Cord. 2019;57(11):992–998.CrossRef
30.
go back to reference Visser-Meily JMA, Post MWM, Riphagen II, Lindeman E. Measures used to assess burden among caregivers of stroke patients: A review. Clin Rehabil. 2004;18(6):601–623.CrossRef Visser-Meily JMA, Post MWM, Riphagen II, Lindeman E. Measures used to assess burden among caregivers of stroke patients: A review. Clin Rehabil. 2004;18(6):601–623.CrossRef
Metadata
Title
Measurement Properties of the Full and Brief Version of the Work Rehabilitation Questionnaire in Persons with Physical Disabilities
Authors
Ellen H. Roels
Michiel F. Reneman
Marcel W. M. Post
Publication date
01-12-2021
Publisher
Springer US
Keyword
Stroke
Published in
Journal of Occupational Rehabilitation / Issue 4/2021
Print ISSN: 1053-0487
Electronic ISSN: 1573-3688
DOI
https://doi.org/10.1007/s10926-021-09973-8

Other articles of this Issue 4/2021

Journal of Occupational Rehabilitation 4/2021 Go to the issue