Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2020

01-12-2020 | Pathology | Research

Interpretation and content validity of the items of the numeric rating version short-WORC to evaluate outcomes in management of rotator cuff pathology: a cognitive interview approach

Authors: Rochelle Furtado, Joy C. MacDermid, Dianne M. Bryant, Kenneth J. Faber, George S. Athwal

Published in: Health and Quality of Life Outcomes | Issue 1/2020

Login to get access

Abstract

Background

The shortened version of the Western Ontario Rotator Cuff Index (Short-WORC) is a patient reported outcome measure that evaluates quality of life (QoL) of patients with rotator cuff pathology. However, formal content validation of the full or Short-WORC has not been reported. This study aims to understand how 1) people interpret and calibrate responses to items on the Short-WORC and 2) compensatory strategies that might enhance function and thereby affect responses.

Methods

This study uses cognitive interviewing, a qualitative methodology that focuses on the interpretation of questionnaire items. Patients with rotator cuff disorders (n = 10), clinicians (n = 6) and measurement researchers (n = 10) were interviewed using a talk aloud structured interview that evaluated each of the 7 items of the Short-WORC. All interviews were recorded and transcribed verbatim by one researcher (R.F). Analysis was done through an open coding scheme using a previously established framework.

Results

Overall, the items on the Short-WORC were well received by participants. Through the interviews, the 6 themes of: Comprehension, Inadequate response definition, Reference Point, Relevance, Perspective Modifiers and Calibration Across Items emerged. The items of working above the shoulder (90%), compensating with the unaffected arm (88%) and lifting heavy objects (92%) were the most relevant to participants. Participants calibrated their scores on the items of sleeping and styling (19%) the most. Perspective modifiers of gender, influenced the calibrations of items of styling your hair (30%) and dressing or undressing (19%). Compensatory strategies of task-re allocation and using assistive devices/resources were frequently mentioned by participants. Overall, participants had minor comprehension issues, but found the 7- items of the Short-WORC to be relevant to QoL.

Conclusions

Therefore, the findings demonstrate that the Short-WORC is not cognitively complex, but varies with patient perspectives. Overall, the Short-WORC provides evidence of demonstrating strong content validity when used for rotator cuff disorder patients.
Literature
1.
go back to reference Dewan N, MacDermid JC, MacIntyre N, Grewal R. Reproducibility: reliability and agreement of short version of Western Ontario rotator cuff index (short-WORC) in patients with rotator cuff disorders. J Hand Ther. 2016;29(3):281–91.CrossRef Dewan N, MacDermid JC, MacIntyre N, Grewal R. Reproducibility: reliability and agreement of short version of Western Ontario rotator cuff index (short-WORC) in patients with rotator cuff disorders. J Hand Ther. 2016;29(3):281–91.CrossRef
2.
go back to reference Puga VOO, Lopes AD, Costa LOP. Assessment of cross-cultural adaptations and measurement properties of self-report outcome measures relevant to shoulder disability in Portuguese: a systematic review. Braz J Phys Ther. 2012;16(2):85–93.CrossRef Puga VOO, Lopes AD, Costa LOP. Assessment of cross-cultural adaptations and measurement properties of self-report outcome measures relevant to shoulder disability in Portuguese: a systematic review. Braz J Phys Ther. 2012;16(2):85–93.CrossRef
3.
go back to reference Johanson ME. Rehabilitation after surgical reconstruction to restore function to the upper limb in tetraplegia: a changing landscape. Arch Phys Med Rehabil. 2016;97(6):S71–4.CrossRef Johanson ME. Rehabilitation after surgical reconstruction to restore function to the upper limb in tetraplegia: a changing landscape. Arch Phys Med Rehabil. 2016;97(6):S71–4.CrossRef
4.
go back to reference Michener LA, Synder AR. Evaluation of health-related quality of life in patients with shoulder pain: are we doing the best we can? Clin Sports Med. 2008;27(3):491–505.CrossRef Michener LA, Synder AR. Evaluation of health-related quality of life in patients with shoulder pain: are we doing the best we can? Clin Sports Med. 2008;27(3):491–505.CrossRef
5.
go back to reference Kirkley A, Griffin S. Development of disease-specific quality of life measurement tools. Arthroscopy. 2003;19(10):1121–8.CrossRef Kirkley A, Griffin S. Development of disease-specific quality of life measurement tools. Arthroscopy. 2003;19(10):1121–8.CrossRef
7.
go back to reference Furtado R, MacDermid JC. Clinimetrics: short Western Ontario rotator cuff index. J Physiother. 2019;65(1):56.CrossRef Furtado R, MacDermid JC. Clinimetrics: short Western Ontario rotator cuff index. J Physiother. 2019;65(1):56.CrossRef
9.
go back to reference Lee JJ, Lee MK, Kim JE, Kim HZ, Park SH, Tae JH, et al. Pain relief scale is more highly correlated with numerical rating scale than with visual analogue scale in chronic pain patients. Pain Physician. 2015;18(2):195–200. Lee JJ, Lee MK, Kim JE, Kim HZ, Park SH, Tae JH, et al. Pain relief scale is more highly correlated with numerical rating scale than with visual analogue scale in chronic pain patients. Pain Physician. 2015;18(2):195–200.
11.
go back to reference Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28:563–75.CrossRef Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28:563–75.CrossRef
12.
go back to reference Myrvik MP, Drendel AL, Brandow AM, Yan K, Hoffmann RG, Panepinto JA. A comparison of pain assessment measures in pediatric sickle cell disease: visual analog scale versus numeric rating scale. J Pediatr Hematol Oncol. 2015;37(3):190–4.CrossRef Myrvik MP, Drendel AL, Brandow AM, Yan K, Hoffmann RG, Panepinto JA. A comparison of pain assessment measures in pediatric sickle cell disease: visual analog scale versus numeric rating scale. J Pediatr Hematol Oncol. 2015;37(3):190–4.CrossRef
13.
go back to reference Food Drug Administration (FDA). Guidance for industry patient- reported outcome measures: use in medical product development to support labeling claims. Fed Regist. 2009;74(235):65132–3. Food Drug Administration (FDA). Guidance for industry patient- reported outcome measures: use in medical product development to support labeling claims. Fed Regist. 2009;74(235):65132–3.
14.
go back to reference Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks: Sage Publications; 2004. Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks: Sage Publications; 2004.
16.
go back to reference Damman OC, Hendriks M, Rademakers J, Delnoij DM, Groenewegen PP. How do healthcare consumers process and evaluate comparative healthcare information? A qualitative study using cognitive interviews. BMC Public Health. 2009;9(1):423.CrossRef Damman OC, Hendriks M, Rademakers J, Delnoij DM, Groenewegen PP. How do healthcare consumers process and evaluate comparative healthcare information? A qualitative study using cognitive interviews. BMC Public Health. 2009;9(1):423.CrossRef
17.
go back to reference Arumugam V, MacDermid JC, Grewal R. Content analysis of work limitation, Stanford presenteeism, and work instability questionnaires using international classification of functioning, disability, and health and item perspective framework. In: Rehabilitation research and practice; 2013. Arumugam V, MacDermid JC, Grewal R. Content analysis of work limitation, Stanford presenteeism, and work instability questionnaires using international classification of functioning, disability, and health and item perspective framework. In: Rehabilitation research and practice; 2013.
18.
go back to reference MacDermid J. Cognitive interviewing (CI) - to identify sources of interpretation dissonance in in patient-reported outcome measures (PRO).1-3; 2018. MacDermid J. Cognitive interviewing (CI) - to identify sources of interpretation dissonance in in patient-reported outcome measures (PRO).1-3; 2018.
20.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.CrossRef Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.CrossRef
21.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRef Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRef
22.
go back to reference Terwee CB, Prinsen CA, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27(5):1159–70.CrossRef Terwee CB, Prinsen CA, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27(5):1159–70.CrossRef
23.
go back to reference Murtagh FE, Addington-Hall JM, Higginson IJ. The value of cognitive interviewing techniques in palliative care research. Palliat Med. 2007;21(2):87–93.CrossRef Murtagh FE, Addington-Hall JM, Higginson IJ. The value of cognitive interviewing techniques in palliative care research. Palliat Med. 2007;21(2):87–93.CrossRef
24.
go back to reference Bialocerkowski AE. Difficulties associated with wrist disorders–a qualitative study. Clin Rehabil. 2002;16(4):429–40.CrossRef Bialocerkowski AE. Difficulties associated with wrist disorders–a qualitative study. Clin Rehabil. 2002;16(4):429–40.CrossRef
25.
go back to reference Magasi S, Ryan G, Revicki D, Lenderking W, Hays R, Brod M, et al. Content validity of patient-reported outcome measures: perspectives from a PROMIS meeting. Qual Life Res. 2012;21(5):739–46.CrossRef Magasi S, Ryan G, Revicki D, Lenderking W, Hays R, Brod M, et al. Content validity of patient-reported outcome measures: perspectives from a PROMIS meeting. Qual Life Res. 2012;21(5):739–46.CrossRef
26.
go back to reference Mercier C, Peladeau N, Tempier R. Age, gender and quality of life. Community Ment Health J. 1998;34(5):487–500.CrossRef Mercier C, Peladeau N, Tempier R. Age, gender and quality of life. Community Ment Health J. 1998;34(5):487–500.CrossRef
27.
go back to reference Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104.CrossRef Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104.CrossRef
28.
go back to reference Packham TL, MacDermid J. Content validity of the patient-report Hamilton inventory for complex regional pain syndrome. J Hand Ther. 2014;27(3):e3.CrossRef Packham TL, MacDermid J. Content validity of the patient-report Hamilton inventory for complex regional pain syndrome. J Hand Ther. 2014;27(3):e3.CrossRef
29.
go back to reference Shi J, Mo X, Sun Z. Content validity index in scale development. J Central South Univ Med Sci. 2012;37(2):152–5. Shi J, Mo X, Sun Z. Content validity index in scale development. J Central South Univ Med Sci. 2012;37(2):152–5.
Metadata
Title
Interpretation and content validity of the items of the numeric rating version short-WORC to evaluate outcomes in management of rotator cuff pathology: a cognitive interview approach
Authors
Rochelle Furtado
Joy C. MacDermid
Dianne M. Bryant
Kenneth J. Faber
George S. Athwal
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Pathology
Published in
Health and Quality of Life Outcomes / Issue 1/2020
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-020-01339-7

Other articles of this Issue 1/2020

Health and Quality of Life Outcomes 1/2020 Go to the issue