Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2020

Open Access 01-12-2020 | Osteoarthrosis | Research

Evaluation of the content validity index of the Australian/Canadian osteoarthritis hand index, the patient-rated wrist/hand evaluation and the thumb disability exam in people with hand arthritis

Authors: Pavlos Bobos, Joy C. MacDermid, Eleni C. Boutsikari, Emily A. Lalone, Louis Ferreira, Ruby Grewal

Published in: Health and Quality of Life Outcomes | Issue 1/2020

Login to get access

Abstract

Background

The Australian/Canadian Osteoarthritis Hand Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) designed to assess pain and hand function in patients with hand arthritis, hand pain and disability, or thumb pathology respectively. This study evaluated the content validity of AUSCAN, PRWHE and TDX in people with hand arthritis.

Methods

This study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the raters.

Results

Overall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales were very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k > 0.76). The S-CVI for all PROMs was very high for relevance (AUSCAN = 0.92, 95% CI 0.90 to 0.94; PRWHE = 0.85, 95% CI 0.82 to 0.88 and TDX = 0.87, 95% CI 0.85 to 0.89) and for clarity (AUSCAN = 0.99, 95% CI 0.98 to 1.00; PRWHE = 0.95, 95% CI 0.93 to 0.97 and TDX = 0.91, 95% CI 0.89 to 0.94), respectively.

Conclusions

This study demonstrated very high content validity indices for the AUSCAN, PRWHE and TDX; with strong consensus across raters. This augments prior studies demonstrating appropriate statistical measurement properties, to provide confidence that all three measures assess important patient concepts of pain and disability.
Literature
1.
go back to reference Branco JC, Rodrigues AM, Gouveia N, Eusébio M, Ramiro S, Machado PM, et al. Prevalence of rheumatic and musculoskeletal diseases and their impact on health-related quality of life, physical function and mental health in Portugal: results from EpiReumaPt– a national health survey. RMD Open. 2016;2:e000166.PubMedPubMedCentralCrossRef Branco JC, Rodrigues AM, Gouveia N, Eusébio M, Ramiro S, Machado PM, et al. Prevalence of rheumatic and musculoskeletal diseases and their impact on health-related quality of life, physical function and mental health in Portugal: results from EpiReumaPt– a national health survey. RMD Open. 2016;2:e000166.PubMedPubMedCentralCrossRef
2.
go back to reference Dahaghin S, Bierma-Zeinstra SMA, Ginai AZ, Pols HAP, Hazes JMW, Koes BW. Prevalence and pattern of radiographic hand osteoarthritis and association with pain and disability (the Rotterdam study). Ann Rheum Dis. 2005;64:682.PubMedCrossRef Dahaghin S, Bierma-Zeinstra SMA, Ginai AZ, Pols HAP, Hazes JMW, Koes BW. Prevalence and pattern of radiographic hand osteoarthritis and association with pain and disability (the Rotterdam study). Ann Rheum Dis. 2005;64:682.PubMedCrossRef
3.
go back to reference Zhang Y, Niu J, Kelly-Hayes M, Chaisson CE, Aliabadi P, Felson DT. Prevalence of symptomatic hand osteoarthritis and its impact on functional status among the ElderlyThe Framingham study. Am J Epidemiol Oxford Academic. 2002;156:1021–7.PubMedCrossRef Zhang Y, Niu J, Kelly-Hayes M, Chaisson CE, Aliabadi P, Felson DT. Prevalence of symptomatic hand osteoarthritis and its impact on functional status among the ElderlyThe Framingham study. Am J Epidemiol Oxford Academic. 2002;156:1021–7.PubMedCrossRef
4.
go back to reference Bobos P, Nazari G, Szekeres M, Lalone EA, Ferreira L, MacDermid JC. The effectiveness of joint-protection programs on pain, hand function, and grip strength levels in patients with hand arthritis: a systematic review and meta-analysis. J Hand Ther. 2019;32:194–211.PubMedCrossRef Bobos P, Nazari G, Szekeres M, Lalone EA, Ferreira L, MacDermid JC. The effectiveness of joint-protection programs on pain, hand function, and grip strength levels in patients with hand arthritis: a systematic review and meta-analysis. J Hand Ther. 2019;32:194–211.PubMedCrossRef
5.
go back to reference Kloppenburg M, Kroon FP, Blanco FJ, Doherty M, Dziedzic KS, Greibrokk E, et al. 2018 update of the EULAR recommendations for the management of hand osteoarthritis. Ann Rheum Dis. 2019;78:16.PubMedCrossRef Kloppenburg M, Kroon FP, Blanco FJ, Doherty M, Dziedzic KS, Greibrokk E, et al. 2018 update of the EULAR recommendations for the management of hand osteoarthritis. Ann Rheum Dis. 2019;78:16.PubMedCrossRef
6.
go back to reference Cai P, Jiang T, Li B, Qin X, Lu Z, Le Y, et al. Comparison of rheumatoid arthritis (RA) and osteoarthritis (OA) based on microarray profiles of human joint fibroblast-like synoviocytes: bioinformation for RA and OA interpretation. Cell Biochem Funct. 2019;37:31–41. https://doi.org/10.1002/cbf.3370 [cited 2020 Apr 28].PubMedCrossRef Cai P, Jiang T, Li B, Qin X, Lu Z, Le Y, et al. Comparison of rheumatoid arthritis (RA) and osteoarthritis (OA) based on microarray profiles of human joint fibroblast-like synoviocytes: bioinformation for RA and OA interpretation. Cell Biochem Funct. 2019;37:31–41. https://​doi.​org/​10.​1002/​cbf.​3370 [cited 2020 Apr 28].PubMedCrossRef
9.
go back to reference Bobos P, Nazari G, Lu Z, MacDermid JC. Measurement properties of the hand grip strength assessment: a systematic review with meta-analysis. Arch Phys Med Rehabil. 2019;101:553–65.PubMedCrossRef Bobos P, Nazari G, Lu Z, MacDermid JC. Measurement properties of the hand grip strength assessment: a systematic review with meta-analysis. Arch Phys Med Rehabil. 2019;101:553–65.PubMedCrossRef
10.
go back to reference Bobos P, MacDermid JC, Walton DM, Gross A, Santaguida PL. Patient-reported outcome measures used for neck disorders: an overview of systematic reviews. J Orthop Sports Phys Ther. 2018;48:775–88.PubMedCrossRef Bobos P, MacDermid JC, Walton DM, Gross A, Santaguida PL. Patient-reported outcome measures used for neck disorders: an overview of systematic reviews. J Orthop Sports Phys Ther. 2018;48:775–88.PubMedCrossRef
11.
go back to reference Bobos P, MacDermid J, Nazari G, Furtado R. Psychometric properties of the global rating of change scales in patients with neck disorders: a systematic review with meta-analysis and meta-regression. BMJ Open. 2019;9:e033909.PubMedPubMedCentralCrossRef Bobos P, MacDermid J, Nazari G, Furtado R. Psychometric properties of the global rating of change scales in patients with neck disorders: a systematic review with meta-analysis and meta-regression. BMJ Open. 2019;9:e033909.PubMedPubMedCentralCrossRef
12.
go back to reference Bobos P, Ziebart C, Furtado R, Lu Z, MacDermid JC. Psychometric properties of the global rating of change scales in patients with low back pain, upper and lower extremity disorders. A systematic review with meta-analysis. J Orthop. 2020;21:40–8.PubMedCrossRef Bobos P, Ziebart C, Furtado R, Lu Z, MacDermid JC. Psychometric properties of the global rating of change scales in patients with low back pain, upper and lower extremity disorders. A systematic review with meta-analysis. J Orthop. 2020;21:40–8.PubMedCrossRef
13.
go back to reference McGee S, Sipos T, Allin T, Chen C, Greco A, Bobos P, et al. Systematic review of the measurement properties of performance-based functional tests in patients with neck disorders. BMJ Open. 2019;9:e031242.PubMedPubMedCentralCrossRef McGee S, Sipos T, Allin T, Chen C, Greco A, Bobos P, et al. Systematic review of the measurement properties of performance-based functional tests in patients with neck disorders. BMJ Open. 2019;9:e031242.PubMedPubMedCentralCrossRef
14.
go back to reference Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27:1159–70.PubMedPubMedCentralCrossRef Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27:1159–70.PubMedPubMedCentralCrossRef
15.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol Elsevier. 2010;63:737–45.PubMedCrossRef Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol Elsevier. 2010;63:737–45.PubMedCrossRef
16.
go back to reference Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health Elsevier. 2011;14:978–88.PubMedCrossRef Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health Elsevier. 2011;14:978–88.PubMedCrossRef
18.
go back to reference McQuillan TJ, Vora MM, Kenney DE, Crisco JJ, Weiss A-PC, Ebert KA, et al. The AUSCAN and PRWHE demonstrate comparable internal consistency and validity in patients with early thumb carpometacarpal osteoarthritis: HAND [Internet]. Los Angeles: SAGE PublicationsSage CA; 2017 [cited 2020 Apr 17]. https://doi.org/10.1177/1558944717729217.CrossRef McQuillan TJ, Vora MM, Kenney DE, Crisco JJ, Weiss A-PC, Ebert KA, et al. The AUSCAN and PRWHE demonstrate comparable internal consistency and validity in patients with early thumb carpometacarpal osteoarthritis: HAND [Internet]. Los Angeles: SAGE PublicationsSage CA; 2017 [cited 2020 Apr 17]. https://​doi.​org/​10.​1177/​1558944717729217​.CrossRef
19.
go back to reference Noback PC, Lombardi JM, Seetharaman M, Lee DH, Strauch RJ, Rosenwasser MP. Development and validation of a disease-specific questionnaire for basal joint arthritis. J Wrist Surg. 2017;06:126–33 Thieme Medical Publishers.CrossRef Noback PC, Lombardi JM, Seetharaman M, Lee DH, Strauch RJ, Rosenwasser MP. Development and validation of a disease-specific questionnaire for basal joint arthritis. J Wrist Surg. 2017;06:126–33 Thieme Medical Publishers.CrossRef
20.
go back to reference Bellamy N, Campbell J, Haraoui B, Buchbinder R, Hobby K, Roth JH, et al. Dimensionality and clinical importance of pain and disability in hand osteoarthritis: development of the Australian/Canadian (AUSCAN) osteoarthritis hand index. Osteoarthr Cartil. 2002;10:855–62.PubMedCrossRef Bellamy N, Campbell J, Haraoui B, Buchbinder R, Hobby K, Roth JH, et al. Dimensionality and clinical importance of pain and disability in hand osteoarthritis: development of the Australian/Canadian (AUSCAN) osteoarthritis hand index. Osteoarthr Cartil. 2002;10:855–62.PubMedCrossRef
21.
go back to reference Mehta SP, MacDermid JC, Richardson J, MacIntyre NJ, Grewal R. A systematic review of the measurement properties of the patient-rated wrist evaluation. J Orthop Sports Phys Ther. 2015 JOSPT, Inc. JOSPT, 1033 North Fairfax Street, Suite 304, Alexandria, VA 22134-1540 [cited 2020 Apr 17]. https://doi.org/10.2519/jospt.2015.5236. Mehta SP, MacDermid JC, Richardson J, MacIntyre NJ, Grewal R. A systematic review of the measurement properties of the patient-rated wrist evaluation. J Orthop Sports Phys Ther. 2015 JOSPT, Inc. JOSPT, 1033 North Fairfax Street, Suite 304, Alexandria, VA 22134-1540 [cited 2020 Apr 17]. https://​doi.​org/​10.​2519/​jospt.​2015.​5236.
22.
go back to reference Allen KD, Jordan JM, Renner JB, Kraus VB. Validity, factor structure, and clinical relevance of the AUSCAN osteoarthritis hand index. Arthritis Rheum. John Wiley & Sons, Ltd. 2006;54:551–6.PubMedCrossRef Allen KD, Jordan JM, Renner JB, Kraus VB. Validity, factor structure, and clinical relevance of the AUSCAN osteoarthritis hand index. Arthritis Rheum. John Wiley & Sons, Ltd. 2006;54:551–6.PubMedCrossRef
24.
go back to reference Haugen IK, Moe RH, Slatkowsky-Christensen B, Kvien TK, van der Heijde D, Garratt A. The AUSCAN subscales, AIMS-2 hand/finger subscale, and FIOHA were not unidimensional scales. J Clin Epidemiol. 2011;64:1039–46.PubMedCrossRef Haugen IK, Moe RH, Slatkowsky-Christensen B, Kvien TK, van der Heijde D, Garratt A. The AUSCAN subscales, AIMS-2 hand/finger subscale, and FIOHA were not unidimensional scales. J Clin Epidemiol. 2011;64:1039–46.PubMedCrossRef
26.
go back to reference MacDermid JC, Tottenham V. Responsiveness of the disability of the arm, shoulder, and hand (DASH) and patient-rated wrist/hand evaluation (PRWHE) in evaluating change after hand therapy. J Hand Ther. Elsevier. 2004;17:18–23.PubMedCrossRef MacDermid JC, Tottenham V. Responsiveness of the disability of the arm, shoulder, and hand (DASH) and patient-rated wrist/hand evaluation (PRWHE) in evaluating change after hand therapy. J Hand Ther. Elsevier. 2004;17:18–23.PubMedCrossRef
27.
go back to reference Packham T, MacDermid JC. Measurement properties of the patient-rated wrist and hand evaluation: Rasch analysis of responses from a traumatic hand injury population. J Hand Ther Elsevier. 2013;26:216–24.PubMedCrossRef Packham T, MacDermid JC. Measurement properties of the patient-rated wrist and hand evaluation: Rasch analysis of responses from a traumatic hand injury population. J Hand Ther Elsevier. 2013;26:216–24.PubMedCrossRef
28.
go back to reference MacDermid JC, Wessel J, Humphrey R, Ross D, Roth JH. Validity of self-report measures of pain and disability for persons who have undergone arthroplasty for osteoarthritis of the carpometacarpal joint of the hand. Osteoarthr Cartil Elsevier. 2007;15:524–30.PubMedCrossRef MacDermid JC, Wessel J, Humphrey R, Ross D, Roth JH. Validity of self-report measures of pain and disability for persons who have undergone arthroplasty for osteoarthritis of the carpometacarpal joint of the hand. Osteoarthr Cartil Elsevier. 2007;15:524–30.PubMedCrossRef
29.
go back to reference Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. John Wiley & Sons, Ltd. 2007;30:459–67.PubMedCrossRef Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. John Wiley & Sons, Ltd. 2007;30:459–67.PubMedCrossRef
30.
go back to reference Cicchetti DV, Sparrow SA. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am J Ment Defic US: American Assn on Mental Retardation. 1981;86:127–37.PubMed Cicchetti DV, Sparrow SA. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am J Ment Defic US: American Assn on Mental Retardation. 1981;86:127–37.PubMed
31.
32.
go back to reference Kleinlugtenbelt YV, Krol RG, Bhandari M, Goslings JC, Poolman RW, Scholtes VAB. Are the patient-rated wrist evaluation (PRWE) and the disabilities of the arm, shoulder and hand (DASH) questionnaire used in distal radial fractures truly valid and reliable? Bone Joint Res. 2018 The British Editorial Society of Bone and Joint Surgery London [cited 2020 Apr 25]. https://doi.org/10.1302/2046-3758.71.BJR-2017-0081.R1. Kleinlugtenbelt YV, Krol RG, Bhandari M, Goslings JC, Poolman RW, Scholtes VAB. Are the patient-rated wrist evaluation (PRWE) and the disabilities of the arm, shoulder and hand (DASH) questionnaire used in distal radial fractures truly valid and reliable? Bone Joint Res. 2018 The British Editorial Society of Bone and Joint Surgery London [cited 2020 Apr 25]. https://​doi.​org/​10.​1302/​2046-3758.​71.​BJR-2017-0081.​R1.
33.
go back to reference Shauver MJ, Chung KC. The Michigan hand outcomes questionnaire (MHQ) after 15 years of field trial. Plast Reconstr Surg. NIH Public Access. 2013;131:779e.PubMedPubMedCentralCrossRef Shauver MJ, Chung KC. The Michigan hand outcomes questionnaire (MHQ) after 15 years of field trial. Plast Reconstr Surg. NIH Public Access. 2013;131:779e.PubMedPubMedCentralCrossRef
34.
go back to reference Gummesson C, Atroshi I, Ekdahl C. The disabilities of the arm, shoulder and hand (DASH) outcome questionnaire: longitudinal construct validity and measuring self-rated health change after surgery [Internet]. BMC Musculoskelet Disord. 2003; [cited 2020 Aug 9]. Available from: https://pubmed.ncbi.nlm.nih.gov/12809562/. Gummesson C, Atroshi I, Ekdahl C. The disabilities of the arm, shoulder and hand (DASH) outcome questionnaire: longitudinal construct validity and measuring self-rated health change after surgery [Internet]. BMC Musculoskelet Disord. 2003; [cited 2020 Aug 9]. Available from: https://​pubmed.​ncbi.​nlm.​nih.​gov/​12809562/​.
36.
go back to reference Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. John Wiley & Sons, Ltd. 2006;29:489–97.PubMedCrossRef Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. John Wiley & Sons, Ltd. 2006;29:489–97.PubMedCrossRef
Metadata
Title
Evaluation of the content validity index of the Australian/Canadian osteoarthritis hand index, the patient-rated wrist/hand evaluation and the thumb disability exam in people with hand arthritis
Authors
Pavlos Bobos
Joy C. MacDermid
Eleni C. Boutsikari
Emily A. Lalone
Louis Ferreira
Ruby Grewal
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2020
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-020-01556-0

Other articles of this Issue 1/2020

Health and Quality of Life Outcomes 1/2020 Go to the issue