Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2012

Open Access 01-12-2012 | Research article

Exploring differential item functioning in the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC)

Authors: Beth Pollard, Marie Johnston, Diane Dixon

Published in: BMC Musculoskeletal Disorders | Issue 1/2012

Login to get access

Abstract

Background

The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) is a widely used patient reported outcome in osteoarthritis. An important, but frequently overlooked, aspect of validating health outcome measures is to establish if items exhibit differential item functioning (DIF). That is, if respondents have the same underlying level of an attribute, does the item give the same score in different subgroups or is it biased towards one subgroup or another. The aim of the study was to explore DIF in the Likert format WOMAC for the first time in a UK osteoarthritis population with respect to demographic, social, clinical and psychological factors.

Methods

The sample comprised a community sample of 763 people with osteoarthritis who participated in the Somerset and Avon Survey of Health. The WOMAC was explored for DIF by gender, age, social deprivation, social class, employment status, distress, body mass index and clinical factors. Ordinal regression models were used to identify DIF items.

Results

After adjusting for age, two items were identified for the physical functioning subscale as having DIF with age identified as the DIF factor for 2 items, gender for 1 item and body mass index for 1 item. For the WOMAC pain subscale, for people with hip osteoarthritis one item was identified with age-related DIF. The impact of the DIF items rarely had a significant effect on the conclusions of group comparisons.

Conclusions

Overall, the WOMAC performed well with only a small number of DIF items identified. However, as DIF items were identified in for the WOMAC physical functioning subscale it would be advisable to analyse data taking into account the possible impact of the DIF items when weight, gender or especially age effects, are the focus of interest in UK-based osteoarthritis studies. Similarly for the WOMAC pain subscale in people with hip osteoarthritis it would be worthwhile to analyse data taking into account the possible impact of the DIF item when age comparisons are of primary interest.
Appendix
Available only for authorised users
Literature
2.
go back to reference Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC - a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug-therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15: 1833-1840.PubMed Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC - a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug-therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15: 1833-1840.PubMed
3.
go back to reference Brockow T, Cieza A, Kuhlow H, Sigl T, Franke T, Harder M: Identifying the concepts contained in outcome measures of clinical trials on musculoskeletal disorders and chronic widespread pain using the international classification of functioning, disability and health as a reference. J Rehabil Med. 2004, 36: 30-36. 10.1080/16501960410015371.CrossRef Brockow T, Cieza A, Kuhlow H, Sigl T, Franke T, Harder M: Identifying the concepts contained in outcome measures of clinical trials on musculoskeletal disorders and chronic widespread pain using the international classification of functioning, disability and health as a reference. J Rehabil Med. 2004, 36: 30-36. 10.1080/16501960410015371.CrossRef
4.
go back to reference Covic T, Pallant JF, Conaghan PG, Tennant A: A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D) in a rheumatoid arthritis population using Rasch analysis. Health Qual Life Outcomes. 2007, 5: 41-10.1186/1477-7525-5-41.CrossRefPubMedPubMedCentral Covic T, Pallant JF, Conaghan PG, Tennant A: A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D) in a rheumatoid arthritis population using Rasch analysis. Health Qual Life Outcomes. 2007, 5: 41-10.1186/1477-7525-5-41.CrossRefPubMedPubMedCentral
5.
go back to reference Zumbo BD, Koh KH: Manifestation of differences in item-level characteristics in scale-level measurement invariance tests of multi group confirmatory factor analysis. J Mod App Stat Met. 2005, 4: 275-282. Zumbo BD, Koh KH: Manifestation of differences in item-level characteristics in scale-level measurement invariance tests of multi group confirmatory factor analysis. J Mod App Stat Met. 2005, 4: 275-282.
6.
go back to reference Teresi JA, Fleishman JA: Differential item functioning and health assessment. Qual Life Res. 2007, 16 (Suppl 1): 33-42.CrossRefPubMed Teresi JA, Fleishman JA: Differential item functioning and health assessment. Qual Life Res. 2007, 16 (Suppl 1): 33-42.CrossRefPubMed
7.
go back to reference McHorney CA, Fleishman JA: Assessing and understanding measurement equivalence in health outcome measures. Issues for further quantitative and qualitative inquiry. Med Care. 2006, 44: S205-S210. 10.1097/01.mlr.0000245451.67862.57.CrossRefPubMed McHorney CA, Fleishman JA: Assessing and understanding measurement equivalence in health outcome measures. Issues for further quantitative and qualitative inquiry. Med Care. 2006, 44: S205-S210. 10.1097/01.mlr.0000245451.67862.57.CrossRefPubMed
8.
go back to reference Teresi JA, Golden RR, Cross P, Gurland B, Kleinman M, Wilder D: Item bias in cognitive screening measures: comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups. J Clin Epidemiol. 1995, 48: 473-483. 10.1016/0895-4356(94)00159-N.CrossRefPubMed Teresi JA, Golden RR, Cross P, Gurland B, Kleinman M, Wilder D: Item bias in cognitive screening measures: comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups. J Clin Epidemiol. 1995, 48: 473-483. 10.1016/0895-4356(94)00159-N.CrossRefPubMed
9.
go back to reference Nijsten T, Meads DM, de Korte J, Sampogna F, Gelfand JM, Ongenae K: Cross-cultural inequivalence of dermatology-specific health-related quality of life instruments in psoriasis patients. J Invest Dermatol. 2007, 127: 2315-2322. 10.1038/sj.jid.5700875.CrossRefPubMed Nijsten T, Meads DM, de Korte J, Sampogna F, Gelfand JM, Ongenae K: Cross-cultural inequivalence of dermatology-specific health-related quality of life instruments in psoriasis patients. J Invest Dermatol. 2007, 127: 2315-2322. 10.1038/sj.jid.5700875.CrossRefPubMed
10.
go back to reference McKenna SP, Doward LC, Meads DM, Tennant A, Lawton G, Grueger J: Quality of life in infants and children with atopic dermatitis: addressing issues of differential item functioning across countries in multinational clinical trials. Health Qual Life Outcomes. 2007, 5: 45-10.1186/1477-7525-5-45.CrossRefPubMedPubMedCentral McKenna SP, Doward LC, Meads DM, Tennant A, Lawton G, Grueger J: Quality of life in infants and children with atopic dermatitis: addressing issues of differential item functioning across countries in multinational clinical trials. Health Qual Life Outcomes. 2007, 5: 45-10.1186/1477-7525-5-45.CrossRefPubMedPubMedCentral
11.
go back to reference Osborne RH, Elsworth GR, Sprangers MA, Oort FJ, Hopper JL: The value of the Hospital Anxiety and Depression Scale (HADS) for comparing women with early onset breast cancer with population-based reference women. Qual Life Res. 2004, 13: 191-206.CrossRefPubMed Osborne RH, Elsworth GR, Sprangers MA, Oort FJ, Hopper JL: The value of the Hospital Anxiety and Depression Scale (HADS) for comparing women with early onset breast cancer with population-based reference women. Qual Life Res. 2004, 13: 191-206.CrossRefPubMed
12.
go back to reference Dallmeijer AJ, de Groot V, Roorda LD, Schepers VP, Lindeman E, Van den Berg LH: Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: a study using Rasch analysis. J Rehabil Med. 2007, 39: 163-169. 10.2340/16501977-0024.CrossRefPubMed Dallmeijer AJ, de Groot V, Roorda LD, Schepers VP, Lindeman E, Van den Berg LH: Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: a study using Rasch analysis. J Rehabil Med. 2007, 39: 163-169. 10.2340/16501977-0024.CrossRefPubMed
13.
go back to reference Taylor WJ, McPherson KM: Using Rasch analysis to compare the psychometric properties of the short form 36 physical function score and the health assessment questionnaire disability index in patients with psoriatic arthritis and rheumatoid arthritis. Arthritis Rheum. 2007, 57: 723-729. 10.1002/art.22770.CrossRefPubMed Taylor WJ, McPherson KM: Using Rasch analysis to compare the psychometric properties of the short form 36 physical function score and the health assessment questionnaire disability index in patients with psoriatic arthritis and rheumatoid arthritis. Arthritis Rheum. 2007, 57: 723-729. 10.1002/art.22770.CrossRefPubMed
14.
go back to reference Roorda LD, Jones CA, Waltz M, Lankhorst GJ, Bouter LM, van der Eijken JW: Satisfactory cross cultural equivalence of the Dutch WOMAC in patients with hip osteoarthritis waiting for arthroplasty. Ann Rheum Dis. 2004, 63: 36-42. 10.1136/ard.2002.001784.CrossRefPubMedPubMedCentral Roorda LD, Jones CA, Waltz M, Lankhorst GJ, Bouter LM, van der Eijken JW: Satisfactory cross cultural equivalence of the Dutch WOMAC in patients with hip osteoarthritis waiting for arthroplasty. Ann Rheum Dis. 2004, 63: 36-42. 10.1136/ard.2002.001784.CrossRefPubMedPubMedCentral
15.
go back to reference Davis AM, Badley EM, Beaton DE, Kopec J, Wright JG, Young NL: Rasch analysis of the Western Ontario McMaster (WOMAC) Osteoarthritis Index: results from community and arthroplasty samples. J Clin Epidemiol. 2003, 56: 1076-1083. 10.1016/S0895-4356(03)00179-3.CrossRefPubMed Davis AM, Badley EM, Beaton DE, Kopec J, Wright JG, Young NL: Rasch analysis of the Western Ontario McMaster (WOMAC) Osteoarthritis Index: results from community and arthroplasty samples. J Clin Epidemiol. 2003, 56: 1076-1083. 10.1016/S0895-4356(03)00179-3.CrossRefPubMed
16.
go back to reference Rothenfluh DA, Reedwisch D, Muller U, Ganz R, Tennant A, Leunig M: Construct validity of a 12-item WOMAC for assessment of femoro-acetabular impingement and osteoarthritis of the hip. Osteoarthritis Cartilage. 2008, 16: 1032-1038. 10.1016/j.joca.2008.02.006.CrossRefPubMed Rothenfluh DA, Reedwisch D, Muller U, Ganz R, Tennant A, Leunig M: Construct validity of a 12-item WOMAC for assessment of femoro-acetabular impingement and osteoarthritis of the hip. Osteoarthritis Cartilage. 2008, 16: 1032-1038. 10.1016/j.joca.2008.02.006.CrossRefPubMed
17.
go back to reference Kersten P, White PJ, Tennant A: The visual analogue WOMAC 3.0 scale–internal validity and responsiveness of the VAS version. BMC Musculoskelet Disord. 2010, 11: 80-10.1186/1471-2474-11-80.CrossRefPubMedPubMedCentral Kersten P, White PJ, Tennant A: The visual analogue WOMAC 3.0 scale–internal validity and responsiveness of the VAS version. BMC Musculoskelet Disord. 2010, 11: 80-10.1186/1471-2474-11-80.CrossRefPubMedPubMedCentral
18.
go back to reference Eachus J, Williams M, Chan P, Smith GD, Grainge M, Donovan J: Deprivation and cause specific morbidity: evidence from the Somerset and Avon survey of health. BMJ. 1996, 312: 287-292. 10.1136/bmj.312.7026.287.CrossRefPubMedPubMedCentral Eachus J, Williams M, Chan P, Smith GD, Grainge M, Donovan J: Deprivation and cause specific morbidity: evidence from the Somerset and Avon survey of health. BMJ. 1996, 312: 287-292. 10.1136/bmj.312.7026.287.CrossRefPubMedPubMedCentral
19.
go back to reference Juni P, Dieppe P, Donovan J, Peters T, Eachus J, Pearson N: Population requirement for primary knee replacement surgery: a cross-sectional study. Rheumatology (Oxford). 2003, 42: 516-521. 10.1093/rheumatology/keg196.CrossRef Juni P, Dieppe P, Donovan J, Peters T, Eachus J, Pearson N: Population requirement for primary knee replacement surgery: a cross-sectional study. Rheumatology (Oxford). 2003, 42: 516-521. 10.1093/rheumatology/keg196.CrossRef
22.
go back to reference Anderson RO: The theoretical development and empirical evaluation of a logistic regression, paired-comparisons procedure for assessing unidimensionality in the Rasch model. 1994, Minnesota: University of Minnesota, PhD Anderson RO: The theoretical development and empirical evaluation of a logistic regression, paired-comparisons procedure for assessing unidimensionality in the Rasch model. 1994, Minnesota: University of Minnesota, PhD
23.
go back to reference Cooke DJ, Michie C, Hart SD, Hare RD: Evaluating the screening version of the hare psychopathy checklist - Revised (PCL: SV): an item response theory analysis. Psychol Assess. 1999, 11: 3-13.CrossRef Cooke DJ, Michie C, Hart SD, Hare RD: Evaluating the screening version of the hare psychopathy checklist - Revised (PCL: SV): an item response theory analysis. Psychol Assess. 1999, 11: 3-13.CrossRef
24.
25.
go back to reference Zumbo BD: A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-type (Ordinal) Item Scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense Zumbo BD: A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-type (Ordinal) Item Scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense
26.
go back to reference Swaminathan H, Rogers HJ: Detecting differential item functioning using logistic regression procedures. J Educ Meas. 1990, 26: 361-370.CrossRef Swaminathan H, Rogers HJ: Detecting differential item functioning using logistic regression procedures. J Educ Meas. 1990, 26: 361-370.CrossRef
27.
go back to reference Zumbo BD: Psychometric Methods for Investigating Item and Scale/Test Level Invariance: DIF and Scale level Techniques. 2008, Liverpool, England: 6th International Test Commission Conference Zumbo BD: Psychometric Methods for Investigating Item and Scale/Test Level Invariance: DIF and Scale level Techniques. 2008, Liverpool, England: 6th International Test Commission Conference
28.
go back to reference Crane PK, Gibbons LE, Ocepek-Welikson K, Cook K, Cella D, Narasimhalu K: A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Qual Life Res. 2007, 16 (Suppl 1): 69-84.CrossRefPubMed Crane PK, Gibbons LE, Ocepek-Welikson K, Cook K, Cella D, Narasimhalu K: A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Qual Life Res. 2007, 16 (Suppl 1): 69-84.CrossRefPubMed
29.
go back to reference Crane PK, Gibbons LE, Jolley L, van Belle G: Differential item functioning analysis with ordinal logistic regression techniques. DIFdetect and difwithpar. Med Care. 2006, 44: S115-S123. 10.1097/01.mlr.0000245183.28384.ed.CrossRefPubMed Crane PK, Gibbons LE, Jolley L, van Belle G: Differential item functioning analysis with ordinal logistic regression techniques. DIFdetect and difwithpar. Med Care. 2006, 44: S115-S123. 10.1097/01.mlr.0000245183.28384.ed.CrossRefPubMed
30.
go back to reference Perkins AJ, Stump TE, Monahan PO, McHorney CA: Assessment of differential item functioning for demographic comparisons in the MOS SF-36 health survey. Qual Life Res. 2006, 15: 331-348. 10.1007/s11136-005-1551-6.CrossRefPubMed Perkins AJ, Stump TE, Monahan PO, McHorney CA: Assessment of differential item functioning for demographic comparisons in the MOS SF-36 health survey. Qual Life Res. 2006, 15: 331-348. 10.1007/s11136-005-1551-6.CrossRefPubMed
31.
go back to reference Lewis C: A note on the value of including the studied item in the test score when analyzing test items for DIF. Differential Item Functioning. Edited by: Holland P, Wainer H. 1993, Hillsdale, NJ: Lawrence Erlbaum Associates, 317-319. Lewis C: A note on the value of including the studied item in the test score when analyzing test items for DIF. Differential Item Functioning. Edited by: Holland P, Wainer H. 1993, Hillsdale, NJ: Lawrence Erlbaum Associates, 317-319.
32.
go back to reference Wolfe F, Hawley DJ, Goldenberg DL, Russell IJ, Buskila D, Neumann L: The assessment of functional impairment in fibromyalgia (FM): Rasch analyses of 5 functional scales and the development of the FM Health Assessment Questionnaire. J Rheumatol. 2000, 27: 1989-1999.PubMed Wolfe F, Hawley DJ, Goldenberg DL, Russell IJ, Buskila D, Neumann L: The assessment of functional impairment in fibromyalgia (FM): Rasch analyses of 5 functional scales and the development of the FM Health Assessment Questionnaire. J Rheumatol. 2000, 27: 1989-1999.PubMed
33.
go back to reference Hambleton RK: Good practices for identifying differential item functioning. Med Care. 2006, 44: S182-S188. 10.1097/01.mlr.0000245443.86671.c4.CrossRefPubMed Hambleton RK: Good practices for identifying differential item functioning. Med Care. 2006, 44: S182-S188. 10.1097/01.mlr.0000245443.86671.c4.CrossRefPubMed
34.
go back to reference Scott NW, Fayers PM, Aaronson NK, Bottomley A, de Graeff A, Groenvold M: Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010, 8: 81-PubMedPubMedCentral Scott NW, Fayers PM, Aaronson NK, Bottomley A, de Graeff A, Groenvold M: Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010, 8: 81-PubMedPubMedCentral
35.
go back to reference Teresi JA: Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Med Care. 2006, 44: S152-S170. 10.1097/01.mlr.0000245142.74628.ab.CrossRefPubMed Teresi JA: Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Med Care. 2006, 44: S152-S170. 10.1097/01.mlr.0000245142.74628.ab.CrossRefPubMed
Metadata
Title
Exploring differential item functioning in the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC)
Authors
Beth Pollard
Marie Johnston
Diane Dixon
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2012
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-13-265

Other articles of this Issue 1/2012

BMC Musculoskeletal Disorders 1/2012 Go to the issue