Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2013

Open Access 01-12-2013 | Research article

Exploring differential item functioning in the SF-36 by demographic, clinical, psychological and social factors in an osteoarthritis population

Authors: Beth Pollard, Marie Johnston, Diane Dixon

Published in: BMC Musculoskeletal Disorders | Issue 1/2013

Login to get access

Abstract

Background

The SF-36 is a very commonly used generic measure of health outcome in osteoarthritis (OA). An important, but frequently overlooked, aspect of validating health outcome measures is to establish if items work in the same way across subgroup of a population. That is, if respondents have the same ‘true’ level of outcome, does the item give the same score in different subgroups or is it biased towards one subgroup or another. Differential item functioning (DIF) can identify items that may be biased for one group or another and has been applied to measuring patient reported outcomes. Items may show DIF for different conditions and between cultures, however the SF-36 has not been specifically examined in an osteoarthritis population nor in a UK population. Hence, the aim of the study was to apply the DIF method to the SF-36 for a UK OA population.

Methods

The sample comprised a community sample of 763 people with OA who participated in the Somerset and Avon Survey of Health. The SF-36 was explored for DIF with respect to demographic, social, clinical and psychological factors. Well developed ordinal regression models were used to identify DIF items.

Results

DIF items were found by age (6 items), employment status (6 items), social class (2 items), mood (2 items), hip v knee (2 items), social deprivation (1 item) and body mass index (1 item). Although the impact of the DIF items rarely had a significant effect on the conclusions of group comparisons, in most cases there was a significant change in effect size.

Conclusions

Overall, the SF-36 performed well with only a small number of DIF items identified, a reassuring finding in view of the frequent use of the SF-36 in OA. Nevertheless, where DIF items were identified it would be advisable to analyse data taking account of DIF items, especially when age effects are the focus of interest.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bombardier C, Melfi CA, Paul J, Green R, Hawker G, Wright J: Comparison of a generic and a disease-specific measure of pain and physical function after knee replacement surgery. Med Care. 1995, 33: AS131-AS144.PubMed Bombardier C, Melfi CA, Paul J, Green R, Hawker G, Wright J: Comparison of a generic and a disease-specific measure of pain and physical function after knee replacement surgery. Med Care. 1995, 33: AS131-AS144.PubMed
2.
go back to reference Covic T, Pallant JF, Conaghan PG, Tennant A: A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D) in a rheumatoid arthritis population using Rasch analysis38. Health Qual Life Outcomes. 2007, 5: 41-10.1186/1477-7525-5-41.CrossRefPubMedPubMedCentral Covic T, Pallant JF, Conaghan PG, Tennant A: A longitudinal evaluation of the Center for Epidemiologic Studies-Depression scale (CES-D) in a rheumatoid arthritis population using Rasch analysis38. Health Qual Life Outcomes. 2007, 5: 41-10.1186/1477-7525-5-41.CrossRefPubMedPubMedCentral
3.
go back to reference Zumbo BD, Koh KH: Manifestation of differences in item-level characteristics in scale-level measurement invariance tests of multi group confirmatory factor analysis. J Modern Appl Statistical Methods. 2005, 4: 275-282. Zumbo BD, Koh KH: Manifestation of differences in item-level characteristics in scale-level measurement invariance tests of multi group confirmatory factor analysis. J Modern Appl Statistical Methods. 2005, 4: 275-282.
4.
go back to reference Teresi JA, Fleishman JA: Differential item functioning and health assessment. Qual Life Res. 2007, 16 (Suppl 1): 33-42.CrossRefPubMed Teresi JA, Fleishman JA: Differential item functioning and health assessment. Qual Life Res. 2007, 16 (Suppl 1): 33-42.CrossRefPubMed
5.
go back to reference McHorney CA, Fleishman JA: Assessing and understanding measurement equivalence in health outcome measures. Issues for further quantitative and qualitative inquiry. Med Care. 2006, 44: S205-S210. 10.1097/01.mlr.0000245451.67862.57.CrossRefPubMed McHorney CA, Fleishman JA: Assessing and understanding measurement equivalence in health outcome measures. Issues for further quantitative and qualitative inquiry. Med Care. 2006, 44: S205-S210. 10.1097/01.mlr.0000245451.67862.57.CrossRefPubMed
6.
go back to reference Teresi JA, Golden RR, Cross P, Gurland B, Kleinman M, Wilder D: Item bias in cognitive screening measures: comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups. J Clin Epidemiol. 1995, 48: 473-483. 10.1016/0895-4356(94)00159-N.CrossRefPubMed Teresi JA, Golden RR, Cross P, Gurland B, Kleinman M, Wilder D: Item bias in cognitive screening measures: comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups. J Clin Epidemiol. 1995, 48: 473-483. 10.1016/0895-4356(94)00159-N.CrossRefPubMed
7.
go back to reference Dallmeijer AJ, de GV, Roorda LD, Schepers VP, Lindeman E, van den Berg LH: Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: a study using Rasch analysis. J Rehabil Med. 2007, 39: 163-169. 10.2340/16501977-0024.CrossRefPubMed Dallmeijer AJ, de GV, Roorda LD, Schepers VP, Lindeman E, van den Berg LH: Cross-diagnostic validity of the SF-36 physical functioning scale in patients with stroke, multiple sclerosis and amyotrophic lateral sclerosis: a study using Rasch analysis. J Rehabil Med. 2007, 39: 163-169. 10.2340/16501977-0024.CrossRefPubMed
8.
go back to reference Taylor WJ, McPherson KM: Using Rasch analysis to compare the psychometric properties of the Short Form 36 physical function score and the Health Assessment Questionnaire disability index in patients with psoriatic arthritis and rheumatoid arthritis1. Arthritis Rheum. 2007, 57: 723-729. 10.1002/art.22770.CrossRefPubMed Taylor WJ, McPherson KM: Using Rasch analysis to compare the psychometric properties of the Short Form 36 physical function score and the Health Assessment Questionnaire disability index in patients with psoriatic arthritis and rheumatoid arthritis1. Arthritis Rheum. 2007, 57: 723-729. 10.1002/art.22770.CrossRefPubMed
9.
go back to reference Bjorner JB, Kreiner S, Ware JE, Damsgaard MT, Bech P: Differential item functioning in the Danish translation of the SF-3648. J Clin Epidemiol. 1998, 51: 1189-1202. 10.1016/S0895-4356(98)00111-5.CrossRefPubMed Bjorner JB, Kreiner S, Ware JE, Damsgaard MT, Bech P: Differential item functioning in the Danish translation of the SF-3648. J Clin Epidemiol. 1998, 51: 1189-1202. 10.1016/S0895-4356(98)00111-5.CrossRefPubMed
10.
go back to reference Perkins AJ, Stump TE, Monahan PO, McHorney CA: Assessment of differential item functioning for demographic comparisons in the MOS SF-36 health survey. Qual Life Res. 2006, 15: 331-348. 10.1007/s11136-005-1551-6.CrossRefPubMed Perkins AJ, Stump TE, Monahan PO, McHorney CA: Assessment of differential item functioning for demographic comparisons in the MOS SF-36 health survey. Qual Life Res. 2006, 15: 331-348. 10.1007/s11136-005-1551-6.CrossRefPubMed
11.
go back to reference Bjorner JB, Kristensen TS: Multi-item scales for measuring global self-rated health: investigation of construct validity using structural equation models. Res Aging. 1999, 21: 417-439. 10.1177/0164027599213004.CrossRef Bjorner JB, Kristensen TS: Multi-item scales for measuring global self-rated health: investigation of construct validity using structural equation models. Res Aging. 1999, 21: 417-439. 10.1177/0164027599213004.CrossRef
12.
go back to reference Wolfe F, Hawley DJ, Goldenberg DL, Russell IJ, Buskila D, Neumann L: The assessment of functional impairment in fibromyalgia (FM): Rasch analyses of 5 functional scales and the development of the FM Health Assessment Questionnaire. J Rheumatol. 2000, 27: 1989-1999.PubMed Wolfe F, Hawley DJ, Goldenberg DL, Russell IJ, Buskila D, Neumann L: The assessment of functional impairment in fibromyalgia (FM): Rasch analyses of 5 functional scales and the development of the FM Health Assessment Questionnaire. J Rheumatol. 2000, 27: 1989-1999.PubMed
13.
go back to reference Eachus J, Williams M, Chan P, Smith GD, Grainge M, Donovan J: Deprivation and cause specific morbidity: evidence from the Somerset and Avon survey of health. BMJ. 1996, 312: 287-292. 10.1136/bmj.312.7026.287.CrossRefPubMedPubMedCentral Eachus J, Williams M, Chan P, Smith GD, Grainge M, Donovan J: Deprivation and cause specific morbidity: evidence from the Somerset and Avon survey of health. BMJ. 1996, 312: 287-292. 10.1136/bmj.312.7026.287.CrossRefPubMedPubMedCentral
14.
go back to reference Juni P, Dieppe P, Donovan J, Peters T, Eachus J, Pearson N: Population requirement for primary knee replacement surgery: a cross-sectional study. Rheumatology (Oxford). 2003, 42: 516-521. 10.1093/rheumatology/keg196.CrossRef Juni P, Dieppe P, Donovan J, Peters T, Eachus J, Pearson N: Population requirement for primary knee replacement surgery: a cross-sectional study. Rheumatology (Oxford). 2003, 42: 516-521. 10.1093/rheumatology/keg196.CrossRef
16.
go back to reference Ware JE, Snow KK, Kosinski MK, Gandek BG: SF-36 Health Survey: Manual and interpretation guide. 1993, Boston: The Health Institute, New England Medical Center Ware JE, Snow KK, Kosinski MK, Gandek BG: SF-36 Health Survey: Manual and interpretation guide. 1993, Boston: The Health Institute, New England Medical Center
17.
go back to reference Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC - A health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug-therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15: 1833-1840.PubMed Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC - A health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug-therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15: 1833-1840.PubMed
18.
go back to reference OPCS: Standard Occupational Classification. 1991, London: HMSO, 3: OPCS: Standard Occupational Classification. 1991, London: HMSO, 3:
19.
go back to reference Williams A: Euroqol - a new facility for the measurement of health-related quality-of-life. Health Policy. 1990, 16: 199-208.CrossRef Williams A: Euroqol - a new facility for the measurement of health-related quality-of-life. Health Policy. 1990, 16: 199-208.CrossRef
21.
go back to reference Cooke DJ, Michie C, Hart SD, Hare RD: Evaluating the screening version of the hare psychopathy checklist - Revised (PCL : SV): an item response theory analysis. Psychol Assess. 1999, 11: 3-13.CrossRef Cooke DJ, Michie C, Hart SD, Hare RD: Evaluating the screening version of the hare psychopathy checklist - Revised (PCL : SV): an item response theory analysis. Psychol Assess. 1999, 11: 3-13.CrossRef
22.
go back to reference Reckase M: Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Stat. 1979, 4: 207-230.CrossRef Reckase M: Unifactor latent trait models applied to multifactor tests: results and implications. J Educ Stat. 1979, 4: 207-230.CrossRef
23.
go back to reference Anderson RO: The theoretical development and empirical evaluation of a logistic regression, paired-comparisons procedure for assessing unidimensionality in the Rasch model. 1994, Minnesota: University of Minnesota, PhD Anderson RO: The theoretical development and empirical evaluation of a logistic regression, paired-comparisons procedure for assessing unidimensionality in the Rasch model. 1994, Minnesota: University of Minnesota, PhD
24.
go back to reference Velicer WF: Determining the number of components from the matrix of partial correlations. Psychometrika. 1976, 41: 321-327. 10.1007/BF02293557.CrossRef Velicer WF: Determining the number of components from the matrix of partial correlations. Psychometrika. 1976, 41: 321-327. 10.1007/BF02293557.CrossRef
25.
go back to reference Pollard B, Johnston M, Dixon D: Exploring differential item functioning in the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). BMC Musculoskelet Disord. 2012, 13: 265-10.1186/1471-2474-13-265.CrossRefPubMedPubMedCentral Pollard B, Johnston M, Dixon D: Exploring differential item functioning in the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). BMC Musculoskelet Disord. 2012, 13: 265-10.1186/1471-2474-13-265.CrossRefPubMedPubMedCentral
26.
go back to reference Zumbo BD: A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-type (Ordinal) Item Scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense, Ref Type: Report Zumbo BD: A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-type (Ordinal) Item Scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense, Ref Type: Report
27.
go back to reference Swaminathan H, Rogers HJ: Detecting differential item functioning using logistic regression procedures. J Educ Meas. 1990, 26: 361-370.CrossRef Swaminathan H, Rogers HJ: Detecting differential item functioning using logistic regression procedures. J Educ Meas. 1990, 26: 361-370.CrossRef
28.
go back to reference Crane PK, Gibbons LE, Jolley L, van BG: Differential item functioning analysis with ordinal logistic regression techniques. DIFdetect and difwithpar. Med Care. 2006, 44: S115-S123. 10.1097/01.mlr.0000245183.28384.ed.CrossRefPubMed Crane PK, Gibbons LE, Jolley L, van BG: Differential item functioning analysis with ordinal logistic regression techniques. DIFdetect and difwithpar. Med Care. 2006, 44: S115-S123. 10.1097/01.mlr.0000245183.28384.ed.CrossRefPubMed
29.
go back to reference Lewis C: A note on the value of including the studied item in the test score when analyzing test items for DIF. Differential Item Functioning. Edited by: Holland P, Wainer H. 1993, Hillsdale, NJ: Lawrence Erlbaum Associates, 317-319. Lewis C: A note on the value of including the studied item in the test score when analyzing test items for DIF. Differential Item Functioning. Edited by: Holland P, Wainer H. 1993, Hillsdale, NJ: Lawrence Erlbaum Associates, 317-319.
30.
go back to reference McKenna SP, Doward LC, Meads DM, Tennant A, Lawton G, Grueger J: Quality of life in infants and children with atopic dermatitis: addressing issues of differential item functioning across countries in multinational clinical trials. Health Qual Life Outcomes. 2007, 5: 45-10.1186/1477-7525-5-45.CrossRefPubMedPubMedCentral McKenna SP, Doward LC, Meads DM, Tennant A, Lawton G, Grueger J: Quality of life in infants and children with atopic dermatitis: addressing issues of differential item functioning across countries in multinational clinical trials. Health Qual Life Outcomes. 2007, 5: 45-10.1186/1477-7525-5-45.CrossRefPubMedPubMedCentral
31.
go back to reference Baltes PB, Baltes MM: Successful aging. Perspectives from the behavioral sciences. 1990, New York: Cambridge University PressCrossRef Baltes PB, Baltes MM: Successful aging. Perspectives from the behavioral sciences. 1990, New York: Cambridge University PressCrossRef
32.
go back to reference Teresi JA: Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Med Care. 2006, 44: S152-S170. 10.1097/01.mlr.0000245142.74628.ab.CrossRefPubMed Teresi JA: Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Med Care. 2006, 44: S152-S170. 10.1097/01.mlr.0000245142.74628.ab.CrossRefPubMed
33.
go back to reference Scott NW, Fayers PM, Aaronson NK, Bottomley A, de GA, Groenvold M: Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010, 8: 81-PubMedPubMedCentral Scott NW, Fayers PM, Aaronson NK, Bottomley A, de GA, Groenvold M: Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010, 8: 81-PubMedPubMedCentral
Metadata
Title
Exploring differential item functioning in the SF-36 by demographic, clinical, psychological and social factors in an osteoarthritis population
Authors
Beth Pollard
Marie Johnston
Diane Dixon
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2013
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-14-346

Other articles of this Issue 1/2013

BMC Musculoskeletal Disorders 1/2013 Go to the issue