Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2014

Open Access 01-12-2014 | Research

Violations of local stochastic independence exaggerate scalability in Mokken scaling analysis of the Chinese Mandarin SF-36

Authors: Roger Watson, Wenru Wang, David R Thompson

Published in: Health and Quality of Life Outcomes | Issue 1/2014

Login to get access

Abstract

Background

Previous work using Mokken scaling analysis with the SF-36 has found subscales appearing to show excellent Mokken scaling properties. However, the values of scalability of the subscales are very large, raising the possibility that these are artificially high and this may result from violations of local stochastic independence between items.

Objectives

To analyse selected items from the Chinese Mandarin form of the SF-36 scale using Mokken scaling and to investigate if violations of local stochastic independence exaggerate scalability.

Methods

Exploratory Mokken scaling analysis was run using the online public domain software R by entering 19 items from the Chinese Mandarin form of the SF-36 items into the analysis. The items in the resulting scales, judged by the size of Loevinger’s coefficient, were analysed for violations of monotony, 95% confidence intervals and invariant item ordering, including inspection of item pair plots.

Results

Two Mokken scales were obtained, one including items from the Physical Functioning subscale, and one including items from the Mental Health subscale of the Chinese Mandarin form of the SF-36. The Physical Functioning scale was very strong according to Loevinger’s coefficient with high invariant item ordering; the Mental Health scale was moderately strong with weak invariant item ordering.

Conclusion

The strength of the Physical Functioning Mokken scale derived from the Chinese Mandarin form of the SF-36 is probably the result of an item chain and item overlap which violate local stochastic independence. This is due to the nature of the items in the Physical Functioning subscale, all of which relate to physical ability and some of which can only be achieved if previous items in the subscale have been achieved.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mokken R, Lewis JC: A nonparametric approach to the analysis of dichotomous item responses. Appl Psychol Meas 1982, 6: 417–430. 10.1177/014662168200600404CrossRef Mokken R, Lewis JC: A nonparametric approach to the analysis of dichotomous item responses. Appl Psychol Meas 1982, 6: 417–430. 10.1177/014662168200600404CrossRef
2.
go back to reference Nader IW, Tran US, Baranyai P, Voracek M: Investigating dimensionality of Eskin’s Attitudes Towards Suicide Scale with Mokken scaling and confirmatory factor analysis. Arch Suicide Res 2012, 16: 226–237. 10.1080/13811118.2012.695271CrossRefPubMed Nader IW, Tran US, Baranyai P, Voracek M: Investigating dimensionality of Eskin’s Attitudes Towards Suicide Scale with Mokken scaling and confirmatory factor analysis. Arch Suicide Res 2012, 16: 226–237. 10.1080/13811118.2012.695271CrossRefPubMed
3.
go back to reference Sijtsma K, Molenaar IW: Introduction to nonparametric item response theory. Sage, London; 2002. Sijtsma K, Molenaar IW: Introduction to nonparametric item response theory. Sage, London; 2002.
4.
go back to reference De Ayala RJ: The theory and practice of item response theory. The Guildford Press, New York; 2009. De Ayala RJ: The theory and practice of item response theory. The Guildford Press, New York; 2009.
5.
go back to reference Balazs K, de Boeck P: (undated) Detecting local item dependence stemming from minor dimensions. IAP Statistics Network, http://sites.uclouvain.be/IAP-Stat-Phase-V-VI/PhaseV/publications_2006/TR/TR0684.pdf. Balazs K, de Boeck P: (undated) Detecting local item dependence stemming from minor dimensions. IAP Statistics Network, http://​sites.​uclouvain.​be/​IAP-Stat-Phase-V-VI/​PhaseV/​publications_​2006/​TR/​TR0684.​pdf.​
6.
go back to reference Kline P: An easy guide to factor analysis. Routledge, London; 1994. Kline P: An easy guide to factor analysis. Routledge, London; 1994.
7.
go back to reference Straat JH: Using scalability coefficients and conditional association to assess monotone homogeneity. Ridderprint BV, Ridderkerk; 2012. Straat JH: Using scalability coefficients and conditional association to assess monotone homogeneity. Ridderprint BV, Ridderkerk; 2012.
8.
go back to reference Watson R, van der Ark LA, Lin L-C, Fieo R, Deary IJ, Meijer RR: Item response theory: how Mokken scaling can be used in clinical practice. J Clin Nurs 2011, 21: 2736–2746. 10.1111/j.1365-2702.2011.03893.xCrossRefPubMed Watson R, van der Ark LA, Lin L-C, Fieo R, Deary IJ, Meijer RR: Item response theory: how Mokken scaling can be used in clinical practice. J Clin Nurs 2011, 21: 2736–2746. 10.1111/j.1365-2702.2011.03893.xCrossRefPubMed
9.
go back to reference Niemöller K, van Schuur W: Stochastic models for unidimensional scaling: Mokken and Rasch. In Data analysis and the social sciences. Edited by: McKay D, Schofield N, Whitely P. Frances Pinter, London; 1983:120–170. Niemöller K, van Schuur W: Stochastic models for unidimensional scaling: Mokken and Rasch. In Data analysis and the social sciences. Edited by: McKay D, Schofield N, Whitely P. Frances Pinter, London; 1983:120–170.
10.
go back to reference Kuijpers RE, van der Ark LA, Croon MA: Standard errors and confidence intervals for scalability coefficients in Mokken scale analysis using marginal models. Sociol Methodol 2013, 43: 42–69. 10.1177/0081175013481958CrossRef Kuijpers RE, van der Ark LA, Croon MA: Standard errors and confidence intervals for scalability coefficients in Mokken scale analysis using marginal models. Sociol Methodol 2013, 43: 42–69. 10.1177/0081175013481958CrossRef
11.
go back to reference Egberink IJL, Meijer RR: An item response theory analysis of Harter’s Self-Perception Profile for children or why strong scales should be distrusted. Assessment 2011, 18: 201–212. 10.1177/1073191110367778CrossRefPubMed Egberink IJL, Meijer RR: An item response theory analysis of Harter’s Self-Perception Profile for children or why strong scales should be distrusted. Assessment 2011, 18: 201–212. 10.1177/1073191110367778CrossRefPubMed
12.
go back to reference Bedford A, Watson R, Lyne J, Tibbles J, Davies F, Deary IJ: Mokken scaling and principal components analysis of the CORE-OM in a large clinical sample. Clin Psychol Psychother 2010, 17: 51–56.PubMed Bedford A, Watson R, Lyne J, Tibbles J, Davies F, Deary IJ: Mokken scaling and principal components analysis of the CORE-OM in a large clinical sample. Clin Psychol Psychother 2010, 17: 51–56.PubMed
13.
go back to reference Ligtvoet R, van der Ark LA, Marvelde JM, Sijtsma K: Investigating an Invariant Item Ordering for Polytomously Scored Items. Educ Psychol Meas 2010, 70: 578–595. 10.1177/0013164409355697CrossRef Ligtvoet R, van der Ark LA, Marvelde JM, Sijtsma K: Investigating an Invariant Item Ordering for Polytomously Scored Items. Educ Psychol Meas 2010, 70: 578–595. 10.1177/0013164409355697CrossRef
14.
go back to reference Sijtsma K, Molenaar IW: Reliability of test scores on nonparametric item response theory. Psychometrika 1987, 52: 79–97. 10.1007/BF02293957CrossRef Sijtsma K, Molenaar IW: Reliability of test scores on nonparametric item response theory. Psychometrika 1987, 52: 79–97. 10.1007/BF02293957CrossRef
15.
go back to reference Ware JE, Kosinske M, Gandek B: SF-36 Health Survey: Manual and interpretation guide. QualityMetric Incorporated, Lincoln, RI; 2003. Ware JE, Kosinske M, Gandek B: SF-36 Health Survey: Manual and interpretation guide. QualityMetric Incorporated, Lincoln, RI; 2003.
16.
go back to reference Liu CJ, Li LX, Ren XH, Li J, Zhang J, Shun D: Feasibility of using Short Form 36 in Chinese population. Acad J West China Univ Med Sci 2001, 32: 39–42. Liu CJ, Li LX, Ren XH, Li J, Zhang J, Shun D: Feasibility of using Short Form 36 in Chinese population. Acad J West China Univ Med Sci 2001, 32: 39–42.
17.
go back to reference Wang W, Lopez V, Chair SY, Thompson DR: The psychometric properties of the Chinese version of the SF-36 health survey in patients with myocardial infarction in mainland China. Qual Life Res 2006, 15: 1525–1531. 10.1007/s11136-006-0012-1CrossRefPubMed Wang W, Lopez V, Chair SY, Thompson DR: The psychometric properties of the Chinese version of the SF-36 health survey in patients with myocardial infarction in mainland China. Qual Life Res 2006, 15: 1525–1531. 10.1007/s11136-006-0012-1CrossRefPubMed
18.
go back to reference Wang W, Lau Y, Chow A, Thompson D, He H-G: Health-related quality of life and social support among Chinese patients with coronary heart disease in mainland China. Eur J Cardiovasc Nurs 2014, 13: 48–54. 10.1177/1474515113476995CrossRefPubMed Wang W, Lau Y, Chow A, Thompson D, He H-G: Health-related quality of life and social support among Chinese patients with coronary heart disease in mainland China. Eur J Cardiovasc Nurs 2014, 13: 48–54. 10.1177/1474515113476995CrossRefPubMed
19.
go back to reference Wang W, Thompson DR, Ski DF, Liu M: Health-related quality of life and its associated factors in Chinese patients with myocardial infarction. Eur J Prev Cardiol 2014, 21: 318–326. 10.1177/2047487312454757CrossRef Wang W, Thompson DR, Ski DF, Liu M: Health-related quality of life and its associated factors in Chinese patients with myocardial infarction. Eur J Prev Cardiol 2014, 21: 318–326. 10.1177/2047487312454757CrossRef
20.
go back to reference Van der Heijden PMG, van Buuren S, Fekkes M, Radder J, Verrips E: Unidimensionality and reliability under Mokken scaling of the Dutch language version of the SF-36. Qual Life Res 2003, 12: 189–198. 10.1023/A:1022269315437CrossRefPubMed Van der Heijden PMG, van Buuren S, Fekkes M, Radder J, Verrips E: Unidimensionality and reliability under Mokken scaling of the Dutch language version of the SF-36. Qual Life Res 2003, 12: 189–198. 10.1023/A:1022269315437CrossRefPubMed
21.
go back to reference Mishra GD, Gale CR, Sayre AA, Cooper C, Dennison EM, Whalley LJ, Craig L, Kuh D, Deary IJ: The HALCyon Study Team: how useful are the SF-36 sub-scales in older people? Mokken scaling of data from the HALCyon programme. Qual Life Res 2011, 20: 1005–1010. 10.1007/s11136-010-9838-7PubMedCentralCrossRefPubMed Mishra GD, Gale CR, Sayre AA, Cooper C, Dennison EM, Whalley LJ, Craig L, Kuh D, Deary IJ: The HALCyon Study Team: how useful are the SF-36 sub-scales in older people? Mokken scaling of data from the HALCyon programme. Qual Life Res 2011, 20: 1005–1010. 10.1007/s11136-010-9838-7PubMedCentralCrossRefPubMed
22.
go back to reference Emons WHM, Sijtsma K, Pedersen SS: Dimensionality of the Hospital Anxiety and Depression Scale (HADS) in cardiac patients: comparison of Mokken scale analysis and factor analysis. Assessment 2012, 19: 337–353. 10.1177/1073191110384951CrossRefPubMed Emons WHM, Sijtsma K, Pedersen SS: Dimensionality of the Hospital Anxiety and Depression Scale (HADS) in cardiac patients: comparison of Mokken scale analysis and factor analysis. Assessment 2012, 19: 337–353. 10.1177/1073191110384951CrossRefPubMed
23.
24.
go back to reference DeSante CD: Revisiting Reliability: The Misuse of Cronbach’s ? in Political Science. American Political Science Association Annual Meeting, Washington, DC; 2011. DeSante CD: Revisiting Reliability: The Misuse of Cronbach’s ? in Political Science. American Political Science Association Annual Meeting, Washington, DC; 2011.
25.
go back to reference Starkweather J: Step out of the past: stop using coefficient alpha; there are better ways to calculate reliability. Benchmarks Research and Statistical Support Matters; 2012. http://www.unt.edu/rss/class/Jon/Benchmarks/Omega_JDS_Jun2012.pdf. Starkweather J: Step out of the past: stop using coefficient alpha; there are better ways to calculate reliability. Benchmarks Research and Statistical Support Matters; 2012. http://​www.​unt.​edu/​rss/​class/​Jon/​Benchmarks/​Omega_​JDS_​Jun2012.​pdf.​
26.
go back to reference Molenaar IW, Sijtsma K, Boer P: MSP5 for Windows: a program for Mokken scale analysis for polytomous items. iec ProGAMMA, Groningen; 2000. Molenaar IW, Sijtsma K, Boer P: MSP5 for Windows: a program for Mokken scale analysis for polytomous items. iec ProGAMMA, Groningen; 2000.
27.
go back to reference Hempker BT, Sijtsma K, Molenaar IW: Selection of unidimensional scales from a multidimensional item bank in the polytomous Mokken IRT model. Appl Psychol Meas 1995, 19: 337–352. 10.1177/014662169501900404CrossRef Hempker BT, Sijtsma K, Molenaar IW: Selection of unidimensional scales from a multidimensional item bank in the polytomous Mokken IRT model. Appl Psychol Meas 1995, 19: 337–352. 10.1177/014662169501900404CrossRef
28.
go back to reference Meijer RR, Baneke JJ: Analyzing psychopathology items: a cae for nonparametric item response theory modelling. Psychol Methods 2001, 9: 351–368. Meijer RR, Baneke JJ: Analyzing psychopathology items: a cae for nonparametric item response theory modelling. Psychol Methods 2001, 9: 351–368.
29.
go back to reference Shenkin SD, Watson R, Laidlaw K, Starr JM, Deary IJ: The attitudes to ageing questionnaire: Mokken Scaling Analysis. PLoS One 2014, 9: e99100. 10.1371/journal.pone.0099100PubMedCentralCrossRefPubMed Shenkin SD, Watson R, Laidlaw K, Starr JM, Deary IJ: The attitudes to ageing questionnaire: Mokken Scaling Analysis. PLoS One 2014, 9: e99100. 10.1371/journal.pone.0099100PubMedCentralCrossRefPubMed
30.
go back to reference Van der Ark LA: Mokken scale analysis in R. J Stat Softw 2007, 20: 1–19. Van der Ark LA: Mokken scale analysis in R. J Stat Softw 2007, 20: 1–19.
31.
go back to reference Boyle GJ: Does item homogeneity indicate internal consistency or item redundancy in psychometric scales? Pers Individ Differences 1991, 12: 291–294. 10.1016/0191-8869(91)90115-RCrossRef Boyle GJ: Does item homogeneity indicate internal consistency or item redundancy in psychometric scales? Pers Individ Differences 1991, 12: 291–294. 10.1016/0191-8869(91)90115-RCrossRef
Metadata
Title
Violations of local stochastic independence exaggerate scalability in Mokken scaling analysis of the Chinese Mandarin SF-36
Authors
Roger Watson
Wenru Wang
David R Thompson
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2014
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-014-0149-5

Other articles of this Issue 1/2014

Health and Quality of Life Outcomes 1/2014 Go to the issue