Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

ACC 2024 Congress

Catch up on all the top stories and latest evidence in cardiology research with our ACC 2024 Congress hub page.
ADVANCED SEARCH
Log in
Top
International Journal of Behavioral Medicine
Published in: International Journal of Behavioral Medicine 2/2009

Open Access 01-06-2009

Cross-Language Differential Item Functioning of the Job Content Questionnaire Among European Countries: The JACE Study

Authors: BongKyoo Choi, Jakob Blue Bjorner, Per-Olof Ostergren, Els Clays, Irene Houtman, Laura Punnett, Annika Rosengren, Dirk De Bacquer, Marco Ferrario, Maaike Bilau, Robert Karasek

Published in: International Journal of Behavioral Medicine | Issue 2/2009

Login to get access

Abstract

Background

Little is known about cross-language measurement equivalence of the job content questionnaire (JCQ)

Purpose

The purposes of this study were to assess the extent of cross-language differential item functioning (DIF) of the 27 JCQ items in six languages (French, Dutch, Belgian-French, Belgian-Dutch (Flemish), Italian, and Swedish) from six European research centers and to test whether its effects on the scale-level mean comparisons among the centers were substantial or not.

Method

A partial gamma coefficient method was used for statistical DIF analyses where the Flemish JCQ was the reference for other language versions. Additionally, equivalence between the Flemish and Dutch translations was subjected to a judgmental review.

Results

On average, 36% to 39% of the total tested items appeared to be cross-language DIF items in the statistical analyses. The judgmental review indicated that half of the DIF items may be associated with translation difference. The impacts of the DIF items on the mean comparisons of the JCQ scales between the centers were non-trivial: underestimated skill discretion (Milan), underestimated decision authority (Leiden), underestimated psychological demands (Milan women), and incomparable coworker support (Gothenburg 95).

Conclusion

Cross-language DIF of the JCQ among European countries should be considered in international comparative studies on psychosocial job hazards using JCQ scales.
Footnotes
1
The following SPSS syntax was used for partial gamma coefficients.
CROSSTABS
variables = varx (minvalue,maxvalue), vary (minvalue, maxvalue), varz, (minvalue, maxvalue)
/tables = varx by vary by varz
/statistics = gamma
/format = avalue tables
 
Literature
1.
Karasek RA, Gordon G, Pietrokovsky C, Frese M, Pieper C, Schwartz J, et al. Job content questionnaire and user’s guide. Los Angeles: University of Southern California; 1985.
2.
Hurrell JJ Jr, Nelson DL, Simmons B. Measuring job stressors and strains: where we have been, where we are, and where we need to go. J Occup Health Psychol. 1998;3:322–55.CrossRef
3.
Lansbergis P, Theorell T. Self-reported questionnaires. In: Schnall PL, Belkić K, Lansbergis P, Baker D, editors. Occupational medicine: State of the art reviews-the workplace and cardiovascular disease, vol. 15, no. 1. Philadelphia: Hanley & Belfus; 2000. p. 163–71.
4.
Sauter SL, Brightwell WS, Colligan MJ, Hurrell JJ Jr, Katz TM, LeGrande DE, et al. The changing organization of work and the safety and health of working people: Knowledge gaps and research directions (DHHS publication no. 2002-116). Cincinnati: National Institute for Occupational Safety and Health; 2002.
5.
World Health Organization (WHO). The world health report 2002: reducing risks, promoting healthy life. Geneva: WHO; 2002.
6.
Cavusgil ST, Das A. Methodological issues in empirical cross-cultural research: a survey of the management literature and a framework. Manag Int Rev. 1997;37:71–96.
7.
Hambleton RK. Issues, designs, and technical guidelines of adapting tests into multiple languages and cultures. In: Hambleton RK, Merenda PF, Spielberger CD, editors. Adapting educational and psychological tests for cross-cultural assessment. Mahwah: Erlbaum; 2005. p. 3–38.
8.
Harkness J. In pursuit of quality: Issues for cross-national survey research. Int J Soc Res Methodol. 1999;2(2):125–40.CrossRef
9.
Peng TK, Peterson MF, Shyi YP. Quantitative methods in cross-national management research: Trends and equivalence issues. J Organ Behav. 1991;12:87–107.CrossRef
10.
Schaffer B, Riordan CM. A review of cross-cultural methodologies for organizational research: a best-practices approach. Organ Res Methods. 2003;6(2):169–215.CrossRef
11.
Van de Vijver FJR, Poortinga YH. Conceptual and methodological issues in adapting tests. In: Hambleton RK, Merenda PF, Spielberger CD, editors. Adapting educational and psychological tests for cross-cultural assessment. Mahwah: Erlbaum; 2005. p. 39–63.
12.
Riordan CM, Vandenberg RJ. A central question in cross-cultural research: do employees of different cultures interpret work-related measures in an equivalent manner? J Manage. 1994;20(3):643–71.CrossRef
13.
Angolf WH. Use of difficulty and discrimination indices for detecting item bias. In: Berk RA, editor. Handbook of methods for detecting test bias. Baltimore: The Johns Hopkins University; 1982. p. 96–116.
14.
Angolf WH. Perspectives on differential item functioning methodology. In: Holland PW, Wainer H, editors. Differential item functioning. Hillsdale: Erlbaum; 1993. p. 3–29.
15.
Bjorner JB, Kreiner S, Ware JE, Damsgaard MT, Bech P. Differential item functioning in the Danish translation of the SF-36. J Clin Epidemiol. 1998;51(11):1189–202.PubMedCrossRef
16.
Camilli G, Shepard LA. MMSS: Methods for identifying biased test items. Thousand Oaks: Sage; 1994.
17.
Ørhede E, Kreiner S. Item bias in indices measuring psychosocial work environment and health. Scand J Work Environ Health. 2000;26(3):263–72.PubMed
18.
Bullinger M, Alonso J, Apolone G, Leplège A, Sullivan M, Wood-Dauphinee S, et al. Translating health status questionnaires and evaluating their quality: the IQOLA project approach. J Clin Epidemiol. 1998;51(11):913–23.PubMedCrossRef
19.
Bjorner JB, Thunedborg K, Kristensen TS, Modvig J, Bech P. The Danish SF-36 health survey: translation and preliminary validity studies. J Clin Epidemiol. 1998;51:991–99.PubMedCrossRef
20.
Hunt S, McKenna S. Cross-cultural comparability of quality of measures. Br J Med Econ. 1992;4:17–23.
21.
Keller SD, Ware JE, Gandek B, Aaronson NK, Alonso J, Apolone G, et al. Testing the equivalence of translations of widely used response choice labels: results from the IQOLA project. J Clin Epidemiol. 1998;51(11):933–44.PubMedCrossRef
22.
Wagner AK, Gandek B, Aaronson NK, Acquadro C, Alonso J, Apolone G, et al. Cross-cultural comparisons of the content of SF-36 translations across 10 countries: results from the IQOLA project. J Clin Epidemiol. 1998;51(11):925–32.PubMedCrossRef
23.
Ellis BB, Kimmel HD. Identification of unique cultural response patterns by means of item response theory. J Appl Psychol. 1992;77(2):177–84.CrossRef
24.
Petersen MA, Groenvold M, Bjorner JB, Aaronson N, Conroy T, Cull A, et al. Use of differential item functioning analysis to assess the equivalence of translation of a questionnaire. Qual Life Res. 2003;12:373–85.PubMedCrossRef
25.
Kristensen TS. Job stress and cardiovascular disease: a theoretic critical review. J Occup Health Psychol. 1996;1(3):246–60.PubMedCrossRef
26.
Karasek RA, Brisson C, Kawakami N, Houtman I, Bongers P, Amick B. The job content questionnaire (JCQ): An instrument for internationally comparative assessment of psychosocial job characteristics. J Occup Health Psychol. 1998;3:322–55.PubMedCrossRef
27.
Choi B, Cho SL, Jian L, Yang W, Jhun HJ, Xu Z et al. (2006). A differential item functioning test for the cross-national quantitative comparison of psychosocial job hazards between Chinese and Korean nurses. Paper submitted to the 9th International Congress of Behavioral Medicine, Bangkok, Thailand.
28.
de Smet P, Sans S, Dramaix M, Boulenguez C, de Backer G, Ferrario M, et al. Gender and regional differences in perceived job stress across Europe. Eur J Pub Health. 2005;15(5):536–45.CrossRef
29.
Stark S, Chernyshenko OS, Drasgow F. Examining the effects of differential item (functioning and differential) test functioning on selection decisions: when are statistically significant effects practically important? J Appl Psychol. 2005;89(3):497–508.CrossRef
30.
Houtman I, Kornitzer M, de Smet P, Koyunko R, de Barker G, Pelfrene E, et al. Job stress, absenteeism and coronary heart disease European cooperative study (the JACE study): design of a multicentre prospective study. Eur J Pub Health. 1999;9:52–7.CrossRef
31.
Karasek RA, Choi B, Ostergren PO, Ferrario M, de Smet P. Testing two methods to create comparable scale scores between the Job Content Questionnaire (JCQ) and JCQ-like questionnaires, in the European JACE study. Int J Behav Med. 2007;14(4):189–201.PubMedCrossRef
32.
International Labor Office. International standard classification of occupations: ISCO-88. Geneva: International Labor Office; 1990.
33.
Choi B (2006) Methodological and theoretical issues in cross-national comparative studies of psychosocial job hazards: from questionnaire items to social class. Dissertation, University of Massachusetts, Lowell, MA
34.
Pelfrene E, Vlerick P, Mak RP, de Smet P, Kornitzer M, de Barker G. Scale reliability and validity of the Karasek ‘job demand-control-support’ model in the Belstress study. Work Stress. 2001;15:297–313.CrossRef
35.
Kreiner S. Validation of index scales for analysis of survey data: the symptom index. In: Dean K, editor. Population health research: liking theory and methods. Thousand Oaks: Sage; 1993. p. 116–44.
36.
37.
Reise SP, Widaman KF, Pugh RH. Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. Psychol Bull. 1993;114(3):552–66.PubMedCrossRef
38.
Meade AW, Lautenschlager GJ. A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/invariance. Organ Res Methods. 2004;7(4):361–88.CrossRef
39.
40.
Ercikan K. Translation effects in international assessments. Int J Educ Res. 1998;29:543–53.CrossRef
41.
Ercikan K. Disentangling sources of differential item functioning in multilanguage assessments. Int J Testing. 2002;2(3&4):199–215.CrossRef
42.
Hofstede G. Cultural consequences: comparing values, behaviors, institutions, and organizations across nations, vol. 2. Thousand Oaks, CA: Sage; 2001. p. 209–372.
43.
Theorell T, Karasek RA. Current issues relating to psychosocial job strain and cardiovascular disease research. J Occup Health Psychol. 1996;1(1):9–26.PubMedCrossRef
44.
Standsfeld S, Candy B. Psychosocial work environment and mental health—a meta-analytic review. Scand J Work Environ Health. 2006;32(6):443–62.
45.
Mallinson S. Listening to respondents: a qualitative assessment of the Short-Form 36 Health Status Questionnaire. Soc Sci Med. 2002;54:11–21.PubMedCrossRef
Metadata
Title
Cross-Language Differential Item Functioning of the Job Content Questionnaire Among European Countries: The JACE Study
Authors
BongKyoo Choi
Jakob Blue Bjorner
Per-Olof Ostergren
Els Clays
Irene Houtman
Laura Punnett
Annika Rosengren
Dirk De Bacquer
Marco Ferrario
Maaike Bilau
Robert Karasek
Publication date
01-06-2009
Publisher
Springer US
Published in
International Journal of Behavioral Medicine / Issue 2/2009
Print ISSN: 1070-5503
Electronic ISSN: 1532-7558
DOI
https://doi.org/10.1007/s12529-009-9048-2

Other articles of this Issue 2/2009

International Journal of Behavioral Medicine 2/2009 Go to the issue

OriginalPaper

The Factor Structure and Factorial Invariance for the Decisional Balance Scale for Adolescent Smoking

OriginalPaper

The Body Image Avoidance Questionnaire: Assessment of its Construct Validity in a Community Sample of French Adolescents

OriginalPaper

Self-rated Health and Social Capital Among Aging People Across the Urban–Rural Dimension

OriginalPaper

Development and Psychometric Properties of the World Health Organization Quality of Life Assessment Instrument (WHOQOL-100) in Portugal

OriginalPaper

Health Behavior and Protective Factors Among School Children in Four African Countries

Editorial

Measurement Instruments in Behavioral Medicine