Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Effort, reward and self-reported mental health: a simulation study on negative affectivity bias

Authors: Marc Arial, Pascal Wild

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

In the present article, we propose an alternative method for dealing with negative affectivity (NA) biases in research, while investigating the association between a deleterious psychosocial environment at work and poor mental health. First, we investigated how strong NA must be to cause an observed correlation between the independent and dependent variables. Second, we subjectively assessed whether NA can have a large enough impact on a large enough number of subjects to invalidate the observed correlations between dependent and independent variables.

Methods

We simulated 10,000 populations of 300 subjects each, using the marginal distribution of workers in an actual population that had answered the Siegrist's questionnaire on effort and reward imbalance (ERI) and the General Health Questionnaire (GHQ).

Results

The results of the present study suggested that simulated NA has a minimal effect on the mean scores for effort and reward. However, the correlations between the effort and reward imbalance (ERI) ratio and the GHQ score might be important, even in simulated populations with a limited NA.

Conclusions

When investigating the relationship between the ERI ratio and the GHQ score, we suggest the following rules for the interpretation of the results: correlations with an explained variance of 5% and below should be considered with caution; correlations with an explained variance between 5% and 10% may result from NA, although this effect does not seem likely; and correlations with an explained variance of 10% and above are not likely to be the result of NA biases.
Literature
1.
go back to reference Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ: Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006, 367: 1747-1757. 10.1016/S0140-6736(06)68770-9.CrossRefPubMed Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ: Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006, 367: 1747-1757. 10.1016/S0140-6736(06)68770-9.CrossRefPubMed
2.
go back to reference Siegrist J: Adverse health effects of high effort - low reward conditions at work. Journal of Occupational Health Psychology. 1996, 1: 27-43.CrossRefPubMed Siegrist J: Adverse health effects of high effort - low reward conditions at work. Journal of Occupational Health Psychology. 1996, 1: 27-43.CrossRefPubMed
3.
go back to reference Siegrist J: Social reciprocity and health: new scientific evidence and policy implications. Psychoneuroendocrinology. 2005, 30: 1033-1038. 10.1016/j.psyneuen.2005.03.017.CrossRefPubMed Siegrist J: Social reciprocity and health: new scientific evidence and policy implications. Psychoneuroendocrinology. 2005, 30: 1033-1038. 10.1016/j.psyneuen.2005.03.017.CrossRefPubMed
4.
go back to reference Niedhammer I, Chea M: Psychosocial factors at work and self reported health: comparative results of cross sectional and prospective analyses of the French GAZEL cohort. Occupational & Environmental Medicine. 2003, 60: 509-515. 10.1136/oem.60.7.509.CrossRef Niedhammer I, Chea M: Psychosocial factors at work and self reported health: comparative results of cross sectional and prospective analyses of the French GAZEL cohort. Occupational & Environmental Medicine. 2003, 60: 509-515. 10.1136/oem.60.7.509.CrossRef
5.
go back to reference Kivimaki M, Virtanen M, Elovainio M, Kouvonen A, Vaananen A, Vahtera J: Work stress in the etiology of coronary heart disease--a meta-analysis. Scandinavian Journal of Work, Environment & Health. 2006, 32: 431-442.CrossRef Kivimaki M, Virtanen M, Elovainio M, Kouvonen A, Vaananen A, Vahtera J: Work stress in the etiology of coronary heart disease--a meta-analysis. Scandinavian Journal of Work, Environment & Health. 2006, 32: 431-442.CrossRef
6.
go back to reference Macfarlane GJ, Pallewatte N, Paudyal P, Blyth FM, Coggon D, Crombez G, Linton S, Leino-Arjas P, Silman AJ, Smeets RJ, et al: Evaluation of work-related psychosocial factors and regional musculoskeletal pain: results from a EULAR Task Force. Annals of the Rheumatic Diseases. 2009, 68: 885-891. 10.1136/ard.2008.090829.CrossRefPubMed Macfarlane GJ, Pallewatte N, Paudyal P, Blyth FM, Coggon D, Crombez G, Linton S, Leino-Arjas P, Silman AJ, Smeets RJ, et al: Evaluation of work-related psychosocial factors and regional musculoskeletal pain: results from a EULAR Task Force. Annals of the Rheumatic Diseases. 2009, 68: 885-891. 10.1136/ard.2008.090829.CrossRefPubMed
7.
go back to reference Bonde JP: Psychosocial factors at work and risk of depression: a systematic review of the epidemiological evidence. Occupational & Environmental Medicine. 2008, 65: 438-445. 10.1136/oem.2007.038430.CrossRef Bonde JP: Psychosocial factors at work and risk of depression: a systematic review of the epidemiological evidence. Occupational & Environmental Medicine. 2008, 65: 438-445. 10.1136/oem.2007.038430.CrossRef
8.
go back to reference Godin I, Kittel F, Coppieters Y, Siegrist J: A prospective study of cumulative job stress in relation to mental health. BMC Public Health. 2005, 5: 67-10.1186/1471-2458-5-67.CrossRefPubMedPubMedCentral Godin I, Kittel F, Coppieters Y, Siegrist J: A prospective study of cumulative job stress in relation to mental health. BMC Public Health. 2005, 5: 67-10.1186/1471-2458-5-67.CrossRefPubMedPubMedCentral
9.
go back to reference Pikhart H, Bobak M, Pajak A, Malyutina S, Kubinova R, Topor R, Sebakova H, Nikitin Y, Marmot M: Psychosocial factors at work and depression in three countries of Central and Eastern Europe. Social Science & Medicine. 2004, 58: 1475-1482. 10.1016/S0277-9536(03)00350-2.CrossRef Pikhart H, Bobak M, Pajak A, Malyutina S, Kubinova R, Topor R, Sebakova H, Nikitin Y, Marmot M: Psychosocial factors at work and depression in three countries of Central and Eastern Europe. Social Science & Medicine. 2004, 58: 1475-1482. 10.1016/S0277-9536(03)00350-2.CrossRef
10.
go back to reference Stansfeld S, Candy B: Psychosocial work environment and mental health--a meta-analytic review. Scandinavian Journal of Work, Environment & Health. 2006, 32: 443-462.CrossRef Stansfeld S, Candy B: Psychosocial work environment and mental health--a meta-analytic review. Scandinavian Journal of Work, Environment & Health. 2006, 32: 443-462.CrossRef
11.
go back to reference Spector PE: Method variance in organizational research; truth or urban legend?. Organizational research methods. 2006, 9: 221-232. 10.1177/1094428105284955.CrossRef Spector PE: Method variance in organizational research; truth or urban legend?. Organizational research methods. 2006, 9: 221-232. 10.1177/1094428105284955.CrossRef
12.
go back to reference Shadish WR, Cook TD, Campbell DT: Experimental and quasi-experimental designs for generalized causal inference. 2002, Boston, New-York: Houghton Mifflin Company Shadish WR, Cook TD, Campbell DT: Experimental and quasi-experimental designs for generalized causal inference. 2002, Boston, New-York: Houghton Mifflin Company
13.
go back to reference Siegrist J, Starke D, Chandola T, Godin I, Marmot M, Niedhammer I, Peter R: The measurement of effort-reward imbalance at work: European comparisons. Social Science & Medicine. 2004, 58: 1483-1499. 10.1016/S0277-9536(03)00351-4.CrossRef Siegrist J, Starke D, Chandola T, Godin I, Marmot M, Niedhammer I, Peter R: The measurement of effort-reward imbalance at work: European comparisons. Social Science & Medicine. 2004, 58: 1483-1499. 10.1016/S0277-9536(03)00351-4.CrossRef
14.
go back to reference Niedhammer I, Tek ML, Starke D, Siegrist J: Effort-reward imbalance model and self-reported health: cross-sectional and prospective findings from the GAZEL cohort. Social Science & Medicine. 2004, 58: 1531-1541. 10.1016/S0277-9536(03)00346-0.CrossRef Niedhammer I, Tek ML, Starke D, Siegrist J: Effort-reward imbalance model and self-reported health: cross-sectional and prospective findings from the GAZEL cohort. Social Science & Medicine. 2004, 58: 1531-1541. 10.1016/S0277-9536(03)00346-0.CrossRef
15.
go back to reference Pikhart H, Bobak M, Siegrist J, Pajak A, Rywik S, Kyshegyi J, Gostautas A, Skodova Z, Marmot M: Psychosocial work characteristics and self rated health in four post-communist countries. Journal of Epidemiology & Community Health. 2001, 55: 624-630. 10.1136/jech.55.9.624.CrossRef Pikhart H, Bobak M, Siegrist J, Pajak A, Rywik S, Kyshegyi J, Gostautas A, Skodova Z, Marmot M: Psychosocial work characteristics and self rated health in four post-communist countries. Journal of Epidemiology & Community Health. 2001, 55: 624-630. 10.1136/jech.55.9.624.CrossRef
16.
go back to reference Goldberg DP, Hillier VF: A scaled version of the General Health Questionnaire. Psychological Medicine. 1979, 9: 139-145. 10.1017/S0033291700021644.CrossRefPubMed Goldberg DP, Hillier VF: A scaled version of the General Health Questionnaire. Psychological Medicine. 1979, 9: 139-145. 10.1017/S0033291700021644.CrossRefPubMed
17.
go back to reference Goldberg DP, Gater R, Sartorius N, Ustun TB: The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine. 1997, 27: 191-197. 10.1017/S0033291796004242.CrossRefPubMed Goldberg DP, Gater R, Sartorius N, Ustun TB: The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine. 1997, 27: 191-197. 10.1017/S0033291796004242.CrossRefPubMed
18.
go back to reference McDowell I: Measuring health: a guide to rating scales and questionnaires. 2006, Oxford: Oxford University PressCrossRef McDowell I: Measuring health: a guide to rating scales and questionnaires. 2006, Oxford: Oxford University PressCrossRef
19.
go back to reference Politi PL, Piccinelli M, Wilkinson G: Reliability, validity and factor structure of the 12-item General Health Questionnaire among young males in Italy. Acta Psychiatrica Scandinavica. 1994, 90: 432-437. 10.1111/j.1600-0447.1994.tb01620.x.CrossRefPubMed Politi PL, Piccinelli M, Wilkinson G: Reliability, validity and factor structure of the 12-item General Health Questionnaire among young males in Italy. Acta Psychiatrica Scandinavica. 1994, 90: 432-437. 10.1111/j.1600-0447.1994.tb01620.x.CrossRefPubMed
20.
go back to reference Sriram TG, Chandrashekar CR, Isaac MK, Shanmugham V: The General Health Questionnaire (GHQ). Comparison of the English version and a translated Indian version. Social Psychiatry & Psychiatric Epidemiology. 1989, 24: 317-320. 10.1007/BF01788035.CrossRef Sriram TG, Chandrashekar CR, Isaac MK, Shanmugham V: The General Health Questionnaire (GHQ). Comparison of the English version and a translated Indian version. Social Psychiatry & Psychiatric Epidemiology. 1989, 24: 317-320. 10.1007/BF01788035.CrossRef
21.
go back to reference Winefield HR, Goldney RD, Winefield AH, Tiggemann M: The General Health Questionnaire: reliability and validity for Australian youth. Australian & New Zealand Journal of Psychiatry. 1989, 23: 53-58. 10.3109/00048678909062592.CrossRef Winefield HR, Goldney RD, Winefield AH, Tiggemann M: The General Health Questionnaire: reliability and validity for Australian youth. Australian & New Zealand Journal of Psychiatry. 1989, 23: 53-58. 10.3109/00048678909062592.CrossRef
22.
go back to reference Bolognini M, Bettschart W, Zehnder-Gubler M, Rossier L: The validity of the French version of the GHQ-28 and PSYDIS in a community sample of 20 year olds in Switzerland. European Archives of Psychiatry & Neurological Sciences. 1989, 238: 161-168. 10.1007/BF00451005.CrossRef Bolognini M, Bettschart W, Zehnder-Gubler M, Rossier L: The validity of the French version of the GHQ-28 and PSYDIS in a community sample of 20 year olds in Switzerland. European Archives of Psychiatry & Neurological Sciences. 1989, 238: 161-168. 10.1007/BF00451005.CrossRef
23.
go back to reference Pariente P, Challita H, Mesba M, Guelfi JD: The GHQ-28 questionnaire in French: a validation survey in a pannel of 158 general psychiatric patients. Eur Psychiat. 1992, 7: 15-20. Pariente P, Challita H, Mesba M, Guelfi JD: The GHQ-28 questionnaire in French: a validation survey in a pannel of 158 general psychiatric patients. Eur Psychiat. 1992, 7: 15-20.
24.
go back to reference Kalliath TJ, O'Driscoll MP, Brough P: A confirmatory factor analysis of the General Health Questionnaire - 12. Stress and Health: Journal of the International Society for the Investigation of Stress. 2004, 20: 11-20.CrossRef Kalliath TJ, O'Driscoll MP, Brough P: A confirmatory factor analysis of the General Health Questionnaire - 12. Stress and Health: Journal of the International Society for the Investigation of Stress. 2004, 20: 11-20.CrossRef
25.
go back to reference Goodchild ME, Duncan-Jones P: Chronicity and the General Health Questionnaire. British Journal of Psychiatry. 1985, 146: 55-61. 10.1192/bjp.146.1.55.CrossRefPubMed Goodchild ME, Duncan-Jones P: Chronicity and the General Health Questionnaire. British Journal of Psychiatry. 1985, 146: 55-61. 10.1192/bjp.146.1.55.CrossRefPubMed
26.
go back to reference Arial M, Benoit D, Wild P, Chouanière D, Danuser B: Multi-level modeling of aspects associated with poor mental health in a sample of prehospital emergency professionals. American Journal of Industrial Medicine. 2011, Arial M, Benoit D, Wild P, Chouanière D, Danuser B: Multi-level modeling of aspects associated with poor mental health in a sample of prehospital emergency professionals. American Journal of Industrial Medicine. 2011,
27.
go back to reference Arial M, Gonik V, Wild P, Danuser B: Association of work related chronic stressors and psychiatric symptoms in a Swiss sample of police officers; a cross sectional questionnaire study. International Archives of Occupational & Environmental Health. 2010, 83: 323-331. 10.1007/s00420-009-0500-z.CrossRef Arial M, Gonik V, Wild P, Danuser B: Association of work related chronic stressors and psychiatric symptoms in a Swiss sample of police officers; a cross sectional questionnaire study. International Archives of Occupational & Environmental Health. 2010, 83: 323-331. 10.1007/s00420-009-0500-z.CrossRef
28.
go back to reference Spector PE, Zapf D, Chen PY, Frese M: Why negative affectivity should not be controlled in job stress research: don't throw out the baby with the bath water. Journal of Organizational Behavior. 2000, 21: 79-95. 10.1002/(SICI)1099-1379(200002)21:1<79::AID-JOB964>3.0.CO;2-G.CrossRef Spector PE, Zapf D, Chen PY, Frese M: Why negative affectivity should not be controlled in job stress research: don't throw out the baby with the bath water. Journal of Organizational Behavior. 2000, 21: 79-95. 10.1002/(SICI)1099-1379(200002)21:1<79::AID-JOB964>3.0.CO;2-G.CrossRef
Metadata
Title
Effort, reward and self-reported mental health: a simulation study on negative affectivity bias
Authors
Marc Arial
Pascal Wild
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-121

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue