Skip to main content
Top
Published in: BMC Public Health 1/2008

Open Access 01-12-2008 | Research article

The reliability of the twelve-item general health questionnaire (GHQ-12) under realistic assumptions

Author: Matthew Hankins

Published in: BMC Public Health | Issue 1/2008

Login to get access

Abstract

Background

The twelve-item General Health Questionnaire (GHQ-12) was developed to screen for non-specific psychiatric morbidity. It has been widely validated and found to be reliable. These validation studies have assumed that the GHQ-12 is one-dimensional and free of response bias, but recent evidence suggests that neither of these assumptions may be correct, threatening its utility as a screening instrument. Further uncertainty arises because of the multiplicity of scoring methods of the GHQ-12. This study set out to establish the best fitting model for the GHQ-12 for three scoring methods (Likert, GHQ and C-GHQ) and to calculate the degree of measurement error under these more realistic assumptions.

Methods

GHQ-12 data were obtained from the Health Survey for England 2004 cohort (n = 3705). Structural equation modelling was used to assess the fit of [1] the one-dimensional model [2] the current 'best fit' three-dimensional model and [3] a one-dimensional model with response bias. Three different scoring methods were assessed for each model. The best fitting model was assessed for reliability, standard error of measurement and discrimination.

Results

The best fitting model was one-dimensional with response bias on the negatively phrased items, suggesting that previous GHQ-12 factor structures were artifacts of the analysis method. The reliability of this model was over-estimated by Cronbach's Alpha for all scoring methods: 0.90 (Likert method), 0.90 (GHQ method) and 0.75 (C-GHQ). More realistic estimates of reliability were 0.73, 0.87 and 0.53 (C-GHQ), respectively. Discrimination (Delta) also varied according to scoring method: 0.94 (Likert method), 0.63 (GHQ method) and 0.97 (C-GHQ method).

Conclusion

Conventional psychometric assessments using factor analysis and reliability estimates have obscured substantial measurement error in the GHQ-12 due to response bias on the negative items, which limits its utility as a screening instrument for psychiatric morbidity.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goldberg DP, Williams P: A user's guide to the General Health Questionnaire. 1988, Basingstoke NFER-Nelson Goldberg DP, Williams P: A user's guide to the General Health Questionnaire. 1988, Basingstoke NFER-Nelson
2.
go back to reference Werneke U, Goldberg DP, Yalcin I, Ustun BT: The stability of the factor structure of the General Health Questionnaire. Psychological Medicine. 2000, 30: 823-9. 10.1017/S0033291799002287.CrossRefPubMed Werneke U, Goldberg DP, Yalcin I, Ustun BT: The stability of the factor structure of the General Health Questionnaire. Psychological Medicine. 2000, 30: 823-9. 10.1017/S0033291799002287.CrossRefPubMed
3.
go back to reference Hardy GE, Shapiro DA, Haynes CE, Rick JE: Validation of the General Health Questionnaire-12: Using a sample of employees from England's health care services. Psychological Assessment. 1999, 11 (2): 159-165. 10.1037/1040-3590.11.2.159.CrossRef Hardy GE, Shapiro DA, Haynes CE, Rick JE: Validation of the General Health Questionnaire-12: Using a sample of employees from England's health care services. Psychological Assessment. 1999, 11 (2): 159-165. 10.1037/1040-3590.11.2.159.CrossRef
4.
go back to reference Gilbody S, Touse A, Sheldon T: Routinely administered questionnaires for depression and anxiety: systematic review. BMJ. 2001, 332: 406-9. 10.1136/bmj.322.7283.406.CrossRef Gilbody S, Touse A, Sheldon T: Routinely administered questionnaires for depression and anxiety: systematic review. BMJ. 2001, 332: 406-9. 10.1136/bmj.322.7283.406.CrossRef
5.
go back to reference Mitchell AA, Werler MM, Shapiro S: Analyses and reanalyses of epidemiologic data: Learning lessons and maintaining perspective. Teratology. 1994, 167-168. 10.1002/tera.1420490304. Mitchell AA, Werler MM, Shapiro S: Analyses and reanalyses of epidemiologic data: Learning lessons and maintaining perspective. Teratology. 1994, 167-168. 10.1002/tera.1420490304.
6.
go back to reference Guilford JP: Psychometric Methods. 1954, McGraw-Hill, New York Guilford JP: Psychometric Methods. 1954, McGraw-Hill, New York
7.
go back to reference Martin CR, Newell RJ: Is the 12-item General Health Questionnaire (GHQ-12) confounded by scoring method in individuals with facial disfigurement?. Psychology and Health. 2005, 20: 651-659. 10.1080/14768320500060061.CrossRef Martin CR, Newell RJ: Is the 12-item General Health Questionnaire (GHQ-12) confounded by scoring method in individuals with facial disfigurement?. Psychology and Health. 2005, 20: 651-659. 10.1080/14768320500060061.CrossRef
8.
go back to reference Shevlin M, Adamson G: Alternative Factor Models and Factorial Invariance of the GHQ-12: A Large Sample Analysis Using Confirmatory Factor Analysis. Psychological Assessment. 2005, 17: 231-236. 10.1037/1040-3590.17.2.231.CrossRefPubMed Shevlin M, Adamson G: Alternative Factor Models and Factorial Invariance of the GHQ-12: A Large Sample Analysis Using Confirmatory Factor Analysis. Psychological Assessment. 2005, 17: 231-236. 10.1037/1040-3590.17.2.231.CrossRefPubMed
9.
go back to reference Graetz B: Multidimensional properties of the General Health Questionnaire. Social Psychiatry & Psychiatric Epidemiology. 1991, 132-8. 10.1007/BF00782952. Graetz B: Multidimensional properties of the General Health Questionnaire. Social Psychiatry & Psychiatric Epidemiology. 1991, 132-8. 10.1007/BF00782952.
10.
go back to reference Hankins M: The factor structure of the twelve item General Health Questionnaire (GHQ-12): the result of negative phrasing?. Clinical Practice and Epidemiology in Mental Health. 2008, 4: 10-10.1186/1745-0179-4-10.CrossRefPubMedPubMedCentral Hankins M: The factor structure of the twelve item General Health Questionnaire (GHQ-12): the result of negative phrasing?. Clinical Practice and Epidemiology in Mental Health. 2008, 4: 10-10.1186/1745-0179-4-10.CrossRefPubMedPubMedCentral
11.
go back to reference Schmitt N, Stults DM: Factors defined by negatively keyed items: The result of careless respondents?. Applied Psychological Measurement. 1985, 367-373. 10.1177/014662168500900405. Schmitt N, Stults DM: Factors defined by negatively keyed items: The result of careless respondents?. Applied Psychological Measurement. 1985, 367-373. 10.1177/014662168500900405.
12.
go back to reference Cordery JL, Sevastos PP: Responses to the original and revised job diagnostic survey: Is education a factor in responses to negatively worded items?. Journal of Applied Psychology. 1993, 141-143. 10.1037/0021-9010.78.1.141. Cordery JL, Sevastos PP: Responses to the original and revised job diagnostic survey: Is education a factor in responses to negatively worded items?. Journal of Applied Psychology. 1993, 141-143. 10.1037/0021-9010.78.1.141.
13.
go back to reference Mook J, Kleijn WC, Ploeg HM: Positively and negatively worded self-report measure of dispositional optimism. Psychological Reports. 1992, 275-78. 10.2466/PR0.71.5.275-278. Mook J, Kleijn WC, Ploeg HM: Positively and negatively worded self-report measure of dispositional optimism. Psychological Reports. 1992, 275-78. 10.2466/PR0.71.5.275-278.
14.
go back to reference Marsh HW: Positive and negative global self-esteem: A substantively meaningful distinction or artifactors?. Journal of Personality and Social Psychology. 1996, 810-819. 10.1037/0022-3514.70.4.810. Marsh HW: Positive and negative global self-esteem: A substantively meaningful distinction or artifactors?. Journal of Personality and Social Psychology. 1996, 810-819. 10.1037/0022-3514.70.4.810.
15.
go back to reference Rosenberg M: Society and the adolescent self-image. 1965, Princeton, NJ: Princeton University PressCrossRef Rosenberg M: Society and the adolescent self-image. 1965, Princeton, NJ: Princeton University PressCrossRef
16.
go back to reference Greenberger E, Chuansheng C, Dmitrieva J, Farruggia SP: Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: do they matter?. Personality and Individual Differences. 2003, 1241-1254. 10.1016/S0191-8869(02)00331-8. Greenberger E, Chuansheng C, Dmitrieva J, Farruggia SP: Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: do they matter?. Personality and Individual Differences. 2003, 1241-1254. 10.1016/S0191-8869(02)00331-8.
17.
go back to reference Strathman A, Gleicher F, Boninger DS, Edwards CS: The consideration of future consequences – weighing immediate and distant outcomes of behavior. Journal of Personality and Social Psychology. 1994, 742-752. 10.1037/0022-3514.66.4.742. Strathman A, Gleicher F, Boninger DS, Edwards CS: The consideration of future consequences – weighing immediate and distant outcomes of behavior. Journal of Personality and Social Psychology. 1994, 742-752. 10.1037/0022-3514.66.4.742.
18.
go back to reference Crockett RA, Weinman J, Hankins M, Marteau T: Time orientation and health-related behaviour: measurement in general population samples. Psychology & Health. 2008, 1-18. iFirst. Crockett RA, Weinman J, Hankins M, Marteau T: Time orientation and health-related behaviour: measurement in general population samples. Psychology & Health. 2008, 1-18. iFirst.
19.
20.
go back to reference Goodchild ME, Duncan-Jones P: Chronicity and the general health questionnaire. British Journal of Psychiatry. 1985, 55-61. 10.1192/bjp.146.1.55. Goodchild ME, Duncan-Jones P: Chronicity and the general health questionnaire. British Journal of Psychiatry. 1985, 55-61. 10.1192/bjp.146.1.55.
21.
go back to reference Cronbach LJ: Coefficient Alpha and the internal structure of tests. Psychometrika. 1951, 297-334. 10.1007/BF02310555. Cronbach LJ: Coefficient Alpha and the internal structure of tests. Psychometrika. 1951, 297-334. 10.1007/BF02310555.
22.
go back to reference Raykov T: Bias of coefficient Alpha for fixed congeneric measures with correlated errors. Applied Psychological Measurement. 2001, 69-76. 10.1177/01466216010251005. Raykov T: Bias of coefficient Alpha for fixed congeneric measures with correlated errors. Applied Psychological Measurement. 2001, 69-76. 10.1177/01466216010251005.
23.
go back to reference Raykov T: Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology. 2001, 315-323. 10.1348/000711001159582. Raykov T: Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology. 2001, 315-323. 10.1348/000711001159582.
24.
go back to reference National Centre for Social Research and University College London: Department of Epidemiology and Public Health, Health Survey for England, 2004 [computer file]. 2006, Colchester, Essex: UK Data Archive [distributor], SN: 5439. National Centre for Social Research and University College London: Department of Epidemiology and Public Health, Health Survey for England, 2004 [computer file]. 2006, Colchester, Essex: UK Data Archive [distributor], SN: 5439.
25.
go back to reference Hankins M: How discriminating are discriminative instruments?. Health & Quality of Life Outcomes. 2008 Hankins M: How discriminating are discriminative instruments?. Health & Quality of Life Outcomes. 2008
26.
go back to reference Byrne B: Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming. 2001, Lawrence Erlbaum Associates Byrne B: Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming. 2001, Lawrence Erlbaum Associates
Metadata
Title
The reliability of the twelve-item general health questionnaire (GHQ-12) under realistic assumptions
Author
Matthew Hankins
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2008
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-8-355

Other articles of this Issue 1/2008

BMC Public Health 1/2008 Go to the issue