Skip to main content
Top
Published in: BMC Psychiatry 1/2008

Open Access 01-12-2008 | Research article

Evaluating cutpoints for the MHI-5 and MCS using the GHQ-12: a comparison of five different methods

Authors: Mark J Kelly, Frank D Dunstan, Keith Lloyd, David L Fone

Published in: BMC Psychiatry | Issue 1/2008

Login to get access

Abstract

Background

The Mental Health Inventory (MHI-5) and the Mental Health Component Summary score (MCS) derived from the Short Form 36 (SF-36) instrument are well validated and reliable scales. A drawback of their construction is that neither has a clinically validated cutpoint to define a case of common mental disorder (CMD). This paper aims to produce cutpoints for the MHI-5 and MCS by comparison with the General Health Questionnaire (GHQ-12).

Methods

Data were analysed from wave 9 of the British Household Panel Survey (2000), providing a sample size of 14,669 individuals. Receiver Operating Characteristic (ROC) curves were used to compare the scales and define cutpoints for the MHI-5 and MCS, using the following optimisation criteria: the Youden Index, the point closest to (0,1) on the ROC curve, minimising the misclassification rate, the minimax method, and prevalence matching.

Results

For the MHI-5, the Youden Index and the (0,1) methods both gave a cutpoint of 76, minimising the misclassification rate gave a cutpoint of 60 and the minimax method and prevalence matching gave a cutpoint of 68. For the MCS, the Youden Index and the (0,1) methods gave cutpoints of 51.7 and 52.1 respectively, minimising the error rate gave a cutpoint of 44.8 and both the minimax method and prevalence matching gave a cutpoint of 48.9. The correlation between the MHI-5 and the MCS was 0.88.

Conclusion

The Youden Index and (0,1) methods are most suitable for determining a cutpoint for the MHI-5, since they are least dependent on population prevalence. The choice of method is dependent on the intended application. The MHI-5 performs remarkably well against the longer MCS.
Appendix
Available only for authorised users
Literature
1.
go back to reference Weich S: Prevention of the common mental disorders: a public health perspective. Psychological Medicine. 1997, 27: 757-764. 10.1017/S0033291797005394.CrossRefPubMed Weich S: Prevention of the common mental disorders: a public health perspective. Psychological Medicine. 1997, 27: 757-764. 10.1017/S0033291797005394.CrossRefPubMed
2.
go back to reference Goldberg D, Williams P: A User's Guide to the General Health Questionnaire. 1988, Windsor: NEFR-Nelson Goldberg D, Williams P: A User's Guide to the General Health Questionnaire. 1988, Windsor: NEFR-Nelson
3.
go back to reference Ware J, Kosinksi M, Gandek B: SF-36® health survey: Manual & Interpretation Guide. 2000, Lincoln: Quality Metric Incorporated Ware J, Kosinksi M, Gandek B: SF-36® health survey: Manual & Interpretation Guide. 2000, Lincoln: Quality Metric Incorporated
4.
go back to reference Ware E, Gandek B: Overview of the SF-36 survey and the international quality of life assessment(IQOLA). Journal of Clinical Epidemiology. 1998, 51 (11): 903-912. 10.1016/S0895-4356(98)00081-X.CrossRefPubMed Ware E, Gandek B: Overview of the SF-36 survey and the international quality of life assessment(IQOLA). Journal of Clinical Epidemiology. 1998, 51 (11): 903-912. 10.1016/S0895-4356(98)00081-X.CrossRefPubMed
5.
go back to reference Ware J, Kosinksi M, Dewey J: How to score version 2 of the SF-36® health survey. 2000, Lincoln: Quality Metric Incorporated Ware J, Kosinksi M, Dewey J: How to score version 2 of the SF-36® health survey. 2000, Lincoln: Quality Metric Incorporated
6.
go back to reference Taylor M, Brice J, Buck N, Prentice-Lane E: British Household Panel Survey User Manual Volume A: Introduction, technical report and appendices. 2005, Colchester: University of Essex Taylor M, Brice J, Buck N, Prentice-Lane E: British Household Panel Survey User Manual Volume A: Introduction, technical report and appendices. 2005, Colchester: University of Essex
7.
go back to reference Goldberg D, Gater G, Sartorius N, Ustun T, Piccinelli M, Gureje O, Rutter C: The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine. 1997, 27: 191-197. 10.1017/S0033291796004242.CrossRefPubMed Goldberg D, Gater G, Sartorius N, Ustun T, Piccinelli M, Gureje O, Rutter C: The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine. 1997, 27: 191-197. 10.1017/S0033291796004242.CrossRefPubMed
8.
go back to reference Jenkinson C, Layte R, Lawrence K: Development and testing of the medical outcomes study 36-item short from health survey summary scale scores in the United Kingdom: Results from a large-scale survey and clinical trial. Medical Care. 1997, 35 (4): 410-416. 10.1097/00005650-199704000-00010.CrossRefPubMed Jenkinson C, Layte R, Lawrence K: Development and testing of the medical outcomes study 36-item short from health survey summary scale scores in the United Kingdom: Results from a large-scale survey and clinical trial. Medical Care. 1997, 35 (4): 410-416. 10.1097/00005650-199704000-00010.CrossRefPubMed
9.
go back to reference Jenkinson C, Stewart-Brown S, Petersen S, Paice C: Assessment of the SF-36 version 2 in the United Kingdom. Journal of Epidemiology and Community Health. 1999, 53: 46-50.CrossRefPubMedPubMedCentral Jenkinson C, Stewart-Brown S, Petersen S, Paice C: Assessment of the SF-36 version 2 in the United Kingdom. Journal of Epidemiology and Community Health. 1999, 53: 46-50.CrossRefPubMedPubMedCentral
10.
go back to reference Youden W: An index for rating diagnostic tests. Cancer. 1950, 3: 32-35. 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3.CrossRefPubMed Youden W: An index for rating diagnostic tests. Cancer. 1950, 3: 32-35. 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3.CrossRefPubMed
11.
go back to reference Holmes W: A short, psychiatric, case-finding measure for HIV seropositive outpatients. Medical Care. 1998, 36 (2): 237-243. 10.1097/00005650-199802000-00012.CrossRefPubMed Holmes W: A short, psychiatric, case-finding measure for HIV seropositive outpatients. Medical Care. 1998, 36 (2): 237-243. 10.1097/00005650-199802000-00012.CrossRefPubMed
12.
go back to reference Hand D: Screening vs Prevalence Estimation. Applied Statistics. 1987, 36: 1-7. 10.2307/2347839.CrossRef Hand D: Screening vs Prevalence Estimation. Applied Statistics. 1987, 36: 1-7. 10.2307/2347839.CrossRef
13.
go back to reference Hoeymans N, Garssen A, Westert G, Verhaak P: Measuring mental health of the Dutch population: a comparison of the GHQ-12 and the MHI-5. Health and Quality of Life Outcomes. 2004, 2: 23-29. 10.1186/1477-7525-2-23.CrossRefPubMedPubMedCentral Hoeymans N, Garssen A, Westert G, Verhaak P: Measuring mental health of the Dutch population: a comparison of the GHQ-12 and the MHI-5. Health and Quality of Life Outcomes. 2004, 2: 23-29. 10.1186/1477-7525-2-23.CrossRefPubMedPubMedCentral
14.
go back to reference Weinstein W, Berwick D, Goldman P, Murphy J, Barsky A: A comparison of three psychiatric screening tests using reciever operating characteristics (ROC) analysis. Medical Care. 1989, 27 (6): 593-607. 10.1097/00005650-198906000-00003.CrossRefPubMed Weinstein W, Berwick D, Goldman P, Murphy J, Barsky A: A comparison of three psychiatric screening tests using reciever operating characteristics (ROC) analysis. Medical Care. 1989, 27 (6): 593-607. 10.1097/00005650-198906000-00003.CrossRefPubMed
15.
go back to reference Winston M, Smith J: A trans-cultural comparison of four psychiatric case-finding instruments in a Welsh community. Social Psychiatry and Psychiatric Epidemiology. 2000, 35: 569-575. 10.1007/s001270050281.CrossRefPubMed Winston M, Smith J: A trans-cultural comparison of four psychiatric case-finding instruments in a Welsh community. Social Psychiatry and Psychiatric Epidemiology. 2000, 35: 569-575. 10.1007/s001270050281.CrossRefPubMed
16.
go back to reference Perenboom R, Oudshoorn K, van Herten L, Hoeymans N, Bijl R: Life-expectancy in good mental health: establishing cut-offs for the MHI-5 and GHQ-12 (in Dutch). Leiden: TNO-report. 2000 Perenboom R, Oudshoorn K, van Herten L, Hoeymans N, Bijl R: Life-expectancy in good mental health: establishing cut-offs for the MHI-5 and GHQ-12 (in Dutch). Leiden: TNO-report. 2000
17.
go back to reference Rumpf H, Meyer C, Hapke U, John U: Screening for mental health: validity of the MHI-5 using DSM-IV Axis 1 psychiatric disorders as gold standard. Psychiatry Research. 2001, 105: 243-253. 10.1016/S0165-1781(01)00329-8.CrossRefPubMed Rumpf H, Meyer C, Hapke U, John U: Screening for mental health: validity of the MHI-5 using DSM-IV Axis 1 psychiatric disorders as gold standard. Psychiatry Research. 2001, 105: 243-253. 10.1016/S0165-1781(01)00329-8.CrossRefPubMed
18.
go back to reference Strand BH, Dalgard OS, Tambs K, Rognerund M: Measuring the mental health status of the Norwegian population: a comparison of the instruments SCL-25, SCL-10, SCL-5 and MHI-5 (SF-36). Nordic Journal of Psychiatry. 2003, 57 (2): 113-118. 10.1080/08039480310000932.CrossRefPubMed Strand BH, Dalgard OS, Tambs K, Rognerund M: Measuring the mental health status of the Norwegian population: a comparison of the instruments SCL-25, SCL-10, SCL-5 and MHI-5 (SF-36). Nordic Journal of Psychiatry. 2003, 57 (2): 113-118. 10.1080/08039480310000932.CrossRefPubMed
19.
go back to reference Furukawa T, Goldberg D, Rabe-Hesketh S, Ustun T: Stratum-specific likelihood ratios of two versions of the General Health Questionnaire. Psychological Medicine. 2001, 31: 519-529.CrossRefPubMed Furukawa T, Goldberg D, Rabe-Hesketh S, Ustun T: Stratum-specific likelihood ratios of two versions of the General Health Questionnaire. Psychological Medicine. 2001, 31: 519-529.CrossRefPubMed
20.
go back to reference Gilbody S, House A, Sheldon T: Routinely administered questionnaires for depression and anxiety: systematic review. British Medical Journal. 2001, 322: 406-409. 10.1136/bmj.322.7283.406.CrossRefPubMedPubMedCentral Gilbody S, House A, Sheldon T: Routinely administered questionnaires for depression and anxiety: systematic review. British Medical Journal. 2001, 322: 406-409. 10.1136/bmj.322.7283.406.CrossRefPubMedPubMedCentral
21.
go back to reference Gilbody S, House A, Sheldon T: Screening and case finding instruments for depression. The Cochrane Database of Systematic Reviews. 2005, Wiley Gilbody S, House A, Sheldon T: Screening and case finding instruments for depression. The Cochrane Database of Systematic Reviews. 2005, Wiley
22.
go back to reference Keller S, Ware J, Gandek B, Aaronson N, Alonso J, Giovanni A, Bjorner J, Brazier J, Bullinger M, Fukuhara S, Kaasa S, Leplege A, Sanson-Fisher R, Sullivan M, Wood-Dauphine S: Testing the equivalence of translations of widely used response choice labels: results from the IQOLA project. Journal of Clinical Epidemiology. 1998, 51: 933-944. 10.1016/S0895-4356(98)00084-5.CrossRefPubMed Keller S, Ware J, Gandek B, Aaronson N, Alonso J, Giovanni A, Bjorner J, Brazier J, Bullinger M, Fukuhara S, Kaasa S, Leplege A, Sanson-Fisher R, Sullivan M, Wood-Dauphine S: Testing the equivalence of translations of widely used response choice labels: results from the IQOLA project. Journal of Clinical Epidemiology. 1998, 51: 933-944. 10.1016/S0895-4356(98)00084-5.CrossRefPubMed
Metadata
Title
Evaluating cutpoints for the MHI-5 and MCS using the GHQ-12: a comparison of five different methods
Authors
Mark J Kelly
Frank D Dunstan
Keith Lloyd
David L Fone
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2008
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-8-10

Other articles of this Issue 1/2008

BMC Psychiatry 1/2008 Go to the issue