Skip to main content
Top
Published in: Journal of Occupational Rehabilitation 2/2016

Open Access 01-06-2016

Validation of the Patient Health Questionnaire-9 for Major Depressive Disorder in the Occupational Health Setting

Authors: D. Volker, M. C. Zijlstra-Vlasveld, E. P. M. Brouwers, W. A. Homans, W. H. M. Emons, C. M. van der Feltz-Cornelis

Published in: Journal of Occupational Rehabilitation | Issue 2/2016

Login to get access

Abstract

Purpose Because of the increased risk of long-term sickness leave for employees with a major depressive disorder (MDD), it is important for occupational health professionals to recognize depression in a timely manner. The Patient Health Questionnaire-9 (PHQ-9) has proven to be a reliable and valid instrument for screening MDD, but has not been validated in the occupational health setting. The aim of this study was to validate the PHQ-9 for MDD within a population of employees on sickness leave by using the MINI-International Neuropsychiatric Interview (MINI) as a gold standard. Methods Participants were recruited in collaboration with the occupational health service. The study sample consisted of 170 employees on sickness leave between 4 and 26 weeks who completed the PHQ-9 and were evaluated with the MINI by telephone. Sensitivity, specificity, positive and negative predictive value, efficiency and 95 % confidence intervals (95 % CIs) were calculated for all possible cut-off values. A receiver operator characteristics (ROC) analysis was computed for PHQ-9 score versus the MINI. Results The optimal cut-off value of the PHQ-9 was 10. This resulted in a sensitivity of 86.1 % [95 % CI (69.7–94.8)] and a specificity of 78.4 % [95 % CI (70.2–84.8)]. Based on the ROC analysis, the area under the curve for the PHQ-9 was 0.90 [SE = 0.02; 95 % CI (0.85–0.94)]. Conclusion The PHQ-9 shows good sensitivity and specificity as a screener for MDD within a population of employees on sickness leave.
Literature
1.
go back to reference Laitinen-Krispijn S, Bijl RV. Mental disorders and employee sickness absence: the NEMESIS study. Netherlands Mental Health Survey and Incidence Study. Soc Psychiatry Psychiatr Epidemiol. 2000;35(2):71–7.CrossRefPubMed Laitinen-Krispijn S, Bijl RV. Mental disorders and employee sickness absence: the NEMESIS study. Netherlands Mental Health Survey and Incidence Study. Soc Psychiatry Psychiatr Epidemiol. 2000;35(2):71–7.CrossRefPubMed
3.
go back to reference Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de Graaf R, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy Econ. 2006;9(4):193–200.PubMed Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de Graaf R, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy Econ. 2006;9(4):193–200.PubMed
4.
go back to reference Plaisier I, Beekman ATF, de Graaf R, Smit JH, van Dyck R, Penninx BWJH. Work functioning in persons with depressive and anxiety disorders: the role of specific psychopathological characteristics. J Affect Disord. 2010;125(1–3):198–206.CrossRefPubMed Plaisier I, Beekman ATF, de Graaf R, Smit JH, van Dyck R, Penninx BWJH. Work functioning in persons with depressive and anxiety disorders: the role of specific psychopathological characteristics. J Affect Disord. 2010;125(1–3):198–206.CrossRefPubMed
5.
go back to reference Vlasveld MC, van der Feltz-Cornelis CM, Bultmann U, Beekman AT, van Mechelen W, Hoedeman R, et al. Predicting return to work in workers with all-cause sickness absence greater than 4 weeks: a prospective cohort study. J Occup Rehabil. 2011;22(1):118–26.CrossRefPubMedCentral Vlasveld MC, van der Feltz-Cornelis CM, Bultmann U, Beekman AT, van Mechelen W, Hoedeman R, et al. Predicting return to work in workers with all-cause sickness absence greater than 4 weeks: a prospective cohort study. J Occup Rehabil. 2011;22(1):118–26.CrossRefPubMedCentral
7.
go back to reference Lecrubier Y. Widespread underrecognition and undertreatment of anxiety and mood disorders: results from 3 European studies. J Clin Psychiatry. 2007;68(Suppl 2):36–41.PubMed Lecrubier Y. Widespread underrecognition and undertreatment of anxiety and mood disorders: results from 3 European studies. J Clin Psychiatry. 2007;68(Suppl 2):36–41.PubMed
8.
go back to reference Piek E, Nolen WA, Van der Meer K, Joling KJ, Kollen BJ, Penninx BWJH, et al. Determinants of (non-) recognition of depression by general practitioners: results of the Netherlands study of depression and anxiety. J Affect Disord. 2012;138(3):397–404.CrossRefPubMed Piek E, Nolen WA, Van der Meer K, Joling KJ, Kollen BJ, Penninx BWJH, et al. Determinants of (non-) recognition of depression by general practitioners: results of the Netherlands study of depression and anxiety. J Affect Disord. 2012;138(3):397–404.CrossRefPubMed
9.
go back to reference Spitzer RL, Williams JB, Kroenke K, Linzer M, deGruy FV, Hahn SR, et al. Utility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study. J Am Med Assoc. 1994;272(22):1749–56.CrossRef Spitzer RL, Williams JB, Kroenke K, Linzer M, deGruy FV, Hahn SR, et al. Utility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study. J Am Med Assoc. 1994;272(22):1749–56.CrossRef
11.
go back to reference Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602.CrossRefPubMedPubMedCentral Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602.CrossRefPubMedPubMedCentral
12.
go back to reference Kroenke K, Spitzer RL, Williams JBW, Löwe B. The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32:345–59.CrossRefPubMed Kroenke K, Spitzer RL, Williams JBW, Löwe B. The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32:345–59.CrossRefPubMed
13.
go back to reference Zuithoff NPA, Vergouwe Y, King M, Nazareth I, van Wezep MJ, Moons KGM, et al. The Patient Health Questionnaire-9 for detection of major depressive disorder in primary care: consequences of current thresholds in a crosssectional study. BMC Family Pract. 2010;11:98–104.CrossRef Zuithoff NPA, Vergouwe Y, King M, Nazareth I, van Wezep MJ, Moons KGM, et al. The Patient Health Questionnaire-9 for detection of major depressive disorder in primary care: consequences of current thresholds in a crosssectional study. BMC Family Pract. 2010;11:98–104.CrossRef
14.
go back to reference Lowe B, Kroenke K, Herzog W, Grafe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J Affect Disord. 2004;81(1):61–6.CrossRefPubMed Lowe B, Kroenke K, Herzog W, Grafe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J Affect Disord. 2004;81(1):61–6.CrossRefPubMed
15.
go back to reference Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. Can Med Assoc J. 2012;184(3):191–6.CrossRef Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. Can Med Assoc J. 2012;184(3):191–6.CrossRef
16.
go back to reference van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res. 2010;10:235–40.CrossRefPubMedPubMedCentral van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res. 2010;10:235–40.CrossRefPubMedPubMedCentral
17.
go back to reference Bowling A. What things are important in people’s lives? A survey of the public’s judgements to inform scales of health related quality of life. Soc Sci Med. 1995;41(10):1447–62.CrossRefPubMed Bowling A. What things are important in people’s lives? A survey of the public’s judgements to inform scales of health related quality of life. Soc Sci Med. 1995;41(10):1447–62.CrossRefPubMed
18.
go back to reference Bilsker D, Wiseman S, Gilbert M. Managing depression-related occupational disability: a pragmatic approach. Can J Psychiatry. 2006;51(2):76–83.PubMed Bilsker D, Wiseman S, Gilbert M. Managing depression-related occupational disability: a pragmatic approach. Can J Psychiatry. 2006;51(2):76–83.PubMed
19.
go back to reference Volker D, Zijlstra-Vlasveld MC, Brouwers EPM, van Lomwel AGC, van der Feltz-Cornelis CM. Return-to-work self-efficacy and actual return to work among long-term sick-listed employees. J Occup Rehabil. 2015;25(2):423–31.CrossRefPubMed Volker D, Zijlstra-Vlasveld MC, Brouwers EPM, van Lomwel AGC, van der Feltz-Cornelis CM. Return-to-work self-efficacy and actual return to work among long-term sick-listed employees. J Occup Rehabil. 2015;25(2):423–31.CrossRefPubMed
20.
go back to reference Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33.PubMed Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33.PubMed
21.
go back to reference Volker D, Vlasveld MC, Anema JR, Beekman ATF, Hakkaart-van Roijen L, Brouwers EPM, et al. Blended E-health module on return to work embedded in collaborative occupational health care for common mental disorders: design of a cluster randomized controlled trial. Neuropsychiatr Dis Treat. 2013;9:529–37.PubMedPubMedCentral Volker D, Vlasveld MC, Anema JR, Beekman ATF, Hakkaart-van Roijen L, Brouwers EPM, et al. Blended E-health module on return to work embedded in collaborative occupational health care for common mental disorders: design of a cluster randomized controlled trial. Neuropsychiatr Dis Treat. 2013;9:529–37.PubMedPubMedCentral
22.
go back to reference van Vliet IM, de Beurs E. Het Mini Internationaal Neuropsychiatrisch Interview (MINI). Een kort gestructureerd diagnostisch psychiatrisch interview voor DSM-IV en ICD-10-stoornissen. Tijdschrift voor Psychiatrie. 2007;49(6):393–7.PubMed van Vliet IM, de Beurs E. Het Mini Internationaal Neuropsychiatrisch Interview (MINI). Een kort gestructureerd diagnostisch psychiatrisch interview voor DSM-IV en ICD-10-stoornissen. Tijdschrift voor Psychiatrie. 2007;49(6):393–7.PubMed
23.
go back to reference Devellis RF. Scale development: theory and applications. 2nd ed. Newbury Park, CA: Sage Publications; 2003. Devellis RF. Scale development: theory and applications. 2nd ed. Newbury Park, CA: Sage Publications; 2003.
24.
go back to reference Cohen J. Statistical power analysis for the behavioral science. 2nd ed. Hillsdale: Lawrence Erlbaum Associates Inc; 1988. Cohen J. Statistical power analysis for the behavioral science. 2nd ed. Hillsdale: Lawrence Erlbaum Associates Inc; 1988.
25.
go back to reference Agresti A, Coull BA. Approximate is better than “Exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26. Agresti A, Coull BA. Approximate is better than “Exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26.
26.
go back to reference de Vroege L, Emons WHM, Sijtsma K, Hoedeman R, van der Feltz-Cornelis CM. Validation of the 4DSQ somatization subscale in the occupational health care setting as a screener. J Occup Rehabil. 2014. doi:10.1007/s10926-014-9529-2. de Vroege L, Emons WHM, Sijtsma K, Hoedeman R, van der Feltz-Cornelis CM. Validation of the 4DSQ somatization subscale in the occupational health care setting as a screener. J Occup Rehabil. 2014. doi:10.​1007/​s10926-014-9529-2.
27.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36.CrossRefPubMed
28.
go back to reference IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp, 2013. IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp, 2013.
30.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
Metadata
Title
Validation of the Patient Health Questionnaire-9 for Major Depressive Disorder in the Occupational Health Setting
Authors
D. Volker
M. C. Zijlstra-Vlasveld
E. P. M. Brouwers
W. A. Homans
W. H. M. Emons
C. M. van der Feltz-Cornelis
Publication date
01-06-2016
Publisher
Springer US
Published in
Journal of Occupational Rehabilitation / Issue 2/2016
Print ISSN: 1053-0487
Electronic ISSN: 1573-3688
DOI
https://doi.org/10.1007/s10926-015-9607-0

Other articles of this Issue 2/2016

Journal of Occupational Rehabilitation 2/2016 Go to the issue