Skip to main content
Top
Published in: BMC Psychiatry 1/2017

Open Access 01-12-2017 | Research article

Measurement invariance testing of the PHQ-9 in a multi-ethnic population in Europe: the HELIUS study

Authors: Henrike Galenkamp, Karien Stronks, Marieke B. Snijder, Eske M. Derks

Published in: BMC Psychiatry | Issue 1/2017

Login to get access

Abstract

Background

In Western European countries, the prevalence of depressive symptoms is higher among ethnic minority groups, compared to the host population. We explored whether these inequalities reflect variance in the way depressive symptoms are measured, by investigating whether items of the PHQ-9 measure the same underlying construct in six ethnic groups in the Netherlands.

Methods

A total of 23,182 men and women aged 18–70 of Dutch, South-Asian Surinamese, African Surinamese, Ghanaian, Turkish or Moroccan origin were included in the HELIUS study and had answered to at least one of the PHQ-9 items. We conducted multiple group confirmatory factor analyses (MGCFA), with increasingly stringent model constraints (i.e. assessing Configural, Metric, Strong and Strict measurement invariance (MI)), and regression analysis, to confirm comparability of PHQ-9 items across ethnic groups.

Results

A one-factor model, where all nine items reflect a single underlying construct, showed acceptable model fit and was used for MI testing. In each subsequent step, change in goodness-of-fit measures did not exceed 0.015 (RMSEA) or 0.01 (CFI). Moreover, strict invariance models showed good or acceptable model fit (Men: RMSEA = 0.050; CFI = 0.985; Women: RMSEA = 0.058; CFI = 0.979), indicating between-group equality of item clusters, factor loadings, item thresholds and residual variances. Finally, regression analysis did not indicate potential ethnicity-related differential item functioning (DIF) of the PHQ-9.

Conclusions

This study provides evidence of measurement invariance of the PHQ-9 regarding ethnicity, implying that the observed inequalities in depressive symptoms cannot be attributed to DIF.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJL, Vos T, Whiteford HA. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11):e1001547.CrossRefPubMedPubMedCentral Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJL, Vos T, Whiteford HA. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11):e1001547.CrossRefPubMedPubMedCentral
2.
go back to reference Lorant V, Deliège D, Eaton W, Robert A, Philippot P, Ansseau M. Socioeconomic inequalities in depression: a meta-analysis. Am J Epidemiol. 2003;157(2):98–112.CrossRefPubMed Lorant V, Deliège D, Eaton W, Robert A, Philippot P, Ansseau M. Socioeconomic inequalities in depression: a meta-analysis. Am J Epidemiol. 2003;157(2):98–112.CrossRefPubMed
3.
go back to reference Fryers T, Melzer D, Jenkins R. Social inequalities and the common mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2003;38(5):229–37.CrossRefPubMed Fryers T, Melzer D, Jenkins R. Social inequalities and the common mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2003;38(5):229–37.CrossRefPubMed
4.
go back to reference Tinghög P, Hemmingsson T, Lundberg I. To what extent may the association between immigrant status and mental illness be explained by socioeconomic factors? Soc Psychiatry Psychiatr Epidemiol. 2007;42(12):990–6.CrossRefPubMed Tinghög P, Hemmingsson T, Lundberg I. To what extent may the association between immigrant status and mental illness be explained by socioeconomic factors? Soc Psychiatry Psychiatr Epidemiol. 2007;42(12):990–6.CrossRefPubMed
5.
go back to reference de Wit MAS, Tuinebreijer WC, Dekker J, Beekman A-JTF, Gorissen WHM, Schrier AC, Penninx BWJH, Komproe IH, Verhoeff AP. Depressive and anxiety disorders in different ethnic groups. Soc Psychiatry Psychiatr Epidemiol. 2008;43(11):905–12.CrossRefPubMed de Wit MAS, Tuinebreijer WC, Dekker J, Beekman A-JTF, Gorissen WHM, Schrier AC, Penninx BWJH, Komproe IH, Verhoeff AP. Depressive and anxiety disorders in different ethnic groups. Soc Psychiatry Psychiatr Epidemiol. 2008;43(11):905–12.CrossRefPubMed
6.
go back to reference Missinne S, Bracke P. Depressive symptoms among immigrants and ethnic minorities: a population based study in 23 European countries. Soc Psychiatry Psychiatr Epidemiol. 2012;47(1):97–109.CrossRefPubMed Missinne S, Bracke P. Depressive symptoms among immigrants and ethnic minorities: a population based study in 23 European countries. Soc Psychiatry Psychiatr Epidemiol. 2012;47(1):97–109.CrossRefPubMed
7.
go back to reference Levecque K, Lodewyckx I, Vranken J. Depression and generalised anxiety in the general population in Belgium: a comparison between native and immigrant groups. J Affect Disord. 2007;97(1):229–39.CrossRefPubMed Levecque K, Lodewyckx I, Vranken J. Depression and generalised anxiety in the general population in Belgium: a comparison between native and immigrant groups. J Affect Disord. 2007;97(1):229–39.CrossRefPubMed
8.
go back to reference Rechel B, Mladovsky P, Ingleby D, Mackenbach JP, McKee M. Migration and health in an increasingly diverse Europe. Lancet. 2013;381(9873):1235–45.CrossRefPubMed Rechel B, Mladovsky P, Ingleby D, Mackenbach JP, McKee M. Migration and health in an increasingly diverse Europe. Lancet. 2013;381(9873):1235–45.CrossRefPubMed
9.
go back to reference Ikram UZ, Snijder MB, Fassaert TJL, Schene AH, Kunst AE, Stronks K. The contribution of perceived ethnic discrimination to the prevalence of depression. The European Journal of Public Health. 2015;25(2):243–8.CrossRefPubMed Ikram UZ, Snijder MB, Fassaert TJL, Schene AH, Kunst AE, Stronks K. The contribution of perceived ethnic discrimination to the prevalence of depression. The European Journal of Public Health. 2015;25(2):243–8.CrossRefPubMed
11.
go back to reference Bhugra D. Migration and depression. Acta Psychiatr Scand. 2003;108:67–72.CrossRef Bhugra D. Migration and depression. Acta Psychiatr Scand. 2003;108:67–72.CrossRef
12.
go back to reference Agyemang C, Denktas S, Bruijnzeels M, Foets M. Validity of the single-item question on self-rated health status in first generation Turkish and Moroccans versus native Dutch in the Netherlands. Public Health. 2006;120(6):543–50.CrossRefPubMed Agyemang C, Denktas S, Bruijnzeels M, Foets M. Validity of the single-item question on self-rated health status in first generation Turkish and Moroccans versus native Dutch in the Netherlands. Public Health. 2006;120(6):543–50.CrossRefPubMed
13.
go back to reference Van der Wurff F, Beekman A, Dijkshoorn H, Spijker J, Smits C, Stek M, Verhoeff A. Prevalence and risk-factors for depression in elderly Turkish and Moroccan migrants in the Netherlands. J Affect Disord. 2004;83(1):33–41.CrossRefPubMed Van der Wurff F, Beekman A, Dijkshoorn H, Spijker J, Smits C, Stek M, Verhoeff A. Prevalence and risk-factors for depression in elderly Turkish and Moroccan migrants in the Netherlands. J Affect Disord. 2004;83(1):33–41.CrossRefPubMed
15.
go back to reference Spijker J, van der Wurff FB, Poort EC, Smits CHM, Verhoeff AP, Beekman ATF. Depression in first generation labour migrants in Western Europe: the utility of the Center for Epidemiologic Studies Depression Scale (CES-D). International Journal of Geriatric Psychiatry. 2004;19(6):538–44.CrossRefPubMed Spijker J, van der Wurff FB, Poort EC, Smits CHM, Verhoeff AP, Beekman ATF. Depression in first generation labour migrants in Western Europe: the utility of the Center for Epidemiologic Studies Depression Scale (CES-D). International Journal of Geriatric Psychiatry. 2004;19(6):538–44.CrossRefPubMed
16.
go back to reference Kirmayer LJ. Cultural variations in the clinical presentation of depression and anxiety: implications for diagnosis and treatment. J Clin Psychiatry. 2001;62:22–30.PubMed Kirmayer LJ. Cultural variations in the clinical presentation of depression and anxiety: implications for diagnosis and treatment. J Clin Psychiatry. 2001;62:22–30.PubMed
17.
go back to reference Simon GE, Goldberg DP, Von Korff M, Üstun TB. Understanding cross-national differences in depression prevalence. Psychol Med. 2002;32(04):585–94.CrossRefPubMed Simon GE, Goldberg DP, Von Korff M, Üstun TB. Understanding cross-national differences in depression prevalence. Psychol Med. 2002;32(04):585–94.CrossRefPubMed
18.
go back to reference Simon GE, VonKorff M, Piccinelli M, Fullerton C, Ormel J. An international study of the relation between somatic symptoms and depression. N Engl J Med. 1999;341(18):1329–35.CrossRefPubMed Simon GE, VonKorff M, Piccinelli M, Fullerton C, Ormel J. An international study of the relation between somatic symptoms and depression. N Engl J Med. 1999;341(18):1329–35.CrossRefPubMed
19.
go back to reference Groenvold M, Bjorner JB, Klee MC, Kreiner S. Test for item bias in a quality of life questionnaire. J Clin Epidemiol. 1995;48(6):805–16.CrossRefPubMed Groenvold M, Bjorner JB, Klee MC, Kreiner S. Test for item bias in a quality of life questionnaire. J Clin Epidemiol. 1995;48(6):805–16.CrossRefPubMed
20.
go back to reference Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78.CrossRefPubMedPubMedCentral Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78.CrossRefPubMedPubMedCentral
22.
go back to reference Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review. Gen Hosp Psychiatry. 2007;29(5):388–95.CrossRefPubMed Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review. Gen Hosp Psychiatry. 2007;29(5):388–95.CrossRefPubMed
23.
go back to reference Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.CrossRefPubMed Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.CrossRefPubMed
24.
go back to reference Teresi JA, Ramirez M, Lai J-S, Silver S. Occurrences and sources of differential item functioning (DIF) in patient-reported outcome measures: description of DIF methods, and review of measures of depression, quality of life and general health. Psychol Sci Q. 2008;50(4):538–8. Teresi JA, Ramirez M, Lai J-S, Silver S. Occurrences and sources of differential item functioning (DIF) in patient-reported outcome measures: description of DIF methods, and review of measures of depression, quality of life and general health. Psychol Sci Q. 2008;50(4):538–8.
25.
go back to reference Hirsch O, Donner-Banzhoff N, Bachmann V. Measurement equivalence of four psychological questionnaires in native-born Germans, Russian-speaking immigrants, and native-born Russians. J Transcult Nurs. 2013;24(3):225–35.CrossRefPubMed Hirsch O, Donner-Banzhoff N, Bachmann V. Measurement equivalence of four psychological questionnaires in native-born Germans, Russian-speaking immigrants, and native-born Russians. J Transcult Nurs. 2013;24(3):225–35.CrossRefPubMed
26.
go back to reference Baas KD, Cramer AO, Koeter MW, van de Lisdonk EH, van Weert HC, Schene AH. Measurement invariance with respect to ethnicity of the patient health Questionnaire-9 (PHQ-9). J Affect Disord. 2011;129(1):229–35.CrossRefPubMed Baas KD, Cramer AO, Koeter MW, van de Lisdonk EH, van Weert HC, Schene AH. Measurement invariance with respect to ethnicity of the patient health Questionnaire-9 (PHQ-9). J Affect Disord. 2011;129(1):229–35.CrossRefPubMed
27.
go back to reference Kessler RC, McGonagle KA, Swartz M, Blazer DG, Nelson CB. Sex and depression in the National Comorbidity Survey I: lifetime prevalence, chronicity and recurrence. J Affect Disord. 1993;29(2–3):85–96.CrossRefPubMed Kessler RC, McGonagle KA, Swartz M, Blazer DG, Nelson CB. Sex and depression in the National Comorbidity Survey I: lifetime prevalence, chronicity and recurrence. J Affect Disord. 1993;29(2–3):85–96.CrossRefPubMed
28.
go back to reference Nolen-Hoeksema S, Larson J, Grayson C. Explaining the gender difference in depressive symptoms. J Pers Soc Psychol. 1999;77(5):1061.CrossRefPubMed Nolen-Hoeksema S, Larson J, Grayson C. Explaining the gender difference in depressive symptoms. J Pers Soc Psychol. 1999;77(5):1061.CrossRefPubMed
29.
go back to reference Snijder MB, Galenkamp H, Prins M, Derks EM, Peters RJ, Zwinderman AH, Stronks K. Cohort Profile: the Healthy Life in an Urban Setting (HELIUS) study in Amsterdam, the Netherlands. BMJ Open. 2017. in press. Snijder MB, Galenkamp H, Prins M, Derks EM, Peters RJ, Zwinderman AH, Stronks K. Cohort Profile: the Healthy Life in an Urban Setting (HELIUS) study in Amsterdam, the Netherlands. BMJ Open. 2017. in press.
30.
go back to reference Stronks K, Snijder MB, Peters RJ, Prins M, Schene AH, Zwinderman AH. Unravelling the impact of ethnicity on health in Europe: the HELIUS study. BMC Public Health. 2013;13(1):1–10.CrossRef Stronks K, Snijder MB, Peters RJ, Prins M, Schene AH, Zwinderman AH. Unravelling the impact of ethnicity on health in Europe: the HELIUS study. BMC Public Health. 2013;13(1):1–10.CrossRef
31.
go back to reference Stronks K, Kulu-Glasgow I, Agyemang C. The utility of ‘country of birth’ for the classification of ethnic groups in health research: the Dutch experience. Ethnicity & Health. 2009;14(3):255–69.CrossRef Stronks K, Kulu-Glasgow I, Agyemang C. The utility of ‘country of birth’ for the classification of ethnic groups in health research: the Dutch experience. Ethnicity & Health. 2009;14(3):255–69.CrossRef
32.
go back to reference Crane P, Gibbons L, Willig J, Mugavero M, Lawrence S, Schumacher J, Saag M, Kitahata M, Crane H. Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item patient health questionnaire (PHQ-9). AIDS Care. 2010;22(7):874–85.CrossRefPubMedPubMedCentral Crane P, Gibbons L, Willig J, Mugavero M, Lawrence S, Schumacher J, Saag M, Kitahata M, Crane H. Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item patient health questionnaire (PHQ-9). AIDS Care. 2010;22(7):874–85.CrossRefPubMedPubMedCentral
33.
go back to reference Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL. Using the patient health questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med. 2006;21(6):547–52.CrossRefPubMedPubMedCentral Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL. Using the patient health questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med. 2006;21(6):547–52.CrossRefPubMedPubMedCentral
34.
go back to reference Forkmann T, Gauggel S, Spangenberg L, Brähler E, Glaesmer H. Dimensional assessment of depressive severity in the elderly general population: psychometric evaluation of the PHQ-9 using Rasch analysis. J Affect Disord. 2013;148(2):323–30.CrossRefPubMed Forkmann T, Gauggel S, Spangenberg L, Brähler E, Glaesmer H. Dimensional assessment of depressive severity in the elderly general population: psychometric evaluation of the PHQ-9 using Rasch analysis. J Affect Disord. 2013;148(2):323–30.CrossRefPubMed
35.
go back to reference Kendel F, Wirtz M, Dunkel A, Lehmkuhl E, Hetzer R, Regitz-Zagrosek V. Screening for depression: Rasch analysis of the dimensional structure of the PHQ-9 and the HADS-D. J Affect Disord. 2010;122(3):241–6.CrossRefPubMed Kendel F, Wirtz M, Dunkel A, Lehmkuhl E, Hetzer R, Regitz-Zagrosek V. Screening for depression: Rasch analysis of the dimensional structure of the PHQ-9 and the HADS-D. J Affect Disord. 2010;122(3):241–6.CrossRefPubMed
36.
go back to reference Beard C, Hsu K, Rifkin L, Busch A, Björgvinsson T. Validation of the PHQ-9 in a psychiatric sample. J Affect Disord. 2016;193:267–73.CrossRefPubMed Beard C, Hsu K, Rifkin L, Busch A, Björgvinsson T. Validation of the PHQ-9 in a psychiatric sample. J Affect Disord. 2016;193:267–73.CrossRefPubMed
37.
go back to reference Elhai JD, Contractor AA, Tamburrino M, Fine TH, Prescott MR, Shirley E, Chan PK, Slembarski R, Liberzon I, Galea S. The factor structure of major depression symptoms: a test of four competing models using the patient health Questionnaire-9. Psychiatry Res. 2012;199(3):169–73.CrossRefPubMed Elhai JD, Contractor AA, Tamburrino M, Fine TH, Prescott MR, Shirley E, Chan PK, Slembarski R, Liberzon I, Galea S. The factor structure of major depression symptoms: a test of four competing models using the patient health Questionnaire-9. Psychiatry Res. 2012;199(3):169–73.CrossRefPubMed
38.
go back to reference Muthén LKM, B. O. Mplus User’s guide. Seventh edition. In. Muthén & Muthén: Los Angeles, CA; 1998-2015. Muthén LKM, B. O. Mplus User’s guide. Seventh edition. In. Muthén & Muthén: Los Angeles, CA; 1998-2015.
39.
go back to reference Muthén B, Asparouhov T. Latent variable analysis with categorical outcomes: multiple-group and growth modeling in Mplus. Mplus web notes. 2002;4(5):1–22. Muthén B, Asparouhov T. Latent variable analysis with categorical outcomes: multiple-group and growth modeling in Mplus. Mplus web notes. 2002;4(5):1–22.
40.
go back to reference Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14(3):464–504.CrossRef Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14(3):464–504.CrossRef
41.
go back to reference Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55.CrossRef Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55.CrossRef
42.
go back to reference Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef
43.
go back to reference Fan X, Sivo SA. Sensitivity of fit indices to model misspecification and model types. Multivar Behav Res. 2007;42(3):509–29.CrossRef Fan X, Sivo SA. Sensitivity of fit indices to model misspecification and model types. Multivar Behav Res. 2007;42(3):509–29.CrossRef
44.
go back to reference Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods of psychological research online. 2003;8(2):23–74. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods of psychological research online. 2003;8(2):23–74.
45.
go back to reference Meade AW, Johnson EC, Braddy PW. Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol. 2008;93(3):568.CrossRefPubMed Meade AW, Johnson EC, Braddy PW. Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol. 2008;93(3):568.CrossRefPubMed
46.
go back to reference Bjorner JB, Kosinski M, Ware JE Jr. Calibration of an item pool for assessing the burden of headaches: an application of item response theory to the headache impact test (HIT™). Qual Life Res. 2003;12(8):913–33.CrossRefPubMed Bjorner JB, Kosinski M, Ware JE Jr. Calibration of an item pool for assessing the burden of headaches: an application of item response theory to the headache impact test (HIT™). Qual Life Res. 2003;12(8):913–33.CrossRefPubMed
47.
go back to reference Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New Jersey: Lawrence Erlbaum Associates; 1988. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New Jersey: Lawrence Erlbaum Associates; 1988.
48.
go back to reference Schrier AC, de Wit MAS, Rijmen F, Tuinebreijer WC, Verhoeff AP, Kupka RW, Dekker J, Beekman ATF. Similarity in depressive symptom profile in a population-based study of migrants in the Netherlands. Soc Psychiatry Psychiatr Epidemiol. 2010;45(10):941–51.CrossRefPubMed Schrier AC, de Wit MAS, Rijmen F, Tuinebreijer WC, Verhoeff AP, Kupka RW, Dekker J, Beekman ATF. Similarity in depressive symptom profile in a population-based study of migrants in the Netherlands. Soc Psychiatry Psychiatr Epidemiol. 2010;45(10):941–51.CrossRefPubMed
49.
go back to reference Stark S, Chernyshenko OS, Drasgow F. Detecting differential item functioning with confirmatory factor analysis and item response theory: toward a unified strategy. J Appl Psychol. 2006;91(6):1292.CrossRefPubMed Stark S, Chernyshenko OS, Drasgow F. Detecting differential item functioning with confirmatory factor analysis and item response theory: toward a unified strategy. J Appl Psychol. 2006;91(6):1292.CrossRefPubMed
50.
go back to reference Swinnen SGHA, Selten J-P. Mood disorders and migration. Meta-analysis. 2007;190(1):6–10. Swinnen SGHA, Selten J-P. Mood disorders and migration. Meta-analysis. 2007;190(1):6–10.
51.
go back to reference Hepner KA, Morales LS, Hays RD, Edelen MO, Miranda J. Evaluating differential item functioning of the PRIME-MD mood module among impoverished black and white women in primary care. Womens Health Issues. 2008;18(1):53–61.CrossRefPubMed Hepner KA, Morales LS, Hays RD, Edelen MO, Miranda J. Evaluating differential item functioning of the PRIME-MD mood module among impoverished black and white women in primary care. Womens Health Issues. 2008;18(1):53–61.CrossRefPubMed
Metadata
Title
Measurement invariance testing of the PHQ-9 in a multi-ethnic population in Europe: the HELIUS study
Authors
Henrike Galenkamp
Karien Stronks
Marieke B. Snijder
Eske M. Derks
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2017
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-017-1506-9

Other articles of this Issue 1/2017

BMC Psychiatry 1/2017 Go to the issue