Skip to main content
Top
Published in: Social Psychiatry and Psychiatric Epidemiology 4/2015

01-04-2015 | Invited Reviews

Factors of psychological distress: clinical value, measurement substance, and methodological artefacts

Authors: J. R. Böhnke, T. J. Croudace

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 4/2015

Login to get access

Abstract

Purpose

Psychometric models and statistical techniques are cornerstones of research into latent structures of specific psychopathology and general mental health. We discuss “pivot points” for future research efforts from a psychometric epidemiology perspective, emphasising sampling and selection processes of both indicators that guide data collection as well as samples that are confronted with them.

Method

First, we discuss how a theoretical model of psychopathology determines which empirical indicators (questions, diagnoses, etc.) and modelling methods are appropriate to test its implications. Second, we deal with how different research designs introduce different (co-)variances between indicators, potentially leading to a different understanding of latent structures. Third, we discuss widening the range of statistical models available within the “psychometrics class”: the inclusion of categorical approaches can help to enlighten the debate on the structure of psychopathology and agreement on a minimal set of models might lead to greater convergence between studies. Fourth, we deal with aspects of methodology that introduce spurious (co-)variance in latent structure analysis (response styles, clustered data) and differential item functioning to gather more detailed information and to guard against over-generalisation of results, which renders assessments unfair.

Conclusions

Building on established insights, future research efforts should be more explicit about their theoretical understanding of psychopathology and how the analysis of a given indicator–respondent set informs this theoretical model. A coherent treatment of theoretical assumptions, indicators, and samples holds the key to building a comprehensive account of the latent structures of different types of psychopathology and mental health in general.
Footnotes
1
This is in line with what is usually considered to be a  “psychometric assessment”: a situation in which itemised categorical information is gathered on respondents to provide information on a number of non-observed (“latent”) properties with the aim of reaching a (often quantitative) statement about individual differences.
 
2
A topic that we ignore in this section comprises the differences between self-reported symptoms, observer-rated symptoms, and clinician-assessed diagnoses. In our view, the methodological challenges with respect to our discussion are the same across all three assessment strategies, while we agree that depending on the background of the reader these might have very different epistemological values for the debate on the structure of psychopathology.
 
Literature
1.
go back to reference Brodbeck J, Stulz N, Itten S, Regli D, Znoj H, Caspar F (2014) The structure of psychopathological symptoms and the associations with DSM-diagnoses in treatment seeking individuals. Compr Psychiatry 55:714–726PubMed Brodbeck J, Stulz N, Itten S, Regli D, Znoj H, Caspar F (2014) The structure of psychopathological symptoms and the associations with DSM-diagnoses in treatment seeking individuals. Compr Psychiatry 55:714–726PubMed
2.
go back to reference Carragher N, Krueger RF, Eaton NR, Slade T (2015). Disorders without borders: current and future directions in the meta-structure of mental disorders. Soc Psychiatry Psychiatr Epidemiol 50:339–350 Carragher N, Krueger RF, Eaton NR, Slade T (2015). Disorders without borders: current and future directions in the meta-structure of mental disorders. Soc Psychiatry Psychiatr Epidemiol 50:339–350
3.
go back to reference Eaton NR, Rodriguez-Seijas C, Carragher N, Krueger RF (2015) Transdiagnostic factors of psychopathology and substance use disorders: a review. Soc Psychiatry Psychiatr Epidemiol 50:171–182PubMed Eaton NR, Rodriguez-Seijas C, Carragher N, Krueger RF (2015) Transdiagnostic factors of psychopathology and substance use disorders: a review. Soc Psychiatry Psychiatr Epidemiol 50:171–182PubMed
4.
go back to reference Lahey BB, Waldman ID (2012) Annual research review: phenotypic and causal structure of conduct disorder in the broader context of prevalent forms of psychopathology. J Child Psychol Psychiatry 53:536–557PubMedCentralPubMed Lahey BB, Waldman ID (2012) Annual research review: phenotypic and causal structure of conduct disorder in the broader context of prevalent forms of psychopathology. J Child Psychol Psychiatry 53:536–557PubMedCentralPubMed
5.
go back to reference Markon KE, Chmielewski M, Miller CJ (2011) The reliability and validity of discrete and continuous measures of psychopathology: a quantitative review. Psychol Bull 137:856–879PubMed Markon KE, Chmielewski M, Miller CJ (2011) The reliability and validity of discrete and continuous measures of psychopathology: a quantitative review. Psychol Bull 137:856–879PubMed
6.
go back to reference Goldberg D (2015) Psychopathology and classification in psychiatry. Soc Psychiatry Psychiatr Epidemiol 50:1–5PubMed Goldberg D (2015) Psychopathology and classification in psychiatry. Soc Psychiatry Psychiatr Epidemiol 50:1–5PubMed
7.
go back to reference Krueger RF, Markon KE (2014) The role of the DSM-5 personality trait model in moving toward a quantitative and empirically based approach to classifying personality and psychopathology. Annu Rev Clin Psychol 10:477–501PubMed Krueger RF, Markon KE (2014) The role of the DSM-5 personality trait model in moving toward a quantitative and empirically based approach to classifying personality and psychopathology. Annu Rev Clin Psychol 10:477–501PubMed
8.
go back to reference Brown TA, Barlow DH (2009) A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess 21:256–271PubMedCentralPubMed Brown TA, Barlow DH (2009) A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess 21:256–271PubMedCentralPubMed
9.
go back to reference Brown TA, Chorpita BF, Barlow DH (1998) Structural relationships among dimensions of the DSM-IV anxiety and mood disorders and dimensions of negative affect, positive affect, and autonomic arousal. J Abnorm Psychol 107:179–192PubMed Brown TA, Chorpita BF, Barlow DH (1998) Structural relationships among dimensions of the DSM-IV anxiety and mood disorders and dimensions of negative affect, positive affect, and autonomic arousal. J Abnorm Psychol 107:179–192PubMed
10.
go back to reference Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington HL, Israel S et al (2014) The p Factor: one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci 2:119–137PubMedCentralPubMed Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington HL, Israel S et al (2014) The p Factor: one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci 2:119–137PubMedCentralPubMed
11.
12.
go back to reference Reise SP, Bonifay WE, Haviland MG (2013) Scoring and modeling psychological measures in the presence of multidimensionality. J Pers Assess 95:129–140PubMed Reise SP, Bonifay WE, Haviland MG (2013) Scoring and modeling psychological measures in the presence of multidimensionality. J Pers Assess 95:129–140PubMed
13.
go back to reference Castonguay LG, Barkham M, Lutz W, McAleavey A (2013) Practice-oriented research: approaches and applications. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 6th edn. Wiley, Hoboken, pp 85–133 Castonguay LG, Barkham M, Lutz W, McAleavey A (2013) Practice-oriented research: approaches and applications. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 6th edn. Wiley, Hoboken, pp 85–133
14.
go back to reference Kamphuis JH, Noordhof A (2009) On categorical diagnoses in “DSM-V”: cutting dimensions at useful points? Psychol Assess 21:294–301PubMed Kamphuis JH, Noordhof A (2009) On categorical diagnoses in “DSM-V”: cutting dimensions at useful points? Psychol Assess 21:294–301PubMed
15.
go back to reference Lutz W, Stulz N, Martinovich Z, Leon SC, Saunders SM (2009) Methodological background of decision rules and feedback tools for outcomes management in psychotherapy. Psychother Res 19:502–510PubMed Lutz W, Stulz N, Martinovich Z, Leon SC, Saunders SM (2009) Methodological background of decision rules and feedback tools for outcomes management in psychotherapy. Psychother Res 19:502–510PubMed
16.
go back to reference Edwards JR (2011) The fallacy of formative measurement. Organ Res Methods 14:370–388 Edwards JR (2011) The fallacy of formative measurement. Organ Res Methods 14:370–388
17.
go back to reference Jarvis CB, MacKenzie SB, Podsakoff PM (2003) A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J Consum Res 30:199–218 Jarvis CB, MacKenzie SB, Podsakoff PM (2003) A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J Consum Res 30:199–218
18.
go back to reference Willoughby M, Holochwost SJ, Blanton ZE, Blair CB (2014) Executive functions: formative versus reflective measurement. Measurement 12:69–95 Willoughby M, Holochwost SJ, Blanton ZE, Blair CB (2014) Executive functions: formative versus reflective measurement. Measurement 12:69–95
19.
go back to reference Borsboom D, Mellenbergh GJ, van Heerden J (2003) The theoretical status of latent variables. Psychol Rev 110:203–219PubMed Borsboom D, Mellenbergh GJ, van Heerden J (2003) The theoretical status of latent variables. Psychol Rev 110:203–219PubMed
20.
go back to reference Cohen P, Cohen J, Teresi J, Marchi M, Velez CN (1990) Problems in the measurement of latent variables in structural equations causal models. Appl Psychol Meas 14:183–196 Cohen P, Cohen J, Teresi J, Marchi M, Velez CN (1990) Problems in the measurement of latent variables in structural equations causal models. Appl Psychol Meas 14:183–196
21.
go back to reference Gaskin CJ, Happell B (2014) On exploratory factor analysis: a review of recent evidence, an assessment of current practice, and recommendations for future use. Int J Nurs Stud 51:511–521PubMed Gaskin CJ, Happell B (2014) On exploratory factor analysis: a review of recent evidence, an assessment of current practice, and recommendations for future use. Int J Nurs Stud 51:511–521PubMed
22.
go back to reference Wright AGC, Krueger RF, Hobbs MJ, Markon KE, Eaton NR, Slade T (2013) The structure of psychopathology: toward an expanded quantitative empirical model. J Abnorm Psychol 122:281–294PubMedCentralPubMed Wright AGC, Krueger RF, Hobbs MJ, Markon KE, Eaton NR, Slade T (2013) The structure of psychopathology: toward an expanded quantitative empirical model. J Abnorm Psychol 122:281–294PubMedCentralPubMed
24.
go back to reference Markon KE (2010) Modeling psychopathology structure: a symptom-level analysis of Axis I and II disorders. Psychol Med 40:273–288PubMed Markon KE (2010) Modeling psychopathology structure: a symptom-level analysis of Axis I and II disorders. Psychol Med 40:273–288PubMed
25.
go back to reference Cliff N, Hamburger CD (1967) The study of sampling errors in factor analysis by means of artificial experiments. Psychol Bull 68:430–445PubMed Cliff N, Hamburger CD (1967) The study of sampling errors in factor analysis by means of artificial experiments. Psychol Bull 68:430–445PubMed
26.
go back to reference Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ (1999) Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods 4:272–299 Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ (1999) Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods 4:272–299
27.
go back to reference Böhnke JR, Lutz W, Delgadillo J (2014) Negative affectivity as a transdiagnostic factor in patients with common mental disorders. J Affect Disord 166:270–278PubMed Böhnke JR, Lutz W, Delgadillo J (2014) Negative affectivity as a transdiagnostic factor in patients with common mental disorders. J Affect Disord 166:270–278PubMed
28.
go back to reference Fairhurst C, Böhnke JR, Gabe R, Croudace TJ, Tober G, Raistrick D (2014) Factor analysis of treatment outcomes from a UK specialist addiction service: relationship between the Leeds Dependence Questionnaire, Social Satisfaction Questionnaire and 10-item Clinical Outcomes in Routine Evaluation. Drug Alcohol Rev 33:643–650PubMedCentralPubMed Fairhurst C, Böhnke JR, Gabe R, Croudace TJ, Tober G, Raistrick D (2014) Factor analysis of treatment outcomes from a UK specialist addiction service: relationship between the Leeds Dependence Questionnaire, Social Satisfaction Questionnaire and 10-item Clinical Outcomes in Routine Evaluation. Drug Alcohol Rev 33:643–650PubMedCentralPubMed
29.
go back to reference Paap MCS, Meijer RR, Cohen-Kettenis PT, Richter-Appelt H, de Cuypere G, Kreukels BPC et al (2012) Why the factorial structure of the SCL-90-R is unstable: comparing patient groups with different levels of psychological distress using Mokken Scale Analysis. Psychiatry Res 200:819–826PubMed Paap MCS, Meijer RR, Cohen-Kettenis PT, Richter-Appelt H, de Cuypere G, Kreukels BPC et al (2012) Why the factorial structure of the SCL-90-R is unstable: comparing patient groups with different levels of psychological distress using Mokken Scale Analysis. Psychiatry Res 200:819–826PubMed
30.
go back to reference Eaton NR, Krueger RF, Keyes KM, Wall M, Hasin DS, Markon KE et al (2013) The structure and predictive validity of the internalizing disorders. J Abnorm Psychol 122:86–92PubMedCentralPubMed Eaton NR, Krueger RF, Keyes KM, Wall M, Hasin DS, Markon KE et al (2013) The structure and predictive validity of the internalizing disorders. J Abnorm Psychol 122:86–92PubMedCentralPubMed
31.
go back to reference El-Gabalawy R, Tsai J, Harpaz-Rotem I, Hoff R, Sareen J, Pietrzak RH (2013) Predominant typologies of psychopathology in the United States: a latent class analysis. J Psychiatr Res 47:1649–1657PubMed El-Gabalawy R, Tsai J, Harpaz-Rotem I, Hoff R, Sareen J, Pietrzak RH (2013) Predominant typologies of psychopathology in the United States: a latent class analysis. J Psychiatr Res 47:1649–1657PubMed
32.
go back to reference Murphy J, Shevlin M, Adamson G (2007) A latent class analysis of positive psychosis symptoms based on the British Psychiatric Morbidity Survey. Personal Individ Differ 42:1491–1502 Murphy J, Shevlin M, Adamson G (2007) A latent class analysis of positive psychosis symptoms based on the British Psychiatric Morbidity Survey. Personal Individ Differ 42:1491–1502
33.
go back to reference Vaidyanathan U, Patrick CJ, Iacono WG (2011) Patterns of comorbidity among mental disorders: a person-centered approach. Compr Psychiatry 52:527–535PubMedCentralPubMed Vaidyanathan U, Patrick CJ, Iacono WG (2011) Patterns of comorbidity among mental disorders: a person-centered approach. Compr Psychiatry 52:527–535PubMedCentralPubMed
34.
go back to reference Carragher N, Krueger R, Eaton N, Markon K, Keyes K, Blanco C et al (2014) ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Soc Psychiatry Psychiatr Epidemiol 49:1307–1317PubMedCentralPubMed Carragher N, Krueger R, Eaton N, Markon K, Keyes K, Blanco C et al (2014) ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Soc Psychiatry Psychiatr Epidemiol 49:1307–1317PubMedCentralPubMed
35.
go back to reference Böhnke JR, Lutz W (2014) Using item and test information to optimize targeted assessments of psychological distress. Assessment 21:679–693PubMed Böhnke JR, Lutz W (2014) Using item and test information to optimize targeted assessments of psychological distress. Assessment 21:679–693PubMed
36.
go back to reference McAleavey AA, Nordberg SS, Hayes JA, Castonguay LG, Locke BD, Lockard AJ (2012) Clinical validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): further evaluation and clinical applications. J Couns Psychol 59:575–590PubMed McAleavey AA, Nordberg SS, Hayes JA, Castonguay LG, Locke BD, Lockard AJ (2012) Clinical validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): further evaluation and clinical applications. J Couns Psychol 59:575–590PubMed
37.
go back to reference Lambert MJ (2013) The efficacy and effectiveness of psychotherapy. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 6th edn. Wiley, Hoboken, pp 169–218 Lambert MJ (2013) The efficacy and effectiveness of psychotherapy. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 6th edn. Wiley, Hoboken, pp 169–218
38.
go back to reference Cahill J, Barkham M, Stiles WB, Twigg E, Rees A, Hardy GE et al (2006) Convergent validity of the CORE measures with measures of depression for clients in brief cognitive therapy for depression. J Couns Psychol 53:253–259 Cahill J, Barkham M, Stiles WB, Twigg E, Rees A, Hardy GE et al (2006) Convergent validity of the CORE measures with measures of depression for clients in brief cognitive therapy for depression. J Couns Psychol 53:253–259
39.
go back to reference Raistrick D, Bradshaw J, Tober G, Weiner J, Allison J, Healey C (1994) Development of the Leeds Dependence Questionnaire (LDQ): a questionnaire to measure alcohol and opiate dependence in the context of a treatment evaluation package. Addict Abingdon Engl 89:563–572 Raistrick D, Bradshaw J, Tober G, Weiner J, Allison J, Healey C (1994) Development of the Leeds Dependence Questionnaire (LDQ): a questionnaire to measure alcohol and opiate dependence in the context of a treatment evaluation package. Addict Abingdon Engl 89:563–572
40.
go back to reference Reininghaus U, Priebe S (2012) Measuring patient-reported outcomes in psychosis: conceptual and methodological review. Br J Psychiatry 201:262–267PubMed Reininghaus U, Priebe S (2012) Measuring patient-reported outcomes in psychosis: conceptual and methodological review. Br J Psychiatry 201:262–267PubMed
41.
go back to reference Simms LJ, Prisciandaro JJ, Krueger RF, Goldberg DP (2012) The structure of depression, anxiety and somatic symptoms in primary care. Psychol Med 42:15–28PubMedCentralPubMed Simms LJ, Prisciandaro JJ, Krueger RF, Goldberg DP (2012) The structure of depression, anxiety and somatic symptoms in primary care. Psychol Med 42:15–28PubMedCentralPubMed
42.
go back to reference Derogatis LR (1993) BSI. Brief Symptom Inventory: administration, scoring, and procedures manual, 4th edn. Natl Comp Syst, Minneapolis Derogatis LR (1993) BSI. Brief Symptom Inventory: administration, scoring, and procedures manual, 4th edn. Natl Comp Syst, Minneapolis
43.
go back to reference Adam D (2013) Mental health: on the spectrum. Nature 496(7446):416–418PubMed Adam D (2013) Mental health: on the spectrum. Nature 496(7446):416–418PubMed
44.
go back to reference Craddock N, Owen MJ (2010) The Kraepelinian dichotomy—going, going… but still not gone. Br J Psychiatry 196:92–95PubMedCentralPubMed Craddock N, Owen MJ (2010) The Kraepelinian dichotomy—going, going… but still not gone. Br J Psychiatry 196:92–95PubMedCentralPubMed
45.
go back to reference Bühler J, Keller F, Läge D (2014) Activation as an overlooked factor in the BDI–II: a factor model based on core symptoms and qualitative aspects of depression. Psychol Assess 26:970–979PubMed Bühler J, Keller F, Läge D (2014) Activation as an overlooked factor in the BDI–II: a factor model based on core symptoms and qualitative aspects of depression. Psychol Assess 26:970–979PubMed
46.
go back to reference Sullivan PF, Kessler RC, Kendler KS (1998) Latent class analysis of lifetime depressive symptoms in the National Comorbidity Survey. Am J Psychiatry 155:1398–1406PubMed Sullivan PF, Kessler RC, Kendler KS (1998) Latent class analysis of lifetime depressive symptoms in the National Comorbidity Survey. Am J Psychiatry 155:1398–1406PubMed
47.
go back to reference Unick GJ, Snowden L, Hastings J (2009) Heterogeneity in comorbidity between major depressive disorder and generalized anxiety disorder and its clinical consequences. J Nerv Ment Dis 197:215–224PubMedCentralPubMed Unick GJ, Snowden L, Hastings J (2009) Heterogeneity in comorbidity between major depressive disorder and generalized anxiety disorder and its clinical consequences. J Nerv Ment Dis 197:215–224PubMedCentralPubMed
48.
go back to reference Derks EM, Allardyce J, Boks MP, Vermunt JK, Hijman R, Ophoff RA et al (2012) Kraepelin was right: a latent class analysis of symptom dimensions in patients and controls. Schizophr Bull 38:495–505PubMedCentralPubMed Derks EM, Allardyce J, Boks MP, Vermunt JK, Hijman R, Ophoff RA et al (2012) Kraepelin was right: a latent class analysis of symptom dimensions in patients and controls. Schizophr Bull 38:495–505PubMedCentralPubMed
49.
go back to reference Reininghaus U, Priebe S, Bentall RP (2013) Testing the psychopathology of psychosis: evidence for a general psychosis dimension. Schizophr Bull 39:884–895PubMedCentralPubMed Reininghaus U, Priebe S, Bentall RP (2013) Testing the psychopathology of psychosis: evidence for a general psychosis dimension. Schizophr Bull 39:884–895PubMedCentralPubMed
51.
go back to reference Cella D, Gershon R, Lai J-S, Choi S (2007) The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res 16:133–141PubMed Cella D, Gershon R, Lai J-S, Choi S (2007) The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res 16:133–141PubMed
52.
go back to reference Croudace TJ, Böhnke JR (2014) Item bank measurement of depression: will one dimension work? J Clin Epidemiol 67:4–6PubMed Croudace TJ, Böhnke JR (2014) Item bank measurement of depression: will one dimension work? J Clin Epidemiol 67:4–6PubMed
53.
go back to reference Wahl I, Löwe B, Bjorner JB, Fischer F, Langs G, Voderholzer U et al (2014) Standardization of depression measurement: a common metric was developed for 11 self-report depression measures. J Clin Epidemiol 67:73–86PubMed Wahl I, Löwe B, Bjorner JB, Fischer F, Langs G, Voderholzer U et al (2014) Standardization of depression measurement: a common metric was developed for 11 self-report depression measures. J Clin Epidemiol 67:73–86PubMed
54.
go back to reference Reininghaus U, McCabe R, Burns T, Croudace T, Priebe S (2011) Measuring patients’ views: a bifactor model of distinct patient-reported outcomes in psychosis. Psychol Med 41:277–289PubMed Reininghaus U, McCabe R, Burns T, Croudace T, Priebe S (2011) Measuring patients’ views: a bifactor model of distinct patient-reported outcomes in psychosis. Psychol Med 41:277–289PubMed
55.
go back to reference Reise SP (2012) The rediscovery of bifactor measurement models. Multivar Behav Res 47:667–696 Reise SP (2012) The rediscovery of bifactor measurement models. Multivar Behav Res 47:667–696
56.
go back to reference Blanco C, Wall MM, He J-P, Krueger RF, Olfson M, Jin CJ et al (2015) The space of common psychiatric disorders in adolescents: comorbidity structure and individual latent liabilities. J Am Acad Child Adolesc Psychiatry 54:45–52PubMed Blanco C, Wall MM, He J-P, Krueger RF, Olfson M, Jin CJ et al (2015) The space of common psychiatric disorders in adolescents: comorbidity structure and individual latent liabilities. J Am Acad Child Adolesc Psychiatry 54:45–52PubMed
57.
go back to reference Henry JD, Crawford JR (2005) The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol 44:227–239PubMed Henry JD, Crawford JR (2005) The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol 44:227–239PubMed
58.
go back to reference Page AC, Hooke GR, Morrison DL (2007) Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. Br J Clin Psychol 46:283–297PubMed Page AC, Hooke GR, Morrison DL (2007) Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. Br J Clin Psychol 46:283–297PubMed
59.
go back to reference Chen FF, Hayes A, Carver CS, Laurenceau J-P, Zhang Z (2012) Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. J Pers 80:219–251PubMed Chen FF, Hayes A, Carver CS, Laurenceau J-P, Zhang Z (2012) Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. J Pers 80:219–251PubMed
60.
go back to reference Collins LM, Lanza ST (2010) Latent class and latent transition analysis. Wiley, Hoboken Collins LM, Lanza ST (2010) Latent class and latent transition analysis. Wiley, Hoboken
61.
go back to reference Hagenaars JA, McCutcheon AL (eds) (2002) Applied latent class analysis. Cambridge University Press, Cambridge Hagenaars JA, McCutcheon AL (eds) (2002) Applied latent class analysis. Cambridge University Press, Cambridge
64.
go back to reference Sellbom M (2014) A factor mixture model approach to elaborating on offender mental health classification with the MMPI–2–RF. J Pers Assess 96:293–305PubMed Sellbom M (2014) A factor mixture model approach to elaborating on offender mental health classification with the MMPI–2–RF. J Pers Assess 96:293–305PubMed
65.
go back to reference Rost J (2001) The growing family of Rasch models. In: Boomsma A, van Duijn MAJ, Snijders TAB (eds) Essays on item response theory. Springer, New York, pp 25–42 Rost J (2001) The growing family of Rasch models. In: Boomsma A, van Duijn MAJ, Snijders TAB (eds) Essays on item response theory. Springer, New York, pp 25–42
66.
go back to reference Lubke GH, Muthén B (2005) Investigating population heterogeneity with factor mixture models. Psychol Methods 10:21–39PubMed Lubke GH, Muthén B (2005) Investigating population heterogeneity with factor mixture models. Psychol Methods 10:21–39PubMed
67.
go back to reference Hallquist MN, Wright AG (2014) Mixture modeling methods for the assessment of normal and abnormal personality, part I: cross-sectional models. J Pers Assess 96:256–268PubMedCentralPubMed Hallquist MN, Wright AG (2014) Mixture modeling methods for the assessment of normal and abnormal personality, part I: cross-sectional models. J Pers Assess 96:256–268PubMedCentralPubMed
68.
go back to reference Kim S-H, Beretvas SN, Sherry AR (2010) A validation of the factor structure of OQ-45 scores using factor mixture modeling. Meas Eval Couns Dev 42:275–295 Kim S-H, Beretvas SN, Sherry AR (2010) A validation of the factor structure of OQ-45 scores using factor mixture modeling. Meas Eval Couns Dev 42:275–295
69.
go back to reference Masyn KE, Henderson CE, Greenbaum PE (2010) Exploring the latent structures of psychological constructs in social development using the dimensional–categorical spectrum. Soc Dev 19:470–493PubMedCentralPubMed Masyn KE, Henderson CE, Greenbaum PE (2010) Exploring the latent structures of psychological constructs in social development using the dimensional–categorical spectrum. Soc Dev 19:470–493PubMedCentralPubMed
70.
go back to reference Eaton NR, Krueger RF, Docherty AR, Sponheim SR (2014) Toward a model-based approach to the clinical assessment of personality psychopathology. J Pers Assess 96:283–292PubMedCentralPubMed Eaton NR, Krueger RF, Docherty AR, Sponheim SR (2014) Toward a model-based approach to the clinical assessment of personality psychopathology. J Pers Assess 96:283–292PubMedCentralPubMed
71.
go back to reference Moors G (2003) Diagnosing response style behavior by means of a latent-class factor approach: socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Qual Quant 37:277–302 Moors G (2003) Diagnosing response style behavior by means of a latent-class factor approach: socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Qual Quant 37:277–302
72.
go back to reference Wetzel E, Böhnke JR, Carstensen CH, Ziegler M, Ostendorf F (2013) Do individual response styles matter? J Individ Differ 34:69–81 Wetzel E, Böhnke JR, Carstensen CH, Ziegler M, Ostendorf F (2013) Do individual response styles matter? J Individ Differ 34:69–81
73.
go back to reference Subramaniam M, Abdin E, Vaingankar JA, Verma S, Chong SA (2014) Latent structure of psychosis in the general population: results from the Singapore mental health study. Psychol Med 44:51–60PubMed Subramaniam M, Abdin E, Vaingankar JA, Verma S, Chong SA (2014) Latent structure of psychosis in the general population: results from the Singapore mental health study. Psychol Med 44:51–60PubMed
74.
go back to reference Stochl J, Khandaker GM, Lewis G, Perez J, Goodyer IM, Zammit S, et al. (in press) Mood, anxiety and psychotic phenomena measure a common psychopathological factor. Psychol Med. doi:10.1017/S003329171400261X Stochl J, Khandaker GM, Lewis G, Perez J, Goodyer IM, Zammit S, et al. (in press) Mood, anxiety and psychotic phenomena measure a common psychopathological factor. Psychol Med. doi:10.​1017/​S003329171400261​X
75.
go back to reference Pickles A, Croudace T (2010) Latent mixture models for multivariate and longitudinal outcomes. Stat Methods Med Res 19:271–289PubMed Pickles A, Croudace T (2010) Latent mixture models for multivariate and longitudinal outcomes. Stat Methods Med Res 19:271–289PubMed
76.
go back to reference Wright AG, Hallquist MN (2014) Mixture modeling methods for the assessment of normal and abnormal personality, part II: longitudinal models. J Pers Assess 96:269–282PubMedCentralPubMed Wright AG, Hallquist MN (2014) Mixture modeling methods for the assessment of normal and abnormal personality, part II: longitudinal models. J Pers Assess 96:269–282PubMedCentralPubMed
77.
go back to reference Podsakoff PM, MacKenzie SB, Lee J-Y, Podsakoff NP (2003) Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 88:879–903PubMed Podsakoff PM, MacKenzie SB, Lee J-Y, Podsakoff NP (2003) Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 88:879–903PubMed
78.
go back to reference Podsakoff PM, MacKenzie SB, Podsakoff NP (2012) Sources of method bias in social science research and recommendations on how to control it. Annu Rev Psychol 63:539–569PubMed Podsakoff PM, MacKenzie SB, Podsakoff NP (2012) Sources of method bias in social science research and recommendations on how to control it. Annu Rev Psychol 63:539–569PubMed
79.
go back to reference Tackett JL, Lahey BB, van Hulle C, Waldman I, Krueger RF, Rathouz PJ (2013) Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. J Abnorm Psychol 122:1142–1153PubMedCentralPubMed Tackett JL, Lahey BB, van Hulle C, Waldman I, Krueger RF, Rathouz PJ (2013) Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. J Abnorm Psychol 122:1142–1153PubMedCentralPubMed
80.
go back to reference Nisbett RE, Aronson J, Blair C, Dickens W, Flynn J, Halpern DF et al (2012) Intelligence: new findings and theoretical developments. Am Psychol 67:130–159PubMed Nisbett RE, Aronson J, Blair C, Dickens W, Flynn J, Halpern DF et al (2012) Intelligence: new findings and theoretical developments. Am Psychol 67:130–159PubMed
81.
go back to reference Just C (2011) A review of literature on the general factor of personality. Personal Individ Differ 50:765–771 Just C (2011) A review of literature on the general factor of personality. Personal Individ Differ 50:765–771
82.
go back to reference Brown A, Ford T, Deighton J, Wolpert M (2014) Satisfaction in child and adolescent mental health services: translating users’ feedback into measurement. Adm Policy Ment Health 41:434–446PubMed Brown A, Ford T, Deighton J, Wolpert M (2014) Satisfaction in child and adolescent mental health services: translating users’ feedback into measurement. Adm Policy Ment Health 41:434–446PubMed
83.
go back to reference Hafner-Fink M, Uhan S (2013) Bipolarity and/or duality of social survey measurement scales and the question-order effect. Qual Quant 47:839–852 Hafner-Fink M, Uhan S (2013) Bipolarity and/or duality of social survey measurement scales and the question-order effect. Qual Quant 47:839–852
84.
go back to reference Weijters B, De Beuckelaer A, Baumgartner H (2014) Discriminant validity where there should be none: positioning same-scale items in separated blocks of a questionnaire. Appl Psychol Meas 38:450–463 Weijters B, De Beuckelaer A, Baumgartner H (2014) Discriminant validity where there should be none: positioning same-scale items in separated blocks of a questionnaire. Appl Psychol Meas 38:450–463
85.
go back to reference Baumgartner H, Steenkamp J-BEM (2001) Response styles in marketing research: a cross-national investigation. J Mark Res 38:143–156 Baumgartner H, Steenkamp J-BEM (2001) Response styles in marketing research: a cross-national investigation. J Mark Res 38:143–156
86.
go back to reference Bolt DM, Johnson TR (2009) Addressing score bias and differential item functioning due to individual differences in response style. Appl Psychol Meas 33:335–352 Bolt DM, Johnson TR (2009) Addressing score bias and differential item functioning due to individual differences in response style. Appl Psychol Meas 33:335–352
87.
go back to reference Van Vaerenbergh Y, Thomas TD (2013) Response styles in survey research: a literature review of antecedents, consequences, and remedies. Int J Public Opin Res 25:195–217 Van Vaerenbergh Y, Thomas TD (2013) Response styles in survey research: a literature review of antecedents, consequences, and remedies. Int J Public Opin Res 25:195–217
88.
go back to reference Weijters B, Geuens M, Schillewaert N (2010) The individual consistency of acquiescence and extreme response style in self-report questionnaires. Appl Psychol Meas 34:105–121 Weijters B, Geuens M, Schillewaert N (2010) The individual consistency of acquiescence and extreme response style in self-report questionnaires. Appl Psychol Meas 34:105–121
89.
go back to reference Weijters B, Geuens M, Schillewaert N (2010) The stability of individual response styles. Psychol Methods 15:96–110PubMed Weijters B, Geuens M, Schillewaert N (2010) The stability of individual response styles. Psychol Methods 15:96–110PubMed
90.
go back to reference Wetzel E, Carstensen CH, Böhnke JR (2013) Consistency of extreme response style and non-extreme response style across traits. J Res Personal 47:178–189 Wetzel E, Carstensen CH, Böhnke JR (2013) Consistency of extreme response style and non-extreme response style across traits. J Res Personal 47:178–189
91.
go back to reference Hoyt WT, Kerns M-D (1999) Magnitude and moderators of bias in observer ratings: a meta-analysis. Psychol Methods 4:403–424 Hoyt WT, Kerns M-D (1999) Magnitude and moderators of bias in observer ratings: a meta-analysis. Psychol Methods 4:403–424
92.
go back to reference Hoyt WT (2000) Rater bias in psychological research: when is it a problem and what can we do about it? Psychol Methods 5:64–86PubMed Hoyt WT (2000) Rater bias in psychological research: when is it a problem and what can we do about it? Psychol Methods 5:64–86PubMed
93.
go back to reference Julian MW (2001) The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Struct Equ Model 8:325–352 Julian MW (2001) The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Struct Equ Model 8:325–352
94.
go back to reference Pornprasertmanit S, Lee J, Preacher KJ (2014) Ignoring clustering in confirmatory factor analysis: some consequences for model fit and standardized parameter estimates. Multivar Behav Res 49:518–543 Pornprasertmanit S, Lee J, Preacher KJ (2014) Ignoring clustering in confirmatory factor analysis: some consequences for model fit and standardized parameter estimates. Multivar Behav Res 49:518–543
95.
go back to reference Satorra A, Muthen B (1995) Complex sample data in structural equation modeling. Sociol Methodol 25:267–316 Satorra A, Muthen B (1995) Complex sample data in structural equation modeling. Sociol Methodol 25:267–316
96.
go back to reference Stochl J, Jones PB, Perez J, Khandaker GM, Böhnke JR, Croudace TJ (in press) Effects of ignoring clustered data structure in confirmatory factor analysis of ordered polytomous items: a simulation study based on PANSS. Int J Methods Psychiatr Res (accepted) Stochl J, Jones PB, Perez J, Khandaker GM, Böhnke JR, Croudace TJ (in press) Effects of ignoring clustered data structure in confirmatory factor analysis of ordered polytomous items: a simulation study based on PANSS. Int J Methods Psychiatr Res (accepted)
97.
go back to reference Meijer RR, Egberink IJL (2012) Investigating invariant item ordering in personality and clinical scales: some empirical findings and a discussion. Educ Psychol Meas 72:589–607 Meijer RR, Egberink IJL (2012) Investigating invariant item ordering in personality and clinical scales: some empirical findings and a discussion. Educ Psychol Meas 72:589–607
98.
go back to reference Sturt E (1981) Hierarchical patterns in the distribution of psychiatric symptoms. Psychol Med 11:783–794PubMed Sturt E (1981) Hierarchical patterns in the distribution of psychiatric symptoms. Psychol Med 11:783–794PubMed
99.
go back to reference Teresi JA, Ocepek-Welikson K, Kleinman M, Eimicke JP, Crane PK, Jones RN et al (2009) Analysis of differential item functioning in the depression item bank from the Patient Reported Outcome Measurement Information System (PROMIS): an item response theory approach. Psychol Sci Q 51:148–180 Teresi JA, Ocepek-Welikson K, Kleinman M, Eimicke JP, Crane PK, Jones RN et al (2009) Analysis of differential item functioning in the depression item bank from the Patient Reported Outcome Measurement Information System (PROMIS): an item response theory approach. Psychol Sci Q 51:148–180
100.
go back to reference Crane P, Gibbons L, Ocepek-Welikson K, Cook K, Cella D, Narasimhalu K et al (2007) A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Qual Life Res 16:69–84PubMed Crane P, Gibbons L, Ocepek-Welikson K, Cook K, Cella D, Narasimhalu K et al (2007) A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Qual Life Res 16:69–84PubMed
101.
go back to reference Penfield RD, Algina J (2006) A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests. J Educ Meas 43:295–312 Penfield RD, Algina J (2006) A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests. J Educ Meas 43:295–312
102.
go back to reference Woods CM (2009) Evaluation of MIMIC-model methods for DIF testing with comparison to two-group analysis. Multivar Behav Res 44:1–27 Woods CM (2009) Evaluation of MIMIC-model methods for DIF testing with comparison to two-group analysis. Multivar Behav Res 44:1–27
103.
go back to reference Uebelacker LA, Strong D, Weinstock LM, Miller IW (2009) Use of item response theory to understand differential functioning of DSM-IV major depression symptoms by race, ethnicity and gender. Psychol Med 39:591–601PubMed Uebelacker LA, Strong D, Weinstock LM, Miller IW (2009) Use of item response theory to understand differential functioning of DSM-IV major depression symptoms by race, ethnicity and gender. Psychol Med 39:591–601PubMed
104.
go back to reference Eaton NR (2014) Transdiagnostic psychopathology factors and sexual minority mental health: evidence of disparities and associations with minority stressors. Psychol Sex Orientat Gend Divers 1:244–254PubMed Eaton NR (2014) Transdiagnostic psychopathology factors and sexual minority mental health: evidence of disparities and associations with minority stressors. Psychol Sex Orientat Gend Divers 1:244–254PubMed
105.
go back to reference Barnes D, Keyes K, Bates L (2013) Racial differences in depression in the United States: how do subgroup analyses inform a paradox? Soc Psychiatry Psychiatr Epidemiol 48:1941–1949PubMed Barnes D, Keyes K, Bates L (2013) Racial differences in depression in the United States: how do subgroup analyses inform a paradox? Soc Psychiatry Psychiatr Epidemiol 48:1941–1949PubMed
106.
go back to reference Helms-Lorenz M, Van de Vijver FJ (1995) Cognitive assessment in education in a multicultural society. Eur J Psychol Assess 11:158–169 Helms-Lorenz M, Van de Vijver FJ (1995) Cognitive assessment in education in a multicultural society. Eur J Psychol Assess 11:158–169
107.
go back to reference Schnohr CW, Kreiner S, Due EP, Currie C, Boyce W, Diderichsen F (2008) Differential item functioning of a family affluence scale: validation study on data from HBSC 2001/02. Soc Indic Res 89:79–95 Schnohr CW, Kreiner S, Due EP, Currie C, Boyce W, Diderichsen F (2008) Differential item functioning of a family affluence scale: validation study on data from HBSC 2001/02. Soc Indic Res 89:79–95
108.
go back to reference Sunderland M, Mewton L, Slade T, Baillie AJ (2010) Investigating differential symptom profiles in major depressive episode with and without generalized anxiety disorder: true co-morbidity or symptom similarity? Psychol Med 40:1113–1123PubMed Sunderland M, Mewton L, Slade T, Baillie AJ (2010) Investigating differential symptom profiles in major depressive episode with and without generalized anxiety disorder: true co-morbidity or symptom similarity? Psychol Med 40:1113–1123PubMed
109.
go back to reference Unternaehrer E, Luers P, Mill J, Dempster E, Meyer AH, Staehli S et al (2012) Dynamic changes in DNA methylation of stress-associated genes (OXTR, BDNF) after acute psychosocial stress. Transl Psychiatry 2:e150PubMedCentralPubMed Unternaehrer E, Luers P, Mill J, Dempster E, Meyer AH, Staehli S et al (2012) Dynamic changes in DNA methylation of stress-associated genes (OXTR, BDNF) after acute psychosocial stress. Transl Psychiatry 2:e150PubMedCentralPubMed
110.
111.
go back to reference Miller GA, Rockstroh B (2013) Endophenotypes in psychopathology research: where do we stand? Annu Rev Clin Psychol 9:177–213PubMed Miller GA, Rockstroh B (2013) Endophenotypes in psychopathology research: where do we stand? Annu Rev Clin Psychol 9:177–213PubMed
112.
go back to reference Crane PK, Narasimhalu K, Gibbons LE, Pedraza O, Mehta KM, Tang Y et al (2008) Composite scores for executive function items: demographic heterogeneity and relationships with quantitative magnetic resonance imaging. J Int Neuropsychol Soc 14:746–759PubMedCentralPubMed Crane PK, Narasimhalu K, Gibbons LE, Pedraza O, Mehta KM, Tang Y et al (2008) Composite scores for executive function items: demographic heterogeneity and relationships with quantitative magnetic resonance imaging. J Int Neuropsychol Soc 14:746–759PubMedCentralPubMed
113.
go back to reference Meyer-Lindenberg A, Tost H (2012) Neural mechanisms of social risk for psychiatric disorders. Nat Neurosci 15:663–668PubMed Meyer-Lindenberg A, Tost H (2012) Neural mechanisms of social risk for psychiatric disorders. Nat Neurosci 15:663–668PubMed
114.
go back to reference Miller GA, Elbert T, Sutton BP, Heller W (2007) Innovative clinical assessment technologies: challenges and opportunities in neuroimaging. Psychol Assess 19:58–73PubMed Miller GA, Elbert T, Sutton BP, Heller W (2007) Innovative clinical assessment technologies: challenges and opportunities in neuroimaging. Psychol Assess 19:58–73PubMed
115.
go back to reference Schmidt NB, Kotov R, Joiner TE (2004) Taxometrics: toward a new diagnostic scheme for psychopathology. American Psychological Association, Washington, DC Schmidt NB, Kotov R, Joiner TE (2004) Taxometrics: toward a new diagnostic scheme for psychopathology. American Psychological Association, Washington, DC
116.
go back to reference Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D (2010) Comorbidity: a network perspective. Behav Brain Sci 33:137–150PubMed Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D (2010) Comorbidity: a network perspective. Behav Brain Sci 33:137–150PubMed
117.
go back to reference Eaton N (2015) Latent variable and network models of comorbidity: toward an empirically derived nosology. Soc Psychiatry Psychiatr Epidemiol 20:1–5 Eaton N (2015) Latent variable and network models of comorbidity: toward an empirically derived nosology. Soc Psychiatry Psychiatr Epidemiol 20:1–5
118.
go back to reference Pickles A, Angold A (2003) Natural categories or fundamental dimensions: on carving nature at the joints and the rearticulation of psychopathology. Dev Psychopathol 15:529–551PubMed Pickles A, Angold A (2003) Natural categories or fundamental dimensions: on carving nature at the joints and the rearticulation of psychopathology. Dev Psychopathol 15:529–551PubMed
119.
go back to reference Box GEP (1979) Some problems of statistics and everyday life. J Am Stat Assoc 74:1–4 Box GEP (1979) Some problems of statistics and everyday life. J Am Stat Assoc 74:1–4
120.
go back to reference Everitt BS, Dunn G (2001) Multivariate data analysis, 2nd edn. Wiley, Chichester Everitt BS, Dunn G (2001) Multivariate data analysis, 2nd edn. Wiley, Chichester
Metadata
Title
Factors of psychological distress: clinical value, measurement substance, and methodological artefacts
Authors
J. R. Böhnke
T. J. Croudace
Publication date
01-04-2015
Publisher
Springer Berlin Heidelberg
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 4/2015
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-015-1022-5

Other articles of this Issue 4/2015

Social Psychiatry and Psychiatric Epidemiology 4/2015 Go to the issue