Skip to main content
Top
Published in: European Child & Adolescent Psychiatry 10/2015

01-10-2015 | Original Contribution

Investigation of a bifactor model of the Strengths and Difficulties Questionnaire

Authors: Hervé Caci, Alexandre J. S. Morin, Antoine Tran

Published in: European Child & Adolescent Psychiatry | Issue 10/2015

Login to get access

Abstract

The Strengths and Difficulties Questionnaire (SDQ) is used to measure psychopathological symptoms in children and adolescents from 4 to 17 years old, but its underlying structure is still a matter of debate. Indeed, on the basis of a systematic review of English and non-English articles conducted using multiple databases, 54 studies reporting on the factor structure of the SDQ were located. The original 5 first-order factor structure is generally supported by exploratory procedures, but support based on confirmatory factor analyses is not clear. We analysed data from 889 youths from the general French population, rated on the SDQ by their teachers. We tested the original model, hierarchical models and bifactor models. The best-fitting model is a bifactor model with the five a priori factors grouped in two global factors (Externalizing Disorders—Hyperactivity and Conduct—and Internalizing Disorders—Peer relationships and Emotions) and one Strength/Prosocial factor. However, we show that the Conduct-Specific factor should not be used in practice in its current state, that the Hyperactivity-Specific factor mainly covers hyperactivity rather than inattention, and that the Peer Problems-Specific factor mainly reflects a preference for solitude. Nevertheless, the measurement model proved to be fully invariant across gender and school levels (kindergarten, primary and secondary schools), with statistically significant differences in latent means between genders only. Beyond computing the five a priori scores when using the teacher ratings of the SDQ, our results prove the usefulness of computing Externalizing Disorders and Internalizing Disorders global scores.
Appendix
Available only for authorised users
Literature
1.
go back to reference American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Press, Washington American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Press, Washington
2.
go back to reference Preisig M, Waeber G, Vollenweider P, Bovet P, Rothen S, Vandeleur C, Guex P, Middleton L, Waterworth D, Mooser V, Tozzi F, Muglia P (2009) The PsyCoLaus study: methodology and characteristics of the smaple of a population-based survey on psychiatric disorders and their association with genetic and cardiovascular risk factors. BMC Psychiatry 9: 9 Preisig M, Waeber G, Vollenweider P, Bovet P, Rothen S, Vandeleur C, Guex P, Middleton L, Waterworth D, Mooser V, Tozzi F, Muglia P (2009) The PsyCoLaus study: methodology and characteristics of the smaple of a population-based survey on psychiatric disorders and their association with genetic and cardiovascular risk factors. BMC Psychiatry 9: 9
3.
go back to reference Kessler RC, Adler L, Ames M, Demler O, Faraone S, Hiripi E, Howes MJ, Jin R, Secnik K, Spencer T, Ustun TB, Walters EE (2005) The World Health Organization adult ADHD self-report scale (ASRS): a short screening scale for use in the general population. Psychol Med 35(2):245–256CrossRefPubMed Kessler RC, Adler L, Ames M, Demler O, Faraone S, Hiripi E, Howes MJ, Jin R, Secnik K, Spencer T, Ustun TB, Walters EE (2005) The World Health Organization adult ADHD self-report scale (ASRS): a short screening scale for use in the general population. Psychol Med 35(2):245–256CrossRefPubMed
4.
go back to reference Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 38(5):581–586CrossRefPubMed Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 38(5):581–586CrossRefPubMed
5.
go back to reference Rutter M (1967) A children’s behaviour questionnaire for completion by teachers: preliminary findings. J Child Psychol Psychiatry 8(1):1–11CrossRefPubMed Rutter M (1967) A children’s behaviour questionnaire for completion by teachers: preliminary findings. J Child Psychol Psychiatry 8(1):1–11CrossRefPubMed
6.
go back to reference Goodman R (1994) A modified version of the Rutter parent questionnaire including extra items on children’s strengths: a research note. J Child Psychol Psychiatry 35(8):1483–1494CrossRefPubMed Goodman R (1994) A modified version of the Rutter parent questionnaire including extra items on children’s strengths: a research note. J Child Psychol Psychiatry 35(8):1483–1494CrossRefPubMed
7.
go back to reference Goodman R (2001) Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry 40(11):1337–1345CrossRefPubMed Goodman R (2001) Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry 40(11):1337–1345CrossRefPubMed
8.
go back to reference Goodman A, Lamping DL, Ploubidis GB (2010) When to use broader internalising and externalising subscales instead of the hypothesized five subscales on the Strengths and Difficulties Questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol 38(8):1179–1191CrossRefPubMed Goodman A, Lamping DL, Ploubidis GB (2010) When to use broader internalising and externalising subscales instead of the hypothesized five subscales on the Strengths and Difficulties Questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol 38(8):1179–1191CrossRefPubMed
9.
go back to reference Widaman KF (2007) Common factors versus components: principals and principles, errors and misconceptions. In: Cudeck R, MacCallum RC (eds) Factor analysis at 100. Lawrence Erlbaum Associates, Mahwah, pp 177–203 Widaman KF (2007) Common factors versus components: principals and principles, errors and misconceptions. In: Cudeck R, MacCallum RC (eds) Factor analysis at 100. Lawrence Erlbaum Associates, Mahwah, pp 177–203
10.
go back to reference Morin AJS, Marsh HW, Nagengast B (2013) Exploratory structural equation modeling. In: Hancock GR, Mueller RO (eds) Structural equation modeling: a second course, 2nd edn. IAP, Greewich, pp 395–436 Morin AJS, Marsh HW, Nagengast B (2013) Exploratory structural equation modeling. In: Hancock GR, Mueller RO (eds) Structural equation modeling: a second course, 2nd edn. IAP, Greewich, pp 395–436
11.
go back to reference Guay F, Morin AJS, Litalien D, Valois P, Vallerand RJ (In Press) An application of exploratory structural equation modeling to evaluate the construct validity and the gender invariance of the Academic Motivation Scale. J Exp Educ Guay F, Morin AJS, Litalien D, Valois P, Vallerand RJ (In Press) An application of exploratory structural equation modeling to evaluate the construct validity and the gender invariance of the Academic Motivation Scale. J Exp Educ
12.
go back to reference Dickey WC, Blumberg SJ (2004) Revisiting the factor structure of the strengths and difficulties questionnaire: United States, 2001. J Am Acad Child Adolesc Psychiatry 43(9):1159–1167CrossRefPubMed Dickey WC, Blumberg SJ (2004) Revisiting the factor structure of the strengths and difficulties questionnaire: United States, 2001. J Am Acad Child Adolesc Psychiatry 43(9):1159–1167CrossRefPubMed
14.
go back to reference Rindskopf D, Rose T (1988) Some theory and application of confirmatory second-order factor analyses. Multivar Behav Res 23(1):51–67CrossRef Rindskopf D, Rose T (1988) Some theory and application of confirmatory second-order factor analyses. Multivar Behav Res 23(1):51–67CrossRef
15.
go back to reference Chen FF, West SG, Sousa KH (2006) A comparison of bifactor and second-order models of quality of life. Multivar Behav Res 41(2):189–225CrossRef Chen FF, West SG, Sousa KH (2006) A comparison of bifactor and second-order models of quality of life. Multivar Behav Res 41(2):189–225CrossRef
16.
go back to reference Reise SP, Moore TM, Haviland MG (2010) Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess 92(6):544–559PubMedCentralCrossRefPubMed Reise SP, Moore TM, Haviland MG (2010) Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess 92(6):544–559PubMedCentralCrossRefPubMed
17.
go back to reference Schmid J, Leiman JM (1957) The development of hierarchical factor solutions. Psychometrika 22(1):53–61CrossRef Schmid J, Leiman JM (1957) The development of hierarchical factor solutions. Psychometrika 22(1):53–61CrossRef
18.
go back to reference Reise SP (2012) Invited paper: The rediscovery of bifactor measurement models. Multivar Behav Res 47(5):667–696CrossRef Reise SP (2012) Invited paper: The rediscovery of bifactor measurement models. Multivar Behav Res 47(5):667–696CrossRef
19.
go back to reference Caci H, Morin AJS, Tran A (In press) Teacher ratings of the ADHD-RS IV in a community sample: results from the ChiP-ARD study. J Atten Disord Caci H, Morin AJS, Tran A (In press) Teacher ratings of the ADHD-RS IV in a community sample: results from the ChiP-ARD study. J Atten Disord
20.
go back to reference Morin AJS, Tran A, Caci H (In press) Factorial Validity of the ADHD Adult Symptom Rating Scale in a French community sample: results from the ChiP-ARD study. J Atten Disord Morin AJS, Tran A, Caci H (In press) Factorial Validity of the ADHD Adult Symptom Rating Scale in a French community sample: results from the ChiP-ARD study. J Atten Disord
21.
go back to reference Morin AJS, Moullec G, Maïano C, Layet L, Just J-L, Ninot G (2011) Psychometric properties of the Center for Epidemiologic Studies Depression Scale (CES-D) in French clinical and non-clinical adults. Epidemiology and Public Health [Revue d’Épidémiologie et de Santé Publique] 59(5): 327–340 Morin AJS, Moullec G, Maïano C, Layet L, Just J-L, Ninot G (2011) Psychometric properties of the Center for Epidemiologic Studies Depression Scale (CES-D) in French clinical and non-clinical adults. Epidemiology and Public Health [Revue d’Épidémiologie et de Santé Publique] 59(5): 327–340
22.
go back to reference Kobor A, Takacs A, Urban R (2013) The bifactor model of the strenghts and difficulties questionnaire. Eur J Psychol Assess 29(4):299–307CrossRef Kobor A, Takacs A, Urban R (2013) The bifactor model of the strenghts and difficulties questionnaire. Eur J Psychol Assess 29(4):299–307CrossRef
23.
go back to reference Meredith W (1993) Measurement invariance, factor analysis and factorial invariance. Psychometrika 58(4):525–543CrossRef Meredith W (1993) Measurement invariance, factor analysis and factorial invariance. Psychometrika 58(4):525–543CrossRef
24.
go back to reference Millsap RE (2011) Statistical approaches to measurement invariance. Taylor and Francis, New York Millsap RE (2011) Statistical approaches to measurement invariance. Taylor and Francis, New York
25.
go back to reference Niclasen J, Skovgaard AM, Andersen AM, Somhovd MJ, Obel C (2013) A confirmatory approach to examining the factor structure of the Strengths and Difficulties Questionnaire (SDQ): a large scale cohort study. J Abnorm Child Psychol 41(3):355–365CrossRefPubMed Niclasen J, Skovgaard AM, Andersen AM, Somhovd MJ, Obel C (2013) A confirmatory approach to examining the factor structure of the Strengths and Difficulties Questionnaire (SDQ): a large scale cohort study. J Abnorm Child Psychol 41(3):355–365CrossRefPubMed
26.
go back to reference Niclasen J, Teasdale TW, Andersen AM, Skovgaard MJ, Elberling H, Obel C (2012) Psychometric properties of the Danish Strengths and Difficulties Questionnaire: the SDQ assessed for more than 70,000 raters in four different cohorts. PLoS One 7(2):e32025PubMedCentralCrossRefPubMed Niclasen J, Teasdale TW, Andersen AM, Skovgaard MJ, Elberling H, Obel C (2012) Psychometric properties of the Danish Strengths and Difficulties Questionnaire: the SDQ assessed for more than 70,000 raters in four different cohorts. PLoS One 7(2):e32025PubMedCentralCrossRefPubMed
27.
go back to reference d’Acremont M, Van der Linden M (2008) Confirmatory factor analysis of the strengths and difficulties questionnaire in a community of French-speaking adolescents. Eur J Psychol Assess 24(1):1–8CrossRef d’Acremont M, Van der Linden M (2008) Confirmatory factor analysis of the strengths and difficulties questionnaire in a community of French-speaking adolescents. Eur J Psychol Assess 24(1):1–8CrossRef
28.
go back to reference Caci H, Morin AJS, Tran A (2014) Prevalence and correlates of attention deficit/hyperactivity disorder in adults from a French community sample. J Nerv Mental Dis 202(4):324–332CrossRef Caci H, Morin AJS, Tran A (2014) Prevalence and correlates of attention deficit/hyperactivity disorder in adults from a French community sample. J Nerv Mental Dis 202(4):324–332CrossRef
29.
go back to reference Muthén LK, Muthén BO (2012) Mplus User’s Guide, 7th edn. Muthén and Muthén, Los Angeles Muthén LK, Muthén BO (2012) Mplus User’s Guide, 7th edn. Muthén and Muthén, Los Angeles
30.
go back to reference Beauducel A, Herzberg PY (2006) On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Struct Equ Model 13(2):186–203CrossRef Beauducel A, Herzberg PY (2006) On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Struct Equ Model 13(2):186–203CrossRef
31.
go back to reference Finney SJ, DiStefano C (2006) Non-normal and categorical data in structural equation modeling. In: Hancock GR, Mueller RO (eds) Structural equation modeling: a second course. IAP, Greenwich, pp 269–314 Finney SJ, DiStefano C (2006) Non-normal and categorical data in structural equation modeling. In: Hancock GR, Mueller RO (eds) Structural equation modeling: a second course. IAP, Greenwich, pp 269–314
32.
go back to reference Flora DB, Curran PJ (2004) An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods 9(4):466–491PubMedCentralCrossRefPubMed Flora DB, Curran PJ (2004) An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods 9(4):466–491PubMedCentralCrossRefPubMed
33.
go back to reference Forero CG, Maydeu-Olivares A, Gallardo-Pujol D (2009) Factor analysis with ordinal indicators: a Monte Carlo study comparing DWLS and ULS estimation. Struct Equ Model 16(4):625–641CrossRef Forero CG, Maydeu-Olivares A, Gallardo-Pujol D (2009) Factor analysis with ordinal indicators: a Monte Carlo study comparing DWLS and ULS estimation. Struct Equ Model 16(4):625–641CrossRef
35.
go back to reference Millsap RE, Tein JY (2004) Assessing factorial invariance in ordered-categorical measures. Multivar Behav Res 39(3):479–515CrossRef Millsap RE, Tein JY (2004) Assessing factorial invariance in ordered-categorical measures. Multivar Behav Res 39(3):479–515CrossRef
36.
go back to reference Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55CrossRef Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55CrossRef
37.
go back to reference Yu CY (2002) Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. University of California, Los Angeles Yu CY (2002) Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. University of California, Los Angeles
40.
go back to reference Bollen KA (1989) Structural equations with latent variables. Wiley, New YorkCrossRef Bollen KA (1989) Structural equations with latent variables. Wiley, New YorkCrossRef
41.
go back to reference Morin AJS, Madore I, Morizot J, Boudrias J-S, Tremblay M (2009) The workplace affective commitment multidimensional questionnaire: factor structure and measurement invariance. Int J Psychol Res 4(3–4):307–344 Morin AJS, Madore I, Morizot J, Boudrias J-S, Tremblay M (2009) The workplace affective commitment multidimensional questionnaire: factor structure and measurement invariance. Int J Psychol Res 4(3–4):307–344
42.
go back to reference Rensvold RB, Cheung GW (1998) Testing measurement model for factorial invariance: a systematic approach. Educ Psychol Meas 58(6):1017–1034CrossRef Rensvold RB, Cheung GW (1998) Testing measurement model for factorial invariance: a systematic approach. Educ Psychol Meas 58(6):1017–1034CrossRef
43.
go back to reference Chen FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model 14(3):464–504CrossRef Chen FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model 14(3):464–504CrossRef
44.
go back to reference Cheung GW, Rensvold RB (2002) Evaluating goodness-of fit indexes for testing measurement invariance. Struct Equ Model 9(2):233–255CrossRef Cheung GW, Rensvold RB (2002) Evaluating goodness-of fit indexes for testing measurement invariance. Struct Equ Model 9(2):233–255CrossRef
45.
go back to reference McDonald RP (1970) The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. Br J Math Stat Psychol 23(1):1–21CrossRef McDonald RP (1970) The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. Br J Math Stat Psychol 23(1):1–21CrossRef
46.
go back to reference Sijtsma K (2009) On the use, misuse, and the very limited usefulness of Cronbach’s alpha [Introduction to a special issue]. Psychometrika 74(1):107–120PubMedCentralCrossRefPubMed Sijtsma K (2009) On the use, misuse, and the very limited usefulness of Cronbach’s alpha [Introduction to a special issue]. Psychometrika 74(1):107–120PubMedCentralCrossRefPubMed
47.
go back to reference Morin AJS, Arens AK, Marsh HW (In press) A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Struct Equ Model Morin AJS, Arens AK, Marsh HW (In press) A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Struct Equ Model
48.
go back to reference Le Corff Y, Toupin J (Ahead of print) Overt versus covert conduct disorder symptoms and the prospective prediction of antisocial personality disorder. J Personal Dis. doi:10.1521/pedi_2013_27_074 Le Corff Y, Toupin J (Ahead of print) Overt versus covert conduct disorder symptoms and the prospective prediction of antisocial personality disorder. J Personal Dis. doi:10.​1521/​pedi_​2013_​27_​074
49.
go back to reference Connor DF, Glatt SJ, Lopez ID, Jackson D, Melloni RHJ (2002) Psychopharmacology and aggression. I: a meta-analysis of stimulant effects on overt/covert aggression-related behaviors in ADHD. J Am Acad Child Adolesc Psychiatry 41(3):253–261CrossRefPubMed Connor DF, Glatt SJ, Lopez ID, Jackson D, Melloni RHJ (2002) Psychopharmacology and aggression. I: a meta-analysis of stimulant effects on overt/covert aggression-related behaviors in ADHD. J Am Acad Child Adolesc Psychiatry 41(3):253–261CrossRefPubMed
50.
go back to reference Loeber R, Schmaling KB (1985) Empirical evidence for overt and covert patterns of antisocial conduct problems: a metaanalysis. J Abnorm Child Psychol 13(2):337–353CrossRefPubMed Loeber R, Schmaling KB (1985) Empirical evidence for overt and covert patterns of antisocial conduct problems: a metaanalysis. J Abnorm Child Psychol 13(2):337–353CrossRefPubMed
51.
go back to reference Arseneault L, Kim-Cohen J, Taylor A, Caspi A, Moffit TE (2005) Psychometric evaluation of 5- and 7-year-old children’s self-reports of conduct problems. J Abnorm Child Psychol 33(5):537–550CrossRefPubMed Arseneault L, Kim-Cohen J, Taylor A, Caspi A, Moffit TE (2005) Psychometric evaluation of 5- and 7-year-old children’s self-reports of conduct problems. J Abnorm Child Psychol 33(5):537–550CrossRefPubMed
52.
go back to reference Simonoff E, Pickles A, Hewitt J, Silberg J, Rutter M, Loeber R, Meyer J, Neale M, Eaves L (1995) Multiple raters of disruptive child behavior: using a genetic strategy to examine shared views and bias. Behavioral Genetics 25(4):311–326CrossRef Simonoff E, Pickles A, Hewitt J, Silberg J, Rutter M, Loeber R, Meyer J, Neale M, Eaves L (1995) Multiple raters of disruptive child behavior: using a genetic strategy to examine shared views and bias. Behavioral Genetics 25(4):311–326CrossRef
54.
go back to reference Wang JM, Rubina KH, Laursenb B, Booth-LaForcec C, Rose-Krasnord L (2013) Preference-for-solitude and adjustment difficulties in early and late adolescence. J Clin Child Adolesc Psychol 42(6):834–842CrossRefPubMed Wang JM, Rubina KH, Laursenb B, Booth-LaForcec C, Rose-Krasnord L (2013) Preference-for-solitude and adjustment difficulties in early and late adolescence. J Clin Child Adolesc Psychol 42(6):834–842CrossRefPubMed
55.
go back to reference Merwood A, Greven CU, Price TS, Fijsdijk F, Kuntsi J, McLoughlin G, Larsson H, Asherson PJ (2013) Different heritabilities but shared etiological influences for parent, teacher and self-ratings of ADHD symptoms: an adolescent twin study. Psychol Med 43(9):1973–1984CrossRefPubMed Merwood A, Greven CU, Price TS, Fijsdijk F, Kuntsi J, McLoughlin G, Larsson H, Asherson PJ (2013) Different heritabilities but shared etiological influences for parent, teacher and self-ratings of ADHD symptoms: an adolescent twin study. Psychol Med 43(9):1973–1984CrossRefPubMed
Metadata
Title
Investigation of a bifactor model of the Strengths and Difficulties Questionnaire
Authors
Hervé Caci
Alexandre J. S. Morin
Antoine Tran
Publication date
01-10-2015
Publisher
Springer Berlin Heidelberg
Published in
European Child & Adolescent Psychiatry / Issue 10/2015
Print ISSN: 1018-8827
Electronic ISSN: 1435-165X
DOI
https://doi.org/10.1007/s00787-015-0679-3

Other articles of this Issue 10/2015

European Child & Adolescent Psychiatry 10/2015 Go to the issue