Top

Published in:

Open Access 01-02-2021

A multi-center psychometric evaluation of the Severity Indices of Personality Problems 118 (SIPP-118): Do we really need all those facets?

Authors: Muirne C. S. Paap, Benjamin Hummelen, Johan Braeken, Espen A. Arnevik, Espen Walderhaug, Theresa Wilberg, Han Berghuis, Joost Hutsebaut, Geir Pedersen

Published in: Quality of Life Research | Issue 2/2021

Abstract

Purpose

The Severity Indices of Personality Problems 118 (SIPP-118) is a self-report questionnaire that aims to measure core components of (mal)adaptive personality functioning that can change over time. In this study, we aimed to assess the facet strength of the 16 facets across three large clinical samples.

Methods

Data from Norwegian and Dutch psychiatric patients were analyzed in this international multi-center study (N₁ = 2814, N₂ = 4751, N₃ = 2217). Bi-factor modeling was used to assess to what degree the SIPP items tap into an overall general factor. The incremental value (distinctiveness) of the facets was studied using proportional reduction in mean squared error (PRMSE) based statistics.

Results

The estimated model showed adequate fit. The explained common variance (ECV) attributable to the general factor equaled 50% for all three samples. All but two facets (stable self-image and frustration tolerance) showed sufficient levels of distinctiveness. The findings were observed to be comparable across the three samples.

Conclusion

Our findings showed that the general factor was relatively weak, and the facets had a clear incremental value.

The computation was based on primary and secondary factor loadings as regression weights for the facets combined with clinical judgment [7]. Note that some facets are thought to load on multiple higher-order factors.

Lenzenweger, M. F., Lane, M. C., Loranger, A. W., & Kessler, R. C. (2007). DSM-IV personality disorders in the national comorbidity survey replication. Biological Psychiatry, 62(6), 553–564. https://doi.org/10.1016/j.biopsych.2006.09.019.CrossRefPubMedPubMedCentral

Saß, H. (2001). Personality disorders. In P. B. Baltes (Ed.), International Encyclopedia of the Social & Behavioral Sciences (pp. 11301-11308). Oxford: Pergamon.

Beckwith, H., Moran, P. F., & Reilly, J. (2014). Personality disorder prevalence in psychiatric outpatients: A systematic literature review. Personality and Mental Health, 8(2), 91–101. https://doi.org/10.1002/pmh.1252.CrossRefPubMed

Tyrer, P., Reed, G. M., & Crawford, M. J. (2015). Classification, assessment, prevalence, and effect of personality disorder. The Lancet, 385(9969), 717–726. https://doi.org/10.1016/S0140-6736(14)61995-4.CrossRef

Andrea, H., Verheul, R., Berghout, C., Dolan, C., Vanderkroft, P., Busschbach, J., Bateman, A., & Fonagy, P. (2007). Measuring the Core Components of Maladaptive Personality: Severity Indices of Personality Problems (SIPP-118) - The first technical report. Halsteren, The Netherlands: Viersprong Institute for Studies on Personality Disorders (VISPD) Medical Psychology and Psychotherapy.

McAdams, D. P., & Pals, J. L. (2006). A new big five: Fundamental principles for an integrative science of personality. American Psychologist, 61(3), 204–217. https://doi.org/10.1037/0003-066x.61.3.204.CrossRefPubMed

Verheul, R., Andrea, H., Berghout, C. C., Dolan, C., Busschbach, J. J., van der Kroft, P. J., et al. (2008). Severity Indices of Personality Problems (SIPP-118): Development, factor structure, reliability, and validity. Psychological Assessment, 20(1), 23–34. https://doi.org/10.1037/1040-3590.20.1.23.CrossRefPubMed

Pedersen, G., Arnevik, E. A., Hummelen, B., Walderhaug, E., & Wilberg, T. (2019). Psychometric properties of the Severity Indices of Personality Problems (SIPP) in two samples: A Norwegian community sample and clinical samples of patients with and without personality disorders. European Journal of Psychological Assessment, 35(5), 698–711.CrossRef

Arnevik, E., Wilberg, T., Monsen, J. T., Andrea, H., & Karterud, S. (2009). A cross-national validity study of the severity indices of personality problems (SIPP-118). Personality and Mental Health, 3(1), 41–55. https://doi.org/10.1002/pmh.60.CrossRef

10.

Bales, D., van Beek, N., Smits, M., Willemsen, S., Busschbach, J. J., Verheul, R., et al. (2012). Treatment outcome of 18-month, day hospital mentalization-based treatment (MBT) in patients with severe borderline personality disorder in The Netherlands. Journal of Personality Disorders, 26(4), 568–582. https://doi.org/10.1521/pedi.2012.26.4.568.CrossRefPubMed

11.

Bales, D. L., Timman, R., Andrea, H., Busschbach, J. J., Verheul, R., & Kamphuis, J. H. (2015). Effectiveness of day hospital mentalization-based treatment for patients with severe borderline personality disorder: A matched control study. Clinical Psychology & Psychotherapy, 22(5), 409–417. https://doi.org/10.1002/cpp.1914.CrossRef

12.

Berghuis, H., Kamphuis, J. H., & Verheul, R. (2014). Specific personality traits and general personality dysfunction as predictors of the presence and severity of personality disorders in a clinical sample. Journal of Personality Assessment, 96(4), 410–416. https://doi.org/10.1080/00223891.2013.834825.CrossRefPubMed

13.

Feenstra, D. J., Hutsebaut, J., Verheul, R., & Busschbach, J. J. V. (2011). Severity indices of personality problems (SIPP–118) in adolescents: Reliability and validity. Psychological Assessment, 23(3), 646–655. https://doi.org/10.1037/a0022995.CrossRefPubMed

14.

Feenstra, D. J., Hutsebaut, J., Verheul, R., & van Limbeek, J. (2014). Identity: Empirical contribution. Changes in the identity integration of adolescents in treatment for personality disorders. Journal of Personality Disorders, 28(1), 101–112. https://doi.org/10.1521/pedi.2014.28.1.101.CrossRefPubMed

15.

Gudjonsson, G. H., Sigurdsson, J. F., Guðmundsdóttir, H. B., Sigurjónsdóttir, S., & Smari, J. (2010). The relationship between ADHD symptoms in college students and core components of maladaptive personality. Personality and Individual Differences, 48(5), 601–606. https://doi.org/10.1016/j.paid.2009.12.015.CrossRef

16.

Lien, I. A., & Arnevik, E. A. (2016). Assessment of personality problems among patients with substance use disorders. Nordic Studies on Alcohol and Drugs, 33(4), 399–414. https://doi.org/10.1515/nsad-2016-0033.CrossRef

17.

Morey, L. C., Berghuis, H., Bender, D. S., Verheul, R., Krueger, R. F., & Skodol, A. E. (2011). Toward a model for assessing level of personality functioning in DSM–5, Part II: Empirical articulation of a core dimension of personality pathology. Journal of Personality Assessment, 93(4), 347–353. https://doi.org/10.1080/00223891.2011.577853.CrossRefPubMed

18.

Bastiaansen, L., Hopwood, C. J., Van den Broeck, J., Rossi, G., Schotte, C., & De Fruyt, F. (2016). The twofold diagnosis of personality disorder: How do personality dysfunction and pathological traits increment each other at successive levels of the trait hierarchy? Personality Disorder, 7(3), 280–292. https://doi.org/10.1037/per0000149.CrossRef

19.

Meijer, R. R., Niessen, S., & Boevé, A. (2015). Rapporteren van subtestscores in de klinische praktijk: Oppassen met de interpretatie [Reporting subtestscores in clinical practice: Be careful with interpretation]. De Psycholoog, 50(9), 35–41.

20.

Brouwer, D. (2013). Modern psychometric perspectives on the evaluation of clinical scales. (PhD), University of Groningen, Groningen. https://www.rug.nl/research/portal/files/2404658/Dissertation_DBrouwer_2013-1.pdf

21.

Karterud, S., Pedersen, G., Friis, S., Urnes, Ø., Irion, T., Brabrand, J., et al. (1998). The Norwegian network of psychotherapeutic day hospitals. Therapeutic Communities, 19(1), 15–28.

22.

Pedersen, G,, & Karterud, S. (2010). Using measures from the SCL-90-R to screen for personality disorders. Personality and Mental Health, 4(2), 121–132. https://doi.org/10.1002/pmh.122.CrossRef

23.

Weekers, L. C., Hutsebaut, J., & Kamphuis, J. H. (2019). The level of personality functioning scale-brief form 2.0: Update of a brief instrument for assessing level of personality functioning. Personality and Mental Health, 13(1), 3–14. https://doi.org/10.1002/pmh.1434.CrossRefPubMed

24.

Hutsebaut, J., Kamphuis, J. H., Feenstra, D. J., Weekers, L. C., & De Saeger, H. (2017). Assessing DSM-5-oriented level of personality functioning: Development and psychometric evaluation of the Semi-Structured Interview for Personality Functioning DSM-5 (STiP-5.1). Personality Disorder, 8(1), 94–101. https://doi.org/10.1037/per0000197.CrossRef

25.

Cai, L. (2010). A two-tier full-information item factor analysis model with applications. Psychometrika, 75(4), 581–612. https://doi.org/10.1007/s11336-010-9178-0.CrossRef

26.

Gibbons, R. D., & Hedeker, D. R. (1992). Full-information item bi-factor analysis. Psychometrika, 57(3), 423–436. https://doi.org/10.1007/bf02295430.CrossRef

27.

Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555.CrossRefPubMedPubMedCentral

28.

Paap, M. C. S., Brouwer, D., Glas, C. A. W., Monninkhof, E. M., Forstreuter, B., Pieterse, M. E., et al. (2015). The St George’s respiratory questionnaire revisited: A psychometric evaluation. Quality of Life Research, 24(1), 67–79. https://doi.org/10.1007/s11136-013-0570-y.CrossRefPubMed

29.

Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26. https://doi.org/10.1177/0013164412449831.CrossRef

30.

Quinn, H. (2014). Bifactor models, Explained Common Variance (ECV), and the usefulness of scores from unidimensional item response theory analyses. University of North Carolina at Chapel Hill. https://doi.org/10.17615/t6ff-a088.

31.

Cook, K. F., Kallen, M. A., & Amtmann, D. (2009). Having a fit: Impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality assumption. Quality of Life Research, 18(4), 447–460. https://doi.org/10.1007/s11136-009-9464-4.CrossRefPubMedPubMedCentral

32.

Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to unparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRef

33.

Haberman, S. J. (2008). When can subscores have value? Journal of Educational and Behavioral Statistics, 33(2), 204–229. https://doi.org/10.3102/1076998607302636.CrossRef

34.

Feinberg, R. A., & Wainer, H. (2014). A Simple equation to predict a subscore's value. Educational Measurement: Issues and Practice, 33(3), 55–56. https://doi.org/10.1111/emip.12035.CrossRef

35.

Feinberg, R. A., & Jurich, D. P. (2017). Guidelines for interpreting and reporting subscores. Educational Measurement: Issues and Practice, 36(1), 5–13. https://doi.org/10.1111/emip.12142.CrossRef

36.

R Development Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.

37.

Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06CrossRef

38.

Skodol, A. E., Clark, L. A., Bender, D. S., Krueger, R. F., Morey, L. C., Verheul, R., et al. (2011). Proposed changes in personality and personality disorder assessment and diagnosis for DSM-5 Part I: Description and rationale. Personality Disorders: Theory, Research, and Treatment, 2(1), 4–22. https://doi.org/10.1037/a0021891.CrossRef

39.

Tyrer, P., Crawford, M., Mulder, R., Blashfield, R., Farnam, A., Fossati, A., et al. (2011). The rationale for the reclassification of personality disorder in the 11th revision of the International Classification of Diseases (ICD-11). Personality and Mental Health, 5(4), 246–259. https://doi.org/10.1002/pmh.190.CrossRef

40.

Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., et al. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137. https://doi.org/10.1177/2167702613497473.CrossRefPubMedPubMedCentral

41.

Sharp, C., Wright, A. G., Fowler, J. C., Frueh, B. C., Allen, J. G., Oldham, J., et al. (2015). The structure of personality pathology: Both general (‘g’) and specific (‘s’) factors? Journal of Abnormal Psychology, 124(2), 387–398. https://doi.org/10.1037/abn0000033.CrossRefPubMed

42.

Widiger, T. A., Bach, B., Chmielewski, M., Clark, L. A., DeYoung, C., Hopwood, C. J., et al. (2019). Criterion A of the AMPD in HiTOP. Journal of Personality Assessment, 101(4), 345–355. https://doi.org/10.1080/00223891.2018.1465431.CrossRefPubMed

43.

Wright, A. G., Hopwood, C. J., Skodol, A. E., & Morey, L. C. (2016). Longitudinal validation of general and specific structural features of personality pathology. Journal of Abnormal Psychology, 125(8), 1120–1134. https://doi.org/10.1037/abn0000165.CrossRefPubMedPubMedCentral

44.

Wilberg, T., Dammen, T., & Friis, S. (2000). Comparing personality diagnostic questionnaire-4+ with longitudinal, expert, all data (LEAD) standard diagnoses in a sample with a high prevalence of axis I and axis II disorders. Comprehensive Psychiatry, 41(4), 295–302. https://doi.org/10.1053/comp.2000.0410295.CrossRefPubMed

45.

Guy, L. S., Poythress, N. G., Douglas, K. S., Skeem, J. L., & Edens, J. F. (2008). Correspondence between self-report and interview-based assessments of antisocial personality disorder. Psychological Assessment, 20(1), 47–54. https://doi.org/10.1037/1040-3590.20.1.47.CrossRefPubMed

Title: A multi-center psychometric evaluation of the Severity Indices of Personality Problems 118 (SIPP-118): Do we really need all those facets?
Authors: Muirne C. S. Paap
Benjamin Hummelen
Johan Braeken
Espen A. Arnevik
Espen Walderhaug
Theresa Wilberg
Han Berghuis
Joost Hutsebaut
Geir Pedersen
Publication date: 01-02-2021
Publisher: Springer International Publishing
Published in: Quality of Life Research / Issue 2/2021
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI: https://doi.org/10.1007/s11136-020-02654-8

Keynote webinar | Spotlight on medication adherence

Springer Medicine

A multi-center psychometric evaluation of the Severity Indices of Personality Problems 118 (SIPP-118): Do we really need all those facets?

Abstract

Purpose

Methods

Results

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 2/2021

A randomised online experimental study to compare responses to brief and extended surveys of health-related quality of life and psychosocial outcomes among women with breast cancer

Predictors of quality of life among youths in foster care—a 5-year prospective follow-up study

Development and assessment of a verbal response scale for the Patient-Specific Functional Scale (PSFS) in a low-literacy, non-western population

Quality of life of cancer patients at palliative care units in developing countries: systematic review of the published literature

A validation study of the CarerQol instrument in informal caregivers of people with dementia from eight European countries

Quality of life more than 10 years after radiotherapy for localized prostate cancer—impact of time after treatment and prescription dose