Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2020

01-12-2020 | Affective Disorder | Research

Using Rasch measurement theory to assess the psychometric properties of a depressive symptoms scale in Norwegian adolescents

Authors: Annette Løvheim Kleppang, Anne Mari Steigen, Hanne Søberg Finbråten

Published in: Health and Quality of Life Outcomes | Issue 1/2020

Login to get access

Abstract

Background

Scales measuring depressive symptoms in adolescents and adults are widely used for epidemiological purposes. The purpose of this study is to use Rasch measurement theory to examine the psychometric properties of a six-item scale intended to measure depressive symptoms in Norwegian adolescents.

Methods

The study is based on cross-sectional data from Ungdata, a survey conducted by the Norwegian Social Research Institute in cooperation with Regional Centres for Drug Rehabilitation in 2017. The target group comprised 13- to 19-years olds in Norway. Six items with four response categories, intended to measure depressive symptoms, were analysed. The analysis focused on invariance, including differential item functioning across gender and school levels. In addition, targeting, possible multidimensionality, response dependency, and the categorisation of the items were analysed.

Results

The scale measuring depressive symptoms shows good reliability and, on the whole, the items work well. However, one item, ‘had sleep problems’, clearly misfit and another, ‘worried too much about things’, works differently for males and females.

Conclusions

The scale has the potential to measure depressive symptoms in adolescents though there is room for improvement. To further improve the scale, the item concerning sleep problems should be rephrased.
Literature
1.
go back to reference Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet. 2007;369:1302–13.CrossRef Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet. 2007;369:1302–13.CrossRef
2.
go back to reference Kieling C, Baker-Henningham H, Belfer M, et al. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011;378:1515–25.CrossRef Kieling C, Baker-Henningham H, Belfer M, et al. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011;378:1515–25.CrossRef
3.
go back to reference Bakken A. Ungdata 2017. Nasjonale resultater [Ungdata 2017. National results]. Oslo: NOVA; 2017. Bakken A. Ungdata 2017. Nasjonale resultater [Ungdata 2017. National results]. Oslo: NOVA; 2017.
4.
go back to reference Fergusson DM, Woodward LJ. Mental health, educational, and social role outcomes of adolescents with depression. Arch Gen Psychiatry. 2002;59:225–31.CrossRef Fergusson DM, Woodward LJ. Mental health, educational, and social role outcomes of adolescents with depression. Arch Gen Psychiatry. 2002;59:225–31.CrossRef
5.
go back to reference Goodman A, Joyce R, Smith JP. The long shadow cast by childhood physical and mental problems on adult life. Proc Natl Acad Sci U S A. 2011;108:6032–7.CrossRef Goodman A, Joyce R, Smith JP. The long shadow cast by childhood physical and mental problems on adult life. Proc Natl Acad Sci U S A. 2011;108:6032–7.CrossRef
6.
go back to reference McCarty CA, Mason WA, Kosterman R, McGorry P. Adolescent school failure predicts later depression among girls. J Adolesc Health. 2008;43:180–7.CrossRef McCarty CA, Mason WA, Kosterman R, McGorry P. Adolescent school failure predicts later depression among girls. J Adolesc Health. 2008;43:180–7.CrossRef
7.
go back to reference Merikangas KR, He J-P, Burstein M, et al. Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49:980–9.CrossRef Merikangas KR, He J-P, Burstein M, et al. Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49:980–9.CrossRef
8.
go back to reference Wichstrøm L. The emerge of gender difference in depressed mood during adolecence: the role of intensified gender socialization. Dev Psychol. 1999;35:232–45.CrossRef Wichstrøm L. The emerge of gender difference in depressed mood during adolecence: the role of intensified gender socialization. Dev Psychol. 1999;35:232–45.CrossRef
9.
go back to reference Andrich D. Rasch models for measurement. Newbury Park: Sage Publications; 1988.CrossRef Andrich D. Rasch models for measurement. Newbury Park: Sage Publications; 1988.CrossRef
10.
go back to reference Beck AT, Steer RA. Internal consistencies of the original and revised Beck depression inventory. J Clin Psychol. 1984;40:1365–7.CrossRef Beck AT, Steer RA. Internal consistencies of the original and revised Beck depression inventory. J Clin Psychol. 1984;40:1365–7.CrossRef
11.
go back to reference Kandel DB, Davies M. Epidemiology of depressive mood in adolescents: an empirical study. Arch Gen Psychiatry. 1982;39:1205–12.CrossRef Kandel DB, Davies M. Epidemiology of depressive mood in adolescents: an empirical study. Arch Gen Psychiatry. 1982;39:1205–12.CrossRef
12.
go back to reference Derogatis LR, Lipman RS, Richels K, Uhlenhuth EH, Covi L. The Hopkins Symptoms Checklist (HSCL) -a self-report symptom inventory. Behav Sci. 1974;19:1–15.CrossRef Derogatis LR, Lipman RS, Richels K, Uhlenhuth EH, Covi L. The Hopkins Symptoms Checklist (HSCL) -a self-report symptom inventory. Behav Sci. 1974;19:1–15.CrossRef
13.
go back to reference Abebe DS, Frøyland LR, Bakken A, et al. Municipal-level differences in depressive symptoms among adolescents in Norway: results from the cross-national Ungdata study. Scand J Soc Med. 2016;44:47–54. Abebe DS, Frøyland LR, Bakken A, et al. Municipal-level differences in depressive symptoms among adolescents in Norway: results from the cross-national Ungdata study. Scand J Soc Med. 2016;44:47–54.
14.
go back to reference Granrud MD, Steffenak AKM, Theander K. Gender differences in symptoms of depression among adolescents in Eastern Norway: results from a cross-sectional study. Scand J Public Health. 2017;47:157–65. Granrud MD, Steffenak AKM, Theander K. Gender differences in symptoms of depression among adolescents in Eastern Norway: results from a cross-sectional study. Scand J Public Health. 2017;47:157–65.
15.
go back to reference von Soest T, Wichstrøm L. Secular trends in depressive symptoms among Norwegian adolescents from 1992 to 2010. J Abnorm Child Psychol. 2014;42:403–15.CrossRef von Soest T, Wichstrøm L. Secular trends in depressive symptoms among Norwegian adolescents from 1992 to 2010. J Abnorm Child Psychol. 2014;42:403–15.CrossRef
16.
go back to reference Rasch G. Probabilistic models for some intelligence and attainment tests. (Expanded ed.). Chichago: University of Chicago Press; 1980. Rasch G. Probabilistic models for some intelligence and attainment tests. (Expanded ed.). Chichago: University of Chicago Press; 1980.
17.
go back to reference Duncan OD. Rasch measurement: further examples and discussion. In: Turner CF, Martin E, editors. Surveying subjective phenomena. New York: Russel Sage foundation; 1984. p. 367–401. Duncan OD. Rasch measurement: further examples and discussion. In: Turner CF, Martin E, editors. Surveying subjective phenomena. New York: Russel Sage foundation; 1984. p. 367–401.
18.
go back to reference Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Care Res. 2007;57:1358–62.CrossRef Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Care Res. 2007;57:1358–62.CrossRef
19.
go back to reference Stenner AJ. Specific objectivity - local and general. Rasch Meas Trans. 1994;8(3):374. Stenner AJ. Specific objectivity - local and general. Rasch Meas Trans. 1994;8(3):374.
20.
go back to reference Perline R, Wright BD, Wainer H. The Rasch model as additive conjoint measurement. Appl Psychol Meas. 1979;3(2):237–55.CrossRef Perline R, Wright BD, Wainer H. The Rasch model as additive conjoint measurement. Appl Psychol Meas. 1979;3(2):237–55.CrossRef
21.
go back to reference Andrich D. Distinctions between assumptions and requirements in measurement in the social sciences. In: Keats JA, Taft R, Heath RA, Lovibond SH, editors. Mathematical and theoretical systems. North-Holland: Elsevier Science Publishers BV; 1989. p. 7–16. Andrich D. Distinctions between assumptions and requirements in measurement in the social sciences. In: Keats JA, Taft R, Heath RA, Lovibond SH, editors. Mathematical and theoretical systems. North-Holland: Elsevier Science Publishers BV; 1989. p. 7–16.
22.
go back to reference Andersen EB. Sufficient statistics and latent trait models. Psychometrika. 1977;42(1):69–81.CrossRef Andersen EB. Sufficient statistics and latent trait models. Psychometrika. 1977;42(1):69–81.CrossRef
23.
go back to reference Andrich D, Marais I. A course in Rasch measurement theory: measuring in the educational, social and health sciences. Singapore: Springer; 2019.CrossRef Andrich D, Marais I. A course in Rasch measurement theory: measuring in the educational, social and health sciences. Singapore: Springer; 2019.CrossRef
24.
go back to reference Hagquist C, Bruce M, Gustavsson JP. Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009;46:380–93.CrossRef Hagquist C, Bruce M, Gustavsson JP. Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009;46:380–93.CrossRef
25.
go back to reference Hagquist C. Explaining differential item functioning focusing on the crucial role of external information–an example from the measurement of adolescent mental health. BMC Med Res Methodol. 2019;19(1):185.CrossRef Hagquist C. Explaining differential item functioning focusing on the crucial role of external information–an example from the measurement of adolescent mental health. BMC Med Res Methodol. 2019;19(1):185.CrossRef
26.
go back to reference Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.CrossRef Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.CrossRef
27.
go back to reference Salzberger T, Sinkovics RR. Reconsidering the problem of data equivalence in international marketing research: contrasting approaches based on CFA and the Rasch model for measurement. Int Mark Rev. 2006;23:390–417.CrossRef Salzberger T, Sinkovics RR. Reconsidering the problem of data equivalence in international marketing research: contrasting approaches based on CFA and the Rasch model for measurement. Int Mark Rev. 2006;23:390–417.CrossRef
28.
go back to reference Kleppang AL, Hagquist C. The psychometric properties of the Hopkins Symptom Checklist-10: a Rasch analysis based on adolescent data from Norway. Fam Pract. 2016;33:740–5.CrossRef Kleppang AL, Hagquist C. The psychometric properties of the Hopkins Symptom Checklist-10: a Rasch analysis based on adolescent data from Norway. Fam Pract. 2016;33:740–5.CrossRef
30.
go back to reference Masters GN. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.CrossRef Masters GN. A Rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.CrossRef
31.
go back to reference Hagell P. Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the Rasch model: the primacy of theory over statistics. Open J Stat. 2014;4:456–65.CrossRef Hagell P. Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the Rasch model: the primacy of theory over statistics. Open J Stat. 2014;4:456–65.CrossRef
32.
go back to reference Smith EV. Understanding Rasch measurement: detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.PubMed Smith EV. Understanding Rasch measurement: detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.PubMed
33.
go back to reference Andrich D, Humphry SM, Marais I. Quantifying local, response dependence between two polytomous items using the Rasch model. Appl Psychol Meas. 2012;36:309–24.CrossRef Andrich D, Humphry SM, Marais I. Quantifying local, response dependence between two polytomous items using the Rasch model. Appl Psychol Meas. 2012;36:309–24.CrossRef
34.
go back to reference Lantz B. The large sample size fallacy. Scand J Caring Sci. 2013;27:487–92.CrossRef Lantz B. The large sample size fallacy. Scand J Caring Sci. 2013;27:487–92.CrossRef
35.
go back to reference Bergh D. Chi-squared test of fit and sample size-a comparison between a random sample approach and a chi-square value adjustment method. J Appl Meas. 2015;16:204–17.PubMed Bergh D. Chi-squared test of fit and sample size-a comparison between a random sample approach and a chi-square value adjustment method. J Appl Meas. 2015;16:204–17.PubMed
36.
go back to reference Hagquist C, Andrich D. Recent advances in analysis of differential item functioning in health research using the Rasch model. Health Qual Life Outcomes. 2017;15:1–8.CrossRef Hagquist C, Andrich D. Recent advances in analysis of differential item functioning in health research using the Rasch model. Health Qual Life Outcomes. 2017;15:1–8.CrossRef
37.
go back to reference Andrich D, Hagquist C. Real and artificial differential item functioning in polytomous items. Educ Psychol Meas. 2014;75(2):185–207.CrossRef Andrich D, Hagquist C. Real and artificial differential item functioning in polytomous items. Educ Psychol Meas. 2014;75(2):185–207.CrossRef
38.
go back to reference Andrich D, Sheridan B, Luo G. RUMM2030: a windows program for the Rasch unidimensional measurement model [computer software]. Perth: RUMM Laboratory; 2013. Andrich D, Sheridan B, Luo G. RUMM2030: a windows program for the Rasch unidimensional measurement model [computer software]. Perth: RUMM Laboratory; 2013.
39.
go back to reference Cavanagh A, Caputi P, Wilson CJ, Kavanagh DJ. Gender differences in self-reported depression and co-occurring anxiety and stress in a vulnerable community population. Aust Psychol. 2016;51(6):411–21.CrossRef Cavanagh A, Caputi P, Wilson CJ, Kavanagh DJ. Gender differences in self-reported depression and co-occurring anxiety and stress in a vulnerable community population. Aust Psychol. 2016;51(6):411–21.CrossRef
40.
go back to reference Masters GN. Item discrimination: when more is worse. J Educ Meas. 1988;25(1):15–29.CrossRef Masters GN. Item discrimination: when more is worse. J Educ Meas. 1988;25(1):15–29.CrossRef
41.
go back to reference Gradisar M, Gardner G, Dohnt H. Recent worldwide sleep patterns and problems during adolescence: a review and meta-analysis of age, region, and sleep. Sleep Med. 2011;12(2):110–8.CrossRef Gradisar M, Gardner G, Dohnt H. Recent worldwide sleep patterns and problems during adolescence: a review and meta-analysis of age, region, and sleep. Sleep Med. 2011;12(2):110–8.CrossRef
42.
go back to reference Robichaud M, Dugas MJ, Conway M. Gender differences in worry and associated cognitive-behavioral variables. J Anxiety Disord. 2003;17:501–16.CrossRef Robichaud M, Dugas MJ, Conway M. Gender differences in worry and associated cognitive-behavioral variables. J Anxiety Disord. 2003;17:501–16.CrossRef
Metadata
Title
Using Rasch measurement theory to assess the psychometric properties of a depressive symptoms scale in Norwegian adolescents
Authors
Annette Løvheim Kleppang
Anne Mari Steigen
Hanne Søberg Finbråten
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2020
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-020-01373-5

Other articles of this Issue 1/2020

Health and Quality of Life Outcomes 1/2020 Go to the issue