Skip to main content
Top
Published in: Quality of Life Research 1/2017

01-01-2017 | Brief Communication

Exploring measurement invariance by gender in the profile of mood states depression subscale among cancer survivors

Authors: Jihye Kim, Tenbroeck Smith

Published in: Quality of Life Research | Issue 1/2017

Login to get access

Abstract

Purpose

The Profile of Mood States-Short Form (POMS-SF) is a well-validated tool commonly used in medical/clinical research. Less attention has been paid to the measurement invariance of the POMS—the degree to which the structure and items behave similarly for different groups (e.g., women and men). This study investigated the measurement invariance of the POMS Depression subscale across gender groups in a sample of cancer survivors.

Methods

The POMS Depression subscale has 8 items (Unhappy, Sad, Blue, Hopeless, Discouraged, Miserable, Helpless, and Worthless). Invariance was measured using multigroup confirmatory factor analysis. This study used data from American Cancer Society Studies of Cancer Survivors-II, a population-based survey of adult cancer survivors (n = 9170).

Results

We found factor structures and factor loadings were invariant for gender groups, but moderate differential item functioning (DIF) in the question containing the word blue.

Conclusion

With regard to cancer survivors’ gender, we found the Depression subscale of the POMS-SF had configural invariance, and partial metric and scalar invariance. This suggests that results should be interpreted with caution, especially when gender is considered important. More broadly, our finding suggests that questions with the word blue may introduce DIF into other measures of depressive mood. More research is needed to replicate these findings in other samples and with other instruments.
Appendix
Available only for authorised users
Literature
2.
go back to reference Anderson, B. L., DeRubeis, R. J., Berman, B. S., Gruman, J., Champion, V. L., Massie, M. J., et al. (2014). Screening, assessment, and care of anxiety and depressive symptoms in adults with cancer: An American Society of Clinical Oncology guideline adaption. Journal of Clinical Oncology, 32(15), 1605–1619.CrossRef Anderson, B. L., DeRubeis, R. J., Berman, B. S., Gruman, J., Champion, V. L., Massie, M. J., et al. (2014). Screening, assessment, and care of anxiety and depressive symptoms in adults with cancer: An American Society of Clinical Oncology guideline adaption. Journal of Clinical Oncology, 32(15), 1605–1619.CrossRef
3.
go back to reference Brunet, J., Sabiston, C. M., Chaiton, M., Low, N. C., Contrera, G., Barnett, T. A., et al. (2014). Measurement invariance of the depressive symptoms scale during adolescence. BMC Psychiatry, 14, 95–105.CrossRefPubMedPubMedCentral Brunet, J., Sabiston, C. M., Chaiton, M., Low, N. C., Contrera, G., Barnett, T. A., et al. (2014). Measurement invariance of the depressive symptoms scale during adolescence. BMC Psychiatry, 14, 95–105.CrossRefPubMedPubMedCentral
4.
go back to reference Cella, D., & Stone, A. A. (2015). Health-related quality of life measurement in oncology. American Psychologist, 70(2), 175–185.CrossRefPubMed Cella, D., & Stone, A. A. (2015). Health-related quality of life measurement in oncology. American Psychologist, 70(2), 175–185.CrossRefPubMed
5.
go back to reference Curran, S. L., Andrykowski, M. A., & Studts, J. L. (1995). Short form of the Profile of Mood States (POMS-SF): Psychometric information. Psychological Assessment, 7(1), 80–83.CrossRef Curran, S. L., Andrykowski, M. A., & Studts, J. L. (1995). Short form of the Profile of Mood States (POMS-SF): Psychometric information. Psychological Assessment, 7(1), 80–83.CrossRef
6.
go back to reference Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299.CrossRef Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299.CrossRef
7.
go back to reference Finney, S. J., & DiStefano, C. (2006). Dealing with nonnormality and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Chapter in a second course in structural equation modeling. Greenwich: Information Age Publishing, Inc. Finney, S. J., & DiStefano, C. (2006). Dealing with nonnormality and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Chapter in a second course in structural equation modeling. Greenwich: Information Age Publishing, Inc.
8.
go back to reference Goe, L., Bell, C., & Little, O. (2008). Approaches to evaluating teacher effectiveness: A research synthesis. Washington: National Comprehensive Center for Teacher Quality. Goe, L., Bell, C., & Little, O. (2008). Approaches to evaluating teacher effectiveness: A research synthesis. Washington: National Comprehensive Center for Teacher Quality.
9.
go back to reference Grant, B. F., & Weissman, M. M. (2007). Gender and the prevalence of psychiatric disorders. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 31–46). Washington: American Psychiatric Association. Grant, B. F., & Weissman, M. M. (2007). Gender and the prevalence of psychiatric disorders. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 31–46). Washington: American Psychiatric Association.
10.
go back to reference Hennessy, C. H., Moriarty, D. G., Zack, M. M., Scherr, P. A., & Brackbill, R. (1994). Measuring health-related quality of life for public health surveillance. Public Health Reports, 109, 665–672.PubMedPubMedCentral Hennessy, C. H., Moriarty, D. G., Zack, M. M., Scherr, P. A., & Brackbill, R. (1994). Measuring health-related quality of life for public health surveillance. Public Health Reports, 109, 665–672.PubMedPubMedCentral
11.
go back to reference Holland, P. W., & Wainer, H. (1993). Differential item functioning. New York: Routledge. Holland, P. W., & Wainer, H. (1993). Differential item functioning. New York: Routledge.
12.
go back to reference Isometsã, E. T., Heikkinen, M., Marttunen, M., Henriksson, M., Aro, H., Kuoppasalmi, K., et al. (1997). Mental disorders in young and middle aged men who commit suicide. The British Medical Journal, 310(6991), 1366–1367.CrossRef Isometsã, E. T., Heikkinen, M., Marttunen, M., Henriksson, M., Aro, H., Kuoppasalmi, K., et al. (1997). Mental disorders in young and middle aged men who commit suicide. The British Medical Journal, 310(6991), 1366–1367.CrossRef
13.
go back to reference Jodoin, M., & Girl, M. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329–349.CrossRef Jodoin, M., & Girl, M. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329–349.CrossRef
14.
go back to reference Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543.CrossRef Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543.CrossRef
15.
go back to reference Millsap, R. E., & Kwok, O. M. (2004). Evaluating the impact of partial measurement invariance on selection in two populations. Psychological Methods, 9, 93–115.CrossRefPubMed Millsap, R. E., & Kwok, O. M. (2004). Evaluating the impact of partial measurement invariance on selection in two populations. Psychological Methods, 9, 93–115.CrossRefPubMed
16.
go back to reference NcNair, D. M., Lorr, M., & Droppleman, L. F. (1992). Revised manual for the 16 Profile of Mood States. San Diego: Educational and Industrial Testing Services. NcNair, D. M., Lorr, M., & Droppleman, L. F. (1992). Revised manual for the 16 Profile of Mood States. San Diego: Educational and Industrial Testing Services.
17.
go back to reference Plecki, M. L., Elfers, A. M., & Nakamura, Y. (2012). Using evidence for teacher education program improvement and accountability: An illustrative case of the role of value-added measures. Journal of Teacher Education, 63, 318–334.CrossRef Plecki, M. L., Elfers, A. M., & Nakamura, Y. (2012). Using evidence for teacher education program improvement and accountability: An illustrative case of the role of value-added measures. Journal of Teacher Education, 63, 318–334.CrossRef
18.
go back to reference Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566.CrossRefPubMed Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566.CrossRefPubMed
19.
go back to reference Raju, N. S., Oshima, T. C., van Der Linden, W. J., & Fleer, P. F. (1995). An IRT-based internal measure of test bias with applications for differential item functioning. Applied Psychological Measurement, 19, 353–368.CrossRef Raju, N. S., Oshima, T. C., van Der Linden, W. J., & Fleer, P. F. (1995). An IRT-based internal measure of test bias with applications for differential item functioning. Applied Psychological Measurement, 19, 353–368.CrossRef
20.
go back to reference Shacham, S. (1983). A shortened version of the Profile of Mood States. Journal of Personality Assessment, 47, 305–306.CrossRefPubMed Shacham, S. (1983). A shortened version of the Profile of Mood States. Journal of Personality Assessment, 47, 305–306.CrossRefPubMed
21.
go back to reference Shear, K., Halmi, K. A., Widiger, T. A., & Boyce, C. (2007). Sociocultural factors and gender. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 65–79). Washington: American Psychiatric Association. Shear, K., Halmi, K. A., Widiger, T. A., & Boyce, C. (2007). Sociocultural factors and gender. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 65–79). Washington: American Psychiatric Association.
22.
go back to reference Smith, T., Stein, K. D., Mehta, C. C., Kaw, C., Kepner, J. L., Buskirk, T., et al. (2007). The rationale, design, and implementation of the American Cancer Society’s studies of cancer survivors. Cancer, 1(1), 1–12.CrossRef Smith, T., Stein, K. D., Mehta, C. C., Kaw, C., Kepner, J. L., Buskirk, T., et al. (2007). The rationale, design, and implementation of the American Cancer Society’s studies of cancer survivors. Cancer, 1(1), 1–12.CrossRef
23.
go back to reference Substance Abuse and Mental Health Services Administration. Results from the 2013 National Survey on Drug Use and Health: Mental health findings, NSDUH Series H-49, HHS Publication No. (SMA) 14-4887. Rockville: Substance Abuse and Mental Health Services Administration, 2014. Substance Abuse and Mental Health Services Administration. Results from the 2013 National Survey on Drug Use and Health: Mental health findings, NSDUH Series H-49, HHS Publication No. (SMA) 14-4887. Rockville: Substance Abuse and Mental Health Services Administration, 2014.
Metadata
Title
Exploring measurement invariance by gender in the profile of mood states depression subscale among cancer survivors
Authors
Jihye Kim
Tenbroeck Smith
Publication date
01-01-2017
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 1/2017
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1452-x

Other articles of this Issue 1/2017

Quality of Life Research 1/2017 Go to the issue