Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-09-2008 | Original Paper

The Psychometric Properties of the Colorado Symptom Index

Authors: Roger A. Boothroyd, Huey Jen Chen

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 5/2008

Abstract

The Colorado Symptom Index (CSI: Shern et al. 1994, Milbank Quart 72:123–148) is widely used in research as a self-report measure of psychiatric symptomatology, yet little information exists regarding the scale’s psychometric properties. Additionally, the CSI has no cut-off score denoting the need for further psychiatric assessment. This study examined the CSI’s psychometric properties and established a cut-off score. Analyses were based on 3,874 adult Florida Medicaid respondents. The CSI had excellent internal consistency (.92) and test-retest reliability (.71). Evidence of the CSI’s validity was strong; CSI scores distinguished among individuals with and without mental health services needs and were significantly correlated with functioning. Results using a contrasting groups approach indicate that 30 is a reasonable “clinical” cut-off score. At this score, the CSI had respectable sensitivity (.76) and specificity (.68) and a ROC curve analysis suggests that the CSI is “fair to good” discriminator of individuals with psychiatric disabilities.

Addy, J., Mundil, K., Parker, T., & Talbott, P. (2008). Intensive case management for behavioral health jail diversion: The Lancaster county, Nebraska approach. American Jails, 21(6), 31–40.

Boothroyd, R. A., & Shern, D. L. (1998). Accessing the feasibility of using mail survey Methodology with Medicaid enrollees: A summary of a pilot study for the member survey. Tampa, FL: Louis de la Parte Florida Mental Health Institute, University of South Florida.

Ciarlo, J. A., & Reihman, J. (1977). The Denver community mental health questionnaire: Development of a multi-dimensional program evaluation instrument. In R. Coursey, G. Spector, S. Murrell, & B. Hunt (Eds.), Program evaluation for mental health: Methods, strategies, and participants (pp. 131–167). New York: Grune and Stratton.

Ciarlo, J. A., Edwards, D. W., Kiresuk, T. J., et al. (1981). The assessment of client/patient outcome: Techniques for use in mental health programs (Contract No. 278-80-0005). Washington, DC: National Institute of Mental Health.

Clark, C., & Rich, A. (2003). Outcomes of homeless adults with mental illness in a housing program and in case management only. Psychiatric Services (Washington, DC), 54, 78–83. doi:10.1176/appi.ps.54.1.78.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.

Conrad, K. J., Yagelka, J. R., Matters, M. D., Rich, A. R., Williams, V., & Buchanan, M. (2001). Reliability and validity of a Modified Colorado Symptom Index in a national homeless sample. Mental Health Services Research, 3(3), 141–153. doi:10.1023/A:1011571531303.PubMedCrossRef

Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: Wiley.

Ellis, R., Wilson, N., & Foster, F. (1984). Statewide treatment outcome assessment in Colorado: The Colorado Client Assessment Record (CCAR). Community Mental Health Journal, 20, 72–88. doi:10.1007/BF00754105.PubMedCrossRef

Godfrey, J., Salyers, M., Mueser, K., & Labriola, S. (2006) Psychometrics of a recovery scale. Paper presented in the Conference on State Mental Health Agency Services Research, Program Evaluation and Policy Research to Inform the System Transformation Process. February 13, 2006.

Greenwood, R. M., Schaefer-McDaniel, N. J., Winkel, G., & Tsemberis, S. J. (2005). Decreasing psychiatric symptoms by increasing choice in services for adults with histories of homelessness. American Journal of Community Psychology, 36(3/4), 223–238. doi:10.1007/s10464-005-8617-z.PubMedCrossRef

Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981). Selection and interpretation of diagnostic tests and procedures. Annals of Internal Medicine, 94, 555–600.

Kahng, S. K., Oyserman, D., Bybee, D., & Mowbray, C. (2008). Mothers with severe mental illness: When symptom declines, does parenting improve? Journal of Family Psychology, 22(1), 162–166. doi:10.1037/0893-3200.22.1.162.PubMedCrossRef

Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a Receiver Operating Characteristic (ROC) curve. Radiology, 43, 29–36.

Laudet, A. B., Magura, S., Cleland, C. M., Vogel, H. S., Knight, E. L., & Rosenblum, A. (2004). The effect of 12-Step based fellowship participation on abstinence among dually diagnosed persons: A 2-year longitudinal study. Journal of Psychoactive Drugs, 36(2), 207–221.PubMed

Lee, B., Shern, D., Coen, A., Bartsch, D., & Wilson, N. (2003).The Colorado Symptom Index: A measure of symptom distress for persons with severe and persistent mental illness. Unpublished Manuscript.

Lehman, A. F., Dixon, L. B., Kernan, E., DeForge, B. R., & Postrado, L. T. (1997). A randomized trail of assertive community treatment for homeless persons with severe mental illness. Archives of General Psychiatry, 54(11), 1038–1043.PubMed

Livingston, S. A., & Zieky, M. J. (1982). Passing scores. Princeton, NJ: Educational Testing Service.

Magura, S., Laudet, A. B., Mahmood, D., Rosenblum, A., Vogel, H. S., & Knight, E. L. (2003). Role of self-help processes in achieving abstinence among dually diagnosed persons. Addictive Behaviors, 28, 399–413. doi:10.1016/S0306-4603(01)00278-7.PubMedCrossRef

Marx, R. G., Menezes, A., Horovitz, L., Jones, E. C., & Warren, R. F. (2003). A comparison of two time intervals for test-retest reliability of health status instruments. Journal of Clinical Epidemiology, 56(8), 730–735. doi:10.1016/S0895-4356(03)00084-2.PubMedCrossRef

Mowbray, C. T., Bybee, D., Oyserman, D., & MacFarlane, P. (2005). Timing of mental illness onset and motherhood. The Journal of Nervous and Mental Disease, 193(6), 369–378. doi:10.1097/01.nmd.0000165088.82453.bd.PubMedCrossRef

Murry-Swank, A., Goldberg, R., Dickerson, F., Medoff, D., Wohleiter, K., & Dixon, L. (2007). Correlates of religious service attendance and contact with religious leaders among persons with co-occurring serious mental illness and Type 2 diabetes. The Journal of Nervous and Mental Disease, 195(5), 382–388.

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed., pp. 264–265). New York, NY: McGraw-Hill Series in Psychology, McGraw-Hill, Inc.

Salant, P. A., & Dillman, D. A. (1994). How to conduct your own survey. New York: Wiley.

Salyers, M. P., Bosworth, H. B., Swanson, J. W., Lamb-Pagone, J., & Osher, F. C. (2000). Reliability and validity of the SF-12 health survey among people with sever mental illness. Medical Care, 38(11), 1141–1150. doi:10.1097/00005650-200011000-00008.PubMedCrossRef

Shern, D. L., Wilson, N. Z., Coen, A. S., Patrick, D. C., Foster, M., Bartsch, D. A., et al. (1994). Client outcomes II: Longitudinal client data from the Colorado Treatment Outcome Study. The Milbank Quarterly, 72, 123–148. doi:10.2307/3350341.PubMedCrossRef

Tsemberis, S., Gulcur, L., & Nakae, M. (2004). Housing first, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. American Journal of Public Health, 94(4), 651–656.PubMedCrossRef

Ware, J. E., Kosinski, M., & Keller, S. D. (1995). SF-12: How to score the SF-12 physical and mental health summary scales. Boston, MA: The Health Institute.

Ware, J., Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 32(3), 220–233. doi:10.1097/00005650-199603000-00003.CrossRef

Zweig, M. H., & Campbell, G. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561–577.PubMed

Title: The Psychometric Properties of the Colorado Symptom Index
Authors: Roger A. Boothroyd
Huey Jen Chen
Publication date: 01-09-2008
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 5/2008
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-008-0179-6

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The Psychometric Properties of the Colorado Symptom Index

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2008

Travel Distance and the Use of Inpatient Care among Patients with Schizophrenia

Enhancing Schools’ Capacity to Support Children in Poverty: An Ecological Model of School-Based Mental Health Services

Treatment Content in Child and Adolescent Mental Health Services: Development of the Treatment Recording Sheet

Therapist Adherence and Organizational Effects on Change in Youth Behavior Problems One Year After Multisystemic Therapy

Results of an Innovative University-based Recovery Education Program for Adults with Psychiatric Disabilities

Improving Integrated General Medical and Mental Health Services in Community-based Practices