Skip to main content
Top
Published in: Community Mental Health Journal 4/2009

Open Access 01-08-2009 | Original Paper

Psychometric Properties of an Assessment for Mental Health Recovery Programs

Authors: Dennis G. Fisher, David Pilon, Scott L. Hershberger, Grace L. Reynolds, Stephen C. LaMaster, Monica Davis

Published in: Community Mental Health Journal | Issue 4/2009

Login to get access

Abstract

The concept of recovery can be operationalized from either the point of view of the consumer, or from the perspective of the agency providing services. The Milestones of Recovery Scale (MORS) was created to capture aspects of recovery from the agency perspective. Evidence establishing the psychometric properties of the MORS was obtained in three efforts: Inter-rater reliability using staff at The Village, a multi-service organization serving the homeless mentally ill in Long Beach, California; inter-rater reliability was also obtained from Vinfen Corporation, a large provider of housing services to mentally ill persons in Boston, Massachusetts. A test–retest reliability study was conducted using staff rating of clients at The Village, and evidence for validity was obtained using the Level of Care Utilization System (LOCUS) as a validity measure. The intra-class correlation coefficient for the inter-rater reliability study was r = .85 (CI .81, .89) for The Village and r = .86 (CI .80, .90) for Vinfen Corporation; test–retest reliability was r = .85 (CI .81, .87); and validity coefficients for the LOCUS were at or above r = .49 for all subscales except one. There is sufficient evidence for the reliability and validity of the MORS.
Literature
go back to reference Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33(6), 766–771.PubMed Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33(6), 766–771.PubMed
go back to reference Falloon, I. R. H., Economou, M., Palli, A., Malm, U., Mizuno, M., Murakami, M., et al. (2005). The clinical strategies implementation scale to measure implementation of treatment in mental health services. Psychiatric Services, 56(12), 1584–1590.PubMedCrossRef Falloon, I. R. H., Economou, M., Palli, A., Malm, U., Mizuno, M., Murakami, M., et al. (2005). The clinical strategies implementation scale to measure implementation of treatment in mental health services. Psychiatric Services, 56(12), 1584–1590.PubMedCrossRef
go back to reference Greenberg, G. A., & Rosenheck, R. A. (2005). Using the GAF as a national mental health outcome measure in the Department of Veterans Affairs. Psychiatric Services, 56(4), 420–426.PubMedCrossRef Greenberg, G. A., & Rosenheck, R. A. (2005). Using the GAF as a national mental health outcome measure in the Department of Veterans Affairs. Psychiatric Services, 56(4), 420–426.PubMedCrossRef
go back to reference Hall, R. C. (1995). Global assessment of functioning. A modified scale. Psychosomatics, 36, 267–275.PubMed Hall, R. C. (1995). Global assessment of functioning. A modified scale. Psychosomatics, 36, 267–275.PubMed
go back to reference Kidd, S. A., Styron, T. H., Carlson, S., & Hoge, M. (2004). Utilization management for residential programs. Administration and Policy in Mental Health, 31(6), 435–448.PubMedCrossRef Kidd, S. A., Styron, T. H., Carlson, S., & Hoge, M. (2004). Utilization management for residential programs. Administration and Policy in Mental Health, 31(6), 435–448.PubMedCrossRef
go back to reference Littel, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS system for mixed models (2nd ed.). Cary, NC: SAS Institute, Inc. Littel, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS system for mixed models (2nd ed.). Cary, NC: SAS Institute, Inc.
go back to reference McGlynn, E. A. (1996). Setting the context for measuring patient outcomes. New Directions for Mental Health Services, 71, 19–32.PubMedCrossRef McGlynn, E. A. (1996). Setting the context for measuring patient outcomes. New Directions for Mental Health Services, 71, 19–32.PubMedCrossRef
go back to reference Moos, R. H., Nichol, A. C., & Moos, B. S. (2002). Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services, 53(6), 730–737.PubMedCrossRef Moos, R. H., Nichol, A. C., & Moos, B. S. (2002). Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services, 53(6), 730–737.PubMedCrossRef
go back to reference Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory. New York, NY: McGraw-Hill, Inc. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory. New York, NY: McGraw-Hill, Inc.
go back to reference O’Hare, T., Sherrer, M. V., Connery, H. S., Thornton, J., LaButti, A., & Emrick, K. (2003). Further validation of the psycho-social well-being Scale (PSWS) with community clients. Community Mental Health Journal, 39(2), 115–129.PubMedCrossRef O’Hare, T., Sherrer, M. V., Connery, H. S., Thornton, J., LaButti, A., & Emrick, K. (2003). Further validation of the psycho-social well-being Scale (PSWS) with community clients. Community Mental Health Journal, 39(2), 115–129.PubMedCrossRef
go back to reference Pilon, D., LaMaster, S., & Fisher, D. G. (2006). Knowing it when we see it: A proposed system for measuring recovery. Paper presented at the United States Psychiatric Rehabilitation Association Conference, Phoenix, AZ. Pilon, D., LaMaster, S., & Fisher, D. G. (2006). Knowing it when we see it: A proposed system for measuring recovery. Paper presented at the United States Psychiatric Rehabilitation Association Conference, Phoenix, AZ.
go back to reference Resnick, S. G. (2005). Fidelity measurement, the CSI, and the current evidence base. Psychiatric Services, 56(12), 1592.PubMedCrossRef Resnick, S. G. (2005). Fidelity measurement, the CSI, and the current evidence base. Psychiatric Services, 56(12), 1592.PubMedCrossRef
go back to reference Sirey, J. A., Meyers, B. S., Teresi, J. A., Bruce, M. L., Ramirez, M., Raue, P. J., et al. (2005). The cornell service index as a measure of health service use. Psychiatric Services, 56(12), 1564–1569.PubMedCrossRef Sirey, J. A., Meyers, B. S., Teresi, J. A., Bruce, M. L., Ramirez, M., Raue, P. J., et al. (2005). The cornell service index as a measure of health service use. Psychiatric Services, 56(12), 1564–1569.PubMedCrossRef
go back to reference Sowers, W. (2005). Transforming systems of care: The American Association of Community Psychiatrists guidelines for recovery oriented services. Community Mental Health Journal, 41(6), 757–774.PubMedCrossRef Sowers, W. (2005). Transforming systems of care: The American Association of Community Psychiatrists guidelines for recovery oriented services. Community Mental Health Journal, 41(6), 757–774.PubMedCrossRef
go back to reference Sowers, W., George, C., & Thompson, K. (1999). Level of care utilization system for psychiatric and addiction services (LOCUS): A preliminary assessment of reliability and validity. Community Mental Health Journal, 35(6), 545–563.PubMedCrossRef Sowers, W., George, C., & Thompson, K. (1999). Level of care utilization system for psychiatric and addiction services (LOCUS): A preliminary assessment of reliability and validity. Community Mental Health Journal, 35(6), 545–563.PubMedCrossRef
go back to reference Sowers, W., Pumariega, A., Huffine, C., & Fallon, T. (2003). Level-of-care decision making in behavioral health services: The Locus and the Calocus. Psychiatric Services, 54(11), 1461–1463.PubMedCrossRef Sowers, W., Pumariega, A., Huffine, C., & Fallon, T. (2003). Level-of-care decision making in behavioral health services: The Locus and the Calocus. Psychiatric Services, 54(11), 1461–1463.PubMedCrossRef
go back to reference Test, M. A., Greenberg, J. S., Long, J. D., Brekke, J. S., & Burke, S. S. (2005). Construct validity of a measure of subjective satisfaction with life of adults with serious mental illness. Psychiatric Services, 56(3), 292–300.PubMedCrossRef Test, M. A., Greenberg, J. S., Long, J. D., Brekke, J. S., & Burke, S. S. (2005). Construct validity of a measure of subjective satisfaction with life of adults with serious mental illness. Psychiatric Services, 56(3), 292–300.PubMedCrossRef
go back to reference Trauer, T., & Tobias, G. (2004). The Camberwell assessment of need and behaviour and symptom identification scale as routine outcome measures in a psychiatric disability rehabilitation and support service. Community Mental Health Journal, 40(3), 211–221.PubMedCrossRef Trauer, T., & Tobias, G. (2004). The Camberwell assessment of need and behaviour and symptom identification scale as routine outcome measures in a psychiatric disability rehabilitation and support service. Community Mental Health Journal, 40(3), 211–221.PubMedCrossRef
go back to reference Uehara, E. S., Srebnik, D. S., & Smukler, M. (2003). Statistical and consensus-based strategies for grouping consumers in mental health level-of-care schemes. Administration and Policy in Mental Health, 30(4), 287–306.PubMedCrossRef Uehara, E. S., Srebnik, D. S., & Smukler, M. (2003). Statistical and consensus-based strategies for grouping consumers in mental health level-of-care schemes. Administration and Policy in Mental Health, 30(4), 287–306.PubMedCrossRef
Metadata
Title
Psychometric Properties of an Assessment for Mental Health Recovery Programs
Authors
Dennis G. Fisher
David Pilon
Scott L. Hershberger
Grace L. Reynolds
Stephen C. LaMaster
Monica Davis
Publication date
01-08-2009
Publisher
Springer US
Published in
Community Mental Health Journal / Issue 4/2009
Print ISSN: 0010-3853
Electronic ISSN: 1573-2789
DOI
https://doi.org/10.1007/s10597-009-9213-8

Other articles of this Issue 4/2009

Community Mental Health Journal 4/2009 Go to the issue