Top

Published in:

01-10-2007

The Hoosier Assurance Plan Instrument for Adults (HAPI-A): The Psychometric Properties of a Level of Functioning Assessment Instrument Designed for Use in a State Managed Care Mental Health Program

Authors: John McGrew, Ph.D., Frederick L. Newman, Ph.D., Richard N. DeLiberty, M.S.W.

Published in: Community Mental Health Journal | Issue 5/2007

Abstract

The psychometric properties of the HAPI-A were examined at intake and 90-day follow-up in consumers with mental illness (MI) or chronic addiction (CA) being served at one of 11 treatment facilities (n = 1168). A 4-factor subscale structure was confirmed and factor invariance tests indicated a single model for the CA and MI samples. Internal consistency and inter-rater reliability were good (ICCs = 0.72–0.88). Factor scores correlated with GAF ratings and predicted membership in severity/cost groupings proposed for setting reimbursement rates. Sensitivity to change was confirmed for all four factors for the CA sample and for three of four factors for the MI sample.

Available only for authorised users

American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC: Author.

Arbuckle J. L. (2003). Amos 5.0 update to the Amos user’s guide. Chicago, IL: SmallWaters Corp

Arbuckle, J. L. (2005). Amos 6.0 User’s Guide. Chicago, IL: SPSS Inc.

Barker S., Barron N., McFarland B. (1994). A community ability scale for chronically mentally ill consumers: I. Reliability and validity. Community Mental Health Journal 30:363–379PubMedCrossRef

Bieber, J., Wroblewski, J. M., & Barber, C. A. (1999). Design and implementation of an outcomes management system within inpatient and outpatient behavioral health settings. In M. E. Maruish (Ed.), The use of psychological testing for treatment planing and outcomes assessment (2nd ed., pp. 171–210). Mahwah, NJ, US: Lawrence Erlbaum Associates

Burlingame G. M., Dunn T. W., Chen S., Lehman A., Axman R. et al. (2005). Selection of outcome assessment instruments for inpatients with severe and persistent mental illness. Psychiatric Services 56:444–451PubMedCrossRef

Butcher J. N., Graham J. R., Ben-Porath Y. S. (1995). Methodological problems and issues in MMPI, MMPI-2, and MMPI-A research. Psychological Assessment 7:320–329CrossRef

Byrne B. M. (1989). A primer of LISREL: Basic applications and programming for confirmatory factor analytic models. New York: Springer-Verlag

Byrne, B. (2001). Structural equation modeling with AMOS: Basic concepts, applications and programming. Mahwah, NJ: Lawrence Erlbaum.

Carmines E. G., McIver J. P. (1981). Analyzing models with unobserved variables. In Bohrnsted G. W., Borgatta E. F. (Eds.) Social measurement: Current issues (pp. 65–118). Beverly Hills: Sage

Ciarlo, J. A., Brown, T. R., Edwards, D. W., Kiresuk, T. J., & Newman, F. L. (1986). Assessing mental health treatment outcome measurement techniques (DHHS Publication No. ADM 86–1301). Washington, DC: Superintendent of Documents, US Government Printing Office.

Cohen J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Asssociates

Comrey, A., & Lee, H. (1992). A first course in factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

Crane-Ross, D., Roth, D. & Lauber, B. (2000). Consumers and case managers perceptions of mental health service needs. Community Mental Health Journal, 26, 161–178.CrossRef

Crits-Christoph P., Gladis M., Connolly M. (2002). Outcome measurement in patients receiving psychosocial treatments. In W. IsHak, T. Burt, L. Sederer (Eds.), Outcome measurement in psychiatry: A critical review (pp. 121–138). Arlington, VA.: American Psychiatric Association

Dawes, R. M. (1999). Two methods for studying incremental validity of a Rorschach variable. Psychological Assessment, 11, 297–302.

DeLiberty R. N., Newman F. L., Ward E. O. (2001). Risk adjustment in the Hoosier Assurance Plan: Impact on providers. Journal of Behavioral Health Services & Research 28(3):301–318CrossRef

Dickerson F. (1997). Assessing clinical outcomes: The community functioning of persons with serious mental illness. Psychiatric Services 48:897–902PubMed

Eisen S., Dill D., Grob M. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome and evaluation. Hospital and Community Psychiatry 45:242–247PubMed

Ellis R. J., Wackwitz J. H., Foster M. (1991). Uses of an empirically derived client typology based on level of functioning: Twelve years of the CCAR. Journal of Mental Health Administration 18:88–100PubMedCrossRef

Felker B., Yazel J., Short D. (1996) Mortality and medical comorbidity among psychiatric patients: A review. Psychiatric Services 47:1356–1363PubMed

Foster S. L., Cone J. D. (1995). Validity issues in clinical assessment. Psychological Assessment 7:275–285CrossRef

Greenberg G. A, Rosenheck R. A. (2005). Using the GAF as a national mental health outcome measure in the Department of Veteran Affairs. Psychiatric services 56:420–426PubMedCrossRef

Hilsenroth M. J., Ackerman S. J., Blagys M. D., Baumann B. D., Baity M. R. et al. (2000). Reliability and validity of DSM-IV Axis V. American Journal of Psychiatry 157:1858–1863PubMedCrossRef

Howard K. I., Lueger R. J., Maling M. S., Martinovich A. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology 61:678–685PubMedCrossRef

Hu L., Bentler P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods 3:424–453CrossRef

Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press.

Lambert M. J., Hawkins E. J. (2004). Use of psychological tests for assessing treatment outcome. In M. E. Maruish (Ed.) The use of psychological testing for treatment planning and outcomes assessment (3 ed., pp. 171–196). Mahwah, NJ, US: Lawrence Erlbaum Associates

Lambert, M. J., & Lambert, J. M. (1999). Use of psychological tests for assessing treatment outcome. In M. E. Maruish (Ed.), The use of psychological testing for treatment planing and outcomes assessment (2nd ed., pp. 115–152). Mahwah, NJ, US: Lawrence Erlbaum Associates.

Marsh H. W., Hocevar D. (1985). Applications of confirmatory factor analysis to the study of self-concept: First- and higher-order factor models in their invariance across groups. Psychological Bulletin 97:62–582CrossRef

Maruish M. E. (Ed.) (1994). The use of psychological testing for treatment planning and outcomes assessment (2 ed.). Mahwah, NJ, US: Lawrence Erlbaum Associates

McLellan A. T., Luborsky L., O’Brien C. P., Woody G. E. (1980). An improved diagnostic instrument for substance abuse patients: The Addiction Severity Index. Journal of Nervous and Mental Disease 168:26–33PubMedCrossRef

Mercer, W. A., Inc. (1998). Actuarial needs assessment for FY 98 provider contracts, Final Report. Indianapolis, IN: Indiana Division of Mental Health.

Newman F., McGrew J., DeLiberty R. (1996). The hoosier assurance plan instrument for adults: Preliminary pilot study. Indianapolis, IN: Indiana Division of Mental Health

Newman F., McGrew J., DeLiberty R. (2006). Field test of the feasibility and validity of using the Hoosier Assurance Plan Instrument for Adults (HAPI-A) in a State Managed Care Mental Health Program. Indianapolis, IN: Indiana Division of Mental Health and Addictions

Newman F. L., Tejeda M. J. (1996) The need for research designed to support decisions in the delivery of mental health services. American Psychologist 51:1040–1049PubMedCrossRef

Newman F. L., Rugh, D., & Ciarlo, J. A. (2004). Guidelines for selecting psychological instruments for treatment planning and outcome assessment. In M. E. Maruish (Ed.), The use of psychological testing for treatment planing and outcomes assessment (3rd ed., pp. 197–214). Mahwah, NJ, US: Lawrence Erlbaum Associates.

Petry N., Tennen H., Affleck G. (2000). Stalking the elusive client variable in psychotherapy research. In C. R. Snyder, R. E. Ingram (Eds.) Handbook of psychological change: Psychotherapy processes and practices or the 21st century (pp 88–108). New York: John Wiley and Sons

President’s New Freedom Commission on Mental Health (2003). Achieving the promise: Transforming mental health care in America. Pub SMA 03–3832. Rockville, MD: Department of Health and Human Services

Project MATCH Research Group. (1997). Matching alcoholism treatments to client heterogeneity: Project MATCH posttreatment drinking outcomes. Journal of Studies on Alcohol, 58, 7–29.

Reis B. F., Brown L. G. (1999). Reducing psychotherapy dropouts: Maximizing perspective convergence in the psychotherapy dyad. Psychotherapy: Theory, Research, Practice, Training 36:123–136

Rosen A., Hadzi-Pavlovic D., Parker G. (1989). The life skills profile: A measure assessing function and disability in schizophrenia. Schizophrenia Bulletin 15:325–337PubMed

Sitzia J., Wood N. (1997). Patient satisfaction: A review of issues and concepts. Social Science and Medicine 45:1829–1843PubMedCrossRef

Smith T. (1997). Memo on state hospital inter rater reliability. Indianapolis, IN: Indiana Family and Social Services Administration, Division of Mental Health

Soderberg P., Tungstrom S., Armelius B. A. (2005). Reliability of Global Assessment of Functioning ratings made by clinical psychiatric staff. Psychiatric Services 56:434–438PubMedCrossRef

Sperry, L., Brill, P., Howard, K. I., & Grissan, G. (1996). Treatment outcomes in Psychotherapy and Psychiatric Interventions. New York: Brunner/Mazel.

Startup M., Jackson M. C., Bendix S. (2002). The concurrent validity of the Global Assessment of Functioning (GAF). British Journal of Clinical Psychology 41:417–422PubMedCrossRef

Sue S. (1977). Community mental health services to minority groups: Some optimism, some pessimism. American Psychologist 32:616–624PubMedCrossRef

Surgeon General’s Report on Mental Health. (1999). Washington, DC: Government Printing Office.

Swartz, M., Swanson, J., Hannon, M., Bosworth, H., Osher, F., Essock, S., Rosenberg, S., & Five-Site health and Risk Study Research Committee. (2003). Regular sources of medical care among persons with severe mental illness at risk of hepatitis C infection. Psychiatric Services, 54, 854–859.

Tungstrom S., Soderberg P., Armelius B. A. (2005). Reliability of global assessment of functioning ratings made by clinical psychiatric staff. Psychiatric Services 56:434–438PubMedCrossRef

Vandenberg R. J., Lance C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 3(1):4–69CrossRef

Weiner H. (1993). Multi-function needs assessment: The development of a functional assessment instrument. Psychosocial Rehabilitation Journal 16(4):51–61

Wierzbicki M., Pekarik G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice 29:190–195CrossRef

Wheaton B., Muthén B., Alwin D. F., Summers G. F. (1977). Assessing reliability and stability in panel models. In Heisse D. R. (Ed.) Sociological methodology 1977 San Francisco, CA: Jossey-Bass, pp 84–136

Wykes T., Sturt E. (1986). The measurement of social behavior in psychiatric patients: An assessment of the reliability and validity of the SBS schedule. British Journal of Psychiatry 148:1–11PubMedCrossRef

Title: The Hoosier Assurance Plan Instrument for Adults (HAPI-A): The Psychometric Properties of a Level of Functioning Assessment Instrument Designed for Use in a State Managed Care Mental Health Program
Authors: John McGrew, Ph.D.
Frederick L. Newman, Ph.D.
Richard N. DeLiberty, M.S.W.
Publication date: 01-10-2007
Publisher: Springer US
Published in: Community Mental Health Journal / Issue 5/2007
Print ISSN: 0010-3853
Electronic ISSN: 1573-2789
DOI: https://doi.org/10.1007/s10597-007-9090-y

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The Hoosier Assurance Plan Instrument for Adults (HAPI-A): The Psychometric Properties of a Level of Functioning Assessment Instrument Designed for Use in a State Managed Care Mental Health Program

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2007

What Contribution Can Ordinary People Make to National Mental Health Policies?

The Stigma of Psychiatric Disorders and the Gender, Ethnicity, and Education of the Perceiver

Extending Assertive Community Treatment to Criminal Justice Settings: Origins, Current Evidence, and Future Directions

Forensic Mental Illness and Other Policy Misadventures. Commentary on “Extending Assertive Community Treatment to Criminal Justice Settings: Origins, Current Evidence, and Future Directions”

Measuring Illness Management Outcomes: A Psychometric Study of Clinician and Consumer Rating Scales for Illness Self Management and Recovery

Book review