Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-09-2006 | Original paper

Comparison of Self-report and Clinician-rated Measures of Psychiatric Symptoms and Functioning in Predicting 1-year Hospital Readmission

Authors: Karen M. Clements, Jane M. Murphy, Susan V. Eisen, Sharon-Lise T. Normand

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 5/2006

Abstract

This study compared the self-report Behavior and Symptom Identification Scale (BASIS-32) and clinician-rated Global Assessment of Functioning (GAF) in their ability to predict a measure of psychiatric outcome, 1-year psychiatric hospital readmission. BASIS-32 and GAF were completed at admission for 1034 patients in an inpatient psychiatric facility. Multiple informants analysis was used to determine the difference between the two in predicting readmission within 1 year. We also examined sensitivity, specificity, and predictive value positive of the two measures, and whether self-report added information above clinician rating in predicting outcome. While the odds of 1-year readmission decreased with increasing BASIS-32 score, there was no association between change in GAF score and 1-year readmission. Although neither measure used alone demonstrated high predictive value, using both scores improved predictive ability over using clinician rating alone. In this setting, self-report was better than clinician rating in predicting psychiatric outcome. Differences between the two in relation to other outcomes need to be examined.

Atkinson, M., Zibin, S., & Chuang, H. (1997). Characterizing quality of life among patients with chronic mental illness: A critical examination of the self-report methodology. American Journal of Psychiatry, 154(1), 99–105.PubMed

Caldecott-Hazard, S., & Hall, R. C. (1995). Outcome assessment in depressed hospitalized patient. Journal of the Florida Medical Association, 82(1), 24–29.

Coffey, M., Jones, S. H., & Thornicroft, G. (1996). A brief mental health outcome scale: Relationships between scale scores and diagnostic/sociodemographic variables in the long-term mentally ill. Journal of Psychiatric and Mental Health Nursing, 3(2), 89–93.PubMedCrossRef

Dickey, B., & Wagenaar, H. (1996). Evaluating health status. In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 56–57). Philadelphia, PA: Lippincott Williams & Wilkins.

DSM-IV (1994). Diagnostic and statistical manual of mental disorders, fourth edition. Washington, DC: American Psychiatric Association.

Eisen, S. V., & Culhane, M. A. (1999). Behavior and Symptom Identification Scale (BASIS-32). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes asessment second edition (pp. 759–790). Mahway NJ: Lawrence Erlbaum Associates.

Eisen, S., Dill, D., & Grob, M. C. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45(3), 242–247.PubMed

Eisen, S. V., Grob, M. C., & Dill, D. L. (1991). Outcome measurement: Tapping the patient’s perspective. In S. M. Mirin, J. Gossett, & M. C. Grob (Eds.), Psychiatric treatment: Advances in outcome research (pp. 213–235). Washington, DC: American Psychiatric Press.

Garb, H. N. (2003). Incremental validity and the assessment of psychopathology in adults. Psychological Assessment, 15(4), 508–520PubMedCrossRef

Goethe, J. W., Fischer, E. H., & Dornelas, E. A. (1997). Assessing outcomes: Identifying psychiatric patients with severe and persistent illness. Connecticut Medicine, 61(9), 559–564PubMed

Goldman, H. H., Skodol, A. E., & Lave, T. R. (1992). Revising axis V for DSM-IV: A review of measures of social functioning. American Journal of Psychiatry, 149(9), 1148–1156PubMed

Goldstein, J. M., & Simpson, J. C. (1995). Validity: Definitions and applications to psychiatric research. In M. T. Tsuang, M. Tohen, & G. E. Zahner (Eds.), Textbook of psychiatric epidemiology (pp. 229–242). New York: John Wiley and sons, Inc.

Hall, R. C. (1995). Global assessment of functioning, a modified scale. Psychosomatics 36(3), 267–274.PubMed

Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under the Receiver Operating Characteristic Curves derived from the same cases. Radiology, 148(3), 839–843.PubMed

Hendryx, M. S., Russo, J. E., Stegner, B., Dyck, D. G., Ries, R. K., & Roy-Byrne, P. (2003). Predicting rehospitalization and outpatient services from administration and clinical databases. Journal of Behavioral Health Services Research, 30(3), 342–351.PubMedCrossRef

Horton, N. J., Laird, N. M., Murphy, J. M., Monson, R. R., Sobol, A. M., & Leighton, A. H. (2001). Multiple informants: Mortality associated with psychiatric disorders in the Stirling County Study. American Journal of Epidemiology, 154(7), 649–656.PubMedCrossRef

Horton, N. J., Laird, N. M., & Zahner, G. E. (1999). Use of multiple informant data as a predictor in psychiatric epidemiology. International Journal of Methods in Psychiatric Research, 8(1), 6–18.CrossRef

Hudson, C. G., Dorwart, R. A., & Wieman, D. A. (1998). Impact of Medicaid Behavioral Carve-out program on patterns of acute psychiatric hospitalization, the Massachusetts experience FY 1996–FY 1997. Retrieved September, 2002, from http://www.salemstate.edu/socialwork/casemix.pdf

Hunsley, J., & Meyer, G. (2003). The incremental validity of psychological testing and assessment: Conceptual, methodological, and statistical issues. Psychological Assessment, 15(4), 446–455.PubMedCrossRef

Jones, S. H., Thornicroft, G., Coffey, M., & Dunn, G. (1995). A brief mental health outcome scale-reliability and validity of the Global Assessment of Functioning (GAF). British Journal of Psychiatry, 166(5), 654–659.PubMedCrossRef

Kroenke, K., West, S. L., Swindle, R., Gilsenan, A., Eckert, G. J., Dolor, R., Stang, P., Zhou, X. H., Hays, R., & Weinberger, M. (2001). Similar effectiveness of paroxetine, fluoxetine, and sertraline in primary care: A randomized trial. Journal of the American Medical Association, 286(23), 2947–2955.PubMedCrossRef

Lash, T. L., Thwin, S. S., Horton, N. J., Guadagnoli, E., & Silliman, R. A. (2003). Multiple informants: A new method to assess breast cancer patients’ comorbidity. American Journal of Epidemiology, 157(3), 249–257.PubMedCrossRef

Merchant, D. J., & Henfling, P. A. (1994). Scheduled brief admissions: Patient “tueneups”. The Journal of Psychosocial Nursing and Mental Health Services, 32(12), 7–10.

Miller, J. S., O’Mahoney, M. T., Miller, S. I., Neme, J., Kabut, J., & Miller, F. (1997). Predicting readmission to the psychiatric Hospital in a managed care environment: Implications for quality indicators. American Journal of Psychiatry, 154(3), 337–340.PubMed

Mirin, S. M., & Namerow, M. J. (1991). Why study treatment outcome? Hospital and Community Psychiatry, 42(10), 1007–1013.PubMed

Monnelly, E. P. (1997). Instability before discharge and previous psychiatric admissions as predictors of early readmission. Psychiatric Services, 48(12), 1584–1586.PubMed

Moos, R. H., McCoy, L., & Moos, B. S. (2000). Global assessment of functioning (GAF) ratings: Determinants and role as predictors of one-year treatment outcomes. Journal of Clinical Psychology, 56(4), 449–461.PubMedCrossRef

Moos, R. H., Nichol, A. C., & Moos, B. S. (2002). Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services, 53(6), 730–737.PubMedCrossRef

Oiesvold, T., Saarento, O., Sytema, S., Vinding, H., Gostas, G., Lonnerberg, O., Muus, S., Sandlund, M., & Hansson, L. (2000). Predictors for readmission risk of new patients: The Nordic comparative study on sectorized psychiatry. Acta Psychiatrica Scandinavica, 101(5), 367–373.PubMedCrossRef

Parker, G., O’Donnell, M., Hadzi-Pavlovic, D., & Proberts, M. (2002). Assessing outcome in community mental health patients: A comparative analysis of measures. International Journal of Social Psychiatry, 48(1), 11–19.PubMedCrossRef

Pepe, M. S., Whitaker, R. C., & Seidel, K. (1999). Estimating and comparing univariate associations with application to the prediction of adult obesity. Statistics in Medicine, 18(2), 163–173.PubMedCrossRef

Piersma, H. L., & Boes, J. L. (1997). The GAF and Psychiatric outcome: A descriptive report. Community Mental Health Journal, 33(1), 35–40.PubMedCrossRef

Ruggeri, M., Biggeri, A., Rucci, P., & Tansella, M. (1998). Multivariate analysis of outcome of mental health care using graphical chain models: The South-Verona Outcome Project 1. Psychological Medicine, 28(6), 1421–1431.PubMedCrossRef

Russo, J., Roy-Byrne, P., Jaffe, C., Ries, R., Dagadakis, C., Dwyer-O’Connor, E., & Reeder, D. (1997a). The relationship of patient-administered outcome assessments to quality of life and clinician ratings: Validity of the BASIS-32. Journal of Mental Health Administration, 24(2), 199–214.CrossRef

Russo, J., Roy-Byrne, P., Jaffe, C., Ries, R., Dagadakis, C., & Avery, D. (1997b). Psychiatric status, quality of life and level of care as predictors of outcomes of acute inpatient treatment. Psychiatric Services, 48(11), 1427–1433.

SAS Institute, Inc. SAS/Stat user’s guide: version 8. Carry, NC: SAS Institute.

Sederer, L. I., Dickey, B., & Hermann, R. C. (1996). The imperative of outcomes assessment in psychiatry. In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 1–7). Baltimore MD: Lippincott Williams & Wilkins.

Sohlberg, S. (1989). There’s more in a number than you think: New validity data for the Global Assessment Scale. Psychological Reports, 64(2), 455–461.PubMed

Spitzer, R. L., Williams, J. B. W., Gibbon, M., & First, M. B. (1992). The Structured Clinical Interview for DSM-III-R (SCID) 1: History, rational and description. Archives of General Psychiatry, 49(8), 624–662.PubMed

Thornicroft, G., Gooch, C., & Dayson, D. (1992). Readmission to hospital for long term psychiatric patients after discharge to the community. British Medical Journal 305(6860), 996–998.PubMedCrossRef

Vetter, P., & Koller, O. (1996). Clinical and psychosocial variables in different diagnostic groups: Their interrelationships and value as predictors of course and outcome during a 14-year follow-up. Psychopathology, 29(3), 159–168.PubMedCrossRef

Walker, R., Minor-Schork, D., Bloch, R., & Esinhart, J. (1996). High risk factors for rehospitalization within six months. Psychiatric Quarterly, 67(3), 235–243.PubMedCrossRef

Zeger, S. L., & Liang, K. Y. (1986). Longitudinal data analysis for discrete and continuous outcomes. Biometrics, 42(1), 121–130.PubMedCrossRef

Title: Comparison of Self-report and Clinician-rated Measures of Psychiatric Symptoms and Functioning in Predicting 1-year Hospital Readmission
Authors: Karen M. Clements
Jane M. Murphy
Susan V. Eisen
Sharon-Lise T. Normand
Publication date: 01-09-2006
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 5/2006
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-006-0066-y

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Comparison of Self-report and Clinician-rated Measures of Psychiatric Symptoms and Functioning in Predicting 1-year Hospital Readmission

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2006

Research–Practice Partnership in Mental Health: Lessons from Participants

In the Aftermath of CATIE: How Should Administrators Value Atypical Antipsychotic Medications?

Intensive Case Management: A Critical Re-Appraisal of the Scientific Evidence for Effectiveness

Short Term Involuntary Psychiatric Examination of Children in Florida

CATIE and the Value of Atypical Antipsychotics in the Context of Creating a Recovery-Oriented Behavioral Health System

Service Utilization among Ethnic Minority Children with ADHD: A Model of Help-Seeking Behavior