Top

Published in:

01-06-2006

USE OF NATIONWIDE OUTCOMES MONITORING DATA TO COMPARE CLINICAL OUTCOMES IN SPECIALIZED MENTAL HEALTH PROGRAMS AND GENERAL PSYCHIATRIC CLINICS IN THE VETERANS HEALTH ADMINISTRATION

Authors: Greg A. Greenberg, Ph.D., Robert A. Rosenheck, M.D.

Published in: Psychiatric Quarterly | Issue 2/2006

Abstract

There has been a growing interest in the implementation of evidence-based specialized mental health programs. However, there has been little study of the effectiveness of these programs in comparison with standard mental health care in real world mental health systems. This study used a national sample of patients from the Veterans Health Administration to compare changes in mental health status in various specialized mental health outpatient programs and in general psychiatric clinics. Hierarchical linear models were used to compare the association of both regularity and intensity of care in six specialized mental health programs with GAF change scores in patients treated in general psychiatric clinics. While improvements were observed in all programs, two specialized programs performed better overall than general psychiatric care, one was not significantly different, and three had poorer outcomes than general psychiatric clinics. Programmatic differences in target populations accompanied by imperfect risk adjustment for population differences most likely explain why these results differ from those observed in clinical trials. While the analytic strategies demonstrated here may have wider applicability to comparative performance assessment, this study provides a cautionary tale concerning the limits of conclusions that can be drawn from large scale outcomes monitoring efforts.

Compared to the typical ACT program MHICM teams are staffed at a lower level and therefore provide a more limited range of services in the community. National MHICM program fidelity to the ACT model has remained steady at 4.0 on the Dartmouth ACT Fidelity Scale since 1997.

Donohoe MT: Comparing generalist and specialty care: discrepancies, deficiencies, and excesses. Archives of Internal Medicine 158(15):1596–1608, 1998.PubMedCrossRef

Engstrom S, Foldevi M, Borgquist L: Is general practice effective? A systematic literature review. Scandinavian Journal of Primary Health Care 19(2):131–144, 2001.PubMedCrossRef

Hedrick SC, Chaney EF, Felker B, et al: Effectiveness of collaborative care depression treatment in Veterans’ Affairs primary care. Journal of General Internal Medicine 18(1):9–16, 2003.PubMedCrossRef

Katon W, Von Korff M, Lin E, et al:. Collaborative management to achieve treatment guidelines. Impact on depression in primary care. Journal of the American Medical Association 273(13):1026–1031, 1995.PubMedCrossRef

Bond GR, Resnick SG, Drake RE, Xie H, et al: Does competitive employment improve non-vocational outcomes for people with severe mental illness? Journal of Consulting and Clinical Psychology 69(3):489–501, 2001.PubMedCrossRef

Kashner TM, Rosenheck RA, Campinell AB, et al: Impact of work therapy on health status among homeless substance dependent veterans. Archives of General Psychiatry 59(10):938–945, 2002.PubMedCrossRef

Salyers MP, Becker DR, Drake RE, et al: A ten-year follow-up of a supported employment program. Psychiatric Services 55(3):302–308, 2004.PubMedCrossRef

Phillips SD, Burns BJ, Edgar ER, et al: Assertive Community Treatment: Moving an evidence-based intervention into standard practice. Psychiatric Services 52:771–779, 2001.PubMedCrossRef

Rosenheck RA, Neale MS: Cost-Effectiveness of intensive psychiatric community care for high users of inpatient services. Archives of General Psychiatry 55(5):459–466, 1998.PubMedCrossRef

Stein LI, Test MA: Alternative to mental hospital treatment: Conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry 37(4):392–397, 1980.PubMed

Fontana A, Rosenheck RA: Effectiveness and cost of inpatient treatment of Posttraumatic Stress Disorder. American Journal of Psychiatry 154:758–765, 1997.PubMed

Rosenheck RA, Fontana AF: Treatment of veterans severely impaired by PTSD, in Emotional Aftermath of the Persian Gulf War. Edited by Ursano RJ, Norwood AE. Washington DC: American Psychiatric Press, 1996.

Linn MW, Caffey EM: Foster placement for the older psychiatric patient. Journal of Gerontology 32(3):340–345, 1977.PubMed

Linn MW, Caffey EM, Klett CJ, et al: Hospital vs community (foster) care for psychiatric patients. Archives of General Psychiatry 34(1):78–83, 1977.PubMed

Mares A, McGuire J. Reducing psychiatric hospitalization among mentally ill veterans living in board-and-care homes. Psychiatric Services 51(7):914–921, 2000.PubMedCrossRef

D’Agostino D, McCabe J, Sclar B: A psychiatric day hospital program in an HMO. HMO Practice 9(2):79–83, 1995.PubMed

Linn MW, Caffey EM Jr, Klett CJ, et al: Day treatment and psychotropic drugs in the aftercare of schizophrenic patients. Archives of General Psychiatry 36:1055–1066, 1979.PubMed

Weisner C, Mertens J, Parthasarathy S, et al: The outcome and cost of alcohol and drug treatment in an HMO: day hospital versus traditional outpatient regimens. Health Services Research 35(4):791–812, 2000.PubMed

Jerrell JM, Hu TW: Estimating the cost impact of three dual diagnosis treatment programs. Evaluation Review 20(2):160–180, 1996.PubMedCrossRef

McLellan AT, Grissom GR, Brill P, et al: Private substance abuse treatments: are some programs more effective than others? Journal of Substance Abuse Treatment 10(3):243–254, 1993.PubMedCrossRef

Moos RH, Finney JW, Federman EB, et al: Specialty mental health care improves patients’ outcomes: Findings from a nationwide program to monitor the quality of care for patients with substance use disorders. Journal of Studies on Alcohol 61:704–713, 2000.PubMed

Rawson RA, Shoptaw SJ, Obert JL, et al: An intensive outpatient approach for cocaine abuse treatment. The Matrix model. Journal of Substance Abuse Treatment 12(2):117–127, 1995.PubMedCrossRef

Van Stone W, Henderson K, Moos RH, et al: In Nationwide implementation of Global Assessment of Functioning as an indicator of patient severity and service outcomes Standardized Evaluation in Clinical Practice. Edited by First MB. Washington, DC, American Psychiatric Publishing Inc, 2003.

Greenberg G, Rosenheck R: Using the GAF as a national mental health outcome measure in the Veterans Health Administration. Psychiatric Services 56(4):420–426, 2005.PubMedCrossRef

Greenberg G, Rosenheck R: Continuity of care and clinical outcomes in a national health system 56 (4): 427–433, 2005.

Sernyak M, Leslie DL, Rosenheck RA: Use of system-wide outcomes monitoring data to compare the effectiveness of atypical neuroleptic medications. American Journal of Psychiatry 160(2):310–315, 2003.PubMedCrossRef

Resnick R, Baldino R, Corwel L, et al: Seventh Progress Report on the Compensated Work Therapy/Veterans Industries Program. Fiscal Year 2003. West Haven, CT, Northeast Program Evaluation Center, 2004.

Neale M, Rosenheck R, Castrodonatti J, et al: Mental Health Intensive Case Management (MHICM): The Seventh National Performance Monitoring Report: FY 2003. West Haven, CT, Northeast Program Evaluation Center, 2004.

Fontana A, Rosenheck R, Spencer H, et al: Long Journey Home XII: Treatment of Posttraumatic Stress Disorder in the Department of Veterans Affairs: Fiscal Year 2003. West Haven, CT, Northeast Program Evaluation Center, 2004.

Humphreys K, Huebsch PD, Moos RH, et al: The transformation of the veterans affairs substance abuse treatment system. Psychiatric Services 50(11):1399–1401, 1999.PubMed

Endicott J, Spitzer RL, Fleiss JL: The Global Assessment Scale: A procedure for measuring the overall severity of psychiatric disturbance. Archives of General Psychiatry 33:766–771, 1976.PubMed

Tracy K, Adler LA, Rotrosen J, et al: Interrater reliability issues in multicenter trials, Part 1: Theoretical concepts and operational procedures used in Department of Veterans Affairs cooperative study #394. Psychopharmacology Bulletin 33:53–57, 1997.

Rey JM, Starling J, Wever C, et al: Inter-rater reliability of global assessment of functioning in a clinical setting. Journal of Child Psychology and Psychiatry 36(5):787–792, 1995.PubMedCrossRef

American Psychiatric Association: Diagnostics and Statistics Manual of Mental Disorders, 4th ed. Washington: DC, American Psychiatric Association, 1994.

Moos RH, Nichol AC, Moos BS: Global assessment of functioning (GAF) ratings: Global Assessment of Functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services 53(6):730–737, 2002.PubMedCrossRef

Rosenheck RA, Cicchetti D: A Mental Health Program Performance Monitoring System for the Department of Veterans Affairs. West Haven, CT, Northeast Program Evaluation Center, 1995.

Rosenheck RA, Cramer J, Xu W, et al: A comparison of Clozapine and Haloperidol in hospitalized patients with refractory schizophrenia. New England Journal of Medicine 337:809–815, 1997.PubMedCrossRef

Bryk AS, Raudenbush SW: Hierarchical Linear Models. London, Sage, 1992.

Desai RA, Rosenheck RA, Rothberg, A: Cross-system use among VA mental health patients living in Philadelphia. Administration and Policy in Mental Health 28:299–309, 2001.PubMedCrossRef

Rosenheck RA, Frisman L, Essock S: Impact of VA bed closures on use of state psychiatric services. Journal of Behavioral Health Services and Research 28:58–66, 2001.PubMedCrossRef

Greenberg GA, Rosenheck RA: National Mental Health Program Performance Monitoring System: Fiscal Year 2003 Report. West Haven, CT, Northeast Program Evaluation Center; 2004.

Ellwood PM: Shattuck Lecture – Outcomes management: A technology of patient experience. New England Journal of Medicine 318(23):1549–1556, 1988.PubMedCrossRef

Epstein AM: The outcomes movement – will get us where we want to go? New England Journal of Medicine 323(4):265–270, 1990.CrossRef

Marshall MN, Shekelle PG, Leatherman S, et al: The public release of performance data: What do we expect to gain? Journal of the American Medical Association 283(14):1866–1874, 2000.PubMedCrossRef

Relman AS: Assessment and accountability: The third revolution in medical care. New England Journal of Medicine 319(18):1220–1222, 1988.PubMedCrossRef

Roper WL, Winkenwerder W, Hackbarth GM, et al:. Effectiveness in health care, An initiative to evaluate and improve medical practice. New England Journal of Medicine 319(18):1197–1202, 1988.PubMedCrossRef

Title: USE OF NATIONWIDE OUTCOMES MONITORING DATA TO COMPARE CLINICAL OUTCOMES IN SPECIALIZED MENTAL HEALTH PROGRAMS AND GENERAL PSYCHIATRIC CLINICS IN THE VETERANS HEALTH ADMINISTRATION
Authors: Greg A. Greenberg, Ph.D.
Robert A. Rosenheck, M.D.
Publication date: 01-06-2006
Publisher: Springer US
Published in: Psychiatric Quarterly / Issue 2/2006
Print ISSN: 0033-2720
Electronic ISSN: 1573-6709
DOI: https://doi.org/10.1007/s11126-006-9004-0

At a glance: The STEP trials

Springer Medicine

USE OF NATIONWIDE OUTCOMES MONITORING DATA TO COMPARE CLINICAL OUTCOMES IN SPECIALIZED MENTAL HEALTH PROGRAMS AND GENERAL PSYCHIATRIC CLINICS IN THE VETERANS HEALTH ADMINISTRATION

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2006

Tanning in Body Dysmorphic Disorder

Avoiding Extinction: Successful Private Psychiatric Hospitals in the Opening Decade OF the Twenty-First Century

GENERAL PSYCHIATRISTS AND THEIR PATIENTS’ CHILDREN: ASSESSMENT AND PREVENTION

A NATIONAL SURVEY OF STATE MENTAL HEALTH AUTHORITY PROGRAMS AND POLICIES FOR CLIENTS WHO ARE PARENTS: A DECADE LATER

DETERMINANTS OF INPATIENT PSYCHIATRIC LENGTH OF STAY IN AN URBAN COUNTY HOSPITAL

WHO RECEIVES ANTIDEPRESSANTS AND WHAT IMPACT DO THEY HAVE? AN ACUTE-CARE STUDY