Top

The Journal of Behavioral Health Services & Research

Published in:

01-07-2006 | Regular Article

Reliability and Validity of the BASIS-24^© Mental Health Survey for Whites, African-Americans, and Latinos

Authors: Susan V. Eisen, PhD, Mariana Gerena, PhD, Gayatri Ranganathan, MS, David Esch, PhD, Thomas Idiculla, MSW

Published in: The Journal of Behavioral Health Services & Research | Issue 3/2006

Abstract

Increasing racial and ethnic diversity calls for mental health assessment instruments that are appropriate, reliable, and valid for the wide range of cultures that comprise the current US population. However, most assessment instruments have not been tested on diverse samples. This study assessed psychometric properties and sensitivity to change of the revised Behavior and Symptom Identification Scale (BASIS-24©) among the three largest race/ethnicity groups in the USA: Whites, African-Americans, and Latinos. BASIS-24© assessments were obtained for 2436 inpatients and 2975 outpatients treated at one of 27 mental health and/or substance abuse programs. Confirmatory factor analysis and several psychometric tests supported the factor structure, reliability, concurrent validity, and sensitivity of the instrument within each race/ethnicity group, although discriminant validity may be weaker for African-Americans and Latinos than for Whites. Further research is needed to test and validate assessment instruments with other race/ethnicity groups.

Donabedian A. Explorations in quality assessment and monitoring, Vol. I: The definition of quality and approaches to it's assessment. Ann Arbor, MI: Health Administration Press; 1980.

Mirin SM, Namerow MJ. Why study treatment outcome? Hospital and Community Psychiatry. 1991;42:1007–1013.PubMed

Eisen SV, Dickey B. Mental health outcome assessment: the new agenda. Psychotherapy. 1996;33:181–189.

Sederer LI, Dickey B, Hermann RC. The imperative of outcomes assessment in psychiatry. In: Sederer LI, Dickey B, eds. Outcomes Assessment in Clinical Practice. Baltimore, MD: Williams & Wilkins; 1996:1–7.

Smith GR, Fischer EP, Nordquist CR, et al. Implementing outcomes management systems in mental health settings. Psychiatric Services. 1997;48:364–368.PubMed

Smith GR, Manderscheid RW, Flynn LM, et al. Principles for assessment of patient outcomes in mental health care. Psychiatric Services. 1997;48:1033–1036.PubMed

Hodges K, Wotring J. The role of monitoring outcomes in initiating implementation of evidence-based treatments at the state level. Psychiatric Services. 2004;55:396–400.PubMedCrossRef

Brown GS, Burlingame GM, Lambert MJ. Pushing the quality envelope: a new outcomes management system. Psychiatric Services. 2001;52:925–934.PubMedCrossRef

Joint Commission on Accreditation of Healthcare Organizations. Oryx Outcomes: The Next Evolution in Accreditation. Oakbrook Terrace, IL; 1997.

10.

National Committee for Quality Assurance. 2001 Standards and Surveyor Guidelines for the Accreditation of MBHO's. Washington, DC; 2000.

11.

Sechrest L, McKnight P, McKnight K. Calibration of measures for psychotherapy outcome studies. American Psychologist. 1996;51:1065–1071.PubMedCrossRef

12.

Lambert MJ, Gregersen AT, Burlingame GM. The Outcome Questionnaire-45. In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:191–234.

13.

McLellan AT, Cacciola J. Kushner H, et al. The fifth edition of the addiction severity index: cautions, additions and normative data. Journal of Substance Abuse and Treatment. 1992;9:461–480.CrossRef

14.

Derogatis LR, Fitzpatrick M. The SCL-90-R, the Brief Symptom Inventory (BSI) and the BSI-18. In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:1–41.

15.

McHorney CA, Ware JE, Lu, et al. The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Medical Care. 1994;32:40–66.PubMedCrossRef

16.

Chow JC-C, Snowden LR, McConnell W. A confirmatory factor analysis of the BASIS-32 in racial and ethnic samples. Journal of Behavioral Health Services & Research. 2001;28:400–411.CrossRef

17.

Stewart AL, Nápoles-Springer A. Health-related quality of life assessments in diverse population groups in the United States. Medical Care. 2000;38(Supplement II):II102–II124.PubMedCrossRef

18.

Canino G, Bravo M. The adaptation and testing of diagnostic and outcome measures for cross-cultural research. International Review of Psychiatry. 1994;6:281–286.CrossRef

19.

U.S. Department of Health & Human Services. Culture, Race and Ethnicity. A Supplement to Mental Health: A Report of the Surgeon General. Chapter 6. Mental Health Care for Hispanic Americans. Office of the Surgeon General. Substance Abuse and Mental Health Services Administration, Center for Mental Health Services; 2001:129–155.

20.

Shrout PE, Canino GJ, Bird HR, et al. Mental health status among Puerto Ricans, Mexican Americans and non-Hispanic whites. American Journal of Community Psychology. 1993;21:383–395.CrossRef

21.

Phillips D, Leff HS, Kaniasty E, et al. Culture, Race and Ethnicity in Performance Measurement: A Compendium of Resources. The Evaluation Center @ HSRI. Cambridge, MA: Human Services Research Institute; 1999.

22.

Eisen SV, Dill DL, Grob MC. Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry. 1994;45:242–247.PubMed

23.

Eisen SV, Normand SLT, Belanger AJ, et al. BASIS-32® and the Revised Behavior and Symptom Identification Scale (BASIS-R). In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:79–115.

24.

Eisen SV, Normand SLT, Belanger AJ, et al. The revised Behavior and Symptom Identification Scale (BASIS-24): reliability and validity. Medical Care. 2004;42:1230–1241.PubMedCrossRef

25.

Lessler JT. Choosing questions that people can understand and answer. Medical Care. 1995;33:AS203–AS208.PubMed

26.

DeMaio TJ, Rothgeb JM. Cognitive interviewing techniques: in the lab and in the field. In: Schwarz N, Sudman S, eds. Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research. San Francisco: Jossey-Bass; 1996:177–195.

27.

Nunnaly JC, Bernstein IH. Psychometric Theory. 3rd ed. New York: McGraw-Hill; 1994.

28.

Embretson SE. The new rules of measurement. Psychological Assessment. 1996;8:341–349.CrossRef

29.

Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Medical Care. 2000;38(9 Suppl): II28–II42.PubMed

30.

Hambleton RK. Emergence of item response modeling in instrument development and data analysis. Medical Care. 2000;38(9 suppl):II60–II65.PubMed

31.

McHorney CA. Generic health measurement: past accomplishments and a measurement paradigm for the 21st century. Annals of Internal Medicine. 1997;127:743–750.PubMed

32.

Ware JE, Kosinksi M, Keller S. A 12-item short-form health survey (SF-12): construction of scales and preliminary tests of reliability and validity. Medical Care. 1996;24:220–233.CrossRef

33.

American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. Fourth Edition (DSM-IV). Washington, DC: American Psychiatric Association; 1994.

34.

Spitzer RL, Gibbon M, Endicott J. Global Assessment Scale (GAS), Global Assessment of Functioning (GAF) Scale, Social and Occupational Functioning Assessment Scale (SOFAS). In: Handbook of Psychiatric Measures. Washington, DC: American Psychiatric Association; 2000:96–100.

35.

Friedman DJ, Cohen BB, Averbach AR, et al. Race/ethnicity and OMB directive 15: implications for state public health practice. American Journal of Public Health. 2000;90:1714–1719.PubMedCrossRef

36.

Little RJA. Regression with missing X's: a review. Journal of the American Statistical Association. 1992;87:1227–1237.CrossRef

37.

Joreskog K, Sorbom D. LISREL 8.53: Structural Equation Modeling with the SIMPLIS Command Language. Chicago: Scientific Software International; 2002.

38.

Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef

39.

Hu L, Bentler PM. Cutoff criterion for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6:1–55.CrossRef

40.

Browne MS, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, eds. Testing Structural Equation Models. Newbury Park, CA: Sage; 1993:136–162.

41.

Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.

42.

Eisen SV, Culhane MA. Behavior and Symptom Identification Scale (BASIS-32). In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Second Edition. Mahwah, NJ: Lawrence Erlbaum Associates; 1999:759–790.

43.

Canino G, Bravo M. The adaptation and testing of diagnostic and outcome measures for cross-cultural research. International Review of Psychiatry. 1994;6:281–286.CrossRef

44.

U.S. Department of Health & Human Services. Culture, Race and Ethnicity. A Supplement to Mental Health: A Report of the Surgeon General. Chapter 6, Mental health care for Hispanic Americans. Office of the Surgeon General. Substance Abuse and Mental Health Services Administration, Center for Mental Health Services; 2001:129–155.

45.

Canino G, Lewis-Fernandez R, Bravo M. Methodological challenges in cross-cultural mental health research. Transcultural Research. 1997;23:163–184.CrossRef

46.

Moos RH, McCoy L, Moos BS. Global assessment of functioning (GAF) ratings: determinants and role as predictors of one-year treatment outcomes. Journal of Clinical Psychology. 2000;56:449–460.PubMedCrossRef

47.

Moos RH, Nichol AC, Moos BS. Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services. 2002;53:730–737.PubMedCrossRef

48.

Wang PS, Lane ML, Olfson M, et al. Twelve-month use of mental health services in the United States. Results from the national comorbidity survey replication. Archives of General Psychiatry. 2005;62:629–640.PubMedCrossRef

49.

Wang PS, Berglund P, Olfson M. Failure and delay in initial treatment contact after first onset of mental disorders in the national comorbidity survey replication. Archives of General Psychiatry. 2005;62:603–613.PubMedCrossRef

Authors: Susan V. Eisen, PhD
Mariana Gerena, PhD
Gayatri Ranganathan, MS
David Esch, PhD
Thomas Idiculla, MSW
Publication date: 01-07-2006
Publisher: Springer US
Published in: The Journal of Behavioral Health Services & Research / Issue 3/2006
Print ISSN: 1094-3412
Electronic ISSN: 2168-6793
DOI: https://doi.org/10.1007/s11414-006-9025-3

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Reliability and Validity of the BASIS-24^© Mental Health Survey for Whites, African-Americans, and Latinos

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2006

Employment and Mental Health Service Utilization in Washington State

Use of Depression Education Materials to Improve Treatment Compliance of Primary Care Patients

An Examination of Fulfilled Housing Preferences and Quality of Life among Homeless Persons with Mental Illness and/or Substance Use Disorders

Treatment Outcomes for Substance Abuse among Adolescents with Learning Disorders

Medical Cost-Offset Following Treatment Referral for Alcohol and Other Drug Use Disorders in a Group Model HMO

Medicaid Coverage and Access to Publicly Funded Opiate Treatment