Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-03-2008 | Original Paper

Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice

Authors: Charles Glisson, John Landsverk, Sonja Schoenwald, Kelly Kelleher, Kimberly Eaton Hoagwood, Stephen Mayberg, Philip Green, The Research Network on Youth Mental Health

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1-2/2008

Abstract

The organizational social context in which mental health services are provided is believed to affect the adoption and implementation of evidence-based practices (EBPs) as well as the quality and outcomes of the services. A fully developed science of implementation effectiveness requires conceptual models that include organizational social context and tools for assessing social context that have been tested in a broad cross-section of mental health systems. This paper describes the role of organizational social context in services and implementation research and evaluates a comprehensive contextual measure, labeled Organizational Social Context (OSC), designed to assess the key latent constructs of culture, climate and work attitudes. The psychometric properties of the OSC measure were assessed in a nationwide study of 1,154 clinicians in 100 mental health clinics with a second-order confirmatory factor analysis of clinician responses, estimates of scale reliabilities, and indices of within-clinic agreement and between-clinic differences among clinicians. Finally, the paper illustrates the use of nationwide norms in describing the OSC profiles of individual mental health clinics and examines the cross-level association of organizational-level culture and climate with clinician-level work attitudes.

Aarons, G. A., & Palinkas, L. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.PubMedCrossRef

Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301.PubMedCrossRef

Argyris, C. (1958). Some problems in conceptualizing organizational climate: A case study of a bank Administrative Science Quarterly, 2, 501–520.CrossRef

Ashkanasy, N. M., Broadfoot, L. E., & Falkus, S. (2000a). Questionnaire measures of organizational culture. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 131–146). Thousand Oaks, CA: Sage Publications, Inc.

Ashkanasy, N. M., Wilderom, C. P. M., Peterson, M. F. (Eds.) (2000b). Handbook of organizational culture and climate. Thousand Oaks, CA: Sage Publications.

Bickman, L. (1996a). The evaluation of a children’s mental health managed care demonstration Journal of Mental Health Administration, 23(1), 7–15.PubMedCrossRef

Bickman, L. (1996b). A continuum of care: More is not always better American Psychologist, 51, 689–701.PubMedCrossRef

Bliese, P. (2000). Within-group agreement, non-independence, and reliability. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 349–381). San Francisco: Jossey-Bass.

Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.

Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents Clinical Child and Family Psychology Review, 2, 199–242.PubMedCrossRef

Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health needs and access to mental health services by youths involved with child welfare: A national survey Journal of the American Academy of Child and Adolescent Psychiatry, 43(8), 960–970.PubMedCrossRef

Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahway, NJ: Lawrence Erlbaum Associates.

Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models Journal of Applied Psychology, 83, 234–246.CrossRef

Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

Dowd, K., Kinsey, S., Wheeless, S., Thissen, R. Richardson, J., Suresh, R., et al. (2004). National Survey of Child and Adolescent Well-Being (NSCAW), combined waves 1–4, data file user’s manual, restricted release version. Research Triangle Institute, University of North Carolina at Chapel Hill, and Caliber Associates, University of California at Berkeley.

Fleishman, E. A. (1953). Leadership climate, human relations training, and supervisory behavior Personnel Psychology, 6, 205–222.CrossRef

Glisson, C. (1978). Dependence of technological routinization on structural variables in human service organizations Administrative Science Quarterly, 23, 383–395.PubMedCrossRef

Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.PubMedCrossRef

Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations Administrative Science Quarterly, 33, 61–81.CrossRef

Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448.PubMedCrossRef

Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421.CrossRef

Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams Journal of Organizational Behavior, 23, 767–794.CrossRef

Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.PubMedCrossRef

Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients’ care Lancet, 362(9391), 1225–1230.PubMedCrossRef

Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170.CrossRef

Handy, C. B. (1976). Understanding organizations. New York: Penguin Books.

Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: John Wiley & Sons.

Hedeker, D., Gibbons, R. D., & Flay, B. R. (1994). Random-effects regression models for clustered data with an example from smoking prevention research Journal of Consulting and Clinical Psychology, 62, 757–765.PubMedCrossRef

Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of family-centered care Children’s Health Care, 30(2), 93–110.CrossRef

Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and intervention research Clinical Psychology: Science and Practice, 13(1), 73–93.CrossRef

Herman, J. B., Dunham, R. B., & Hulin, C. L. (1975). Organizational structure, demographic characteristics, and employee responses Organizational Behavior and Human Performance, 13(2), 206–232.CrossRef

Herman, J. B., & Hulin, C. L. (1972). Studying organizational attitudes from individual and organizational frames of reference Organizational Behavior and Human Performance, 8, 84–108.CrossRef

Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services Psychiatric Services, 52, 1190–1197.PubMedCrossRef

Hofmann, D. A., Griffin, M. H., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations. San Francisco: Jossey-Bass.

Hofstede, G. (1998). Attitudes, values and organizational culture: Disentangling the concepts Organization Studies, 19, 477–492.CrossRef

Hofstede, G., Neuijen, B., Ohayv, D. D., & Sanders, G. (1990). Measuring organizational cultures: A qualitative and quantitative study across twenty states. Administrative Science Quarterly, 35, 286–316.CrossRef

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling, 6, 1–55.CrossRef

James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning Journal of Applied Psychology, 74, 739–751.CrossRef

James, L. R., Demaree, R. G., & Wolf, G. (1993). Rwg: An assessment of within-group interrater agreement Journal of Applied Psychology, 75(2), 306–309.CrossRef

James, L. R., & Williams, L. J. (2000). The cross-level operator in regression, ANCOVA, contextual analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 382–424). San Francisco: Jossey-Bass.

Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions Organizational Behavior and Human Performance, 23, 201–250.CrossRef

Joyce, W. F., & Slocum, J. W. (1984). Collective climate: Agreement as a basis for defining aggregate climates in organizations Academy of Management Journal, 24(4), 721–742.CrossRef

Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments Journal of Consulting and Clinical Psychology, 66, 19–36.PubMedCrossRef

Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment Journal of Applied Psychology, 86(1), 3–16.PubMedCrossRef

Klein, K. J., & Kozlowski, S. W. J. (2000a). From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods, 3(3), 211–236.CrossRef

Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000b). Multi-level theory, research, and methods in organizations. San Francisco: Jossey-Bass.

Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.CrossRef

Locke, E. A. (1976). The nature and causes of job satisfaction. New York: McGraw-Hill.

MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling Psychological Methods, 1, 130–149.CrossRef

Morris, J. H., & Sherman, J. D. (1981). Generalizability of an organizational commitment model Academy of Management Journal, 24, 512–526.CrossRef

Mowday, R., Porter, L., & Steers, R. (1982). Organizational linkages: The psychology of commitment, absenteeism, and turnover. New York: Academic Press.

Nelson, T. D., & Steele, R. F. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34, 319–330.PubMedCrossRef

Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges Administrative Policy in Mental Health and Mental Health Services Research, 33, 398–409.CrossRef

NSCAW Research Group (2002). Methodological lessons from the National Survey of Child and Adolescent Well-Being: The first three years of the USA’s first national probability study of children and families investigated for abuse and neglect Children and Youth Services Review, 24(6–7), 513–541.

Pettigrew, A. (1979). On studying organizational cultures Administrative Science Quarterly, 24, 570–581.CrossRef

Porras, J. I., & Robertson, P. J. (1992). Organizational development: Theory, practice, and research. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3 pp. 719–822). Palo Alto, CA: Consulting Psychologists Press, Inc.

Raudenbush, S. W., & Bryk, A. S. (2002) Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.

Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Loncolnwood, IL: Scientific Software International.

Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco: Jossey-Bass.

Rousseau, D. M. (1977). Technological differences in job characteristics, employee satisfaction and motivation: A synthesis of job design research and sociotechnical systems theory Organizational Behavior and Human Performance, 19, 18–42.CrossRef

Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level, cross-level perspectives. In B. M. Stow & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1–37). Greenwich, CT: JAI Press.

Rousseau, D. M. (1990). Assessing organizational culture: The case for multiple methods. In B. Schneider (Ed.), Organizational climate and culture (pp. 153–192). San Francisco: Jossey-Bass.

Stackman, R. W., Pinder, C. C., & Connor, P. E. (2000). Values lost: Redirecting research on values in the workplace. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate, (pp. 37–54). Thousand Oaks, CA: Sage Publications.

Verbeke, W., Volgering, M., & Hessels, M. (1998). Exploring the conceptual expansion within the field of organizational behavior: Organizational climate and organizational culture. Journal of Management Studies, 35(3), 303–329.CrossRef

Viteles, M. S. (1953). Motivation and morale in industry. New York: W.W. Norton.

Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-basted treatments and case examples. Cambridge: Cambridge University Press.

Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy American Psychologist, 47, 1578–1585.PubMedCrossRef

Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231.CrossRef

Title: Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice
Authors: Charles Glisson
John Landsverk
Sonja Schoenwald
Kelly Kelleher
Kimberly Eaton Hoagwood
Stephen Mayberg
Philip Green
The Research Network on Youth Mental Health
Publication date: 01-03-2008
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 1-2/2008
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-007-0148-5

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1-2/2008

Therapist Turnover and New Program Sustainability in Mental Health Clinics as a Function of Organizational Culture, Climate, and Service Structure

Advancing the Science of Implementation: A Workshop Summary

The De-adoption of Innovative Mental Health Practices (IMHP): Why Organizations Choose not to Sustain an IMHP

Family Advocacy, Support and Education in Children’s Mental Health: Results of a National Survey

A Survey of the Infrastructure for Children’s Mental Health Services: Implications for the Implementation of Empirically Supported Treatments (ESTs)

The Adoption and Implementation of an Evidence Based Practice in Child and Family Mental Health Services Organizations: A Pilot Study of Functional Family Therapy in New York State