Skip to main content
Top
Published in: Implementation Science 1/2019

Open Access 01-12-2019 | Research

Organizational culture and climate profiles: relationships with fidelity to three evidence-based practices for autism in elementary schools

Authors: Nathaniel J. Williams, Hannah E. Frank, Lindsay Frederick, Rinad S. Beidas, David S. Mandell, Gregory A. Aarons, Philip Green, Jill Locke

Published in: Implementation Science | Issue 1/2019

Login to get access

Abstract

Background

Implementation researchers have typically studied organizational culture and climate by testing whether individual dimensions are linked to the implementation of evidence-based practices (EBPs) rather than examining how the overarching social context influences implementation. This approach may limit implementation theory and strategy development to the extent that individual dimensions of culture and climate interact, mutually reinforce or counteract one another, or exhibit non-linear relationships. This study tests whether empirically identifiable culture and climate profiles emerge in a sample of organizations and examines how these profiles relate to EBP fidelity and work attitudes that support EBP sustainment, focusing on three EBPs for youth with autism delivered in schools as an example.

Methods

The study included 65 elementary schools in the U.S. that implemented three EBPs—discrete trial training, pivotal response training, and visual schedules—for youth with autism. Organizational culture and climate and work attitudes were assessed using the Organizational Social Context measure at the beginning of the school year. Observations of EBP fidelity occurred mid school-year. We used bias-adjusted stepwise latent profile modeling to (1) identify subpopulations of schools that share similar culture and climate profiles, and (2) test for mean differences across profiles in observed EBP fidelity and teacher and staff work attitudes.

Results

Controlling for region, four profiles best characterized the organizational cultures and climates of schools. Teachers and staff in schools with a comprehensive profile (high proficiency culture, positive climate) exhibited higher fidelity to two of three EBPs (d’s = .95 to 1.64) and reported superior work attitudes (d’s = .71 to 1.93) than teachers and staff in all other schools. Teachers and staff in supportive schools (low rigidity culture, positive climate) had better work attitudes, but not better fidelity, than those in schools with indifferent (low culture/climate, elevated stress) and constrained (high rigidity and resistance, high stress) profiles.

Conclusions

Organizational culture and climate profiles are a strong predictor of EBP fidelity and work attitudes that support EBP sustainment, highlighting the importance of an organization’s overarching social context when developing implementation theory and strategies. Strategies that foster a comprehensive profile may improve EBP implementation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef
2.
go back to reference Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–50.PubMedPubMedCentralCrossRef Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–50.PubMedPubMedCentralCrossRef
3.
go back to reference Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81.PubMedCrossRef Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41:171–81.PubMedCrossRef
4.
go back to reference Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health and Ment Health Serv Res. 2011;38:4–23.CrossRef Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health and Ment Health Serv Res. 2011;38:4–23.CrossRef
6.
go back to reference Schulte M, Ostroff C, Shmulyian S, Kinicki A. Organizational climate configurations: relationships to collective attitudes, customer satisfaction, and financial performance. J Appl Psychol. 2009;94:618–34.PubMedCrossRef Schulte M, Ostroff C, Shmulyian S, Kinicki A. Organizational climate configurations: relationships to collective attitudes, customer satisfaction, and financial performance. J Appl Psychol. 2009;94:618–34.PubMedCrossRef
8.
go back to reference Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. J Am Acad Child Adolesc Psychiatry. 2013;52:1009–25.PubMedPubMedCentralCrossRef Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. J Am Acad Child Adolesc Psychiatry. 2013;52:1009–25.PubMedPubMedCentralCrossRef
9.
go back to reference Denison D. What is the difference between organizational culture and organizational climate? A native’s point of view on a decade of paradigm wars. Acad Manag Rev. 1996;21:519–654.CrossRef Denison D. What is the difference between organizational culture and organizational climate? A native’s point of view on a decade of paradigm wars. Acad Manag Rev. 1996;21:519–654.CrossRef
10.
go back to reference Ostroff C, Kinicki AJ, Tamkins MM. Organizational culture and climate. In: Borman WC, Ilgen DR, Klimoski RJ, editors. Comprehensive handbook of psychology. New York: Wiley; 2003. p. 565–93. Ostroff C, Kinicki AJ, Tamkins MM. Organizational culture and climate. In: Borman WC, Ilgen DR, Klimoski RJ, editors. Comprehensive handbook of psychology. New York: Wiley; 2003. p. 565–93.
11.
go back to reference Williams NJ, Ehrhart MG, Aarons GA, Marcus SC, Beidas RS. Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: cross-sectional and lagged analyses from a two-year observational study. Implement Sci. 2018;13:85.PubMedPubMedCentralCrossRef Williams NJ, Ehrhart MG, Aarons GA, Marcus SC, Beidas RS. Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: cross-sectional and lagged analyses from a two-year observational study. Implement Sci. 2018;13:85.PubMedPubMedCentralCrossRef
12.
go back to reference Meyer AD, Tsui AS, Hinings C. Configurational approaches to organizational analysis. Acad Manag J. 1993;36:1175–95. Meyer AD, Tsui AS, Hinings C. Configurational approaches to organizational analysis. Acad Manag J. 1993;36:1175–95.
13.
go back to reference Ringeisen H, Henderson K, Hoagwood K. Context matters: schools and the “research to practice gap” in children's mental health. School Psych Rev. 2003;32:153. Ringeisen H, Henderson K, Hoagwood K. Context matters: schools and the “research to practice gap” in children's mental health. School Psych Rev. 2003;32:153.
14.
go back to reference Forman SG, Fagley NS, Steiner DD, Schneider K. Teaching evidence-based interventions: perceptions of influences on use in professional practice in school psychology. Train Educ Prof Psychol. 2009;3:226. Forman SG, Fagley NS, Steiner DD, Schneider K. Teaching evidence-based interventions: perceptions of influences on use in professional practice in school psychology. Train Educ Prof Psychol. 2009;3:226.
15.
go back to reference Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–6.PubMedCrossRef Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–6.PubMedCrossRef
16.
go back to reference Lyon AR, Ludwig KA, Vander Stoep A, Gudmundsen G, McCauley E. Patterns and predictors of mental healthcare utilization in schools and other service sectors among adolescents at risk for depression. School Ment Health. 2013;5:155–65.CrossRef Lyon AR, Ludwig KA, Vander Stoep A, Gudmundsen G, McCauley E. Patterns and predictors of mental healthcare utilization in schools and other service sectors among adolescents at risk for depression. School Ment Health. 2013;5:155–65.CrossRef
17.
go back to reference Fixsen D, Blase K, Metz A, Van Dyke M. Statewide implementation of evidence-based programs. Except Child. 2013;79:213–30.CrossRef Fixsen D, Blase K, Metz A, Van Dyke M. Statewide implementation of evidence-based programs. Except Child. 2013;79:213–30.CrossRef
18.
go back to reference Odom SL, Cox AW, Brock ME, Asd NPDCO. Implementation science, professional development, and autism spectrum disorders. Excep Child. 2013;79:233–51.CrossRef Odom SL, Cox AW, Brock ME, Asd NPDCO. Implementation science, professional development, and autism spectrum disorders. Excep Child. 2013;79:233–51.CrossRef
19.
go back to reference Pellecchia M, Connell JE, Beidas RS, Xie M, Marcus SC, Mandell DS. Dismantling the active ingredients of an intervention for children with autism. J Autism Dev Disord. 2015;45:2917–27.PubMedPubMedCentralCrossRef Pellecchia M, Connell JE, Beidas RS, Xie M, Marcus SC, Mandell DS. Dismantling the active ingredients of an intervention for children with autism. J Autism Dev Disord. 2015;45:2917–27.PubMedPubMedCentralCrossRef
20.
go back to reference Mandell DS, Stahmer AC, Shin S, Xie M, Reisinger E, Marcus SC. The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. Autism. 2013;17:281–95.PubMedPubMedCentralCrossRef Mandell DS, Stahmer AC, Shin S, Xie M, Reisinger E, Marcus SC. The role of treatment fidelity on outcomes during a randomized field trial of an autism intervention. Autism. 2013;17:281–95.PubMedPubMedCentralCrossRef
21.
go back to reference Suhrheinrich J, Stahmer AC, Reed S, Schreibman L, Reisinger E, Mandell D. Implementation challenges in translating pivotal response training into community settings. J Autism Dev Disord. 2013;43:2970–6.PubMedCrossRef Suhrheinrich J, Stahmer AC, Reed S, Schreibman L, Reisinger E, Mandell D. Implementation challenges in translating pivotal response training into community settings. J Autism Dev Disord. 2013;43:2970–6.PubMedCrossRef
22.
go back to reference Locke J, Olsen A, Wideman R, Downey MM, Kretzmann M, Kasari C, Mandell DS. A tangled web: the challenges of implementing an evidence-based social engagement intervention for children with autism in urban public school settings. Behav Ther. 2015;46:54–67.PubMedCrossRef Locke J, Olsen A, Wideman R, Downey MM, Kretzmann M, Kasari C, Mandell DS. A tangled web: the challenges of implementing an evidence-based social engagement intervention for children with autism in urban public school settings. Behav Ther. 2015;46:54–67.PubMedCrossRef
23.
go back to reference Kang-Yi CD, Locke J, Marcus SC, Hadley TR, Mandell DS. School-based behavioral health service use and expenditures for children with autism and children with other disorders. Psychiatr Serv. 2015;67:101–6.PubMedPubMedCentralCrossRef Kang-Yi CD, Locke J, Marcus SC, Hadley TR, Mandell DS. School-based behavioral health service use and expenditures for children with autism and children with other disorders. Psychiatr Serv. 2015;67:101–6.PubMedPubMedCentralCrossRef
24.
go back to reference Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S. Research Network on Youth Mental Health. Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Admin Pol Ment Health 2008;35:98. Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S. Research Network on Youth Mental Health. Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Admin Pol Ment Health 2008;35:98.
25.
go back to reference Hartnell CA, Ou AY, Kinicki A. Organizational culture and organizational effectiveness: a meta-analytic investigation of the competing values framework's theoretical suppositions. J Appl Psychol. 2011;96:677.PubMedCrossRef Hartnell CA, Ou AY, Kinicki A. Organizational culture and organizational effectiveness: a meta-analytic investigation of the competing values framework's theoretical suppositions. J Appl Psychol. 2011;96:677.PubMedCrossRef
26.
go back to reference Ostroff C, Kinicki AJ, Muhammad RS. Organizational culture and climate. In: Schmitt NW, Highhouse S, Weiner IB, editors. Handbook of psychology: industrial and organizational psychology. Hoboken: John Wiley & Sons Inc; 2013. p. 643–76. Ostroff C, Kinicki AJ, Muhammad RS. Organizational culture and climate. In: Schmitt NW, Highhouse S, Weiner IB, editors. Handbook of psychology: industrial and organizational psychology. Hoboken: John Wiley & Sons Inc; 2013. p. 643–76.
27.
go back to reference Hofstede G, Neuijen B, Ohayv DD, Sanders G. Measuring organizational cultures: a qualitative and quantitative study across twenty states. Adm Sci Q. 1990;35:286–316.CrossRef Hofstede G, Neuijen B, Ohayv DD, Sanders G. Measuring organizational cultures: a qualitative and quantitative study across twenty states. Adm Sci Q. 1990;35:286–316.CrossRef
28.
go back to reference James LR, Choi CC, Ko CE, McNeil PK, Minton MK, Wright MA, Kim K. Organizational and psychological climate: a review of theory and research. Eur J Work Organ Psy. 2008;17:5–32.CrossRef James LR, Choi CC, Ko CE, McNeil PK, Minton MK, Wright MA, Kim K. Organizational and psychological climate: a review of theory and research. Eur J Work Organ Psy. 2008;17:5–32.CrossRef
29.
go back to reference Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, Mandell DS. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatr. 2015;169:374–82.PubMedPubMedCentralCrossRef Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, Mandell DS. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatr. 2015;169:374–82.PubMedPubMedCentralCrossRef
30.
go back to reference Glisson C, Schoenwald SK, Kelleher K, Landsverk J, Hoagwood KE, Mayberg S. Research Network on Youth Mental Health. Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Admin Pol Ment Health 2008;35:124–133. Glisson C, Schoenwald SK, Kelleher K, Landsverk J, Hoagwood KE, Mayberg S. Research Network on Youth Mental Health. Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Admin Pol Ment Health 2008;35:124–133.
31.
go back to reference Glisson C, Williams NJ, Hemmelgarn A, Proctor EK, Green P. Increasing clinicians’ EBT exploration and preparation behavior in youth mental health services by changing organizational culture with ARC. Behav Res Ther. 2016;76:40–6.PubMedCrossRef Glisson C, Williams NJ, Hemmelgarn A, Proctor EK, Green P. Increasing clinicians’ EBT exploration and preparation behavior in youth mental health services by changing organizational culture with ARC. Behav Res Ther. 2016;76:40–6.PubMedCrossRef
32.
go back to reference Glisson C, Williams NJ. Assessing and changing organizational social contexts for effective mental health services. Annu Rev Public Health. 2015;36:507–23.PubMedCrossRef Glisson C, Williams NJ. Assessing and changing organizational social contexts for effective mental health services. Annu Rev Public Health. 2015;36:507–23.PubMedCrossRef
33.
go back to reference Olin SS, Williams NJ, Pollock M, Armusewicz K, Kutash K, Glisson C, Hoagwood KE. Quality indicators for family support services and their relationship to organizational social context. Admin Pol Ment Health. 2014;41:43–54.CrossRef Olin SS, Williams NJ, Pollock M, Armusewicz K, Kutash K, Glisson C, Hoagwood KE. Quality indicators for family support services and their relationship to organizational social context. Admin Pol Ment Health. 2014;41:43–54.CrossRef
34.
go back to reference Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Admin Pol Ment Health. 2017;44:269–83.CrossRef Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Admin Pol Ment Health. 2017;44:269–83.CrossRef
35.
go back to reference Glisson C, Green P. The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Admin Pol Ment Health. 2006;33:433–48.CrossRef Glisson C, Green P. The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Admin Pol Ment Health. 2006;33:433–48.CrossRef
36.
go back to reference Glisson C, Hemmelgarn A, Green P, Williams NJ. Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. J Am Acad Child Adolesc Psychiatry. 2013;52:493–500.PubMedCrossRef Glisson C, Hemmelgarn A, Green P, Williams NJ. Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. J Am Acad Child Adolesc Psychiatry. 2013;52:493–500.PubMedCrossRef
37.
go back to reference Williams NJ, Glisson C. Testing a theory of organizational culture, climate and youth outcomes in child welfare systems: a United States national study. Child Abuse Negl. 2014;38:757–67.PubMedCrossRef Williams NJ, Glisson C. Testing a theory of organizational culture, climate and youth outcomes in child welfare systems: a United States national study. Child Abuse Negl. 2014;38:757–67.PubMedCrossRef
38.
go back to reference Woltmann EM, Whitley R, McHugo GJ, Brunette M, Torrey WC, Coots L, Drake RE. The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatr Serv. 2008;59:732–7.PubMedCrossRef Woltmann EM, Whitley R, McHugo GJ, Brunette M, Torrey WC, Coots L, Drake RE. The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatr Serv. 2008;59:732–7.PubMedCrossRef
39.
go back to reference Harrison DA, Newman DA, Roth PL. How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences. Acad Manag J. 2006;49:305–25.CrossRef Harrison DA, Newman DA, Roth PL. How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences. Acad Manag J. 2006;49:305–25.CrossRef
40.
go back to reference Tett RP, Meyer JP. Job satisfaction, organizational commitment, turnover intention, and turnover: path analyses based on meta-analytic findings. Pers Psychol. 1993;46:259–93.CrossRef Tett RP, Meyer JP. Job satisfaction, organizational commitment, turnover intention, and turnover: path analyses based on meta-analytic findings. Pers Psychol. 1993;46:259–93.CrossRef
41.
go back to reference Locke J, Beidas RS, Marcus S, Stahmer A, Aarons GA, Lyon AR, Mandell DS. A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implement Sci. 2016;11:135.PubMedPubMedCentralCrossRef Locke J, Beidas RS, Marcus S, Stahmer A, Aarons GA, Lyon AR, Mandell DS. A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implement Sci. 2016;11:135.PubMedPubMedCentralCrossRef
42.
go back to reference Schreibman L. Intensive behavioral/psychoeducational treatments for autism: research needs and future directions. J Autism Dev Disord. 2000;30:373–8.PubMedCrossRef Schreibman L. Intensive behavioral/psychoeducational treatments for autism: research needs and future directions. J Autism Dev Disord. 2000;30:373–8.PubMedCrossRef
43.
go back to reference Smith T. Discrete trial training in the treatment of autism. Focus Autism Other Dev Disabl. 2001;16:86–92.CrossRef Smith T. Discrete trial training in the treatment of autism. Focus Autism Other Dev Disabl. 2001;16:86–92.CrossRef
44.
go back to reference Arick J, Loos L, Falco R, Krug DA. The STAR Program: strategies for teaching based on autism research. Austin: PRO-ED; 2004. Arick J, Loos L, Falco R, Krug DA. The STAR Program: strategies for teaching based on autism research. Austin: PRO-ED; 2004.
45.
go back to reference Stahmer AC. Using pivotal response training to facilitate appropriate play in children with autistic spectrum disorders. Child Lang Teach Ther. 1999;15:29–40.CrossRef Stahmer AC. Using pivotal response training to facilitate appropriate play in children with autistic spectrum disorders. Child Lang Teach Ther. 1999;15:29–40.CrossRef
46.
go back to reference Dettmer S, Simpson RL, Myles BS, Ganz JB. The use of visual supports to facilitate transitions of students with autism. Focus Autism Other Dev Disabl. 2000;15:163–9.CrossRef Dettmer S, Simpson RL, Myles BS, Ganz JB. The use of visual supports to facilitate transitions of students with autism. Focus Autism Other Dev Disabl. 2000;15:163–9.CrossRef
47.
go back to reference Pinnock H, Barwick M, Carpenter C, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, Sheikh A, Taylor SJC. For the StaRI group. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.PubMedPubMedCentralCrossRef Pinnock H, Barwick M, Carpenter C, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, Sheikh A, Taylor SJC. For the StaRI group. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.PubMedPubMedCentralCrossRef
48.
go back to reference Glisson C, Green P, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: implications for research and practice. Child Abuse Negl. 2012;36:621–32.PubMedCrossRef Glisson C, Green P, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: implications for research and practice. Child Abuse Negl. 2012;36:621–32.PubMedCrossRef
49.
go back to reference Klein KJ, Dansereau F, Hall RJ. Levels issues in theory development, data collection, and analysis. Acad Manag J. 1994;19:195–229. Klein KJ, Dansereau F, Hall RJ. Levels issues in theory development, data collection, and analysis. Acad Manag J. 1994;19:195–229.
50.
go back to reference Chan D. Functional relations among constructs in the same content domain at different levels of analysis: a typology of composition models. J Appl Psychol. 1998;83:234–46.CrossRef Chan D. Functional relations among constructs in the same content domain at different levels of analysis: a typology of composition models. J Appl Psychol. 1998;83:234–46.CrossRef
51.
go back to reference James LR, Demaree RG, Wolf G. RWG: an assessment of within-group interrater agreement. J Appl Psychol. 1993;78:306–9.CrossRef James LR, Demaree RG, Wolf G. RWG: an assessment of within-group interrater agreement. J Appl Psychol. 1993;78:306–9.CrossRef
52.
go back to reference Bliese PD. Within-group agreement, non-independence, and reliability: implications for data aggregation and analysis. In: Klein KJ, Kozlowski SWJ, editors. Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions. San Francisco: Jossey-Bass; 2000. p. 349–81. Bliese PD. Within-group agreement, non-independence, and reliability: implications for data aggregation and analysis. In: Klein KJ, Kozlowski SWJ, editors. Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions. San Francisco: Jossey-Bass; 2000. p. 349–81.
53.
go back to reference LeBreton JM, Senter JL. Answers to 20 questions about interrater reliability and interrater agreement. Organ Res Methods. 2008;11:815–52.CrossRef LeBreton JM, Senter JL. Answers to 20 questions about interrater reliability and interrater agreement. Organ Res Methods. 2008;11:815–52.CrossRef
54.
go back to reference Glisson C, Williams NJ, Green P, Hemmelgarn A, Hoagwood K. The organizational social context of mental health Medicaid waiver programs with family support services: implications for research and practice. Admin Pol Ment Health. 2014;41:32–42.CrossRef Glisson C, Williams NJ, Green P, Hemmelgarn A, Hoagwood K. The organizational social context of mental health Medicaid waiver programs with family support services: implications for research and practice. Admin Pol Ment Health. 2014;41:32–42.CrossRef
55.
go back to reference Glisson C, Durick M. Predictors of job satisfaction and organizational commitment in human service organizations. Adm Sci Q. 1988;33:61–81.CrossRef Glisson C, Durick M. Predictors of job satisfaction and organizational commitment in human service organizations. Adm Sci Q. 1988;33:61–81.CrossRef
56.
go back to reference Stahmer AC, Reed S, Lee E, Reisinger EM, Mandell DS, Connell JE. Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity. Psychol Sch. 2015;52:181–95.PubMedCrossRef Stahmer AC, Reed S, Lee E, Reisinger EM, Mandell DS, Connell JE. Training teachers to use evidence-based practices for autism: examining procedural implementation fidelity. Psychol Sch. 2015;52:181–95.PubMedCrossRef
57.
go back to reference Pellecchia M, Beidas RS, Marcus SC, Fishman J, Kimberly JR, Cannuscio CC, Mandell DS. Study protocol: implementation of a computer-assisted intervention for autism in schools: a hybrid type II cluster randomized effectiveness-implementation trial. Implement Sci. 2016;11:154.PubMedPubMedCentralCrossRef Pellecchia M, Beidas RS, Marcus SC, Fishman J, Kimberly JR, Cannuscio CC, Mandell DS. Study protocol: implementation of a computer-assisted intervention for autism in schools: a hybrid type II cluster randomized effectiveness-implementation trial. Implement Sci. 2016;11:154.PubMedPubMedCentralCrossRef
58.
go back to reference Bakk Z, Tekle FT, Vermunt JK. Estimating the association between latent class membership and external variables using bias adjusted three-step approaches. Sociol Methodol. 2013;43:272–311.CrossRef Bakk Z, Tekle FT, Vermunt JK. Estimating the association between latent class membership and external variables using bias adjusted three-step approaches. Sociol Methodol. 2013;43:272–311.CrossRef
59.
go back to reference Bolck A, Croon M, Hagenaars J. Estimating latent structure models with categorical variables: one-step versus three-step estimators. Polit Anal. 2014;12:3–27.CrossRef Bolck A, Croon M, Hagenaars J. Estimating latent structure models with categorical variables: one-step versus three-step estimators. Polit Anal. 2014;12:3–27.CrossRef
60.
go back to reference Bakk Z, Vermunt JK. Robustness of stepwise latent class modeling with continuous distal outcomes. Struct Equ Model. 2016;23:20–31.CrossRef Bakk Z, Vermunt JK. Robustness of stepwise latent class modeling with continuous distal outcomes. Struct Equ Model. 2016;23:20–31.CrossRef
61.
go back to reference Vermunt JK, Magidson J. Latent class cluster analysis. In: Hagenaars JA, McCutcheon AL, editors. Applied latent class analysis. Cambridge: Cambridge University Press; 2002. p. 89–106.CrossRef Vermunt JK, Magidson J. Latent class cluster analysis. In: Hagenaars JA, McCutcheon AL, editors. Applied latent class analysis. Cambridge: Cambridge University Press; 2002. p. 89–106.CrossRef
62.
go back to reference Nylund KL, Asparouhov T, Muthen BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equ Modeling. 2007;14:535–69.CrossRef Nylund KL, Asparouhov T, Muthen BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equ Modeling. 2007;14:535–69.CrossRef
63.
go back to reference Raftery AE. Bayesian model selection in social research. Sociol Methodol. 1995;25:111–63.CrossRef Raftery AE. Bayesian model selection in social research. Sociol Methodol. 1995;25:111–63.CrossRef
64.
go back to reference Celeux G, Soromenho G. An entropy criterion for assessing the number of clusters in a mixture model. J Classif. 1996;13:195–212.CrossRef Celeux G, Soromenho G. An entropy criterion for assessing the number of clusters in a mixture model. J Classif. 1996;13:195–212.CrossRef
65.
go back to reference Foti RJ, Thompson NJ, Allgood SF. The pattern-oriented approach: a framework for the experience of work. Ind Organ Psychol. 2011;4:122–5.CrossRef Foti RJ, Thompson NJ, Allgood SF. The pattern-oriented approach: a framework for the experience of work. Ind Organ Psychol. 2011;4:122–5.CrossRef
66.
go back to reference Morin AJ, Morizot J, Boudrias JS, Madore I. A multifoci person-centered perspective on workplace affective commitment: a latent profile/factor mixture analysis. Organ Res Methods. 2011;14:58–90.CrossRef Morin AJ, Morizot J, Boudrias JS, Madore I. A multifoci person-centered perspective on workplace affective commitment: a latent profile/factor mixture analysis. Organ Res Methods. 2011;14:58–90.CrossRef
67.
go back to reference Vermunt JK. Latent class modeling with covariates: two improved three-step approaches. Polit Anal. 2010;18:450–69.CrossRef Vermunt JK. Latent class modeling with covariates: two improved three-step approaches. Polit Anal. 2010;18:450–69.CrossRef
68.
go back to reference Muthén LK, Muthén BO. Mplus user’s guide: statistical analysis with latent variables. Muthén & Muthén: Los Angeles; 1998. Muthén LK, Muthén BO. Mplus user’s guide: statistical analysis with latent variables. Muthén & Muthén: Los Angeles; 1998.
69.
go back to reference Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Earlbaum Associates; 1988. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Earlbaum Associates; 1988.
70.
go back to reference Henggeler SW, Chapman JE, Rowland MD, Halliday-Boykins CA, Randall J, Shackelford J, Schoenwald SK. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Psychol. 2008;76:556–67.CrossRef Henggeler SW, Chapman JE, Rowland MD, Halliday-Boykins CA, Randall J, Shackelford J, Schoenwald SK. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Psychol. 2008;76:556–67.CrossRef
71.
go back to reference Ostroff C, Schulte M. A configural approach to the study of organizational culture and climate. In: Schneider B, Barbera KM, editors. The Oxford Handbook of Organizational Climate and Culture. New York: Oxford University Press; 2014. p. 532–52. Ostroff C, Schulte M. A configural approach to the study of organizational culture and climate. In: Schneider B, Barbera KM, editors. The Oxford Handbook of Organizational Climate and Culture. New York: Oxford University Press; 2014. p. 532–52.
72.
go back to reference Schneider CQ, Wagemann C. Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis. New York: Cambridge University Press; 2012.CrossRef Schneider CQ, Wagemann C. Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis. New York: Cambridge University Press; 2012.CrossRef
73.
go back to reference McKay PF, Avery DR, Liao H, Morris MA. Does diversity climate lead to customer satisfaction? It depends on the service climate and business unit demography. Organ Sci. 2011;22:788–803.CrossRef McKay PF, Avery DR, Liao H, Morris MA. Does diversity climate lead to customer satisfaction? It depends on the service climate and business unit demography. Organ Sci. 2011;22:788–803.CrossRef
74.
go back to reference Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci. 2014;9:157.PubMedPubMedCentralCrossRef Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci. 2014;9:157.PubMedPubMedCentralCrossRef
75.
go back to reference Ryan RM, Deci EL. Self-determination theory: basic psychological needs in motivation, development, and wellness. Guilford: New York; 2017. Ryan RM, Deci EL. Self-determination theory: basic psychological needs in motivation, development, and wellness. Guilford: New York; 2017.
76.
go back to reference Williams NJ, Beidas RS. Navigating the storm: how proficient organizational culture promotes clinician retention in the shift to evidence-based practice. PLoS One. 2018;13:e0209745.PubMedPubMedCentralCrossRef Williams NJ, Beidas RS. Navigating the storm: how proficient organizational culture promotes clinician retention in the shift to evidence-based practice. PLoS One. 2018;13:e0209745.PubMedPubMedCentralCrossRef
77.
go back to reference Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev. 2002;5:233–53.PubMedCrossRef Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev. 2002;5:233–53.PubMedCrossRef
78.
go back to reference Rollins AL, Salyers MP, Tsai J, Lydick JM. Staff turnover in statewide implementation of ACT: relationship with ACT fidelity and other team characteristics. Admin Pol Ment Health. 2010;37:417–26.CrossRef Rollins AL, Salyers MP, Tsai J, Lydick JM. Staff turnover in statewide implementation of ACT: relationship with ACT fidelity and other team characteristics. Admin Pol Ment Health. 2010;37:417–26.CrossRef
79.
go back to reference Hom PW, Lee TW, Shaw JD, Hausknecht JP. One hundred years of employee turnover theory and research. J Appl Psychol. 2017;102:530–45.PubMedCrossRef Hom PW, Lee TW, Shaw JD, Hausknecht JP. One hundred years of employee turnover theory and research. J Appl Psychol. 2017;102:530–45.PubMedCrossRef
80.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.PubMedPubMedCentralCrossRef Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.PubMedPubMedCentralCrossRef
81.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10(1):11.PubMedPubMedCentralCrossRef Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10(1):11.PubMedPubMedCentralCrossRef
Metadata
Title
Organizational culture and climate profiles: relationships with fidelity to three evidence-based practices for autism in elementary schools
Authors
Nathaniel J. Williams
Hannah E. Frank
Lindsay Frederick
Rinad S. Beidas
David S. Mandell
Gregory A. Aarons
Philip Green
Jill Locke
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-019-0863-9

Other articles of this Issue 1/2019

Implementation Science 1/2019 Go to the issue