Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Study protocol

The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health

Authors: Aaron R. Lyon, Kelly Whitaker, Jill Locke, Clayton R. Cook, Kevin M. King, Mylien Duong, Chayna Davis, Mark D. Weist, Mark G. Ehrhart, Gregory A. Aarons

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Integrated healthcare delivered by work groups in nontraditional service settings is increasingly common, yet contemporary implementation frameworks typically assume a single organization—or organizational unit—within which system-level processes influence service quality and implementation success. Recent implementation frameworks predict that inter-organizational alignment (i.e., similarity in values, characteristics, activities related to implementation across organizations) may facilitate the implementation of evidence-based practices (EBP), but few studies have evaluated this premise. This study’s aims examine the impact of overlapping organizational contexts by evaluating the implementation contexts of externally employed mental health clinicians working in schools—the most common integrated service delivery setting for children and adolescents. Aim 1 is to estimate the effects of unique intra-organizational implementation contexts and combined inter-organizational alignment on implementation outcomes. Aim 2 is to examine the underlying mechanisms through which inter-organizational alignment facilitates or hinders EBP implementation.

Methods/design

This study will conduct sequential, exploratory mixed-methods research to evaluate the intra- and inter-organizational implementation contexts of schools and the external community-based organizations that most often employ school-based mental health clinicians, as they relate to mental health EBP implementation. Aim 1 will involve quantitative surveys with school-based, externally-employed mental health clinicians, their supervisors, and proximal school-employed staff (total n = 120 participants) to estimate the effects of each organization’s general and implementation-specific organizational factors (e.g., climate, leadership) on implementation outcomes (fidelity, acceptability, appropriateness) and assess the moderating role of the degree of clinician embeddedness in the school setting. Aim 2 will explore the mechanisms through which inter-organizational alignment influences implementation outcomes by presenting the results of Aim 1 surveys to school-based clinicians (n = 30) and conducting semi-structured qualitative interviews. Qualitative data will be evaluated using an integrative inductive and deductive approach.

Discussion

The study aims are expected to identify intra- and inter-organizational constructs that are most instrumental to EBP implementation success in school-based integrated care settings and illuminate mechanisms that may account for the influence of inter-organizational alignment. In addition to improving school-based mental health, these findings will spur future implementation science that considers the relationships across organizations and optimize the capacity of implementation science to guide practice in increasingly complex systems of care.
Literature
1.
go back to reference Butler M, Kane RL, McAlpine D, Kathol RG, Fu SS, Hagedorn H, et al. Integration of mental health/substance abuse and primary care. Evid Reporttechnology Assess. 2008;173:1–362. Butler M, Kane RL, McAlpine D, Kathol RG, Fu SS, Hagedorn H, et al. Integration of mental health/substance abuse and primary care. Evid Reporttechnology Assess. 2008;173:1–362.
2.
go back to reference Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health Ment Health Serv Res. 2011;38:4–23.CrossRef Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health Ment Health Serv Res. 2011;38:4–23.CrossRef
3.
go back to reference Croft B, Parish SL. Care integration in the patient protection and affordable care act: implications for behavioral health. Adm Policy Ment Health Ment Health Serv Res. 2013;40:258–63.CrossRef Croft B, Parish SL. Care integration in the patient protection and affordable care act: implications for behavioral health. Adm Policy Ment Health Ment Health Serv Res. 2013;40:258–63.CrossRef
4.
go back to reference WHO global strategy on people-centred and integrated health services. World Health Organization; 2015. WHO global strategy on people-centred and integrated health services. World Health Organization; 2015.
5.
go back to reference Asarnow JR, Rozenman M, Wiblin J, Zeltzer L. Integrated medical-behavioral care compared with usual primary care for child and adolescent behavioral health: a meta-analysis. JAMA Pediatr. 2015;169:929–37.PubMedCrossRef Asarnow JR, Rozenman M, Wiblin J, Zeltzer L. Integrated medical-behavioral care compared with usual primary care for child and adolescent behavioral health: a meta-analysis. JAMA Pediatr. 2015;169:929–37.PubMedCrossRef
6.
go back to reference Skowyra KR, Cocozza JJ. Blueprint for change: a comprehensive model for the identification and treatment of youth with mental health needs in contact with the juvenile justice system. Policy Res Assoc Inc. 2007; Skowyra KR, Cocozza JJ. Blueprint for change: a comprehensive model for the identification and treatment of youth with mental health needs in contact with the juvenile justice system. Policy Res Assoc Inc. 2007;
7.
go back to reference Kortenkamp K. The well-being of children involved with the child welfare system: a national overview. Urban Inst. 2002;B B-43. Kortenkamp K. The well-being of children involved with the child welfare system: a national overview. Urban Inst. 2002;B B-43.
8.
go back to reference Burns BJ, Phillips SD, Wagner HR, Barth RP, Kolko DJ, Campbell Y, et al. Mental health need and access to mental health services by youths involved with child welfare: a national survey. J Am Acad Child Adolesc Psychiatry. 2004;43:960–70.PubMedCrossRef Burns BJ, Phillips SD, Wagner HR, Barth RP, Kolko DJ, Campbell Y, et al. Mental health need and access to mental health services by youths involved with child welfare: a national survey. J Am Acad Child Adolesc Psychiatry. 2004;43:960–70.PubMedCrossRef
9.
go back to reference Skowyra K, Cocozza JJ. A blueprint for change: improving the system response to youth with mental health needs involved with the juvenile justice system. NY: National Center for Mental Health and Juvenile Justice Delmar; 2006. Skowyra K, Cocozza JJ. A blueprint for change: improving the system response to youth with mental health needs involved with the juvenile justice system. NY: National Center for Mental Health and Juvenile Justice Delmar; 2006.
11.
go back to reference Unützer J, Chan Y-F, Hafer E, Knaster J, Shields A, Powers D, et al. Quality improvement with pay-for-performance incentives in integrated behavioral health care. Am J Public Health. 2012;102:e41–5.PubMedPubMedCentralCrossRef Unützer J, Chan Y-F, Hafer E, Knaster J, Shields A, Powers D, et al. Quality improvement with pay-for-performance incentives in integrated behavioral health care. Am J Public Health. 2012;102:e41–5.PubMedPubMedCentralCrossRef
12.
go back to reference Bickman L, Smith CM, Lambert EW, Andrade AR. Evaluation of a congressionally mandated wraparound demonstration. J Child Fam Stud. 2003;12:135–56.CrossRef Bickman L, Smith CM, Lambert EW, Andrade AR. Evaluation of a congressionally mandated wraparound demonstration. J Child Fam Stud. 2003;12:135–56.CrossRef
13.
go back to reference Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17:1–30.CrossRef Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17:1–30.CrossRef
14.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef
15.
go back to reference Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, et al. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health Ment Health Serv Res. 2008;35:98.CrossRef Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, et al. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health Ment Health Serv Res. 2008;35:98.CrossRef
16.
go back to reference Glisson C, Green P. Organizational climate, services, and outcomes in child welfare systems. Child Abuse Negl. 2011;35:582–91.PubMedCrossRef Glisson C, Green P. Organizational climate, services, and outcomes in child welfare systems. Child Abuse Negl. 2011;35:582–91.PubMedCrossRef
17.
go back to reference Glisson C, Schoenwald SK, Hemmelgarn A, Green P, Dukes D, Armstrong KS, et al. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol. 2010;78:537–50.PubMedPubMedCentralCrossRef Glisson C, Schoenwald SK, Hemmelgarn A, Green P, Dukes D, Armstrong KS, et al. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol. 2010;78:537–50.PubMedPubMedCentralCrossRef
18.
go back to reference Organ DW, Podaskoff PM, MacKenzie SB. Organizational citizenship behavior: its nature, antecedents, and consequences. Sage Publ. 2005; Organ DW, Podaskoff PM, MacKenzie SB. Organizational citizenship behavior: its nature, antecedents, and consequences. Sage Publ. 2005;
19.
go back to reference Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7:56.PubMedPubMedCentralCrossRef Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7:56.PubMedPubMedCentralCrossRef
20.
go back to reference Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: implications for services and interventions research. Clin Psychol Sci Pract. 2006;13:73–89.CrossRef Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: implications for services and interventions research. Clin Psychol Sci Pract. 2006;13:73–89.CrossRef
21.
go back to reference Shaw S, Rosen R, Rumbold B. What is integrated care? Lond Nuffield Trust: An overview of integrated care in the NHS; 2011. Shaw S, Rosen R, Rumbold B. What is integrated care? Lond Nuffield Trust: An overview of integrated care in the NHS; 2011.
22.
go back to reference Beidas RS, Edmunds J, Ditty M, Watkins J, Walsh L, Marcus S, et al. Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Adm Policy Ment Health Ment Health Serv Res. 2014;41:788–99.CrossRef Beidas RS, Edmunds J, Ditty M, Watkins J, Walsh L, Marcus S, et al. Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Adm Policy Ment Health Ment Health Serv Res. 2014;41:788–99.CrossRef
23.
go back to reference Guerrero EG, He A, Kim A, Aarons GA. Organizational implementation of evidence-based substance abuse treatment in racial and ethnic minority communities. Adm Policy Ment Health Ment Health Serv Res. 2014;41:737–49.CrossRef Guerrero EG, He A, Kim A, Aarons GA. Organizational implementation of evidence-based substance abuse treatment in racial and ethnic minority communities. Adm Policy Ment Health Ment Health Serv Res. 2014;41:737–49.CrossRef
24.
go back to reference Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci IS. 2014;9:157.PubMedCrossRef Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci IS. 2014;9:157.PubMedCrossRef
25.
go back to reference Aarons G, Ehrhart M, Farahnak L, Sklar M. The role of leadership in creating a strategic climate for evidence-based practice implementation and sustainment in systems and organizations. Front Public Health Serv Syst Res. 2014;3:3. Aarons G, Ehrhart M, Farahnak L, Sklar M. The role of leadership in creating a strategic climate for evidence-based practice implementation and sustainment in systems and organizations. Front Public Health Serv Syst Res. 2014;3:3.
26.
go back to reference Lippitt R, Van Til J. Can we achieve a collaborative community? Issues, Imperatives, potentials. J Volunt Action Res. 1981. Lippitt R, Van Til J. Can we achieve a collaborative community? Issues, Imperatives, potentials. J Volunt Action Res. 1981.
28.
go back to reference Jones N, Thomas P, Rudd L. Collaborating for mental health services in wales: a process evaluation. Public Adm. 2004;82:109–21.CrossRef Jones N, Thomas P, Rudd L. Collaborating for mental health services in wales: a process evaluation. Public Adm. 2004;82:109–21.CrossRef
29.
go back to reference Chuang E, Wells R. The role of inter-agency collaboration in facilitating receipt of behavioral health services for youth involved with child welfare and juvenile justice. Child Youth Serv Rev. 2010;32:1814–22.PubMedPubMedCentralCrossRef Chuang E, Wells R. The role of inter-agency collaboration in facilitating receipt of behavioral health services for youth involved with child welfare and juvenile justice. Child Youth Serv Rev. 2010;32:1814–22.PubMedPubMedCentralCrossRef
30.
go back to reference Cottrell D, Lucey D, Porter I, Walker D. Joint working between child and adolescent mental health services and the department of social services: the Leeds model. Clin Child Psychol Psychiatry. 2000;5:481–9.CrossRef Cottrell D, Lucey D, Porter I, Walker D. Joint working between child and adolescent mental health services and the department of social services: the Leeds model. Clin Child Psychol Psychiatry. 2000;5:481–9.CrossRef
31.
go back to reference Bai Y, Wells R, Hillemeier MM. Coordination between child welfare agencies and mental health service providers, children’s service use, and outcomes. Child Abuse Negl. 2009;33:372–81.PubMedPubMedCentralCrossRef Bai Y, Wells R, Hillemeier MM. Coordination between child welfare agencies and mental health service providers, children’s service use, and outcomes. Child Abuse Negl. 2009;33:372–81.PubMedPubMedCentralCrossRef
32.
go back to reference Glisson C, Hemmelgarn A. The effects organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse Negl. 1998;22:401–21.PubMedCrossRef Glisson C, Hemmelgarn A. The effects organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse Negl. 1998;22:401–21.PubMedCrossRef
33.
go back to reference Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17:67–79.PubMedCrossRef Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17:67–79.PubMedCrossRef
34.
go back to reference Sobo EJ, Bowman C, Gifford AL. Behind the scenes in health care improvement: the complex structures and emergent strategies of implementation science. Soc Sci Med. 2008;67:1530–40.PubMedCrossRef Sobo EJ, Bowman C, Gifford AL. Behind the scenes in health care improvement: the complex structures and emergent strategies of implementation science. Soc Sci Med. 2008;67:1530–40.PubMedCrossRef
35.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.PubMedPubMedCentralCrossRef Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.PubMedPubMedCentralCrossRef
36.
go back to reference Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manag Rev. 1996;21:1055–80. Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manag Rev. 1996;21:1055–80.
38.
go back to reference Ehrhart MG, Schneider B, Macey WH. Organizational climate and culture: an introduction to theory, research, and practice: Routledge; 2013. Ehrhart MG, Schneider B, Macey WH. Organizational climate and culture: an introduction to theory, research, and practice: Routledge; 2013.
39.
go back to reference Zohar D, Luria G. A multilevel model of safety climate: cross-level relationships between organization and group-level climates. J Appl Psychol. 2005;90:616–28.PubMedCrossRef Zohar D, Luria G. A multilevel model of safety climate: cross-level relationships between organization and group-level climates. J Appl Psychol. 2005;90:616–28.PubMedCrossRef
40.
go back to reference Palinkas LA, Fuentes D, Finno M, Garcia AR, Holloway IW, Chamberlain P. Inter-organizational collaboration in the implementation of evidence-based practices among public agencies serving abused and neglected youth. Adm Policy Ment Health Ment Health Serv Res. 2014;41:74–85.CrossRef Palinkas LA, Fuentes D, Finno M, Garcia AR, Holloway IW, Chamberlain P. Inter-organizational collaboration in the implementation of evidence-based practices among public agencies serving abused and neglected youth. Adm Policy Ment Health Ment Health Serv Res. 2014;41:74–85.CrossRef
41.
go back to reference Weinberg LA, Zetlin A, Shea NM. Removing barriers to educating children in foster care through interagency collaboration: a seven county multiple-case study. Child Welf Arlingt. 2009;88:77–111. Weinberg LA, Zetlin A, Shea NM. Removing barriers to educating children in foster care through interagency collaboration: a seven county multiple-case study. Child Welf Arlingt. 2009;88:77–111.
42.
go back to reference Johnson P, Wistow G, Schulz R, Hardy B. Interagency and interprofessional collaboration in community care: the interdependence of structures and values. J Interprof Care. 2003;17:70–83.CrossRef Johnson P, Wistow G, Schulz R, Hardy B. Interagency and interprofessional collaboration in community care: the interdependence of structures and values. J Interprof Care. 2003;17:70–83.CrossRef
43.
go back to reference Pullmann MD, Bruns EJ, Daly BP, Sander MA. Improving the evaluation and impact of mental health and other supportive school-based programmes on students’ academic outcomes. Adv School Ment Health Promot. 2013;6:226–30.CrossRef Pullmann MD, Bruns EJ, Daly BP, Sander MA. Improving the evaluation and impact of mental health and other supportive school-based programmes on students’ academic outcomes. Adv School Ment Health Promot. 2013;6:226–30.CrossRef
44.
go back to reference Pullmann MD, VanHooser S, Hoffman C, Heflinger CA. Barriers to and supports of family participation in a rural system of care for children with serious emotional problems. Community Ment Health J. 2010;46:211–20.PubMedCrossRef Pullmann MD, VanHooser S, Hoffman C, Heflinger CA. Barriers to and supports of family participation in a rural system of care for children with serious emotional problems. Community Ment Health J. 2010;46:211–20.PubMedCrossRef
45.
go back to reference Kataoka S, Stein BD, Nadeem E, Wong M. Who gets care? Mental health service use following a school-based suicide prevention program. J Am Acad Child Adolesc Psychiatry. 2007;46:1341–8.PubMedCrossRef Kataoka S, Stein BD, Nadeem E, Wong M. Who gets care? Mental health service use following a school-based suicide prevention program. J Am Acad Child Adolesc Psychiatry. 2007;46:1341–8.PubMedCrossRef
46.
go back to reference Lyon AR, Frazier SL, Mehta T, Atkins MS, Weisbach J. Easier said than done: intervention sustainability in an urban after-school program. Adm Policy Ment Health Ment Health Serv Res. 2011;38:504–17.CrossRef Lyon AR, Frazier SL, Mehta T, Atkins MS, Weisbach J. Easier said than done: intervention sustainability in an urban after-school program. Adm Policy Ment Health Ment Health Serv Res. 2011;38:504–17.CrossRef
47.
go back to reference Weist MD, Bruns EJ, Whitaker K, Wei Y, Kutcher S, Larsen T, et al. School mental health promotion and intervention: experiences from four nations. Sch Psychol Int. 2017;38:343–62.CrossRef Weist MD, Bruns EJ, Whitaker K, Wei Y, Kutcher S, Larsen T, et al. School mental health promotion and intervention: experiences from four nations. Sch Psychol Int. 2017;38:343–62.CrossRef
48.
go back to reference Weist MD, Lever NA, Bradshaw CP, Owens JS. Handbook of school mental health: research, training, practice, and policy. Springer Science & Business Media; 2013. Weist MD, Lever NA, Bradshaw CP, Owens JS. Handbook of school mental health: research, training, practice, and policy. Springer Science & Business Media; 2013.
49.
go back to reference Weist MD, Rowling L. International efforts to advance mental health in schools. Int J Ment Health Promot. 2002;4:3–7.CrossRef Weist MD, Rowling L. International efforts to advance mental health in schools. Int J Ment Health Promot. 2002;4:3–7.CrossRef
50.
go back to reference Burns B, Burns BJ, Costello EJ, Angold A, Tweed D, Stangl D, et al. Children’s mental health service use across service sectors. Health Aff Proj Hope. 1995;14:147–59.CrossRef Burns B, Burns BJ, Costello EJ, Angold A, Tweed D, Stangl D, et al. Children’s mental health service use across service sectors. Health Aff Proj Hope. 1995;14:147–59.CrossRef
51.
go back to reference Farmer EMZ, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–6.PubMedCrossRef Farmer EMZ, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–6.PubMedCrossRef
52.
go back to reference Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, et al. Prevalence and treatment of mental disorders, 1990 to 2003. N Engl J Med. 2005;352:2515–23.PubMedPubMedCentralCrossRef Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, et al. Prevalence and treatment of mental disorders, 1990 to 2003. N Engl J Med. 2005;352:2515–23.PubMedPubMedCentralCrossRef
53.
go back to reference Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, et al. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6:99–111.CrossRef Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, et al. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6:99–111.CrossRef
54.
go back to reference Rones M, Hoagwood K. School-based mental health services: a research review. Clin Child Fam Psychol Rev. 2000;3:223–41.PubMedCrossRef Rones M, Hoagwood K. School-based mental health services: a research review. Clin Child Fam Psychol Rev. 2000;3:223–41.PubMedCrossRef
55.
go back to reference Wilson DB, Gottfredson DC, Najaka SS. School-based prevention of problem behaviors: a meta-analysis. J Quant Criminol. 2001;17:247–72.CrossRef Wilson DB, Gottfredson DC, Najaka SS. School-based prevention of problem behaviors: a meta-analysis. J Quant Criminol. 2001;17:247–72.CrossRef
56.
go back to reference Lyon AR, Cook CR, Brown EC, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13:5.PubMedPubMedCentralCrossRef Lyon AR, Cook CR, Brown EC, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13:5.PubMedPubMedCentralCrossRef
57.
go back to reference Foster S, Rollefson M, Doksum T, Noonan D, Robinson G, Teich J. School mental health services in the United States, 2002-2003. Subst Abuse Ment Health Serv Adm 2005. Foster S, Rollefson M, Doksum T, Noonan D, Robinson G, Teich J. School mental health services in the United States, 2002-2003. Subst Abuse Ment Health Serv Adm 2005.
58.
59.
go back to reference Eber L, Weist MD, Barrett S. An introduction to the interconnected systems framework. In: Advancing education effectiveness: an interconnected systems framework for positive behavioral interventions and supports (PBIS) and school mental health. Eugene, Oregon: University of Oregon Press; 2013. p. 3–17. Eber L, Weist MD, Barrett S. An introduction to the interconnected systems framework. In: Advancing education effectiveness: an interconnected systems framework for positive behavioral interventions and supports (PBIS) and school mental health. Eugene, Oregon: University of Oregon Press; 2013. p. 3–17.
60.
go back to reference Forman SG, Fagley NS, Chu BC, Walkup JT. Factors influencing school psychologists’ “willingness to implement” evidence-based interventions. Sch Ment Heal. 2012;4:207–18.CrossRef Forman SG, Fagley NS, Chu BC, Walkup JT. Factors influencing school psychologists’ “willingness to implement” evidence-based interventions. Sch Ment Heal. 2012;4:207–18.CrossRef
61.
go back to reference Lyon AR, Charlesworth-Attie S, Vander Stoep A, McCauley E. Research into practice. Sch Psychol Rev. 2011;40:569–81. Lyon AR, Charlesworth-Attie S, Vander Stoep A, McCauley E. Research into practice. Sch Psychol Rev. 2011;40:569–81.
62.
go back to reference Lyon AR, Ludwig K, Romano E, Koltracht J, Stoep AV, McCauley E. Using modular psychotherapy in school mental health: provider perspectives on intervention-setting fit. J Clin Child Adolesc Psychol. 2014;43:890–901.PubMedCrossRef Lyon AR, Ludwig K, Romano E, Koltracht J, Stoep AV, McCauley E. Using modular psychotherapy in school mental health: provider perspectives on intervention-setting fit. J Clin Child Adolesc Psychol. 2014;43:890–901.PubMedCrossRef
63.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11.PubMedPubMedCentralCrossRef Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11.PubMedPubMedCentralCrossRef
64.
go back to reference Mellin EA, Taylor L, Weist MD. The expanded school mental health collaboration instrument [school version]: development and initial psychometrics. Sch Ment Heal. 2014;6:151–62.CrossRef Mellin EA, Taylor L, Weist MD. The expanded school mental health collaboration instrument [school version]: development and initial psychometrics. Sch Ment Heal. 2014;6:151–62.CrossRef
65.
go back to reference Zarb P, Coignard B, Griskeviciene J, Muller A, Vankerckhoven V, Weist K, et al. The European Centre for Disease Prevention and Control (ECDC) pilot point prevalence survey of healthcare-associated infections and antimicrobial use. Euro Surveill. 2012;17:1–16.CrossRef Zarb P, Coignard B, Griskeviciene J, Muller A, Vankerckhoven V, Weist K, et al. The European Centre for Disease Prevention and Control (ECDC) pilot point prevalence survey of healthcare-associated infections and antimicrobial use. Euro Surveill. 2012;17:1–16.CrossRef
66.
go back to reference Mellin EA, Weist MD. Exploring school mental health collaboration in an urban community: a social capital perspective. Sch Ment Heal. 2011;3:81–92.CrossRef Mellin EA, Weist MD. Exploring school mental health collaboration in an urban community: a social capital perspective. Sch Ment Heal. 2011;3:81–92.CrossRef
67.
go back to reference Splett JW, Perales K, Halliday-Boykins CA, Gilchrest CE, Gibson N, Weist MD. Best practices for teaming and collaboration in the interconnected systems framework. J Appl Sch Psychol. 2017;33:347–68.CrossRef Splett JW, Perales K, Halliday-Boykins CA, Gilchrest CE, Gibson N, Weist MD. Best practices for teaming and collaboration in the interconnected systems framework. J Appl Sch Psychol. 2017;33:347–68.CrossRef
68.
go back to reference Garland AF, Haine-Schlagel R, Brookman-Frazee L, Baker-Ericzen M, Trask E, Fawley-King K. Improving community-based mental health care for children: translating knowledge into action. Adm Policy Ment Health Ment Health Serv Res 2013;40:6–22. Garland AF, Haine-Schlagel R, Brookman-Frazee L, Baker-Ericzen M, Trask E, Fawley-King K. Improving community-based mental health care for children: translating knowledge into action. Adm Policy Ment Health Ment Health Serv Res 2013;40:6–22.
69.
go back to reference Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.PubMedPubMedCentralCrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.PubMedPubMedCentralCrossRef
70.
go back to reference Lewis C, Boyd M, Beidas R, Lyon A, Chambers D, Aarons G, et al. A research agenda for mechanistic dissemination and implementation research. 2015. Lewis C, Boyd M, Beidas R, Lyon A, Chambers D, Aarons G, et al. A research agenda for mechanistic dissemination and implementation research. 2015.
72.
go back to reference Pajunen K. The nature of organizational mechanisms. Organ Stud. 2008;29:1449–68.CrossRef Pajunen K. The nature of organizational mechanisms. Organ Stud. 2008;29:1449–68.CrossRef
73.
go back to reference Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, et al. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010;167:748–51.PubMedCrossRef Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, et al. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010;167:748–51.PubMedCrossRef
74.
go back to reference Insel TR. The NIMH research domain criteria (RDoC) project: precision medicine for psychiatry. Am J Psychiatry. 2014;171:395–7.PubMedCrossRef Insel TR. The NIMH research domain criteria (RDoC) project: precision medicine for psychiatry. Am J Psychiatry. 2014;171:395–7.PubMedCrossRef
75.
go back to reference Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Health Ment Health Serv Res. 2016;43:783–98.CrossRef Williams NJ. Multilevel mechanisms of implementation strategies in mental health: integrating theory, research, and practice. Adm Policy Ment Health Ment Health Serv Res. 2016;43:783–98.CrossRef
76.
go back to reference Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health Ment Health Serv Res. 2011;38:44–53.CrossRef Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health Ment Health Serv Res. 2011;38:44–53.CrossRef
77.
go back to reference Glisson C, Green P, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: implications for research and practice. Child Abuse Negl. 2012;36:621–32.PubMedCrossRef Glisson C, Green P, Williams NJ. Assessing the organizational social context (OSC) of child welfare systems: implications for research and practice. Child Abuse Negl. 2012;36:621–32.PubMedCrossRef
78.
go back to reference Locke J, Beidas RS, Marcus S, Stahmer A, Aarons GA, Lyon AR, et al. A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implement Sci. 2016;11:135.PubMedPubMedCentralCrossRef Locke J, Beidas RS, Marcus S, Stahmer A, Aarons GA, Lyon AR, et al. A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implement Sci. 2016;11:135.PubMedPubMedCentralCrossRef
79.
go back to reference Finn NK, Torres EM, Ehrhart MG, Roesch SC, Aarons GA. Cross-validation of the implementation leadership scale (ILS) in child welfare service organizations. Child Maltreat. 2016;21:250–5.PubMedCrossRef Finn NK, Torres EM, Ehrhart MG, Roesch SC, Aarons GA. Cross-validation of the implementation leadership scale (ILS) in child welfare service organizations. Child Maltreat. 2016;21:250–5.PubMedCrossRef
80.
go back to reference Ehrhart MG, Torres EM, Wright LA, Martinez SY, Aarons GA. Validating the implementation climate scale (ICS) in child welfare organizations. Child Abuse Negl. 2016;53(Supplement C):17–26.PubMedCrossRef Ehrhart MG, Torres EM, Wright LA, Martinez SY, Aarons GA. Validating the implementation climate scale (ICS) in child welfare organizations. Child Abuse Negl. 2016;53(Supplement C):17–26.PubMedCrossRef
81.
go back to reference Ehrhart MG, Aarons GA, Farahnak LR. Going above and beyond for implementation: the development and validity testing of the implementation citizenship behavior scale (ICBS). Implement Sci IS. 2015;10:65.PubMedCrossRef Ehrhart MG, Aarons GA, Farahnak LR. Going above and beyond for implementation: the development and validity testing of the implementation citizenship behavior scale (ICBS). Implement Sci IS. 2015;10:65.PubMedCrossRef
82.
go back to reference Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6:61–74.PubMedPubMedCentralCrossRef Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6:61–74.PubMedPubMedCentralCrossRef
83.
go back to reference Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12:108.PubMedPubMedCentralCrossRef Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12:108.PubMedPubMedCentralCrossRef
84.
go back to reference Corp IBM. IBM SPSS Statistics for Windows, version 19.0. IBm Corp: Armonk, NY; 2010. Corp IBM. IBM SPSS Statistics for Windows, version 19.0. IBm Corp: Armonk, NY; 2010.
86.
go back to reference Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. SAGE; 2002. Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. SAGE; 2002.
87.
go back to reference Core Team R. R 3.4.2: a language and environment for statistical. Computing. 2017; Core Team R. R 3.4.2: a language and environment for statistical. Computing. 2017;
88.
go back to reference Edwards JR. Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organ Behav Hum Decis Process. 1995;64:307–24.CrossRef Edwards JR. Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organ Behav Hum Decis Process. 1995;64:307–24.CrossRef
89.
go back to reference Page TJ, Spreng RA. Difference scores versus direct effects in service quality measurement. J Serv Res. 2002;4:184–92.CrossRef Page TJ, Spreng RA. Difference scores versus direct effects in service quality measurement. J Serv Res. 2002;4:184–92.CrossRef
90.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Finn N. Implementation leadership: confirmatory factor analysis and supervisor-clinician discrepancy in ratings on the implementation leadership scale (ILS). Implement Sci. 2015;10:A70.PubMedCentralCrossRef Aarons GA, Ehrhart MG, Farahnak LR, Finn N. Implementation leadership: confirmatory factor analysis and supervisor-clinician discrepancy in ratings on the implementation leadership scale (ILS). Implement Sci. 2015;10:A70.PubMedCentralCrossRef
91.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Sklar M, Horowitz J. Discrepancies in leader and follower ratings of transformational leadership: relationship with organizational culture in mental health. Adm Policy Ment Health Ment Health Serv Res. 2017;44:480–91.CrossRef Aarons GA, Ehrhart MG, Farahnak LR, Sklar M, Horowitz J. Discrepancies in leader and follower ratings of transformational leadership: relationship with organizational culture in mental health. Adm Policy Ment Health Ment Health Serv Res. 2017;44:480–91.CrossRef
92.
go back to reference Shanock LR, Baran BE, Gentry WA, Pattison SC, Heggestad ED. Polynomial regression with response surface analysis: a powerful approach for examining moderation and overcoming limitations of difference scores. J Bus Psychol. 2010;25:543–54.CrossRef Shanock LR, Baran BE, Gentry WA, Pattison SC, Heggestad ED. Polynomial regression with response surface analysis: a powerful approach for examining moderation and overcoming limitations of difference scores. J Bus Psychol. 2010;25:543–54.CrossRef
93.
go back to reference Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45:626–9.PubMedCrossRef Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45:626–9.PubMedCrossRef
94.
go back to reference Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry. 2006;63:484–9.PubMedCrossRef Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry. 2006;63:484–9.PubMedCrossRef
96.
go back to reference Gulliford MC, Ukoumunne OC, Chinn S. Components of variance and intraclass correlations for the design of community-based surveys and intervention studies: data from the health survey for England 1994. Am J Epidemiol. 1999;149:876–83.PubMedCrossRef Gulliford MC, Ukoumunne OC, Chinn S. Components of variance and intraclass correlations for the design of community-based surveys and intervention studies: data from the health survey for England 1994. Am J Epidemiol. 1999;149:876–83.PubMedCrossRef
97.
go back to reference Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.PubMedCrossRef Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.PubMedCrossRef
98.
go back to reference Creswell JW, Klassen AC, Plano Clark VL, Smith KC. Best practices for mixed methods research in the health sciences. Office of Behavioral and Social Sciences Research: Bethesda, MD; 2011.CrossRef Creswell JW, Klassen AC, Plano Clark VL, Smith KC. Best practices for mixed methods research in the health sciences. Office of Behavioral and Social Sciences Research: Bethesda, MD; 2011.CrossRef
99.
go back to reference Creswell JW. Clark VLP. Designing and conducting mixed methods research: Sage Publ; 2007. Creswell JW. Clark VLP. Designing and conducting mixed methods research: Sage Publ; 2007.
100.
go back to reference Edhlund BM. NVivo 11 essentials: your guide to the world’s most powerful data analysis software. 2016. Edhlund BM. NVivo 11 essentials: your guide to the world’s most powerful data analysis software. 2016.
101.
go back to reference Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42:1758–72.PubMedPubMedCentralCrossRef Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42:1758–72.PubMedPubMedCentralCrossRef
102.
go back to reference Glaser BG, Strauss A. The discovery of grounded theory: strategies for qualtitative research. Chicago: Aldine; 1967. Glaser BG, Strauss A. The discovery of grounded theory: strategies for qualtitative research. Chicago: Aldine; 1967.
103.
go back to reference Strauss AC, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. Sage Publications; 1990. Strauss AC, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. Sage Publications; 1990.
104.
go back to reference DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000;22:351–72.PubMedCrossRef DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000;22:351–72.PubMedCrossRef
105.
go back to reference Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. 1997;25:517–72.CrossRef Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. 1997;25:517–72.CrossRef
106.
go back to reference Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52:196.CrossRef Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52:196.CrossRef
107.
go back to reference Lyon AR, Ludwig K, Romano E, Leonard S, Stoep AV, McCauley E. “If it’s worth my time, I will make the time”: school-based providers’ decision-making about participating in an evidence-based psychotherapy consultation program. Adm Policy Ment Health Ment Health Serv Res. 2013;40:467–81.CrossRef Lyon AR, Ludwig K, Romano E, Leonard S, Stoep AV, McCauley E. “If it’s worth my time, I will make the time”: school-based providers’ decision-making about participating in an evidence-based psychotherapy consultation program. Adm Policy Ment Health Ment Health Serv Res. 2013;40:467–81.CrossRef
108.
go back to reference Lyon AR, Ludwig K, Wasse JK, Bergstrom A, Hendrix E, Mcauley E. Determinants and functions of standardized assessment use among school mental health clinicians: a mixed methods evaluation. Adm Policy Ment Health Ment Health Serv Res. 2016;43:122–34.CrossRef Lyon AR, Ludwig K, Wasse JK, Bergstrom A, Hendrix E, Mcauley E. Determinants and functions of standardized assessment use among school mental health clinicians: a mixed methods evaluation. Adm Policy Ment Health Ment Health Serv Res. 2016;43:122–34.CrossRef
109.
go back to reference Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18:59–82.CrossRef Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18:59–82.CrossRef
110.
111.
go back to reference Adelman H, Taylor L. Moving prevention from the fringes into the fabric of school improvement. J Educ Psychol Consult. 2000;11:7–36.CrossRef Adelman H, Taylor L. Moving prevention from the fringes into the fabric of school improvement. J Educ Psychol Consult. 2000;11:7–36.CrossRef
112.
go back to reference Forman SG, Olin SS, Hoagwood KE, Crowe M, Saka N. Evidence-based interventions in schools: developers’ views of implementation barriers and facilitators. Sch Ment Heal. 2009;1:26.CrossRef Forman SG, Olin SS, Hoagwood KE, Crowe M, Saka N. Evidence-based interventions in schools: developers’ views of implementation barriers and facilitators. Sch Ment Heal. 2009;1:26.CrossRef
113.
go back to reference Jennings J, Pearson G, Harris M. Implementing and maintaining school-based mental health services in a large, urban school district. J Sch Health. 2000;48:201.CrossRef Jennings J, Pearson G, Harris M. Implementing and maintaining school-based mental health services in a large, urban school district. J Sch Health. 2000;48:201.CrossRef
115.
go back to reference Weist MD, Mellin EA, Chambers KL, Lever NA, Haber D, Blaber C. Challenges to collaboration in school mental health and strategies for overcoming them. J Sch Health. 2012;82:97–105.PubMedCrossRef Weist MD, Mellin EA, Chambers KL, Lever NA, Haber D, Blaber C. Challenges to collaboration in school mental health and strategies for overcoming them. J Sch Health. 2012;82:97–105.PubMedCrossRef
116.
go back to reference Bacchetti P. Current sample size conventions: flaws, harms, and alternatives . BioMedCent Med 2010;8:17. Bacchetti P. Current sample size conventions: flaws, harms, and alternatives . BioMedCent Med 2010;8:17.
118.
go back to reference Gelman A. Going beyond the book: towards critical reading in statistics teaching. Teach Stat. 2012;34:82–6.CrossRef Gelman A. Going beyond the book: towards critical reading in statistics teaching. Teach Stat. 2012;34:82–6.CrossRef
119.
go back to reference Bruns EJ, Suter JC, Force MM, Burchard JD. Adherence to wraparound principles and association with outcomes. J Child Fam Stud. 2005;14:521–34.CrossRef Bruns EJ, Suter JC, Force MM, Burchard JD. Adherence to wraparound principles and association with outcomes. J Child Fam Stud. 2005;14:521–34.CrossRef
120.
go back to reference Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health Ment Health Serv Res. 2011;38:32–43.CrossRef Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health Ment Health Serv Res. 2011;38:32–43.CrossRef
Metadata
Title
The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health
Authors
Aaron R. Lyon
Kelly Whitaker
Jill Locke
Clayton R. Cook
Kevin M. King
Mylien Duong
Chayna Davis
Mark D. Weist
Mark G. Ehrhart
Gregory A. Aarons
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0721-1

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue