Skip to main content
Top
Published in: Implementation Science 1/2019

Open Access 01-12-2019 | Research

Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioral health organizations

Authors: Enola Proctor, Alex T. Ramsey, Matthew T. Brown, Sara Malone, Cole Hooley, Virginia McKay

Published in: Implementation Science | Issue 1/2019

Login to get access

Abstract

Background

Effective leadership for organizational change is critical to the implementation of evidence-based practices (EBPs). As organizational leaders in behavioral health organizations often are promoted from within the agency for their long-standing, effective work as counselors, they may lack formal training in leadership, management, or practice change. This study assesses a novel implementation leadership training designed to promote leadership skills and successful organizational change specific to EBP implementation.

Methods

We conducted a pre-post outcome evaluation of the Training in Implementation Practice Leadership (TRIPLE), delivered via three in-person, half-day training sessions, with interim coaching and technical support. Sixteen mid-level leaders (75% female, 94% Caucasian, mean age 37 years) from 8 substance abuse treatment agencies participated. Professional roles included clinical managers, quality improvement coordinators, and program directors. Participants completed surveys prior to the first and following the final session. At both time points, measures included the Implementation Leadership Scale, Implementation Climate Scale, and Organizational Readiness for Implementing Change Scale. At post-test, we added the Training Acceptability and Appropriateness Scale (TAAS), assessing participant satisfaction with the training. Qualitative interviews were conducted 6 to 8 months after the training.

Results

Most participants (86% and 79%, respectively) reported increased implementation leadership skills and implementation climate; paired samples t tests indicated these pre-post increases were statistically significant. Implementation leadership scores improved most markedly on the Proactive and Knowledgeable subscales. For implementation climate, participants reported the greatest increases in educational support and recognition for using EBP. Post-test scores on the TAAS also indicated that participants found the training program to be highly acceptable and appropriate for their needs. Qualitative results supported positive outcomes of training that resulted in both increased organizational implementation as well as leadership skills of participants.

Conclusions

This training program represents an innovative, effective, and well-received implementation strategy for emerging behavioral healthcare leaders seeking to adopt or improve the delivery of EBPs. Reported implementation leadership skills and implementation climate improved following the training program, suggesting that TRIPLE may have helped fulfill a critical need for emerging behavioral healthcare leaders.
Appendix
Available only for authorised users
Literature
2.
go back to reference Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. The role of organizational processes in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Diss and imp res in health. Translating science to practice. New York, NY: Oxford University Press; 2012. Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. The role of organizational processes in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Diss and imp res in health. Translating science to practice. New York, NY: Oxford University Press; 2012.
5.
go back to reference Proctor E, Luke D, Calhoun A, McMillen C, Brownson R, McCrary S, et al. Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Imp Sci. 2015;10(88):1–13. Proctor E, Luke D, Calhoun A, McMillen C, Brownson R, McCrary S, et al. Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Imp Sci. 2015;10(88):1–13.
6.
go back to reference McMillen JC, Raffol M. Characterizing the quality workforce in private U.S. child and family behavioral health agencies. Admin Pol Ment Health. 2016;43(5):750–9.CrossRef McMillen JC, Raffol M. Characterizing the quality workforce in private U.S. child and family behavioral health agencies. Admin Pol Ment Health. 2016;43(5):750–9.CrossRef
7.
go back to reference Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Imp Sc. 2017;12(1):29.CrossRef Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Imp Sc. 2017;12(1):29.CrossRef
8.
go back to reference Egeland KM, Skar AMS, Endsjø M, Laukvik EH, Bækkelund H, Babaii A, et al. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Imp Sci. 20019;14(1):28. Egeland KM, Skar AMS, Endsjø M, Laukvik EH, Bækkelund H, Babaii A, et al. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Imp Sci. 20019;14(1):28.
9.
go back to reference Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7(3):624–35.CrossRef Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7(3):624–35.CrossRef
10.
go back to reference Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2017;7(3):593–601.CrossRef Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2017;7(3):593–601.CrossRef
11.
go back to reference Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17(1):67–79.CrossRef Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17(1):67–79.CrossRef
12.
go back to reference Proctor EK. Implementing evidence-based practice in social work education: principles, strategies, and partnerships. Res Soc Work Pract. 2007;17(5):583–91.CrossRef Proctor EK. Implementing evidence-based practice in social work education: principles, strategies, and partnerships. Res Soc Work Pract. 2007;17(5):583–91.CrossRef
16.
go back to reference Padek M, Colditz G, Dobbins M, Koscielniak N, Proctor EK, Sales AE, Brownson RC. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card-sorts. Imp Sci. 2015;10(114). https://doi.org/10.1186/s13012-015-0304-3. Padek M, Colditz G, Dobbins M, Koscielniak N, Proctor EK, Sales AE, Brownson RC. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card-sorts. Imp Sci. 2015;10(114). https://​doi.​org/​10.​1186/​s13012-015-0304-3.
17.
go back to reference Grol RP, Wensing M, Eccles MP, Davis D. Editors. Improving patient care: the implementation of change in health care. 2nd ed. New York: Wiley; 2013.CrossRef Grol RP, Wensing M, Eccles MP, Davis D. Editors. Improving patient care: the implementation of change in health care. 2nd ed. New York: Wiley; 2013.CrossRef
18.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Imp Sci. 2014;9(45). Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Imp Sci. 2014;9(45).
19.
go back to reference Aarons GA, Ehrhart MG, Farahnak LR, Finn N. Implementation leadership: confirmatory factor analysis and supervisor-clinician discrepancy in ratings on the Implementation Leadership Scale (ILS). Imp Sci. 2015;10(1):A70.CrossRef Aarons GA, Ehrhart MG, Farahnak LR, Finn N. Implementation leadership: confirmatory factor analysis and supervisor-clinician discrepancy in ratings on the Implementation Leadership Scale (ILS). Imp Sci. 2015;10(1):A70.CrossRef
20.
go back to reference Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci. 2014;9:157. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the implementation climate scale (ICS). Implement Sci. 2014;9:157.
21.
go back to reference Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Imp Sci. 2014;9:7. Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Imp Sci. 2014;9:7.
22.
go back to reference Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. San Francisco: Berrett-Koehler Publishers; 2009. p. 22. Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. San Francisco: Berrett-Koehler Publishers; 2009. p. 22.
23.
go back to reference De Winter JC. Using the Student’s t-test with extremely small sample sizes. Pract Assess Res Eval. 2013;18:10. De Winter JC. Using the Student’s t-test with extremely small sample sizes. Pract Assess Res Eval. 2013;18:10.
24.
go back to reference Creswell JW, Clark VLP. Designing and conducting mixed methods research. Los Angeles: Sage publications; 2017. Creswell JW, Clark VLP. Designing and conducting mixed methods research. Los Angeles: Sage publications; 2017.
Metadata
Title
Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioral health organizations
Authors
Enola Proctor
Alex T. Ramsey
Matthew T. Brown
Sara Malone
Cole Hooley
Virginia McKay
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-019-0906-2

Other articles of this Issue 1/2019

Implementation Science 1/2019 Go to the issue