Top

Implementation Science

Published in:

Open Access 01-12-2017 | Study protocol

Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol

Authors: Gregory A. Aarons, Mark G. Ehrhart, Joanna C. Moullin, Elisa M. Torres, Amy E. Green

Published in: Implementation Science | Issue 1/2017

Abstract

Background

Evidence-based practice (EBP) implementation represents a strategic change in organizations that requires effective leadership and alignment of leadership and organizational support across organizational levels. As such, there is a need for combining leadership development with organizational strategies to support organizational climate conducive to EBP implementation. The leadership and organizational change for implementation (LOCI) intervention includes leadership training for workgroup leaders, ongoing implementation leadership coaching, 360° assessment, and strategic planning with top and middle management regarding how they can support workgroup leaders in developing a positive EBP implementation climate.

Methods

This test of the LOCI intervention will take place in conjunction with the implementation of motivational interviewing (MI) in 60 substance use disorder treatment programs in California, USA. Participants will include agency executives, 60 program leaders, and approximately 360 treatment staff. LOCI will be tested using a multiple cohort, cluster randomized trial that randomizes workgroups (i.e., programs) within agency to either LOCI or a webinar leadership training control condition in three consecutive cohorts. The LOCI intervention is 12 months, and the webinar control intervention takes place in months 1, 5, and 8, for each cohort. Web-based surveys of staff and supervisors will be used to collect data on leadership, implementation climate, provider attitudes, and citizenship. Audio recordings of counseling sessions will be coded for MI fidelity. The unit of analysis will be the workgroup, randomized by site within agency and with care taken that co-located workgroups are assigned to the same condition to avoid contamination. Hierarchical linear modeling (HLM) will be used to analyze the data to account for the nested data structure.

Discussion

LOCI has been developed to be a feasible and effective approach for organizations to create a positive climate and fertile context for EBP implementation. The approach seeks to cultivate and sustain both effective general and implementation leadership as well as organizational strategies and support that will remain after the study has ended. Development of a positive implementation climate for MI should result in more positive service provider attitudes and behaviors related to the use of MI and, ultimately, higher fidelity in the use of MI.

Trial registration

This study is registered with Clinicaltrials.gov (NCT03042832), 2 February 2017, retrospectively registered.

Available only for authorised users

Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10:11.CrossRefPubMedPubMedCentral

Schein E. Organizational culture and leadership. San Francisco: John Wiley and Sons; 2010.

Dadich A. From bench to bedside: methods that help clinicians use evidence-based practice. Aust Psychol. 2010;45:197–211.CrossRef

Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv. 2006;3:61–72.CrossRefPubMedPubMedCentral

Glisson C, Schoenwald SK, Hemmelgarn A, Green P, Dukes D, Armstrong KS, Chapman JE. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol. 2010;78:537–50.CrossRefPubMedPubMedCentral

Parmelli E, Flodgren G, Beyer F, Baillie N, Schaafsma ME, Eccles MP. The effectiveness of strategies to change organisational culture to improve healthcare performance: a systematic review. Implement Sci. 2011;6:33.CrossRefPubMedPubMedCentral

Sobo EJ, Bowman C, Aarons GA, Asch S, Gifford AL. Enhancing organizational change and improvement prospects: lessons from an HIV testing intervention for veterans. Hum Organ. 2008;67:443–53.CrossRef

Weiner BJ, Belden CM, Bergmire DM, Johnston M. The meaning and measurement of implementation climate. Implement Sci. 2011;6:78–89.CrossRefPubMedPubMedCentral

Green AE, Albanese BJ, Cafri G, Aarons GA. Leadership, organizational climate, and working alliance in a children’s mental health service system. Community Ment Health J. 2014;50:771–7.CrossRefPubMed

10.

De Hoogh AHB, Den Hartog DN, Koopman PL, Thierry H, Van Den Berg PT, Van Der Weide JG, Wilderom CPM. Leader motives, charismatic leadership, and subordinates’ work attitude in the profit and voluntary sector. Leadersh Q. 2005;16:17–38.CrossRef

11.

Glisson C, Durick M. Predictors of job satisfaction and organizational commitment in human service organizations. Adm Sci Q. 1988;33:61–81.CrossRef

12.

Aarons GA. Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiatr Serv. 2006;57:1162–9.CrossRefPubMedPubMedCentral

13.

Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Psychiatry. 2012;51:423–31.CrossRef

14.

Corrigan PW, Lickey SE, Campion J, Rashid F. Mental health team leadership and consumers’ satisfaction and quality of life. Psychiatr Serv. 2000;51:781–5.CrossRefPubMed

15.

Griffith TL, Zammuto RF, Aiman-Smith L. Why new technologies fail: overcoming the invisibility of implementation. Ind Manag. 1999;41:29–34.

16.

Klein KJ, Knight AP. Innnovation implementation: overcoming the challenge. Curr Dir Psychol Sci. 2005;14:243–6.CrossRef

17.

Rizzuto TE, Reeves J. A multidisciplinary meta-analysis of human barriers to technology implementation. Consult Psychol J: Pract Res. 2007;59:226–40.CrossRef

18.

Demakis JG, McQueen L, Kizer KW, Feussner JR. Quality enhancement research initiative (QUERI): a collaboration between research and clinical practice. Med Care. 2000;38:17–25.CrossRef

19.

Ford JH, Green CA, Hoffman KA, Widsdom JP, Riley KJ, Bergmann L, Molfenter T. Process improvement needs in substance abuse treatment: admissions walk-through results. J Subst Abuse Treat. 2007;33:379–89.CrossRefPubMedPubMedCentral

20.

McCarty D, Gustafson DH, Wisdom JP, Ford J, Choi D, Molfenter T, Capoccia V, Cotter F. The Network for the Improvement of Addiction Treatment (NIATx): enhancing access and retention. Drug Alcohol Depend. 2007;88:138–45.CrossRefPubMed

21.

Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38:4–23.CrossRefPubMed

22.

Hoffman KA, Green CA, Ford II JH, Wisdom JP, Gustafson DH, McCarty D. Improving quality of care in substance abuse treatment using five key process improvement principles. J Behav Health Serv Res. 2012;39:234–44.CrossRefPubMedPubMedCentral

23.

Aarons GA, Ehrhart MG, Farahnak LR. The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9:45.CrossRefPubMedPubMedCentral

24.

Bass BM, Avolio BJ. The implications of transformational and transactional leadership for individual, team, and organizational development. In: Pasmore W, Woodman RW, editors. Research in organizational change and development. Greenwich: JAI Press; 1990. p. 231–72.

25.

Judge TA, Piccolo RF. Transformational and transactional leadership: a meta-analytic test of their relative validity. J Appl Psychol. 2004;89:755–68.CrossRefPubMed

26.

Avolio BJ, Bass BM, Jung DI. Re-examining the components of transformational and transactional leadership using the Multifactor Leadership Questionnaire. J Occup Organ Psychol. 1999;72:441–62.CrossRef

27.

Bass BM. Does the transactional-transformational leadership paradigm transcend organizational and national boundaries. Am Psychol. 1997;52:130–9.CrossRef

28.

Bass BM, Avolio BJ, Jung DI, Berson Y. Predicting unit performance by assessing transformational and transactional leadership. J Appl Psychol. 2003;88:207–18.CrossRefPubMed

29.

Aarons GA, Ehrhart MG, Torres EM, Finn NK, Roesch SC. Validation of the Implementation Leadership Scale (ILS) in substance use disorder treatment organizations. J Subst Abuse Treat. 2016;68:31–5.CrossRefPubMed

30.

Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9:157.CrossRefPubMedPubMedCentral

31.

Klein KJ, Conn AB, Sorra JS. Implementing computerized technology: an organizational analysis. J Appl Psychol. 2001;86:811–24.CrossRefPubMed

32.

Schneider B. Organizational climate and culture. San Francisco: Jossey-Bass; 1990.

33.

Ehrhart MG, Schneider B, Macey WH. Organizational climate and culture: an introduction to theory, research, and practice. New York: Routledge; 2014.

34.

Klein KJ, Conn AB, Smith DB, Sorra JS. Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. J Appl Psychol. 2001;86:3–16.CrossRefPubMed

35.

Aarons GA, Palinkas LA. Implementation of evidence-based practice in child welfare: service provider perspectives. Adm Policy Ment Heallth. 2007;34:411–9.CrossRef

36.

O’Reilly CA, Caldwell DF, Chatman JA, Lapiz M, Self W. How leadership matters: the effects of leaders’ alignment on strategy implementation. Leadersh Q. 2010;21:104–13.CrossRef

37.

Chamberlain P, Brown CH, Saldana L. Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC). Implement Sci. 2011;6:116–23.CrossRefPubMedPubMedCentral

38.

Saldana L. The stages of implementation completion for evidence-based practice: protocol for a mixed methods study. Implement Sci. 2014;9:43.CrossRefPubMedPubMedCentral

39.

Podsakoff PM, Todor WD. Relationships between leader reward and punishment behavior and group processes and productivity. J Manage. 1985;11:55–73.

40.

Huang L, Macbeth G, Dodge J, Jacobstein D. Transforming the workforce in children’s mental health. Adm Policy Ment Health. 2004;32:167–87.CrossRefPubMed

41.

Rogers EM. Diffusions of innovations. 4th ed. New York: The Free Press; 1995.

42.

Priestland A, Hanig R. Developing first-level leaders. Harv Bus Rev. 2005;83:112–20.PubMed

43.

Ash J. Organizational factors that influence information technology diffusion in academic health sciences centers. J Am Med Inform Assoc. 1997;4:102–11.CrossRefPubMedPubMedCentral

44.

Aarons GA, Sommerfeld DH, Walrath-Greene CM. Evidence-based practice implementation: the impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implement Sci. 2009;4:83–96.CrossRefPubMedPubMedCentral

45.

Birleson P. Turning child and adolescent mental-health services into learning organizations. Clinl Child Psychol Psychiatry. 1999;4:265–74.CrossRef

46.

Eisenberger R, Fasolo P, Davis-LaMastro V. Perceived organizational support and employee diligence, commitment, and innovation. J Appl Psychol. 1990;75:51–9.CrossRef

47.

Shortell SM. Developing individual leaders is not enough. J Health Serv Res Policy. 2002;7:193–4.CrossRefPubMed

48.

Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50–64.CrossRefPubMedPubMedCentral

49.

Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Q. 2001;79:281–315.CrossRefPubMedPubMedCentral

50.

Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.CrossRefPubMedPubMedCentral

51.

Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.CrossRefPubMedPubMedCentral

52.

Miller WR. Motivational interviewing with problem drinkers. Behav Psychother. 1983;11:147–72.CrossRef

53.

Miller WR, Rollnick S. Motivational interviewing: preparing people for change. 2nd ed. New York: Guilford Press; 2002.

54.

Henman MJ, Butow PN, Brown RF, Boyle F, Tattersall MHN. Lay constructions of decision-making in cancer. Psychooncology. 2002;11:295–306.CrossRefPubMed

55.

Jahng KH, Martin LR, Golin CE, DiMatteo MR. Preferences for medical collaboration: patient-physician congruence and patient outcomes. Patient Educ Couns. 2005;57:308–14.CrossRefPubMed

56.

Kaplan SH, Greenfield S, Ware Jr JE. Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care. 1989;27:110.CrossRef

57.

Ong LM, De Haes JC, Hoos AM, Lammes FB. Doctor-patient communication: a review of the literature. Soc Sci Med. 1995;40:903–18.CrossRefPubMed

58.

Oates J, Weston WW, Jordan J. The impact of patient-centered care on outcomes. J Fam Pract. 2000;49:796–804.PubMed

59.

Trummer UF, Mueller UO, Nowak P, Stidl T, Pelikan JM. Does physician-patient communication that aims at empowering patients improve clinical outcome? A case study. Patient Educ Couns. 2006;61:299–306.CrossRefPubMed

60.

Street RL, Piziak VK, Carpenter WS, Herzog J, Hejl J, Skinner G, McLellan L. Provider-patient communication and metabolic control. Diabetes Care. 1993;16:714–21.CrossRefPubMed

61.

Fields S. Characteristics associated with retention among African American and Latino adolescent HIV-positive men: results from the outreach, care, and prevention to engage HIV-seropositive young MSM of color special project of national significance initiative. J Acquir Immune Defic Syndr. 2010;53:529–36.CrossRefPubMed

62.

Street Jr RL, Gordon HW, Haidet P. Physicians’ communication and perceptions of patients: is it how they look, how they talk, or is it just the doctor? Soc Sci Med. 2007;65:586–98.CrossRefPubMedPubMedCentral

63.

Baker A, Kochan NN, Dixon JJ, Heather NN, Wodak AA. Controlled evaluation of a brief intervention for HIV prevention among injecting drug users not in treatment. AIDS Care. 1994;6:559–70.CrossRefPubMed

64.

Vasilaki E, Hosier SG, Cox WM. The efficacy of motivational interviewing as a brief intervention for excessive drinking: a meta-analytic review. Alcohol Alcohol. 2006;41:328–35.CrossRefPubMed

65.

Aarons GA, Ehrhart MG, Horowitz JD. Leadership to facilitate evidence-based practice implementation in healthcare organizations. In: Academy of Management Annual Meeting; Montreal. 2010.

66.

Balas EA, Boren SA. Managing clinical knowledge for healthcare improvements. In: Bemmel J, McCray AT, editors. Yearbook of medical informatics 2000: patient-centered systems. Stuttgart: Schattauer Verlagsgesellschaft; 2000. p. 65–70.

67.

Tooley EM, Moyers TB. Motivational interviewing in practice. In: Walters ST, Rotgers F, editors. Treating substance abuse: theory and technique. 3rd ed. New York: Guilford Press; 2011. p. 28–47.

68.

Miller WR, Rollnick S. Ten things that motivational interviewing is not. Behav Cogn Psychother. 2009;37:129–40.CrossRefPubMed

69.

Ehrhart MG, Aarons GA, Farahnak LR. Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS). Implement Sci. 2015;10:65.CrossRefPubMedPubMedCentral

70.

Bass BM, Avolio BJ. MLQ: Multifactor Leadership Questionnaire. Redwood City: Mind Garden; 1995.

71.

Aarons GA, Sommerfeld DH, Willging CE. The soft underbelly of system change: the role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychol Serv. 2011;8:269–81.CrossRefPubMedPubMedCentral

72.

Edmondson AC. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44:350–83.CrossRef

73.

Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6:61–74.CrossRefPubMedPubMedCentral

74.

Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and United States national norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;22:356–65.CrossRefPubMed

75.

Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA, The Research Network on Youth Mental Health. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7:56–70.CrossRefPubMedPubMedCentral

76.

Hofmann DA, Morgeson FP, Gerras SJ. Climate as a moderator of the relationship between leader-member exchange and content specific citizenship: safety climate as an exemplar. J Appl Psychol. 2003;88:170–8.CrossRefPubMed

77.

Naar-King S, Suarez M, editors. Motivational Interviewing with adolescents and young adults. New York: Guilford Press; 2011.

78.

Moyers TB, Rowell LN, Manuel JK, Ernst D, Houck JM. The motivational interviewing treatment integrity code (MITI 4): Rationale, preliminary reliability and validity. J Subst Abuse Treat. 2016;65:36–42.CrossRefPubMed

79.

D’Amico EJ, Osilla KC, Miles JN, Ewing B, Sullivan K, Katz K, Hunter SB. Assessing motivational interviewing integrity for group interventions with adolescents. Psychol Addict Behav. 2012;26:994–1000.CrossRefPubMedPubMedCentral

80.

American Educational Research Association. American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, Psychological Testing: standards for educational and psychological testing. Washington: American Educational Research Association; 1999.

81.

Wilson M. Constructing measures: an item response modeling approach. Mahwah: Lawrence Erlbaum Associates, Inc; 2005.

82.

Chamberlain P, Snowden LR, Padgett C, Saldana L, Roles J, Holmes L, Landsverk J. A strategy for assessing costs of implementing new practices in the child welfare system: adapting the English cost calculator in the United States. Adm Policy Ment Health. 2011;38:24–31.CrossRefPubMedPubMedCentral

83.

Saldana L, Chamberlain P, Wang W, Brown CH. Predicting program start-up using the stages of implementation measure. Adm Policy Ment Health. 2012;39:419–25.CrossRefPubMedPubMedCentral

84.

Brown CH, Chamberlain P, Saldana L, Wang W, Cruden G. Evaluation of two implementation strategies in fifty-one counties in two states: results of a cluster randomized implementation trial. Implement Sci. 2014;9:134.

85.

Brown CH, Kellam SG, Kaupert S, Muthen B, Wang W, Muthen LK, Chamberlain P, PoVey CL, Cady R, Valente TW, et al. Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: experiences of the prevention science and methodology group. Adm Policy Ment Health. 2012;39:301–16.CrossRefPubMedPubMedCentral

86.

Brown CH, Wang W, Kellam SG, Muthen BO, Petras H, Toyinbo P, Poduska J, Ialongo N, Wyman PA, Chamberlain P, et al. Methods for testing theory and evaluating impact in randomized field trials: intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug Alcohol Depend. 2008;95:74–104.CrossRef

87.

Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. Thousand Oaks: Sage Publications; 2002.

88.

Allison PD. Fixed effects regression models. Thousand Oaks: Sage Publications; 2009.CrossRef

89.

Preacher KJ, Curran PJ, Bauer DJ. Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. J Educ Behav Stat. 2006;31:437–48.CrossRef

90.

Beretvas SN. Cross-classified and multiple-membership models. In: Hox JJ, Roberts JK, editors. Handbook for advanced multilevel analysis. New York: Routledge/Taylor; 2011. p. 313–34.

91.

MacKinnon DP. Introduction to statistical mediation analysis. New York: Erlbaum; 2008.

92.

Edmondson AC. Framing for learning: lessons in successful technology implementation. Calif Manage Rev. 2003;45:35–54.CrossRef

93.

Goldstein IL, Ford JK. Training in organizations. 4th ed. Belmont: Wadsworth Thomson Learning; 2002.

94.

Howell JM, Hall-Merenda KE. The ties that bind: the impact of leader-member exchange, transformational and transactional leadership, and distance on predicting follower performance. J Appl Psychol. 1999;84:680–94.CrossRef

Title: Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol
Authors: Gregory A. Aarons
Mark G. Ehrhart
Joanna C. Moullin
Elisa M. Torres
Amy E. Green
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-017-0562-3

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol

Abstract

Background

Methods

Discussion

Trial registration

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Abstract

Background

Methods

Discussion

Trial registration

Please log in to get access to this content

Other articles of this Issue 1/2017

Erratum to: Does a quality improvement campaign accelerate take-up of new evidence? A ten-state cluster-randomized controlled trial of the IHI’s Project JOINTS

Impact of a tailored program on the implementation of evidence-based recommendations for multimorbid patients with polypharmacy in primary care practices—results of a cluster-randomized controlled trial

Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review

A complex intervention to improve implementation of World Health Organization guidelines for diagnosis of severe illness in low-income settings: a quasi-experimental study from Uganda

Increasing the provision of preventive care by community healthcare services: a stepped wedge implementation trial

Information exchange networks of health care providers and evidence-based cardiovascular risk management: an observational study