Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS)

Authors: Mark G Ehrhart, Gregory A Aarons, Lauren R Farahnak

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

In line with recent research on the role of the inner context of organizations in implementation effectiveness, this study extends research on organizational citizenship behavior (OCB) to the domain of evidence-based practice (EBP) implementation. OCB encompasses those behaviors that go beyond what is required for a given job that contribute to greater organizational effectiveness. The goal of this study was to develop and test a measure of implementation citizenship behavior (ICB) or those behaviors that employees perform that go above and beyond what is required in order to support EBP implementation.

Methods

The primary participants were 68 supervisors from ten mental health agencies throughout California. Items measuring ICB were developed based on past research on OCB and in consultation with experts on EBP implementation in mental health settings. Supervisors rated 357 of their subordinates on ICB and implementation success. In addition, 292 of the subordinates provided data on self-rated performance, attitudes towards EBPs, work experience, and full-time status. The supervisor sample was randomly split, with half used for exploratory factor analyses and the other half for confirmatory factor analyses. The entire sample of supervisors and subordinates was utilized for analyses assessing the reliability and construct validity of the measure.

Results

Exploratory factor analyses supported the proposed two-factor structure of the Implementation Citizenship Behavior Scale (ICBS): (1) Helping Others and (2) Keeping Informed. Confirmatory factor analyses with the other half of the sample supported the factor structure. Additional analyses supported the reliability and construct validity for the ICBS.

Conclusions

The ICBS is a pragmatic brief measure (six items) that captures critical behaviors employees perform to go above and beyond the call of duty to support EBP implementation, including helping their fellow employees on implementation-related activities and keeping informed about issues related to EBP and implementation efforts. The ICBS can be used by researchers to better understand the outcomes of improved organizational support for implementation (i.e., implementation climate) and the proximal predictors of implementation effectiveness. The ICBS can also provide insight for organizations, practitioners, and managers by focusing on key employee behaviors that should increase the probability of implementation success.
Appendix
Available only for authorised users
Literature
1.
Organ DW, Podsakoff PM, MacKenzie SB. Organizational citizenship behavior: its nature, antecedents, and consequences. Thousand Oaks, CA: Sage Publications; 2006.
2.
Nielsen TM, Hrivnak GA, Shaw M. Organizational citizenship behavior and performance: a meta-analysis of group-level research. Small Gr Res. 2009;40:555–77.CrossRef
3.
Podsakoff PM, MacKenzie SB. Impact of organizational citizenship behavior on organizational performance: a review and suggestions for future research. Hum Perform. 1997;10:133–51.CrossRef
4.
Podsakoff NP, Whiting SW, Podsakoff PM, Blume BD. Individual- and organizational-level consequences of organizational citizenship behaviors: a meta-analysis. J Appl Psychol. 2009;94:122–41.CrossRefPubMed
5.
MacKenzie SB, Podsakoff PM, Fetter R. Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons’ performance. Organ Behav Hum Decis Process. 1991;50:123–50.CrossRef
6.
MacKenzie SB, Podsakoff PM, Fetter R. The impact of organizational citizenship behavior on evaluations of salesperson performance. J Mark Ment Health. 1993;57:70–80.
7.
Piercy NF, Cravens DW, Lane N. Sales manager behavior-based control and salesperson performance: the effects of manager control competencies and organizational citizenship behavior. J Mark Theory Pract. 2012;20:7–22.CrossRef
8.
Walz SM, Niehoff BP. Organizational citizenship behaviors: their relationship to organizational effectiveness. J Hosp To. 2000;24:301–19.CrossRef
9.
Podsakoff PM, MacKenzie SB. Organizational citizenship behaviors and sales unit effectiveness. J Mark Res. 1994;31:351–63.CrossRef
10.
Podsakoff PM, Ahearne M, MacKenzie SB. Organizational citizenship behavior and the quantity and quality of work group performance. J Appl Psychol. 1997;82:262–70.CrossRefPubMed
11.
Chen CH, Wang SJ, Chang WC, Hu CS. The effect of leader-member exchange, trust, and supervisor support on organizational citizenship behavior in nurses. J Nurs Res. 2008;16:321–8.CrossRefPubMed
12.
Chien CC, Chou HK, Hung ST. A conceptual model of nurses’ goal orientation, service behavior, and service performance. Nurs Econ. 2008;26:374–83.PubMed
13.
Cohen A, Kol Y. Professionalism and organizational citizenship behavior: an empirical examination among Israeli nurses. J Manage Psychol. 2004;19:386–405.CrossRef
14.
Kalisch BJ, Curley M, Stefanov S. An intervention to enhance nursing staff teamwork and engagement. J Nurs Adm. 2007;37:77–84.CrossRefPubMed
15.
Bettencourt LA, Brown SW. Contact employees: relationships among workplace fairness, job satisfaction and prosocial service behaviors. J Retailing. 1997;73:39–61.CrossRef
16.
Schneider B, Ehrhart MG, Mayer DM, Saltz JL, Niles-Jolly K. Understanding organization-customer links in service settings. Acad Manage J. 2005;48:1017–32.CrossRef
17.
Griffin MA, Neal A. Perceptions of safety at work: a framework for linking safety climate to safety performance, knowledge, and motivation. J Occup Health Psychol. 2000;5:347–58.CrossRefPubMed
18.
Cree T, Kelloway KE. Responses to occupational hazards: exit and participation. J Occup Health Psychol. 1997;2:304–11.CrossRefPubMed
19.
Mullen J. Testing a model of employee willingness to raise safety issues. Can J Behav Sc. 2005;37:273–82.CrossRef
20.
Sackett DL, Straus SE, Richardson WS, Rosenberg WM, Haynes RB. Evidence-based medicine: how to practice and teach EBM. 2nd ed. New York: Churchill Livingstone; 2000.
21.
Beidas RS, Kendall PC, editors. Dissemination and implementation of evidence-based practices in child and adolescent mental health. Oxford, UK: Oxford University Press; 2014.
22.
23.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Hlth. 2011;38:4–23.CrossRef
24.
Williams NJ, Glisson C. The role of organizational culture and climate in the dissemination and implementation of empirically supported treatments for youth. In: Beidas RS, Kendall P, editors. Dissemination and implementation of evidence-based practices in child and adolescent mental health. Oxford, UK: Oxford University Press; 2014. p. 61–81.
25.
Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9:45.CrossRefPubMedPubMedCentral
26.
Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9:157.CrossRefPubMedPubMedCentral
27.
28.
Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood K, Mayberg S, et al. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research Special Issue: Improving mental health services. 2008;35:98–113.CrossRef
29.
Soumerai SB, McLaughlin TJ, Gurwitz JH, Guadagnoli E, Hauptman PJ, Borbas C, et al. Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. JAMA. 1998;279:1358–63.CrossRefPubMed
30.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.CrossRefPubMedPubMedCentral
31.
Glisson C, Schoenwald S. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005;7:243–59.CrossRefPubMed
32.
Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50–64.CrossRefPubMedPubMedCentral
33.
Williams LJ, Anderson SE. Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. J Air Waste Manage Assoc. 1991;17:601–17.
34.
Organ DW, Ryan K. A meta-analytic review of attitudinal and dispositional predictors of organizational citizenship behavior. Pers Psychol. 1995;48:775–802.CrossRef
35.
Morrison EW, Vancouver JB. Within-person analysis of information seeking: the effects of perceived costs and benefits. J Air Waste Manage Assoc. 2000;26:119–37.
36.
Sosna T, Marsenich L. Community development team model: supporting the model adherent implementation of programs and practices. Sacramento: California Institute for Mental Health; 2006.
37.
Hofmann DA, Morgeson FP, Gerras SJ. Climate as a moderator of the relationship between leader-member exchange and content specific citizenship: safety climate as an exemplar. J Appl Psychol. 2003;88:170–8.CrossRefPubMed
38.
Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6:61–74.CrossRefPubMedPubMedCentral
39.
Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and United States national norms of the evidence-based practice attitude scale (EBPAS). Psychol Assessment. 2010;22:356–65.CrossRef
40.
Muthén LK, Muthén BO. Mplus user’s guide. 7th ed. Los Angeles, CA: Muthén & Muthén; 2012. p. 1998–2012.
41.
Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–85.CrossRefPubMed
42.
Patil VH, Singh SN, Mishra S, Donavan DT. Efficient theory development and factor retention criteria: a case for abandoning the ‘eigenvalue greater than one’ criterion. J Bus Res. 2008;61:162–70.CrossRef
43.
Zwick WR, Velicer WF. Comparison of five rules for determining the number of components to retain. Psychol Bull. 1986;99:432–42.CrossRef
44.
Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4:272–99.CrossRef
45.
Hu L-T, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6:1–55.CrossRef
46.
Guo Q, Li F, Chen X, Wang W, Meng Q. Performance of fit indices in different conditions and selection of cut-off values. Acta Psychol Sinica. 2008;40:109–18.CrossRef
47.
Heilman ME, Chen JJ. Same behavior, different consequences: reactions to women’s altruistic citizenship behavior. J Appl Psychol. 2005;90:431–41.CrossRefPubMed
48.
McAllister DJ, Kamdar D, Morrison EW, Turban DB. Disentangling role perceptions: how perceived role breadth, discretion, instrumentality, and efficacy relate to helping and taking charge. J Appl Psychol. 2007;92:1200–11.CrossRefPubMed
49.
Morrison EW. Role definitions and organizational citizenship behavior: The importance of the employee’s perspective. Acad Manage J. 1994;37:1543–67.CrossRef
50.
MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychol Methods. 1999;4:84–99.CrossRef
Metadata
Title
Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS)
Authors
Mark G Ehrhart
Gregory A Aarons
Lauren R Farahnak
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0255-8

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue

Systematic review

Effectiveness of implementation strategies for clinical guidelines to community pharmacy: a systematic review

Research

Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program

Study protocol

Development and preliminary evaluation of a rehabilitation consult for survivors of head and neck cancer: an intervention mapping protocol

Study protocol

Effect of person-centred care on antipsychotic drug use in nursing homes (EPCentCare): study protocol for a cluster-randomised controlled trial

Research

Learning before leaping: integration of an adaptive study design process prior to initiation of BetterBirth, a large-scale randomized controlled trial in Uttar Pradesh, India

Research

Implementation of a cystic fibrosis lung transplant referral patient decision aid in routine clinical practice: an observational study