Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Organizational readiness for implementing change: a psychometric assessment of a new measure

Authors: Christopher M Shea, Sara R Jacobs, Denise A Esserman, Kerry Bruce, Bryan J Weiner

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner’s theory of organizational readiness for change.

Methods

We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure’s factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three.

Results

Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis.

Conclusions

This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kotter JP: Leading change. 1996, Boston: Harvard Business Press Kotter JP: Leading change. 1996, Boston: Harvard Business Press
2.
go back to reference Weiner BJ, Amick H, Lee SY: Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008, 65 (4): 379-436. 10.1177/1077558708317802.CrossRefPubMed Weiner BJ, Amick H, Lee SY: Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008, 65 (4): 379-436. 10.1177/1077558708317802.CrossRefPubMed
3.
go back to reference Weiner BJ, Lewis MA, Linnan LA: Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009, 24 (2): 292-305.CrossRefPubMed Weiner BJ, Lewis MA, Linnan LA: Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009, 24 (2): 292-305.CrossRefPubMed
4.
go back to reference Alexander JA, Hearld LR: Methods and metrics challenges of delivery-system research. Imp Sci. 2012, 7: 15-10.1186/1748-5908-7-15.CrossRef Alexander JA, Hearld LR: Methods and metrics challenges of delivery-system research. Imp Sci. 2012, 7: 15-10.1186/1748-5908-7-15.CrossRef
5.
go back to reference Helfrich CD: Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework. Imp Sci. 2009, 4: 38-10.1186/1748-5908-4-38.CrossRef Helfrich CD: Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework. Imp Sci. 2009, 4: 38-10.1186/1748-5908-4-38.CrossRef
6.
go back to reference Holt DT: Readiness for organizational change: the systematic development of a scale. J Appl Behav Sci. 2007, 43 (2): 232-255. 10.1177/0021886306295295.CrossRef Holt DT: Readiness for organizational change: the systematic development of a scale. J Appl Behav Sci. 2007, 43 (2): 232-255. 10.1177/0021886306295295.CrossRef
7.
go back to reference Lehman WEK, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abus Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7.CrossRef Lehman WEK, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abus Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7.CrossRef
8.
go back to reference Weiner BJ: A theory of organizational readiness for change. Imp Sci. 2009, 4: 67.10- Weiner BJ: A theory of organizational readiness for change. Imp Sci. 2009, 4: 67.10-
9.
go back to reference Nunnally JC: McGraw-Hill series in psychology. Psychometric theory. 1978, New York: McGraw-Hill, xv, 701 p, 2nd Nunnally JC: McGraw-Hill series in psychology. Psychometric theory. 1978, New York: McGraw-Hill, xv, 701 p, 2nd
10.
go back to reference Schriesheim CA: Improving construct measurement in management research - comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. J Air Waste Manage Assoc. 1993, 19 (2): 385-417. Schriesheim CA: Improving construct measurement in management research - comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. J Air Waste Manage Assoc. 1993, 19 (2): 385-417.
11.
go back to reference Carlson DS, Kacmar KM, Williams LJ: Construction and initial validation of a multidimensional measure of work-family conflict. J Vocat Behav. 2000, 56 (2): 249-276. 10.1006/jvbe.1999.1713.CrossRef Carlson DS, Kacmar KM, Williams LJ: Construction and initial validation of a multidimensional measure of work-family conflict. J Vocat Behav. 2000, 56 (2): 249-276. 10.1006/jvbe.1999.1713.CrossRef
12.
go back to reference Hinkin TR, Tracey JB: An analysis of variance approach to content validation. Organ Res Methods. 1999, 2 (2): 175-186. 10.1177/109442819922004.CrossRef Hinkin TR, Tracey JB: An analysis of variance approach to content validation. Organ Res Methods. 1999, 2 (2): 175-186. 10.1177/109442819922004.CrossRef
13.
go back to reference Herscovitch L, Meyer JP: Commitment to organizational change: extension of a three- component model. J Appl Psychol. 2002, 87 (3): 474-487.CrossRefPubMed Herscovitch L, Meyer JP: Commitment to organizational change: extension of a three- component model. J Appl Psychol. 2002, 87 (3): 474-487.CrossRefPubMed
14.
go back to reference Tabachnick BG, Fidell LS: Using Multivariate Statistics. 2001, Boston, M.A: Allyn and Bacon, Boston, 4 Tabachnick BG, Fidell LS: Using Multivariate Statistics. 2001, Boston, M.A: Allyn and Bacon, Boston, 4
15.
go back to reference LeBreton JM, Senter JL: Answers to 20 questions about interrater reliability and interrater agreement. Organ Res Methods. 2008, 11 (4): 815-852.CrossRef LeBreton JM, Senter JL: Answers to 20 questions about interrater reliability and interrater agreement. Organ Res Methods. 2008, 11 (4): 815-852.CrossRef
16.
go back to reference Comrey AL: A first course in factor analysis. 1973, New York: Academic Press, xii, 316 Comrey AL: A first course in factor analysis. 1973, New York: Academic Press, xii, 316
17.
go back to reference Hu LT, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus New alternatives. Structural Equation Modeling-a Multidisciplinary Journal. 1999, 6 (1): 1-55. 10.1080/10705519909540118.CrossRef Hu LT, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus New alternatives. Structural Equation Modeling-a Multidisciplinary Journal. 1999, 6 (1): 1-55. 10.1080/10705519909540118.CrossRef
18.
go back to reference Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, N.J: L. Erlbaum Associates, xxi, 567 p, 2 Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, N.J: L. Erlbaum Associates, xxi, 567 p, 2
19.
go back to reference Klein KJ, Dansereau F, Hall RJ: Levels issues in theory development, data collection, and analysis. Acad Manag Rev. 1994, 19 (2): 195-229. Klein KJ, Dansereau F, Hall RJ: Levels issues in theory development, data collection, and analysis. Acad Manag Rev. 1994, 19 (2): 195-229.
20.
go back to reference Klein KJ, Kozlowski SWJ: From micro to meso: critical steps in conceptualizing and conducting multilevel research. Organ Res Methods. 2000, 3 (3): 211-236. 10.1177/109442810033001.CrossRef Klein KJ, Kozlowski SWJ: From micro to meso: critical steps in conceptualizing and conducting multilevel research. Organ Res Methods. 2000, 3 (3): 211-236. 10.1177/109442810033001.CrossRef
21.
go back to reference Bliese PD, Halverson RR: Group size and measures of group-level properties: an examination of eta-squared and ICC values. J Air Waste Manage Assoc. 1998, 24 (2): 157-172. Bliese PD, Halverson RR: Group size and measures of group-level properties: an examination of eta-squared and ICC values. J Air Waste Manage Assoc. 1998, 24 (2): 157-172.
22.
go back to reference Bliese PD: Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis, in Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions. 2000, San Francisco: Jossey-Bass, 349-381. K.J. Klein and S.W.J. Kozlowski Bliese PD: Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis, in Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions. 2000, San Francisco: Jossey-Bass, 349-381. K.J. Klein and S.W.J. Kozlowski
23.
go back to reference Cohen A, Doveh E, Nahum-Shani I: Testing agreement for multi-item scales with the indices rWG(J) and ADM(J). Organ Res Methods. 2009, 12 (1): 148-164.CrossRef Cohen A, Doveh E, Nahum-Shani I: Testing agreement for multi-item scales with the indices rWG(J) and ADM(J). Organ Res Methods. 2009, 12 (1): 148-164.CrossRef
24.
go back to reference Bliese PD: Mulilevel modeling in R (2.4): A brief introduction to R, the multilevel package and the nlme package. 2012, Washington DC: Walter Reed Army Institute of Research Bliese PD: Mulilevel modeling in R (2.4): A brief introduction to R, the multilevel package and the nlme package. 2012, Washington DC: Walter Reed Army Institute of Research
25.
go back to reference Murphy KR, Myors B, Wolach AH: Statistical power analysis: a simple and general model for traditional and modern hypothesis tests. 2009, New York: Routledge, xii, 212 p, 3 Murphy KR, Myors B, Wolach AH: Statistical power analysis: a simple and general model for traditional and modern hypothesis tests. 2009, New York: Routledge, xii, 212 p, 3
26.
go back to reference Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed
27.
go back to reference Burke MJ, Dunlap WP: Estimating interrater agreement with the average deviation index: a user’s guide. Organ Res Methods. 2002, 5 (2): 159-172. 10.1177/1094428102005002002.CrossRef Burke MJ, Dunlap WP: Estimating interrater agreement with the average deviation index: a user’s guide. Organ Res Methods. 2002, 5 (2): 159-172. 10.1177/1094428102005002002.CrossRef
28.
go back to reference Lehman WE, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abuse Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7. 30CrossRefPubMed Lehman WE, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abuse Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7. 30CrossRefPubMed
29.
go back to reference Arthaud-Day ML, Rode JC, Turnley WH: Direct and contextual effects of individual values on organizational citizenship behavior in teams. J Appl Psychol. 2012, 97 (4): 792-807.CrossRefPubMed Arthaud-Day ML, Rode JC, Turnley WH: Direct and contextual effects of individual values on organizational citizenship behavior in teams. J Appl Psychol. 2012, 97 (4): 792-807.CrossRefPubMed
30.
go back to reference Christian JS: Examining retaliatory responses to justice violations and recovery attempts in teams. J Appl Psychol. 2012, 97 (6): 1218-1232.CrossRefPubMed Christian JS: Examining retaliatory responses to justice violations and recovery attempts in teams. J Appl Psychol. 2012, 97 (6): 1218-1232.CrossRefPubMed
Metadata
Title
Organizational readiness for implementing change: a psychometric assessment of a new measure
Authors
Christopher M Shea
Sara R Jacobs
Denise A Esserman
Kerry Bruce
Bryan J Weiner
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-7

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue