Top

Implementation Science

Published in:

Open Access 01-12-2018 | Short report

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC)

Authors: Marie Höjriis Storkholm, Pamela Mazzocato, Mesfin Kassaye Tessma, Carl Savage

Published in: Implementation Science | Issue 1/2018

Abstract

Background

Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the Organizational Readiness for Implementing Change (ORIC) questionnaire. It measures if organizational members are confident in their collective commitment towards and ability (efficacy) to implement organizational change. ORIC is concise, grounded in theory, and designed, but not yet validated among employees in a real hospital setting.

Methods

The 12-item ORIC instrument was translated into Danish and back-translated to English. Employees (N = 284) at a hospital department facing a major organizational change in the Central Denmark Region completed the questionnaire. Face and content validity was ascertained. Exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were used to assess construct validity. Reliability was assessed with Cronbach’s alpha. Item response theory (Rasch analysis) was used to determine item and person reliability.

Results

Response rate was 72%. A two factor (commitment and efficacy), 11-item scale, of the Danish language ORIC was shown to be valid (CFI = .95, RMSEA = .067, and CMNI/DF = 2.32) and reliable (Cronbach’s alpha 0.88) in a health care setting. Item response analysis confirmed acceptable person and item separation reliability.

Conclusions

Our version of ORIC showed acceptable validity and reliability as an instrument for measuring readiness for implementing organizational change in a Danish-speaking health care population. For health care managers interested in evaluating their organizations and tailor change strategies, ORIC’s brevity and theoretical underpinnings could make it an appealing and feasible tool to develop more successful change efforts.

Available only for authorised users

Shortell S, Bennett C, Byck G. Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q 1998;76:593–624, 510. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2751103&tool=pmcentrez&rendertype=abstract. Accessed 22 Apr 2014.

Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629. https://doi.org/10.1111/j.0887-378X.2005.340_1.x. CrossRefPubMedPubMedCentral

Weiner BJ, Amick H, S-YD L. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65:379–436. https://doi.org/10.1177/1077558708317802. CrossRefPubMed

Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;9. https://doi.org/10.1186/1748-5908-9-7.

Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4:67. https://doi.org/10.1186/1748-5908-4-67.CrossRefPubMedPubMedCentral

Meyer JP, Stanley DJ, Herscovitch L, Topolnytsky L. Affective, continuance, and normative commitment to the organization: a meta-analysis of antecedents, correlates, and consequences. J Vocat Behav. 2002;61:20–52. https://doi.org/10.1006/jvbe.2001.1842.CrossRef

Herscovitch L, Meyer JP. Commitment to organizational change: extension of a three-component model. J Appl Psychol. 2002;87:474–87. https://doi.org/10.1037//0021-9010.87.3.474.CrossRefPubMed

Bandura A. Self-efficacy: The exercise of control. New York: Freeman; 1997.

Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24:292–305. https://doi.org/10.1093/her/cyn019. CrossRefPubMed

10.

Rudkjøbing A, Olejaz M, Birk HO, Nielsen AJ, Hernández-quevedo C, Published A. Integrated care: a Danish perspective. BMJ. 2012;345:4451.

11.

Storkholm MH, Mazzocato P, Savage M, Savage C. Money’s (not) on my mind: a qualitative study of how staff and managers understand health care’s triple aim. BMC Health Serv Res. 2017;17:98. https://doi.org/10.1186/s12913-017-2052-3.CrossRefPubMedPubMedCentral

12.

Jordan C, Hoefer RA. Reliability and validity in quantitative measurement. In: Thyer BA, editor. Social work research methods. Thousand Oaks, CA: Sage; 2001.

13.

Behling O, Law KS. Translating questionnaires and other research instruments. London: Sage; 2000.CrossRef

14.

Rode N. Translation of measurement instruments and their reliability: an example of job-related affective well-being scale. Metod Zv. 2005;2:15–26.

15.

Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960;20:141–51.CrossRef

16.

Myers ND, Ahn S, Jin Y. Sample size and power estimates for a confirmatory factor analytic model in exercise and sport. Res Q Exerc Sport. 2011;82:412–23. https://doi.org/10.1080/02701367.2011.10599773.CrossRefPubMed

17.

Marsh HW, Hocevar D. Application of confirmatory factor analysis to the study of self-concept: first- and higher order factor models and their invariance across groups. Psychol Bull. 1985;97:562–82.CrossRef

18.

Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis: Global Edition. 7th Edition. Upper Saddle River: Pearson Higher Education; 2010.

19.

Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107:238–46. https://doi.org/10.1037/0033-2909.107.2.238.CrossRefPubMed

20.

Browne M, Cudeck R. Alternative ways of assessing model fit. In: Bollen K, Long J, editors. Testing structural equation models. Newbury Park, CA: Sage; 1993.

21.

Kline R. Principles and practice of structural equation modeling. NY: Guilford press; 1998.

22.

Andrich D. Controversy and the Rasch model. Med Care 2004;42 Supplement:I-7. https://doi.org/10.1097/01.mlr.0000103528.48582.7c.

23.

Nguyan TH, Han H-R, Kim MT, Chan KS. An introduction to item response theory for patient-reported outcome measurement. Patient. 2014;7:23–35.CrossRef

24.

Linacre J. A User’s guide to WINSTEPS. In: Rasch-model computer programs. Program Manual for 4.0.0. Chicago. http://www.winsteps.com/winman/copyright.htm.

25.

Jöreskog KG, Sörbom D. LISREL 8: user’s reference guide. 2nd ed. Lincolnwood: Scientific Software International; 1996.

26.

Sanders KA, Wolcott MD, McLaughlin JE, D’Ostroph A, Shea CM, Pinelli NR. Organizational readiness for change: Preceptor perceptions regarding early immersion of student pharmacists in health-system practice. Res Soc Adm Pharm. 2017. https://doi.org/10.1016/j.sapharm.2017.03.004.

27.

Hannon PA, Helfrich CD, Chan KG, Allen CL, Hammerback K, Kohn MJ, et al. Development and pilot test of the workplace readiness questionnaire, a theory-based instrument to measure small workplaces’ readiness to implement wellness programs. Am J Health Promot. 2017;31:67–75.CrossRefPubMed

Title: Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC)
Authors: Marie Höjriis Storkholm
Pamela Mazzocato
Mesfin Kassaye Tessma
Carl Savage
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-018-0769-y

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC)

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2018

Shedding light on conditions for the successful passive dissemination of recommendations in primary care: a mixed methods study

Effectiveness of educational outreach visits compared with usual guideline dissemination to improve family physician prescribing—an 18-month open cluster-randomized trial

Protocol to disseminate a hospital-site controlled intervention using audit and feedback to implement guidelines concerning inappropriate treatment of asymptomatic bacteriuria

A practice change intervention to improve antenatal care addressing alcohol consumption by women during pregnancy: research protocol for a randomised stepped-wedge cluster trial

An individually tailored family-centered intervention for pediatric obesity in primary care: study protocol of a randomized type II hybrid effectiveness–implementation trial (Raising Healthy Children study)

Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach