Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Research

Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire

Authors: Gonzalo Grandes, Paola Bully, Catalina Martinez, Marie-Pierre Gagnon

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

Organizational readiness to change healthcare practice is a major determinant of successful implementation of evidence-based interventions. However, we lack of comprehensive, valid, and reliable instruments to measure it. We assessed the validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire in the context of the implementation of the Prescribe Vida Saludable III project, which seeks to strengthen health promotion and chronic disease prevention in primary healthcare organizations of the Osakidetza (Basque Health Service, Spain).

Methods

A cross-sectional study was conducted including 127 professionals from 20 primary care centers within Osakidetza. They filled in the OR4KT questionnaire twice in a 15- to 30-day period to test repeatability. In addition, we used the Survey of Organizational Attributes for Primary Care (SOAPC) and we documented the number of healthcare professionals who formally engaged in the Prescribe Vida Saludable III project within each participating center to assess concurrent validity.

Results

Cronbach’s alpha for the overall OR4KT was .95, and the overall repeatability coefficient was 6.95%, both excellent results. Confirmatory factor analysis supported the underlying theoretical structure of 6 dimensions and 23 sub-dimensions. There were positive moderate-to-high internal correlations between these six dimensions, and there was evidence of good concurrent validity (correlation coefficient of .76 with SOAPC, and .80 with the proportion of professionals engaged by center). A score higher than 64 (out of 100) would be indicative of an organization with high level of readiness to implement the intervention (sensitivity = .75, specificity = 1).

Conclusions

The Spanish version of the OR4KT exhibits very strong reliability and good validity, although it needs to be validated in a larger sample and in different implementation contexts.
Appendix
Available only for authorised users
Literature
1.
go back to reference Gagnon MP, Attieh R, Dunn S, Grandes G, Bully P, Estabrooks CA, Légaré F et al. Development and content validation of a transcultural instrument to assess organizational readiness for knowledge translation in healthcare organizations: the OR4KT, International Journal of Health Policy and Management, Submitted. Gagnon MP, Attieh R, Dunn S, Grandes G, Bully P, Estabrooks CA, Légaré F et al. Development and content validation of a transcultural instrument to assess organizational readiness for knowledge translation in healthcare organizations: the OR4KT, International Journal of Health Policy and Management, Submitted.
2.
go back to reference Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.CrossRefPubMedPubMedCentral Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.CrossRefPubMedPubMedCentral
3.
go back to reference Forouzanfar MH, Alexander L, Anderson HR, Bachman VF, Biryukov S, Brauer M, Burnett R, Casey D, Coates MM, Cohen A, Delwiche K. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the global burden of disease study 2013. Lancet. 2015;386(10010):2287–323.CrossRefPubMed Forouzanfar MH, Alexander L, Anderson HR, Bachman VF, Biryukov S, Brauer M, Burnett R, Casey D, Coates MM, Cohen A, Delwiche K. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the global burden of disease study 2013. Lancet. 2015;386(10010):2287–323.CrossRefPubMed
4.
go back to reference Thomas K, Krevers B, Bendtsen P. Long-term impact of a real-world coordinated lifestyle promotion initiative in primary care: a quasi-experimental cross-sectional study. BMC Fam Pract. 2014;15(1):1.CrossRef Thomas K, Krevers B, Bendtsen P. Long-term impact of a real-world coordinated lifestyle promotion initiative in primary care: a quasi-experimental cross-sectional study. BMC Fam Pract. 2014;15(1):1.CrossRef
5.
go back to reference Grandes G, Sánchez A, Cortada JM, Balague L, Calderon C, Arrazola A, Vergara I, Millan E. For the “Prescribe Vida Saludable” group. Is integration of healthy lifestyle promotion into primary care feasible? Discussion and consensus sessions between clinicians and researchers. BMC Health Serv Res. 2008;8:213.CrossRefPubMedPubMedCentral Grandes G, Sánchez A, Cortada JM, Balague L, Calderon C, Arrazola A, Vergara I, Millan E. For the “Prescribe Vida Saludable” group. Is integration of healthy lifestyle promotion into primary care feasible? Discussion and consensus sessions between clinicians and researchers. BMC Health Serv Res. 2008;8:213.CrossRefPubMedPubMedCentral
6.
go back to reference Sanchez A, Grandes G, Cortada JM, Pombo H, Martinez C, Corrales MH, de la Peña E, Mugica J, Gorostiza E. PVS group. Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation. BMC Fam Pract. 2017;18(1):24.CrossRefPubMedPubMedCentral Sanchez A, Grandes G, Cortada JM, Pombo H, Martinez C, Corrales MH, de la Peña E, Mugica J, Gorostiza E. PVS group. Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation. BMC Fam Pract. 2017;18(1):24.CrossRefPubMedPubMedCentral
7.
go back to reference Martinez C, Bacigalupe G, Cortada JM, Grandes G, Sanchez A, Pombo H, Bully P, PVS group. The implementation of health promotion in primary and community care: a qualitative analysis of the ‘Prescribe Vida Saludable’ strategy. BMC Fam Pract. 2017;18(1):23.CrossRefPubMedPubMedCentral Martinez C, Bacigalupe G, Cortada JM, Grandes G, Sanchez A, Pombo H, Bully P, PVS group. The implementation of health promotion in primary and community care: a qualitative analysis of the ‘Prescribe Vida Saludable’ strategy. BMC Fam Pract. 2017;18(1):23.CrossRefPubMedPubMedCentral
8.
go back to reference Kardakis T, Weinehall L, Jerdén L, Nyström ME, Johansson H. Lifestyle interventions in primary health care: professional and organizational challenges. Eur J Pub Health. 2014;24(1):79–84.CrossRef Kardakis T, Weinehall L, Jerdén L, Nyström ME, Johansson H. Lifestyle interventions in primary health care: professional and organizational challenges. Eur J Pub Health. 2014;24(1):79–84.CrossRef
9.
go back to reference Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abus Treat. 2002;22(4):197–209.CrossRef Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abus Treat. 2002;22(4):197–209.CrossRef
10.
go back to reference Holt DT, Armenakis AA, Feild HS, Harris SG. Readiness for organizational change: the systematic development of a scale. J Appl Behav Sci. 2007;43(2):232–55.CrossRef Holt DT, Armenakis AA, Feild HS, Harris SG. Readiness for organizational change: the systematic development of a scale. J Appl Behav Sci. 2007;43(2):232–55.CrossRef
11.
go back to reference Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436.CrossRefPubMed Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436.CrossRefPubMed
12.
go back to reference Shea C, Jacobs S, Esserman D, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. J Impl Sci. 2014;9:7.CrossRef Shea C, Jacobs S, Esserman D, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. J Impl Sci. 2014;9:7.CrossRef
13.
go back to reference Nuño-Solinís R, Fernández-Cano P, Mira-Solves JJ, Toro-Polanco N, Contel JC, Guilabert Mora M, Solas O. Development of an instrument for the assessment of chronic care models. Gac Sanit. 2013;27(2):128–34.CrossRefPubMed Nuño-Solinís R, Fernández-Cano P, Mira-Solves JJ, Toro-Polanco N, Contel JC, Guilabert Mora M, Solas O. Development of an instrument for the assessment of chronic care models. Gac Sanit. 2013;27(2):128–34.CrossRefPubMed
14.
go back to reference Mira JJ, Nuño-Solinís R, Fernández-Cano P, Toro-Polanco N, Contel JC, Guilabert-Mora M, Solas-Gaspar O. Readiness to tackle chronicity in Spanish health care organisations: a two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument. Int J Integrated Care. 2015;15(4) Mira JJ, Nuño-Solinís R, Fernández-Cano P, Toro-Polanco N, Contel JC, Guilabert-Mora M, Solas-Gaspar O. Readiness to tackle chronicity in Spanish health care organisations: a two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument. Int J Integrated Care. 2015;15(4)
15.
go back to reference Weeks DL, Polello JM, Hansen DT, Keeney BJ, Conrad DA. Measuring primary care organizational capacity for diabetes care coordination: the diabetes care coordination readiness assessment. J Gen Intern Med. 2014;29(1):98–103.CrossRefPubMed Weeks DL, Polello JM, Hansen DT, Keeney BJ, Conrad DA. Measuring primary care organizational capacity for diabetes care coordination: the diabetes care coordination readiness assessment. J Gen Intern Med. 2014;29(1):98–103.CrossRefPubMed
18.
go back to reference Sanz-Guinea A, Espinosa M, Grandes G, Sanchez A, Martinez C, Pombo H, Bully P, Cortada J. Efficiency of “Prescribe Vida Saludable”, a health promotion innovation. Pilot phase Gac Sanit. 2017; Sanz-Guinea A, Espinosa M, Grandes G, Sanchez A, Martinez C, Pombo H, Bully P, Cortada J. Efficiency of “Prescribe Vida Saludable”, a health promotion innovation. Pilot phase Gac Sanit. 2017;
19.
go back to reference Bully P, Sanchez A, Grandes G, Pombo H, Arietalenizbeaskoa MS, Arce V, Martinez C, PVS Group. Metric properties of the “prescribe healthy life” screening questionnaire to detect healthy behaviors: a cross-sectional pilot study. BMC Public Health. 2016;16(1):1228.CrossRefPubMedPubMedCentral Bully P, Sanchez A, Grandes G, Pombo H, Arietalenizbeaskoa MS, Arce V, Martinez C, PVS Group. Metric properties of the “prescribe healthy life” screening questionnaire to detect healthy behaviors: a cross-sectional pilot study. BMC Public Health. 2016;16(1):1228.CrossRefPubMedPubMedCentral
20.
go back to reference Attieh R, Gagnon M-P, Estabrooks CA, Légaré F, Ouimet M, Roch G, Ghandour EK, Grimshaw J. Organizational readiness for knowledge translation in chronic care: a review of theoretical components. Implement Sci. 2013;8:138.CrossRefPubMedPubMedCentral Attieh R, Gagnon M-P, Estabrooks CA, Légaré F, Ouimet M, Roch G, Ghandour EK, Grimshaw J. Organizational readiness for knowledge translation in chronic care: a review of theoretical components. Implement Sci. 2013;8:138.CrossRefPubMedPubMedCentral
22.
go back to reference Ohman-Strickland PA, John Orzano A, Nutting PA, Perry Dickinson W, Scott-Cawiezell J, Hahn K, Gibel M, Crabtree BF. Measuring organizational attributes of primary care practices: development of a new instrument. Health Serv Res. 2007;42(3 Pt 1):1257–73.CrossRefPubMedPubMedCentral Ohman-Strickland PA, John Orzano A, Nutting PA, Perry Dickinson W, Scott-Cawiezell J, Hahn K, Gibel M, Crabtree BF. Measuring organizational attributes of primary care practices: development of a new instrument. Health Serv Res. 2007;42(3 Pt 1):1257–73.CrossRefPubMedPubMedCentral
23.
go back to reference Vaz S, Falkmer T, Passmore AE, Parson R, Andreou P. The case for using the repeatability coefficient when calculating test–retest reliability. PLoS One. 2013;8(9):e73990.CrossRefPubMedPubMedCentral Vaz S, Falkmer T, Passmore AE, Parson R, Andreou P. The case for using the repeatability coefficient when calculating test–retest reliability. PLoS One. 2013;8(9):e73990.CrossRefPubMedPubMedCentral
24.
go back to reference Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 3rd ed. Oxford: Oxford University Press; 1995. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 3rd ed. Oxford: Oxford University Press; 1995.
25.
go back to reference Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. MA, USA: Allyn & Bacon, Inc. Needham Heights; 2005. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. MA, USA: Allyn & Bacon, Inc. Needham Heights; 2005.
26.
go back to reference Barrentine L. Concepts for R&R studies. Milwaukee, WI: ASQC Quality Press; 1991. Barrentine L. Concepts for R&R studies. Milwaukee, WI: ASQC Quality Press; 1991.
Metadata
Title
Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire
Authors
Gonzalo Grandes
Paola Bully
Catalina Martinez
Marie-Pierre Gagnon
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0664-y

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue