Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Research

Evaluation of the “Foundations in Knowledge Translation” training initiative: preparing end users to practice KT

Authors: Jamie S. Park, Julia E. Moore, Radha Sayal, Bev J. Holmes, Gayle Scarrow, Ian D. Graham, Lianne Jeffs, Caitlyn Timmings, Shusmita Rashid, Alekhya Mascarenhas Johnson, Sharon E. Straus

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Current knowledge translation (KT) training initiatives are primarily focused on preparing researchers to conduct KT research rather than on teaching KT practice to end users. Furthermore, training initiatives that focus on KT practice have not been rigorously evaluated and have focused on assessing short-term outcomes and participant satisfaction only. Thus, there is a need for longitudinal training evaluations that assess the sustainability of training outcomes and contextual factors that may influence outcomes.

Methods

We evaluated the KT training initiative “Foundations in KT” using a mixed-methods longitudinal design. “Foundations in KT” provided training in KT practice and included three tailored in-person workshops, coaching, and an online platform for training materials and knowledge exchange. Two cohorts were included in the study (62 participants, including 46 “Foundations in KT” participants from 16 project teams and 16 decision-maker partners). Participants completed self-report questionnaires, focus groups, and interviews at baseline and at 6, 12, 18, and 24 months after the first workshop.

Results

Participant-level outcomes include survey results which indicated that participants’ self-efficacy in evidence-based practice (F(1,8.9) = 23.7, p = 0.001, n = 45), KT activities (F(1,23.9) = 43.2, p < 0.001, n = 45), and using evidence to inform practice increased over time (F(1,11.0) = 6.0, p = 0.03, n = 45). Interviews and focus groups illustrated that participants’ understanding of and confidence in using KT increased from baseline to 24 months after the workshop. Interviews and focus groups suggested that the training initiative helped participants achieve their KT project objectives, plan their projects, and solve problems over time. Contextual factors include teams with high self-reported organizational capacity and commitment to implement at the start of their project had buy-in from upper management that resulted in secured funding and resources for their project. Training initiative outcomes include participants who applied the KT knowledge and skills they learned to other projects by sharing their knowledge informally with coworkers. Sustained spread of KT practice was observed with five teams at 24 months.

Conclusions

We completed a longitudinal evaluation of a KT training initiative. Positive participant outcomes were sustained until 24 months after the initial workshop. Given the emphasis on implementing evidence and the need to train implementers, these findings are promising for future KT training.
Appendix
Available only for authorised users
Literature
2.
go back to reference Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, Glisson C, Chambers D. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013; https://doi.org/10.1186/1748-5908-8-105. Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, Glisson C, Chambers D. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013; https://​doi.​org/​10.​1186/​1748-5908-8-105.
4.
go back to reference Morrato EH, Rabin B, Proctor J, Cicutto LC, Battaglia CT, Lambert-Kerzner A, Leeman-Castillo B, Prahl-Wretling M, Nuechterlein B, Glasgow RE, Kempe A. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015; https://doi.org/10.1186/s13012-015-0281-6. Morrato EH, Rabin B, Proctor J, Cicutto LC, Battaglia CT, Lambert-Kerzner A, Leeman-Castillo B, Prahl-Wretling M, Nuechterlein B, Glasgow RE, Kempe A. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015; https://​doi.​org/​10.​1186/​s13012-015-0281-6.
9.
go back to reference Balas EA, Boren SA. Managing clinical knowledge for health care improvement. In: Bemmel J, McCray AT, editors. Yearbook of medical informatics 2000: patient-centered systems. Stuttgart: Schattauer Verlagsgesellschaft mbH; 2000. p. 65–70. Balas EA, Boren SA. Managing clinical knowledge for health care improvement. In: Bemmel J, McCray AT, editors. Yearbook of medical informatics 2000: patient-centered systems. Stuttgart: Schattauer Verlagsgesellschaft mbH; 2000. p. 65–70.
20.
go back to reference Li Y-F, Helfrich Christian D, Sharp Nancy D, Sales Anne E. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009; https://doi.org/10.1186/1748-5908-4-38. Li Y-F, Helfrich Christian D, Sharp Nancy D, Sales Anne E. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009; https://​doi.​org/​10.​1186/​1748-5908-4-38.
22.
go back to reference Corp. I. IBM SPSS statistics for Windows, Version 20.0. Armonk: IMB Corp; 2011. Corp. I. IBM SPSS statistics for Windows, Version 20.0. Armonk: IMB Corp; 2011.
23.
go back to reference Ltd. QIP: NVivo qualitative data analysis software. vol. Version 10: QSR; 2012. Ltd. QIP: NVivo qualitative data analysis software. vol. Version 10: QSR; 2012.
24.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef
25.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed
26.
go back to reference Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2001;1(3):385–405.CrossRef Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2001;1(3):385–405.CrossRef
27.
go back to reference Miles MHA, Saldana J. Qualitative data analysis: a methods sourcebook. Thousand Oaks: SAGE; 2014. Miles MHA, Saldana J. Qualitative data analysis: a methods sourcebook. Thousand Oaks: SAGE; 2014.
28.
go back to reference Ritchie J, Spencer L, O’ Connor W. Carrying out qualitative analysis. In: Ritchie J, Lewis J, editors. Qualitative research practice: a guide for social science students and researchers. London: SAGE; 2003. p. 219–62. Ritchie J, Spencer L, O’ Connor W. Carrying out qualitative analysis. In: Ritchie J, Lewis J, editors. Qualitative research practice: a guide for social science students and researchers. London: SAGE; 2003. p. 219–62.
29.
go back to reference Hmelo-Silver CE. Problem-based learning: what and how do students learn? Educ Psychol Rev. 2004;16(3):235–66.CrossRef Hmelo-Silver CE. Problem-based learning: what and how do students learn? Educ Psychol Rev. 2004;16(3):235–66.CrossRef
30.
go back to reference Furman N, Sibthorp J. Leveraging experiential learning techniques for transfer. New Dir Adult Contin Educ. 2013;137:17–26.CrossRef Furman N, Sibthorp J. Leveraging experiential learning techniques for transfer. New Dir Adult Contin Educ. 2013;137:17–26.CrossRef
35.
go back to reference Harvey G, Fitzgerald L, Fielden S, McBride A, Waterman H, Bamford D, et al. The NIHR collaboration for leadership in applied health research and care (CLAHRC) for greater Manchester: combining empirical, theoretical and experiential evidence to design and evaluate a large-scale implementation strategy. Implement Sci. 2011; https://doi.org/10.1186/1748-5908-6-96. Harvey G, Fitzgerald L, Fielden S, McBride A, Waterman H, Bamford D, et al. The NIHR collaboration for leadership in applied health research and care (CLAHRC) for greater Manchester: combining empirical, theoretical and experiential evidence to design and evaluate a large-scale implementation strategy. Implement Sci. 2011; https://​doi.​org/​10.​1186/​1748-5908-6-96.
38.
go back to reference Avolio B, Zhu W, Koh W, Bhatia P. Transformational leadership and organizational commitment: mediating role of psychological empowerment and moderating role of structural distance. J Organ Behav. 2004; https://doi.org/10.1002/job.283. Avolio B, Zhu W, Koh W, Bhatia P. Transformational leadership and organizational commitment: mediating role of psychological empowerment and moderating role of structural distance. J Organ Behav. 2004; https://​doi.​org/​10.​1002/​job.​283.
40.
43.
go back to reference Michaelis B, Stegmaier R, Sonntag K. Shedding light on followers’ innovation implementation behavior: the role of transformational leadership, commitment to change, and climate for initiative. J Manage Psychol. 2010;25(4):408–29.CrossRef Michaelis B, Stegmaier R, Sonntag K. Shedding light on followers’ innovation implementation behavior: the role of transformational leadership, commitment to change, and climate for initiative. J Manage Psychol. 2010;25(4):408–29.CrossRef
44.
45.
go back to reference Gifford W, Graham I, Ehrhart MG, Davies BL, Aarons G. Ottawa model of implementation leadership and implementation leadership scale: mapping concepts for developing and evaluating theory-based leadership interventions. J Healthc Leadersh. 2017;9:15–23.CrossRefPubMedPubMedCentral Gifford W, Graham I, Ehrhart MG, Davies BL, Aarons G. Ottawa model of implementation leadership and implementation leadership scale: mapping concepts for developing and evaluating theory-based leadership interventions. J Healthc Leadersh. 2017;9:15–23.CrossRefPubMedPubMedCentral
46.
go back to reference Gifford WA, Davies B, Edwards N, Graham ID. Leadership strategies to influence the use of clinical practice guidelines. Nurs Leadersh (Tor Ont). 2006;19:72–88.CrossRef Gifford WA, Davies B, Edwards N, Graham ID. Leadership strategies to influence the use of clinical practice guidelines. Nurs Leadersh (Tor Ont). 2006;19:72–88.CrossRef
47.
go back to reference Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. Dissemination and implementation research in health: translating science to practice. In: Browson RC, Colditz GA, Proctor EK, editors. The role of organizational processes in dissemination and implementation research. New York: OXford University Press; 2012.CrossRef Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. Dissemination and implementation research in health: translating science to practice. In: Browson RC, Colditz GA, Proctor EK, editors. The role of organizational processes in dissemination and implementation research. New York: OXford University Press; 2012.CrossRef
49.
go back to reference Hutchinson A, Estabrooks C. Theories of KT: educational theories. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge translation in health care. Oxford: Wiley/Blackwell; 2009. Hutchinson A, Estabrooks C. Theories of KT: educational theories. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge translation in health care. Oxford: Wiley/Blackwell; 2009.
50.
51.
go back to reference Knowles MS. The modern practice of adult education. Revised edn. Chicago: Association Press/Follett; 1980. Knowles MS. The modern practice of adult education. Revised edn. Chicago: Association Press/Follett; 1980.
52.
54.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):1–72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):1–72.CrossRef
Metadata
Title
Evaluation of the “Foundations in Knowledge Translation” training initiative: preparing end users to practice KT
Authors
Jamie S. Park
Julia E. Moore
Radha Sayal
Bev J. Holmes
Gayle Scarrow
Ian D. Graham
Lianne Jeffs
Caitlyn Timmings
Shusmita Rashid
Alekhya Mascarenhas Johnson
Sharon E. Straus
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0755-4

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue