Top

Implementation Science

Published in:

Open Access 01-12-2018 | Research

Longitudinal evaluation of a course to build core competencies in implementation practice

Authors: Julia E. Moore, Shusmita Rashid, Jamie S. Park, Sobia Khan, Sharon E. Straus

Published in: Implementation Science | Issue 1/2018

Abstract

Background

Few training opportunities are available for implementation practitioners; we designed the Practicing Knowledge Translation (PKT) to address this gap. The goal of PKT is to train practitioners to use evidence and apply implementation science in healthcare settings. The aim of this study was to describe PKT and evaluate participant use of implementation science theories, models, and frameworks (TMFs), knowledge, self-efficacy, and satisfaction and feedback on the course.

Methods

PKT was delivered to implementation practitioners between September 2015 and February 2016 through a 3-day workshop, 11 webinars. We assessed PKT using an uncontrolled before and after study design, using convergent parallel mixed methods. The primary outcome was use of TMFs in implementation projects. Secondary outcomes were knowledge and self-efficacy across six core competencies, factors related to each of the outcomes, and satisfaction with the course. Participants completed online surveys and semi-structured interviews at baseline, 3, 6, and 12 months.

Results

Participants (n = 15) reported an increase in their use of implementation TMFs (mean = 2.11; estimate = 2.11; standard error (SE) = 0.4; p = 0.03). There was a significant increase in participants’ knowledge of developing an evidence-informed, theory-driven program (ETP) (estimate = 4.10; SE = 0.37; p = 0.002); evidence implementation (estimate = 2.68; SE = 0.42; p < 0.001); evaluation (estimate = 4.43; SE = 0.36; p < 0.001); sustainability, scale, and spread (estimate = 2.55; SE = 0.34; p < 0.001); and context assessment (estimate = 3.86; SE = 0.32; p < 0.001). There was a significant increase in participants’ self-efficacy in developing an ETP (estimate = 3.81; SE = 0.34; p < 0.001); implementation (estimate = 3.01; SE = 0.36; p < 0.001); evaluation (estimate = 3.83; SE = 0.39; p = 0.002); sustainability, scale, and spread (estimate = 3.06; SE = 0.46; p = 0.003); and context assessment (estimate = 4.05; SE = 0.38; p = 0.016).

Conclusion

Process and outcome measures collected indicated that PKT participants increased use of, knowledge of, self-efficacy in KT. Our findings highlight the importance of longitudinal evaluations of training initiatives to inform how to build capacity for implementers.

Available only for authorised users

Norton WE, Lungeanu A, Chambers D, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. 2017;112 https://doi.org/10.1007/s11192-017-2455-2.

Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Translational Behavioral Medicine. 2017;7:593–601. https://doi.org/10.1007/s13142-016-0399-3.CrossRefPubMed

Wensing M. Implementation science in healthcare: introduction and perspective. Z Evid Fortbild Qual Gesundhwes. 2015;109:97–102. https://doi.org/10.1016/j.zefq.2015.02.014.CrossRefPubMed

Morrato EH, Rabin B, Proctor J, Cicutto LC, Battaglia CT, Lambert-Kerzner A, et al. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015;10:94. https://doi.org/10.1186/s13012-015-0281-6.CrossRefPubMedPubMedCentral

Meissner HI, Glasgow RE, Vinson CA, Chambers D, Brownson RC, Green LW, et al. The U.S. training institute for dissemination and implementation research in health. Implementation Science. 2013;8:12. https://doi.org/10.1186/1748-5908-8-12.CrossRefPubMed

Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:105. https://doi.org/10.1186/1748-5908-8-105.CrossRefPubMedPubMedCentral

What is the MT-DIRC. MT-DIRC. 2018. http://mtdirc.org/. Accessed 24 Nov 2017.

Marriott BR, Rodriguez AL, Landes SJ, Lewis CC, Comtois KA. A methodology for enhancing implementation science proposals: comparison of face-to-face versus virtual workshops. Implementation Science : IS. 2016;11:62. https://doi.org/10.1186/s13012-016-0429-z.CrossRefPubMed

Implementation Science Masterclass Tuesday 11 and Wednesday 12 July 2017. Collaboration for Leadership in Applied Health Research and Care South London. 2017. http://www.clahrc-southlondon.nihr.ac.uk/events/2017/implementation-science-masterclass-tuesday-11-and-wednesday-12-july-2017. Accessed 12 Nov 2017.

10.

UCSF Online implementation science courses and certificate program, in implementation science news.2017.

11.

Brownson RC, Fielding JE, Green LW. Building capacity for evidence-based public health: reconciling the pulls of practice and the push of research. Annu Rev Public Health. 2017; https://doi.org/10.1146/annurev-publhealth-040617-014746.

12.

Scientist knowledge translation training workshop. Knowledge Translation Programs. 2018 http://www.sickkids.ca/Learning/AbouttheInstitute/Programs/Knowledge-Translation/2-Day-Scientist-Knowledge-Translation-Training/index.html. Accessed 15 Feb 2018.

13.

Dunagan PB, Kimble LP, Gunby SS, Andrews MM. Attitudes of prejudice as a predictor of cultural competence among baccalaureate nursing students. J Nurs Educ. 2014;53(6):320–8.CrossRefPubMed

14.

EBCP workshop. 2018. http://ebm.mcmaster.ca/. Accessed 15 Feb 2018.

15.

Educational program & training. 2018. https://www.cebm.net/education-and-training/. Accessed 15 Feb 2018.

16.

The Michael Smith Foundation for Health Research. Training and resources to support research use: a BC needs assessment; 2012.

17.

Knowledge Translation Program. breaKThrough: a knowledge translation support service report on findings of a needs assessment and exploration of growth opportunities. Toronto: St. Michael’s Hospital; 2013.

18.

Leung WC. Competency based medical training: review. BMJ. 2002;325:693–6.CrossRefPubMedPubMedCentral

19.

Thacker SB, Brownson RC Practicing Epidemiology. How competent are we? Public Health Rep. 2008;123:4–5.CrossRefPubMedPubMedCentral

20.

Padek M, Colditz G, Dobbins M, Koscielniak N, Proctor EK, Sales AE, et al. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts. Implement Sci. 2015;10:114. https://doi.org/10.1186/s13012-015-0304-3.CrossRefPubMedPubMedCentral

21.

Straus SE, Brouwers M, Johnson D, Lavis JN, Légaré F, Majumdar SR, et al. Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011;6(1):127.CrossRefPubMedPubMedCentral

22.

Ullrich C, Mahler C, Forstner J, Szecsenyi J, Wensing M. Teaching implementation science in a new Master of Science Program in Germany: a survey of stakeholder expectations. Implement Sci. 2017;12:55. https://doi.org/10.1186/s13012-017-0583-y.CrossRefPubMedPubMedCentral

23.

Gonzales R, Handley MA, Ackerman S, O’Sullivan PS. Increasing the translation of evidence into practice, policy, and public health improvements: a framework for training health professionals in implementation and dissemination science. Acad Med. 2012;87:271–8. https://doi.org/10.1097/ACM.0b013e3182449d33.PubMedPubMedCentralCrossRef

24.

Brownson RC, Proctor EK, Luke DA, Baumann AA, Staub M, Brown MT, et al. Building capacity for dissemination and implementation research: one university’s experience. Implementation Science : IS. 2017;12:104. https://doi.org/10.1186/s13012-017-0634-4.CrossRefPubMed

25.

Metz A, Louison L, Ward C, and Burke K. Global implementation specialist practice profile. 2018. https://nirn.fpg.unc.edu/resources/is-practice-profile.

26.

Straus SE, Sales A, Wensing M, Michie S, Kent B, Foy R. Education and training for implementation science: our interest in manuscripts describing education and training materials. Implement Sci. 2015;10:136.CrossRefPubMedPubMedCentral

27.

Carlfjord S, Roback K, Nilsen P. Five years’ experience of an annual course on implementation science: an evaluation among course participants. Implement Sci. 2017;12:101. https://doi.org/10.1186/s13012-017-0618-4.CrossRefPubMedPubMedCentral

28.

EXTRA Program for Healthcare Improvement. Foundation for Healthcare Improvement (CFHI) 2018. https://www.cfhi-fcass.ca/WhatWeDo/extra. Accessed 15 Feb 2018.

29.

Park JS, Moore JE, Sayal R, Holmes BJ, Scarrow G, Graham ID, et al. Evaluation of the “Foundations in Knowledge Translation” training initiative: preparing end users to practice KT. Implement Sci. 2018;13(1):63.CrossRefPubMedPubMedCentral

30.

Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26:13–24.CrossRefPubMed

31.

Nilsen P Making sense of implementation theories, models and frameworks. Implementation Science 2015; 10: 53.

32.

Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implementation science. 2011;6:42.CrossRefPubMed

33.

Mezirow J. Transformative dimensions of adult learning: San Francisco: Jossey-Bass; 1991.

34.

Fosnot CT, Perry RS. Constructivism: theory, perspectives, and practice. Vol. 2. New York: Teachers College Press; 2005. p. 8–33.

35.

Kolb DA. Experiential learning: experience as the source of learning and development. Englewood Cliffs: Prentice-Hall; 1984.

36.

Conrad R-M, Donaldson JA. Continuing to engage the online learner: more activities and resources for creative instruction. Vol. 35. New York: Wiley; 2012.

37.

Lehman RM, Conceição SC. Motivating and retaining online students: research-based strategies that work: San Francisco: Jossey-Bass; 2013.

38.

Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;2:CD003030

39.

Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008;300:1181–96.CrossRefPubMed

40.

Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(10):CD004398.

41.

Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed

42.

Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Admin Pol Ment Health. 2011;38(1):44–53.CrossRef

43.

Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health services research. 2013;48(6pt2):2134–56.CrossRefPubMedPubMedCentral

44.

Dillman DA. Mail and telephone surveys: the total design method. Vol. 19. New York: Wiley; 1978.

45.

Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.CrossRef

46.

Padek M, Mir N, Jacob RR, Chambers DA, Dobbins M, Emmons KM, et al. Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach. Implement Sci. 2018;13(1):18.CrossRefPubMedPubMedCentral

47.

Salyers V, Carter L, Cairns S, and Durrer L The use of scaffolding and interactive learning strategies in online courses for working nurses: implications for adult and online education. 2014.

48.

Hmelo-Silver CE. Problem-based learning: what and how do students learn? Educ Psychol Rev. 2004;16:235–66.CrossRef

49.

Furman N, Sibthorp J. Leveraging experiential learning techniques for transfer. New Directions for Adult and Continuing Education. 2013;2013:17–26.CrossRef

50.

Osanjo GO, Oyugi JO, Kibwage IO, Mwanda WO, Ngugi EN, Otieno FC, et al. Building capacity in implementation science research training at the University of Nairobi. Implementation Science : IS. 2016;11:30. https://doi.org/10.1186/s13012-016-0395-5.CrossRefPubMed

51.

Hutchinson A, Estabrooks C. Theories of KT: educational theories. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge translation in health care. Oxford: Wiley/Blackwell; 2009.

52.

Heifetz R, Linsky M, Grashow A. Practice of adaptive leadership: tools and tactics for changing your organization and the world. Boston: Harvard Business Review Press; 2009.

53.

Knowles MS, Holton EF, Holton E, Swanson RA. The adult learner: the definitive classic in adult education and human resource development. New York: Routledge; 2005.

54.

Sachdeva AK. Use of effective feedback to facilitate adult learning. J Cancer Educ. 1996;11(2):106–18.PubMed

55.

Wandersman A, Chien VH, Katz J. Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Community Psychol. 2012;50:445–59.CrossRefPubMed

56.

Leeman J, Calancie L, Hartman MA, Escoffery CT, Herrmann AK, Tague LE, et al. What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: a systematic review. Implement Sci. 2015;10:80.CrossRefPubMedPubMedCentral

57.

Practicing knowledge translation. 2015. Accessed 30 Mar 2018.

58.

Bandura A. Social learning theory. General Learning Corporation. New York City: General Learning Press; 1971.

Title: Longitudinal evaluation of a course to build core competencies in implementation practice
Authors: Julia E. Moore
Shusmita Rashid
Jamie S. Park
Sobia Khan
Sharon E. Straus
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-018-0800-3

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Longitudinal evaluation of a course to build core competencies in implementation practice

Abstract

Background

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2018

Impact of patient involvement on clinical practice guideline development: a parallel group study

“I had to somehow still be flexible”: exploring adaptations during implementation of brief cognitive behavioral therapy in primary care

Barriers and facilitators to implementing evidence-based interventions among third sector organisations: a systematic review

De-implementation of low value castration for men with prostate cancer: protocol for a theory-based, mixed methods approach to minimizing low value androgen deprivation therapy (DeADT)

Cluster randomised controlled trial of a theory-based multiple behaviour change intervention aimed at healthcare professionals to improve their management of type 2 diabetes in primary care

Applying modern measurement approaches to constructs relevant to evidence-based practice among Canadian physical and occupational therapists