Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches

Authors: François Champagne, Louise Lemieux-Charles, Marie-France Duranceau, Gail MacKean, Trish Reay

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change.

Methods

We conducted a theory-driven evaluation of the organizational impact of healthcare leaders’ participation in two training programs using a logic model based on Nonaka’s theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed.

Results

We found that the impact of training could primarily be felt in trainees’ immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members.

Conclusions

Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence—both positive and negative—of specific organizational factors on extending the impact of training programs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Davidson EJ: Ascertaining causality in theory-based evaluation. Program Theory in Evaluation Challenges and Opportunities: New Directions. Edited by: Rogers PJ, Hasci TA, Petrosino A, Huebner TA. 2000, San Francisco: Jossey-Bass, 18- Davidson EJ: Ascertaining causality in theory-based evaluation. Program Theory in Evaluation Challenges and Opportunities: New Directions. Edited by: Rogers PJ, Hasci TA, Petrosino A, Huebner TA. 2000, San Francisco: Jossey-Bass, 18-
2.
go back to reference Von Krogh G, Nonaka I, Rechsteiner L: Leadership in organizational knowledge creation: a review and framework. J Manag Studies. 2012, 49 (1): 240-277. 10.1111/j.1467-6486.2010.00978.x.CrossRef Von Krogh G, Nonaka I, Rechsteiner L: Leadership in organizational knowledge creation: a review and framework. J Manag Studies. 2012, 49 (1): 240-277. 10.1111/j.1467-6486.2010.00978.x.CrossRef
3.
go back to reference Nonaka I, Toyama R, Konno N: SECI, ba and leadership: a unified model of dynamic knowledge creation. Long Range Plann. 2000, 33 (1): 5-34. 10.1016/S0024-6301(99)00115-6.CrossRef Nonaka I, Toyama R, Konno N: SECI, ba and leadership: a unified model of dynamic knowledge creation. Long Range Plann. 2000, 33 (1): 5-34. 10.1016/S0024-6301(99)00115-6.CrossRef
4.
5.
go back to reference Lavis J, Davies H, Oxman A, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48. 10.1258/1355819054308549.CrossRefPubMed Lavis J, Davies H, Oxman A, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48. 10.1258/1355819054308549.CrossRefPubMed
6.
go back to reference Denis J-L, Lomas J, Stipich N: Creating receptor capacity for research in the health system: the Executive Training for Research Application (EXTRA) program in Canada. J Health Serv Res Policy. 2008, 1 (Suppl 1): 1-7.CrossRef Denis J-L, Lomas J, Stipich N: Creating receptor capacity for research in the health system: the Executive Training for Research Application (EXTRA) program in Canada. J Health Serv Res Policy. 2008, 1 (Suppl 1): 1-7.CrossRef
8.
go back to reference Nonaka I: A dynamic theory of organizational knowledge creation. Organization Science. 1994, 5 (1): 14-37. 10.1287/orsc.5.1.14.CrossRef Nonaka I: A dynamic theory of organizational knowledge creation. Organization Science. 1994, 5 (1): 14-37. 10.1287/orsc.5.1.14.CrossRef
9.
go back to reference Nonaka I, Takeuchi H: A theory of the firm, a knowledge-creation dynamics. The Dynamic Firm: The Role of Technology, Strategy, Organization and Regions. Edited by: Dupont Chandler A, Hagstrom H, Solvell O. 1999, Oxford: Oxford University Press, 214-241.CrossRef Nonaka I, Takeuchi H: A theory of the firm, a knowledge-creation dynamics. The Dynamic Firm: The Role of Technology, Strategy, Organization and Regions. Edited by: Dupont Chandler A, Hagstrom H, Solvell O. 1999, Oxford: Oxford University Press, 214-241.CrossRef
10.
go back to reference Nonaka I, Toyama R, Byosière P: A theory of organizational knowledge creation: understanding the dynamic process of creating knowledge. Handbook of Organizational Learning and Knowledge. Edited by: Dierkes M, Antal AB, Child J, Nonaka I. 2001, Oxford: Oxford University Press, 491-518. Nonaka I, Toyama R, Byosière P: A theory of organizational knowledge creation: understanding the dynamic process of creating knowledge. Handbook of Organizational Learning and Knowledge. Edited by: Dierkes M, Antal AB, Child J, Nonaka I. 2001, Oxford: Oxford University Press, 491-518.
11.
go back to reference Nonaka I, Von Krogh G: Perspective, a tacit knowledge and knowledge conversion: controversy and advancement in organizational knowledge creation theory. Organization Science. 2009, 20 (3): 635-652. 10.1287/orsc.1080.0412.CrossRef Nonaka I, Von Krogh G: Perspective, a tacit knowledge and knowledge conversion: controversy and advancement in organizational knowledge creation theory. Organization Science. 2009, 20 (3): 635-652. 10.1287/orsc.1080.0412.CrossRef
12.
go back to reference Patton MQ: Toward distinguishing empowerment evaluation and placing it in a larger context. Eval Pract. 1997, 18 (2): 147-163. 10.1016/S0886-1633(97)90019-2.CrossRef Patton MQ: Toward distinguishing empowerment evaluation and placing it in a larger context. Eval Pract. 1997, 18 (2): 147-163. 10.1016/S0886-1633(97)90019-2.CrossRef
13.
go back to reference Patton MQ: Discovering process use. Evaluation. 1998, 4 (2): 225-233. 10.1177/13563899822208437.CrossRef Patton MQ: Discovering process use. Evaluation. 1998, 4 (2): 225-233. 10.1177/13563899822208437.CrossRef
14.
go back to reference Cousins J, Goh S, Clark S, Lee L: Integrating evaluative inquiry into the organizational culture: a review and synthesis of the knowledge base. Can J Program Eval. 2004, 19: 99-141. Cousins J, Goh S, Clark S, Lee L: Integrating evaluative inquiry into the organizational culture: a review and synthesis of the knowledge base. Can J Program Eval. 2004, 19: 99-141.
15.
go back to reference Champagne F, Lemieux-Charles L, McGuire W: Introduction: towards a broader understanding of the use of knowledge and evidence in health care. Using Knowledge and Evidence in Health Care. Edited by: Lemieux-Charles L, Champagne F. 2004, Toronto: University of Toronto Press, 3-17. Champagne F, Lemieux-Charles L, McGuire W: Introduction: towards a broader understanding of the use of knowledge and evidence in health care. Using Knowledge and Evidence in Health Care. Edited by: Lemieux-Charles L, Champagne F. 2004, Toronto: University of Toronto Press, 3-17.
16.
go back to reference Nonaka I, Toyama R: The knowledge-creating theory revisited: knowledge creation as a synthesizing process. KMRP. 2003, 1 (1): 2-10. Nonaka I, Toyama R: The knowledge-creating theory revisited: knowledge creation as a synthesizing process. KMRP. 2003, 1 (1): 2-10.
17.
go back to reference Nonaka I, Konno N, Toyama R: Emergence of ba. Knowledge Emergence: Social, Technical, and Evolutionary Dimensions of Knowledge Creation. Edited by: Nonaka I, Nishiguchi T. 2001, New York: Oxford University Press, 13-29. Nonaka I, Konno N, Toyama R: Emergence of ba. Knowledge Emergence: Social, Technical, and Evolutionary Dimensions of Knowledge Creation. Edited by: Nonaka I, Nishiguchi T. 2001, New York: Oxford University Press, 13-29.
18.
go back to reference Polanyi M: The growth of science in society. Minerva. 1967, 5 (4): 533-545. 10.1007/BF01096782.CrossRef Polanyi M: The growth of science in society. Minerva. 1967, 5 (4): 533-545. 10.1007/BF01096782.CrossRef
19.
go back to reference Alavi M, Leidner D: Review: knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Quarterly. 2001, 25 (1): 110-CrossRef Alavi M, Leidner D: Review: knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Quarterly. 2001, 25 (1): 110-CrossRef
20.
go back to reference Burns T, Stalker GM: The Management of Innovation. 1961, Urbana-Champaign: University of Illinois at Urbana-Champaign’s Academy for Entrepreneurial Leadership Historical Reference in Entrepreneurship Burns T, Stalker GM: The Management of Innovation. 1961, Urbana-Champaign: University of Illinois at Urbana-Champaign’s Academy for Entrepreneurial Leadership Historical Reference in Entrepreneurship
21.
go back to reference Tannenbaum AS: Control in Organizations. 1968, New York: McGraw-Hill Tannenbaum AS: Control in Organizations. 1968, New York: McGraw-Hill
22.
go back to reference Simon Herbert A: ‘Making management decisions: the role of intuition and emotion.’. Acad Manage Exec. 1987, 1.1: 57-64.CrossRef Simon Herbert A: ‘Making management decisions: the role of intuition and emotion.’. Acad Manage Exec. 1987, 1.1: 57-64.CrossRef
23.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
25.
go back to reference Carroll JS, Edmondson AC: Leading organisational learning in health care. Qual Saf Health Care. 2002, 11 (1): 51-56. 10.1136/qhc.11.1.51.CrossRefPubMed Carroll JS, Edmondson AC: Leading organisational learning in health care. Qual Saf Health Care. 2002, 11 (1): 51-56. 10.1136/qhc.11.1.51.CrossRefPubMed
26.
go back to reference Mintzberg H: B. W. Ahlstrand, and Joseph Lampel. ‘Strategy Safari: The Complete Guide Through the Wilds of Strategic Management. 1998, Harlow (UK): Financial Times Mintzberg H: B. W. Ahlstrand, and Joseph Lampel. ‘Strategy Safari: The Complete Guide Through the Wilds of Strategic Management. 1998, Harlow (UK): Financial Times
28.
go back to reference Garvin DA: Learning in Action: A Guide to Putting the Learning Organization to Work. 2000, Cambridge, MA: Harvard Business School Press Garvin DA: Learning in Action: A Guide to Putting the Learning Organization to Work. 2000, Cambridge, MA: Harvard Business School Press
29.
go back to reference Barley SR: Images of imaging: notes on doing longitudinal field work. Org Sci. 1990, 1 (3): 220-247. 10.1287/orsc.1.3.220.CrossRef Barley SR: Images of imaging: notes on doing longitudinal field work. Org Sci. 1990, 1 (3): 220-247. 10.1287/orsc.1.3.220.CrossRef
30.
go back to reference Yin RK: Designing case studies. Case Study Research: Design and Methods. Edited by: Yin RK. 2003, Thousand Oaks, CA: Sage, 19-56. Yin RK: Designing case studies. Case Study Research: Design and Methods. Edited by: Yin RK. 2003, Thousand Oaks, CA: Sage, 19-56.
31.
go back to reference Anderson M: Lavoie-Tremblay: Evaluation of the Executive Training for Research Application (EXTRA) program: design and early findings. Healthc Policy. 2008, 4 (2): 136-148. Anderson M: Lavoie-Tremblay: Evaluation of the Executive Training for Research Application (EXTRA) program: design and early findings. Healthc Policy. 2008, 4 (2): 136-148.
32.
go back to reference Nonaka I, Von Krogh G, Voelpel S: Organizational knowledge creation theory: evolutionary paths and future advances. Org Studies. 2006, 27 (8): 1179-1208. 10.1177/0170840606066312.CrossRef Nonaka I, Von Krogh G, Voelpel S: Organizational knowledge creation theory: evolutionary paths and future advances. Org Studies. 2006, 27 (8): 1179-1208. 10.1177/0170840606066312.CrossRef
33.
go back to reference Fletcher L, Thornhill J: Organizational value in enhancing individual research use capacity: a joint evaluation project led by EXTRA and SEARCH Canada. Healthc Q. 2009, 12 (2): 18-20. 10.12927/hcq.2009.20673.CrossRefPubMed Fletcher L, Thornhill J: Organizational value in enhancing individual research use capacity: a joint evaluation project led by EXTRA and SEARCH Canada. Healthc Q. 2009, 12 (2): 18-20. 10.12927/hcq.2009.20673.CrossRefPubMed
Metadata
Title
Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches
Authors
François Champagne
Louise Lemieux-Charles
Marie-France Duranceau
Gail MacKean
Trish Reay
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-53

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue