Skip to main content
Top
Published in: Implementation Science 1/2009

Open Access 01-12-2009 | Research article

Is research working for you? validating a tool to examine the capacity of health organizations to use research

Authors: Anita Kothari, Nancy Edwards, Nadia Hamel, Maria Judd

Published in: Implementation Science | Issue 1/2009

Login to get access

Abstract

Background

'Is research working for you? A self-assessment tool and discussion guide for health services management and policy organizations', developed by the Canadian Health Services Research Foundation, is a tool that can help organizations understand their capacity to acquire, assess, adapt, and apply research. Objectives were to: determine whether the tool demonstrated response variability; describe how the tool differentiated between organizations that were known to be lower-end or higher-end research users; and describe the potential usability of the tool.

Methods

Thirty-two focus groups were conducted among four sectors of Canadian health organizations. In the first hour of the focus group, participants individually completed the tool and then derived a group consensus ranking on items. In the second hour, the facilitator asked about overall impressions of the tool, to identify insights that emerged during the review of items on the tool and to elicit comments on research utilization. Discussion data were analyzed qualitatively, and individual and consensus item scores were analyzed using descriptive and non-parametric statistics.

Results

The tool demonstrated good usability and strong response variability. Differences between higher-end and lower-end research use organizations on scores suggested that this tool has adequate discriminant validity. The group discussion based on the tool was the more useful aspect of the exercise, rather than the actual score assigned.

Conclusion

The tool can serve as a catalyst for an important discussion about research use at the organizational level; such a discussion, in and of itself, demonstrates potential as an intervention to encourage processes and supports for research translation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hayward J: Promoting clinical effectiveness: a welcome initiative, but both clinical and health policy need to be based on evidence. BMJ. 1996, 312: 1491-1492.CrossRefPubMedPubMedCentral Hayward J: Promoting clinical effectiveness: a welcome initiative, but both clinical and health policy need to be based on evidence. BMJ. 1996, 312: 1491-1492.CrossRefPubMedPubMedCentral
2.
go back to reference Kazanjian A: How policy informs the evidence. Comprehensive evidence is needed in decision making. BMJ. 2001, 322 (7297): 1304-10.1136/bmj.322.7297.1304.CrossRefPubMedPubMedCentral Kazanjian A: How policy informs the evidence. Comprehensive evidence is needed in decision making. BMJ. 2001, 322 (7297): 1304-10.1136/bmj.322.7297.1304.CrossRefPubMedPubMedCentral
3.
go back to reference Muir Gray JA: Evidence-based healthcare: How to make health policy and management decisions. 1997, London: Churchill Livingstone Muir Gray JA: Evidence-based healthcare: How to make health policy and management decisions. 1997, London: Churchill Livingstone
4.
go back to reference The Bamako call to action: research for health. The Lancet. 2008, 372: 1855-10.1016/S0140-6736(08)61789-4. The Bamako call to action: research for health. The Lancet. 2008, 372: 1855-10.1016/S0140-6736(08)61789-4.
5.
go back to reference World Health Organization: World Report on Knowledge for Better Health: Strengthening Health. Geneva. 2004 World Health Organization: World Report on Knowledge for Better Health: Strengthening Health. Geneva. 2004
6.
go back to reference Fieschi M, Dufour JC, Staccini P, Gouvernet J, Bouhaddou O: Medical decision support systems: old dilemmas and new paradigms? Tracks for successful integration and adoption. Methods Information in Medicine. 2003, 42: 190-198. Fieschi M, Dufour JC, Staccini P, Gouvernet J, Bouhaddou O: Medical decision support systems: old dilemmas and new paradigms? Tracks for successful integration and adoption. Methods Information in Medicine. 2003, 42: 190-198.
7.
go back to reference Peleg M, Tu SW: Decision support, knowledge representation and management in Medicine. IMIA Yearbook of Medical Informatics. 2006, 72-80. Peleg M, Tu SW: Decision support, knowledge representation and management in Medicine. IMIA Yearbook of Medical Informatics. 2006, 72-80.
8.
go back to reference Scott S, Edwards N: Decision Support Simulation Tools for Community Health Policy and Program Decision-Making. 2005, University of Ottawa, Community Health Research Unit Monograph M05-3 Scott S, Edwards N: Decision Support Simulation Tools for Community Health Policy and Program Decision-Making. 2005, University of Ottawa, Community Health Research Unit Monograph M05-3
9.
go back to reference Landry R, Lamari M, Amara N: The extent and determinants of the utilization of university research in government agencies. Public Administration Review. 2003, 63: 192-205. 10.1111/1540-6210.00279.CrossRef Landry R, Lamari M, Amara N: The extent and determinants of the utilization of university research in government agencies. Public Administration Review. 2003, 63: 192-205. 10.1111/1540-6210.00279.CrossRef
10.
go back to reference Bapuji H, Crossan M: From questions to answers: Reviewing organizational learning research. Management Learning. 2004, 35: 397-10.1177/1350507604048270.CrossRef Bapuji H, Crossan M: From questions to answers: Reviewing organizational learning research. Management Learning. 2004, 35: 397-10.1177/1350507604048270.CrossRef
11.
go back to reference Yano EM: The role of organizational research in implementing evidence-based practice: QUERI Series. Implementation Science. 2008, 3: 29-10.1186/1748-5908-3-29.CrossRefPubMedPubMedCentral Yano EM: The role of organizational research in implementing evidence-based practice: QUERI Series. Implementation Science. 2008, 3: 29-10.1186/1748-5908-3-29.CrossRefPubMedPubMedCentral
12.
go back to reference Graham ID, Logan J: Innovations in knowledge transfer and continuity of care. CJNR. 2004, 36: 89-103.PubMed Graham ID, Logan J: Innovations in knowledge transfer and continuity of care. CJNR. 2004, 36: 89-103.PubMed
13.
go back to reference Beyer JM, Trice HM: The utilization process: A conceptual framework and synthesis of empirical findings. Administrative Science Quarterly. 1982, 27: 591-622. 10.2307/2392533.CrossRef Beyer JM, Trice HM: The utilization process: A conceptual framework and synthesis of empirical findings. Administrative Science Quarterly. 1982, 27: 591-622. 10.2307/2392533.CrossRef
14.
go back to reference Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence-based practice: a conceptual framework. Quality in Health Care. 1998, 7: 149-158. 10.1136/qshc.7.3.149.CrossRefPubMedPubMedCentral Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence-based practice: a conceptual framework. Quality in Health Care. 1998, 7: 149-158. 10.1136/qshc.7.3.149.CrossRefPubMedPubMedCentral
15.
go back to reference Greenhalgh T, Robert G, McFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. The Milbank Quarterly. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, McFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic review and recommendations. The Milbank Quarterly. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
16.
go back to reference Damanpour F: Organizational innovation: a meta-analysis of effects of determinants and moderators. Academy of Management Journal. 1991, 34: 555-590. 10.2307/256406.CrossRef Damanpour F: Organizational innovation: a meta-analysis of effects of determinants and moderators. Academy of Management Journal. 1991, 34: 555-590. 10.2307/256406.CrossRef
17.
go back to reference Damanpour F: Organizational complexity and innovation: developing and testing multiple contingency models. Management Sciences. 1996, 42: 693-716. 10.1287/mnsc.42.5.693.CrossRef Damanpour F: Organizational complexity and innovation: developing and testing multiple contingency models. Management Sciences. 1996, 42: 693-716. 10.1287/mnsc.42.5.693.CrossRef
18.
go back to reference Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. International Journal for Quality in Health Care. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. International Journal for Quality in Health Care. 2004, 16: 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed
19.
go back to reference Zahra SA, George G: Absorptive capacity: A review, reconceptualization, and extension. The Academy of Management Review. 2002, 27: 185-203. 10.2307/4134351. Zahra SA, George G: Absorptive capacity: A review, reconceptualization, and extension. The Academy of Management Review. 2002, 27: 185-203. 10.2307/4134351.
20.
go back to reference Walshe K, Rundall TG: Evidence-based management: from theory to practice in health care. The Milbank Quarterly. 2001, 79: 429-457. 10.1111/1468-0009.00214.CrossRefPubMedPubMedCentral Walshe K, Rundall TG: Evidence-based management: from theory to practice in health care. The Milbank Quarterly. 2001, 79: 429-457. 10.1111/1468-0009.00214.CrossRefPubMedPubMedCentral
21.
go back to reference Jones K, Fink R, Vojir C, Pepper G, Hutt E, Clark L, Scott J, Martinez R, Vincent D, Mellis BK: Translation research in long-term care: improving pain management in nursing homes. Worldviews on Evidence-Based Nursing. 2004, 1 (Suppl 1): S13-S20. 10.1111/j.1524-475X.2004.04045.x.CrossRefPubMed Jones K, Fink R, Vojir C, Pepper G, Hutt E, Clark L, Scott J, Martinez R, Vincent D, Mellis BK: Translation research in long-term care: improving pain management in nursing homes. Worldviews on Evidence-Based Nursing. 2004, 1 (Suppl 1): S13-S20. 10.1111/j.1524-475X.2004.04045.x.CrossRefPubMed
22.
go back to reference Lemieux-Charles L, Barnsley J: Using knowledge and evidence in health care: multidisciplinary perspectives. An Innovation Diffusion Perspective on Knowledge and Evidence in Health Care. Edited by: Champagne F. 2004, Toronto: University of Toronto Press, 115-138. Lemieux-Charles L, Barnsley J: Using knowledge and evidence in health care: multidisciplinary perspectives. An Innovation Diffusion Perspective on Knowledge and Evidence in Health Care. Edited by: Champagne F. 2004, Toronto: University of Toronto Press, 115-138.
23.
go back to reference Senge P, Kleiner A, Roberts C, Roth G, Ross R: The Dance of Change: The Challenges to Sustaining Momentum in a Learning Organization. 1999, New York: Doubleday Senge P, Kleiner A, Roberts C, Roth G, Ross R: The Dance of Change: The Challenges to Sustaining Momentum in a Learning Organization. 1999, New York: Doubleday
24.
go back to reference Nonaka I: A dynamic theory of organizational knowledge creation. Organization Science. 1994, 5: 14-37. 10.1287/orsc.5.1.14.CrossRef Nonaka I: A dynamic theory of organizational knowledge creation. Organization Science. 1994, 5: 14-37. 10.1287/orsc.5.1.14.CrossRef
25.
go back to reference Ugolini C, Lewis S: Evidence-based decision making: do we have the right stuff? Backgrounder for discussions of the Self-Audit Tool for Decision Making Organizations. 2000 Ugolini C, Lewis S: Evidence-based decision making: do we have the right stuff? Backgrounder for discussions of the Self-Audit Tool for Decision Making Organizations. 2000
26.
go back to reference Reay T: Making Managerial Health Care Decisions in Complex, High Velocity Environments. 2000, Alberta Heritage Foundation for Medical Research, HTA Initiative #2 Reay T: Making Managerial Health Care Decisions in Complex, High Velocity Environments. 2000, Alberta Heritage Foundation for Medical Research, HTA Initiative #2
27.
go back to reference Pope C, Ziebland S, Mays N: Qualitative research in health care: A nalysing qualitative data. BMJ. 2000, 320 (7227): 114-116. 10.1136/bmj.320.7227.114.CrossRefPubMedPubMedCentral Pope C, Ziebland S, Mays N: Qualitative research in health care: A nalysing qualitative data. BMJ. 2000, 320 (7227): 114-116. 10.1136/bmj.320.7227.114.CrossRefPubMedPubMedCentral
28.
go back to reference Burnett S, Brookes-Rooney A, Keogh W: Brokering knowledge in organizational networks: The SPN approach. Knowledge and Process Management. 2002, 9 (1): 1-11. 10.1002/kpm.133.CrossRef Burnett S, Brookes-Rooney A, Keogh W: Brokering knowledge in organizational networks: The SPN approach. Knowledge and Process Management. 2002, 9 (1): 1-11. 10.1002/kpm.133.CrossRef
Metadata
Title
Is research working for you? validating a tool to examine the capacity of health organizations to use research
Authors
Anita Kothari
Nancy Edwards
Nadia Hamel
Maria Judd
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2009
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-4-46

Other articles of this Issue 1/2009

Implementation Science 1/2009 Go to the issue