Skip to main content
Top
Published in: Implementation Science 1/2008

Open Access 01-12-2008 | Research article

Evidence-informed health policy 3 – Interviews with the directors of organizations that support the use of research evidence

Authors: John N Lavis, Andrew D Oxman, Ray Moynihan, Elizabeth J Paulsen

Published in: Implementation Science | Issue 1/2008

Login to get access

Abstract

Background

Only a small number of previous efforts to describe the experiences of organizations that produce clinical practice guidelines (CPGs), undertake health technology assessments (HTAs), or directly support the use of research evidence in developing health policy (i.e., government support units, or GSUs) have relied on interviews and then only with HTA agencies. Interviews offer the potential for capturing experiences in great depth, particularly the experiences of organizations that may be under-represented in surveys.

Methods

We purposively sampled organizations from among those who completed a questionnaire in the first phase of our three-phase study, developed and piloted a semi-structured interview guide, and conducted the interviews by telephone, audio-taped them, and took notes simultaneously. Binary or categorical responses to more structured questions were counted when possible. Themes were identified from among responses to semi-structured questions using a constant comparative method of analysis. Illustrative quotations were identified to supplement the narrative description of the themes.

Results

We interviewed the director (or his or her nominee) in 25 organizations, of which 12 were GSUs. Using rigorous methods that are systematic and transparent (sometimes shortened to 'being evidence-based') was the most commonly cited strength among all organizations. GSUs more consistently described their close links with policymakers as a strength, whereas organizations producing CPGs, HTAs, or both had conflicting viewpoints about such close links. With few exceptions, all types of organizations tended to focus largely on weaknesses in implementation, rather than strengths. The advice offered to those trying to establish similar organizations include: 1) collaborate with other organizations; 2) establish strong links with policymakers and stakeholders; 3) be independent and manage conflicts of interest; 4) build capacity; 5) use good methods and be transparent; 6) start small and address important questions; and 7) be attentive to implementation considerations. The advice offered to the World Health Organization (WHO) and other international organizations and networks was to foster collaborations across organizations.

Conclusion

The findings from our interview study, the most broadly based of its kind, extend to both CPG-producing organizations and GSUs the applicability of the messages arising from previous interview studies of HTA agencies, such as to collaborate with other organizations and to be attentive to implementation considerations. Our interview study also provides a rich description of organizations supporting the use of research evidence, which can be drawn upon by those establishing or leading similar organizations in LMICs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lavis JN, Oxman AD, Moynihan R, Paulsen EJ: Evidence-informed health policy 1 – Synthesis of findings from a multi-method study of organizations that support the use of research evidence. Implementation Science. 2008, 3: 53-10.1186/1748-5908-3-53.CrossRefPubMedPubMedCentral Lavis JN, Oxman AD, Moynihan R, Paulsen EJ: Evidence-informed health policy 1 – Synthesis of findings from a multi-method study of organizations that support the use of research evidence. Implementation Science. 2008, 3: 53-10.1186/1748-5908-3-53.CrossRefPubMedPubMedCentral
2.
go back to reference Lavis JN, Paulsen EJ, Oxman AD, Moynihan R: Evidence-informed health policy 2 – Survey of organizations that support the use of research evidence. Implementation Science. 2008, 3: 54-10.1186/1748-5908-3-54.CrossRefPubMedPubMedCentral Lavis JN, Paulsen EJ, Oxman AD, Moynihan R: Evidence-informed health policy 2 – Survey of organizations that support the use of research evidence. Implementation Science. 2008, 3: 54-10.1186/1748-5908-3-54.CrossRefPubMedPubMedCentral
3.
go back to reference Moynihan R, Oxman AD, Lavis JN, Paulsen E: Evidence-Informed Health Policy: Using Research to Make Health Systems Healthier – Report from the Kunnskapssenteret (Norwegian Knowledge Centre for the Health Services), No. 1-2008. 2008, Oslo: Norwegian Knowledge Centre for the Health Services Moynihan R, Oxman AD, Lavis JN, Paulsen E: Evidence-Informed Health Policy: Using Research to Make Health Systems Healthier – Report from the Kunnskapssenteret (Norwegian Knowledge Centre for the Health Services), No. 1-2008. 2008, Oslo: Norwegian Knowledge Centre for the Health Services
4.
go back to reference Audet A, Greenfield S, Field M: Medical practice guidelines: Current activities and future directions. Annals of Internal Medicine. 1990, 113: 709-714.CrossRefPubMed Audet A, Greenfield S, Field M: Medical practice guidelines: Current activities and future directions. Annals of Internal Medicine. 1990, 113: 709-714.CrossRefPubMed
5.
go back to reference McGlynn EA, Kosecoff J, Brook RH: Format and conduct of consensus development conferences. International Journal of Technology Assessment in Health Care. 1990, 6: 450-469.CrossRefPubMed McGlynn EA, Kosecoff J, Brook RH: Format and conduct of consensus development conferences. International Journal of Technology Assessment in Health Care. 1990, 6: 450-469.CrossRefPubMed
6.
go back to reference Grol R, Eccles M, Maisonneuve H, Woolf S: Developing clinical practice guidelines: The European experience. Disease Management and Health Outcomes. 1998, 4: 355-366. 10.2165/00115677-199804050-00002.CrossRef Grol R, Eccles M, Maisonneuve H, Woolf S: Developing clinical practice guidelines: The European experience. Disease Management and Health Outcomes. 1998, 4: 355-366. 10.2165/00115677-199804050-00002.CrossRef
7.
go back to reference Engelbrecht R, Courte-Wienecke S: A Survey on the Current State of Development, Dissemination and Implementation of Guidelines of Clinical Practice in European countries. 1999, Neuherberg: GSF – National Research Center for Environment and Health Engelbrecht R, Courte-Wienecke S: A Survey on the Current State of Development, Dissemination and Implementation of Guidelines of Clinical Practice in European countries. 1999, Neuherberg: GSF – National Research Center for Environment and Health
8.
go back to reference Woolf SH, Grol RP, Hutchinson A, Eccles M, Grimshaw JM: Potential benefits, limitations, and harms of clinical guidelines. British Medical Journal. 1999, 318: 527-530.CrossRefPubMedPubMedCentral Woolf SH, Grol RP, Hutchinson A, Eccles M, Grimshaw JM: Potential benefits, limitations, and harms of clinical guidelines. British Medical Journal. 1999, 318: 527-530.CrossRefPubMedPubMedCentral
9.
go back to reference The Appraisal of Guidelines, Research and Evaluation in Europe (AGREE) Collaborative Group: Guideline development in Europe: An international comparison. International Journal of Technology Assessment in Health Care. 2000, 16: 1039-1049. 10.1017/S0266462300103101.CrossRef The Appraisal of Guidelines, Research and Evaluation in Europe (AGREE) Collaborative Group: Guideline development in Europe: An international comparison. International Journal of Technology Assessment in Health Care. 2000, 16: 1039-1049. 10.1017/S0266462300103101.CrossRef
10.
go back to reference Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J, AGREE Collaboration: Towards evidence-based clinical practice: An international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003, 15: 31-45. 10.1093/intqhc/15.1.31.CrossRefPubMed Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J, AGREE Collaboration: Towards evidence-based clinical practice: An international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003, 15: 31-45. 10.1093/intqhc/15.1.31.CrossRefPubMed
11.
go back to reference Graham ID, Beardall S, Carter AO, Tetroe J, Davies B: The state of the science and art of practice guidelines development, dissemination and evaluation in Canada. Journal of Evaluation in Clinical Practice. 2003, 9: 195-202. 10.1046/j.1365-2753.2003.00385.x.CrossRefPubMed Graham ID, Beardall S, Carter AO, Tetroe J, Davies B: The state of the science and art of practice guidelines development, dissemination and evaluation in Canada. Journal of Evaluation in Clinical Practice. 2003, 9: 195-202. 10.1046/j.1365-2753.2003.00385.x.CrossRefPubMed
12.
go back to reference Perry S, Gardner E, Thamer M: The status of health technology assessment worldwide: Results of an international survey. International Journal of Technology Assessment in Health Care. 1997, 13: 81-98.CrossRefPubMed Perry S, Gardner E, Thamer M: The status of health technology assessment worldwide: Results of an international survey. International Journal of Technology Assessment in Health Care. 1997, 13: 81-98.CrossRefPubMed
13.
go back to reference Perry S, Thamer M: Health technology assessment: Decentralized and fragmented in the US compared to other countries. Health Policy. 1997, 40: 177-198. 10.1016/S0168-8510(97)00897-X.CrossRefPubMed Perry S, Thamer M: Health technology assessment: Decentralized and fragmented in the US compared to other countries. Health Policy. 1997, 40: 177-198. 10.1016/S0168-8510(97)00897-X.CrossRefPubMed
14.
go back to reference Sassi F: The European way to health technology assessment. Lessons from an evaluation of EUR-ASSESS. International Journal of Technology Assessment in Health Care. 2000, 16: 282-290. 10.1017/S0266462300161240.CrossRefPubMed Sassi F: The European way to health technology assessment. Lessons from an evaluation of EUR-ASSESS. International Journal of Technology Assessment in Health Care. 2000, 16: 282-290. 10.1017/S0266462300161240.CrossRefPubMed
15.
go back to reference Hastings J, Adams EJ: Joint project of the international network of agencies for health technology assessment – Part 1: Survey results on diffusion, assessment, and clinical use of positron emission tomography. International Journal of Technology Assessment in Health Care. 2006, 22: 143-148. 10.1017/S026646230605094X.CrossRefPubMed Hastings J, Adams EJ: Joint project of the international network of agencies for health technology assessment – Part 1: Survey results on diffusion, assessment, and clinical use of positron emission tomography. International Journal of Technology Assessment in Health Care. 2006, 22: 143-148. 10.1017/S026646230605094X.CrossRefPubMed
16.
go back to reference Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J: How can research organizations more effectively transfer research knowledge to decision makers?. Milbank Quarterly. 2003, 81: 221-248. 10.1111/1468-0009.t01-1-00052.CrossRefPubMedPubMedCentral Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J: How can research organizations more effectively transfer research knowledge to decision makers?. Milbank Quarterly. 2003, 81: 221-248. 10.1111/1468-0009.t01-1-00052.CrossRefPubMedPubMedCentral
17.
go back to reference McDaid D: Co-ordinating health technology assessment in Canada: A European perspective. Health Policy. 2003, 63: 205-213. 10.1016/S0168-8510(02)00067-2.CrossRefPubMed McDaid D: Co-ordinating health technology assessment in Canada: A European perspective. Health Policy. 2003, 63: 205-213. 10.1016/S0168-8510(02)00067-2.CrossRefPubMed
18.
go back to reference Lehoux P, Tailliez S, Denis J-L, Hivon M: Redefining health technology assessment in Canada: Diversification of producers and contextualization of findings. International Journal of Technology Assessment in Health Care. 2004, 20: 325-336. 10.1017/S026646230400114X.CrossRefPubMed Lehoux P, Tailliez S, Denis J-L, Hivon M: Redefining health technology assessment in Canada: Diversification of producers and contextualization of findings. International Journal of Technology Assessment in Health Care. 2004, 20: 325-336. 10.1017/S026646230400114X.CrossRefPubMed
19.
go back to reference Hivon M, Lehoux P, Denis J-L, Tailliez S: Use of health technology assessment in decision making: Coresponsibility of users and producers?. International Journal of Technology Assessment in Health Care. 2005, 21: 268-275.PubMed Hivon M, Lehoux P, Denis J-L, Tailliez S: Use of health technology assessment in decision making: Coresponsibility of users and producers?. International Journal of Technology Assessment in Health Care. 2005, 21: 268-275.PubMed
20.
go back to reference Lehoux P, Denis J-L, Tailliez S, Hivon M: Dissemination of health technology assessment: Identifying the visions guiding an evolving policy innovation in Canada. Journal of Health Politics, Policy and Law. 2005, 30: 603-641. 10.1215/03616878-30-4-603.CrossRefPubMed Lehoux P, Denis J-L, Tailliez S, Hivon M: Dissemination of health technology assessment: Identifying the visions guiding an evolving policy innovation in Canada. Journal of Health Politics, Policy and Law. 2005, 30: 603-641. 10.1215/03616878-30-4-603.CrossRefPubMed
21.
go back to reference Lavis JN, Moynihan R, Oxman AD, Paulsen EJ: Evidence-informed health policy 4 – Case descriptions of organizations that support the use of research evidence. Implementation Science. 2008, 3: 56-10.1186/1748-5908-3-56.CrossRefPubMedPubMedCentral Lavis JN, Moynihan R, Oxman AD, Paulsen EJ: Evidence-informed health policy 4 – Case descriptions of organizations that support the use of research evidence. Implementation Science. 2008, 3: 56-10.1186/1748-5908-3-56.CrossRefPubMedPubMedCentral
22.
go back to reference Lavis JN, Davies HTO, Oxman AD, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. Journal of Health Services Research and Policy. 2005, 10: S1:35-S1:48. 10.1258/1355819054308549.CrossRef Lavis JN, Davies HTO, Oxman AD, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. Journal of Health Services Research and Policy. 2005, 10: S1:35-S1:48. 10.1258/1355819054308549.CrossRef
Metadata
Title
Evidence-informed health policy 3 – Interviews with the directors of organizations that support the use of research evidence
Authors
John N Lavis
Andrew D Oxman
Ray Moynihan
Elizabeth J Paulsen
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2008
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-3-55

Other articles of this Issue 1/2008

Implementation Science 1/2008 Go to the issue