Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Understanding factors associated with the translation of cardiovascular research: a multinational case study approach

Authors: Steven Wooding, Stephen R Hanney, Alexandra Pollitt, Jonathan Grant, Martin J Buxton

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Funders of health research increasingly seek to understand how best to allocate resources in order to achieve maximum value from their funding. We built an international consortium and developed a multinational case study approach to assess benefits arising from health research. We used that to facilitate analysis of factors in the production of research that might be associated with translating research findings into wider impacts, and the complexities involved.

Methods

We built on the Payback Framework and expanded its application through conducting co-ordinated case studies on the payback from cardiovascular and stroke research in Australia, Canada and the United Kingdom. We selected a stratified random sample of projects from leading medical research funders. We devised a series of innovative steps to: minimize the effect of researcher bias; rate the level of impacts identified in the case studies; and interrogate case study narratives to identify factors that correlated with achieving high or low levels of impact.

Results

Twenty-nine detailed case studies produced many and diverse impacts. Over the 15 to 20 years examined, basic biomedical research has a greater impact than clinical research in terms of academic impacts such as knowledge production and research capacity building. Clinical research has greater levels of wider impact on health policies, practice, and generating health gains. There was no correlation between knowledge production and wider impacts. We identified various factors associated with high impact. Interaction between researchers and practitioners and the public is associated with achieving high academic impact and translation into wider impacts, as is basic research conducted with a clinical focus. Strategic thinking by clinical researchers, in terms of thinking through pathways by which research could potentially be translated into practice, is associated with high wider impact. Finally, we identified the complexity of factors behind research translation that can arise in a single case.

Conclusions

We can systematically assess research impacts and use the findings to promote translation. Research funders can justify funding research of diverse types, but they should not assume academic impacts are proxies for wider impacts. They should encourage researchers to consider pathways towards impact and engage potential research users in research processes.
Literature
1.
go back to reference UK Evaluation Forum: Medical Research: Assessing the Benefits to Society. 2006, London: UK Evaluation Forum UK Evaluation Forum: Medical Research: Assessing the Benefits to Society. 2006, London: UK Evaluation Forum
2.
go back to reference Banzi R, Moja L, Pistotti V, Facchini A, Liberati A: Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011, 9: 26-10.1186/1478-4505-9-26.CrossRefPubMedPubMedCentral Banzi R, Moja L, Pistotti V, Facchini A, Liberati A: Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011, 9: 26-10.1186/1478-4505-9-26.CrossRefPubMedPubMedCentral
3.
go back to reference Marburger JH: Wanted: better benchmarks. Science. 2005, 308 (5725): 1087-1087. 10.1126/science.1114801.CrossRefPubMed Marburger JH: Wanted: better benchmarks. Science. 2005, 308 (5725): 1087-1087. 10.1126/science.1114801.CrossRefPubMed
5.
go back to reference Ward V, House A, Hamer S: Developing a framework for transferring knowledge into action: a thematic analysis of the literature. J Health Serv Res Policy. 2009, 14 (3): 156-164. 10.1258/jhsrp.2009.008120.CrossRefPubMedPubMedCentral Ward V, House A, Hamer S: Developing a framework for transferring knowledge into action: a thematic analysis of the literature. J Health Serv Res Policy. 2009, 14 (3): 156-164. 10.1258/jhsrp.2009.008120.CrossRefPubMedPubMedCentral
6.
7.
go back to reference Wilson PM, Petticrew M, Calnan MW, Nazareth I: Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010, 5: 91-10.1186/1748-5908-5-91.CrossRefPubMedPubMedCentral Wilson PM, Petticrew M, Calnan MW, Nazareth I: Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010, 5: 91-10.1186/1748-5908-5-91.CrossRefPubMedPubMedCentral
8.
go back to reference Squires JE, Estabrooks C, Gustavsson P, Wallin L: Individual determinants of research utilization by nurses: a systematic review update. Implement Sci. 2011, 6: 1-10.1186/1748-5908-6-1.CrossRefPubMedPubMedCentral Squires JE, Estabrooks C, Gustavsson P, Wallin L: Individual determinants of research utilization by nurses: a systematic review update. Implement Sci. 2011, 6: 1-10.1186/1748-5908-6-1.CrossRefPubMedPubMedCentral
9.
go back to reference Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, Durieux P, Légaré F, Nielson CP, Adily A, Ward JE, Porter C, Shea B, Grimshaw JM: Health research funding agencies’ support and promotion of knowledge translation: an international study. Milbank Q. 2008, 86 (1): 125-155. 10.1111/j.1468-0009.2007.00515.x.CrossRefPubMedPubMedCentral Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, Durieux P, Légaré F, Nielson CP, Adily A, Ward JE, Porter C, Shea B, Grimshaw JM: Health research funding agencies’ support and promotion of knowledge translation: an international study. Milbank Q. 2008, 86 (1): 125-155. 10.1111/j.1468-0009.2007.00515.x.CrossRefPubMedPubMedCentral
10.
go back to reference Buxton M, Hanney S: How can payback from health services research be assessed?. J Health Serv Res Policy. 1996, 1 (1): 35-43.PubMed Buxton M, Hanney S: How can payback from health services research be assessed?. J Health Serv Res Policy. 1996, 1 (1): 35-43.PubMed
11.
go back to reference Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005, 44 (9): 1145-1156. 10.1093/rheumatology/keh708.CrossRefPubMed Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005, 44 (9): 1145-1156. 10.1093/rheumatology/keh708.CrossRefPubMed
12.
go back to reference Kuruvilla S, Mays N, Walt G: Describing the impact of health services and policy research. J Health Serv Res Policy. 2007, 12 (Suppl 1): S21-S31.CrossRef Kuruvilla S, Mays N, Walt G: Describing the impact of health services and policy research. J Health Serv Res Policy. 2007, 12 (Suppl 1): S21-S31.CrossRef
13.
go back to reference Hanney S, Buxton M, Green C, Coulson D, Raftery J: An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007, 11: 53-CrossRef Hanney S, Buxton M, Green C, Coulson D, Raftery J: An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007, 11: 53-CrossRef
14.
go back to reference Oortwijn WJ, Hanney SR, Ligtvoet A, Hoorens S, Wooding S, Grant J, Buxton MJ, Bouter LM: Assessing the impact of health technology assessment in the Netherlands. Int J Technol Assess Health Care. 2008, 24 (3): 259-269.CrossRefPubMed Oortwijn WJ, Hanney SR, Ligtvoet A, Hoorens S, Wooding S, Grant J, Buxton MJ, Bouter LM: Assessing the impact of health technology assessment in the Netherlands. Int J Technol Assess Health Care. 2008, 24 (3): 259-269.CrossRefPubMed
15.
go back to reference Solans-Domènech M, Adam P, Guillamón I, Permanyer-Miralda G, Pons JMV, Escarrabill J: Impact of clinical and health services research projects on decision-making: a qualitative study. Health Res Policy Syst. 2013, 11: 15-10.1186/1478-4505-11-15.CrossRefPubMedPubMedCentral Solans-Domènech M, Adam P, Guillamón I, Permanyer-Miralda G, Pons JMV, Escarrabill J: Impact of clinical and health services research projects on decision-making: a qualitative study. Health Res Policy Syst. 2013, 11: 15-10.1186/1478-4505-11-15.CrossRefPubMedPubMedCentral
16.
go back to reference Hanney SR, Watt A, Jones TH, Metcalf L: Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: the case of Asthma UK. All Asth Clin Immun. 2013, 9: 17-10.1186/1710-1492-9-17.CrossRef Hanney SR, Watt A, Jones TH, Metcalf L: Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: the case of Asthma UK. All Asth Clin Immun. 2013, 9: 17-10.1186/1710-1492-9-17.CrossRef
17.
go back to reference Lavis J, Ross S, Hurley J, Hohenadel J, Stoddart G, Woodward C, Abelson J: Examining the role of health services research in public policymaking. Milbank Q. 2002, 80: 125-154. 10.1111/1468-0009.00005.CrossRefPubMedPubMedCentral Lavis J, Ross S, Hurley J, Hohenadel J, Stoddart G, Woodward C, Abelson J: Examining the role of health services research in public policymaking. Milbank Q. 2002, 80: 125-154. 10.1111/1468-0009.00005.CrossRefPubMedPubMedCentral
18.
go back to reference Comroe JH, Dripps RD: Scientific basis for support of biomedical science. Science. 1976, 192 (4235): 105-111. 10.1126/science.769161.CrossRefPubMed Comroe JH, Dripps RD: Scientific basis for support of biomedical science. Science. 1976, 192 (4235): 105-111. 10.1126/science.769161.CrossRefPubMed
19.
go back to reference Health Economics Research Group, Office of Health Economics, RAND Europe: Medical Research: What’s it worth? Estimating the economic benefits from medical research in the UK. 2008, London: UK Evaluation Forum Health Economics Research Group, Office of Health Economics, RAND Europe: Medical Research: What’s it worth? Estimating the economic benefits from medical research in the UK. 2008, London: UK Evaluation Forum
23.
go back to reference Hanney SR, Home PD, Frame I, Grant J, Green P, Buxton MJ: Identifying the impact of diabetes research. Diabetic Med. 2006, 23 (2): 176-184. 10.1111/j.1464-5491.2005.01753.x.CrossRefPubMed Hanney SR, Home PD, Frame I, Grant J, Green P, Buxton MJ: Identifying the impact of diabetes research. Diabetic Med. 2006, 23 (2): 176-184. 10.1111/j.1464-5491.2005.01753.x.CrossRefPubMed
24.
go back to reference Yin RK: Case Study Research: Design and Methods. 2003, Thousand Oaks, Ca: Sage Publications Yin RK: Case Study Research: Design and Methods. 2003, Thousand Oaks, Ca: Sage Publications
25.
go back to reference Boaz A, Fitzpatrick S, Shaw B: Assessing the impact of research on policy: a literature review. Sci Public Policy. 2009, 36 (4): 255-270. 10.3152/030234209X436545.CrossRef Boaz A, Fitzpatrick S, Shaw B: Assessing the impact of research on policy: a literature review. Sci Public Policy. 2009, 36 (4): 255-270. 10.3152/030234209X436545.CrossRef
26.
go back to reference Donovan C, Hanney S: The ‘Payback Framework’ explained. Res Eval. 2011, 20 (3): 181-183. 10.3152/095820211X13118583635756.CrossRef Donovan C, Hanney S: The ‘Payback Framework’ explained. Res Eval. 2011, 20 (3): 181-183. 10.3152/095820211X13118583635756.CrossRef
27.
go back to reference Kogan M, Henkel M: Government and Research:The Rothschild Experiment in a Government Department. 1983, London: Heinemann Kogan M, Henkel M: Government and Research:The Rothschild Experiment in a Government Department. 1983, London: Heinemann
28.
go back to reference Innvær S, Vist G, Trommald M, Oxman A: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.CrossRefPubMed Innvær S, Vist G, Trommald M, Oxman A: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.CrossRefPubMed
29.
go back to reference Hanney SR, González-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2-10.1186/1478-4505-1-2.CrossRefPubMedPubMedCentral Hanney SR, González-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2-10.1186/1478-4505-1-2.CrossRefPubMedPubMedCentral
30.
go back to reference Denis J, Lomas J: Convergent evolution: the academic and policy roots of collaborative research. J Health Serv Res Policy. 2003, 8 (Suppl 2): 1-6. 10.1258/135581903322405108.CrossRefPubMed Denis J, Lomas J: Convergent evolution: the academic and policy roots of collaborative research. J Health Serv Res Policy. 2003, 8 (Suppl 2): 1-6. 10.1258/135581903322405108.CrossRefPubMed
31.
go back to reference Graham ID, Tetroe JM: Getting evidence into policy and practice: perspective of a health funder. J Can Acad Child Adolesc Psychiatry. 2009, 18: 46-50.PubMedPubMedCentral Graham ID, Tetroe JM: Getting evidence into policy and practice: perspective of a health funder. J Can Acad Child Adolesc Psychiatry. 2009, 18: 46-50.PubMedPubMedCentral
32.
go back to reference Oliver K, Innvær S, Lorenc T, Woodman J, Thomas J: A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014, 14: 2-10.1186/1472-6963-14-2.CrossRefPubMedPubMedCentral Oliver K, Innvær S, Lorenc T, Woodman J, Thomas J: A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014, 14: 2-10.1186/1472-6963-14-2.CrossRefPubMedPubMedCentral
33.
go back to reference Lomas J: Using ‘linkage and exchange’ to move research into policy at a Canadian Foundation. Health Aff. 2000, 19: 236-240. 10.1377/hlthaff.19.3.236.CrossRef Lomas J: Using ‘linkage and exchange’ to move research into policy at a Canadian Foundation. Health Aff. 2000, 19: 236-240. 10.1377/hlthaff.19.3.236.CrossRef
34.
go back to reference Fletcher D, Galloway R, Chamberlain D, Pateman J, Bryant G, Newcombe G: Basics in advanced life support: a role for download audit and metronomes. Resuscitation. 2008, 78: 127-134. 10.1016/j.resuscitation.2008.03.003.CrossRefPubMed Fletcher D, Galloway R, Chamberlain D, Pateman J, Bryant G, Newcombe G: Basics in advanced life support: a role for download audit and metronomes. Resuscitation. 2008, 78: 127-134. 10.1016/j.resuscitation.2008.03.003.CrossRefPubMed
35.
go back to reference Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Gasziou P, Ilott I, Kinmonth ALL, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B: An implementation research agenda. Implement Sci. 2009, 4: 1-7. 10.1186/1748-5908-4-1.CrossRef Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Gasziou P, Ilott I, Kinmonth ALL, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B: An implementation research agenda. Implement Sci. 2009, 4: 1-7. 10.1186/1748-5908-4-1.CrossRef
36.
go back to reference Proctor EK, Powell BJ, McMillen JC: Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013, 8: 139-10.1186/1748-5908-8-139.CrossRefPubMedPubMedCentral Proctor EK, Powell BJ, McMillen JC: Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013, 8: 139-10.1186/1748-5908-8-139.CrossRefPubMedPubMedCentral
37.
go back to reference Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O: Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review. 2005, Oxford: BlackwellCrossRef Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O: Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review. 2005, Oxford: BlackwellCrossRef
38.
go back to reference Coleman JS, Katz E, Menzel H: Medical Innovations: A Diffusion Study. 1966, New York: Bobbs-Merrill Coleman JS, Katz E, Menzel H: Medical Innovations: A Diffusion Study. 1966, New York: Bobbs-Merrill
39.
go back to reference Locock L, Dopson S, Chamber D, Gabbay J: Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001, 53: 745-757. 10.1016/S0277-9536(00)00387-7.CrossRefPubMed Locock L, Dopson S, Chamber D, Gabbay J: Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001, 53: 745-757. 10.1016/S0277-9536(00)00387-7.CrossRefPubMed
40.
go back to reference Nichol G, Stiell IG, Laupacis A, Pham B, DeMaio VJ, Wells GA: A cumulative meta-analysis of the effectiveness of defibrillator-capable emergency medical services for victims of out-of-hospital cardiac arrest. Ann Emerg Med. 1999, 34: 517-525. 10.1016/S0196-0644(99)80054-7.CrossRefPubMed Nichol G, Stiell IG, Laupacis A, Pham B, DeMaio VJ, Wells GA: A cumulative meta-analysis of the effectiveness of defibrillator-capable emergency medical services for victims of out-of-hospital cardiac arrest. Ann Emerg Med. 1999, 34: 517-525. 10.1016/S0196-0644(99)80054-7.CrossRefPubMed
Metadata
Title
Understanding factors associated with the translation of cardiovascular research: a multinational case study approach
Authors
Steven Wooding
Stephen R Hanney
Alexandra Pollitt
Jonathan Grant
Martin J Buxton
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-47

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue