Skip to main content
Top
Published in: Health Research Policy and Systems 1/2018

Open Access 01-12-2018 | Research

Measuring research impact: a large cancer research funding programme in Australia

Authors: Jacqueline A. Bowden, Nicole Sargent, Steve Wesselingh, Lincoln Size, Claire Donovan, Caroline L. Miller

Published in: Health Research Policy and Systems | Issue 1/2018

Login to get access

Abstract

Background

Measuring research impact is of critical interest to philanthropic and government funding agencies interested in ensuring that the research they fund is both scientifically excellent and has meaningful impact into health and other outcomes. The Beat Cancer Project (BCP) is a AUD $34 m cancer research funding scheme that commenced in 2011. It was initiated by an Australian charity (Cancer Council SA), and supported by the South Australian Government and the state’s major universities.

Methods

This study applied Buxton and Hanney’s Payback Framework to assess research impact generated from the BCP after 3 years of funding. Data sources were an audit of peer-reviewed publications from January 2011 to September 2014 from Web of Knowledge and a self-report survey of investigators awarded BCP research funding during its first 3 years of implementation (2011–2013). Of the 104 surveys, 92 (88%) were completed.

Results

The BCP performed well across all five categories of the Payback Framework. In terms of knowledge production, 1257 peer-reviewed publications were generated and the mean impact factor of publishing journals increased annually. There were many benefits to future research with 21 respondents (23%) reporting career advancement, and 110 higher degrees obtained or expected (including 84 PhDs). Overall, 52% of funded projects generated tools for future research. The funded research attracted substantial further income yielding a very high rate of leverage. For every AUD $1 that the cancer charity invested, the BCP gained an additional AUD $6.06. Five projects (5%) had informed policy and 5 (5%) informed product development, with an additional 31 (34%) and 35 (38%) projects, respectively, anticipating doing so. In terms of health and sector and broader economic benefits, 8 (9%) projects had influenced practice or behaviour of health staff and 32 (34%) would reportedly to do so in the future.

Conclusions

Research impact was a priority of charity and government funders and led to a deliberate funding strategy. Emphasising research impact while maintaining rigorous, competitive processes can achieve the joint objectives of excellence in research, yielding good research impact and a high rate of leverage for philanthropic and public investment, as indicated by these early results.
Appendix
Available only for authorised users
Literature
2.
go back to reference Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F. GLOBOCAN 2012, V1.0. Cancer Incidence and Mortality Worldwide. Lyon: IARC; 2013. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F. GLOBOCAN 2012, V1.0. Cancer Incidence and Mortality Worldwide. Lyon: IARC; 2013.
3.
go back to reference Westfall J, Mold J, Fagnan L. Practice-based research - "Blue Highways" on the NIH roadmap. JAMA. 2007;297(4):403–6.CrossRefPubMed Westfall J, Mold J, Fagnan L. Practice-based research - "Blue Highways" on the NIH roadmap. JAMA. 2007;297(4):403–6.CrossRefPubMed
4.
go back to reference Green L, Ottoson J, Garcia C, Hiatt R. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009;30:151–74.CrossRefPubMed Green L, Ottoson J, Garcia C, Hiatt R. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009;30:151–74.CrossRefPubMed
5.
go back to reference Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104(12):510–20.CrossRefPubMedPubMedCentral Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104(12):510–20.CrossRefPubMedPubMedCentral
6.
go back to reference Clay MA, Donovan C, Butler L, Oldenburg BF. The returns from cardiovascular research: the impact of the National Heart Foundation of Australia's investment. MJA. 2006;185(4):209–12.PubMed Clay MA, Donovan C, Butler L, Oldenburg BF. The returns from cardiovascular research: the impact of the National Heart Foundation of Australia's investment. MJA. 2006;185(4):209–12.PubMed
8.
go back to reference Buykx P, Humphreys J, Wakerman J, Perkins D, Lyle D, McGrail M, Kinsman L. Making evidence count': a framework to monitor the impact of health services research. Aust J Rural Health. 2012;20(2):51–8.CrossRefPubMed Buykx P, Humphreys J, Wakerman J, Perkins D, Lyle D, McGrail M, Kinsman L. Making evidence count': a framework to monitor the impact of health services research. Aust J Rural Health. 2012;20(2):51–8.CrossRefPubMed
9.
go back to reference Martin BR. The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster? Res Eval. 2011;20(3):247–54.CrossRef Martin BR. The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster? Res Eval. 2011;20(3):247–54.CrossRef
10.
go back to reference Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–33.CrossRefPubMed Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–33.CrossRefPubMed
11.
go back to reference Wooding S, Hanney S, Buxton M, Grant J. Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005;44(9):1145–56.CrossRefPubMed Wooding S, Hanney S, Buxton M, Grant J. Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005;44(9):1145–56.CrossRefPubMed
12.
go back to reference Yazdizadeh B, Majdzadeh R, Janani L, Mohtasham F, Nikooee S, Mousavi A, Najafi F, Atabakzadeh M, Bazrafshan A, Zare M, et al. An assessment of health research impact in Iran. Health Res Policy Syst. 2016;14:56.CrossRefPubMedPubMedCentral Yazdizadeh B, Majdzadeh R, Janani L, Mohtasham F, Nikooee S, Mousavi A, Najafi F, Atabakzadeh M, Bazrafshan A, Zare M, et al. An assessment of health research impact in Iran. Health Res Policy Syst. 2016;14:56.CrossRefPubMedPubMedCentral
13.
go back to reference Raftery J, Hanney S, Greenhalgh T, Glover M, Blatch-Jones A. Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme. Health Technol Assess. 2016;20(76):1–254.CrossRefPubMedPubMedCentral Raftery J, Hanney S, Greenhalgh T, Glover M, Blatch-Jones A. Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme. Health Technol Assess. 2016;20(76):1–254.CrossRefPubMedPubMedCentral
14.
go back to reference Wooding S, Hanney SR, Pollitt A, Grant J, Buxton MJ. Understanding factors associated with the translation of cardiovascular research: a multinational case study approach. Implement Sci. 2014;9:47.CrossRefPubMedPubMedCentral Wooding S, Hanney SR, Pollitt A, Grant J, Buxton MJ. Understanding factors associated with the translation of cardiovascular research: a multinational case study approach. Implement Sci. 2014;9:47.CrossRefPubMedPubMedCentral
15.
go back to reference Hanney SR, Watt A, Jones TH, Metcalf L. Conducting retrospective impact analysis to inform a medical research charity's funding strategies: the case of Asthma UK. Allergy Asthma Clin Immunol. 2013;9(1):17.CrossRefPubMedPubMedCentral Hanney SR, Watt A, Jones TH, Metcalf L. Conducting retrospective impact analysis to inform a medical research charity's funding strategies: the case of Asthma UK. Allergy Asthma Clin Immunol. 2013;9(1):17.CrossRefPubMedPubMedCentral
16.
go back to reference Donovan C, Butler L, Butt AJ, Jones TH, Hanney SR. Evaluation of the impact of National Breast Cancer Foundation-funded research. Med J Aust. 2014;200(4):214–8.CrossRefPubMed Donovan C, Butler L, Butt AJ, Jones TH, Hanney SR. Evaluation of the impact of National Breast Cancer Foundation-funded research. Med J Aust. 2014;200(4):214–8.CrossRefPubMed
17.
go back to reference Donovan C, Hanney S. The 'Payback Framework' explained. Res Eval. 2011;20(3):181–3.CrossRef Donovan C, Hanney S. The 'Payback Framework' explained. Res Eval. 2011;20(3):181–3.CrossRef
Metadata
Title
Measuring research impact: a large cancer research funding programme in Australia
Authors
Jacqueline A. Bowden
Nicole Sargent
Steve Wesselingh
Lincoln Size
Claire Donovan
Caroline L. Miller
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2018
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-018-0311-3

Other articles of this Issue 1/2018

Health Research Policy and Systems 1/2018 Go to the issue