Skip to main content
Top
Published in: Health Research Policy and Systems 1/2015

Open Access 01-12-2015 | Research

Views from senior Australian cancer researchers on evaluating the impact of their research: results from a brief survey

Authors: L. G. Gordon, N. Bartley

Published in: Health Research Policy and Systems | Issue 1/2015

Login to get access

Abstract

Background

The interest and activity in measuring and reporting the impact of publicly funded health and medical research has grown rapidly in recent years. Research evaluation typically relies on researchers for much of the information for an impact assessment. However, the acceptability and feasibility of this activity among health researchers is unknown. The aim of this study was to understand the role and opinions of cancer researchers in the growing area of impact evaluation activity, to inform the logistics of a sustainable program of impact evaluation.

Methods

A brief anonymous online survey was administered to 95 current and past grant recipients funded through the external grants program at Cancer Council New South Wales. Eleven survey statements were constructed with Likert responses and supplemented with two open-ended questions. The statements covered the conceptual, attitudinal and practical aspects of impact evaluation. The survey targeted researchers from the full spectrum of cancer control research classifications. Descriptive analyses obtained response frequencies and percentages.

Results

Forty-five cancer researchers completed the survey (response rate 47%) and 77% were Associate Professors or Professors. Responses were polarised for questions relating to engaging with research end-users, perceived time-pressure to collate data, and pressure to produce research outputs. Some researchers emphasised that quality was an important goal over quantity and warned that collecting impact data created incentives and disincentives for researchers.

Conclusion

There was mixed support and acceptance among senior cancer researchers in Australia on their perceived role and engagement with research impact activities. Sole reliance on researchers for collating and reporting impact data may be problematic. Requesting information from researchers could be minimised and confined to final reports and possible verification of externally-led evaluations.
Literature
1.
go back to reference Guthrie S, Wamae W, Diepeveen S, Wooding S, Grant J. Measuring research. A guide to research evaluation frameworks and tools. Santa Monica: RAND Europe; 2013. Contract No.: MG-1217AAMC. Guthrie S, Wamae W, Diepeveen S, Wooding S, Grant J. Measuring research. A guide to research evaluation frameworks and tools. Santa Monica: RAND Europe; 2013. Contract No.: MG-1217AAMC.
2.
go back to reference Kingwell BA, Anderson GP, Duckett SJ, Hoole EA, Jackson-Pulver LR, Khachigian LM, et al. Evaluation of NHMRC funded research completed in 1992, 1997 and 2003: gains in knowledge, health and wealth. Med J Aust. 2006;184(6):282–6.PubMed Kingwell BA, Anderson GP, Duckett SJ, Hoole EA, Jackson-Pulver LR, Khachigian LM, et al. Evaluation of NHMRC funded research completed in 1992, 1997 and 2003: gains in knowledge, health and wealth. Med J Aust. 2006;184(6):282–6.PubMed
3.
go back to reference Donovan C, Butler L, Butt AJ, Jones TH, Hanney SR. Evaluation of the impact of National Breast Cancer Foundation-funded research. Med J Aust. 2014;200(4):214–8.PubMedCrossRef Donovan C, Butler L, Butt AJ, Jones TH, Hanney SR. Evaluation of the impact of National Breast Cancer Foundation-funded research. Med J Aust. 2014;200(4):214–8.PubMedCrossRef
5.
go back to reference Hanney S, Buxton M, Green C, Coulson D, Raftery J. An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007;11(53):iii–iv.PubMedCrossRef Hanney S, Buxton M, Green C, Coulson D, Raftery J. An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007;11(53):iii–iv.PubMedCrossRef
8.
go back to reference Martin BR. The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster? Res Eval. 2011;20(3):247–54.CrossRef Martin BR. The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster? Res Eval. 2011;20(3):247–54.CrossRef
11.
go back to reference Grant J, Brutscher P-B, Kirk SE, Butler L, Wooding S. Capturing Research Impacts. A review of international practice. Santa Monica: RAND Europe; 2010. Contract No.: DB-578. Grant J, Brutscher P-B, Kirk SE, Butler L, Wooding S. Capturing Research Impacts. A review of international practice. Santa Monica: RAND Europe; 2010. Contract No.: DB-578.
13.
go back to reference Panel on Return on Investment in Health Research. Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research. Ottawa: Canadian Academy of Health Sciences; 2009. Panel on Return on Investment in Health Research. Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research. Ottawa: Canadian Academy of Health Sciences; 2009.
14.
go back to reference Chubb J. How does the impact agenda fit with attitudes and ethics that motivate research? In: Denicolo P, editor. Achieving Impact in Research. London: SAGE Publications Ltd; 2014. Chubb J. How does the impact agenda fit with attitudes and ethics that motivate research? In: Denicolo P, editor. Achieving Impact in Research. London: SAGE Publications Ltd; 2014.
Metadata
Title
Views from senior Australian cancer researchers on evaluating the impact of their research: results from a brief survey
Authors
L. G. Gordon
N. Bartley
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2015
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-015-0073-0

Other articles of this Issue 1/2015

Health Research Policy and Systems 1/2015 Go to the issue