Skip to main content
Top
Published in: Health Research Policy and Systems 1/2010

Open Access 01-12-2010 | Review

Systematic review of methods for evaluating healthcare research economic impact

Authors: Bahareh Yazdizadeh, Reza Majdzadeh, Hojat Salmasian

Published in: Health Research Policy and Systems | Issue 1/2010

Login to get access

Abstract

Background

The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes.

Method

An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified.

Results

The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact.

Conclusions

Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies.
Literature
3.
go back to reference Karnon J: Planning the efficient allocation of research funds: an adapted application of a non-parametric Bayesian value of information analysis. Health Policy. 2002, 61 (3): 329-47. 10.1016/S0168-8510(02)00007-6.CrossRefPubMed Karnon J: Planning the efficient allocation of research funds: an adapted application of a non-parametric Bayesian value of information analysis. Health Policy. 2002, 61 (3): 329-47. 10.1016/S0168-8510(02)00007-6.CrossRefPubMed
4.
go back to reference Claxton KP, Sculpher MJ: Using value of information analysis to prioritise health research: some lessons from recent UK experience. Pharmacoeconomics. 2006, 24 (11): 1055-1068. 10.2165/00019053-200624110-00003.CrossRefPubMed Claxton KP, Sculpher MJ: Using value of information analysis to prioritise health research: some lessons from recent UK experience. Pharmacoeconomics. 2006, 24 (11): 1055-1068. 10.2165/00019053-200624110-00003.CrossRefPubMed
5.
go back to reference Coyle D, Grunfeld E, Wells G: The assessment of the economic return from controlled clinical trials. A framework applied to clinical trials of colorectal cancer follow-up. European Journal of Health Economics. 2003, 4 (1): 6-11. 10.1007/s10198-002-0142-5.CrossRefPubMed Coyle D, Grunfeld E, Wells G: The assessment of the economic return from controlled clinical trials. A framework applied to clinical trials of colorectal cancer follow-up. European Journal of Health Economics. 2003, 4 (1): 6-11. 10.1007/s10198-002-0142-5.CrossRefPubMed
6.
go back to reference Fleurence RL, Torgerson DJ: Setting priorities for research. Health Policy. 2004, 69 (1): 1-10. 10.1016/j.healthpol.2003.11.002.CrossRefPubMed Fleurence RL, Torgerson DJ: Setting priorities for research. Health Policy. 2004, 69 (1): 1-10. 10.1016/j.healthpol.2003.11.002.CrossRefPubMed
7.
go back to reference Fleurence RL: Setting priorities for research: a practical application of 'payback' and expected value of information. Health Economics. 2007, 16 (12): 1345-57. 10.1002/hec.1225.CrossRefPubMed Fleurence RL: Setting priorities for research: a practical application of 'payback' and expected value of information. Health Economics. 2007, 16 (12): 1345-57. 10.1002/hec.1225.CrossRefPubMed
8.
go back to reference Townsend J, Buxton M, Harper G: Prioritisation of health technology assessment. The PATHS model: methods and case studies. Health Technology Assessment. 2003, 7 (20): 1-82.CrossRef Townsend J, Buxton M, Harper G: Prioritisation of health technology assessment. The PATHS model: methods and case studies. Health Technology Assessment. 2003, 7 (20): 1-82.CrossRef
9.
go back to reference Murphy K, Topel R: The Economic Value of Medical Research. Paper presented at the. 1999, December Conference on the Economic Value of American's Investment in Medical Research. As presented in Exceptional Returns: The Value of America's Investment in Medical Research Murphy K, Topel R: The Economic Value of Medical Research. Paper presented at the. 1999, December Conference on the Economic Value of American's Investment in Medical Research. As presented in Exceptional Returns: The Value of America's Investment in Medical Research
12.
go back to reference Health Economics Research Group, RAND Europe: Medical Research: What's it worth? Estimating the economic benefits from medical research in the UK. 2008, London:UK Evaluation Forum Health Economics Research Group, RAND Europe: Medical Research: What's it worth? Estimating the economic benefits from medical research in the UK. 2008, London:UK Evaluation Forum
13.
go back to reference Buxton M, Hanney S: How can payback from health research be assessed?. Health Serv Res Policy. 1996, 1: 35-43. Buxton M, Hanney S: How can payback from health research be assessed?. Health Serv Res Policy. 1996, 1: 35-43.
14.
go back to reference Hanney S, Davies A, Buxton M: Assessing benefits from health research projects: can we use questionnaires instead of case studies?. Research Evaluation. 1999, 8 (3): 189-199. 10.3152/147154499781777469.CrossRef Hanney S, Davies A, Buxton M: Assessing benefits from health research projects: can we use questionnaires instead of case studies?. Research Evaluation. 1999, 8 (3): 189-199. 10.3152/147154499781777469.CrossRef
15.
go back to reference Stephen RH, Jonathan G, Steven W, Martin JB: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign'. Health Research Policy and System. 2004, 2 (1): 4-10.1186/1478-4505-2-4.CrossRef Stephen RH, Jonathan G, Steven W, Martin JB: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign'. Health Research Policy and System. 2004, 2 (1): 4-10.1186/1478-4505-2-4.CrossRef
16.
go back to reference Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005, 44 (9): 1145-56. 10.1093/rheumatology/keh708.CrossRefPubMed Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005, 44 (9): 1145-56. 10.1093/rheumatology/keh708.CrossRefPubMed
18.
go back to reference Kwan P, Johnston J, Fung AY, Chong DS, Collins RA, Lo SV: A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Serv Resh. 2007, 7: 121-10.1186/1472-6963-7-121.CrossRef Kwan P, Johnston J, Fung AY, Chong DS, Collins RA, Lo SV: A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Serv Resh. 2007, 7: 121-10.1186/1472-6963-7-121.CrossRef
19.
go back to reference Primary Health Care Research and Information Service: Exploring the impact of primary health care research. Edited by: Kalucy L, Jackson-Bowers E, McIntyre E, Hordacre A-L, Reed R. 2009, [http://www.phcris.org.au] Primary Health Care Research and Information Service: Exploring the impact of primary health care research. Edited by: Kalucy L, Jackson-Bowers E, McIntyre E, Hordacre A-L, Reed R. 2009, [http://​www.​phcris.​org.​au]
23.
go back to reference Kuruvilla S, Mays N, Pleasant A, Walt G: Describing the impact of health research: a Research Impact Framework. BMC Health Services Research. 2006, 6: 134-10.1186/1472-6963-6-134.CrossRefPubMedPubMedCentral Kuruvilla S, Mays N, Pleasant A, Walt G: Describing the impact of health research: a Research Impact Framework. BMC Health Services Research. 2006, 6: 134-10.1186/1472-6963-6-134.CrossRefPubMedPubMedCentral
24.
go back to reference Wells R, Whitworth JA: Assessing outcomes of health and medical research: do we measure what counts or count what we can measure?. Australia & New Zealand Health Policy. 2007, 4: 14-CrossRef Wells R, Whitworth JA: Assessing outcomes of health and medical research: do we measure what counts or count what we can measure?. Australia & New Zealand Health Policy. 2007, 4: 14-CrossRef
25.
go back to reference Siegler M, Weisfeld A, Cronin D: Is medical research cost effective? Response to Murphy and Topel. Perspectives in Biology & Medicine. 2003, 46 (3 Suppl): S129-37.CrossRef Siegler M, Weisfeld A, Cronin D: Is medical research cost effective? Response to Murphy and Topel. Perspectives in Biology & Medicine. 2003, 46 (3 Suppl): S129-37.CrossRef
27.
go back to reference Brown ML, Nayfield SG, Shibley LM: Adjuvant therapy for stage III colon cancer: economics returns to research and cost-effectiveness of treatment. J Natl Cancer Inst. 1994, 86 (6): 424-430. 10.1093/jnci/86.6.424.CrossRefPubMed Brown ML, Nayfield SG, Shibley LM: Adjuvant therapy for stage III colon cancer: economics returns to research and cost-effectiveness of treatment. J Natl Cancer Inst. 1994, 86 (6): 424-430. 10.1093/jnci/86.6.424.CrossRefPubMed
28.
go back to reference Hanney S, Mugford M, Grant J, Buxton M: Assessing the benefits of health research: lessons from research into the use of antenatal corticosteroids for the prevention of neonatal respiratory distress syndrome. Social Science & Medicine. 2005, 60 (5): 937-47.CrossRef Hanney S, Mugford M, Grant J, Buxton M: Assessing the benefits of health research: lessons from research into the use of antenatal corticosteroids for the prevention of neonatal respiratory distress syndrome. Social Science & Medicine. 2005, 60 (5): 937-47.CrossRef
29.
go back to reference Kamper Jorgensen F, Arber S, Berkman L, Mackenbach J, Rosenstock L, Teperi J: International Evaluation of Swedish Public Health Research: Part 3. Scandinavian Journal of Public Health. 2005, 46-84. 10.1080/14034950510033282. supp 65 Kamper Jorgensen F, Arber S, Berkman L, Mackenbach J, Rosenstock L, Teperi J: International Evaluation of Swedish Public Health Research: Part 3. Scandinavian Journal of Public Health. 2005, 46-84. 10.1080/14034950510033282. supp 65
31.
go back to reference Majdzadeh R, Nejat S, Fotouhi A, Malekafzali H: Iran's Approach to Knowledge Translation. Iranian Journal of Public Health. 2009, 38 (Supp 1.1): 58-60. Majdzadeh R, Nejat S, Fotouhi A, Malekafzali H: Iran's Approach to Knowledge Translation. Iranian Journal of Public Health. 2009, 38 (Supp 1.1): 58-60.
32.
go back to reference Croxson B, Hanney S, Buxton M: Routine monitoring of performance: what makes health research and development different?. Journal of Health Services & Research Policy. 2001, 6 (4): 226-232.CrossRef Croxson B, Hanney S, Buxton M: Routine monitoring of performance: what makes health research and development different?. Journal of Health Services & Research Policy. 2001, 6 (4): 226-232.CrossRef
33.
go back to reference Peipert JF: The economic value of medical research: is it worth the investment?. Obstetrics & Gynecology. 2002, 99 (5 Pt 1): 835-840. Peipert JF: The economic value of medical research: is it worth the investment?. Obstetrics & Gynecology. 2002, 99 (5 Pt 1): 835-840.
34.
go back to reference Chattopadhyay SK, Carande-Kulis VG: Economics of prevention: the public health research agenda. J Public Health Manag Pract. 2004, 10 (5): 467-471.CrossRefPubMed Chattopadhyay SK, Carande-Kulis VG: Economics of prevention: the public health research agenda. J Public Health Manag Pract. 2004, 10 (5): 467-471.CrossRefPubMed
35.
go back to reference Garfinkel MS, Sarewitz D, Porter AL: A societal outcomes map for health research and policy. American Journal of Public Health. 2006, 96 (3): 441-446. 10.2105/AJPH.2005.063495.CrossRefPubMedPubMedCentral Garfinkel MS, Sarewitz D, Porter AL: A societal outcomes map for health research and policy. American Journal of Public Health. 2006, 96 (3): 441-446. 10.2105/AJPH.2005.063495.CrossRefPubMedPubMedCentral
36.
go back to reference Weiss AP: Measuring the impact of medical research: moving from outputs to outcomes. American Journal of Psychiatry. 2007, 164 (2): 206-214. 10.1176/appi.ajp.164.2.206.CrossRefPubMed Weiss AP: Measuring the impact of medical research: moving from outputs to outcomes. American Journal of Psychiatry. 2007, 164 (2): 206-214. 10.1176/appi.ajp.164.2.206.CrossRefPubMed
Metadata
Title
Systematic review of methods for evaluating healthcare research economic impact
Authors
Bahareh Yazdizadeh
Reza Majdzadeh
Hojat Salmasian
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2010
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-8-6

Other articles of this Issue 1/2010

Health Research Policy and Systems 1/2010 Go to the issue