Skip to main content
Top
Published in: Systematic Reviews 1/2013

Open Access 01-12-2013 | Methodology

Issues in the incorporation of economic perspectives and evidence into Cochrane reviews

Authors: Ian Shemilt, David McDaid, Kevin Marsh, Catherine Henderson, Evelina Bertranou, Jacqueline Mallander, Mike Drummond, Miranda Mugford, Luke Vale

Published in: Systematic Reviews | Issue 1/2013

Login to get access

Abstract

Background

Methods for systematic reviews of the effects of health interventions have focused mainly on addressing the question of 'What works?’ or 'Is this intervention effective in achieving one or more specific outcomes?’ Addressing the question 'Is it worth it given the resources available?’ has received less attention. This latter question can be addressed by applying an economic lens to the systematic review process.
This paper reflects on the value and desire for the consideration by end users for coverage of an economic perspective in a Cochrane review and outlines two potential approaches and future directions.

Methods

Two frameworks to guide review authors who are seeking to include an economic perspective are outlined. The first involves conducting a full systematic review of economic evaluations that is integrated into a review of intervention effects. The second involves developing a brief economic commentary. The two approaches share a set of common stages but allow the tailoring of the economic component of the Cochrane review to the skills and resources available to the review team.

Results

The number of studies using the methods outlined in the paper is limited, and further examples are needed both to explore the value of these approaches and to further develop them. The rate of progress will hinge on the organisational leadership, capacity and resources available to the CCEMG, author teams and other Cochrane entities. Particular methodological challenges to overcome relate to understanding the key economic trade-offs and casual relationships for a given decision problem and informing the development of evaluations designed to support local decision-makers.

Conclusions

Methods for incorporating economic perspectives and evidence into Cochrane intervention reviews are established. Their role is not to provide a precise estimate of 'cost-effectiveness’ but rather to help end-users of Cochrane reviews to determine the implications of the economic components of reviews for their own specific decisions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cochrane AL: Effectiveness and efficiency: random reflections on health services. 1972, London: Nuffield Provincial Hospitals Trust Cochrane AL: Effectiveness and efficiency: random reflections on health services. 1972, London: Nuffield Provincial Hospitals Trust
2.
go back to reference Marsh K, Chalfin A, Roman JK: What does cost-benefit analysis add to decision making? Evidence from the criminal justice literature. J Exp Criminol. 2008, 4: 117-135. 10.1007/s11292-008-9049-1.CrossRef Marsh K, Chalfin A, Roman JK: What does cost-benefit analysis add to decision making? Evidence from the criminal justice literature. J Exp Criminol. 2008, 4: 117-135. 10.1007/s11292-008-9049-1.CrossRef
3.
go back to reference Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford (UK): Oxford University Press, 3 Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford (UK): Oxford University Press, 3
4.
go back to reference Canadian Agency for Drugs and Technologies in Health: Guidelines for the evaluation of health technologies. 2006, Ottawa: Canadian Agency for Drugs and Technologies in Health, 3 Canadian Agency for Drugs and Technologies in Health: Guidelines for the evaluation of health technologies. 2006, Ottawa: Canadian Agency for Drugs and Technologies in Health, 3
5.
go back to reference Evers S, Goossens M, De Vet H, van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Asses Health care. 2005, 212: 240-245. Evers S, Goossens M, De Vet H, van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: consensus on health economic criteria. Int J Technol Asses Health care. 2005, 212: 240-245.
6.
go back to reference Institute for Quality and Efficiency in Health care (IQWiG): Working paper Modelling. Version 1.0. 2009, Cologne: Institute for Quality and Efficiency in Health Care Institute for Quality and Efficiency in Health care (IQWiG): Working paper Modelling. Version 1.0. 2009, Cologne: Institute for Quality and Efficiency in Health Care
7.
go back to reference National Institute for Health and Clinical Excellence: Guide to the Methods ofTtechnology Appraisal. 2013, London: National Institute for Health and Clinical Excellence National Institute for Health and Clinical Excellence: Guide to the Methods ofTtechnology Appraisal. 2013, London: National Institute for Health and Clinical Excellence
8.
go back to reference National Institute for Health and Clinical Excellence: Methods for the Development of NICE Public Health Guidance. 2012, National Institute for Health and Clinical Excellence National Institute for Health and Clinical Excellence: Methods for the Development of NICE Public Health Guidance. 2012, National Institute for Health and Clinical Excellence
11.
go back to reference MacLehose H, Hilton J, Tovey D: Background paper for The Cochrane Collaboration’s Strategic Session, Paris, France. The Cochrane Library: Revolution or evolution? Shaping the future of Cochrane content. 2012, London: Cochrane Editorial Unit MacLehose H, Hilton J, Tovey D: Background paper for The Cochrane Collaboration’s Strategic Session, Paris, France. The Cochrane Library: Revolution or evolution? Shaping the future of Cochrane content. 2012, London: Cochrane Editorial Unit
12.
go back to reference Shemilt I, Mugford M, Drummond M, Eisenstein E, Mallender J, McDaid D, Vale L, Walker D, The Campbell & Cochrane Economics Methods Group (CCEMG): Economics methods in Cochrane systematic reviews of health promotion and public health related interventions. BMC Med Res Methodol. 2006, 6: 55-10.1186/1471-2288-6-55.CrossRefPubMedPubMedCentral Shemilt I, Mugford M, Drummond M, Eisenstein E, Mallender J, McDaid D, Vale L, Walker D, The Campbell & Cochrane Economics Methods Group (CCEMG): Economics methods in Cochrane systematic reviews of health promotion and public health related interventions. BMC Med Res Methodol. 2006, 6: 55-10.1186/1471-2288-6-55.CrossRefPubMedPubMedCentral
13.
go back to reference Shemilt I, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, McDaid D, Mugford M, Vale L, Walker D: Incorporating economics evidence. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins J, Green S. 2011, Chichester: Hohn Wiley & Sons Shemilt I, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, McDaid D, Mugford M, Vale L, Walker D: Incorporating economics evidence. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins J, Green S. 2011, Chichester: Hohn Wiley & Sons
14.
go back to reference Sculpher M, Pang F, Manca A, Drummond M, Golder S, Urdahl H, Davies L, Eastwood A: Generalisability in economic evaluation studies in healthcare: a review and case studies. Health Technol Assess. 2004, 8: 49-CrossRef Sculpher M, Pang F, Manca A, Drummond M, Golder S, Urdahl H, Davies L, Eastwood A: Generalisability in economic evaluation studies in healthcare: a review and case studies. Health Technol Assess. 2004, 8: 49-CrossRef
15.
go back to reference Anderson R, Shemilt I: Chapter 3: the role of economic perspectives and evidence in systematic review. Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. Edited by: Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C. 2010, Oxford: Wiley-Blackwell Anderson R, Shemilt I: Chapter 3: the role of economic perspectives and evidence in systematic review. Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. Edited by: Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C. 2010, Oxford: Wiley-Blackwell
16.
go back to reference Gough D, Thomas J: Chapter 3: commonality and diversity in reviews. An Introduction to Systematic Reviews. Edited by: Gough D, Oliver S, Thomas J. 2012, London: Sage Gough D, Thomas J: Chapter 3: commonality and diversity in reviews. An Introduction to Systematic Reviews. Edited by: Gough D, Oliver S, Thomas J. 2012, London: Sage
17.
go back to reference Mowatt G, Houston G, Hernandez R, De Verteuil R, Fraser C, Cuthbertson B, Vale L: Systematic review of the clinical effectiveness and cost-effectiveness of oesophageal Doppler monitoring in critically ill and high risk surgical patients. Health Technol Assess. 2009, 13: 7- Mowatt G, Houston G, Hernandez R, De Verteuil R, Fraser C, Cuthbertson B, Vale L: Systematic review of the clinical effectiveness and cost-effectiveness of oesophageal Doppler monitoring in critically ill and high risk surgical patients. Health Technol Assess. 2009, 13: 7-
18.
go back to reference McDaid D, Sassi F: Equity, efficiency and research synthesis. Evidence-Based Decisions and Economics: Health care, social welfare, education and criminal justice. Edited by: Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C. 2010, Oxford: Wiley-Blackwell McDaid D, Sassi F: Equity, efficiency and research synthesis. Evidence-Based Decisions and Economics: Health care, social welfare, education and criminal justice. Edited by: Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C. 2010, Oxford: Wiley-Blackwell
19.
go back to reference Donaldson C, Mugford M, Vale L: From Effectiveness to Efficiency – Health Economics and Systematic Review. 2002, London: BMJ Books Donaldson C, Mugford M, Vale L: From Effectiveness to Efficiency – Health Economics and Systematic Review. 2002, London: BMJ Books
20.
go back to reference Shemilt I, Mugford M, Donaldson C, Vale L, Marsh K: Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. 2010, London: Wiley BooksCrossRef Shemilt I, Mugford M, Donaldson C, Vale L, Marsh K: Evidence-Based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. 2010, London: Wiley BooksCrossRef
21.
go back to reference Brunetti M, Shemilt I, Pregno S, Vale L, Oxman AD, Lord J, Sisk J, Ruiz F, Hill S, Guyatt GH, Jaeschke R, Helfand M, Harbour R, DAvoli M, Amato L, Liberati A, Shunemann HJ: GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence. J Chin Epidemiol. 2013, 66: 140-150. 10.1016/j.jclinepi.2012.04.012.CrossRef Brunetti M, Shemilt I, Pregno S, Vale L, Oxman AD, Lord J, Sisk J, Ruiz F, Hill S, Guyatt GH, Jaeschke R, Helfand M, Harbour R, DAvoli M, Amato L, Liberati A, Shunemann HJ: GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence. J Chin Epidemiol. 2013, 66: 140-150. 10.1016/j.jclinepi.2012.04.012.CrossRef
22.
go back to reference Williams I, McIver S, Moore D, Bryan S: The use of economic evaluations in NHS decision-making: a review and empirical investigation. Health Technol Assess. 2008, 12: 1-196.CrossRef Williams I, McIver S, Moore D, Bryan S: The use of economic evaluations in NHS decision-making: a review and empirical investigation. Health Technol Assess. 2008, 12: 1-196.CrossRef
24.
go back to reference Boehler C: Mind the GAP! Geographic transferability of economic evaluation in health, Health Economic Research Group (HERG) and Multidisciplinary Assessment of Technology Centre for Healthcare (MATCH). 2012, Brunel University: PhD Thesis Boehler C: Mind the GAP! Geographic transferability of economic evaluation in health, Health Economic Research Group (HERG) and Multidisciplinary Assessment of Technology Centre for Healthcare (MATCH). 2012, Brunel University: PhD Thesis
Metadata
Title
Issues in the incorporation of economic perspectives and evidence into Cochrane reviews
Authors
Ian Shemilt
David McDaid
Kevin Marsh
Catherine Henderson
Evelina Bertranou
Jacqueline Mallander
Mike Drummond
Miranda Mugford
Luke Vale
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2013
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-83

Other articles of this Issue 1/2013

Systematic Reviews 1/2013 Go to the issue