Skip to main content
Top
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Protocol

Early economic evaluation of emerging health technologies: protocol of a systematic review

Authors: Ba’ Pham, Hong Anh Thi Tu, Dolly Han, Petros Pechlivanoglou, Fiona Miller, Valeria Rac, Warren Chin, Andrea C Tricco, Mike Paulden, Joanna Bielecki, Murray Krahn

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice.

Methods/design

This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status.

Discussion

This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.
Literature
1.
go back to reference Drummond M, Sculpher M, Torrance G, O'Brien B, Stoddard G: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford: Oxford University Press, 3 Drummond M, Sculpher M, Torrance G, O'Brien B, Stoddard G: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford: Oxford University Press, 3
2.
go back to reference Hartz S, John J: Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review. Int J Technol Assess Health Care. 2008, 24 (4): 465-472.CrossRefPubMed Hartz S, John J: Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review. Int J Technol Assess Health Care. 2008, 24 (4): 465-472.CrossRefPubMed
3.
go back to reference Lehoux P, Williams-Jones B, Miller F, Urbach D, Tailliez S: What leads to better health care innovation? Arguments for an integrated policy-oriented research agenda. J Health Serv Res Policy. 2008, 13 (4): 251-254.CrossRefPubMed Lehoux P, Williams-Jones B, Miller F, Urbach D, Tailliez S: What leads to better health care innovation? Arguments for an integrated policy-oriented research agenda. J Health Serv Res Policy. 2008, 13 (4): 251-254.CrossRefPubMed
4.
go back to reference Clement FM, Harris A, Jing JL, Yong K, Lee KM, Manns BJ: Using effectiveness and cost-effectiveness to make drug coverage decisions: a comparison of Britain, Australia, and Canada. JAMA. 2009, 302 (13): 1437-1443.CrossRefPubMed Clement FM, Harris A, Jing JL, Yong K, Lee KM, Manns BJ: Using effectiveness and cost-effectiveness to make drug coverage decisions: a comparison of Britain, Australia, and Canada. JAMA. 2009, 302 (13): 1437-1443.CrossRefPubMed
5.
go back to reference Vallejo-Torres L, Steuten L, Parkinson B, Girling AJ, Buxton MJ: Integrating health economics into the product development cycle: a case study of absorbable pins for treating hallux valgus. Med Decis Making. 2011, 31 (4): 596-610.CrossRefPubMed Vallejo-Torres L, Steuten L, Parkinson B, Girling AJ, Buxton MJ: Integrating health economics into the product development cycle: a case study of absorbable pins for treating hallux valgus. Med Decis Making. 2011, 31 (4): 596-610.CrossRefPubMed
6.
go back to reference Retel VP, Joore MA, Linn SC, Rutgers EJ, van Harten WH: Scenario drafting to anticipate future developments in technology assessment. BMC Res Notes. 2012, 5: 442-CrossRefPubMedPubMedCentral Retel VP, Joore MA, Linn SC, Rutgers EJ, van Harten WH: Scenario drafting to anticipate future developments in technology assessment. BMC Res Notes. 2012, 5: 442-CrossRefPubMedPubMedCentral
7.
go back to reference Shah SGS, Robinson I, Alshawi S: Developing medical device technologies from users' perspectives: a theoretical framework for involving users in the development process. Int J Technol Assess Health Care. 2009, 25 (4): 514-521.CrossRefPubMed Shah SGS, Robinson I, Alshawi S: Developing medical device technologies from users' perspectives: a theoretical framework for involving users in the development process. Int J Technol Assess Health Care. 2009, 25 (4): 514-521.CrossRefPubMed
8.
go back to reference Ijzerman MJ, Steuten LM: Early assessment of medical technologies to inform product development and market access: a review of methods and applications. Appl Health Econ Health Policy. 2011, 9 (5): 331-347.CrossRefPubMed Ijzerman MJ, Steuten LM: Early assessment of medical technologies to inform product development and market access: a review of methods and applications. Appl Health Econ Health Policy. 2011, 9 (5): 331-347.CrossRefPubMed
12.
go back to reference Glanville J, Fleetwood K, Yellowlees A, Kaunelis D, Mensinkai S: Development and Testing of Search Filters to Identify Economic Evaluations in MEDLINE and EMBASE. 2009, Canadian Agency for Drugs and Technologies in Health: Ottawa Glanville J, Fleetwood K, Yellowlees A, Kaunelis D, Mensinkai S: Development and Testing of Search Filters to Identify Economic Evaluations in MEDLINE and EMBASE. 2009, Canadian Agency for Drugs and Technologies in Health: Ottawa
13.
go back to reference Hartz S, John J: Public health policy decisions on medical innovations: what role can early economic evaluation play?. Health Policy. 2009, 89 (2): 184-192.CrossRefPubMed Hartz S, John J: Public health policy decisions on medical innovations: what role can early economic evaluation play?. Health Policy. 2009, 89 (2): 184-192.CrossRefPubMed
14.
go back to reference Pietzsch JB, Pate-Cornell ME: Early technology assessment of new medical devices. Int J Technol Assess Health Care. 2008, 24 (1): 36-44.CrossRefPubMed Pietzsch JB, Pate-Cornell ME: Early technology assessment of new medical devices. Int J Technol Assess Health Care. 2008, 24 (1): 36-44.CrossRefPubMed
15.
go back to reference Dong H, Buxton M: Early assessment of the likely cost-effectiveness of a new technology: a Markov model with probabilistic sensitivity analysis of computer-assisted total knee replacement. Int J Technol Assess Health Care. 2006, 22 (2): 191-202.CrossRefPubMed Dong H, Buxton M: Early assessment of the likely cost-effectiveness of a new technology: a Markov model with probabilistic sensitivity analysis of computer-assisted total knee replacement. Int J Technol Assess Health Care. 2006, 22 (2): 191-202.CrossRefPubMed
16.
go back to reference Yao GL, Novielli N, Manaseki-Holland S, Chen YF, van der Klink M, Barach P, Chilton PJ, Lilford RJ, European HANDOVER Research Collaborative: Evaluation of a predevelopment service delivery intervention: an application to improve clinical handovers. BMJ Qual Saf. 2012, 21 (Suppl 1): i29-i38.CrossRefPubMedPubMedCentral Yao GL, Novielli N, Manaseki-Holland S, Chen YF, van der Klink M, Barach P, Chilton PJ, Lilford RJ, European HANDOVER Research Collaborative: Evaluation of a predevelopment service delivery intervention: an application to improve clinical handovers. BMJ Qual Saf. 2012, 21 (Suppl 1): i29-i38.CrossRefPubMedPubMedCentral
17.
go back to reference McAteer H, Cosh E, Freeman G, Pandit A, Wood P, Lilford R: Cost-effectiveness analysis at the development phase of a potential health technology: examples based on tissue engineering of bladder and urethra. J Tissue Eng Regen Med. 2007, 1 (5): 343-349.CrossRefPubMed McAteer H, Cosh E, Freeman G, Pandit A, Wood P, Lilford R: Cost-effectiveness analysis at the development phase of a potential health technology: examples based on tissue engineering of bladder and urethra. J Tissue Eng Regen Med. 2007, 1 (5): 343-349.CrossRefPubMed
18.
go back to reference Postmus D, de Graaf G, Hillege HL, Steyerberg EW, Buskens E: A method for the early health technology assessment of novel biomarker measurement in primary prevention programs. Stat Med. 2012, 31 (23): 2733-2744.CrossRefPubMed Postmus D, de Graaf G, Hillege HL, Steyerberg EW, Buskens E: A method for the early health technology assessment of novel biomarker measurement in primary prevention programs. Stat Med. 2012, 31 (23): 2733-2744.CrossRefPubMed
19.
go back to reference Garrison LP, Veenstra DL: The economic value of innovative treatments over the product life cycle: the case of targeted trastuzumab therapy for breast cancer. Value Health. 2009, 12: 1118-1123.CrossRefPubMed Garrison LP, Veenstra DL: The economic value of innovative treatments over the product life cycle: the case of targeted trastuzumab therapy for breast cancer. Value Health. 2009, 12: 1118-1123.CrossRefPubMed
20.
go back to reference Retel VP, Bueno-de-Mesquita JM, Hummel MJ, van de Vijver MJ, Douma KF, Karsenberg K, van Dam FS, van Krimpen C, Bellot FE, Roumen RM, Linn SC, van Harten WH: Constructive Technology Assessment (CTA) as a tool in coverage with evidence development: the case of the 70-gene prognosis signature for breast cancer diagnostics. Int J Technol Assess Health Care. 2009, 25 (1): 73-83.CrossRefPubMed Retel VP, Bueno-de-Mesquita JM, Hummel MJ, van de Vijver MJ, Douma KF, Karsenberg K, van Dam FS, van Krimpen C, Bellot FE, Roumen RM, Linn SC, van Harten WH: Constructive Technology Assessment (CTA) as a tool in coverage with evidence development: the case of the 70-gene prognosis signature for breast cancer diagnostics. Int J Technol Assess Health Care. 2009, 25 (1): 73-83.CrossRefPubMed
21.
go back to reference Girling AJ, Lilford RJ, Young TP: Pricing of medical devices under coverage uncertainty-a modelling approach. Health Econ. 2012, 21 (12): 1502-1507.CrossRefPubMed Girling AJ, Lilford RJ, Young TP: Pricing of medical devices under coverage uncertainty-a modelling approach. Health Econ. 2012, 21 (12): 1502-1507.CrossRefPubMed
22.
go back to reference Vallejo-Torres L, Steuten LM, Buxton MJ, Girling AJ, Lilford RJ, Young T: Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach. Int J Technol Assess Health Care. 2008, 24 (4): 459-464.CrossRefPubMed Vallejo-Torres L, Steuten LM, Buxton MJ, Girling AJ, Lilford RJ, Young T: Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach. Int J Technol Assess Health Care. 2008, 24 (4): 459-464.CrossRefPubMed
24.
go back to reference Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952.CrossRefPubMed Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952.CrossRefPubMed
26.
go back to reference Salganik MJ, Heckathorn DD: Sampling and estimation in hidden populations using respondent-driven sampling. Socio Meth. 2004, 34: 193-239.CrossRef Salganik MJ, Heckathorn DD: Sampling and estimation in hidden populations using respondent-driven sampling. Socio Meth. 2004, 34: 193-239.CrossRef
27.
go back to reference Carlsson P, Jørgensen T: Scanning the horizon for emerging health technologies: conclusions from a European workshop. Int J Technol Assess Health Care. 1998, 14 (4): 695-704.CrossRefPubMed Carlsson P, Jørgensen T: Scanning the horizon for emerging health technologies: conclusions from a European workshop. Int J Technol Assess Health Care. 1998, 14 (4): 695-704.CrossRefPubMed
28.
go back to reference NICE: Guide to the Methods of Technology Appraisal. 2008, London: National Institute for Health and Clinical Excellence NICE: Guide to the Methods of Technology Appraisal. 2008, London: National Institute for Health and Clinical Excellence
33.
go back to reference Retel VP, Hummel MJ, van Harten WH: Review on early technology assessments of nanotechnologies in oncology. Mol Oncol. 2009, 3 (5–6): 394-401.CrossRefPubMed Retel VP, Hummel MJ, van Harten WH: Review on early technology assessments of nanotechnologies in oncology. Mol Oncol. 2009, 3 (5–6): 394-401.CrossRefPubMed
34.
go back to reference Retel VP, Hummel MJ, van Harten WH: Early phase technology assessment of nanotechnology in oncology. Tumori. 2008, 94 (2): 284-290.PubMed Retel VP, Hummel MJ, van Harten WH: Early phase technology assessment of nanotechnology in oncology. Tumori. 2008, 94 (2): 284-290.PubMed
38.
go back to reference Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273 (5): 408-412.CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273 (5): 408-412.CrossRefPubMed
39.
go back to reference Wood L, Egger M, Gluud LL, Schulz KF, Juni P, Altman DG, Gluud C, Martin RM, Wood AJG, Sterne JAC: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336 (7644): 601-605.CrossRefPubMedPubMedCentral Wood L, Egger M, Gluud LL, Schulz KF, Juni P, Altman DG, Gluud C, Martin RM, Wood AJG, Sterne JAC: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336 (7644): 601-605.CrossRefPubMedPubMedCentral
40.
go back to reference Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352 (9128): 609-613.CrossRefPubMed Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352 (9128): 609-613.CrossRefPubMed
41.
go back to reference Balk EM, Bonis PA, Moskowitz H, Schmid CH, Ioannidis JP, Wang C, Lau J: Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA. 2002, 287 (22): 2973-2982.CrossRefPubMed Balk EM, Bonis PA, Moskowitz H, Schmid CH, Ioannidis JP, Wang C, Lau J: Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA. 2002, 287 (22): 2973-2982.CrossRefPubMed
42.
go back to reference Savovic J, Jones H, Altman D, Harris R, Jűni P, Pildal J, Als-Nielsen B, Balk E, Gluud C, Gluud L, Ioannidis J, Schulz K, Beynon R, Welton N, Wood L, Moher D, Deeks J, Sterne J: Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess. 2012, 16 (35): 1-82.CrossRefPubMed Savovic J, Jones H, Altman D, Harris R, Jűni P, Pildal J, Als-Nielsen B, Balk E, Gluud C, Gluud L, Ioannidis J, Schulz K, Beynon R, Welton N, Wood L, Moher D, Deeks J, Sterne J: Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess. 2012, 16 (35): 1-82.CrossRefPubMed
43.
go back to reference Bell CM, Urbach DR, Ray JG, Bayoumi A, Rosen AB, Greenberg D, Neumann PJ: Bias in published cost effectiveness studies: systematic review. Br Med J. 2006, 332 (7543): 699-701.CrossRef Bell CM, Urbach DR, Ray JG, Bayoumi A, Rosen AB, Greenberg D, Neumann PJ: Bias in published cost effectiveness studies: systematic review. Br Med J. 2006, 332 (7543): 699-701.CrossRef
44.
go back to reference Sculpher MJ, Pang FS, Manca A, Drummond MF, Golder S, Urdahl H, Davies LM, Eastwood A: Generalisability in economic evaluation studies in healthcare: a review and case studies. Health Technol Assess. 2004, 8 (49): iii-iv.CrossRef Sculpher MJ, Pang FS, Manca A, Drummond MF, Golder S, Urdahl H, Davies LM, Eastwood A: Generalisability in economic evaluation studies in healthcare: a review and case studies. Health Technol Assess. 2004, 8 (49): iii-iv.CrossRef
45.
go back to reference Drummond MF, Iglesias CP, Cooper NJ: Systematic reviews and economic evaluations conducted for the National Institute for Health and Clinical Excellence in the United Kingdom: a game of two halves?. Int J Technol Assess Health Care. 2008, 24: 146-150.PubMed Drummond MF, Iglesias CP, Cooper NJ: Systematic reviews and economic evaluations conducted for the National Institute for Health and Clinical Excellence in the United Kingdom: a game of two halves?. Int J Technol Assess Health Care. 2008, 24: 146-150.PubMed
Metadata
Title
Early economic evaluation of emerging health technologies: protocol of a systematic review
Authors
Ba’ Pham
Hong Anh Thi Tu
Dolly Han
Petros Pechlivanoglou
Fiona Miller
Valeria Rac
Warren Chin
Andrea C Tricco
Mike Paulden
Joanna Bielecki
Murray Krahn
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-81

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue