Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2015 | Research article

Using meta-regression analyses in addition to conventional systematic review methods to examine the variation in cost-effectiveness results – a case study

Authors: Laura T. Burgers, Fleur T. van de Wetering, Johan L. Severens, W. Ken Redekop

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Systematic reviews of cost-effectiveness analyses summarize results and describe study characteristics. Variability in the study results is often explained qualitatively or based on sensitivity analyses of individual studies. However, variability due to input parameters and study characteristics (e.g., funding or study quality) is often not statistically explained. As a case study, a systematic review on the cost-effectiveness of drug-eluting stents (DES) versus bare-metal stents (BMS) using meta-regression analyses is performed to explore the usefulness of such methods compared with conventional review methods.

Methods

We attempted to identify and review all modelling studies published until January 2012 that compared costs and consequences of DES versus BMS. We extracted general study information (e.g., funding), modelling methods, values of input parameters, and quality of the model using the Philips et al. checklist. Associations between study characteristics and the incremental costs and effectiveness of individual analyses were explored using regression analyses corrected for study ID.

Results

Sixteen eligible studies were identified, with a combined total of 508 analyses. The overall quality of the models was moderate (59 % ± 15 %). This study showed associations (e.g., type of lesion) that were expected (based on individual studies), however the meta-regression analyses revealed also unpredicted associations: e.g., model quality was negatively associated with repeat revascularizations avoided.

Conclusions

Meta-regressions can be of added value, identifying significant associations that could not be identified using conventional review methods or by sensitivity analyses of individual studies. Furthermore, this study underlines the need to examine input parameters and perform a quality check of studies when interpreting the results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Thompson SG, Higgins JP. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11):1559–73.CrossRefPubMed Thompson SG, Higgins JP. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11):1559–73.CrossRefPubMed
2.
go back to reference Hill RA, Boland A, Dickson R, Dundar Y, Haycox A, McLeod C, et al. Drug-eluting stents: a systematic review and economic evaluation. Health Technol Assess. 2007;11(46):1–242.CrossRef Hill RA, Boland A, Dickson R, Dundar Y, Haycox A, McLeod C, et al. Drug-eluting stents: a systematic review and economic evaluation. Health Technol Assess. 2007;11(46):1–242.CrossRef
3.
go back to reference Neyt M, Van Brabandt H, Devriese S, De Laet C. Cost-effectiveness analyses of drug eluting stents versus bare metal stents: A systematic review of the literature. Health Policy. 2009;91(2):107–20.CrossRefPubMed Neyt M, Van Brabandt H, Devriese S, De Laet C. Cost-effectiveness analyses of drug eluting stents versus bare metal stents: A systematic review of the literature. Health Policy. 2009;91(2):107–20.CrossRefPubMed
4.
go back to reference Ligthart S, Vlemmix F, Dendukuri N, Brophy JM. The cost-effectiveness of drug-eluting stents: A systematic review. Can Med Assoc J. 2007;176(2):199–205.CrossRef Ligthart S, Vlemmix F, Dendukuri N, Brophy JM. The cost-effectiveness of drug-eluting stents: A systematic review. Can Med Assoc J. 2007;176(2):199–205.CrossRef
7.
go back to reference Philips Z, Bojke L, Sculpher M, Claxton K, Golder S. Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006;24(4):355–71.CrossRefPubMed Philips Z, Bojke L, Sculpher M, Claxton K, Golder S. Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006;24(4):355–71.CrossRefPubMed
9.
go back to reference Neyt M, De Laet C, De Ridder A, Van Brabandt H. Cost Effectiveness of Drug-Eluting Stents In Belgian Practice Healthcare Payer Perspective. Pharmacoeconomics. 2009;27(4):313–27.CrossRefPubMed Neyt M, De Laet C, De Ridder A, Van Brabandt H. Cost Effectiveness of Drug-Eluting Stents In Belgian Practice Healthcare Payer Perspective. Pharmacoeconomics. 2009;27(4):313–27.CrossRefPubMed
10.
go back to reference Jahn B, Pfeiffer KP, Theurl E, Tarride JE, Goeree R. Capacity Constraints and Cost-Effectiveness: A Discrete Event Simulation for Drug-Eluting Stents. Med Decis Mak. 2010;30(1):16–28.CrossRef Jahn B, Pfeiffer KP, Theurl E, Tarride JE, Goeree R. Capacity Constraints and Cost-Effectiveness: A Discrete Event Simulation for Drug-Eluting Stents. Med Decis Mak. 2010;30(1):16–28.CrossRef
11.
go back to reference Jahn B, Theurl E, Siebert U, Pfeiffer KP. Tutorial in medical decision modeling incorporating waiting lines and queues using discrete event simulation. Value Health. 2010;13(4):501–6.CrossRefPubMed Jahn B, Theurl E, Siebert U, Pfeiffer KP. Tutorial in medical decision modeling incorporating waiting lines and queues using discrete event simulation. Value Health. 2010;13(4):501–6.CrossRefPubMed
12.
go back to reference Mahieu J, de Ridder A, de Graeve D, Vrints C, Bosmans J. Economic analysis of the use of drug-eluting stents from the perspective of Belgian health care. Acta Cardiol. 2007;62(4):355–65.CrossRefPubMed Mahieu J, de Ridder A, de Graeve D, Vrints C, Bosmans J. Economic analysis of the use of drug-eluting stents from the perspective of Belgian health care. Acta Cardiol. 2007;62(4):355–65.CrossRefPubMed
14.
go back to reference Bischof M, Briel M, Bucher HC, Nordmann A. Cost-Effectiveness of Drug-Eluting Stents in a US Medicare Setting: A Cost-Utility Analysis with 3-Year Clinical Follow-Up Data. Value Health. 2009;12(5):649–56.CrossRefPubMed Bischof M, Briel M, Bucher HC, Nordmann A. Cost-Effectiveness of Drug-Eluting Stents in a US Medicare Setting: A Cost-Utility Analysis with 3-Year Clinical Follow-Up Data. Value Health. 2009;12(5):649–56.CrossRefPubMed
15.
go back to reference Ekman M, Sjogren I, James S. Cost-effectiveness of the Taxus paclitaxel-eluting stent in the Swedish healthcare system. Scand Cardiovasc J. 2006;40(1):17–24.CrossRefPubMed Ekman M, Sjogren I, James S. Cost-effectiveness of the Taxus paclitaxel-eluting stent in the Swedish healthcare system. Scand Cardiovasc J. 2006;40(1):17–24.CrossRefPubMed
16.
go back to reference Ferreira E, Araujo DV, Azevedo VM, Rodrigues CV, Ferreira Jr A, Junqueira Cde L, et al. Analysis of the cost-effectiveness of drug-eluting and bare-metal stents in coronary disease. Arq Bras Cardiol. 2010;94(3):286–92. 306–12.CrossRefPubMed Ferreira E, Araujo DV, Azevedo VM, Rodrigues CV, Ferreira Jr A, Junqueira Cde L, et al. Analysis of the cost-effectiveness of drug-eluting and bare-metal stents in coronary disease. Arq Bras Cardiol. 2010;94(3):286–92. 306–12.CrossRefPubMed
18.
go back to reference Polanczyk CA, Wainstein MV, Ribeiro JP. Cost-effectiveness of sirolimus-eluting stents in percutaneous coronary interventions in Brazil. Arq Bras Cardiol. 2007;88(4):464–74.CrossRefPubMed Polanczyk CA, Wainstein MV, Ribeiro JP. Cost-effectiveness of sirolimus-eluting stents in percutaneous coronary interventions in Brazil. Arq Bras Cardiol. 2007;88(4):464–74.CrossRefPubMed
19.
go back to reference Tarricone RR. What reimbursement for coronary revascularization with drug-eluting stents? Eur J Health Econ. 2004;5(4):309–16.CrossRefPubMed Tarricone RR. What reimbursement for coronary revascularization with drug-eluting stents? Eur J Health Econ. 2004;5(4):309–16.CrossRefPubMed
20.
go back to reference Remak E, Manson S, Hutton J, Brasseur P, Olivier E, Gershlick A. Cost-effectiveness of the Endeavor stent in de novo native coronary artery lesions updated with contemporary data. Euro Intervention. 2010;5(7):826–32.PubMed Remak E, Manson S, Hutton J, Brasseur P, Olivier E, Gershlick A. Cost-effectiveness of the Endeavor stent in de novo native coronary artery lesions updated with contemporary data. Euro Intervention. 2010;5(7):826–32.PubMed
21.
go back to reference Bowen J, Hopkins R, He Y, Blackhouse G, Lazzam C, Tu J, et al. Systematic review and cost-effectiveness analysis of drug eluting stents compared to bare metal stents for percutaneous coronary interventions in Ontario. Interim Report for the Ontario Ministry of Health and Long-term Care. Hamilton, ON: Program for Assessment of Technology in Health, McMaster University; 2005. http://www.path-hta.ca/Libraries/Reports/DESreport.sflb.ashx Bowen J, Hopkins R, He Y, Blackhouse G, Lazzam C, Tu J, et al. Systematic review and cost-effectiveness analysis of drug eluting stents compared to bare metal stents for percutaneous coronary interventions in Ontario. Interim Report for the Ontario Ministry of Health and Long-term Care. Hamilton, ON: Program for Assessment of Technology in Health, McMaster University; 2005. http://​www.​path-hta.​ca/​Libraries/​Reports/​DESreport.​sflb.​ashx
22.
go back to reference Hill R, Bagust A, Bakhai A, Dickson R, Dundar Y, Haycox A. Coronary artery stents: a rapid systematic review and economic evaluation. Health Technol Assess. 2004;8(35):1–256. Hill R, Bagust A, Bakhai A, Dickson R, Dundar Y, Haycox A. Coronary artery stents: a rapid systematic review and economic evaluation. Health Technol Assess. 2004;8(35):1–256.
23.
go back to reference Kuukasjarvi P, Rasanen P, Malmivaara A, Aronen P, Sintonen H. Economic evaluation of drug-eluting stents: A systematic literature review and model-based cost-utility analysis. Int J Technol Assess Health Care. 2007;23(4):473–9.CrossRefPubMed Kuukasjarvi P, Rasanen P, Malmivaara A, Aronen P, Sintonen H. Economic evaluation of drug-eluting stents: A systematic literature review and model-based cost-utility analysis. Int J Technol Assess Health Care. 2007;23(4):473–9.CrossRefPubMed
24.
go back to reference Goeree R, Bowen JM, Blackhouse G, Lazzam C, Cohen E, Chiu M, et al. Economic evaluation of drug-eluting stents compared to bare metal stents using a large prospective study in Ontario. Int J Technol Assess Health Care. 2009;25(2):196–207.CrossRefPubMed Goeree R, Bowen JM, Blackhouse G, Lazzam C, Cohen E, Chiu M, et al. Economic evaluation of drug-eluting stents compared to bare metal stents using a large prospective study in Ontario. Int J Technol Assess Health Care. 2009;25(2):196–207.CrossRefPubMed
25.
go back to reference Ruygrok PN, Melkert R, Morel MAM, Ormiston JA, Bar FW, Fernandez-Aviles F, et al. Does angiography six months after coronary intervention influence management and outcome? J Am Coll Cardiol. 1999;34(5):1507–11.CrossRefPubMed Ruygrok PN, Melkert R, Morel MAM, Ormiston JA, Bar FW, Fernandez-Aviles F, et al. Does angiography six months after coronary intervention influence management and outcome? J Am Coll Cardiol. 1999;34(5):1507–11.CrossRefPubMed
26.
27.
go back to reference Caro JJ, Briggs AH, Siebert U, Kuntz KM. ISPOR-SMDM Modeling Good Research Practices Task Force. Modeling good research practices--overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--1. Value Health. 2012;15(6):796–803.CrossRefPubMed Caro JJ, Briggs AH, Siebert U, Kuntz KM. ISPOR-SMDM Modeling Good Research Practices Task Force. Modeling good research practices--overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--1. Value Health. 2012;15(6):796–803.CrossRefPubMed
28.
go back to reference Handels RL, Wolfs CA, Aalten P, Joore MA, Verhey FR, Severens JL. Diagnosing Alzheimer’s disease: A systematic review of economic evaluations. Alzheimers Dement. 2014;10(2):225-37. Handels RL, Wolfs CA, Aalten P, Joore MA, Verhey FR, Severens JL. Diagnosing Alzheimer’s disease: A systematic review of economic evaluations. Alzheimers Dement. 2014;10(2):225-37.
29.
go back to reference Burgers LT, Redekop WK, Severens JL. Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease. Pharmacoeconomics. 2014;32(7):627-37. Burgers LT, Redekop WK, Severens JL. Challenges in Modelling the Cost Effectiveness of Various Interventions for Cardiovascular Disease. Pharmacoeconomics. 2014;32(7):627-37.
30.
31.
go back to reference Donegan S, Williams L, Dias S, Tudur-Smith C, Welton N. Exploring treatment by covariate interactions using subgroup analysis and meta-regression in cochrane reviews: a review of recent practice. PLoS One. 2015;10(6):e0128804. Donegan S, Williams L, Dias S, Tudur-Smith C, Welton N. Exploring treatment by covariate interactions using subgroup analysis and meta-regression in cochrane reviews: a review of recent practice. PLoS One. 2015;10(6):e0128804.
Metadata
Title
Using meta-regression analyses in addition to conventional systematic review methods to examine the variation in cost-effectiveness results – a case study
Authors
Laura T. Burgers
Fleur T. van de Wetering
Johan L. Severens
W. Ken Redekop
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-1230-4

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue