Skip to main content
Top
Published in: PharmacoEconomics 11/2008

01-11-2008 | Leading Article

Methods for the Meta-Analysis of Willingness-to-Pay Data

An Overview

Author: George Van Houtven

Published in: PharmacoEconomics | Issue 11/2008

Login to get access

Abstract

Given the policy relevance and growing volume of research measuring individuals’ willingness to pay (WTP) for health-related goods and services, meta-analysis provides a potentially rich set of tools for answering key questions about this research area. In particular, when taken as a whole, what does the existing empirical literature tell us about health preferences, the effectiveness of health policies, and the demand for health-related goods and services? Although the application of meta-analysis techniques to health-related WTP data is fundamentally similar to other meta-analysis applications, it nonetheless presents a number of specific challenges. The purpose of this article is to describe some of the main features that distinguish WTP research and to discuss ways in which metaanalysis methods must be tailored to meet these challenges.
One of the most notable features of this research area is its heterogeneity in terms of research methods, reporting practices and publication outlets. This article discusses the implications of this diversity for the methods used at various stages of meta-analysis, including problem formulation, data collection, data evaluation and abstraction, data preparation and data analysis. One central implication is a strong reliance on meta-regression and panel data approaches. Another key feature is the frequent objective of providing benefit estimates for economic evaluation. The implication for meta-analysis is that it is a powerful tool not only for synthesizing results and testing hypotheses, but also for predicting WTP and generating benefit estimates for a variety of scenarios. This article discusses what this role implies for how meta-analysis is conducted and how the results are reported.
Footnotes
1
‘Nonmarket valuation’ refers to the estimation of values for commodities, such as human health or environmental improvements, that are not typically exchanged in markets and whose prices are not directly observable. Values or implicit prices for these commodities must therefore be estimated using information from related or constructed markets.
 
2
Hedonic wage-risk studies use regression methods to estimate how differences in occupational safety risks across job categories affect differences in wage compensation (controlling for other job characteristics).
 
3
When the only difference between estimates is that some are from non-overlapping subsamples (e.g. for men and women separately) and others are for these subsamples combined, then it is arguably best in these cases to only include the subsample estimates (as long as the subsample differences can be accounted for with explanatory variables).
 
4
For example, Stata’s random effects regression command (xtreg) does not allow for or include a regression weighting option.
 
5
Examples of studies using this method are Poe et al.,[27] Smith and Osborne,[28] Van Houtven et al.[4] and Johnston et al.[29]
 
Literature
1.
go back to reference Glass GV. Primary, secondary, and meta-analysis. Educ Res 1976; 5: 3–8 Glass GV. Primary, secondary, and meta-analysis. Educ Res 1976; 5: 3–8
2.
go back to reference Stanley TD. Wheat from chaff: meta-analysis as quantitative literature review. J Econ Perspect 2001; 15: 131–50CrossRef Stanley TD. Wheat from chaff: meta-analysis as quantitative literature review. J Econ Perspect 2001; 15: 131–50CrossRef
3.
go back to reference Smith VK, Pattanayak SK. Is meta-analysis the Noah’s ark for non market valuation? Environ Res Econ 2002; 22 (1–2): 271–96CrossRef Smith VK, Pattanayak SK. Is meta-analysis the Noah’s ark for non market valuation? Environ Res Econ 2002; 22 (1–2): 271–96CrossRef
4.
go back to reference Van Houtven G, Pattanayak SK, Patil SR, et al. Estimating economic values using meta-analysis: a primer. Aquatica Working Paper Series 2005, 5 Van Houtven G, Pattanayak SK, Patil SR, et al. Estimating economic values using meta-analysis: a primer. Aquatica Working Paper Series 2005, 5
5.
go back to reference Bergstrom JC, Taylor LO. Using meta-analysis for benefits transfer: theory and practice. Ecol Econ 2006; 60: 351–60CrossRef Bergstrom JC, Taylor LO. Using meta-analysis for benefits transfer: theory and practice. Ecol Econ 2006; 60: 351–60CrossRef
6.
go back to reference Diener A, O’Brien B, Gafni A. Health care contingent valuation studies: a review and classification of the literature. Health Econ 1998; 7: 313–26PubMedCrossRef Diener A, O’Brien B, Gafni A. Health care contingent valuation studies: a review and classification of the literature. Health Econ 1998; 7: 313–26PubMedCrossRef
7.
go back to reference Olsen JA, Smith RD. Theory versus practice: a review of ‘willingness-to-pay’ in health and health care. Health Econ 2001; 10: 39–52PubMedCrossRef Olsen JA, Smith RD. Theory versus practice: a review of ‘willingness-to-pay’ in health and health care. Health Econ 2001; 10: 39–52PubMedCrossRef
8.
go back to reference Miller TR. Variation between countries in values of a statistical life. J Transp Econ Pol 2000; 34 (2): 169–88 Miller TR. Variation between countries in values of a statistical life. J Transp Econ Pol 2000; 34 (2): 169–88
9.
go back to reference Mrozek J, Taylor L. What determines the value of a life? A meta-analysis. J Policy Anal Manage 2002; 21 (2): 253–70CrossRef Mrozek J, Taylor L. What determines the value of a life? A meta-analysis. J Policy Anal Manage 2002; 21 (2): 253–70CrossRef
10.
go back to reference Viscusi WK, Aldy JE. The value of a statistical life: a critical review of market estimates throughout the world. J Risk Uncertain 2003; 27 (1): 5–76CrossRef Viscusi WK, Aldy JE. The value of a statistical life: a critical review of market estimates throughout the world. J Risk Uncertain 2003; 27 (1): 5–76CrossRef
11.
go back to reference Allen E, Becker BJ, Berline JA, et al. Report of the EPA Work Group on VSL Meta-analysis [report produced for the US Environmental Protection Agency]. Washington (DC): National Center for Environmental Economics, 2006 Allen E, Becker BJ, Berline JA, et al. Report of the EPA Work Group on VSL Meta-analysis [report produced for the US Environmental Protection Agency]. Washington (DC): National Center for Environmental Economics, 2006
12.
go back to reference Van Houtven GL, Powers J, Jessup A, et al. Valuing avoided morbidity using meta-analysis: what can health status measures and QALYs tell us about WTP? Health Econ 2006; 15 (8): 775–95PubMedCrossRef Van Houtven GL, Powers J, Jessup A, et al. Valuing avoided morbidity using meta-analysis: what can health status measures and QALYs tell us about WTP? Health Econ 2006; 15 (8): 775–95PubMedCrossRef
13.
go back to reference Vassanadumrongdee S, Matsuoka S, Shirakawa H. Meta-analysis of contingent valuation studies on air pollution-related morbidity risks. Environ Econ Pol Stud 2004; 6 (1): 11–47 Vassanadumrongdee S, Matsuoka S, Shirakawa H. Meta-analysis of contingent valuation studies on air pollution-related morbidity risks. Environ Econ Pol Stud 2004; 6 (1): 11–47
14.
go back to reference Johnson FR, Fries EE, Banzhaf HS. Valuing morbidity: an integration of the willingness-to-pay and health-status index literatures. J Health Econ 1997; 16: 641–65PubMedCrossRef Johnson FR, Fries EE, Banzhaf HS. Valuing morbidity: an integration of the willingness-to-pay and health-status index literatures. J Health Econ 1997; 16: 641–65PubMedCrossRef
15.
go back to reference Kaplan RM, Anderson JP, Wu AW, et al. The quality of well-being scale: applications in AIDS, cystic fibrosis, and arthritis. Med Care 1989; 27 (3 Suppl.): S27–43CrossRef Kaplan RM, Anderson JP, Wu AW, et al. The quality of well-being scale: applications in AIDS, cystic fibrosis, and arthritis. Med Care 1989; 27 (3 Suppl.): S27–43CrossRef
16.
go back to reference Rosenthal R. Meta-analytic procedures for social research. Thousand Oaks (CA): SAGE Publications, 1991 Rosenthal R. Meta-analytic procedures for social research. Thousand Oaks (CA): SAGE Publications, 1991
17.
go back to reference Moher D, Cook DJ, Eastwood S, et al. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet 1999; 354 (9193): 1896–900PubMedCrossRef Moher D, Cook DJ, Eastwood S, et al. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet 1999; 354 (9193): 1896–900PubMedCrossRef
18.
go back to reference Cooper H. Synthesizing research: a guide for literature review. 3rd ed. Thousand Oaks (CA): SAGE Publications, 1998 Cooper H. Synthesizing research: a guide for literature review. 3rd ed. Thousand Oaks (CA): SAGE Publications, 1998
19.
go back to reference Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000, 2008–12 Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000, 2008–12
21.
go back to reference Pattanayak S, Wing J, Depro B, et al. International health benefits transfer tool: the use of PPP and inflation indices [report prepared for the Economic Analysis and Evaluation Division]. Ottawa (ON): Health Canada, 2002 Pattanayak S, Wing J, Depro B, et al. International health benefits transfer tool: the use of PPP and inflation indices [report prepared for the Economic Analysis and Evaluation Division]. Ottawa (ON): Health Canada, 2002
22.
go back to reference Ready R, Navrud S. International benefit transfer: methods and validity tests. Ecol Econ 2006; 60: 429–34CrossRef Ready R, Navrud S. International benefit transfer: methods and validity tests. Ecol Econ 2006; 60: 429–34CrossRef
23.
go back to reference Smith VK, Huang J. Can markets value air quality? A meta-analysis of hedonic property value models. J Polit Econ 1995; 103 (1): 209–27CrossRef Smith VK, Huang J. Can markets value air quality? A meta-analysis of hedonic property value models. J Polit Econ 1995; 103 (1): 209–27CrossRef
24.
go back to reference Hole AR. A comparison of approaches to estimating confidence intervals for willingness to pay measures. Health Econ 2007; 16: 827–40PubMedCrossRef Hole AR. A comparison of approaches to estimating confidence intervals for willingness to pay measures. Health Econ 2007; 16: 827–40PubMedCrossRef
25.
go back to reference Lipsey MW, Wilson DB. Practical meta-analysis. Thousand Oaks (CA): SAGE, 2001 Lipsey MW, Wilson DB. Practical meta-analysis. Thousand Oaks (CA): SAGE, 2001
26.
go back to reference Rogers WH. Regression standard errors in clustered samples. Stata Technical Bulletin Reprints 1993; 3: 88–94 Rogers WH. Regression standard errors in clustered samples. Stata Technical Bulletin Reprints 1993; 3: 88–94
27.
go back to reference Poe GL, Boyle KJ, Bergstrom JC. A preliminary meta analysis of contingent values for ground water quality revisited. In: Bergstrom JC, Boyle KJ, Poe GL, editors. Economic value of water quality. Northampton (MA): Edward Elgar, 2001: 137–162 Poe GL, Boyle KJ, Bergstrom JC. A preliminary meta analysis of contingent values for ground water quality revisited. In: Bergstrom JC, Boyle KJ, Poe GL, editors. Economic value of water quality. Northampton (MA): Edward Elgar, 2001: 137–162
28.
go back to reference Smith VK, Osborne L. Do contingent valuation estimates pass a scope test? A meta-analysis. J Environ Econ Manage 1996; 31: 287–301CrossRef Smith VK, Osborne L. Do contingent valuation estimates pass a scope test? A meta-analysis. J Environ Econ Manage 1996; 31: 287–301CrossRef
29.
go back to reference Johnston RJ, Besedin EY, Iovanna R, et al. Systematic variation in willingness to pay for aquatic resource improvements and implications for benefit transfer: a meta-analysis. Can J Agric Econ 2005; 53: 221–48CrossRef Johnston RJ, Besedin EY, Iovanna R, et al. Systematic variation in willingness to pay for aquatic resource improvements and implications for benefit transfer: a meta-analysis. Can J Agric Econ 2005; 53: 221–48CrossRef
30.
go back to reference Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics 2000; 56: 645–6PubMedCrossRef Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics 2000; 56: 645–6PubMedCrossRef
31.
go back to reference Froot KA. Consistent covariance matrix estimation with cross-sectional dependence and heteroskedasticity in financial data. J Finan Quant Anal 1989; 24: 333–55CrossRef Froot KA. Consistent covariance matrix estimation with cross-sectional dependence and heteroskedasticity in financial data. J Finan Quant Anal 1989; 24: 333–55CrossRef
32.
go back to reference Van Houtven GL, Powers J, Pattanayak SK. Valuing water quality improvements using meta-analysis: is the glass half-full or half-empty for national policy analysis? Res Energy Econ 2007; 29: 206–28CrossRef Van Houtven GL, Powers J, Pattanayak SK. Valuing water quality improvements using meta-analysis: is the glass half-full or half-empty for national policy analysis? Res Energy Econ 2007; 29: 206–28CrossRef
33.
go back to reference Manning WG. The logged dependent variable, heteroscedasticity, and the retransformation problem. J Health Econ 1998; 17: 283–95PubMedCrossRef Manning WG. The logged dependent variable, heteroscedasticity, and the retransformation problem. J Health Econ 1998; 17: 283–95PubMedCrossRef
34.
go back to reference Van Houtven GL, Pattanayak SK, Smith VK. Benefit transfer functions for avoided morbidity: a preference calibration approach. Washington (DC): US Environmental Protection Agency, National Center of Environmental Economics Working Paper Series, Paper 04–04, 2004 Van Houtven GL, Pattanayak SK, Smith VK. Benefit transfer functions for avoided morbidity: a preference calibration approach. Washington (DC): US Environmental Protection Agency, National Center of Environmental Economics Working Paper Series, Paper 04–04, 2004
Metadata
Title
Methods for the Meta-Analysis of Willingness-to-Pay Data
An Overview
Author
George Van Houtven
Publication date
01-11-2008
Publisher
Springer International Publishing
Published in
PharmacoEconomics / Issue 11/2008
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI
https://doi.org/10.2165/00019053-200826110-00003

Other articles of this Issue 11/2008

PharmacoEconomics 11/2008 Go to the issue