Skip to main content
Top
Published in: Population Health Metrics 1/2008

Open Access 01-12-2008 | Research

Rescaling quality of life values from discrete choice experiments for use as QALYs: a cautionary tale

Authors: Terry N Flynn, Jordan J Louviere, Anthony AJ Marley, Joanna Coast, Tim J Peters

Published in: Population Health Metrics | Issue 1/2008

Login to get access

Abstract

Background

Researchers are increasingly investigating the potential for ordinal tasks such as ranking and discrete choice experiments to estimate QALY health state values. However, the assumptions of random utility theory, which underpin the statistical models used to provide these estimates, have received insufficient attention. In particular, the assumptions made about the decisions between living states and the death state are not satisfied, at least for some people. Estimated values are likely to be incorrectly anchored with respect to death (zero) in such circumstances.

Methods

Data from the Investigating Choice Experiments for the preferences of older people CAPability instrument (ICECAP) valuation exercise were analysed. The values (previously anchored to the worst possible state) were rescaled using an ordinal model proposed previously to estimate QALY-like values. Bootstrapping was conducted to vary artificially the proportion of people who conformed to the conventional random utility model underpinning the analyses.

Results

Only 26% of respondents conformed unequivocally to the assumptions of conventional random utility theory. At least 14% of respondents unequivocally violated the assumptions. Varying the relative proportions of conforming respondents in sensitivity analyses led to large changes in the estimated QALY values, particularly for lower-valued states. As a result these values could be either positive (considered to be better than death) or negative (considered to be worse than death).

Conclusion

Use of a statistical model such as conditional (multinomial) regression to anchor quality of life values from ordinal data to death is inappropriate in the presence of respondents who do not conform to the assumptions of conventional random utility theory. This is clearest when estimating values for that group of respondents observed in valuation samples who refuse to consider any living state to be worse than death: in such circumstances the model cannot be estimated. Only a valuation task requiring respondents to make choices in which both length and quality of life vary can produce estimates that properly reflect the preferences of all respondents.
Literature
1.
go back to reference Drummond M, Sculpher M, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the economic evaluation of health care programmes. Third edition. Oxford: Oxford University Press; 2005. Drummond M, Sculpher M, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the economic evaluation of health care programmes. Third edition. Oxford: Oxford University Press; 2005.
2.
go back to reference Salomon JA: Reconsidering the use of rankings in the valuation of health states: a model for estimating cardinal values from ordinal data. Popul Health Metr 2003,1(1):12. 10.1186/1478-7954-1-12CrossRefPubMedPubMedCentral Salomon JA: Reconsidering the use of rankings in the valuation of health states: a model for estimating cardinal values from ordinal data. Popul Health Metr 2003,1(1):12. 10.1186/1478-7954-1-12CrossRefPubMedPubMedCentral
3.
go back to reference McCabe C, Brazier J, Gilks P, Tsuchiya A, Roberts J, O'Hagan A, Stevens K: Using rank data to estimate health state utility models. J Health Econ 2006, 25: 418-431. 10.1016/j.jhealeco.2005.07.008CrossRefPubMed McCabe C, Brazier J, Gilks P, Tsuchiya A, Roberts J, O'Hagan A, Stevens K: Using rank data to estimate health state utility models. J Health Econ 2006, 25: 418-431. 10.1016/j.jhealeco.2005.07.008CrossRefPubMed
4.
go back to reference Flynn TN, Louviere JJ, Peters TJ, Coast J: Best-Worst Scaling: What it can do for health care research and how to do it. J Health Econ 2007, 26: 171-189. 10.1016/j.jhealeco.2006.04.002CrossRefPubMed Flynn TN, Louviere JJ, Peters TJ, Coast J: Best-Worst Scaling: What it can do for health care research and how to do it. J Health Econ 2007, 26: 171-189. 10.1016/j.jhealeco.2006.04.002CrossRefPubMed
5.
go back to reference Lancaster K: A New Approach To Consumer Theory. Journal of Political Economy 1966, 74: 132-157. 10.1086/259131CrossRef Lancaster K: A New Approach To Consumer Theory. Journal of Political Economy 1966, 74: 132-157. 10.1086/259131CrossRef
6.
go back to reference Street DJ, Burgess L: The Construction of Optimal Stated Choice Experiments: Theory and Methods. John Wiley & Sons Inc; 2007.CrossRef Street DJ, Burgess L: The Construction of Optimal Stated Choice Experiments: Theory and Methods. John Wiley & Sons Inc; 2007.CrossRef
7.
go back to reference McFadden D: Conditional logit analysis of qualitative choice behavior. In Frontiers in Econometrics. Edited by: Zarembka P. New York: Academic Press; 1974:105-142. McFadden D: Conditional logit analysis of qualitative choice behavior. In Frontiers in Econometrics. Edited by: Zarembka P. New York: Academic Press; 1974:105-142.
8.
go back to reference Thurstone LL: A law of comparative judgment. Psychological Review 1927, 34: 273-286. 10.1037/h0070288CrossRef Thurstone LL: A law of comparative judgment. Psychological Review 1927, 34: 273-286. 10.1037/h0070288CrossRef
9.
go back to reference Louviere JJ, Hensher DA, Swait J: Stated choice methods: analysis and application. Cambridge: Cambridge University Press; 2000.CrossRef Louviere JJ, Hensher DA, Swait J: Stated choice methods: analysis and application. Cambridge: Cambridge University Press; 2000.CrossRef
10.
go back to reference Grewal I, Lewis J, Flynn TN, Brown J, Bond J, Coast J: Developing attributes for a generic quality of life measure for older people: Preferences or capabilities? Soc Sci Med 2006, 62: 1891-1901. 10.1016/j.socscimed.2005.08.023CrossRefPubMed Grewal I, Lewis J, Flynn TN, Brown J, Bond J, Coast J: Developing attributes for a generic quality of life measure for older people: Preferences or capabilities? Soc Sci Med 2006, 62: 1891-1901. 10.1016/j.socscimed.2005.08.023CrossRefPubMed
11.
go back to reference Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, Peters TJ: Valuing the ICECAP capability index for older people. Soc Sci Med 2008,67(5):874-882. 10.1016/j.socscimed.2008.05.015CrossRefPubMed Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, Peters TJ: Valuing the ICECAP capability index for older people. Soc Sci Med 2008,67(5):874-882. 10.1016/j.socscimed.2008.05.015CrossRefPubMed
12.
go back to reference Marley AAJ, Louviere JJ: Some probabilistic models of Best, Worst, and Best-Worst choices. J Math Psychol 2005, 49: 464-480. 10.1016/j.jmp.2005.05.003CrossRef Marley AAJ, Louviere JJ: Some probabilistic models of Best, Worst, and Best-Worst choices. J Math Psychol 2005, 49: 464-480. 10.1016/j.jmp.2005.05.003CrossRef
13.
go back to reference Finn A, Louviere JJ: Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety. J Public Policy Mark 1992, 11: 12-25. Finn A, Louviere JJ: Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety. J Public Policy Mark 1992, 11: 12-25.
14.
go back to reference Street DJ, Burgess L, Louviere JJ: Quick and Easy Choice Sets: Constructing Optimal and Nearly Optimal Stated Choice Experiments. Int J Res Mark 2005, 22: 459-470. 10.1016/j.ijresmar.2005.09.003CrossRef Street DJ, Burgess L, Louviere JJ: Quick and Easy Choice Sets: Constructing Optimal and Nearly Optimal Stated Choice Experiments. Int J Res Mark 2005, 22: 459-470. 10.1016/j.ijresmar.2005.09.003CrossRef
15.
go back to reference Luce RD, Suppes P: Preference utility and subjective probability. In Handbook of mathematical psychology. Volume III. Edited by: Luce RD, Bush RR, Galanter E. New York: Wiley; 1965:249-410. Luce RD, Suppes P: Preference utility and subjective probability. In Handbook of mathematical psychology. Volume III. Edited by: Luce RD, Bush RR, Galanter E. New York: Wiley; 1965:249-410.
16.
go back to reference Luce RD: Individual choice behavior. New York: John Wiley & Sons; 1959. Luce RD: Individual choice behavior. New York: John Wiley & Sons; 1959.
17.
go back to reference Ben-Akiva M, Lerman SR: Discrete choice analysis: theory and application to travel demand. Cambridge, MA: MIT Press; 1985. Ben-Akiva M, Lerman SR: Discrete choice analysis: theory and application to travel demand. Cambridge, MA: MIT Press; 1985.
18.
go back to reference Hensher DA, Louviere JJ, Swait J: Combining sources of preference data. J Econometrics 1999, 89: 197-221. 10.1016/S0304-4076(98)00061-XCrossRef Hensher DA, Louviere JJ, Swait J: Combining sources of preference data. J Econometrics 1999, 89: 197-221. 10.1016/S0304-4076(98)00061-XCrossRef
19.
go back to reference Swait J, Louviere JJ: The role of the scale parameter in the estimation and comparison of multinomial logit models. J Marketing Res 1993, 30: 305-314. 10.2307/3172883CrossRef Swait J, Louviere JJ: The role of the scale parameter in the estimation and comparison of multinomial logit models. J Marketing Res 1993, 30: 305-314. 10.2307/3172883CrossRef
20.
go back to reference Efron B, Tibshirani R: An introduction to the Bootstrap. 1st edition. New York: Chapman & Hall; 1993.CrossRef Efron B, Tibshirani R: An introduction to the Bootstrap. 1st edition. New York: Chapman & Hall; 1993.CrossRef
22.
go back to reference Arnesen T, Trommald M: Are QALYs based on time trade-off comparable? – A systematic review of TTO methodologies. Health Econ 2005, 14: 39-53. 10.1002/hec.895CrossRefPubMed Arnesen T, Trommald M: Are QALYs based on time trade-off comparable? – A systematic review of TTO methodologies. Health Econ 2005, 14: 39-53. 10.1002/hec.895CrossRefPubMed
23.
go back to reference Lamers LM: Lamers: The transformation of utilities for health dtates eorse than death: consequences for the estimation of EQ-5D value sets. Medical Care 2007, 45: 238-244. 10.1097/01.mlr.0000252166.76255.68CrossRefPubMed Lamers LM: Lamers: The transformation of utilities for health dtates eorse than death: consequences for the estimation of EQ-5D value sets. Medical Care 2007, 45: 238-244. 10.1097/01.mlr.0000252166.76255.68CrossRefPubMed
24.
go back to reference Robinson A, Spencer A: Exploring challenges to TTO utilities: valuing states worse than dead. Health Econ 2006, 15: 393-402. 10.1002/hec.1069CrossRefPubMed Robinson A, Spencer A: Exploring challenges to TTO utilities: valuing states worse than dead. Health Econ 2006, 15: 393-402. 10.1002/hec.1069CrossRefPubMed
Metadata
Title
Rescaling quality of life values from discrete choice experiments for use as QALYs: a cautionary tale
Authors
Terry N Flynn
Jordan J Louviere
Anthony AJ Marley
Joanna Coast
Tim J Peters
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2008
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/1478-7954-6-6

Other articles of this Issue 1/2008

Population Health Metrics 1/2008 Go to the issue