Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2016

Open Access 01-12-2016 | Research

Assessing the external validity of algorithms to estimate EQ-5D-3L from the WOMAC

Authors: Aliasghar A. Kiadaliri, Martin Englund

Published in: Health and Quality of Life Outcomes | Issue 1/2016

Login to get access

Abstract

Background

The use of mapping algorithms have been suggested as a solution to predict health utilities when no preference-based measure is included in the study. However, validity and predictive performance of these algorithms are highly variable and hence assessing the accuracy and validity of algorithms before use them in a new setting is of importance. The aim of the current study was to assess the predictive accuracy of three mapping algorithms to estimate the EQ-5D-3L from the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) among Swedish people with knee disorders. Two of these algorithms developed using ordinary least squares (OLS) models and one developed using mixture model.

Methods

The data from 1078 subjects mean (SD) age 69.4 (7.2) years with frequent knee pain and/or knee osteoarthritis from the Malmö Osteoarthritis study in Sweden were used. The algorithms’ performance was assessed using mean error, mean absolute error, and root mean squared error. Two types of prediction were estimated for mixture model: weighted average (WA), and conditional on estimated component (CEC).

Results

The overall mean was overpredicted by an OLS model and underpredicted by two other algorithms (P < 0.001). All predictions but the CEC predictions of mixture model had a narrower range than the observed scores (22 to 90 %). All algorithms suffered from overprediction for severe health states and underprediction for mild health states with lesser extent for mixture model. While the mixture model outperformed OLS models at the extremes of the EQ-5D-3D distribution, it underperformed around the center of the distribution.

Conclusions

While algorithm based on mixture model reflected the distribution of EQ-5D-3L data more accurately compared with OLS models, all algorithms suffered from systematic bias. This calls for caution in applying these mapping algorithms in a new setting particularly in samples with milder knee problems than original sample. Assessing the impact of the choice of these algorithms on cost-effectiveness studies through sensitivity analysis is recommended.
Appendix
Available only for authorised users
Literature
1.
go back to reference Torrance GW. Utility approach to measuring health-related quality of life. J Chronic Dis. 1987;40(6):593–603.CrossRefPubMed Torrance GW. Utility approach to measuring health-related quality of life. J Chronic Dis. 1987;40(6):593–603.CrossRefPubMed
2.
go back to reference Brazier JE, Yang Y, Tsuchiya A, Rowen DL. A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures. Eur J Health Econ. 2010;11(2):215–25.CrossRefPubMed Brazier JE, Yang Y, Tsuchiya A, Rowen DL. A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures. Eur J Health Econ. 2010;11(2):215–25.CrossRefPubMed
3.
go back to reference Brazier J. Valuing health States for use in cost-effectiveness analysis. Pharmacoeconomics. 2008;26(9):769–79.CrossRefPubMed Brazier J. Valuing health States for use in cost-effectiveness analysis. Pharmacoeconomics. 2008;26(9):769–79.CrossRefPubMed
5.
go back to reference Pickard AS, Wang Z, Walton SM, Lee TA. Are decisions using cost-utility analyses robust to choice of SF-36/SF-12 preference-based algorithm? Health Qual Life Outcomes. 2005;3:11.CrossRefPubMedPubMedCentral Pickard AS, Wang Z, Walton SM, Lee TA. Are decisions using cost-utility analyses robust to choice of SF-36/SF-12 preference-based algorithm? Health Qual Life Outcomes. 2005;3:11.CrossRefPubMedPubMedCentral
6.
go back to reference Debray TP, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KG. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68(3):279–89.CrossRefPubMed Debray TP, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KG. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68(3):279–89.CrossRefPubMed
7.
go back to reference Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833–40.PubMed Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833–40.PubMed
8.
go back to reference Barton GR, Sach TH, Jenkinson C, Avery AJ, Doherty M, Muir KR. Do estimates of cost-utility based on the EQ-5D differ from those based on the mapping of utility scores? Health Qual Life Outcomes. 2008;6:51.CrossRefPubMedPubMedCentral Barton GR, Sach TH, Jenkinson C, Avery AJ, Doherty M, Muir KR. Do estimates of cost-utility based on the EQ-5D differ from those based on the mapping of utility scores? Health Qual Life Outcomes. 2008;6:51.CrossRefPubMedPubMedCentral
9.
go back to reference Xie F, Pullenayegum EM, Li SC, Hopkins R, Thumboo J, Lo NN. Use of a disease-specific instrument in economic evaluations: mapping WOMAC onto the EQ-5D utility index. Value Health. 2010;13(8):873–8.CrossRefPubMed Xie F, Pullenayegum EM, Li SC, Hopkins R, Thumboo J, Lo NN. Use of a disease-specific instrument in economic evaluations: mapping WOMAC onto the EQ-5D utility index. Value Health. 2010;13(8):873–8.CrossRefPubMed
10.
go back to reference Wailoo A, Hernandez Alava M, Escobar Martinez A. Modelling the relationship between the WOMAC Osteoarthritis Index and EQ-5D. Health Qual Life Outcomes. 2014;12:37.CrossRefPubMedPubMedCentral Wailoo A, Hernandez Alava M, Escobar Martinez A. Modelling the relationship between the WOMAC Osteoarthritis Index and EQ-5D. Health Qual Life Outcomes. 2014;12:37.CrossRefPubMedPubMedCentral
11.
go back to reference Miller LE, Block JE. An 8-week knee osteoarthritis treatment program of hyaluronic acid injection, Deliberate physical rehabilitation, and patient education is cost effective at 2 years follow-up: the osteoarthritis centers of America(SM) experience. Clin Med Insights Arthritis Musculoskelet Disord. 2014;7:49–55.CrossRefPubMedPubMedCentral Miller LE, Block JE. An 8-week knee osteoarthritis treatment program of hyaluronic acid injection, Deliberate physical rehabilitation, and patient education is cost effective at 2 years follow-up: the osteoarthritis centers of America(SM) experience. Clin Med Insights Arthritis Musculoskelet Disord. 2014;7:49–55.CrossRefPubMedPubMedCentral
12.
go back to reference Latimer N, Lord J, Grant RL, O’Mahony R, Dickson J, Conaghan PG, et al. Cost effectiveness of COX 2 selective inhibitors and traditional NSAIDs alone or in combination with a proton pump inhibitor for people with osteoarthritis. BMJ. 2009;339:b2538.CrossRefPubMedPubMedCentral Latimer N, Lord J, Grant RL, O’Mahony R, Dickson J, Conaghan PG, et al. Cost effectiveness of COX 2 selective inhibitors and traditional NSAIDs alone or in combination with a proton pump inhibitor for people with osteoarthritis. BMJ. 2009;339:b2538.CrossRefPubMedPubMedCentral
13.
go back to reference Kiadaliri AA, Gerhardsson de Verdier M, Turkiewicz A, Lohmander LS, Englund M. Socioeconomic inequalities in knee pain, knee osteoarthritis, and health-related quality of life: a population-based cohort study in southern Sweden. Scand J Rheumatol. 2016;6:1–9.CrossRef Kiadaliri AA, Gerhardsson de Verdier M, Turkiewicz A, Lohmander LS, Englund M. Socioeconomic inequalities in knee pain, knee osteoarthritis, and health-related quality of life: a population-based cohort study in southern Sweden. Scand J Rheumatol. 2016;6:1–9.CrossRef
14.
go back to reference Altman R, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, et al. Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association. Arthritis Rheum. 1986;29(8):1039–49.CrossRefPubMed Altman R, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, et al. Development of criteria for the classification and reporting of osteoarthritis. Classification of osteoarthritis of the knee. Diagnostic and Therapeutic Criteria Committee of the American Rheumatism Association. Arthritis Rheum. 1986;29(8):1039–49.CrossRefPubMed
15.
go back to reference Altman RD, Hochberg M, Murphy Jr WA, Wolfe F, Lequesne M. Atlas of individual radiographic features in osteoarthritis. Osteoarthritis Cartilage. 1995;3(Suppl A):3–70.PubMed Altman RD, Hochberg M, Murphy Jr WA, Wolfe F, Lequesne M. Atlas of individual radiographic features in osteoarthritis. Osteoarthritis Cartilage. 1995;3(Suppl A):3–70.PubMed
16.
go back to reference Englund M, Roos EM, Lohmander LS. Impact of type of meniscal tear on radiographic and symptomatic knee osteoarthritis: a sixteen-year followup of meniscectomy with matched controls. Arthritis Rheum. 2003;48(8):2178–87.CrossRefPubMed Englund M, Roos EM, Lohmander LS. Impact of type of meniscal tear on radiographic and symptomatic knee osteoarthritis: a sixteen-year followup of meniscectomy with matched controls. Arthritis Rheum. 2003;48(8):2178–87.CrossRefPubMed
18.
19.
go back to reference Tsuchiya A, Ikeda S, Ikegami N, Nishimura S, Sakai I, Fukuda T, et al. Estimating an EQ-5D population value set: the case of Japan. Health Econ. 2002;11(4):341–53.CrossRefPubMed Tsuchiya A, Ikeda S, Ikegami N, Nishimura S, Sakai I, Fukuda T, et al. Estimating an EQ-5D population value set: the case of Japan. Health Econ. 2002;11(4):341–53.CrossRefPubMed
20.
go back to reference Hernandez Alava M, Wailoo AJ, Ara R. Tails from the peak district: adjusted limited dependent variable mixture models of EQ-5D questionnaire health state utility values. Value Health. 2012;15(3):550–61.CrossRefPubMed Hernandez Alava M, Wailoo AJ, Ara R. Tails from the peak district: adjusted limited dependent variable mixture models of EQ-5D questionnaire health state utility values. Value Health. 2012;15(3):550–61.CrossRefPubMed
21.
go back to reference Coca Perraillon M, Shih YC, Thisted RA. Predicting the EQ-5D-3L Preference Index from the SF-12 Health Survey in a National US Sample: A Finite Mixture Approach. Med Decis Making. 2015;35(7):888–901.CrossRefPubMedPubMedCentral Coca Perraillon M, Shih YC, Thisted RA. Predicting the EQ-5D-3L Preference Index from the SF-12 Health Survey in a National US Sample: A Finite Mixture Approach. Med Decis Making. 2015;35(7):888–901.CrossRefPubMedPubMedCentral
22.
go back to reference Longworth L, Yang Y, Young T, Mulhern B, Hernandez Alava M, Mukuria C, et al. Use of generic and condition-specific measures of health-related quality of life in NICE decision-making: a systematic review, statistical modelling and survey. Health Technol Assess. 2014;18(9):1–224.CrossRefPubMedPubMedCentral Longworth L, Yang Y, Young T, Mulhern B, Hernandez Alava M, Mukuria C, et al. Use of generic and condition-specific measures of health-related quality of life in NICE decision-making: a systematic review, statistical modelling and survey. Health Technol Assess. 2014;18(9):1–224.CrossRefPubMedPubMedCentral
24.
go back to reference Pennington B, Davis S. Mapping from the Health Assessment Questionnaire to the EQ-5D: the impact of different algorithms on cost-effectiveness results. Value Health. 2014;17(8):762–71.CrossRefPubMed Pennington B, Davis S. Mapping from the Health Assessment Questionnaire to the EQ-5D: the impact of different algorithms on cost-effectiveness results. Value Health. 2014;17(8):762–71.CrossRefPubMed
25.
go back to reference Harrison MJ, Lunt M, Verstappen SM, Watson KD, Bansback NJ, Symmons DP. Exploring the validity of estimating EQ-5D and SF-6D utility values from the health assessment questionnaire in patients with inflammatory arthritis. Health Qual Life Outcomes. 2010;8:21.CrossRefPubMedPubMedCentral Harrison MJ, Lunt M, Verstappen SM, Watson KD, Bansback NJ, Symmons DP. Exploring the validity of estimating EQ-5D and SF-6D utility values from the health assessment questionnaire in patients with inflammatory arthritis. Health Qual Life Outcomes. 2010;8:21.CrossRefPubMedPubMedCentral
26.
go back to reference Longworth L, Rowen D. Mapping to obtain EQ-5D utility values for use in NICE health technology assessments. Value Health. 2013;16(1):202–10.CrossRefPubMed Longworth L, Rowen D. Mapping to obtain EQ-5D utility values for use in NICE health technology assessments. Value Health. 2013;16(1):202–10.CrossRefPubMed
Metadata
Title
Assessing the external validity of algorithms to estimate EQ-5D-3L from the WOMAC
Authors
Aliasghar A. Kiadaliri
Martin Englund
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2016
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-016-0547-y

Other articles of this Issue 1/2016

Health and Quality of Life Outcomes 1/2016 Go to the issue