Skip to main content
Top
Published in: Quality of Life Research 2/2016

Open Access 01-02-2016

Correcting bias in self-rated quality of life: an application of anchoring vignettes and ordinal regression models to better understand QoL differences across commuting modes

Authors: Melanie Crane, Chris Rissel, Stephen Greaves, Klaus Gebel

Published in: Quality of Life Research | Issue 2/2016

Login to get access

Abstract

Purpose

Likert scales are frequently used in public health research, but are subject to scale perception bias. This study sought to explore scale perception bias in quality-of-life (QoL) self-assessment and assess its relationships with commuting mode in the Sydney Travel and Health Study.

Methods

Multilevel ordinal logistic regression analysis was used to analyse the association between two global QoL items about overall QoL and health satisfaction, with usual travel mode to work or study. Anchoring vignettes were applied using parametric and simpler nonparametric methods to detect and adjust for differences in reporting behaviour across age, sex, education, and income groups.

Results

The anchoring vignettes exposed differences in scale responses across demographic groups. After adjusting for these biases, public transport users (OR = 0.37, 95 % CI 0.21–0.65), walkers (OR = 0.44, 95 % CI 0.24–0.82), and motor vehicle users (OR = 0.47, 95 % CI 0.25–0.86) were all found to have lower odds of reporting high QoL compared with bicycle commuters. Similarly, the odds of reporting high health satisfaction were found to be proportionally lower amongst all competing travel modes: motor vehicle users (OR = 0.31, 95 % CI 0.18–0.56), public transport users (OR = 0.34, 95 % CI 0.20–0.57), and walkers (OR = 0.35, 95 % CI 0.20–0.64) when compared with cyclists. Fewer differences were observed in the unadjusted models.

Conclusion

Application of the vignettes by the two approaches removed scaling biases, thereby improving the accuracy of the analyses of the associations between travel mode and quality of life. The adjusted results revealed higher quality of life in bicycle commuters compared with all other travel mode users.
Literature
1.
go back to reference Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118(8), 622–629.CrossRefPubMed Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118(8), 622–629.CrossRefPubMed
2.
go back to reference Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life: a conceptual model of patient outcomes. JAMA, 273(1), 59–65.CrossRefPubMed Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life: a conceptual model of patient outcomes. JAMA, 273(1), 59–65.CrossRefPubMed
3.
4.
go back to reference Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of Health Economics., 19(3), 403–420.CrossRefPubMed Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of Health Economics., 19(3), 403–420.CrossRefPubMed
5.
6.
go back to reference Lindeboom, M., & van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics., 23(6), 1083–1099.CrossRefPubMed Lindeboom, M., & van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics., 23(6), 1083–1099.CrossRefPubMed
7.
go back to reference Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: the issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.CrossRefPubMed Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: the issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.CrossRefPubMed
8.
go back to reference King, G., Murray, C. J., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef King, G., Murray, C. J., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef
9.
go back to reference Bjorner, J. B., Kreiner, S., Ware, J. E., Damsgaard, M. T., & Bech, P. (1998). Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemiology, 51(11), 1189–1202.CrossRefPubMed Bjorner, J. B., Kreiner, S., Ware, J. E., Damsgaard, M. T., & Bech, P. (1998). Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemiology, 51(11), 1189–1202.CrossRefPubMed
10.
go back to reference Araña, J. E., & León, C. J. (2012). Scale-perception bias in the valuation of environmental risks. Applied Economics, 44(20), 2607–2617.CrossRef Araña, J. E., & León, C. J. (2012). Scale-perception bias in the valuation of environmental risks. Applied Economics, 44(20), 2607–2617.CrossRef
11.
go back to reference Cummins, R. A. (2013). Subjective well-being, homeostatically protected mood and depression: A synthesis. In A. Delle Fave (Ed.), The exploration of happiness (pp. 77–95). Amsterdam: Springer. Cummins, R. A. (2013). Subjective well-being, homeostatically protected mood and depression: A synthesis. In A. Delle Fave (Ed.), The exploration of happiness (pp. 77–95). Amsterdam: Springer.
12.
go back to reference Sadana, R. (2000). Comparative analyses of more than 50 household surveys on health status. Geneva: World Health Organization. Sadana, R. (2000). Comparative analyses of more than 50 household surveys on health status. Geneva: World Health Organization.
13.
go back to reference Layes, A., Asada, Y., Kepart, G. (2012). Whiners and deniers–what does self-rated health measure? Social Science & Medicine, 75(1), 1–9. Layes, A., Asada, Y., Kepart, G. (2012). Whiners and deniers–what does self-rated health measure? Social Science & Medicine, 75(1), 1–9.
14.
go back to reference Jürges, H. (2007). True health vs response styles: Exploring cross-country differences in self-reported health. Health Economics, 16(2), 163–178.CrossRefPubMed Jürges, H. (2007). True health vs response styles: Exploring cross-country differences in self-reported health. Health Economics, 16(2), 163–178.CrossRefPubMed
15.
go back to reference Taillefer, M.-C., Dupuis, G., Roberge, M.-A., & LeMay, S. (2003). Health-related quality of life models: Systematic review of the literature. Social Indicators Research, 64(2), 293–323.CrossRef Taillefer, M.-C., Dupuis, G., Roberge, M.-A., & LeMay, S. (2003). Health-related quality of life models: Systematic review of the literature. Social Indicators Research, 64(2), 293–323.CrossRef
16.
go back to reference Veenhoven, R. (2000). The four qualities of life. Journal of Happiness Studies, 1(1), 1–39.CrossRef Veenhoven, R. (2000). The four qualities of life. Journal of Happiness Studies, 1(1), 1–39.CrossRef
17.
go back to reference Leplège, A., & Hunt, S. (1997). The problem of quality of life in medicine. JAMA, 278(1), 47–50.CrossRefPubMed Leplège, A., & Hunt, S. (1997). The problem of quality of life in medicine. JAMA, 278(1), 47–50.CrossRefPubMed
18.
go back to reference Salomon, J. A., Tandon, A., Murray, C. J. (2001). Using vignettes to improve cross-population comparability of health surveys: Concepts, design, and evaluation techniques. Global Programme on Evidence for Health Policy Discussion Paper. 41. http://www.who.int/healthinfo/paper41. Salomon, J. A., Tandon, A., Murray, C. J. (2001). Using vignettes to improve cross-population comparability of health surveys: Concepts, design, and evaluation techniques. Global Programme on Evidence for Health Policy Discussion Paper. 41. http://​www.​who.​int/​healthinfo/​paper41.
19.
go back to reference Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social., 52(2), 246–261.CrossRef Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social., 52(2), 246–261.CrossRef
20.
go back to reference Angelini, V., Cavapozzi, D., Corazzini, L., & Paccagnella, O. (2013). Do Danes and Italians rate life satisfaction in the same way? Using vignettes to correct for individual-specific scale biases. Oxford Bulletin of Economics and Statistics, 76(5), 643–666.CrossRef Angelini, V., Cavapozzi, D., Corazzini, L., & Paccagnella, O. (2013). Do Danes and Italians rate life satisfaction in the same way? Using vignettes to correct for individual-specific scale biases. Oxford Bulletin of Economics and Statistics, 76(5), 643–666.CrossRef
21.
go back to reference Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? Health Economics., 17(3), 351–375.CrossRefPubMed Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? Health Economics., 17(3), 351–375.CrossRefPubMed
22.
go back to reference Dowd, J. B., & Todd, M. (2011). Does self-reported health bias the measurement of health inequalities in US adults? evidence using anchoring vignettes from the health and retirement study. Journals of Gerontology—Series B Psychological Sciences and Social Sciences, 66 B(4), 478–489.CrossRef Dowd, J. B., & Todd, M. (2011). Does self-reported health bias the measurement of health inequalities in US adults? evidence using anchoring vignettes from the health and retirement study. Journals of Gerontology—Series B Psychological Sciences and Social Sciences, 66 B(4), 478–489.CrossRef
23.
go back to reference Hirve, S., Gomez-Olive, X., Oti, S., Debpuur, C., Juvekar, S., Tollman, S., et al. (2013). Use of anchoring vignettes to evaluate health reporting amongst adults aged 50 years and above in Africa and Asia–testing assumptions. Global Health Action, 6, 21064. Hirve, S., Gomez-Olive, X., Oti, S., Debpuur, C., Juvekar, S., Tollman, S., et al. (2013). Use of anchoring vignettes to evaluate health reporting amongst adults aged 50 years and above in Africa and Asia–testing assumptions. Global Health Action, 6, 21064.
24.
go back to reference Peracchi, F., & Rossetti, C. (2012). Heterogeneity in health responses and anchoring vignettes. Empirical Economics, 42(2), 513–538.CrossRef Peracchi, F., & Rossetti, C. (2012). Heterogeneity in health responses and anchoring vignettes. Empirical Economics, 42(2), 513–538.CrossRef
25.
go back to reference Au, N., Lorgelly, P. K. (2014). Anchoring vignettes for health comparisons: An analysis of response consistency. Quality of Life Research, 23(6), 1721–31. Au, N., Lorgelly, P. K. (2014). Anchoring vignettes for health comparisons: An analysis of response consistency. Quality of Life Research, 23(6), 1721–31.
26.
go back to reference Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2010). Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes, 8(1), 81.PubMedCentralPubMed Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2010). Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes, 8(1), 81.PubMedCentralPubMed
27.
go back to reference King, G., & Wand, J. (2007). Comparing incomparable survey responses: Evaluating and selecting anchoring vignettes. Political Analysis., 15(1), 46–66.CrossRef King, G., & Wand, J. (2007). Comparing incomparable survey responses: Evaluating and selecting anchoring vignettes. Political Analysis., 15(1), 46–66.CrossRef
28.
go back to reference Tandon, A., Murray, C. J., Salomon, J. A., King, G. (2003). Statistical models for enhancing cross-population comparability. In C. J. Murray & D. E. Evans (Eds.), Health systems performance assessment: Debates, methods and empiricism (pp. 727–746). Geneva: World Health Organization. http://www.who.int/healthinfo/paper42. Accessed 17 April 2015. Tandon, A., Murray, C. J., Salomon, J. A., King, G. (2003). Statistical models for enhancing cross-population comparability. In C. J. Murray & D. E. Evans (Eds.), Health systems performance assessment: Debates, methods and empiricism (pp. 727–746). Geneva: World Health Organization. http://​www.​who.​int/​healthinfo/​paper42. Accessed 17 April 2015.
29.
go back to reference Rissel, C., Greaves, S., Wen, L., Capon, A., Crane, M., & Standen, C. (2013). Evaluating the transport, health and economic impacts of new urban cycling infrastructure in Sydney, Australia—protocol paper. BMC Public Health., 13(1), 963.PubMedCentralCrossRefPubMed Rissel, C., Greaves, S., Wen, L., Capon, A., Crane, M., & Standen, C. (2013). Evaluating the transport, health and economic impacts of new urban cycling infrastructure in Sydney, Australia—protocol paper. BMC Public Health., 13(1), 963.PubMedCentralCrossRefPubMed
30.
go back to reference Frank, L. D. (2000). Land use and transportation interaction implications on public health and quality of life. Journal of Planning Education and Research., 20(1), 6–22.CrossRef Frank, L. D. (2000). Land use and transportation interaction implications on public health and quality of life. Journal of Planning Education and Research., 20(1), 6–22.CrossRef
31.
go back to reference Novaco, R. W., Gonzalez, O. I. (2009). Commuting and well-being. In Y. Amichai-Hamburger (Ed.), Technology and well-being (pp. 174–205). New York: Cambridge University Press. Novaco, R. W., Gonzalez, O. I. (2009). Commuting and well-being. In Y. Amichai-Hamburger (Ed.), Technology and well-being (pp. 174–205). New York: Cambridge University Press.
32.
go back to reference Ding, D., Gebel, K., Phongsavan, P., Bauman, A. E., & Merom, D. (2014). Driving: A road to unhealthy lifestyles and poor health outcomes. PLoS ONE, 9(6), e94602.PubMedCentralCrossRefPubMed Ding, D., Gebel, K., Phongsavan, P., Bauman, A. E., & Merom, D. (2014). Driving: A road to unhealthy lifestyles and poor health outcomes. PLoS ONE, 9(6), e94602.PubMedCentralCrossRefPubMed
33.
go back to reference Renalds, A., Smith, T. H., & Hale, P. J. (2010). A systematic review of built environment and health. Family & Community Health, 33(1), 68–78.CrossRef Renalds, A., Smith, T. H., & Hale, P. J. (2010). A systematic review of built environment and health. Family & Community Health, 33(1), 68–78.CrossRef
34.
go back to reference Kelly, P., Kahlmeier, S., Götschi, T., Orsini, N., Richards, J., Roberts, N., et al. (2014). Systematic review and meta-analysis of reduction in all-cause mortality from walking and cycling and shape of dose response relationship. International Journal of al Nutrition and Physical Activity, 11(1), 132. Kelly, P., Kahlmeier, S., Götschi, T., Orsini, N., Richards, J., Roberts, N., et al. (2014). Systematic review and meta-analysis of reduction in all-cause mortality from walking and cycling and shape of dose response relationship. International Journal of al Nutrition and Physical Activity, 11(1), 132.
35.
go back to reference Murphy, B., Herrman, H., Hawthorne, G., Pinzone, T., & Evert, H. (2000). Australian WHOQoL instruments: User’s manual and interpretation guide. Melbourne: Australian WHOQOL Field Study Centre. Murphy, B., Herrman, H., Hawthorne, G., Pinzone, T., & Evert, H. (2000). Australian WHOQoL instruments: User’s manual and interpretation guide. Melbourne: Australian WHOQOL Field Study Centre.
36.
go back to reference Cummins, R. A. (2000). Personal income and subjective well-being: A review. Journal of Happiness Studies, 1(2), 133–158.CrossRef Cummins, R. A. (2000). Personal income and subjective well-being: A review. Journal of Happiness Studies, 1(2), 133–158.CrossRef
37.
go back to reference Rabe-Hesketh, S., & Skrondal, A. (2002). Estimating CHOPIT models in GLLAMM: Political efficacy example from King et al. (2002). London: Institute of Psychiatry, King’s College. Rabe-Hesketh, S., & Skrondal, A. (2002). Estimating CHOPIT models in GLLAMM: Political efficacy example from King et al. (2002). London: Institute of Psychiatry, King’s College.
38.
go back to reference Akaike, H. (1974). A new look at the statistical model identification. Automatic Control, IEEE Transactions on., 19(6), 716–723.CrossRef Akaike, H. (1974). A new look at the statistical model identification. Automatic Control, IEEE Transactions on., 19(6), 716–723.CrossRef
39.
go back to reference Schwarz, G. (1978). Estimating the dimension of a model. The annals of statistics., 6(2), 461–464.CrossRef Schwarz, G. (1978). Estimating the dimension of a model. The annals of statistics., 6(2), 461–464.CrossRef
40.
go back to reference Lumley, T., & Scott, A. (2015). AIC and BIC for modeling with complex survey data. Journal of Survey Statistics and Methodology., 3(1), 1–18.CrossRef Lumley, T., & Scott, A. (2015). AIC and BIC for modeling with complex survey data. Journal of Survey Statistics and Methodology., 3(1), 1–18.CrossRef
41.
go back to reference Cummins, R. A., Gullone, E., & Lau, A. L. D. (2002). A model of subjective well-being homeostasis: The role of personality. In E. Gullone & R. A. Cummins (Eds.), The universality of subjective wellbeing indicators: Social indicators research series (pp. 7–46). Dordrecht: Kluwer. Cummins, R. A., Gullone, E., & Lau, A. L. D. (2002). A model of subjective well-being homeostasis: The role of personality. In E. Gullone & R. A. Cummins (Eds.), The universality of subjective wellbeing indicators: Social indicators research series (pp. 7–46). Dordrecht: Kluwer.
42.
go back to reference Australian Bureau of Statistics. (2014). Australian social trends, July 2013. CAT 4102.0. Canberra: ABS. Australian Bureau of Statistics. (2014). Australian social trends, July 2013. CAT 4102.0. Canberra: ABS.
43.
go back to reference Carse, A. (2011). Assessment of transport quality of life as an alternative transport appraisal technique. Journal of Transport Geography, 19(5), 1037–1045.CrossRef Carse, A. (2011). Assessment of transport quality of life as an alternative transport appraisal technique. Journal of Transport Geography, 19(5), 1037–1045.CrossRef
44.
go back to reference Cavill, N., Kahlmeier, S., Rutter, H., Racioppi, F., & Oja, P. (2008). Economic analyses of transport infrastructure and policies including health effects related to cycling and walking: A systematic review. Transport Policy, 15(5), 291–304.CrossRef Cavill, N., Kahlmeier, S., Rutter, H., Racioppi, F., & Oja, P. (2008). Economic analyses of transport infrastructure and policies including health effects related to cycling and walking: A systematic review. Transport Policy, 15(5), 291–304.CrossRef
45.
go back to reference Mulley, C., Tyson, R., McCue, P., Rissel, C., & Munro, C. (2013). Valuing active travel: Including the health benefits of sustainable transport in transportation appraisal frameworks. Research in Transportation Business & Management., 7, 27–34.CrossRef Mulley, C., Tyson, R., McCue, P., Rissel, C., & Munro, C. (2013). Valuing active travel: Including the health benefits of sustainable transport in transportation appraisal frameworks. Research in Transportation Business & Management., 7, 27–34.CrossRef
46.
go back to reference Delbosc, A. (2012). The role of well-being in transport policy. Transport Policy, 23, 25–33.CrossRef Delbosc, A. (2012). The role of well-being in transport policy. Transport Policy, 23, 25–33.CrossRef
47.
go back to reference Bize, R., Johnson, J. A., & Plotnikoff, R. C. (2007). Physical activity level and health-related quality of life in the general adult population: A systematic review. Preventive Medicine, 45(6), 401–415.CrossRefPubMed Bize, R., Johnson, J. A., & Plotnikoff, R. C. (2007). Physical activity level and health-related quality of life in the general adult population: A systematic review. Preventive Medicine, 45(6), 401–415.CrossRefPubMed
48.
go back to reference Gatersleben, B., & Uzzell, D. (2007). Affective appraisals of the daily commute: Comparing perceptions of drivers, cyclists, walkers, and users of public transport. Environment and Behavior, 39(3), 416–431.CrossRef Gatersleben, B., & Uzzell, D. (2007). Affective appraisals of the daily commute: Comparing perceptions of drivers, cyclists, walkers, and users of public transport. Environment and Behavior, 39(3), 416–431.CrossRef
49.
go back to reference Ohta, M., Mizoue, T., Mishima, N., & Ikeda, M. (2007). Effect of the physical activities in leisure time and commuting to work on mental health. Journal of Occupational Health., 49(1), 46.CrossRefPubMed Ohta, M., Mizoue, T., Mishima, N., & Ikeda, M. (2007). Effect of the physical activities in leisure time and commuting to work on mental health. Journal of Occupational Health., 49(1), 46.CrossRefPubMed
50.
go back to reference Teresi, J. A. (2006). Different approaches to differential item functioning in health applications: Advantages, disadvantages and some neglected topics. Medical Care, 44(11), S152–S170.CrossRefPubMed Teresi, J. A. (2006). Different approaches to differential item functioning in health applications: Advantages, disadvantages and some neglected topics. Medical Care, 44(11), S152–S170.CrossRefPubMed
51.
go back to reference Tandon A, Murray C, Salomon J, King G. (2001) Statistical methods to enhance cross-population comparability (Global Programme on Evidence for Health Policy Discussion Paper No. 42). Geneva: World Health Organization. Tandon A, Murray C, Salomon J, King G. (2001) Statistical methods to enhance cross-population comparability (Global Programme on Evidence for Health Policy Discussion Paper No. 42). Geneva: World Health Organization.
Metadata
Title
Correcting bias in self-rated quality of life: an application of anchoring vignettes and ordinal regression models to better understand QoL differences across commuting modes
Authors
Melanie Crane
Chris Rissel
Stephen Greaves
Klaus Gebel
Publication date
01-02-2016
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 2/2016
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-015-1090-8

Other articles of this Issue 2/2016

Quality of Life Research 2/2016 Go to the issue