Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2004

Open Access 01-12-2004 | Review

Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal

Authors: Carolyn E Schwartz, Bruce D Rapkin

Published in: Health and Quality of Life Outcomes | Issue 1/2004

Login to get access

Abstract

The increasing evidence for response shift phenomena in quality of life (QOL) assessment points to the necessity to reconsider both the measurement model and the application of psychometric analyses. The proposed psychometric model posits that the QOL true score is always contingent upon parameters of the appraisal process. This new model calls into question existing methods for establishing the reliability and validity of QOL assessment tools and suggests several new approaches for describing the psychometric properties of these scales. Recommendations for integrating the assessment of appraisal into QOL research and clinical practice are discussed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schwartz CE, Sprangers MAG: Methodological approaches for assessing response shift in longitudinal quality of life research. Social Science and Medicine 1999, 48: 1531–1548. 10.1016/S0277-9536(99)00047-7PubMedCrossRef Schwartz CE, Sprangers MAG: Methodological approaches for assessing response shift in longitudinal quality of life research. Social Science and Medicine 1999, 48: 1531–1548. 10.1016/S0277-9536(99)00047-7PubMedCrossRef
2.
go back to reference Bjorner JB, Ware JE, Kosinski M: The potential synergy between cognitive models and modern psychometric models. Quality of Life Research 2003,12(3):261–274. 10.1023/A:1023295421684PubMedCrossRef Bjorner JB, Ware JE, Kosinski M: The potential synergy between cognitive models and modern psychometric models. Quality of Life Research 2003,12(3):261–274. 10.1023/A:1023295421684PubMedCrossRef
3.
go back to reference Rapkin BD, Schwartz CE: Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes 2004, 2: 14. 10.1186/1477-7525-2-14PubMedCentralPubMedCrossRef Rapkin BD, Schwartz CE: Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes 2004, 2: 14. 10.1186/1477-7525-2-14PubMedCentralPubMedCrossRef
5.
go back to reference Ryff CD: Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology 1989, 57: 1069–1081. 10.1037//0022-3514.57.6.1069CrossRef Ryff CD: Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology 1989, 57: 1069–1081. 10.1037//0022-3514.57.6.1069CrossRef
6.
go back to reference Sprangers MAG, Schwartz CE: Integrating response shift into health-related quality-of-life research: A theoretical model. Social Science and Medicine 1999, 48: 1507–1515. 10.1016/S0277-9536(99)00045-3PubMedCrossRef Sprangers MAG, Schwartz CE: Integrating response shift into health-related quality-of-life research: A theoretical model. Social Science and Medicine 1999, 48: 1507–1515. 10.1016/S0277-9536(99)00045-3PubMedCrossRef
7.
go back to reference Jobe JB: Cognitive psychology and self-reports: Models and methods. Quality of Life Research 2003,12(3):219–227. 10.1023/A:1023279029852PubMedCrossRef Jobe JB: Cognitive psychology and self-reports: Models and methods. Quality of Life Research 2003,12(3):219–227. 10.1023/A:1023279029852PubMedCrossRef
8.
go back to reference Schwartz CE, Coulthard-Morris L, Cole B, Vollmer T: The quality-of-life effects of interferon beta-1b in multiple sclerosis. An extended Q-TWiST analysis. Arch Neurol 1997,54(12):1475–1480.PubMedCrossRef Schwartz CE, Coulthard-Morris L, Cole B, Vollmer T: The quality-of-life effects of interferon beta-1b in multiple sclerosis. An extended Q-TWiST analysis. Arch Neurol 1997,54(12):1475–1480.PubMedCrossRef
9.
go back to reference Rapkin B: Personal goals and response shifts: Understanding the impact of illness and events on the quality of life of people living with AIDS. In: Adaptation to changing health: Response shift in quality of life research (Edited by: Schwartz CE, Sprangers MAG). American Psychological Association, Washington D.C 2000, 53–71.CrossRef Rapkin B: Personal goals and response shifts: Understanding the impact of illness and events on the quality of life of people living with AIDS. In: Adaptation to changing health: Response shift in quality of life research (Edited by: Schwartz CE, Sprangers MAG). American Psychological Association, Washington D.C 2000, 53–71.CrossRef
10.
go back to reference Cronbach LJ, Linn RL, Brennan RL, et al.: Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational & Psychological Measurement 1997, 57: 373–399.CrossRef Cronbach LJ, Linn RL, Brennan RL, et al.: Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational & Psychological Measurement 1997, 57: 373–399.CrossRef
11.
go back to reference Fayers PM, Machin D: Factor analysis. In: Quality of life assessment in clinical trials: Methods and practice (Edited by: Staquet MJ, Hays RD, Fayers PM). Oxford University Press, Oxford 1998, 191–223. Fayers PM, Machin D: Factor analysis. In: Quality of life assessment in clinical trials: Methods and practice (Edited by: Staquet MJ, Hays RD, Fayers PM). Oxford University Press, Oxford 1998, 191–223.
12.
go back to reference Meredith W: Latent variable models for studying differences and change. In: Best methods for the analysis of change (Edited by: Collins LM, Horn JL). American Psychological Association, Washington DC 1991, 149–163. Meredith W: Latent variable models for studying differences and change. In: Best methods for the analysis of change (Edited by: Collins LM, Horn JL). American Psychological Association, Washington DC 1991, 149–163.
13.
go back to reference Rausch G: An item analysis which takes individual differences into account. British Journal of Mathematical and Statistical Psychology 1966, 19: 49–57.CrossRef Rausch G: An item analysis which takes individual differences into account. British Journal of Mathematical and Statistical Psychology 1966, 19: 49–57.CrossRef
14.
go back to reference Collins D: Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research 2003,12(3):229–238. 10.1023/A:1023254226592PubMedCrossRef Collins D: Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research 2003,12(3):229–238. 10.1023/A:1023254226592PubMedCrossRef
15.
go back to reference Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16: 297–334.CrossRef Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16: 297–334.CrossRef
16.
go back to reference Schwartz CE, Daltroy LH: Learning from unreliability: The importance of inconsistency in coping dynamics. Social Science and Medicine 1999, 48: 619–631. 10.1016/S0277-9536(98)00353-0PubMedCrossRef Schwartz CE, Daltroy LH: Learning from unreliability: The importance of inconsistency in coping dynamics. Social Science and Medicine 1999, 48: 619–631. 10.1016/S0277-9536(98)00353-0PubMedCrossRef
17.
go back to reference Nunnally JC, Bernstein IH: Psychometric Theory 3 Edition McGraw-Hill, Inc., New York 1994. Nunnally JC, Bernstein IH: Psychometric Theory 3 Edition McGraw-Hill, Inc., New York 1994.
18.
go back to reference Cronbach LJ, Meehl PE: Construct Validity in Psychological Tests. Psychological Bulletin 1955, 52: 281–302.PubMedCrossRef Cronbach LJ, Meehl PE: Construct Validity in Psychological Tests. Psychological Bulletin 1955, 52: 281–302.PubMedCrossRef
19.
go back to reference Rapkin BD, Fischer K: Framing the construct of life satisfaction in terms of older adults' personal goals. Psychology and Aging 1992,7(1):138–149. 10.1037//0882-7974.7.1.138PubMedCrossRef Rapkin BD, Fischer K: Framing the construct of life satisfaction in terms of older adults' personal goals. Psychology and Aging 1992,7(1):138–149. 10.1037//0882-7974.7.1.138PubMedCrossRef
20.
go back to reference Schwartz CE, Sprangers MAG, Carey A, et al.: Exploring response shift in longitudinal data. Psychology and Health 2004,19(1):51–69. 10.1080/0887044031000118456CrossRef Schwartz CE, Sprangers MAG, Carey A, et al.: Exploring response shift in longitudinal data. Psychology and Health 2004,19(1):51–69. 10.1080/0887044031000118456CrossRef
21.
go back to reference Carver CS, Scheier MF: Scaling back goals and recalibration of the affect system are processes in normal adaptive self-regulation: understanding "response shift" phenomena. Social Science and Medicine 2000, 50: 1715–1722. 10.1016/S0277-9536(99)00412-8PubMedCrossRef Carver CS, Scheier MF: Scaling back goals and recalibration of the affect system are processes in normal adaptive self-regulation: understanding "response shift" phenomena. Social Science and Medicine 2000, 50: 1715–1722. 10.1016/S0277-9536(99)00412-8PubMedCrossRef
22.
go back to reference Helson H: Adaptation Level Theory New York: Harper & Row 1964. Helson H: Adaptation Level Theory New York: Harper & Row 1964.
23.
go back to reference Folkman S: Positive psychological states and coping with severe stress. Social Science and Medicine 1997, 45: 1207–1221. 10.1016/S0277-9536(97)00040-3PubMedCrossRef Folkman S: Positive psychological states and coping with severe stress. Social Science and Medicine 1997, 45: 1207–1221. 10.1016/S0277-9536(97)00040-3PubMedCrossRef
24.
go back to reference Brandtstädter J, Renner G: Tenacious goal pursuit and flexible goal adjustment: Explication and age-related analysis of assimilation and accommodation strategies of coping. Psychology and Aging 1990, 5: 58–67. 10.1037//0882-7974.5.1.58PubMedCrossRef Brandtstädter J, Renner G: Tenacious goal pursuit and flexible goal adjustment: Explication and age-related analysis of assimilation and accommodation strategies of coping. Psychology and Aging 1990, 5: 58–67. 10.1037//0882-7974.5.1.58PubMedCrossRef
25.
go back to reference Mayergoyz ID: Mathematical models of hysteresis New York: Springer-Verlag 1991.CrossRef Mayergoyz ID: Mathematical models of hysteresis New York: Springer-Verlag 1991.CrossRef
26.
go back to reference Scherer KR: Emotions as episodes of subsystems synchronization driven by nonlinear appraisal processes. In: Emotion, development, and self-organization: Dynamic systems approaches to emotional development. Cambridge studies in social and emotional development (Edited by: Lewis MD, Granic I). Cambridge University Press, New York, NY, US 2000, 70–99.CrossRef Scherer KR: Emotions as episodes of subsystems synchronization driven by nonlinear appraisal processes. In: Emotion, development, and self-organization: Dynamic systems approaches to emotional development. Cambridge studies in social and emotional development (Edited by: Lewis MD, Granic I). Cambridge University Press, New York, NY, US 2000, 70–99.CrossRef
27.
go back to reference Leventhal H, Colman S: Quality of life: A process view. Psychology and Health 1997, 12: 753–767.CrossRef Leventhal H, Colman S: Quality of life: A process view. Psychology and Health 1997, 12: 753–767.CrossRef
28.
go back to reference Allison PJ, Locker D, Feine JS: Quality of life: A dynamic construct. Social Science and Medicine 1997, 45: 221–230. 10.1016/S0277-9536(96)00339-5PubMedCrossRef Allison PJ, Locker D, Feine JS: Quality of life: A dynamic construct. Social Science and Medicine 1997, 45: 221–230. 10.1016/S0277-9536(96)00339-5PubMedCrossRef
29.
go back to reference Schwartz CE, Feinberg RG, Jilinskaia E, Applegate JC: An evaluation of a psychosocial intervention for survivors of childhood cancer: paradoxical effects of response shift over time. Psychooncology 1999,8(4):344–354. 10.1002/(SICI)1099-1611(199907/08)8:4<344::AID-PON399>3.3.CO;2-KPubMedCrossRef Schwartz CE, Feinberg RG, Jilinskaia E, Applegate JC: An evaluation of a psychosocial intervention for survivors of childhood cancer: paradoxical effects of response shift over time. Psychooncology 1999,8(4):344–354. 10.1002/(SICI)1099-1611(199907/08)8:4<344::AID-PON399>3.3.CO;2-KPubMedCrossRef
30.
go back to reference Rees JE, Waldron D, O'Boyle CA, et al.: Response shift in individualized quality of life in patients with advanced prostate cancer [abstract]. Clinical Therapeutics 2002,24(Supplement B):33–34.CrossRef Rees JE, Waldron D, O'Boyle CA, et al.: Response shift in individualized quality of life in patients with advanced prostate cancer [abstract]. Clinical Therapeutics 2002,24(Supplement B):33–34.CrossRef
31.
go back to reference Bryk AS, Raudenbush SW: Hierarchical Linear Models: Applications and Data Analysis methods Sage, Newbury Park 1992. Bryk AS, Raudenbush SW: Hierarchical Linear Models: Applications and Data Analysis methods Sage, Newbury Park 1992.
Metadata
Title
Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal
Authors
Carolyn E Schwartz
Bruce D Rapkin
Publication date
01-12-2004
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2004
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-2-16

Other articles of this Issue 1/2004

Health and Quality of Life Outcomes 1/2004 Go to the issue