Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2010

Open Access 01-12-2010 | Research

Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients

Authors: Steven McPhail, Terry Haines

Published in: Health and Quality of Life Outcomes | Issue 1/2010

Login to get access

Abstract

Background

Assessments of change in subjective patient reported outcomes such as health-related quality of life (HRQoL) are a key component of many clinical and research evaluations. However, conventional longitudinal evaluation of change may not agree with patient perceived change if patients' understanding of the subjective construct under evaluation changes over time (response shift) or if patients' have inaccurate recollection (recall bias). This study examined whether older adults' perception of change is in agreement with conventional longitudinal evaluation of change in their HRQoL over the duration of their hospital stay. It also investigated this level of agreement after adjusting patient perceived change for recall bias that patients may have experienced.

Methods

A prospective longitudinal cohort design nested within a larger randomised controlled trial was implemented. 103 hospitalised older adults participated in this investigation at a tertiary hospital facility. The EQ-5D utility and Visual Analogue Scale (VAS) scores were used to evaluate HRQoL. Participants completed EQ-5D reports as soon as they were medically stable (within three days of admission) then again immediately prior to discharge. Three methods of change score calculation were used (conventional change, patient perceived change and patient perceived change adjusted for recall bias). Agreement was primarily investigated using intraclass correlation coefficients (ICC) and limits of agreement.

Results

Overall 101 (98%) participants completed both admission and discharge assessments. The mean (SD) age was 73.3 (11.2). The median (IQR) length of stay was 38 (20-60) days. For agreement between conventional longitudinal change and patient perceived change: ICCs were 0.34 and 0.40 for EQ-5D utility and VAS respectively. For agreement between conventional longitudinal change and patient perceived change adjusted for recall bias: ICCs were 0.98 and 0.90 respectively. Discrepancy between conventional longitudinal change and patient perceived change was considered clinically meaningful for 84 (83.2%) of participants, after adjusting for recall bias this reduced to 8 (7.9%).

Conclusions

Agreement between conventional change and patient perceived change was not strong. A large proportion of this disagreement could be attributed to recall bias. To overcome the invalidating effect of response shift (on conventional change) and recall bias (on patient perceived change) a method of adjusting patient perceived change for recall bias has been described.
Appendix
Available only for authorised users
Literature
1.
go back to reference Crosby RD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003,56(5):395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef Crosby RD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003,56(5):395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef
2.
go back to reference Sullivan M: The new subjective medicine: taking the patient's point of view on health care and health. Soc Sci Med 2003,56(7):1595–1604. 10.1016/S0277-9536(02)00159-4PubMedCrossRef Sullivan M: The new subjective medicine: taking the patient's point of view on health care and health. Soc Sci Med 2003,56(7):1595–1604. 10.1016/S0277-9536(02)00159-4PubMedCrossRef
3.
go back to reference Wiklund I: Assessment of patient-reported outcomes in clinical trials: the example of health-related quality of life. Fundam Clin Pharmacol 2004,18(3):351–363. 10.1111/j.1472-8206.2004.00234.xPubMedCrossRef Wiklund I: Assessment of patient-reported outcomes in clinical trials: the example of health-related quality of life. Fundam Clin Pharmacol 2004,18(3):351–363. 10.1111/j.1472-8206.2004.00234.xPubMedCrossRef
4.
go back to reference Drummond MF, Iglesias CP, Cooper NJ: Systematic reviews and economic evaluations conducted for the National Institute for Health and Clinical Excellence in the United Kingdom: a game of two halves? Int J Technol Assess Health Care 2008,24(2):146–150. 10.1017/S0266462308080203PubMedCrossRef Drummond MF, Iglesias CP, Cooper NJ: Systematic reviews and economic evaluations conducted for the National Institute for Health and Clinical Excellence in the United Kingdom: a game of two halves? Int J Technol Assess Health Care 2008,24(2):146–150. 10.1017/S0266462308080203PubMedCrossRef
5.
go back to reference Bullinger M: Assessing health related quality of life in medicine. An overview over concepts, methods and applications in international research. Restor Neurol Neurosci 2002,20(3–4):93–101.PubMed Bullinger M: Assessing health related quality of life in medicine. An overview over concepts, methods and applications in international research. Restor Neurol Neurosci 2002,20(3–4):93–101.PubMed
6.
go back to reference Schwartz CE, Andresen EM, Nosek MA, Krahn GL: Response shift theory: important implications for measuring quality of life in people with disability. Arch Phys Med Rehabil 2007,88(4):529–536. 10.1016/j.apmr.2006.12.032PubMedCrossRef Schwartz CE, Andresen EM, Nosek MA, Krahn GL: Response shift theory: important implications for measuring quality of life in people with disability. Arch Phys Med Rehabil 2007,88(4):529–536. 10.1016/j.apmr.2006.12.032PubMedCrossRef
7.
go back to reference Schwartz CE, Rapkin BD: Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes 2004, 2: 16. 10.1186/1477-7525-2-16PubMedCentralPubMedCrossRef Schwartz CE, Rapkin BD: Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes 2004, 2: 16. 10.1186/1477-7525-2-16PubMedCentralPubMedCrossRef
8.
go back to reference Sprangers M, Schwartz C: Integrating response shift into health-related quality of life research: a theoretical model. Social Science and Medicine 1999,48(11):1507–1515. 10.1016/S0277-9536(99)00045-3PubMedCrossRef Sprangers M, Schwartz C: Integrating response shift into health-related quality of life research: a theoretical model. Social Science and Medicine 1999,48(11):1507–1515. 10.1016/S0277-9536(99)00045-3PubMedCrossRef
9.
go back to reference Visser MR, Smets EM, Sprangers MA, de Haes HJ: How response shift may affect the measurement of change in fatigue. J Pain Symptom Manage 2000,20(1):12–18. 10.1016/S0885-3924(00)00148-2PubMedCrossRef Visser MR, Smets EM, Sprangers MA, de Haes HJ: How response shift may affect the measurement of change in fatigue. J Pain Symptom Manage 2000,20(1):12–18. 10.1016/S0885-3924(00)00148-2PubMedCrossRef
10.
go back to reference Sprangers MA, Van Dam FS, Broersen J, Lodder L, Wever L, Visser MR, Oosterveld P, Smets EM: Revealing response shift in longitudinal research on fatigue--the use of the thentest approach. Acta Oncol 1999,38(6):709–718. 10.1080/028418699432824PubMedCrossRef Sprangers MA, Van Dam FS, Broersen J, Lodder L, Wever L, Visser MR, Oosterveld P, Smets EM: Revealing response shift in longitudinal research on fatigue--the use of the thentest approach. Acta Oncol 1999,38(6):709–718. 10.1080/028418699432824PubMedCrossRef
11.
go back to reference Visser MR, Oort FJ, Sprangers MA: Methods to detect response shift in quality of life data: a convergent validity study. Qual Life Res 2005,14(3):629–639. 10.1007/s11136-004-2577-xPubMedCrossRef Visser MR, Oort FJ, Sprangers MA: Methods to detect response shift in quality of life data: a convergent validity study. Qual Life Res 2005,14(3):629–639. 10.1007/s11136-004-2577-xPubMedCrossRef
12.
go back to reference Schwartz C, Sprangers M: Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine 1999, 48: 1531–1548. 10.1016/S0277-9536(99)00047-7PubMedCrossRef Schwartz C, Sprangers M: Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine 1999, 48: 1531–1548. 10.1016/S0277-9536(99)00047-7PubMedCrossRef
13.
go back to reference Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR: The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. J Clin Epidemiol 2005,58(11):1125–1133. 10.1016/j.jclinepi.2005.03.003PubMedCrossRef Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR: The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. J Clin Epidemiol 2005,58(11):1125–1133. 10.1016/j.jclinepi.2005.03.003PubMedCrossRef
14.
go back to reference Oort FJ, Visser MR, Sprangers MA: An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Qual Life Res 2005,14(3):599–609. 10.1007/s11136-004-0831-xPubMedCrossRef Oort FJ, Visser MR, Sprangers MA: An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Qual Life Res 2005,14(3):599–609. 10.1007/s11136-004-0831-xPubMedCrossRef
15.
go back to reference Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR: Response shift influenced estimates of change in health-related quality of life poststroke. J Clin Epidemiol 2004,57(6):561–570. 10.1016/j.jclinepi.2003.11.003PubMedCrossRef Ahmed S, Mayo NE, Wood-Dauphinee S, Hanley JA, Cohen SR: Response shift influenced estimates of change in health-related quality of life poststroke. J Clin Epidemiol 2004,57(6):561–570. 10.1016/j.jclinepi.2003.11.003PubMedCrossRef
16.
go back to reference McPhail S, Comans T, Haines T: Evidence of disagreement between patient perceived change and conventional longitudinal evaluation of change in health-related quality of life amongst older adults. Clin Rehabil 2010, in press. McPhail S, Comans T, Haines T: Evidence of disagreement between patient perceived change and conventional longitudinal evaluation of change in health-related quality of life amongst older adults. Clin Rehabil 2010, in press.
17.
go back to reference Hill AM, Hill K, Brauer S, Oliver D, Hoffmann T, Beer C, McPhail S, Haines TP: Evaluation of the effect of patient education on rates of falls in older hospital patients: description of a randomised controlled trial. BMC Geriatr 2009, 9: 14. 10.1186/1471-2318-9-14PubMedCentralPubMedCrossRef Hill AM, Hill K, Brauer S, Oliver D, Hoffmann T, Beer C, McPhail S, Haines TP: Evaluation of the effect of patient education on rates of falls in older hospital patients: description of a randomised controlled trial. BMC Geriatr 2009, 9: 14. 10.1186/1471-2318-9-14PubMedCentralPubMedCrossRef
18.
go back to reference Folstein MF, Folstein SE, McHugh PR: "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975,12(3):189–198. 10.1016/0022-3956(75)90026-6PubMedCrossRef Folstein MF, Folstein SE, McHugh PR: "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975,12(3):189–198. 10.1016/0022-3956(75)90026-6PubMedCrossRef
19.
go back to reference Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med 2001,33(5):337–343. 10.3109/07853890109002087PubMedCrossRef Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med 2001,33(5):337–343. 10.3109/07853890109002087PubMedCrossRef
20.
go back to reference Dolan P, Roberts J: Modelling valuations for Eq-5d health states: an alternative model using differences in valuations. Med Care 2002,40(5):442–446. 10.1097/00005650-200205000-00009PubMedCrossRef Dolan P, Roberts J: Modelling valuations for Eq-5d health states: an alternative model using differences in valuations. Med Care 2002,40(5):442–446. 10.1097/00005650-200205000-00009PubMedCrossRef
21.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986,1(8476):307–310.PubMedCrossRef Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986,1(8476):307–310.PubMedCrossRef
22.
go back to reference Walters SJ, Brazier JE: Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res 2005,14(6):1523–1532. 10.1007/s11136-004-7713-0PubMedCrossRef Walters SJ, Brazier JE: Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res 2005,14(6):1523–1532. 10.1007/s11136-004-7713-0PubMedCrossRef
23.
go back to reference Kind P, Dolan P, Gudex C, Williams A: Variations in population health status: results from a United Kingdom national questionnaire survey. BMJ (Clinical research ed) 1998,316(7133):736–741.CrossRef Kind P, Dolan P, Gudex C, Williams A: Variations in population health status: results from a United Kingdom national questionnaire survey. BMJ (Clinical research ed) 1998,316(7133):736–741.CrossRef
24.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 1979,86(2):420–428. 10.1037/0033-2909.86.2.420PubMedCrossRef Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 1979,86(2):420–428. 10.1037/0033-2909.86.2.420PubMedCrossRef
25.
go back to reference Cicchetti DV, Sparrow SA: Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American journal of mental deficiency 1981,86(2):127–137.PubMed Cicchetti DV, Sparrow SA: Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American journal of mental deficiency 1981,86(2):127–137.PubMed
26.
go back to reference Pickard AS, Johnson JA, Feeny DH, Shuaib A, Carriere KC, Nasser AM: Agreement between patient and proxy assessments of health-related quality of life after stroke using the EQ-5D and Health Utilities Index. Stroke 2004,35(2):607–612. 10.1161/01.STR.0000110984.91157.BDPubMedCrossRef Pickard AS, Johnson JA, Feeny DH, Shuaib A, Carriere KC, Nasser AM: Agreement between patient and proxy assessments of health-related quality of life after stroke using the EQ-5D and Health Utilities Index. Stroke 2004,35(2):607–612. 10.1161/01.STR.0000110984.91157.BDPubMedCrossRef
27.
go back to reference McPhail S, Haines T: The Response Shift Phenomenon in Clinical Trials. Journal of Clinical Research Best Practices 2009.,5(12): McPhail S, Haines T: The Response Shift Phenomenon in Clinical Trials. Journal of Clinical Research Best Practices 2009.,5(12):
Metadata
Title
Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients
Authors
Steven McPhail
Terry Haines
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2010
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-8-65

Other articles of this Issue 1/2010

Health and Quality of Life Outcomes 1/2010 Go to the issue