Skip to main content
Top
Published in: Quality of Life Research 4/2008

Open Access 01-05-2008

Listen to their answers! Response behaviour in the measurement of physical and role functioning

Authors: Marjan J. Westerman, Tony Hak, Mirjam A. G. Sprangers, Harry J. M. Groen, Gerrit van der Wal, Anne-Mei The

Published in: Quality of Life Research | Issue 4/2008

Login to get access

Abstract

Background

Quality of life (QoL) is considered to be an indispensable outcome measure of curative and palliative treatment. However, QoL research often yields findings that raise questions about what QoL measurement instruments actually assess and how the scores should be interpreted.

Objective

To investigate how patients interpret and respond to questions on the EORTC-QLQ-C30 over time and to find explanations to account for counterintuitive findings in QoL measurement.

Methods

Qualitative investigation was made of the response behaviour of small-cell lung cancer patients (= 23) in the measurement of QoL with the European Organization for Research and Treatment of Cancer Core Quality of Life Questionnaire (EORTC QLQ-C30). Focus was on physical functioning (PF, items 1 to 5), role functioning (RF, items 6 and 7), global health and QoL rating (GH/QOL, items 29 and 30). Interviews were held at four points: at the start of the chemotherapy, 4 weeks later, at the end, and 6 weeks after the end of chemotherapy. Patients were asked to ‘think aloud’ when filling in the questionnaire.

Results

Patients used various response strategies when answering questions about problems and limitations in functioning, which impacted the accuracy of the scale. Patients had scores suggesting they were less limited than they actually were by taking the wording of questions literally, by guessing their functioning in activities that they did not perform, and by ignoring or excluding certain activities that they could not perform.

Conclusion

Terminally ill patients evaluate their functioning in terms of what they perceive to be normal under the circumstances. Their answers can be interpreted in terms of change in the appraisal process (Rapkin and Schwartz 2004; Health and Quality of Life Outcomes, 2, 14). More care should be taken in assessing the quality of a set of questions about physical and role functioning.
Literature
1.
go back to reference Llewellyn-Thomas, H. A., Thiel, E. C., & Clark, R. M. (1989). Patients versus surrogates: Whose opinion counts on the ethics review panels? Clinical Research, 37, 51–55. Llewellyn-Thomas, H. A., Thiel, E. C., & Clark, R. M. (1989). Patients versus surrogates: Whose opinion counts on the ethics review panels? Clinical Research, 37, 51–55.
2.
go back to reference O’Connor, A. M. (1989). Effects of framing and level of probability on patients’ preferences for cancer chemotherapy. Journal of Clinical Epidemiology, 42(2), 119–126.PubMedCrossRef O’Connor, A. M. (1989). Effects of framing and level of probability on patients’ preferences for cancer chemotherapy. Journal of Clinical Epidemiology, 42(2), 119–126.PubMedCrossRef
3.
go back to reference Bremnes, R. M., Andersen, K., & Wist, E. A. (1995). Cancer patients, doctors and nurses vary in their willingness to undertake cancer chemotherapy. European Journal of Cancer, 31A, 1955–1959.PubMedCrossRef Bremnes, R. M., Andersen, K., & Wist, E. A. (1995). Cancer patients, doctors and nurses vary in their willingness to undertake cancer chemotherapy. European Journal of Cancer, 31A, 1955–1959.PubMedCrossRef
4.
go back to reference Slevin, M. L., Stubbs, L., Plant, H. J., Wilson, P., Gregory, W. M., & Armes, P. J., et al. (1990). Attitudes to chemotherapy: Comparing views of patients with cancer with those of doctors, nurses, and general public. BMJ, 300, 1458–1460.PubMed Slevin, M. L., Stubbs, L., Plant, H. J., Wilson, P., Gregory, W. M., & Armes, P. J., et al. (1990). Attitudes to chemotherapy: Comparing views of patients with cancer with those of doctors, nurses, and general public. BMJ, 300, 1458–1460.PubMed
5.
go back to reference Gralla, R. J. (2004). Quality-of-life considerations in patients with advanced lung cancer: Effect of topotecan on symptom palliation and quality of life. Oncologist, 9(Suppl. 6), 14–24.PubMedCrossRef Gralla, R. J. (2004). Quality-of-life considerations in patients with advanced lung cancer: Effect of topotecan on symptom palliation and quality of life. Oncologist, 9(Suppl. 6), 14–24.PubMedCrossRef
6.
go back to reference Groen, H. J. M., The, Sanderman, R., De Vries, E. G. E., & Mulder, N. H. (1995). Quality of life in lung cancer patients treated by radiation with and without carboplatin. Thesis Groen HJM. Exploration of new therapy for lung cancer. Groen, H. J. M., The, Sanderman, R., De Vries, E. G. E., & Mulder, N. H. (1995). Quality of life in lung cancer patients treated by radiation with and without carboplatin. Thesis Groen HJM. Exploration of new therapy for lung cancer.
7.
go back to reference Aaronson, N. K., Ahmedzai, S., Bergman, B., Bullinger, M., Cull, A., & Duez, N. J., et al. (1993). The European organization for research and treatment of cancer QLQ-C30: A quality-of-life instrument for use in international clinical trials in oncology. Journal of the National Cancer Institute, 85(5), 365–376.PubMedCrossRef Aaronson, N. K., Ahmedzai, S., Bergman, B., Bullinger, M., Cull, A., & Duez, N. J., et al. (1993). The European organization for research and treatment of cancer QLQ-C30: A quality-of-life instrument for use in international clinical trials in oncology. Journal of the National Cancer Institute, 85(5), 365–376.PubMedCrossRef
8.
go back to reference Wisloff, F., Eika, S., Hippe, E., Hjorth, M., Holmberg, E., & Kaasa, S., et al. (1996). Measurement of health-related quality of life in multiple myeloma. Nordic Myeloma Study Group. British Journal of Haematology, 92(3), 604–613.PubMedCrossRef Wisloff, F., Eika, S., Hippe, E., Hjorth, M., Holmberg, E., & Kaasa, S., et al. (1996). Measurement of health-related quality of life in multiple myeloma. Nordic Myeloma Study Group. British Journal of Haematology, 92(3), 604–613.PubMedCrossRef
9.
go back to reference Andrykowski, M. A., Brady, M. J., & Hunt, J. W. (1993). Positive psychological adjustment in potential bone marrow transplant recipients: Cancer as a psychosocial transition. Psycho-Oncology, 2, 261–276.CrossRef Andrykowski, M. A., Brady, M. J., & Hunt, J. W. (1993). Positive psychological adjustment in potential bone marrow transplant recipients: Cancer as a psychosocial transition. Psycho-Oncology, 2, 261–276.CrossRef
10.
go back to reference Bach, J. R., & Tilton, M. C. (1994). Life satisfaction and well-being measures in ventilator assisted individuals with traumatic tetraplegia. Archives of Physical Medicine and Rehabilitation, 75(6), 626–632.PubMedCrossRef Bach, J. R., & Tilton, M. C. (1994). Life satisfaction and well-being measures in ventilator assisted individuals with traumatic tetraplegia. Archives of Physical Medicine and Rehabilitation, 75(6), 626–632.PubMedCrossRef
11.
go back to reference Daltroy, L. H., Larson, M. G., Eaton, H. M., Phillips, C. B., & Liang, M. H. (1999). Discrepancies between self-reported and observed physical function in the elderly: The influence of response shift and other factors. Social Science & Medicine, 48(11), 1549–1561.CrossRef Daltroy, L. H., Larson, M. G., Eaton, H. M., Phillips, C. B., & Liang, M. H. (1999). Discrepancies between self-reported and observed physical function in the elderly: The influence of response shift and other factors. Social Science & Medicine, 48(11), 1549–1561.CrossRef
12.
go back to reference Kagawa-Singer, M. (1993). Redefining health: Living with cancer. Social Science & Medicine, 37(3), 295–304.CrossRef Kagawa-Singer, M. (1993). Redefining health: Living with cancer. Social Science & Medicine, 37(3), 295–304.CrossRef
13.
go back to reference Padilla, G. V., Mishel, M. H., & Grant, M. M. (1992). Uncertainty, appraisal and quality of life. Quality of Life Research, 1(3), 155–165.PubMedCrossRef Padilla, G. V., Mishel, M. H., & Grant, M. M. (1992). Uncertainty, appraisal and quality of life. Quality of Life Research, 1(3), 155–165.PubMedCrossRef
14.
go back to reference Groenvold, M., Fayers, P. M., Sprangers, M. A., Bjorner, J. B., Klee, M. C., & Aaronson, N. K., et al. (1999). Anxiety and depression in breast cancer patients at low risk of recurrence compared with the general population: A valid comparison? Journal of Clinical Epidemiology, 52(6), 523–530.PubMedCrossRef Groenvold, M., Fayers, P. M., Sprangers, M. A., Bjorner, J. B., Klee, M. C., & Aaronson, N. K., et al. (1999). Anxiety and depression in breast cancer patients at low risk of recurrence compared with the general population: A valid comparison? Journal of Clinical Epidemiology, 52(6), 523–530.PubMedCrossRef
15.
go back to reference Sneeuw, K. C., Aaronson, N. K., Sprangers, M. A., Detmar, S. B., Wever, L. D., & Schornagel, J. H. (1997). Value of caregiver ratings in evaluating the quality of life of patients with cancer. Journal of Clinical Oncology, 15(3), 1206–1217.PubMed Sneeuw, K. C., Aaronson, N. K., Sprangers, M. A., Detmar, S. B., Wever, L. D., & Schornagel, J. H. (1997). Value of caregiver ratings in evaluating the quality of life of patients with cancer. Journal of Clinical Oncology, 15(3), 1206–1217.PubMed
16.
go back to reference Sprangers, M. A. G., & Aaronson, N. K. (1992). The role of health care providers and significant others in evaluating the quality of life of parents with chronic disease: A review. Journal of Clinical Epidemiology, 45(7), 743–760.PubMedCrossRef Sprangers, M. A. G., & Aaronson, N. K. (1992). The role of health care providers and significant others in evaluating the quality of life of parents with chronic disease: A review. Journal of Clinical Epidemiology, 45(7), 743–760.PubMedCrossRef
17.
go back to reference Breetvelt, I. S., & Van Dam, F. S. (1991). Underreporting by cancer patients: The case of response-shift. Social Science & Medicine, 32(9), 981–987.CrossRef Breetvelt, I. S., & Van Dam, F. S. (1991). Underreporting by cancer patients: The case of response-shift. Social Science & Medicine, 32(9), 981–987.CrossRef
18.
go back to reference Frick, E., Borasio, G. D., Zehentner, H., Fischer, N., & Bumeder, I. (2004). Individual quality of life of patients undergoing autologous peripheral blood stem cell transplantation. Psycho-Oncology, 13(2), 116–124.PubMedCrossRef Frick, E., Borasio, G. D., Zehentner, H., Fischer, N., & Bumeder, I. (2004). Individual quality of life of patients undergoing autologous peripheral blood stem cell transplantation. Psycho-Oncology, 13(2), 116–124.PubMedCrossRef
19.
go back to reference Herschbach, P. (2002). Das zufriedenheitsparadox in der Lebensqualitätsforschung. Wovon hängt unser Wohlbefinden ab? Psychotherapie, Psychosomatik, Medizinische Psychologie, 52, 141–150.PubMedCrossRef Herschbach, P. (2002). Das zufriedenheitsparadox in der Lebensqualitätsforschung. Wovon hängt unser Wohlbefinden ab? Psychotherapie, Psychosomatik, Medizinische Psychologie, 52, 141–150.PubMedCrossRef
20.
go back to reference Sprangers, M. A., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science & Medicine, 48(11), 1507–1515.CrossRef Sprangers, M. A., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science & Medicine, 48(11), 1507–1515.CrossRef
21.
go back to reference Wilson, I. B. (1999). Clinical understanding and clinical implications of response shift. Social Science & Medicine, 48(11), 1577–1588.CrossRef Wilson, I. B. (1999). Clinical understanding and clinical implications of response shift. Social Science & Medicine, 48(11), 1577–1588.CrossRef
22.
go back to reference Carver, C. S., & Scheier, M. F. (2000). Scaling back goals and recalibration of the affect system are processes in normal adaptive self-regulation: Understanding ‘response shift’ phenomena. Social Science & Medicine, 50(12), 1715–1722.CrossRef Carver, C. S., & Scheier, M. F. (2000). Scaling back goals and recalibration of the affect system are processes in normal adaptive self-regulation: Understanding ‘response shift’ phenomena. Social Science & Medicine, 50(12), 1715–1722.CrossRef
23.
go back to reference Sprangers, M. A. (1996). Response-shift bias: A challenge to the assessment of patients’ quality of life in cancer clinical trials. Cancer Treatment Reviews, 22(Suppl. A), 55–62.PubMedCrossRef Sprangers, M. A. (1996). Response-shift bias: A challenge to the assessment of patients’ quality of life in cancer clinical trials. Cancer Treatment Reviews, 22(Suppl. A), 55–62.PubMedCrossRef
24.
go back to reference Westerman, M. J., Hak, T., The BAM, Groen, H., & van der Wal, G. (2006). Problems eliciting cues in SEIQoL-DW: Quality of life areas in small-cell lung cancer patients. Quality of Life Research, 15(3), 441–449. Westerman, M. J., Hak, T., The BAM, Groen, H., & van der Wal, G. (2006). Problems eliciting cues in SEIQoL-DW: Quality of life areas in small-cell lung cancer patients. Quality of Life Research, 15(3), 441–449.
25.
go back to reference Westerman, M. J., Hak, T., The BAM, Echteld, M. A., Groen, H. J., & van der Wal, G. (2007). Change in what matters to palliative patients: Eliciting information about adaptation with SEIQoL-DW. Palliative Medicine, 21(7), 581–586. Westerman, M. J., Hak, T., The BAM, Echteld, M. A., Groen, H. J., & van der Wal, G. (2007). Change in what matters to palliative patients: Eliciting information about adaptation with SEIQoL-DW. Palliative Medicine, 21(7), 581–586.
26.
go back to reference Westerman, M. J., The BAM, Sprangers, M. A., Groen, H. J., Van der Wal, G., & Hak, T. (2007). Small-cell lung cancer patients are just ‘a little bit’ tired: Response shift and self-presentation in the measurement of fatigue. Quality of Life Research, 16(5), 853–861.PubMedCrossRef Westerman, M. J., The BAM, Sprangers, M. A., Groen, H. J., Van der Wal, G., & Hak, T. (2007). Small-cell lung cancer patients are just ‘a little bit’ tired: Response shift and self-presentation in the measurement of fatigue. Quality of Life Research, 16(5), 853–861.PubMedCrossRef
27.
go back to reference Cox, K. (2003). Assessing the quality of life of patients in phase I and II anti-cancer drug trials: Interviews versus questionnaires. Social Science & Medicine, 56(5), 921–934. Cox, K. (2003). Assessing the quality of life of patients in phase I and II anti-cancer drug trials: Interviews versus questionnaires. Social Science & Medicine, 56(5), 921–934.
28.
go back to reference Bergman, B., Aaronson, N. K., Ahmedzai, S., Kaasa, S., & Sullivan, M. (1994). The EORTC QLQ-LC13: A modular supplement to the EORTC Core Quality of Life Questionnaire (QLQ-C30) for use in lung cancer clinical trials. EORTC Study Group on Quality of Life. European Journal of Cancer, 30A(5), 635–642.PubMedCrossRef Bergman, B., Aaronson, N. K., Ahmedzai, S., Kaasa, S., & Sullivan, M. (1994). The EORTC QLQ-LC13: A modular supplement to the EORTC Core Quality of Life Questionnaire (QLQ-C30) for use in lung cancer clinical trials. EORTC Study Group on Quality of Life. European Journal of Cancer, 30A(5), 635–642.PubMedCrossRef
29.
go back to reference Hak, T., Van der Veer, K., & Jansen, H. (2004). The Three-Step Test-Interview (TSTI): An observational instrument for pre-testing self-completion questionnaires. 2004. Rotterdam: Erasmus Research Institute of Management. ERIM Report ERS–2004–029–ORG. Hak, T., Van der Veer, K., & Jansen, H. (2004). The Three-Step Test-Interview (TSTI): An observational instrument for pre-testing self-completion questionnaires. 2004. Rotterdam: Erasmus Research Institute of Management. ERIM Report ERS–2004–029–ORG.
30.
go back to reference O’Boyle, C. A., Hickey, A., Joyce, C. R. B., Browne, J. P., O’Malley, K., & Hiltbrunner, B. (1993). The schedule for the evaluation of individual quality of life (SEIQOL): Administration manual. Dublin: Royal College of Surgeons in Ireland, Department of Psychology. O’Boyle, C. A., Hickey, A., Joyce, C. R. B., Browne, J. P., O’Malley, K., & Hiltbrunner, B. (1993). The schedule for the evaluation of individual quality of life (SEIQOL): Administration manual. Dublin: Royal College of Surgeons in Ireland, Department of Psychology.
31.
go back to reference O’Boyle, C. A., McGee, H., & Joyce, C. R. B. (1994). Quality of life: Assessing the individual. Advances in Medical Sociology, 5, 159–180. O’Boyle, C. A., McGee, H., & Joyce, C. R. B. (1994). Quality of life: Assessing the individual. Advances in Medical Sociology, 5, 159–180.
32.
go back to reference Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science & Medicine, 48(11), 1531–1548.CrossRef Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science & Medicine, 48(11), 1531–1548.CrossRef
33.
go back to reference Sprangers, M. A. (1988). Response shift and the retrospective pretest. The Hague: SVO. Sprangers, M. A. (1988). Response shift and the retrospective pretest. The Hague: SVO.
34.
go back to reference Sprangers, M. A., Van Dam, F. S., Broersen, J., Lodder, L., Wever, L., & Visser, M. R., et al. (1999). Revealing response shift in longitudinal research on fatigue–the use of the thentest approach. Acta Oncologica, 38(6), 709–718.PubMedCrossRef Sprangers, M. A., Van Dam, F. S., Broersen, J., Lodder, L., Wever, L., & Visser, M. R., et al. (1999). Revealing response shift in longitudinal research on fatigue–the use of the thentest approach. Acta Oncologica, 38(6), 709–718.PubMedCrossRef
35.
go back to reference Mays, N, & Pope, C. (2000). Qualitative research in health care. Assessing quality in qualitative research. BMJ, 320, 50–52. Mays, N, & Pope, C. (2000). Qualitative research in health care. Assessing quality in qualitative research. BMJ, 320, 50–52.
36.
go back to reference Yin, R. K. (1989). Case study research: Design and methods. London: Sage. Yin, R. K. (1989). Case study research: Design and methods. London: Sage.
37.
go back to reference Mallinson, S. (1998). The Short-form 36 and older people: Some problems encountered when using postal administration. Journal of Epidemiology and Community Health, 52(5), 324–328.PubMedCrossRef Mallinson, S. (1998). The Short-form 36 and older people: Some problems encountered when using postal administration. Journal of Epidemiology and Community Health, 52(5), 324–328.PubMedCrossRef
38.
go back to reference Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2,14. Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2,14.
Metadata
Title
Listen to their answers! Response behaviour in the measurement of physical and role functioning
Authors
Marjan J. Westerman
Tony Hak
Mirjam A. G. Sprangers
Harry J. M. Groen
Gerrit van der Wal
Anne-Mei The
Publication date
01-05-2008
Publisher
Springer Netherlands
Published in
Quality of Life Research / Issue 4/2008
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-008-9333-6

Other articles of this Issue 4/2008

Quality of Life Research 4/2008 Go to the issue