Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Quality of Life Research
Published in: Quality of Life Research 12/2021

Open Access 01-12-2021 | Commentary

Response shift in results of patient-reported outcome measures: a commentary to The Response Shift—in Sync Working Group initiative

Authors: Mirjam A. G. Sprangers, Tolulope Sajobi, Antoine Vanier, Nancy E. Mayo, Richard Sawatzky, Lisa M. Lix, Frans J. Oort, Véronique Sébille, The Response Shift—in Sync Working Group

Published in: Quality of Life Research | Issue 12/2021

Login to get access

Abstract

Purpose

The Working Group undertook a critical, comprehensive synthesis of the response shift work to date. We aimed to (1) describe the rationale for this initiative; (2) outline how the Working Group operated; (3) summarize the papers that comprise this initiative; and (4) discuss the way forward.

Methods

Four interdisciplinary teams, consisting of response shift experts, external experts, and new investigators, prepared papers on (1) definitions and theoretical underpinnings, (2) operationalizations and response shift methods, (3) implications for healthcare decision-making, and (4) on the published magnitudes of response shift effects. Draft documents were discussed during a two-day meeting. Papers were reviewed by all members.

Results

Vanier and colleagues revised the formal definition and theory of response shift, and applied these in an amended, explanatory model of response shift. Sébille and colleagues conducted a critical examination of eleven response shift methods and concluded that for each method extra steps are required to make the response shift interpretation plausible. Sawatzky and colleagues created a framework for considering the impact of response shift on healthcare decision-making at the level of the individual patient (micro), the organization (meso), and policy (macro). Sajobi and colleagues are conducting a meta-analysis of published response shift effects. Preliminary findings indicate that the mean effect sizes are often small and variable across studies that measure different outcomes and use different methods.

Conclusion

Future response shift research will benefit from collaboration among diverse people, formulating alternative hypotheses of response shift, and conducting the most conclusive studies aimed at testing these (falsification).
Appendix
Available only for authorised users
Literature
1.
Breetvelt, I. S., & Van Dam, F. S. (1991). Underreporting by cancer patients: the case of response-shift. Social Science and Medicine, 32(9), 981–987.CrossRef
2.
Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979). Internal invalidity in pretest posttest self-report evaluations and a reevaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23.CrossRef
3.
Schwartz, C. E., & Sprangers, M. A. G. (1999). The challenge of response shift [Editorial]. Social Science & Medicine, 48, 1505–1506.CrossRef
4.
Schwartz, C. E., & Sprangers, M. A. G. (2000). Adaptation to Changing Health: Response Shift in Quality of Life Research. Washington, DC: American Psychological Association.CrossRef
5.
Golembiewski, R. T., Billingsley, K., & Yeager, S. (1975). Measuring change and persistence in human affairs: types of change generated by OD designs. The Journal of Applied Behavioral Science, 12(2), 133–157.CrossRef
6.
Sprangers, M. A. G., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science and Medicine, 48(11), 1507–1515.CrossRef
7.
Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine, 48(11), 1531–1548.CrossRef
8.
Daltroy, L. H., Larson, M. G., Eaton, H. M., Phillips, C. B., & Liang, M. H. (1999). Discrepancies between self-reported and observed physical function in the elderly: the influence of response shift and other factors. Social Science and Medicine, 48(11), 1549–1561.CrossRef
9.
Wilson, I. B. (1999). Clinical understanding and clinical implications of response shift. Social Science and Medicine, 48(11), 1577–1588.CrossRef
10.
Schwartz, C. E., & Sendor, M. (1999). Helping others helps oneself: response shift effects in peer support. Social Science and Medicine, 48(11), 1563–1575.CrossRef
11.
12.
13.
Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14, 587–598.CrossRef
14.
Oort, F. J., Visser, M. R. M., & Sprangers, M. A. G. (2009). Formal definitions of measurement bias and explanation bias clarify measurement and conceptual perspectives on response shift. Journal of Clinical Epidemiology, 62(11), 1126–1137.CrossRef
15.
Sajobi, T. T., Brahmbatt, R., Lix, L. M., Zumbo, B. D., & Sawatzky, R. (2018). Scoping review of response shift methods: Current reporting practices and recommendations. Quality of Life Research, 27(5), 1133–1146.CrossRef
16.
Ahmed, S., Schwartz, C., Ring, L., & Sprangers, M. A. G. (2009). Applications of health-related quality of life for guiding health care: advances in response shift research [Editorial]. Journal of Clinical Epidemiology, 62, 1115–1117.CrossRef
17.
18.
19.
20.
Eton, D. T. (2010). Why we need response shift: an appeal to functionalism. Quality of Life Research, 19(6), 929–930.CrossRef
21.
22.
Schwartz C.E., Sprangers M. & Fayers, P. (2005). Response shift: you know it's there but how do you capture it? Challenges for the next phase of research. In: Fayers, P., & Hays, R. Assessing Quality of Life in Clinical Trials. Methods and Practice (pp. 275–290). Oxford: University Press, second edition.
23.
Sawatzky, R., Sajobi, T. T., Brahmbhatt, R., Chan, E. K. H., Lix, L. M., & Zumbo, B. D. (2017). Longitudinal change in response processes: A response shift perspective. In B. D. Zumbo & A. M. Hubley (Eds.), Understanding and investigating response processes in validation research (pp. 251–276). New York: Springer.CrossRef
24.
Hartog, I. D., Willems, D. L., van den Hout, W. B., Scherer-Rath, M., Oreel, T. H., Henriques, J. P. S., et al. (2019). Influence of response shift and disposition on patient-reported outcomes may lead to suboptimal medical decisions: a medical ethics perspective. BMC Medical Ethics, 20(1), 61.CrossRef
25.
Schwartz, C. E., Bode, R., Repucci, N., Becker, J., Sprangers, M. A. G., & Fayers, P. (2006). The clinical significance of adaptation to changing health: a meta-analysis of response shift. Quality Life Research, 15(9), 1553–1550.
26.
27.
28.
Vanier, A., Oort, F. J., McClimans, L., Ow, N., Gulek, B. G., Böhnke, J. R., Sprangers, M. A. G., Sébille, V., Mayo, N., & the Response Shift - in Sync Working Group. Response shift in patient-reported outcomes: definition, theory, and a revised model. Manuscript under review (same issue).
29.
Sébille, V., Lix, L. M., Ayilara, O. F., Sajobi, T. T., Janssens, C. A. J. W., Sawatzky, R., Sprangers, M. A. G., Verdam, M. G. E., & the Response Shift – in Sync Working Group. Critical examination of current response shift methods and proposal for advancing new methods. Manuscript accepted (same issue).
30.
Beeken, R. J., Eiser, C., & Dalley, C. (2011). Health-related quality of life in haematopoietic stem cell transplant survivors: a qualitative study on the role of psychosocial variables and response shifts. Quality of Life Research, 20(2), 153–160.CrossRef
31.
Ring, L., Höfer, S., Heuston, F., Harris, D., & O’Boyle, C. A. (2005). Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients. Health Quality of Life Outcomes, 3, 55.CrossRef
32.
Korfage, I. J., de Koning, H. J., & Essink-Bot, M. L. (2007). Response shift due to diagnosis and primary treatment of localized prostate cancer: A then-test and a vignette study. Quality of Life Research, 16(10), 1627–1634.CrossRef
33.
Guilleux, A., Blanchin, M., Vanier, A., Guillemin, F., Falissard, B., Schwartz, C. E., et al. (2015). RespOnse Shift ALgorithm in Item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Quality of Life Research, 24(3), 553–564.CrossRef
34.
Blanchin, M., Guilleux, A., Hardouin, J. B., & Sébille, V. (2020). Comparison of structural equation modelling, item response theory and Rasch measurement theory-based methods for response shift detection at item level: A simulation study. Statistical Methods Medical Research, 29(4), 1015–1029.CrossRef
35.
Lix, L. M., Sajobi, T. T., Sawatzky, R., Liu, J., Mayo, N. E., Huang, Y., et al. (2013). Relative importance measures for reprioritization response shift. Quality of Life Research, 22(4), 695–703.CrossRef
36.
Li, Y., & Rapkin, B. (2009). Classification and regression tree uncovered hierarchy of psychosocial determinants underlying quality-of-life response shift in HIV/AIDS. Journal of Clinical Epidemiology, 62(11), 1138–1147.CrossRef
37.
Boucekine, M., Boyer, L., Baumstarck, K., Millier, A., Ghattas, B., Auquier, P., & Toumi, M. (2015). Exploring the response shift effect on the quality of life of patients with schizophrenia: An application of the random forest method. Medical Decision Making, 35(3), 388–397.CrossRef
38.
Mayo, N. E., Scott, S. C., Dendukuri, N., Ahmed, S., & Wood-Dauphinee, S. (2008). Identifying response shift statistically at the individual level. Quality of Life Research, 17(4), 627–639.CrossRef
39.
Sawatzky, R., Kwon, J.-Y., Barclay, R. Chauhan, C., Frank, L., Van den Hout, W., Kongsgaard Nielsen, L., Nolte, S., Sprangers, M. A. G., & the Response Shift – in Sync Working Group. Implications of response shift for micro, meso, and macro healthcare decision making using patient-reported outcomes. Manuscript accepted (same issue).
40.
Sawatzky, R., Chan, E. K. H., Zumbo, B. D., Ahmed, S., Bartlett, S. J., Bingham, C. O., & Lix, L. M. (2017). Montreal Accord on Patient-Reported Outcomes (PROs) use series-Paper 7: modern perspectives of measurement validation emphasize justification of inferences based on patient reported outcome scores. Journal of Clinical Epidemiology, 89, 154–159. https://​doi.​org/​10.​1016/​j.​jclinepi.​2016.​12.​002.CrossRefPubMed
41.
42.
Fiedler, K. (2004). Tools, toys, truisms, and theories: Some thoughts on the creative cycle of theory formation. Personality and Social Psychology Review, 8(2), 123–131.CrossRef
43.
44.
Tversky, A., & Kahneman, D. (1982). Judgment under uncertainty: Heuristics and biases. In D. Kahenman, P. Slovic, & A. Tversky (Eds.), Judgment Under Uncertainty: Heuristics and Biases (pp. 3–20). Cambridge, UK: Cambridge University Press.CrossRef
45.
Popper, K. R. (1959). The Logic of Scientific Discovery. New York: Basic Books.
46.
Roberts, S., & Pashler, H. (2000). How persuasive is a good fit? A comment on theory of testing. Psychological Review, 107(2), 358–367.CrossRef
47.
Rodgers, J. L., & Rowe, D. C. (2002). Theory development should begin (but not end) with good empirical fits: a comment on Roberts and Pashler (2000). Psychological Review, 109(3), 599–604.CrossRef
48.
49.
Metadata
Title
Response shift in results of patient-reported outcome measures: a commentary to The Response Shift—in Sync Working Group initiative
Authors
Mirjam A. G. Sprangers
Tolulope Sajobi
Antoine Vanier
Nancy E. Mayo
Richard Sawatzky
Lisa M. Lix
Frans J. Oort
Véronique Sébille
The Response Shift—in Sync Working Group
Publication date
01-12-2021
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 12/2021
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-020-02747-4

Other articles of this Issue 12/2021

Quality of Life Research 12/2021 Go to the issue

OriginalPaper

Response shift in patient-reported outcomes: definition, theory, and a revised model

OriginalPaper

Health-related quality of life in patients with chronic hepatitis C treated with sofosbuvir-based treatment at 1-year post-sustained virological response

Letter to the Editor

Progress in response-shift research needs diverse approaches

OriginalPaper

Factors associated with oral health-related quality of life during pregnancy: a prospective observational study

OriginalPaper

Trends in health-related quality of life of female breast cancer survivors using the Medical Expenditure Panel Survey (MEPS), 2008–2016

OriginalPaper

Parent-child discrepancies in health-related quality of life of children and adolescents with myalgic encephalomyelitis/chronic fatigue syndrome