Skip to main content
Top
Published in: Quality of Life Research 12/2021

Open Access 01-12-2021

Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures

Authors: Richard Sawatzky, Jae-Yung Kwon, Ruth Barclay, Cynthia Chauhan, Lori Frank, Wilbert B. van den Hout, Lene Kongsgaard Nielsen, Sandra Nolte, Mirjam A. G. Sprangers, the Response Shift – in Sync Working Group

Published in: Quality of Life Research | Issue 12/2021

Login to get access

Abstract

Purpose

Results of patient-reported outcome measures (PROMs) are increasingly used to inform healthcare decision-making. Research has shown that response shift can impact PROM results. As part of an international collaboration, our goal is to provide a framework regarding the implications of response shift at the level of patient care (micro), healthcare institute (meso), and healthcare policy (macro).

Methods

Empirical evidence of response shift that can influence patients’ self-reported health and preferences provided the foundation for development of the framework. Measurement validity theory, hermeneutic philosophy, and micro-, meso-, and macro-level healthcare decision-making informed our theoretical analysis.

Results

At the micro-level, patients’ self-reported health needs to be interpreted via dialogue with the clinician to avoid misinterpretation of PROM data due to response shift. It is also important to consider the potential impact of response shift on study results, when these are used to support decisions. At the meso-level, individual-level data should be examined for response shift before aggregating PROM data for decision-making related to quality improvement, performance monitoring, and accreditation. At the macro-level, critical reflection on the conceptualization of health is required to know whether response shift needs to be controlled for when PROM data are used to inform healthcare coverage.

Conclusion

Given empirical evidence of response shift, there is a critical need for guidelines and knowledge translation to avoid potential misinterpretations of PROM results and consequential biases in decision-making. Our framework with guiding questions provides a structure for developing strategies to address potential impacts of response shift at micro-, meso-, and macro-levels.
Appendix
Available only for authorised users
Literature
3.
go back to reference Sprangers, M. A., & Schwartz, C. E. (1999). The challenge of response shift for quality-of-life-based clinical oncology research. Annals of Oncology: Official Journal of the European Society for Medical Oncology, 10(7), 747–749.CrossRef Sprangers, M. A., & Schwartz, C. E. (1999). The challenge of response shift for quality-of-life-based clinical oncology research. Annals of Oncology: Official Journal of the European Society for Medical Oncology, 10(7), 747–749.CrossRef
4.
go back to reference Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.CrossRef Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.CrossRef
7.
go back to reference Vanier, A., Oort, F., McClimans, L., Ow, N., Gulek, B. G., Böhnke, J. R., … Response Shift—in Sync Working Group. (n.d.). Response shift in patient-reported outcomes measures: A formal definition and a revised model. Manuscript, under review (same issue). Vanier, A., Oort, F., McClimans, L., Ow, N., Gulek, B. G., Böhnke, J. R., … Response Shift—in Sync Working Group. (n.d.). Response shift in patient-reported outcomes measures: A formal definition and a revised model. Manuscript, under review (same issue).
10.
go back to reference Hubley, A. M., & Zumbo, B. D. (2013). Psychometric characteristics of assessment procedures: An overview. In APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology (pp. 3–19). Washington, DC, US: American Psychological Association. https://doi.org/10.1037/14047-001. Hubley, A. M., & Zumbo, B. D. (2013). Psychometric characteristics of assessment procedures: An overview. In APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology (pp. 3–19). Washington, DC, US: American Psychological Association. https://​doi.​org/​10.​1037/​14047-001.
11.
go back to reference Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 65–82). Charlotte, NC: IAP Information Age Publishing. Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions, and applications (pp. 65–82). Charlotte, NC: IAP Information Age Publishing.
14.
go back to reference Hawkins, M., Elsworth, G. R., & Osborne, R. H. (2018). Application of validity theory and methodology to patient-reported outcome measures (PROMs): Building an argument for validity. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 27(7), 1695–1710. https://doi.org/10.1007/s11136-018-1815-6.CrossRef Hawkins, M., Elsworth, G. R., & Osborne, R. H. (2018). Application of validity theory and methodology to patient-reported outcome measures (PROMs): Building an argument for validity. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 27(7), 1695–1710. https://​doi.​org/​10.​1007/​s11136-018-1815-6.CrossRef
16.
go back to reference Sawatzky, R., Chan, E. K. H., Zumbo, B. D., Ahmed, S., Bartlett, S. J., Bingham, C. O., …, Lix, L. M. (2017). Montreal Accord on Patient-Reported Outcomes (PROs) use series-Paper 7: Modern perspectives of measurement validation emphasize justification of inferences based on patient reported outcome scores. Journal of Clinical Epidemiology, 89, 154–159. https://doi.org/10.1016/j.jclinepi.2016.12.002.CrossRefPubMed Sawatzky, R., Chan, E. K. H., Zumbo, B. D., Ahmed, S., Bartlett, S. J., Bingham, C. O., …, Lix, L. M. (2017). Montreal Accord on Patient-Reported Outcomes (PROs) use series-Paper 7: Modern perspectives of measurement validation emphasize justification of inferences based on patient reported outcome scores. Journal of Clinical Epidemiology, 89, 154–159. https://​doi.​org/​10.​1016/​j.​jclinepi.​2016.​12.​002.CrossRefPubMed
18.
go back to reference Oort, F. J. (2005). Towards a formal definition of response shift (in reply to G.W. Donaldson). Quality of Life Research, 14(10), 2353–2355. Oort, F. J. (2005). Towards a formal definition of response shift (in reply to G.W. Donaldson). Quality of Life Research, 14(10), 2353–2355.
22.
go back to reference Gadamer, H. G. (1998). Truth and Method (2nd ed.). New York: Continuum. Gadamer, H. G. (1998). Truth and Method (2nd ed.). New York: Continuum.
25.
go back to reference Elwyn, G., Dehlendorf, C., Epstein, R. M., Marrin, K., White, J., & Frosch, D. L. (2014). Shared decision making and motivational interviewing: Achieving patient-centred care across the spectrum of health care problems. Annals of Family Medicine, 12, 270–275.CrossRef Elwyn, G., Dehlendorf, C., Epstein, R. M., Marrin, K., White, J., & Frosch, D. L. (2014). Shared decision making and motivational interviewing: Achieving patient-centred care across the spectrum of health care problems. Annals of Family Medicine, 12, 270–275.CrossRef
30.
go back to reference Chin, K., Fukuhara, S., Takahashi, K., Sumi, K., Nakamura, T., Matsumoto, H., …, Nakamura, T. (2004). Response shift in perception of sleepiness in obstructive sleep apnea-hypopnea syndrome before and after treatment with nasal CPAP. Sleep, 27(3), 490–493.PubMed Chin, K., Fukuhara, S., Takahashi, K., Sumi, K., Nakamura, T., Matsumoto, H., …, Nakamura, T. (2004). Response shift in perception of sleepiness in obstructive sleep apnea-hypopnea syndrome before and after treatment with nasal CPAP. Sleep, 27(3), 490–493.PubMed
34.
go back to reference Ahmed, S., Sawatzky, R., Levesque, J.-F., Ehrmann-Feldman, D., & Schwartz, C. E. (2014). Minimal evidence of response shift in the absence of a catalyst. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 23(9), 2421–2430. https://doi.org/10.1007/s11136-014-0699-3.CrossRef Ahmed, S., Sawatzky, R., Levesque, J.-F., Ehrmann-Feldman, D., & Schwartz, C. E. (2014). Minimal evidence of response shift in the absence of a catalyst. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 23(9), 2421–2430. https://​doi.​org/​10.​1007/​s11136-014-0699-3.CrossRef
35.
go back to reference Joore, M. A., Potjewijd, J., Timmerman, A. A., & Anteunis, L. J. C. (2002). Response shift in the measurement of quality of life in hearing impaired adults after hearing aid fitting. Quality of Life Research, 11(4), 299–307.CrossRef Joore, M. A., Potjewijd, J., Timmerman, A. A., & Anteunis, L. J. C. (2002). Response shift in the measurement of quality of life in hearing impaired adults after hearing aid fitting. Quality of Life Research, 11(4), 299–307.CrossRef
40.
go back to reference Osborne, R. H., Hawkins, M., & Sprangers, M. A. G. (2006). Change of perspective: a measurable and desired outcome of chronic disease self-management intervention programs that violates the premise of preintervention/postintervention assessment. Arthritis and Rheumatism, 55(3), 458–465. https://doi.org/10.1002/art.21982.CrossRefPubMed Osborne, R. H., Hawkins, M., & Sprangers, M. A. G. (2006). Change of perspective: a measurable and desired outcome of chronic disease self-management intervention programs that violates the premise of preintervention/postintervention assessment. Arthritis and Rheumatism, 55(3), 458–465. https://​doi.​org/​10.​1002/​art.​21982.CrossRefPubMed
41.
go back to reference Visser, M. R. M., Oort, F. J., & Sprangers, M. A. G. (2005). Methods to detect response shift in quality of life data: A convergent validity study. Quality of Life Research, 14(3), 629–639.CrossRef Visser, M. R. M., Oort, F. J., & Sprangers, M. A. G. (2005). Methods to detect response shift in quality of life data: A convergent validity study. Quality of Life Research, 14(3), 629–639.CrossRef
54.
55.
go back to reference Barclay-Goddard, R., King, J., Dubouloz, C.-J., Schwartz, C. E., & Response Shift Think Tank Working Group. (2012). Building on transformative learning and response shift theory to investigate health-related quality of life changes over time in individuals with chronic health conditions and disability. Archives of Physical Medicine and Rehabilitation, 93(2), 214–220. https://doi.org/10.1016/j.apmr.2011.09.010.CrossRefPubMed Barclay-Goddard, R., King, J., Dubouloz, C.-J., Schwartz, C. E., & Response Shift Think Tank Working Group. (2012). Building on transformative learning and response shift theory to investigate health-related quality of life changes over time in individuals with chronic health conditions and disability. Archives of Physical Medicine and Rehabilitation, 93(2), 214–220. https://​doi.​org/​10.​1016/​j.​apmr.​2011.​09.​010.CrossRefPubMed
62.
go back to reference Greenhalgh, J., Dalkin, S., Gibbons, E., Wright, J., Valderas, J. M., Meads, D., & Black, N. (2018). How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. Journal of Health Services Research & Policy, 23(1), 57–65. https://doi.org/10.1177/1355819617740925.CrossRef Greenhalgh, J., Dalkin, S., Gibbons, E., Wright, J., Valderas, J. M., Meads, D., & Black, N. (2018). How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. Journal of Health Services Research & Policy, 23(1), 57–65. https://​doi.​org/​10.​1177/​1355819617740925​.CrossRef
65.
go back to reference Feldman, D. E., Lévesque, J.-F., Lemieux, V., Tourigny, A., Lavoie, J.-P., & Tousignant, P. (2012). Primary healthcare organization and quality-of-life outcomes for persons with chronic disease. Healthcare Policy, 7(3), 59–72.PubMedPubMedCentral Feldman, D. E., Lévesque, J.-F., Lemieux, V., Tourigny, A., Lavoie, J.-P., & Tousignant, P. (2012). Primary healthcare organization and quality-of-life outcomes for persons with chronic disease. Healthcare Policy, 7(3), 59–72.PubMedPubMedCentral
68.
go back to reference National Quality Forum. (2013). Patient reported outcomes (PROs) in performance measurement. National Quality Forum. Retrieved from http://www.qualityforum.orgProjectsn-rPatient-Reported_OutcomesPatient-Reported_Outcomes.aspx National Quality Forum. (2013). Patient reported outcomes (PROs) in performance measurement. National Quality Forum. Retrieved from http://​www.​qualityforum.​orgProjectsn-rPatient-Reported_​OutcomesPatient-Reported_​Outcomes.​aspx
69.
go back to reference Black, N., Burke, L., Forrest, C. B., Sieberer, U. H. R., Ahmed, S., Valderas, J. M., …, Alonso, J. (2016). Patient-reported outcomes: Pathways to better health, better services, and better societies. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 25(5), 1103–1112. https://doi.org/10.1007/s11136-015-1168-3.CrossRef Black, N., Burke, L., Forrest, C. B., Sieberer, U. H. R., Ahmed, S., Valderas, J. M., …, Alonso, J. (2016). Patient-reported outcomes: Pathways to better health, better services, and better societies. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 25(5), 1103–1112. https://​doi.​org/​10.​1007/​s11136-015-1168-3.CrossRef
71.
go back to reference Lau, D., Agborsangaya, C., Sayah, F. A., Wu, X., Ohinmaa, A., & Johnson, J. A. (2012). Population-level response shift: Novel implications for research. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 21(9), 1495–1498. https://doi.org/10.1007/s11136-011-0064-8.CrossRef Lau, D., Agborsangaya, C., Sayah, F. A., Wu, X., Ohinmaa, A., & Johnson, J. A. (2012). Population-level response shift: Novel implications for research. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 21(9), 1495–1498. https://​doi.​org/​10.​1007/​s11136-011-0064-8.CrossRef
73.
go back to reference Bernhard, J., Lowy, A., Maibach, R., Hürny, C., & Swiss Group for Clinical Cancer Research (SAKK) and the Swiss Institute for Applied Cancer Research (SIAK), Bern, Switzerland. (2001). Response shift in the perception of health for utility evaluation. An explorative investigation. European Journal of Cancer (Oxford England: 1990), 37(14), 1729–1735.CrossRef Bernhard, J., Lowy, A., Maibach, R., Hürny, C., & Swiss Group for Clinical Cancer Research (SAKK) and the Swiss Institute for Applied Cancer Research (SIAK), Bern, Switzerland. (2001). Response shift in the perception of health for utility evaluation. An explorative investigation. European Journal of Cancer (Oxford England: 1990), 37(14), 1729–1735.CrossRef
88.
go back to reference World Health Organization. (1946). Preamble to the Constitution of WHO as adopted by the International Health Conference, New York, 19 June–22 July 1946; signed on 22 July 1946 by the representatives of 61 States (Official Records of WHO, no. 2, p. 100) and entered into force on 7 April 1948. Retrieved from http://www.who.int/suggestions/faq/en/ World Health Organization. (1946). Preamble to the Constitution of WHO as adopted by the International Health Conference, New York, 19 June–22 July 1946; signed on 22 July 1946 by the representatives of 61 States (Official Records of WHO, no. 2, p. 100) and entered into force on 7 April 1948. Retrieved from http://​www.​who.​int/​suggestions/​faq/​en/​
90.
go back to reference Groenvold, M., Fayers, P. M., Sprangers, M. A., Bjorner, J. B., Klee, M. C., Aaronson, N. K., …, Mouridsen, H. T. (1999). Anxiety and depression in breast cancer patients at low risk of recurrence compared with the general population: A valid comparison? Journal of Clinical Epidemiology, 52(6), 523–530.CrossRef Groenvold, M., Fayers, P. M., Sprangers, M. A., Bjorner, J. B., Klee, M. C., Aaronson, N. K., …, Mouridsen, H. T. (1999). Anxiety and depression in breast cancer patients at low risk of recurrence compared with the general population: A valid comparison? Journal of Clinical Epidemiology, 52(6), 523–530.CrossRef
92.
go back to reference Mesa, R. A., Gotlib, J., Gupta, V., Catalano, J. V., Deininger, M. W., Shields, A. L., …, Verstovsek, S. (2013). Effect of ruxolitinib therapy on myelofibrosis-related symptoms and other patient-reported outcomes in COMFORT-I: A randomized, double-blind, placebo-controlled trial. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 31(10), 1285–1292. https://doi.org/10.1200/JCO.2012.44.4489.CrossRef Mesa, R. A., Gotlib, J., Gupta, V., Catalano, J. V., Deininger, M. W., Shields, A. L., …, Verstovsek, S. (2013). Effect of ruxolitinib therapy on myelofibrosis-related symptoms and other patient-reported outcomes in COMFORT-I: A randomized, double-blind, placebo-controlled trial. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 31(10), 1285–1292. https://​doi.​org/​10.​1200/​JCO.​2012.​44.​4489.CrossRef
Metadata
Title
Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures
Authors
Richard Sawatzky
Jae-Yung Kwon
Ruth Barclay
Cynthia Chauhan
Lori Frank
Wilbert B. van den Hout
Lene Kongsgaard Nielsen
Sandra Nolte
Mirjam A. G. Sprangers
the Response Shift – in Sync Working Group
Publication date
01-12-2021
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 12/2021
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-021-02766-9

Other articles of this Issue 12/2021

Quality of Life Research 12/2021 Go to the issue