Skip to main content
Top
Published in:

Open Access 28-09-2024 | Commentary

Significant individual change should be used as a lower bound for anchor based estimates of meaningful change on patient-reported outcome scores

Authors: John Devin Peipert, David Cella, Ron D. Hays

Published in: Quality of Life Research | Issue 12/2024

Login to get access

Abstract

Interpretation of patient-reported outcome (PRO) scores has been supported by identifying score thresholds or ranges that indicate clinical importance. There has been a recent focus on the estimation of meaningful within patient change (MWPC). While much attention has been focused on anchor-based methods, some researchers prefer that a lower bound to these estimates should exceed a change score that could be observed due to measurement error alone as a safeguard against misclassifying individual patients as changed when they have not. The standard error of measurement (SEM) is often used as the lower bound of anchor estimates. Here, we argue that the SEM is not an the best lower bound for MWPCs. Instead, statistically significant individual change as calculated by the reliable change index (RCI) should be used as the lower bound. Our argument is based on two points. First, conceptually, the SEM does not provide specific enough information to serve as a lower bound for MWPCs, which should be based on the level of observed score change that is unlikely to be due to chance alone. Second, the SEM is not appropriate for direct application to observed scores, and requires a multiplier when examining observed change instead of true change. We conclude with recommendations for using the RCI with a thoughtful range of p-values in combination with anchor estimates.
Literature
2.
go back to reference Cella, D., Eton, D. T., Lai, J.-S., Peterman, A. H., & Merkel, D. E. (2002). Combining anchor and distribution-based methods to derive minimal clinically important differences on the functional assessment of cancer therapy (FACT) anemia and fatigue scales. Journal of Pain and Symptom Management, 24(6), 547–561. https://doi.org/10.1016/S0885-3924(02)00529-8CrossRefPubMed Cella, D., Eton, D. T., Lai, J.-S., Peterman, A. H., & Merkel, D. E. (2002). Combining anchor and distribution-based methods to derive minimal clinically important differences on the functional assessment of cancer therapy (FACT) anemia and fatigue scales. Journal of Pain and Symptom Management, 24(6), 547–561. https://​doi.​org/​10.​1016/​S0885-3924(02)00529-8CrossRefPubMed
13.
go back to reference Griffiths, P., Sims, J., Williams, A., et al. (2022). How strong should my anchor be for estimating group and individual level meaningful change? A simulation study assessing anchor correlation strength and the impact of sample size, distribution of change scores and methodology on establishing a true meaningful change threshold. Quality of Life Research. https://doi.org/10.1007/s11136-022-03286-wCrossRefPubMedPubMedCentral Griffiths, P., Sims, J., Williams, A., et al. (2022). How strong should my anchor be for estimating group and individual level meaningful change? A simulation study assessing anchor correlation strength and the impact of sample size, distribution of change scores and methodology on establishing a true meaningful change threshold. Quality of Life Research. https://​doi.​org/​10.​1007/​s11136-022-03286-wCrossRefPubMedPubMedCentral
23.
go back to reference Blampied, N. M. (2022). Reliable change and the reliable change index: still useful after all these years? The Cognitive Behaviour Therapist, 15, e50.CrossRef Blampied, N. M. (2022). Reliable change and the reliable change index: still useful after all these years? The Cognitive Behaviour Therapist, 15, e50.CrossRef
24.
go back to reference Christensen, L. B., & Mendoza, J. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy., 17, 305–308.CrossRef Christensen, L. B., & Mendoza, J. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy., 17, 305–308.CrossRef
26.
go back to reference American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. 2014. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. 2014.
29.
go back to reference King, M. T., Dueck, A. C., & Revicki, D. A. (2019). Can methods developed for interpreting group-level patient-reported outcome data be applied to individual patient management? Medical Care, 57, S38–S45.CrossRefPubMedPubMedCentral King, M. T., Dueck, A. C., & Revicki, D. A. (2019). Can methods developed for interpreting group-level patient-reported outcome data be applied to individual patient management? Medical Care, 57, S38–S45.CrossRefPubMedPubMedCentral
33.
go back to reference Lord, F. M., Novick, M. R., & Birnbaum, A. (1968). Statistical theories of mental test scores. Addison-Wesley. Lord, F. M., Novick, M. R., & Birnbaum, A. (1968). Statistical theories of mental test scores. Addison-Wesley.
Metadata
Title
Significant individual change should be used as a lower bound for anchor based estimates of meaningful change on patient-reported outcome scores
Authors
John Devin Peipert
David Cella
Ron D. Hays
Publication date
28-09-2024
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 12/2024
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-024-03788-9