Skip to main content
Top
Published in: Quality of Life Research 10/2021

Open Access 01-10-2021 | Addiction

Assessing baseline dependency of anchor-based minimal important change (MIC): don’t stratify on the baseline score!

Authors: Berend Terluin, Ewa M. Roos, Caroline B. Terwee, Jonas B. Thorlund, Lina H. Ingelsrud

Published in: Quality of Life Research | Issue 10/2021

Login to get access

Abstract

Purpose

The minimal important change (MIC) of a patient-reported outcome measure (PROM) is often suspected to be baseline dependent, typically in the sense that patients who are in a poorer baseline health condition need greater improvement to qualify as minimally important. Testing MIC baseline dependency is commonly performed by creating two or more subgroups, stratified on the baseline PROM score. This study’s purpose was to show that this practice produces biased subgroup MIC estimates resulting in spurious MIC baseline dependency, and to develop alternative methods to evaluate MIC baseline dependency.

Methods

Datasets with PROM baseline and follow-up scores and transition ratings were simulated with and without MIC baseline dependency. Mean change MICs, ROC-based MICs, predictive MICs, and adjusted MICs were estimated before and after stratification on the baseline score. Three alternative methods were developed and evaluated. The methods were applied in a real data example for illustration.

Results

Baseline stratification resulted in biased subgroup MIC estimates and the false impression of MIC baseline dependency, due to redistribution of measurement error. Two of the alternative methods require a second baseline measurement with the same PROM or another correlated PROM. The third method involves the construction of two parallel tests based on splitting the PROM’s item set. Two methods could be applied to the real data.

Conclusion

MIC baseline dependency should not be tested in subgroups based on stratification on the baseline PROM score. Instead, one or more of the suggested alternative methods should be used.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status. Ascertaining the minimal clinically important difference. Controlled Clinical Trials, 10, 407–415.CrossRef Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status. Ascertaining the minimal clinically important difference. Controlled Clinical Trials, 10, 407–415.CrossRef
2.
go back to reference Devji, T., Carrasco-Labra, A., & Guyatt, G. (2020). Mind the methods of determining minimal important differences: Three critical issues to consider. Evidence-Based Mental Health, 24, 77–81.CrossRef Devji, T., Carrasco-Labra, A., & Guyatt, G. (2020). Mind the methods of determining minimal important differences: Three critical issues to consider. Evidence-Based Mental Health, 24, 77–81.CrossRef
3.
go back to reference Guyatt, G. H., Norman, G. R., Juniper, E. F., & Griffith, L. E. (2002). A critical look at transition ratings. Journal of Clinical Epidemiology, 55(9), 900–908.CrossRef Guyatt, G. H., Norman, G. R., Juniper, E. F., & Griffith, L. E. (2002). A critical look at transition ratings. Journal of Clinical Epidemiology, 55(9), 900–908.CrossRef
4.
go back to reference Hays, R. D., Brodsky, M., Johnston, M. F., Spritzer, K. L., & Hui, K. K. (2005). Evaluating the statistical significance of health-related quality-of-life change in individual patients. Evaluation and the Health Professions, 28(2), 160–171.CrossRef Hays, R. D., Brodsky, M., Johnston, M. F., Spritzer, K. L., & Hui, K. K. (2005). Evaluating the statistical significance of health-related quality-of-life change in individual patients. Evaluation and the Health Professions, 28(2), 160–171.CrossRef
5.
go back to reference Deyo, R. A., & Centor, R. M. (1986). Assessing the responsiveness of functional scales to clinical change: An analogy to diagnostic test performance. Journal of Chronic Diseases, 39, 897–906.CrossRef Deyo, R. A., & Centor, R. M. (1986). Assessing the responsiveness of functional scales to clinical change: An analogy to diagnostic test performance. Journal of Chronic Diseases, 39, 897–906.CrossRef
6.
go back to reference Terluin, B., Eekhout, I., Terwee, C. B., & de Vet, H. C. W. (2015). Minimal important change (MIC) based on a predictive modeling approach was more precise than MIC based on ROC analysis. Journal of Clinical Epidemiology, 68, 1388–1396.CrossRef Terluin, B., Eekhout, I., Terwee, C. B., & de Vet, H. C. W. (2015). Minimal important change (MIC) based on a predictive modeling approach was more precise than MIC based on ROC analysis. Journal of Clinical Epidemiology, 68, 1388–1396.CrossRef
7.
go back to reference Terluin, B., Eekhout, I., & Terwee, C. B. (2017). The anchor-based minimal important change, based on receiver operating characteristic analysis or predictive modeling, may need to be adjusted for the proportion of improved patients. Journal of Clinical Epidemiology, 83, 90–100.CrossRef Terluin, B., Eekhout, I., & Terwee, C. B. (2017). The anchor-based minimal important change, based on receiver operating characteristic analysis or predictive modeling, may need to be adjusted for the proportion of improved patients. Journal of Clinical Epidemiology, 83, 90–100.CrossRef
8.
go back to reference de Vet, H. C., Foumani, M., Scholten, M. A., Jacobs, W. C., Stiggelbout, A. M., Knol, D. L., & Peul, W. C. (2015). Minimally important change values of a measurement instrument depend more on baseline values than on the type of intervention. Journal of Clinical Epidemiology, 68(5), 518–524.CrossRef de Vet, H. C., Foumani, M., Scholten, M. A., Jacobs, W. C., Stiggelbout, A. M., Knol, D. L., & Peul, W. C. (2015). Minimally important change values of a measurement instrument depend more on baseline values than on the type of intervention. Journal of Clinical Epidemiology, 68(5), 518–524.CrossRef
9.
go back to reference Wang, Y. C., Hart, D. L., Stratford, P. W., & Mioduski, J. E. (2011). Baseline dependency of minimal clinically important improvement. Physical Therapy, 91(5), 675–688.CrossRef Wang, Y. C., Hart, D. L., Stratford, P. W., & Mioduski, J. E. (2011). Baseline dependency of minimal clinically important improvement. Physical Therapy, 91(5), 675–688.CrossRef
10.
go back to reference Chiarotto, A., Vanti, C., Cedraschi, C., Ferrari, S., de Lima, E. S. R. F., Ostelo, R. W., & Pillastrini, P. (2016). Responsiveness and minimal important change of the Pain Self-Efficacy Questionnaire and short forms in patients with chronic low back pain. The Journal of Pain, 17(6), 707–718.CrossRef Chiarotto, A., Vanti, C., Cedraschi, C., Ferrari, S., de Lima, E. S. R. F., Ostelo, R. W., & Pillastrini, P. (2016). Responsiveness and minimal important change of the Pain Self-Efficacy Questionnaire and short forms in patients with chronic low back pain. The Journal of Pain, 17(6), 707–718.CrossRef
11.
go back to reference Schuller, W., Ostelo, R. W., Janssen, R., & de Vet, H. C. (2014). The influence of study population and definition of improvement on the smallest detectable change and the minimal important change of the neck disability index. Health and Quality of Life Outcomes, 12, 53.CrossRef Schuller, W., Ostelo, R. W., Janssen, R., & de Vet, H. C. (2014). The influence of study population and definition of improvement on the smallest detectable change and the minimal important change of the neck disability index. Health and Quality of Life Outcomes, 12, 53.CrossRef
12.
go back to reference Farrar, J. T., Young, J. P., LaMoreaux, L., Werth, J. L., & Poole, R. M. (2001). Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain, 94, 149–158.CrossRef Farrar, J. T., Young, J. P., LaMoreaux, L., Werth, J. L., & Poole, R. M. (2001). Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain, 94, 149–158.CrossRef
13.
go back to reference Thorlund, J. B., Christensen, R., Nissen, N., Jorgensen, U., Schjerning, J., Porneki, J. C., Englund, M., & Lohmander, L. S. (2013). Knee Arthroscopy Cohort Southern Denmark (KACS): Protocol for a prospective cohort study. British Medical Journal Open, 3(10), e003399. Thorlund, J. B., Christensen, R., Nissen, N., Jorgensen, U., Schjerning, J., Porneki, J. C., Englund, M., & Lohmander, L. S. (2013). Knee Arthroscopy Cohort Southern Denmark (KACS): Protocol for a prospective cohort study. British Medical Journal Open, 3(10), e003399.
14.
go back to reference Roos, E. M., Roos, H. P., Lohmander, L. S., Ekdahl, C., & Beynnon, B. D. (1998). Knee Injury and Osteoarthritis Outcome Score (KOOS)—Development of a self-administered outcome measure. Journal of Orthopaedic and Sports Physical Therapy, 28(2), 88–96.CrossRef Roos, E. M., Roos, H. P., Lohmander, L. S., Ekdahl, C., & Beynnon, B. D. (1998). Knee Injury and Osteoarthritis Outcome Score (KOOS)—Development of a self-administered outcome measure. Journal of Orthopaedic and Sports Physical Therapy, 28(2), 88–96.CrossRef
15.
go back to reference Pedersen, J. R., Roos, E. M., Thorlund, J. B., Terluin, B., & Ingelsrud, L. H. (2021). Cut-off values to interpret short-term treatment outcomes after arthroscopic meniscal surgery measured with the Knee Injury and Osteoarthritis Outcome Score. Journal of Orthopaedic & Sports Physical Therapy, 51, 1–31 (Accepted for publication). Pedersen, J. R., Roos, E. M., Thorlund, J. B., Terluin, B., & Ingelsrud, L. H. (2021). Cut-off values to interpret short-term treatment outcomes after arthroscopic meniscal surgery measured with the Knee Injury and Osteoarthritis Outcome Score. Journal of Orthopaedic & Sports Physical Therapy, 51, 1–31 (Accepted for publication).
Metadata
Title
Assessing baseline dependency of anchor-based minimal important change (MIC): don’t stratify on the baseline score!
Authors
Berend Terluin
Ewa M. Roos
Caroline B. Terwee
Jonas B. Thorlund
Lina H. Ingelsrud
Publication date
01-10-2021
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 10/2021
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-021-02886-2

Other articles of this Issue 10/2021

Quality of Life Research 10/2021 Go to the issue