Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2006

Open Access 01-12-2006 | Commentary

Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change

Authors: Henrica C de Vet, Caroline B Terwee, Raymond W Ostelo, Heleen Beckerman, Dirk L Knol, Lex M Bouter

Published in: Health and Quality of Life Outcomes | Issue 1/2006

Login to get access

Abstract

Changes in scores on health status questionnaires are difficult to interpret. Several methods to determine minimally important changes (MICs) have been proposed which can broadly be divided in distribution-based and anchor-based methods. Comparisons of these methods have led to insight into essential differences between these approaches. Some authors have tried to come to a uniform measure for the MIC, such as 0.5 standard deviation and the value of one standard error of measurement (SEM). Others have emphasized the diversity of MIC values, depending on the type of anchor, the definition of minimal importance on the anchor, and characteristics of the disease under study. A closer look makes clear that some distribution-based methods have been merely focused on minimally detectable changes. For assessing minimally important changes, anchor-based methods are preferred, as they include a definition of what is minimally important. Acknowledging the distinction between minimally detectable and minimally important changes is useful, not only to avoid confusion among MIC methods, but also to gain information on two important benchmarks on the scale of a health status measurement instrument. Appreciating the distinction, it becomes possible to judge whether the minimally detectable change of a measurement instrument is sufficiently small to detect minimally important changes.
Literature
1.
go back to reference Jacobson N, Follette W, Revenstorf D: Toward a standard definition of clinically significant change. Behavior Therapy 1986, 17: 308–311. 10.1016/S0005-7894(86)80061-2CrossRef Jacobson N, Follette W, Revenstorf D: Toward a standard definition of clinically significant change. Behavior Therapy 1986, 17: 308–311. 10.1016/S0005-7894(86)80061-2CrossRef
2.
go back to reference Jaeschke R, Singer J, Guyatt GH: Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials 1989, 10: 407–415. 10.1016/0197-2456(89)90005-6PubMedCrossRef Jaeschke R, Singer J, Guyatt GH: Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials 1989, 10: 407–415. 10.1016/0197-2456(89)90005-6PubMedCrossRef
3.
go back to reference Jacobson NS, Truax P: Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991, 59: 12–19. 10.1037/0022-006X.59.1.12PubMedCrossRef Jacobson NS, Truax P: Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991, 59: 12–19. 10.1037/0022-006X.59.1.12PubMedCrossRef
4.
go back to reference Lydick E, Epstein RS: Interpretation of quality of life changes. Qual Life Res 1993, 2: 221–226. 10.1007/BF00435226PubMedCrossRef Lydick E, Epstein RS: Interpretation of quality of life changes. Qual Life Res 1993, 2: 221–226. 10.1007/BF00435226PubMedCrossRef
5.
go back to reference Crosby RD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003, 56: 395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef Crosby RD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003, 56: 395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef
6.
go back to reference Deyo RA, Centor RM: Assessing the responsiveness of functional scales to clinical change : an analogy to diagnostic test performance. J Chron Dis 1986, 39: 897–906. 10.1016/0021-9681(86)90038-XPubMedCrossRef Deyo RA, Centor RM: Assessing the responsiveness of functional scales to clinical change : an analogy to diagnostic test performance. J Chron Dis 1986, 39: 897–906. 10.1016/0021-9681(86)90038-XPubMedCrossRef
7.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. New York: McGraw-Hill; 1994. Nunnally JC, Bernstein IH: Psychometric theory. New York: McGraw-Hill; 1994.
8.
go back to reference Schmidt FL, Le H, Ilies R: Beyond alpha: an empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychol Methods 2003, 8: 206–224. 10.1037/1082-989X.8.2.206PubMedCrossRef Schmidt FL, Le H, Ilies R: Beyond alpha: an empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychol Methods 2003, 8: 206–224. 10.1037/1082-989X.8.2.206PubMedCrossRef
9.
go back to reference Norquist JM, Fitzpatrick R, Jenkinson C: Health-related quality of life in amyotrophic lateral sclerosis: determining a meaningful deterioration. Qual Life Res 2004, 13: 1409–1414. 10.1023/B:QURE.0000040786.75103.3aPubMedCrossRef Norquist JM, Fitzpatrick R, Jenkinson C: Health-related quality of life in amyotrophic lateral sclerosis: determining a meaningful deterioration. Qual Life Res 2004, 13: 1409–1414. 10.1023/B:QURE.0000040786.75103.3aPubMedCrossRef
10.
go back to reference Wyrwich KW, Tierney WM, Wolinsky FD: Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. J Clin Epidemiol 1999, 52: 861–873. 10.1016/S0895-4356(99)00071-2PubMedCrossRef Wyrwich KW, Tierney WM, Wolinsky FD: Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. J Clin Epidemiol 1999, 52: 861–873. 10.1016/S0895-4356(99)00071-2PubMedCrossRef
11.
go back to reference Wyrwich KW, Nienaber NA, Tierney WM, Wolinsky FD: Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. Med Care 1999, 37: 469–478. 10.1097/00005650-199905000-00006PubMedCrossRef Wyrwich KW, Nienaber NA, Tierney WM, Wolinsky FD: Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. Med Care 1999, 37: 469–478. 10.1097/00005650-199905000-00006PubMedCrossRef
12.
go back to reference Cella D, Eton DT, Fairclough DL, Bonomi P, Heyes AE, Silberman C, Wolf MK, Johnson DH: What is a clinically meaningful change on the Functional Assessment of Cancer Therapy-Lung (FACT-L) Questionnaire? Results from Eastern Cooperative Oncology Group (ECOG) Study 5592. J Clin Epidemiol 2002, 55: 285–295. 10.1016/S0895-4356(01)00477-2PubMedCrossRef Cella D, Eton DT, Fairclough DL, Bonomi P, Heyes AE, Silberman C, Wolf MK, Johnson DH: What is a clinically meaningful change on the Functional Assessment of Cancer Therapy-Lung (FACT-L) Questionnaire? Results from Eastern Cooperative Oncology Group (ECOG) Study 5592. J Clin Epidemiol 2002, 55: 285–295. 10.1016/S0895-4356(01)00477-2PubMedCrossRef
13.
go back to reference Crosby RD, Kolotkin RL, Williams GR: An integrated method to determine meaningful changes in health-related quality of life. J Clin Epidemiol 2004, 57: 1153–1160. 10.1016/j.jclinepi.2004.04.004PubMedCrossRef Crosby RD, Kolotkin RL, Williams GR: An integrated method to determine meaningful changes in health-related quality of life. J Clin Epidemiol 2004, 57: 1153–1160. 10.1016/j.jclinepi.2004.04.004PubMedCrossRef
14.
go back to reference Yost KJ, Cella D, Chawla A, Holmgren E, Eton DT, Ayanian JZ, West DW: Minimally important differences were estimated for the Functional Assessment of Cancer Therapy-Colorectal (FACT-C) instrument using a combination of distribution- and anchor-based approaches. J Clin Epidemiol 2005, 58: 1241–1251. 10.1016/j.jclinepi.2005.07.008PubMedCrossRef Yost KJ, Cella D, Chawla A, Holmgren E, Eton DT, Ayanian JZ, West DW: Minimally important differences were estimated for the Functional Assessment of Cancer Therapy-Colorectal (FACT-C) instrument using a combination of distribution- and anchor-based approaches. J Clin Epidemiol 2005, 58: 1241–1251. 10.1016/j.jclinepi.2005.07.008PubMedCrossRef
15.
go back to reference Wyrwich KW: Minimal important difference thresholds and the standard error of measurement: is there a connection? J Biopharm Stat 2004, 14: 97–110. 10.1081/BIP-120028508PubMedCrossRef Wyrwich KW: Minimal important difference thresholds and the standard error of measurement: is there a connection? J Biopharm Stat 2004, 14: 97–110. 10.1081/BIP-120028508PubMedCrossRef
16.
go back to reference Stratford PW, Binkley JM, Riddle DL, Guyatt GH: Sensitivity to change of the Roland-Morris Back Pain Questionnaire: part 1. Phys Ther 1998, 78: 1186–1196.PubMed Stratford PW, Binkley JM, Riddle DL, Guyatt GH: Sensitivity to change of the Roland-Morris Back Pain Questionnaire: part 1. Phys Ther 1998, 78: 1186–1196.PubMed
17.
go back to reference Stratford PW, Riddle DL, Binkley JM, Spadoni G, Westaway MD, Padfield B: Using the neck disability index to make decisions concerning individual patients. Physiother Can 1999, 51: 107–112. Stratford PW, Riddle DL, Binkley JM, Spadoni G, Westaway MD, Padfield B: Using the neck disability index to make decisions concerning individual patients. Physiother Can 1999, 51: 107–112.
18.
go back to reference Binkley JM, Stratford PW, Lott SA, Riddle DL: The Lower Extremity Functional Scale (LEFS): scale development, measurement properties, and clinical application. North American Orthopaedic Rehabilitation Research Network. Phys Ther 1999, 79: 371–383.PubMed Binkley JM, Stratford PW, Lott SA, Riddle DL: The Lower Extremity Functional Scale (LEFS): scale development, measurement properties, and clinical application. North American Orthopaedic Rehabilitation Research Network. Phys Ther 1999, 79: 371–383.PubMed
19.
go back to reference Wyrwich KW, Tierney WM, Wolinsky FD: Using the standard error of measurement to identify important changes on the Asthma Quality of Life Questionnaire. Qual Life Res 2002, 11: 1–7. 10.1023/A:1014485627744PubMedCrossRef Wyrwich KW, Tierney WM, Wolinsky FD: Using the standard error of measurement to identify important changes on the Asthma Quality of Life Questionnaire. Qual Life Res 2002, 11: 1–7. 10.1023/A:1014485627744PubMedCrossRef
20.
go back to reference Beurskens AJ, de Vet HC, Koke AJ, Lindeman E, van der Heijden GJ, Regtop W, Knipschild PG: A patient-specific approach for measuring functional status in low back pain. J Manipulative Physiol Ther 1999, 22: 144–148. 10.1016/S0161-4754(99)70127-2PubMedCrossRef Beurskens AJ, de Vet HC, Koke AJ, Lindeman E, van der Heijden GJ, Regtop W, Knipschild PG: A patient-specific approach for measuring functional status in low back pain. J Manipulative Physiol Ther 1999, 22: 144–148. 10.1016/S0161-4754(99)70127-2PubMedCrossRef
21.
go back to reference Davidson M, Keating JL: A comparison of five low back disability questionnaires: reliability and responsiveness. Phys Ther 2002, 82: 8–24.PubMed Davidson M, Keating JL: A comparison of five low back disability questionnaires: reliability and responsiveness. Phys Ther 2002, 82: 8–24.PubMed
22.
go back to reference Farrar JT, Portenoy RK, Berlin JA, Kinman JL, Strom BL: Defining the clinically important difference in pain outcome measures. Pain 2000, 88: 287–294. 10.1016/S0304-3959(00)00339-0PubMedCrossRef Farrar JT, Portenoy RK, Berlin JA, Kinman JL, Strom BL: Defining the clinically important difference in pain outcome measures. Pain 2000, 88: 287–294. 10.1016/S0304-3959(00)00339-0PubMedCrossRef
23.
go back to reference Ostelo RW, de Vet HC, Knol DL, van den Brandt PA: 24-item Roland-Morris Disability Questionnaire was preferred out of six functional status questionnaires for post-lumbar disc surgery. J Clin Epidemiol 2004, 57: 268–276. 10.1016/j.jclinepi.2003.09.005PubMedCrossRef Ostelo RW, de Vet HC, Knol DL, van den Brandt PA: 24-item Roland-Morris Disability Questionnaire was preferred out of six functional status questionnaires for post-lumbar disc surgery. J Clin Epidemiol 2004, 57: 268–276. 10.1016/j.jclinepi.2003.09.005PubMedCrossRef
24.
go back to reference Van der Roer N, Ostelo RW, Bekkering GE, van Tulder MW, de Vet HC: Minimal clinically important change for different outcome measures in patients with non-specific low back pain. Spine 2006, 31: 578–582. 10.1097/01.brs.0000201293.57439.47PubMedCrossRef Van der Roer N, Ostelo RW, Bekkering GE, van Tulder MW, de Vet HC: Minimal clinically important change for different outcome measures in patients with non-specific low back pain. Spine 2006, 31: 578–582. 10.1097/01.brs.0000201293.57439.47PubMedCrossRef
25.
go back to reference Sloan JA, Cella D, Hays RD: Clinical significance of patient-reported questionnaire data : another step toward consensus. J Clin Epidemiol 2005, 58: 1217–1219. 10.1016/j.jclinepi.2005.07.009PubMedCrossRef Sloan JA, Cella D, Hays RD: Clinical significance of patient-reported questionnaire data : another step toward consensus. J Clin Epidemiol 2005, 58: 1217–1219. 10.1016/j.jclinepi.2005.07.009PubMedCrossRef
26.
go back to reference Kosinski M, Zhao SZ, Dedhiya S, Osterhaus JT, Ware JE Jr: Determining minimally important changes in generic and disease-specific health-related quality of life questionnaires in clinical trials of rheumatoid arthritis. Arthritis Rheum 2000, 43: 1478–1487. Publisher Full Text 10.1002/1529-0131(200007)43:7<1478::AID-ANR10>3.0.CO;2-MPubMedCrossRef Kosinski M, Zhao SZ, Dedhiya S, Osterhaus JT, Ware JE Jr: Determining minimally important changes in generic and disease-specific health-related quality of life questionnaires in clinical trials of rheumatoid arthritis. Arthritis Rheum 2000, 43: 1478–1487. Publisher Full Text 10.1002/1529-0131(200007)43:7<1478::AID-ANR10>3.0.CO;2-MPubMedCrossRef
27.
go back to reference Hagg O, Fritzell P, Nordwall A: The clinical importance of changes in outcome scores after treatment for chronic low back pain. Eur Spine J 2003, 12: 12–20.PubMed Hagg O, Fritzell P, Nordwall A: The clinical importance of changes in outcome scores after treatment for chronic low back pain. Eur Spine J 2003, 12: 12–20.PubMed
28.
go back to reference Riddle DL, Stratford PW, Binkley JM: Sensitivity to change of the Roland-Morris Back Pain Questionnaire: part 2. Phys Ther 1998, 78: 1197–1207.PubMed Riddle DL, Stratford PW, Binkley JM: Sensitivity to change of the Roland-Morris Back Pain Questionnaire: part 2. Phys Ther 1998, 78: 1197–1207.PubMed
29.
go back to reference Juniper EF, Guyatt GH, Willan A, Griffith LE: Determining a minimal important change in a disease-specific Quality of Life Questionnaire. J Clin Epidemiol 1994, 47: 81–87. 10.1016/0895-4356(94)90036-1PubMedCrossRef Juniper EF, Guyatt GH, Willan A, Griffith LE: Determining a minimal important change in a disease-specific Quality of Life Questionnaire. J Clin Epidemiol 1994, 47: 81–87. 10.1016/0895-4356(94)90036-1PubMedCrossRef
30.
go back to reference Redelmeier DA, Guyatt GH, Goldstein RS: Assessing the minimal important difference in symptoms: a comparison of two techniques. J Clin Epidemiol 1996, 49: 1215–1219. 10.1016/S0895-4356(96)00206-5PubMedCrossRef Redelmeier DA, Guyatt GH, Goldstein RS: Assessing the minimal important difference in symptoms: a comparison of two techniques. J Clin Epidemiol 1996, 49: 1215–1219. 10.1016/S0895-4356(96)00206-5PubMedCrossRef
31.
go back to reference Cella D, Hahn EA, Dineen K: Meaningful change in cancer-specific quality of life scores : differences between improvement and worsening. Qual Life Res 2002, 11: 207–221. 10.1023/A:1015276414526PubMedCrossRef Cella D, Hahn EA, Dineen K: Meaningful change in cancer-specific quality of life scores : differences between improvement and worsening. Qual Life Res 2002, 11: 207–221. 10.1023/A:1015276414526PubMedCrossRef
32.
go back to reference Ware JE, Snow K, Kosinski M, Gandek B: SF-36 Health Survey: Manual and Interpretation Guide. Boston: The Health Institute; 1993. Ware JE, Snow K, Kosinski M, Gandek B: SF-36 Health Survey: Manual and Interpretation Guide. Boston: The Health Institute; 1993.
33.
go back to reference Hays RD, Woolley JM: The concept of clinically meaningful difference in health-related quality-of-life research. How meaningful is it? Pharmacoeconomics 2000, 18: 419–423. 10.2165/00019053-200018050-00001PubMedCrossRef Hays RD, Woolley JM: The concept of clinically meaningful difference in health-related quality-of-life research. How meaningful is it? Pharmacoeconomics 2000, 18: 419–423. 10.2165/00019053-200018050-00001PubMedCrossRef
34.
go back to reference Hays RD, Farivar SS, Liu H: Approaches and recommendations for estimating minimally important differences for health-related quality of life measures. COPD: Journal of Chronic Obstructive Pulmonary Disease 2005, 2: 63–67.PubMedCrossRef Hays RD, Farivar SS, Liu H: Approaches and recommendations for estimating minimally important differences for health-related quality of life measures. COPD: Journal of Chronic Obstructive Pulmonary Disease 2005, 2: 63–67.PubMedCrossRef
35.
go back to reference Ostelo RW, de Vet HC: Clinically important outcomes in low back pain. Best Pract Res Clin Rheumatol 2005, 19: 593–607. 10.1016/j.berh.2005.03.003PubMedCrossRef Ostelo RW, de Vet HC: Clinically important outcomes in low back pain. Best Pract Res Clin Rheumatol 2005, 19: 593–607. 10.1016/j.berh.2005.03.003PubMedCrossRef
36.
go back to reference Norman GR, Sloan JA, Wyrwich KW: Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003, 41: 582–592. 10.1097/00005650-200305000-00004PubMed Norman GR, Sloan JA, Wyrwich KW: Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003, 41: 582–592. 10.1097/00005650-200305000-00004PubMed
37.
go back to reference Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek ALM: Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res 2001, 10: 571–578. 10.1023/A:1013138911638PubMedCrossRef Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek ALM: Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res 2001, 10: 571–578. 10.1023/A:1013138911638PubMedCrossRef
38.
go back to reference Salaffi F, Stancati A, Silvestri CA, Ciapetti A, Grassi W: Minimal clinically important changes in chronic musculoskeletal pain intensity measured on a numerical rating scale. Eur J Pain 2004, 8: 283–291. 10.1016/j.ejpain.2003.09.004PubMedCrossRef Salaffi F, Stancati A, Silvestri CA, Ciapetti A, Grassi W: Minimal clinically important changes in chronic musculoskeletal pain intensity measured on a numerical rating scale. Eur J Pain 2004, 8: 283–291. 10.1016/j.ejpain.2003.09.004PubMedCrossRef
39.
go back to reference de Boer MR, de Vet HC, Terwee CB, Moll AC, Volker-Dieben HJ, van Rens GH: Changes to the subscales of two vision-related quality of life questionnaires are proposed. J Clin Epidemiol 2005, 58: 1260–1268. 10.1016/j.jclinepi.2005.04.007PubMedCrossRef de Boer MR, de Vet HC, Terwee CB, Moll AC, Volker-Dieben HJ, van Rens GH: Changes to the subscales of two vision-related quality of life questionnaires are proposed. J Clin Epidemiol 2005, 58: 1260–1268. 10.1016/j.jclinepi.2005.04.007PubMedCrossRef
Metadata
Title
Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change
Authors
Henrica C de Vet
Caroline B Terwee
Raymond W Ostelo
Heleen Beckerman
Dirk L Knol
Lex M Bouter
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2006
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-4-54

Other articles of this Issue 1/2006

Health and Quality of Life Outcomes 1/2006 Go to the issue