Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2005

Open Access 01-12-2005 | Review

Assessing sensitivity to change: choosing the appropriate change coefficient

Authors: Paul W Stratford, Daniel L Riddle

Published in: Health and Quality of Life Outcomes | Issue 1/2005

Login to get access

Abstract

The past 20-years have seen the development and evaluation of many health status measures. Unlike the high standards demanded of those who conduct and report clinical intervention trials, the methodological rigor for studies examining the sensitivity to change of health status measures are less demanding. It is likely that the absence of a criterion standard for change in health status contributes to this shortcoming. To increase confidence in the results of these types of studies investigators have often calculated multiple change coefficients for the same patient sample.
The purpose of this report is to identify the conflict that arises when multiple change coefficients are applied to the same patient sample.
Three families of change coefficients based on different assumptions concerning the sample composition are identified: (1) the sample is homogeneous with respect to change; (2) subgroups of patients who truly change by different amounts exist; (3) individual patients, many of whom truly change by different amounts exist. We present several analyses which illustrate a major conceptual conflict: the signal (a measure's true ability to detect change) for some of these coefficients appears in the noise term (measurement error) of the others.
We speculate that this dilemma occurs as a result of insufficient preparatory work such as pilot studies to establish the likely change characteristic of the patient population of interest. Uncertainty in the choice of change coefficient could be overcome by conducting pilot studies to ascertain the likely change characteristic of the population of interest. Once the population's change characteristic is identified, the choice of change coefficient should be clear.
Literature
1.
go back to reference Liang MH, Fossel AH, Larson MG: Comparisons of five health status instruments for orthopaedic evaluation. Med Care 1990, 28: 632–642.PubMedCrossRef Liang MH, Fossel AH, Larson MG: Comparisons of five health status instruments for orthopaedic evaluation. Med Care 1990, 28: 632–642.PubMedCrossRef
2.
go back to reference Stucki G, Liang MH, Fossel AH, Katz JN: Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis. J Clin Epidemiol 1995, 48: 1369–1378. 10.1016/0895-4356(95)00054-2PubMedCrossRef Stucki G, Liang MH, Fossel AH, Katz JN: Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis. J Clin Epidemiol 1995, 48: 1369–1378. 10.1016/0895-4356(95)00054-2PubMedCrossRef
3.
go back to reference Deyo RA, Andersson G, Bombardier C, Cherkin DC, Keller RB, Lee CK, Liang MH, Lipscomb B, Shekelle P, Spratt KF, et al.: Outcome measures for studying patients with low back pain. Spine 1994,19(18 Suppl):2032S-2036S..PubMedCrossRef Deyo RA, Andersson G, Bombardier C, Cherkin DC, Keller RB, Lee CK, Liang MH, Lipscomb B, Shekelle P, Spratt KF, et al.: Outcome measures for studying patients with low back pain. Spine 1994,19(18 Suppl):2032S-2036S..PubMedCrossRef
4.
go back to reference Kopec JA, Esdaile JM, Abrahamowicz M, Abenhaim L, Wood-Dauphinee S, Lamping DL, Williams JI: The Quebec Back Pain Disability Scale. Measurement properties. Spine 1995,20(3):341–352.PubMedCrossRef Kopec JA, Esdaile JM, Abrahamowicz M, Abenhaim L, Wood-Dauphinee S, Lamping DL, Williams JI: The Quebec Back Pain Disability Scale. Measurement properties. Spine 1995,20(3):341–352.PubMedCrossRef
5.
go back to reference Wright JG, Young NL: A comparison of different indices of responsiveness. J Clin Epidemiol 1997,50(3):239–246. 10.1016/S0895-4356(96)00373-3PubMedCrossRef Wright JG, Young NL: A comparison of different indices of responsiveness. J Clin Epidemiol 1997,50(3):239–246. 10.1016/S0895-4356(96)00373-3PubMedCrossRef
6.
go back to reference Poiraudeau S, Chevalier X, Conrozier T, Flippo RM, Liote F, Noel E, Lefevre-Colau MM, Fermanian J, Revel M, Rhumato R: Reliability, validity, and sensitivity to change of the Cochin hand functional disability scale in hand osteoarthritis. Osteoarthritis Cartilage 2001,9(6):570–577. 10.1053/joca.2001.0422PubMedCrossRef Poiraudeau S, Chevalier X, Conrozier T, Flippo RM, Liote F, Noel E, Lefevre-Colau MM, Fermanian J, Revel M, Rhumato R: Reliability, validity, and sensitivity to change of the Cochin hand functional disability scale in hand osteoarthritis. Osteoarthritis Cartilage 2001,9(6):570–577. 10.1053/joca.2001.0422PubMedCrossRef
7.
go back to reference Grotle M, Brox JI, Vollestad NK: Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain. Spine 2004, 29: E492-E501. 10.1097/01.brs.0000143664.02702.0bPubMedCrossRef Grotle M, Brox JI, Vollestad NK: Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain. Spine 2004, 29: E492-E501. 10.1097/01.brs.0000143664.02702.0bPubMedCrossRef
8.
go back to reference Pengel LHM: Responsiveness of pain, disability, and physical impairment outcomes in patients with low back pain. Spine 2004, 29: 879–883. 10.1097/00007632-200404150-00011PubMedCrossRef Pengel LHM: Responsiveness of pain, disability, and physical impairment outcomes in patients with low back pain. Spine 2004, 29: 879–883. 10.1097/00007632-200404150-00011PubMedCrossRef
9.
go back to reference Willis C, Niere KR, Hoving JL, Green S, Leary EFO, Buchbinder R: Reproducibility and responsiveness of the Whiplash Disability Questionnaire. Pain 2004, 110: 681–688. 10.1016/j.pain.2004.05.008PubMedCrossRef Willis C, Niere KR, Hoving JL, Green S, Leary EFO, Buchbinder R: Reproducibility and responsiveness of the Whiplash Disability Questionnaire. Pain 2004, 110: 681–688. 10.1016/j.pain.2004.05.008PubMedCrossRef
10.
go back to reference Chansirinukor W, Maher CG, Latimer J, Hush J: Comparison of the Functional Rating Index and the 18-item Roland-Morris disability questionnaire: Responsiveness and reliability. Spine 2004, 30: 141–145. Chansirinukor W, Maher CG, Latimer J, Hush J: Comparison of the Functional Rating Index and the 18-item Roland-Morris disability questionnaire: Responsiveness and reliability. Spine 2004, 30: 141–145.
11.
go back to reference Lefevre-Colau MM, Poiraudeau S, Oberlin C, Demaille S, Fermanian J, Rannou F, Revel M: Reliability, validity, and responsiveness of the modified Kapandji index for assessment of functional mobility of the rheumatoid hand. Arch Phys Med Rehabil 2003,84(7):1032–1038. 10.1016/S0003-9993(03)00128-XPubMedCrossRef Lefevre-Colau MM, Poiraudeau S, Oberlin C, Demaille S, Fermanian J, Rannou F, Revel M: Reliability, validity, and responsiveness of the modified Kapandji index for assessment of functional mobility of the rheumatoid hand. Arch Phys Med Rehabil 2003,84(7):1032–1038. 10.1016/S0003-9993(03)00128-XPubMedCrossRef
12.
go back to reference Tidermark J, Bergstrom G, Svensson O, Tornkvist H, Ponzer S: Responsiveness of the EuroQol (EQ 5-D) and the SF-36 in elderly patients with displaced femoral neck fractures. Qual Life Res 2003,12(8):1069–1079. 10.1023/A:1026193812514PubMedCrossRef Tidermark J, Bergstrom G, Svensson O, Tornkvist H, Ponzer S: Responsiveness of the EuroQol (EQ 5-D) and the SF-36 in elderly patients with displaced femoral neck fractures. Qual Life Res 2003,12(8):1069–1079. 10.1023/A:1026193812514PubMedCrossRef
13.
go back to reference Badia X, Diez-Perez A, Lahoz R, Lizan L, Nogues X, Iborra J: The ECOS-16 questionnaire for the evaluation of health related quality of life in post-menopausal women with osteoporosis. Health Qual Life Outcomes 2004,2(1):41. 10.1186/1477-7525-2-41PubMedCentralPubMedCrossRef Badia X, Diez-Perez A, Lahoz R, Lizan L, Nogues X, Iborra J: The ECOS-16 questionnaire for the evaluation of health related quality of life in post-menopausal women with osteoporosis. Health Qual Life Outcomes 2004,2(1):41. 10.1186/1477-7525-2-41PubMedCentralPubMedCrossRef
14.
go back to reference Stratford PW, Binkley JM, Solomon P, Gill C, Finch E: Assessing change over time in patients with low back pain. Phys Ther 1994, 74: 528–533.PubMed Stratford PW, Binkley JM, Solomon P, Gill C, Finch E: Assessing change over time in patients with low back pain. Phys Ther 1994, 74: 528–533.PubMed
15.
go back to reference Colle F, Poiraudeau S, Revel M: [Critical analysis of a systematic review of the literature and a meta-analysis on exercise therapy and chronic low back pain]. Ann Readapt Med Phys 2001,44(4):221–233.PubMedCrossRef Colle F, Poiraudeau S, Revel M: [Critical analysis of a systematic review of the literature and a meta-analysis on exercise therapy and chronic low back pain]. Ann Readapt Med Phys 2001,44(4):221–233.PubMedCrossRef
16.
go back to reference Stratford PW, Binkley JM, Riddle DL: Health status measures: Strategies and analytic methods for assessing change scores. Phys Ther 1996, 76: 1109–1123.PubMed Stratford PW, Binkley JM, Riddle DL: Health status measures: Strategies and analytic methods for assessing change scores. Phys Ther 1996, 76: 1109–1123.PubMed
17.
go back to reference Husted JA, Cook DJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000, 53: 459–468. 10.1016/S0895-4356(99)00206-1PubMedCrossRef Husted JA, Cook DJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000, 53: 459–468. 10.1016/S0895-4356(99)00206-1PubMedCrossRef
18.
go back to reference Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd edition. New York , Oxford University Press; 2003. Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd edition. New York , Oxford University Press; 2003.
19.
go back to reference Meenan RF, Anderson JJ, Kazis LE, Egger MJ, Altz-Smith M, Samuelson COJ, Willkens RF, Solsky MA, Hayes SP, Blocka KL: Outcome assessment in clinical trials. Evidence for the sensitivity of health status measures. Arthritis Rheum 1984, 27: 1344–1352.PubMedCrossRef Meenan RF, Anderson JJ, Kazis LE, Egger MJ, Altz-Smith M, Samuelson COJ, Willkens RF, Solsky MA, Hayes SP, Blocka KL: Outcome assessment in clinical trials. Evidence for the sensitivity of health status measures. Arthritis Rheum 1984, 27: 1344–1352.PubMedCrossRef
20.
go back to reference Lowe A, Wessel J, Battie MC: Test-retest reliability, construct validity, and responsiveness of a functional pain scale for tennis elbow. Physiother Can 2003, 55: 114–122.CrossRef Lowe A, Wessel J, Battie MC: Test-retest reliability, construct validity, and responsiveness of a functional pain scale for tennis elbow. Physiother Can 2003, 55: 114–122.CrossRef
21.
go back to reference Jaeschke R, Singer J, Guyatt GH: Measurement of health status: Ascertaining the minimal clinically important difference. Controlled Clin Trials 1989, 10: 407–415. 10.1016/0197-2456(89)90005-6PubMedCrossRef Jaeschke R, Singer J, Guyatt GH: Measurement of health status: Ascertaining the minimal clinically important difference. Controlled Clin Trials 1989, 10: 407–415. 10.1016/0197-2456(89)90005-6PubMedCrossRef
22.
go back to reference Norman GR, Stratford P, Regehr G: Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol 1997, 50: 869–879. 10.1016/S0895-4356(97)00097-8PubMedCrossRef Norman GR, Stratford P, Regehr G: Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol 1997, 50: 869–879. 10.1016/S0895-4356(97)00097-8PubMedCrossRef
23.
go back to reference Westaway MD, Stratford PW, Binkley JM: The patient-specific functional scale: validation of its use in persons with neck dysfunction. J Orthop Sports Phys Ther 1998,27(5):331–338.PubMedCrossRef Westaway MD, Stratford PW, Binkley JM: The patient-specific functional scale: validation of its use in persons with neck dysfunction. J Orthop Sports Phys Ther 1998,27(5):331–338.PubMedCrossRef
24.
go back to reference Binkley JM, Stratford PW, Lott SA, Riddle DL: The Lower Extremity Functional Scale (LEFS): Scale development, measurement, properties, and clinical application. The North American Orthopaedic Rehabilitation Research Network. Phys Ther 1999, 79: 371–383.PubMed Binkley JM, Stratford PW, Lott SA, Riddle DL: The Lower Extremity Functional Scale (LEFS): Scale development, measurement, properties, and clinical application. The North American Orthopaedic Rehabilitation Research Network. Phys Ther 1999, 79: 371–383.PubMed
25.
go back to reference Stratford PW, Binkley JM: A comparison study of the back pain functional scale and Roland Morris Questionnaire. North American Orthopaedic Rehabilitation Research Network. J Rheumatol 2000,27(8):1928–1936.PubMed Stratford PW, Binkley JM: A comparison study of the back pain functional scale and Roland Morris Questionnaire. North American Orthopaedic Rehabilitation Research Network. J Rheumatol 2000,27(8):1928–1936.PubMed
26.
go back to reference Vernon H, Mior S: The Neck Disability Index: a study of reliability and validity. J Manipulative Physiol Ther 1991,14(7):409–415.PubMed Vernon H, Mior S: The Neck Disability Index: a study of reliability and validity. J Manipulative Physiol Ther 1991,14(7):409–415.PubMed
27.
go back to reference Stratford PW, Gill C, Westaway M, Binkley J: Assessing disability and change on individual patients: A report of a patient specific measure. Physiother Can 1995, 47: 258–263.CrossRef Stratford PW, Gill C, Westaway M, Binkley J: Assessing disability and change on individual patients: A report of a patient specific measure. Physiother Can 1995, 47: 258–263.CrossRef
28.
go back to reference Norman GR: Issues in the of change scores in randomized trials. J clin Epidemiol 1989, 42: 1097–1105. 10.1016/0895-4356(89)90051-6PubMedCrossRef Norman GR: Issues in the of change scores in randomized trials. J clin Epidemiol 1989, 42: 1097–1105. 10.1016/0895-4356(89)90051-6PubMedCrossRef
29.
go back to reference Winer BJ: Statistical Principles in Experimental Design. 2nd edition. Toronto , McGraw-Hill; 1962.CrossRef Winer BJ: Statistical Principles in Experimental Design. 2nd edition. Toronto , McGraw-Hill; 1962.CrossRef
30.
go back to reference Kleinbaum DG, Kupper LL, Muller KE: Applied Regression Analysis and Other Multivariable Methods. 2nd edition. Boston , PWS-Kent; 1987. Kleinbaum DG, Kupper LL, Muller KE: Applied Regression Analysis and Other Multivariable Methods. 2nd edition. Boston , PWS-Kent; 1987.
31.
go back to reference Nunnally JC: Psychometric Theory. Toronto , McGraw-Hill; 1978. Nunnally JC: Psychometric Theory. Toronto , McGraw-Hill; 1978.
Metadata
Title
Assessing sensitivity to change: choosing the appropriate change coefficient
Authors
Paul W Stratford
Daniel L Riddle
Publication date
01-12-2005
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2005
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-3-23

Other articles of this Issue 1/2005

Health and Quality of Life Outcomes 1/2005 Go to the issue