Skip to main content
Top
Published in: BMC Neurology 1/2009

Open Access 01-12-2009 | Research article

The size of the treatment effect: do patients and proxies agree?

Authors: Femke AH van der Linden, Jolijn J Kragt, Jeremy C Hobart, Martin Klein, Alan J Thompson, Henk M van der Ploeg, Chris H Polman, Bernard MJ Uitdehaag

Published in: BMC Neurology | Issue 1/2009

Login to get access

Abstract

Background

This study examined whether MS patients and proxy respondents agreed on change in disease impact, which was induced by treatment. This may be of interest in situations when patients suffer from limitations that interfere with reliable self-assessment, such as cognitive impairment.

Methods

MS patients and proxies completed the Multiple Sclerosis Impact Scale (MSIS-29) before and after intravenous steroid treatment. Analyses focused on patient-proxy agreement between MSIS-29 change scores. Transition ratings were used to measure the patient's judgement of change and whether this change was reflected in the MSIS-29 change of patients and proxies. Receiver operating characteristic (ROC) analyses were also performed to examine the diagnostic properties of the MSIS-29 when completed by patients and proxies.

Results

42 patients and proxy respondents completed the MSIS-29 at baseline and follow-up. Patient-proxy differences between change scores on the physical and psychological MSIS-29 subscale were quite small, although large variability was found. The direction of mean change was in concordance with the transition ratings of the patients. Results of the ROC analyses of the MSIS-29 were similar when completed by patients (physical scale: AUC = 0.79, 95% CI: 0.65 – 0.93 and 0.66, 95% CI: 0.48 – 0.84 for the psychological scale) and proxies (physical scale: 0.80, 95% CI: 0.72 – 0.96 and 0.71, 95% CI: 0.56 – 0.87 for the psychological scale)

Conclusion

Although the results need to be further explored in larger samples, these results do point towards possible use of proxy respondents to assess patient perceived treatment change at the group level.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lublin FD, Reingold SC: Defining the clinical course of multiple sclerosis: results of an international survey. National Multiple Sclerosis Society (USA) Advisory Committee on Clinical Trials of New Agents in Multiple Sclerosis. Neurology. 1996, 46: 907-911.CrossRefPubMed Lublin FD, Reingold SC: Defining the clinical course of multiple sclerosis: results of an international survey. National Multiple Sclerosis Society (USA) Advisory Committee on Clinical Trials of New Agents in Multiple Sclerosis. Neurology. 1996, 46: 907-911.CrossRefPubMed
2.
go back to reference Hoogervorst EL, Eikelenboom MJ, Uitdehaag BM, Polman CH: One year changes in disability in multiple sclerosis: neurological examination compared with patient self report. J Neurol Neurosurg Psychiatry. 2003, 74: 439-442. 10.1136/jnnp.74.4.439.CrossRefPubMedPubMedCentral Hoogervorst EL, Eikelenboom MJ, Uitdehaag BM, Polman CH: One year changes in disability in multiple sclerosis: neurological examination compared with patient self report. J Neurol Neurosurg Psychiatry. 2003, 74: 439-442. 10.1136/jnnp.74.4.439.CrossRefPubMedPubMedCentral
3.
go back to reference Rao SM, Leo GJ, Bernardin L, Unverzagt F: Cognitive dysfunction in multiple sclerosis. I. Frequency, patterns, and prediction. Neurology. 1991, 41: 685-691.CrossRefPubMed Rao SM, Leo GJ, Bernardin L, Unverzagt F: Cognitive dysfunction in multiple sclerosis. I. Frequency, patterns, and prediction. Neurology. 1991, 41: 685-691.CrossRefPubMed
4.
go back to reference Amato MP, Zipoli V, Portaccio E: Multiple sclerosis-related cognitive changes: a review of cross-sectional and longitudinal studies. J Neurol Sci. 2006, 245: 41-46. 10.1016/j.jns.2005.08.019.CrossRefPubMed Amato MP, Zipoli V, Portaccio E: Multiple sclerosis-related cognitive changes: a review of cross-sectional and longitudinal studies. J Neurol Sci. 2006, 245: 41-46. 10.1016/j.jns.2005.08.019.CrossRefPubMed
5.
go back to reference Sadovnick AD, Remick RA, Allen J, Swartz E, Yee IM, Eisen K, et al: Depression and multiple sclerosis. Neurology. 1996, 46: 628-632.CrossRefPubMed Sadovnick AD, Remick RA, Allen J, Swartz E, Yee IM, Eisen K, et al: Depression and multiple sclerosis. Neurology. 1996, 46: 628-632.CrossRefPubMed
6.
go back to reference Korostil M, Feinstein A: Anxiety disorders and their clinical correlates in multiple sclerosis patients. Mult Scler. 2007, 13: 67-72. 10.1177/1352458506071161.CrossRefPubMed Korostil M, Feinstein A: Anxiety disorders and their clinical correlates in multiple sclerosis patients. Mult Scler. 2007, 13: 67-72. 10.1177/1352458506071161.CrossRefPubMed
7.
go back to reference Sprangers MA, Aaronson NK: The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease: a review. J Clin Epidemiol. 1992, 45: 743-760. 10.1016/0895-4356(92)90052-O.CrossRefPubMed Sprangers MA, Aaronson NK: The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease: a review. J Clin Epidemiol. 1992, 45: 743-760. 10.1016/0895-4356(92)90052-O.CrossRefPubMed
8.
go back to reference Linden van der FA, Kragt JJ, Hobart JC, Klein M, Thompson AJ, Ploeg van der HM, et al: Proxy measurements in multiple sclerosis: agreement between patients and their partners on the impact of multiple sclerosis in daily life. J Neurol Neurosurg Psychiatry. 2006, 77: 1157-1162. 10.1136/jnnp.2006.090795.CrossRefPubMedPubMedCentral Linden van der FA, Kragt JJ, Hobart JC, Klein M, Thompson AJ, Ploeg van der HM, et al: Proxy measurements in multiple sclerosis: agreement between patients and their partners on the impact of multiple sclerosis in daily life. J Neurol Neurosurg Psychiatry. 2006, 77: 1157-1162. 10.1136/jnnp.2006.090795.CrossRefPubMedPubMedCentral
9.
go back to reference Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: How responsive is the Multiple Sclerosis Impact Scale (MSIS-29)? A comparison with some other self report scales. J Neurol Neurosurg Psychiatry. 2005, 76: 1539-1543. 10.1136/jnnp.2005.064584.CrossRefPubMedPubMedCentral Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: How responsive is the Multiple Sclerosis Impact Scale (MSIS-29)? A comparison with some other self report scales. J Neurol Neurosurg Psychiatry. 2005, 76: 1539-1543. 10.1136/jnnp.2005.064584.CrossRefPubMedPubMedCentral
10.
go back to reference Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A: The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001, 124: 962-973. 10.1093/brain/124.5.962.CrossRefPubMed Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A: The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001, 124: 962-973. 10.1093/brain/124.5.962.CrossRefPubMed
11.
go back to reference Pickard AS, Knight SJ: Proxy evaluation of health-related quality of life: a conceptual framework for understanding multiple proxy perspectives. Med Care. 2005, 43: 493-499. 10.1097/01.mlr.0000160419.27642.a8.CrossRefPubMedPubMedCentral Pickard AS, Knight SJ: Proxy evaluation of health-related quality of life: a conceptual framework for understanding multiple proxy perspectives. Med Care. 2005, 43: 493-499. 10.1097/01.mlr.0000160419.27642.a8.CrossRefPubMedPubMedCentral
12.
go back to reference Guyatt GH, Norman GR, Juniper EF, Griffith LE: A critical look at transition ratings. J Clin Epidemiol. 2002, 55: 900-908. 10.1016/S0895-4356(02)00435-3.CrossRefPubMed Guyatt GH, Norman GR, Juniper EF, Griffith LE: A critical look at transition ratings. J Clin Epidemiol. 2002, 55: 900-908. 10.1016/S0895-4356(02)00435-3.CrossRefPubMed
13.
go back to reference Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, New Jersey: Lawrence Erlbaum Associates, 19-74. Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, New Jersey: Lawrence Erlbaum Associates, 19-74.
14.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.CrossRefPubMed Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.CrossRefPubMed
15.
go back to reference Bland JM, Altman DG: A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. Comput Biol Med. 1990, 20: 337-340. 10.1016/0010-4825(90)90013-F.CrossRefPubMed Bland JM, Altman DG: A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. Comput Biol Med. 1990, 20: 337-340. 10.1016/0010-4825(90)90013-F.CrossRefPubMed
16.
go back to reference Lee J, Koh D, Ong CN: Statistical evaluation of agreement between two methods for measuring a quantitative variable. Comput Biol Med. 1989, 19: 61-70. 10.1016/0010-4825(89)90036-X.CrossRefPubMed Lee J, Koh D, Ong CN: Statistical evaluation of agreement between two methods for measuring a quantitative variable. Comput Biol Med. 1989, 19: 61-70. 10.1016/0010-4825(89)90036-X.CrossRefPubMed
17.
go back to reference McGraw KO, Wong SP: Forming inferences about some intraclass correlation coefficients. Psychological Methods. 1996, 1: 30-46. 10.1037/1082-989X.1.1.30.CrossRef McGraw KO, Wong SP: Forming inferences about some intraclass correlation coefficients. Psychological Methods. 1996, 1: 30-46. 10.1037/1082-989X.1.1.30.CrossRef
18.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3
19.
go back to reference Guyatt G, Walter S, Norman G: Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987, 40: 171-178. 10.1016/0021-9681(87)90069-5.CrossRefPubMed Guyatt G, Walter S, Norman G: Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987, 40: 171-178. 10.1016/0021-9681(87)90069-5.CrossRefPubMed
20.
go back to reference de Vet HC, Bouter LM, Bezemer PD, Beurskens AJ: Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001, 17: 479-487. 10.1017/S0266462301106148.CrossRefPubMed de Vet HC, Bouter LM, Bezemer PD, Beurskens AJ: Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001, 17: 479-487. 10.1017/S0266462301106148.CrossRefPubMed
21.
go back to reference de Vet HC, Ostelo RW, Terwee CB, van der RN, Knol DL, Beckerman H, et al: Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007, 16: 131-142. 10.1007/s11136-006-9109-9.CrossRefPubMed de Vet HC, Ostelo RW, Terwee CB, van der RN, Knol DL, Beckerman H, et al: Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007, 16: 131-142. 10.1007/s11136-006-9109-9.CrossRefPubMed
22.
go back to reference Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000, 53: 459-468. 10.1016/S0895-4356(99)00206-1.CrossRefPubMed Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000, 53: 459-468. 10.1016/S0895-4356(99)00206-1.CrossRefPubMed
23.
go back to reference Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome. Health Technol Assess. 2004, 8: Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome. Health Technol Assess. 2004, 8:
24.
go back to reference Linden van der FA, Kragt JJ, van BM, Klein M, Thompson AJ, Ploeg van der HM, et al: Longitudinal proxy measurements in multiple sclerosis: patient-proxy agreement on the impact of MS on daily life over a period of two years. BMC Neurol. 2008, 8: 2-10.1186/1471-2377-8-2.CrossRefPubMedPubMedCentral Linden van der FA, Kragt JJ, van BM, Klein M, Thompson AJ, Ploeg van der HM, et al: Longitudinal proxy measurements in multiple sclerosis: patient-proxy agreement on the impact of MS on daily life over a period of two years. BMC Neurol. 2008, 8: 2-10.1186/1471-2377-8-2.CrossRefPubMedPubMedCentral
25.
go back to reference Costelloe L, O'Rourke K, Kearney H, McGuigan C, Gribbin L, Duggan M, et al: The patient knows best: significant change in the physical component of the Multiple Sclerosis Impact Scale (MSIS-29 physical). J Neurol Neurosurg Psychiatry. 2007, 78: 841-844. 10.1136/jnnp.2006.105759.CrossRefPubMedPubMedCentral Costelloe L, O'Rourke K, Kearney H, McGuigan C, Gribbin L, Duggan M, et al: The patient knows best: significant change in the physical component of the Multiple Sclerosis Impact Scale (MSIS-29 physical). J Neurol Neurosurg Psychiatry. 2007, 78: 841-844. 10.1136/jnnp.2006.105759.CrossRefPubMedPubMedCentral
26.
go back to reference Norman GR, Stratford P, Regehr G: Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol. 1997, 50: 869-879. 10.1016/S0895-4356(97)00097-8.CrossRefPubMed Norman GR, Stratford P, Regehr G: Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. J Clin Epidemiol. 1997, 50: 869-879. 10.1016/S0895-4356(97)00097-8.CrossRefPubMed
27.
go back to reference Ross M: Relation of implicit theories to the construction of personal histories. Psychol Rev. 1989, 96: 341-357. 10.1037/0033-295X.96.2.341.CrossRef Ross M: Relation of implicit theories to the construction of personal histories. Psychol Rev. 1989, 96: 341-357. 10.1037/0033-295X.96.2.341.CrossRef
Metadata
Title
The size of the treatment effect: do patients and proxies agree?
Authors
Femke AH van der Linden
Jolijn J Kragt
Jeremy C Hobart
Martin Klein
Alan J Thompson
Henk M van der Ploeg
Chris H Polman
Bernard MJ Uitdehaag
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Neurology / Issue 1/2009
Electronic ISSN: 1471-2377
DOI
https://doi.org/10.1186/1471-2377-9-12

Other articles of this Issue 1/2009

BMC Neurology 1/2009 Go to the issue