Skip to main content
Top
Published in: Journal of Neurology 10/2011

01-10-2011 | Original Communication

Improving power to detect disease progression in multiple sclerosis through alternative analysis strategies

Authors: Brian Healy, Tanuja Chitnis, David Engler

Published in: Journal of Neurology | Issue 10/2011

Login to get access

Abstract

In patients with multiple sclerosis, investigation of a treatment effect on disease progression in clinical trials and observational studies often uses sustained progression on the expanded disability status scale (EDSS) as an outcome. It is not clear whether this outcome is the most powerful to detect a treatment effect on clinical disease progression. Assessment of EDSS modeling choice on the detection of treatment effect was of interest. This assessment was separately conducted under three potential treatment effects: treatment reducing the chance of higher future EDSS, treatment increasing the chance of lower future EDSS, and treatment leading to both effects. To assess the effect of modeling choice, nine modeling strategies were applied to the data to determine the most powerful approach. EDSS measurements were simulated at 6 month intervals for 24 months. Each patient’s initial EDSS value ranged between 0 and 3, and probabilities of transitioning from one EDSS state to another were based on the empirical probabilities of transition obtained from available clinical data. Modeling approaches based on sustained progression had less power than approaches which modeled the EDSS score directly, regardless of treatment effect. This difference was especially pronounced when the treatment effect corresponded to an increase in the probability of improvement. Sustained progression on the EDSS is a less powerful outcome measure for clinical progression than approaches based on the actual EDSS values.
Literature
1.
go back to reference The IFNB Multiple Sclerosis Study Group (1993) Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. I. Clinical results of a multicenter, randomized, double-blind, placebo-controlled trial. Neurology 43:655–661 The IFNB Multiple Sclerosis Study Group (1993) Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. I. Clinical results of a multicenter, randomized, double-blind, placebo-controlled trial. Neurology 43:655–661
2.
go back to reference PRISMS (Prevention of Relapses and Disability by Interferon beta-1a Subcutaneously in Multiple Sclerosis) Study Group (1998) Randomised double-blind placebo-controlled study of interferon beta-1a in relapsing/remitting multiple sclerosis. Lancet 352:1498–1504CrossRef PRISMS (Prevention of Relapses and Disability by Interferon beta-1a Subcutaneously in Multiple Sclerosis) Study Group (1998) Randomised double-blind placebo-controlled study of interferon beta-1a in relapsing/remitting multiple sclerosis. Lancet 352:1498–1504CrossRef
3.
4.
go back to reference Bajorski P, Petkau J (1999) Nonparametric two-sample comparisons of changes on ordinal responses. J Am Stat Assoc 94:970–978CrossRef Bajorski P, Petkau J (1999) Nonparametric two-sample comparisons of changes on ordinal responses. J Am Stat Assoc 94:970–978CrossRef
5.
go back to reference Borm GF, Fransen J, Lemmens WA (2007) A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol 60:1234–1238PubMedCrossRef Borm GF, Fransen J, Lemmens WA (2007) A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol 60:1234–1238PubMedCrossRef
6.
go back to reference Brown MG, Kirby S, Skedgel C, Fisk JD, Murray TJ, Bhan V, Sketris IS (2007) How effective are disease-modifying drugs in delaying progression in relapsing-onset MS? Neurology 69:1498–1507PubMedCrossRef Brown MG, Kirby S, Skedgel C, Fisk JD, Murray TJ, Bhan V, Sketris IS (2007) How effective are disease-modifying drugs in delaying progression in relapsing-onset MS? Neurology 69:1498–1507PubMedCrossRef
7.
go back to reference Coles AJ, Compston DA, Selmaj KW, Lake SL, Moran S, Margolin DH, Norris K, Tandon PK (2008) Alemtuzumab vs. interferon beta-1a in early multiple sclerosis. N Engl J Med 359:1786–1801PubMedCrossRef Coles AJ, Compston DA, Selmaj KW, Lake SL, Moran S, Margolin DH, Norris K, Tandon PK (2008) Alemtuzumab vs. interferon beta-1a in early multiple sclerosis. N Engl J Med 359:1786–1801PubMedCrossRef
8.
go back to reference Cudkowicz ME, Shefner JM, Schoenfeld DA, Brown RH Jr, Johnson H, Qureshi M, Jacobs M, Rothstein JD, Appel SH, Pascuzzi RM, Heiman-Patterson TD, Donofrio PD, David WS, Russell JA, Tandan R, Pioro EP, Felice KJ, Rosenfeld J, Mandler RN, Sachs GM, Bradley WG, Raynor EM, Baquis GD, Belsh JM, Novella S, Goldstein J, Hulihan J (2003) A randomized, placebo-controlled trial of topiramate in amyotrophic lateral sclerosis. Neurology 61:456–464PubMed Cudkowicz ME, Shefner JM, Schoenfeld DA, Brown RH Jr, Johnson H, Qureshi M, Jacobs M, Rothstein JD, Appel SH, Pascuzzi RM, Heiman-Patterson TD, Donofrio PD, David WS, Russell JA, Tandan R, Pioro EP, Felice KJ, Rosenfeld J, Mandler RN, Sachs GM, Bradley WG, Raynor EM, Baquis GD, Belsh JM, Novella S, Goldstein J, Hulihan J (2003) A randomized, placebo-controlled trial of topiramate in amyotrophic lateral sclerosis. Neurology 61:456–464PubMed
9.
go back to reference Ebers GC, Heigenhauser L, Daumer M, Lederer C, Noseworthy JH (2008) Disability as an outcome in MS clinical trials. Neurology 71:624–631PubMedCrossRef Ebers GC, Heigenhauser L, Daumer M, Lederer C, Noseworthy JH (2008) Disability as an outcome in MS clinical trials. Neurology 71:624–631PubMedCrossRef
10.
go back to reference Gauthier SA, Glanz BI, Mandel M, Weiner HL (2006) A model for the comprehensive investigation of a chronic autoimmune disease: the multiple sclerosis CLIMB study. Autoimmun Rev 5:532–536PubMedCrossRef Gauthier SA, Glanz BI, Mandel M, Weiner HL (2006) A model for the comprehensive investigation of a chronic autoimmune disease: the multiple sclerosis CLIMB study. Autoimmun Rev 5:532–536PubMedCrossRef
11.
go back to reference Gauthier SA, Mandel M, Guttmann CR, Glanz BI, Khoury SJ, Betensky RA, Weiner HL (2007) Predicting short-term disability in multiple sclerosis. Neurology 68:2059–2065PubMedCrossRef Gauthier SA, Mandel M, Guttmann CR, Glanz BI, Khoury SJ, Betensky RA, Weiner HL (2007) Predicting short-term disability in multiple sclerosis. Neurology 68:2059–2065PubMedCrossRef
12.
go back to reference Gorman MP, Healy BC, Polgar-Turcsanyi M, Chitnis T (2009) Increased relapse rate in pediatric-onset compared with adult-onset multiple sclerosis. Arch Neurol 66:54–59PubMedCrossRef Gorman MP, Healy BC, Polgar-Turcsanyi M, Chitnis T (2009) Increased relapse rate in pediatric-onset compared with adult-onset multiple sclerosis. Arch Neurol 66:54–59PubMedCrossRef
13.
go back to reference Healy BC, Engler D (2009) Modeling disease-state transition heterogeneity through Bayesian variable selection. Stat Med 28:1353–1368PubMedCrossRef Healy BC, Engler D (2009) Modeling disease-state transition heterogeneity through Bayesian variable selection. Stat Med 28:1353–1368PubMedCrossRef
14.
go back to reference Jacobs LD, Cookfair DL, Rudick RA, Herndon RM, Richert JR, Salazar AM, Fischer JS, Goodkin DE, Granger CV, Simon JH, Alam JJ, Bartoszak DM, Bourdette DN, Braiman J, Brownscheidle CM, Coats ME, Cohan SL, Dougherty DS, Kinkel RP, Mass MK, Munschauer FE 3rd, Priore RL, Pullicino PM, Scherokman BJ, Whitham RH et al (1996) Intramuscular interferon beta-1a for disease progression in relapsing multiple sclerosis. The Multiple Sclerosis Collaborative Research Group (MSCRG). Ann Neurol 39:285–294PubMedCrossRef Jacobs LD, Cookfair DL, Rudick RA, Herndon RM, Richert JR, Salazar AM, Fischer JS, Goodkin DE, Granger CV, Simon JH, Alam JJ, Bartoszak DM, Bourdette DN, Braiman J, Brownscheidle CM, Coats ME, Cohan SL, Dougherty DS, Kinkel RP, Mass MK, Munschauer FE 3rd, Priore RL, Pullicino PM, Scherokman BJ, Whitham RH et al (1996) Intramuscular interferon beta-1a for disease progression in relapsing multiple sclerosis. The Multiple Sclerosis Collaborative Research Group (MSCRG). Ann Neurol 39:285–294PubMedCrossRef
15.
go back to reference Johnson KP, Brooks BR, Cohen JA, Ford CC, Goldstein J, Lisak RP, Myers LW, Panitch HS, Rose JW, Schiffer RB, Vollmer T, Weiner LP, Wolinsky JS (2001) Copolymer 1 reduces relapse rate and improves disability in relapsing-remitting multiple sclerosis: results of a phase III multicenter, double-blind, placebo-controlled trial. 1995. Neurology 57:S16–S24PubMed Johnson KP, Brooks BR, Cohen JA, Ford CC, Goldstein J, Lisak RP, Myers LW, Panitch HS, Rose JW, Schiffer RB, Vollmer T, Weiner LP, Wolinsky JS (2001) Copolymer 1 reduces relapse rate and improves disability in relapsing-remitting multiple sclerosis: results of a phase III multicenter, double-blind, placebo-controlled trial. 1995. Neurology 57:S16–S24PubMed
16.
go back to reference Kurtzke JF (1986) Neuroepidemiology. Part II: assessment of therapeutic trials. Ann Neurol 19:311–319PubMedCrossRef Kurtzke JF (1986) Neuroepidemiology. Part II: assessment of therapeutic trials. Ann Neurol 19:311–319PubMedCrossRef
17.
go back to reference Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 33:1444–1452PubMed Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 33:1444–1452PubMed
18.
go back to reference Li DK, Paty DW (1999) Magnetic resonance imaging results of the PRISMS trial: a randomized, double-blind, placebo-controlled study of interferon-beta1a in relapsing-remitting multiple sclerosis. Prevention of relapses and disability by interferon-beta1a subcutaneously in multiple sclerosis. Ann Neurol 46:197–206PubMedCrossRef Li DK, Paty DW (1999) Magnetic resonance imaging results of the PRISMS trial: a randomized, double-blind, placebo-controlled study of interferon-beta1a in relapsing-remitting multiple sclerosis. Prevention of relapses and disability by interferon-beta1a subcutaneously in multiple sclerosis. Ann Neurol 46:197–206PubMedCrossRef
19.
go back to reference McCullagh P (1980) Regression models for ordinal data. J Royal Stat Soc B 42:109–142 McCullagh P (1980) Regression models for ordinal data. J Royal Stat Soc B 42:109–142
20.
go back to reference Paty DW, Li DK (1993) Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. II. MRI analysis results of a multicenter, randomized, double-blind, placebo-controlled trial. UBC MS/MRI Study Group and the IFNB Multiple Sclerosis Study Group. Neurology 43:662–667PubMed Paty DW, Li DK (1993) Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. II. MRI analysis results of a multicenter, randomized, double-blind, placebo-controlled trial. UBC MS/MRI Study Group and the IFNB Multiple Sclerosis Study Group. Neurology 43:662–667PubMed
21.
go back to reference Polman CH, O’Connor PW, Havrdova E, Hutchinson M, Kappos L, Miller DH, Phillips JT, Lublin FD, Giovannoni G, Wajgt A, Toal M, Lynn F, Panzara MA, Sandrock AW (2006) A randomized, placebo-controlled trial of natalizumab for relapsing multiple sclerosis. N Engl J Med 354:899–910PubMedCrossRef Polman CH, O’Connor PW, Havrdova E, Hutchinson M, Kappos L, Miller DH, Phillips JT, Lublin FD, Giovannoni G, Wajgt A, Toal M, Lynn F, Panzara MA, Sandrock AW (2006) A randomized, placebo-controlled trial of natalizumab for relapsing multiple sclerosis. N Engl J Med 354:899–910PubMedCrossRef
22.
go back to reference Rudick RA, Stuart WH, Calabresi PA, Confavreux C, Galetta SL, Radue EW, Lublin FD, Weinstock-Guttman B, Wynn DR, Lynn F, Panzara MA, Sandrock AW (2006) Natalizumab plus interferon beta-1a for relapsing multiple sclerosis. N Engl J Med 354:911–923PubMedCrossRef Rudick RA, Stuart WH, Calabresi PA, Confavreux C, Galetta SL, Radue EW, Lublin FD, Weinstock-Guttman B, Wynn DR, Lynn F, Panzara MA, Sandrock AW (2006) Natalizumab plus interferon beta-1a for relapsing multiple sclerosis. N Engl J Med 354:911–923PubMedCrossRef
23.
go back to reference van Elteren PH (1960) On the combination of independent two-sample tests of Wilcoxon. Bull Int Stat Inst 37:1–13 van Elteren PH (1960) On the combination of independent two-sample tests of Wilcoxon. Bull Int Stat Inst 37:1–13
24.
25.
go back to reference Wilson EB (1927) Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 22:209–212CrossRef Wilson EB (1927) Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 22:209–212CrossRef
26.
go back to reference Wolinsky JS, Narayana PA, Johnson KP (2001) United States open-label glatiramer acetate extension trial for relapsing multiple sclerosis: MRI and clinical correlates. Multiple Sclerosis Study Group and the MRI Analysis Center. Mult Scler 7:33–41PubMed Wolinsky JS, Narayana PA, Johnson KP (2001) United States open-label glatiramer acetate extension trial for relapsing multiple sclerosis: MRI and clinical correlates. Multiple Sclerosis Study Group and the MRI Analysis Center. Mult Scler 7:33–41PubMed
27.
go back to reference Zeger SL, Liang KY (1986) Longitudinal data analysis for discrete and continuous outcomes. Biometrics 42:121–130PubMedCrossRef Zeger SL, Liang KY (1986) Longitudinal data analysis for discrete and continuous outcomes. Biometrics 42:121–130PubMedCrossRef
28.
go back to reference Zhao YD, Rahardja D, Qu Y (2008) Sample size calculation for the Wilcoxon–Mann–Whitney test adjusting for ties. Stat Med 27:462–468PubMedCrossRef Zhao YD, Rahardja D, Qu Y (2008) Sample size calculation for the Wilcoxon–Mann–Whitney test adjusting for ties. Stat Med 27:462–468PubMedCrossRef
Metadata
Title
Improving power to detect disease progression in multiple sclerosis through alternative analysis strategies
Authors
Brian Healy
Tanuja Chitnis
David Engler
Publication date
01-10-2011
Publisher
Springer-Verlag
Published in
Journal of Neurology / Issue 10/2011
Print ISSN: 0340-5354
Electronic ISSN: 1432-1459
DOI
https://doi.org/10.1007/s00415-011-6021-1

Other articles of this Issue 10/2011

Journal of Neurology 10/2011 Go to the issue