Skip to main content
Top
Published in: Trials 1/2013

Open Access 01-12-2013 | Methodology

The effect of covariate adjustment for baseline severity in acute stroke clinicaltrials with responder analysis outcomes

Authors: Kyra M Garofolo, Sharon D Yeatts, Viswanathan Ramakrishnan, Edward C Jauch, Karen C Johnston, Valerie L Durkalski

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Background

Traditionally in acute stroke clinical trials, the primary clinical outcomeemployed is a dichotomized modified Rankin Scale (mRS). New statisticalmethods, such as responder analysis, are being used in stroke studies toaddress the concern that baseline prognostic variables, such as strokeseverity, impact the likelihood of a successful outcome. Responder analysisallows the definition of success to vary according to baseline prognosticvariables, producing a more clinically relevant insight into the actualeffect of investigational treatments. It is unclear whether or notstatistical analyses should adjust for prognostic variables when responderanalysis is used, as the outcome already takes these prognostic variablesinto account. This research aims to investigate the effect of covariateadjustment in the responder analysis framework in order to determine theappropriate analytic method.

Methods

Using a current stroke clinical trial and its pilot studies to guidesimulation parameters, 1,000 clinical trials were simulated at varyingsample sizes under several treatment effects to assess power and type Ierror. Covariate-adjusted and unadjusted logistic regressions were used toestimate the treatment effect under each scenario. In the case ofcovariate-adjusted logistic regression, the trichotomized National Instituteof Health Stroke Scale (NIHSS) was used in adjustment.

Results

Under various treatment effect settings, the operating characteristics of theunadjusted and adjusted analyses do not substantially differ. Power and typeI error are preserved for both the unadjusted and adjusted analyses.

Conclusions

Our results suggest that, under the given treatment effect scenarios, thedecision whether or not to adjust for baseline severity when using aresponder analysis outcome should be guided by the needs of the study, astype I error rates and power do not appear to vary largely between themethods. These findings are applicable to stroke trials which use the mRSfor the primary outcome, but also provide a broader insight into theanalysis of binary outcomes that are defined based on baseline prognosticvariables.

Trial registration

This research is part of the Stroke Hyperglycemia Insulin Network Effort(SHINE) trial, Identification Number NCT01369069.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sacco RL, Frieden TR, Blakeman DE, Jauch EC, Mohl S: What the Million Hearts Initiative means for stroke: a presidential advisoryfrom the American Heart Association/American Stroke Association. Stroke. 2012, 43: 924-928. 10.1161/STR.0b013e318248f00e.CrossRefPubMed Sacco RL, Frieden TR, Blakeman DE, Jauch EC, Mohl S: What the Million Hearts Initiative means for stroke: a presidential advisoryfrom the American Heart Association/American Stroke Association. Stroke. 2012, 43: 924-928. 10.1161/STR.0b013e318248f00e.CrossRefPubMed
2.
go back to reference Saver JL: Optimal endpoints for acute stroke therapy trials: best ways to measuretreatment effects of drugs and devices. Stroke. 2011, 42: 2356-2362. 10.1161/STROKEAHA.111.619122.CrossRefPubMedPubMedCentral Saver JL: Optimal endpoints for acute stroke therapy trials: best ways to measuretreatment effects of drugs and devices. Stroke. 2011, 42: 2356-2362. 10.1161/STROKEAHA.111.619122.CrossRefPubMedPubMedCentral
3.
go back to reference Hong KS, Lee SJ, Hao Q, Liebeskind DS, Saver JL: Acute stroke trials in the 1st decade of the 21st century. Stroke. 2011, 42: e314-CrossRef Hong KS, Lee SJ, Hao Q, Liebeskind DS, Saver JL: Acute stroke trials in the 1st decade of the 21st century. Stroke. 2011, 42: e314-CrossRef
4.
go back to reference Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J, The Optimising Analysis of Stroke Trials (OAST) Collaboration: Can we improve the statistical analysis of stroke trials? Statisticalreanalysis of functional outcomes in stroke trials. Stroke. 2007, 38: 1911-1915.CrossRefPubMed Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J, The Optimising Analysis of Stroke Trials (OAST) Collaboration: Can we improve the statistical analysis of stroke trials? Statisticalreanalysis of functional outcomes in stroke trials. Stroke. 2007, 38: 1911-1915.CrossRefPubMed
5.
go back to reference Banks JL, Marotta CA: Outcomes validity and reliability of the modified Rankin scale: implicationsfor stroke clinical trials. Stroke. 2007, 38: 1091-1096. 10.1161/01.STR.0000258355.23810.c6.CrossRefPubMed Banks JL, Marotta CA: Outcomes validity and reliability of the modified Rankin scale: implicationsfor stroke clinical trials. Stroke. 2007, 38: 1091-1096. 10.1161/01.STR.0000258355.23810.c6.CrossRefPubMed
6.
go back to reference Saver JL: Novel end point analytic techniques and interpreting shifts across the entirerange of outcome scales in acute stroke trials. Stroke. 2007, 38: 3055-3062. 10.1161/STROKEAHA.107.488536.CrossRefPubMed Saver JL: Novel end point analytic techniques and interpreting shifts across the entirerange of outcome scales in acute stroke trials. Stroke. 2007, 38: 3055-3062. 10.1161/STROKEAHA.107.488536.CrossRefPubMed
7.
go back to reference Young FB, Lees KR, Weir CJ: Strengthening acute stroke trials through optimal use of disability endpoints. Stroke. 2003, 34: 2676-2680. 10.1161/01.STR.0000096210.36741.E7.CrossRefPubMed Young FB, Lees KR, Weir CJ: Strengthening acute stroke trials through optimal use of disability endpoints. Stroke. 2003, 34: 2676-2680. 10.1161/01.STR.0000096210.36741.E7.CrossRefPubMed
8.
go back to reference Murray GD, Barer D, Choi S, Fernandes H, Gregson B, Lees KR, Maas AI, Marmarou A, Mendelow AD, Steyerberg EW, Taylor GS, Teasdale GM, Weir CJ: Design and analysis of phase III trials with ordered outcome scales: theconcept of the sliding dichotomy. J Neurotrauma. 2005, 22: 511-517. 10.1089/neu.2005.22.511.CrossRefPubMed Murray GD, Barer D, Choi S, Fernandes H, Gregson B, Lees KR, Maas AI, Marmarou A, Mendelow AD, Steyerberg EW, Taylor GS, Teasdale GM, Weir CJ: Design and analysis of phase III trials with ordered outcome scales: theconcept of the sliding dichotomy. J Neurotrauma. 2005, 22: 511-517. 10.1089/neu.2005.22.511.CrossRefPubMed
9.
go back to reference Savitz SI, Lew R, Bluhmki E, Hacke W, Fisher M: Shift analysis versus dichotomization of the modified Rankin scale outcomescores in the NINDS and ECASS-II trials. Stroke. 2007, 38: 3205-3212. 10.1161/STROKEAHA.107.489351.CrossRefPubMed Savitz SI, Lew R, Bluhmki E, Hacke W, Fisher M: Shift analysis versus dichotomization of the modified Rankin scale outcomescores in the NINDS and ECASS-II trials. Stroke. 2007, 38: 3205-3212. 10.1161/STROKEAHA.107.489351.CrossRefPubMed
10.
go back to reference Kasner SE: Clinical interpretation and use of stroke scales. Lancet Neurol. 2006, 5: 603-612. 10.1016/S1474-4422(06)70495-1.CrossRefPubMed Kasner SE: Clinical interpretation and use of stroke scales. Lancet Neurol. 2006, 5: 603-612. 10.1016/S1474-4422(06)70495-1.CrossRefPubMed
11.
go back to reference Tilley BC, Marler J, Geller NL, Lu M, Legler J, Brott T, Lyden P, Grotta J: Use of a global test for multiple outcomes in stroke trials with applicationto the National Institute of Neurological Disorders and Stroke t-PA StrokeTrial. Stroke. 1996, 27: 2136-2142. 10.1161/01.STR.27.11.2136.CrossRefPubMed Tilley BC, Marler J, Geller NL, Lu M, Legler J, Brott T, Lyden P, Grotta J: Use of a global test for multiple outcomes in stroke trials with applicationto the National Institute of Neurological Disorders and Stroke t-PA StrokeTrial. Stroke. 1996, 27: 2136-2142. 10.1161/01.STR.27.11.2136.CrossRefPubMed
12.
go back to reference Cobo E, Secades JJ, Miras F, Gonzalez JA, Saver JL, Corchero C, Rius R, Dàvalos A: Boosting the chances to improve stroke treatment. Stroke. 2010, 41: e143-e150. 10.1161/STROKEAHA.109.567404.CrossRefPubMed Cobo E, Secades JJ, Miras F, Gonzalez JA, Saver JL, Corchero C, Rius R, Dàvalos A: Boosting the chances to improve stroke treatment. Stroke. 2010, 41: e143-e150. 10.1161/STROKEAHA.109.567404.CrossRefPubMed
13.
go back to reference Saver JL, Gornbein J: Treatment effects for which shift or binary analyses are advantageous inacute stroke trials. Neurology. 2009, 72: 1310-1315. 10.1212/01.wnl.0000341308.73506.b7.CrossRefPubMedPubMedCentral Saver JL, Gornbein J: Treatment effects for which shift or binary analyses are advantageous inacute stroke trials. Neurology. 2009, 72: 1310-1315. 10.1212/01.wnl.0000341308.73506.b7.CrossRefPubMedPubMedCentral
14.
go back to reference McHugh GS, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcomedata in randomized controlled trials in traumatic brain injury: results fromthe IMPACT Project. Clin Trials. 2010, 7: 44-57. 10.1177/1740774509356580.CrossRefPubMed McHugh GS, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcomedata in randomized controlled trials in traumatic brain injury: results fromthe IMPACT Project. Clin Trials. 2010, 7: 44-57. 10.1177/1740774509356580.CrossRefPubMed
15.
go back to reference Howard G, Waller JL, Voeks JH, Howard VJ, Jauch EC, Lees KR, Nichols FT, Rahlfs VW, Hess DC: A simple, assumption-free, and clinically interpretable approach for analysisof modified Rankin outcomes. Stroke. 2012, 43: 664-669. 10.1161/STROKEAHA.111.632935.CrossRefPubMed Howard G, Waller JL, Voeks JH, Howard VJ, Jauch EC, Lees KR, Nichols FT, Rahlfs VW, Hess DC: A simple, assumption-free, and clinically interpretable approach for analysisof modified Rankin outcomes. Stroke. 2012, 43: 664-669. 10.1161/STROKEAHA.111.632935.CrossRefPubMed
16.
go back to reference Saver JL, Yafeh B: Confirmation of tPA treatment effect by baseline severity-adjusted end pointreanalysis of the NINDS-tPA stroke trials. Stroke. 2007, 38: 414-416. 10.1161/01.STR.0000254580.39297.3c.CrossRefPubMed Saver JL, Yafeh B: Confirmation of tPA treatment effect by baseline severity-adjusted end pointreanalysis of the NINDS-tPA stroke trials. Stroke. 2007, 38: 414-416. 10.1161/01.STR.0000254580.39297.3c.CrossRefPubMed
17.
go back to reference Young FB, Lees KR, Weir CJ: Improving trial power through use of prognosis-adjusted end points. Stroke. 2005, 36: 597-601. 10.1161/01.STR.0000154856.42135.85.CrossRefPubMed Young FB, Lees KR, Weir CJ: Improving trial power through use of prognosis-adjusted end points. Stroke. 2005, 36: 597-601. 10.1161/01.STR.0000154856.42135.85.CrossRefPubMed
18.
go back to reference Bruno A, Durkalski VL, Hall CE, Juneja R, Barsan WG, Janis S, Meurer WJ, Fansler A, Johnston KC: The stroke hyperglycemia insulin network effort (SHINE) trial; design andmethodology. Int J Stroke. In press, Bruno A, Durkalski VL, Hall CE, Juneja R, Barsan WG, Janis S, Meurer WJ, Fansler A, Johnston KC: The stroke hyperglycemia insulin network effort (SHINE) trial; design andmethodology. Int J Stroke. In press,
19.
go back to reference den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: The Paracetamol (Acetaminophen) In Stroke (PAIS) trial: a multicentre,randomised, placebo-controlled, phase III trial. Lancet Neurol. 2009, 8: 434-440. 10.1016/S1474-4422(09)70051-1.CrossRefPubMed den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: The Paracetamol (Acetaminophen) In Stroke (PAIS) trial: a multicentre,randomised, placebo-controlled, phase III trial. Lancet Neurol. 2009, 8: 434-440. 10.1016/S1474-4422(09)70051-1.CrossRefPubMed
20.
go back to reference Adams HP, Effron MB, Torner J, Davalos A, Frayne J, Teal P, Leclerc J, Oemar B, Padgett L, Barnathan ES, Hacke W: Emergency administration of abciximab for treatment of patients with acuteischemic stroke: results of an international phase III trial. Stroke. 2008, 39: 87-99. 10.1161/STROKEAHA.106.476648.CrossRefPubMed Adams HP, Effron MB, Torner J, Davalos A, Frayne J, Teal P, Leclerc J, Oemar B, Padgett L, Barnathan ES, Hacke W: Emergency administration of abciximab for treatment of patients with acuteischemic stroke: results of an international phase III trial. Stroke. 2008, 39: 87-99. 10.1161/STROKEAHA.106.476648.CrossRefPubMed
21.
go back to reference Piantadosi S: Clinical Trials: A Methodological Perspective. 2005, Hoboken, New Jersey: John Wiley and Sons, 470-473. 2CrossRef Piantadosi S: Clinical Trials: A Methodological Perspective. 2005, Hoboken, New Jersey: John Wiley and Sons, 470-473. 2CrossRef
23.
go back to reference Robinson LD, Jewell NP: Some surprising results about covariate adjustment in logistic regressionmodels. Int Stat Rev. 1991, 58: 227-240.CrossRef Robinson LD, Jewell NP: Some surprising results about covariate adjustment in logistic regressionmodels. Int Stat Rev. 1991, 58: 227-240.CrossRef
24.
go back to reference Johnston KC, Hall CE, Kissela BM, Bleck TP, Conaway MR, GRASP Investigators: Glucose Regulation in Acute Stroke Patients (GRASP) trial: a randomized pilottrial. Stroke. 2009, 40: 3804-3809. 10.1161/STROKEAHA.109.561498.CrossRefPubMedPubMedCentral Johnston KC, Hall CE, Kissela BM, Bleck TP, Conaway MR, GRASP Investigators: Glucose Regulation in Acute Stroke Patients (GRASP) trial: a randomized pilottrial. Stroke. 2009, 40: 3804-3809. 10.1161/STROKEAHA.109.561498.CrossRefPubMedPubMedCentral
25.
go back to reference Bruno A, Kent TA, Coull BM, Shankar RR, Saha C, Becker KJ, Kissela BM, Williams LS: Treatment of Hyperglycemia in Ischemic Stroke (THIS): a randomized pilottrial. Stroke. 2008, 39: 384-389. 10.1161/STROKEAHA.107.493544.CrossRefPubMed Bruno A, Kent TA, Coull BM, Shankar RR, Saha C, Becker KJ, Kissela BM, Williams LS: Treatment of Hyperglycemia in Ischemic Stroke (THIS): a randomized pilottrial. Stroke. 2008, 39: 384-389. 10.1161/STROKEAHA.107.493544.CrossRefPubMed
26.
go back to reference The National Institute of Neurological Disorders and Stroke rt-PAStroke Study Group: Tissue plasminogen activator for acute ischemic stroke. N Eng J Med. 1995, 333: 1581-1588.CrossRef The National Institute of Neurological Disorders and Stroke rt-PAStroke Study Group: Tissue plasminogen activator for acute ischemic stroke. N Eng J Med. 1995, 333: 1581-1588.CrossRef
27.
go back to reference Choi SC: Sample size in clinical trials with dichotomous endpoints: use ofcovariables. J Biopharm Stat. 1998, 8: 367-375. 10.1080/10543409808835246.CrossRefPubMed Choi SC: Sample size in clinical trials with dichotomous endpoints: use ofcovariables. J Biopharm Stat. 1998, 8: 367-375. 10.1080/10543409808835246.CrossRefPubMed
28.
go back to reference Hernández AV, Steyerberg EW, Butcher I, Mushkudiani N, Taylor GS, Murray GD, Marmarou A, Choi SC, Lu J, Habbema DF, Maas AI: Adjustment for strong predictors of outcome in traumatic brain injury trials:25% reduction in sample size requirements in the IMPACT study. J Neurotrauma. 2006, 23: 1295-1303. 10.1089/neu.2006.23.1295.CrossRefPubMed Hernández AV, Steyerberg EW, Butcher I, Mushkudiani N, Taylor GS, Murray GD, Marmarou A, Choi SC, Lu J, Habbema DF, Maas AI: Adjustment for strong predictors of outcome in traumatic brain injury trials:25% reduction in sample size requirements in the IMPACT study. J Neurotrauma. 2006, 23: 1295-1303. 10.1089/neu.2006.23.1295.CrossRefPubMed
29.
go back to reference Committee for Proprietary Medicinal Products: Committee for ProprietaryMedicinal Products (CPMP): points to consider on adjustment for baseline covariates. Stat Med. 2004, 23: 701-709.CrossRef Committee for Proprietary Medicinal Products: Committee for ProprietaryMedicinal Products (CPMP): points to consider on adjustment for baseline covariates. Stat Med. 2004, 23: 701-709.CrossRef
30.
go back to reference Lin HJ, Chang WL, Tseng MC: Readmission after stroke in a hospital based registry: risk, etiologies, andrisk factors. Neurology. 2011, 76: 438-443. 10.1212/WNL.0b013e31820a0cd8.CrossRefPubMed Lin HJ, Chang WL, Tseng MC: Readmission after stroke in a hospital based registry: risk, etiologies, andrisk factors. Neurology. 2011, 76: 438-443. 10.1212/WNL.0b013e31820a0cd8.CrossRefPubMed
31.
go back to reference Dai DF, Thajeb P, Tu CF, Chiang FT, Chen CH, Yang RB, Chen JJ: Plasma concentration of SCUBE1, a novel platelet protein, is elevated inpatients with acute coronary syndrome and ischemic stroke. J Am Coll Cardiol. 2008, 51: 2173-2180. 10.1016/j.jacc.2008.01.060.CrossRefPubMed Dai DF, Thajeb P, Tu CF, Chiang FT, Chen CH, Yang RB, Chen JJ: Plasma concentration of SCUBE1, a novel platelet protein, is elevated inpatients with acute coronary syndrome and ischemic stroke. J Am Coll Cardiol. 2008, 51: 2173-2180. 10.1016/j.jacc.2008.01.060.CrossRefPubMed
Metadata
Title
The effect of covariate adjustment for baseline severity in acute stroke clinicaltrials with responder analysis outcomes
Authors
Kyra M Garofolo
Sharon D Yeatts
Viswanathan Ramakrishnan
Edward C Jauch
Karen C Johnston
Valerie L Durkalski
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-98

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue