Skip to main content
Top
Published in: Critical Care 3/2011

Open Access 01-06-2011 | Research

The added value of ordinal analysis in clinical trials: an example in traumatic brain injury

Authors: Bob Roozenbeek, Hester F Lingsma, Pablo Perel, Phil Edwards, Ian Roberts, Gordon D Murray, Andrew IR Maas, Ewout W Steyerberg, the IMPACT (International Mission on Prognosis and Clinical Trial Design in Traumatic Brain Injury) Study Group and the CRASH (Corticosteroid Randomisation After Significant Head Injury) Trial Collaborators

Published in: Critical Care | Issue 3/2011

Login to get access

Abstract

Introduction

In clinical trials, ordinal outcome measures are often dichotomized into two categories. In traumatic brain injury (TBI) the 5-point Glasgow outcome scale (GOS) is collapsed into unfavourable versus favourable outcome. Simulation studies have shown that exploiting the ordinal nature of the GOS increases chances of detecting treatment effects. The objective of this study is to quantify the benefits of ordinal analysis in the real-life situation of a large TBI trial.

Methods

We used data from the CRASH trial that investigated the efficacy of corticosteroids in TBI patients (n = 9,554). We applied two techniques for ordinal analysis: proportional odds analysis and the sliding dichotomy approach, where the GOS is dichotomized at different cut-offs according to baseline prognostic risk. These approaches were compared to dichotomous analysis. The information density in each analysis was indicated by a Wald statistic. All analyses were adjusted for baseline characteristics.

Results

Dichotomous analysis of the six-month GOS showed a non-significant treatment effect (OR = 1.09, 95% CI 0.98 to 1.21, P = 0.096). Ordinal analysis with proportional odds regression or sliding dichotomy showed highly statistically significant treatment effects (OR 1.15, 95% CI 1.06 to 1.25, P = 0.0007 and 1.19, 95% CI 1.08 to 1.30, P = 0.0002), with 2.05-fold and 2.56-fold higher information density compared to the dichotomous approach respectively.

Conclusions

Analysis of the CRASH trial data confirmed that ordinal analysis of outcome substantially increases statistical power. We expect these results to hold for other fields of critical care medicine that use ordinal outcome measures and recommend that future trials adopt ordinal analyses. This will permit detection of smaller treatment effects.
Appendix
Available only for authorised users
Literature
1.
go back to reference Maas AI, Roozenbeek B, Manley GT: Clinical trials in traumatic brain injury: past experience and current developments. Neurotherapeutics 2010, 7: 115-126. 10.1016/j.nurt.2009.10.022CrossRefPubMed Maas AI, Roozenbeek B, Manley GT: Clinical trials in traumatic brain injury: past experience and current developments. Neurotherapeutics 2010, 7: 115-126. 10.1016/j.nurt.2009.10.022CrossRefPubMed
2.
go back to reference Maas AI, Steyerberg EW, Murray GD, Bullock R, Baethmann A, Marshall LF, Teasdale GM: Why have recent trials of neuroprotective agents in head injury failed to show convincing efficacy? A pragmatic analysis and theoretical considerations. Neurosurgery 1999, 44: 1286-1298.PubMed Maas AI, Steyerberg EW, Murray GD, Bullock R, Baethmann A, Marshall LF, Teasdale GM: Why have recent trials of neuroprotective agents in head injury failed to show convincing efficacy? A pragmatic analysis and theoretical considerations. Neurosurgery 1999, 44: 1286-1298.PubMed
3.
go back to reference Narayan RK, Michel ME, Ansell B, Baethmann A, Biegon A, Bracken MB, Bullock MR, Choi SC, Clifton GL, Contant CF, Coplin WM, Dietrich WD, Ghajar J, Grady SM, Grossman RG, Hall ED, Heetderks W, Hovda DA, Jallo J, Katz RL, Knoller N, Kochanek PM, Maas AI, Majde J, Marion DW, Marmarou A, Marshall LF, McIntosh TK, Miller E, Mohberg N, et al.: Clinical trials in head injury. J Neurotrauma 2002, 19: 503-557. 10.1089/089771502753754037PubMedCentralCrossRefPubMed Narayan RK, Michel ME, Ansell B, Baethmann A, Biegon A, Bracken MB, Bullock MR, Choi SC, Clifton GL, Contant CF, Coplin WM, Dietrich WD, Ghajar J, Grady SM, Grossman RG, Hall ED, Heetderks W, Hovda DA, Jallo J, Katz RL, Knoller N, Kochanek PM, Maas AI, Majde J, Marion DW, Marmarou A, Marshall LF, McIntosh TK, Miller E, Mohberg N, et al.: Clinical trials in head injury. J Neurotrauma 2002, 19: 503-557. 10.1089/089771502753754037PubMedCentralCrossRefPubMed
4.
go back to reference Maas AI, Steyerberg EW, Marmarou A, McHugh GS, Lingsma HF, Butcher I, Lu J, Weir J, Roozenbeek B, Murray GD: IMPACT recommendations for improving the design and analysis of clinical trials in moderate to severe traumatic brain injury. Neurotherapeutics 2010, 7: 127-134. 10.1016/j.nurt.2009.10.020CrossRefPubMed Maas AI, Steyerberg EW, Marmarou A, McHugh GS, Lingsma HF, Butcher I, Lu J, Weir J, Roozenbeek B, Murray GD: IMPACT recommendations for improving the design and analysis of clinical trials in moderate to severe traumatic brain injury. Neurotherapeutics 2010, 7: 127-134. 10.1016/j.nurt.2009.10.020CrossRefPubMed
5.
go back to reference McHugh GS, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcome data in randomized controlled trials in traumatic brain injury: results from the IMPACT Project. Clin Trials 2010, 7: 44-57. 10.1177/1740774509356580CrossRefPubMed McHugh GS, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcome data in randomized controlled trials in traumatic brain injury: results from the IMPACT Project. Clin Trials 2010, 7: 44-57. 10.1177/1740774509356580CrossRefPubMed
6.
go back to reference Roberts I, Yates D, Sandercock P, Farrell B, Wasserberg J, Lomas G, Cottingham R, Svoboda P, Brayley N, Mazairac G, Laloe V, Munoz-Sanchez A, Arango M, Hartzenberg B, Khamis H, Yutthakasemsunt S, Komolafe E, Olldashi F, Yadav Y, Murillo-Cabezas F, Shakur H, Edwards P, CRASH trial collaborators: Effect of intravenous corticosteroids on death within 14 days in 10008 adults with clinically significant head injury (MRC CRASH trial): randomised placebo-controlled trial. Lancet 2004, 364: 1321-1328.CrossRefPubMed Roberts I, Yates D, Sandercock P, Farrell B, Wasserberg J, Lomas G, Cottingham R, Svoboda P, Brayley N, Mazairac G, Laloe V, Munoz-Sanchez A, Arango M, Hartzenberg B, Khamis H, Yutthakasemsunt S, Komolafe E, Olldashi F, Yadav Y, Murillo-Cabezas F, Shakur H, Edwards P, CRASH trial collaborators: Effect of intravenous corticosteroids on death within 14 days in 10008 adults with clinically significant head injury (MRC CRASH trial): randomised placebo-controlled trial. Lancet 2004, 364: 1321-1328.CrossRefPubMed
7.
go back to reference Edwards P, Arango M, Balica L, Cottingham R, El-Sayed H, Farrell B, Fernandes J, Gogichaisvili T, Golden N, Hartzenberg B, Husain M, Ulloa MI, Jerbi Z, Khamis H, Komolafe E, Laloe V, Lomas G, Ludwig S, Mazairac G, Munoz Sanchez Mde L, Nasi L, Olldashi F, Plunkett P, Roberts I, Sandercock P, Shakur H, Soler C, Stocker R, Svoboda P, Trenkler S, CRASH trial collaborators, et al.: Final results of MRC CRASH, a randomised placebo-controlled trial of intravenous corticosteroid in adults with head injury-outcomes at 6 months. Lancet 2005, 365: 1957-1959.CrossRefPubMed Edwards P, Arango M, Balica L, Cottingham R, El-Sayed H, Farrell B, Fernandes J, Gogichaisvili T, Golden N, Hartzenberg B, Husain M, Ulloa MI, Jerbi Z, Khamis H, Komolafe E, Laloe V, Lomas G, Ludwig S, Mazairac G, Munoz Sanchez Mde L, Nasi L, Olldashi F, Plunkett P, Roberts I, Sandercock P, Shakur H, Soler C, Stocker R, Svoboda P, Trenkler S, CRASH trial collaborators, et al.: Final results of MRC CRASH, a randomised placebo-controlled trial of intravenous corticosteroid in adults with head injury-outcomes at 6 months. Lancet 2005, 365: 1957-1959.CrossRefPubMed
8.
go back to reference Senn S, Julious S: Measurement in clinical trials: a neglected issue for statisticians? Stat Med 2009, 28: 3189-3209. 10.1002/sim.3603CrossRefPubMed Senn S, Julious S: Measurement in clinical trials: a neglected issue for statisticians? Stat Med 2009, 28: 3189-3209. 10.1002/sim.3603CrossRefPubMed
9.
go back to reference Saver JL: Novel end point analytic techniques and interpreting shifts across the entire range of outcome scales in acute stroke trials. Stroke 2007, 38: 3055-3062. 10.1161/STROKEAHA.107.488536CrossRefPubMed Saver JL: Novel end point analytic techniques and interpreting shifts across the entire range of outcome scales in acute stroke trials. Stroke 2007, 38: 3055-3062. 10.1161/STROKEAHA.107.488536CrossRefPubMed
10.
go back to reference Valenta Z, Pitha J, Poledne R: Proportional odds logistic regression--effective means of dealing with limited uncertainty in dichotomizing clinical outcomes. Stat Med 2006, 25: 4227-4234. 10.1002/sim.2678CrossRefPubMed Valenta Z, Pitha J, Poledne R: Proportional odds logistic regression--effective means of dealing with limited uncertainty in dichotomizing clinical outcomes. Stat Med 2006, 25: 4227-4234. 10.1002/sim.2678CrossRefPubMed
11.
go back to reference Murray GD, Barer D, Choi S, Fernandes H, Gregson B, Lees KR, Maas AI, Marmarou A, Mendelow AD, Steyerberg EW, Taylor GS, Teasdale GM, Weir CJ: Design and analysis of phase III trials with ordered outcome scales: the concept of the sliding dichotomy. J Neurotrauma 2005, 22: 511-517. 10.1089/neu.2005.22.511CrossRefPubMed Murray GD, Barer D, Choi S, Fernandes H, Gregson B, Lees KR, Maas AI, Marmarou A, Mendelow AD, Steyerberg EW, Taylor GS, Teasdale GM, Weir CJ: Design and analysis of phase III trials with ordered outcome scales: the concept of the sliding dichotomy. J Neurotrauma 2005, 22: 511-517. 10.1089/neu.2005.22.511CrossRefPubMed
12.
go back to reference MRC CRASH Trial Collaborators, Perel P, Arango M, Clayton T, Edwards P, Komolafe E, Poccock S, Roberts I, Shakur H, Steyerberg E, Yutthakasemsunt S: Predicting outcome after traumatic brain injury: practical prognostic models based on large cohort of international patients. BMJ 2008, 336: 425-429.PubMedCentralCrossRef MRC CRASH Trial Collaborators, Perel P, Arango M, Clayton T, Edwards P, Komolafe E, Poccock S, Roberts I, Shakur H, Steyerberg E, Yutthakasemsunt S: Predicting outcome after traumatic brain injury: practical prognostic models based on large cohort of international patients. BMJ 2008, 336: 425-429.PubMedCentralCrossRef
13.
go back to reference Hernandez AV, Steyerberg EW, Butcher I, Mushkudiani N, Taylor GS, Murray GD, Marmarou A, Choi SC, Lu J, Habbema JD, Maas AI: Adjustment for strong predictors of outcome in traumatic brain injury trials: 25% reduction in sample size requirements in the IMPACT study. J Neurotrauma 2006, 23: 1295-1303. 10.1089/neu.2006.23.1295CrossRefPubMed Hernandez AV, Steyerberg EW, Butcher I, Mushkudiani N, Taylor GS, Murray GD, Marmarou A, Choi SC, Lu J, Habbema JD, Maas AI: Adjustment for strong predictors of outcome in traumatic brain injury trials: 25% reduction in sample size requirements in the IMPACT study. J Neurotrauma 2006, 23: 1295-1303. 10.1089/neu.2006.23.1295CrossRefPubMed
14.
go back to reference Roozenbeek B, Maas AI, Lingsma HF, Butcher I, Lu J, Marmarou A, McHugh GS, Weir J, Murray GD, Steyerberg EW, IMPACT Study Group: Baseline characteristics and statistical power in randomized controlled trials: selection, prognostic targeting, or covariate adjustment? Crit Care Med 2009, 37: 2683-2690. 10.1097/CCM.0b013e3181ab85ecCrossRefPubMed Roozenbeek B, Maas AI, Lingsma HF, Butcher I, Lu J, Marmarou A, McHugh GS, Weir J, Murray GD, Steyerberg EW, IMPACT Study Group: Baseline characteristics and statistical power in randomized controlled trials: selection, prognostic targeting, or covariate adjustment? Crit Care Med 2009, 37: 2683-2690. 10.1097/CCM.0b013e3181ab85ecCrossRefPubMed
15.
go back to reference Steyerberg EW, Bossuyt PM, Lee KL: Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J 2000, 139: 745-751.CrossRefPubMed Steyerberg EW, Bossuyt PM, Lee KL: Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J 2000, 139: 745-751.CrossRefPubMed
17.
go back to reference Machado SG, Murray GD, Teasdale GM: Evaluation of designs for clinical trials of neuroprotective agents in head injury. European Brain Injury Consortium. J Neurotrauma 1999, 16: 1131-1138. 10.1089/neu.1999.16.1131CrossRefPubMed Machado SG, Murray GD, Teasdale GM: Evaluation of designs for clinical trials of neuroprotective agents in head injury. European Brain Injury Consortium. J Neurotrauma 1999, 16: 1131-1138. 10.1089/neu.1999.16.1131CrossRefPubMed
18.
go back to reference Shannon CE: A mathematical theory of communication. Bell Syst Tech J 1948, 27: 379-423. 623-656.CrossRef Shannon CE: A mathematical theory of communication. Bell Syst Tech J 1948, 27: 379-423. 623-656.CrossRef
19.
go back to reference den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: The Paracetamol (Acetaminophen) In Stroke (PAIS) trial: a multicentre, randomised, placebo-controlled, phase III trial. Lancet Neurol 2009, 8: 434-440. 10.1016/S1474-4422(09)70051-1CrossRefPubMed den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: The Paracetamol (Acetaminophen) In Stroke (PAIS) trial: a multicentre, randomised, placebo-controlled, phase III trial. Lancet Neurol 2009, 8: 434-440. 10.1016/S1474-4422(09)70051-1CrossRefPubMed
20.
go back to reference Mendelow AD, Gregson BA, Fernandes HM, Murray GD, Teasdale GM, Hope DT, Karimi A, Shaw MD, Barer DH, STICH investigators: Early surgery versus initial conservative treatment in patients with spontaneous supratentorial intracerebral haematomas in the International Surgical Trial in Intracerebral Haemorrhage (STICH): a randomised trial. Lancet 2005, 365: 387-397.CrossRefPubMed Mendelow AD, Gregson BA, Fernandes HM, Murray GD, Teasdale GM, Hope DT, Karimi A, Shaw MD, Barer DH, STICH investigators: Early surgery versus initial conservative treatment in patients with spontaneous supratentorial intracerebral haematomas in the International Surgical Trial in Intracerebral Haemorrhage (STICH): a randomised trial. Lancet 2005, 365: 387-397.CrossRefPubMed
21.
go back to reference Maas AI, Murray G, Henney H, Kassem N, Legrand V, Mangelus M, Muizelaar JP, Stocchetti N, Knoller N, Pharmos TBI investigators: Efficacy and safety of dexanabinol in severe traumatic brain injury: results of a phase III randomised, placebo-controlled, clinical trial. Lancet Neurol 2006, 5: 38-45. 10.1016/S1474-4422(05)70253-2CrossRefPubMed Maas AI, Murray G, Henney H, Kassem N, Legrand V, Mangelus M, Muizelaar JP, Stocchetti N, Knoller N, Pharmos TBI investigators: Efficacy and safety of dexanabinol in severe traumatic brain injury: results of a phase III randomised, placebo-controlled, clinical trial. Lancet Neurol 2006, 5: 38-45. 10.1016/S1474-4422(05)70253-2CrossRefPubMed
22.
go back to reference Lees KR, Asplund K, Carolei A, Davis SM, Diener HC, Kaste M, Orgogozo JM, Whitehead J: Glycine antagonist (gavestinel) in neuroprotection (GAIN International) in patients with acute stroke: a randomised controlled trial. GAIN International Investigators. Lancet 2000, 355: 1949-1954. 10.1016/S0140-6736(00)02326-6CrossRefPubMed Lees KR, Asplund K, Carolei A, Davis SM, Diener HC, Kaste M, Orgogozo JM, Whitehead J: Glycine antagonist (gavestinel) in neuroprotection (GAIN International) in patients with acute stroke: a randomised controlled trial. GAIN International Investigators. Lancet 2000, 355: 1949-1954. 10.1016/S0140-6736(00)02326-6CrossRefPubMed
23.
go back to reference Lees KR, Zivin JA, Ashwood T, Davalos A, Davis SM, Diener HC, Grotta J, Lyden P, Shuaib A, Hardemark HG, Wasiewski WW, Stroke-Acute Ischemic NXY Treatment (SAINT I) Trial Investigators: NXY-059 for acute ischemic stroke. N Engl J Med 2006, 354: 588-600. 10.1056/NEJMoa052980CrossRefPubMed Lees KR, Zivin JA, Ashwood T, Davalos A, Davis SM, Diener HC, Grotta J, Lyden P, Shuaib A, Hardemark HG, Wasiewski WW, Stroke-Acute Ischemic NXY Treatment (SAINT I) Trial Investigators: NXY-059 for acute ischemic stroke. N Engl J Med 2006, 354: 588-600. 10.1056/NEJMoa052980CrossRefPubMed
24.
go back to reference Aberegg SK, Richards DR, O'Brien JM: Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 2010, 14: R77. 10.1186/cc8990PubMedCentralCrossRefPubMed Aberegg SK, Richards DR, O'Brien JM: Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 2010, 14: R77. 10.1186/cc8990PubMedCentralCrossRefPubMed
25.
go back to reference Rankin J: Cerebral vascular accidents in patients over the age of 60. II. Prognosis. Scott Med J 1957, 2: 200-215.PubMed Rankin J: Cerebral vascular accidents in patients over the age of 60. II. Prognosis. Scott Med J 1957, 2: 200-215.PubMed
26.
go back to reference Mahoney FI, Barthel DW: Functional Evaluation: the Barthel Index. Md State Med J 1965, 14: 61-65.PubMed Mahoney FI, Barthel DW: Functional Evaluation: the Barthel Index. Md State Med J 1965, 14: 61-65.PubMed
27.
go back to reference Optimising Analysis of Stroke Trials (OAST) Collaboration, Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J: Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials. Stroke 2007, 38: 1911-1915.CrossRef Optimising Analysis of Stroke Trials (OAST) Collaboration, Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J: Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials. Stroke 2007, 38: 1911-1915.CrossRef
Metadata
Title
The added value of ordinal analysis in clinical trials: an example in traumatic brain injury
Authors
Bob Roozenbeek
Hester F Lingsma
Pablo Perel
Phil Edwards
Ian Roberts
Gordon D Murray
Andrew IR Maas
Ewout W Steyerberg
the IMPACT (International Mission on Prognosis and Clinical Trial Design in Traumatic Brain Injury) Study Group and the CRASH (Corticosteroid Randomisation After Significant Head Injury) Trial Collaborators
Publication date
01-06-2011
Publisher
BioMed Central
Published in
Critical Care / Issue 3/2011
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc10240

Other articles of this Issue 3/2011

Critical Care 3/2011 Go to the issue