Skip to main content
Top
Published in: Trials 1/2012

Open Access 01-12-2012 | Methodology

Assessment of blinding to treatment allocation in studies of a cannabis-based medicine (Sativex®) in people with multiple sclerosis: a new approach

Authors: Stephen Wright, Paul Duncombe, Douglas G Altman

Published in: Trials | Issue 1/2012

Login to get access

Abstract

Background

Maintenance of the blind-to-treatment allocation is one of the most important means of avoiding bias in randomised controlled clinical trials. Commonly used methodologies to determine whether patients have become unblinded to treatment allocation are imperfect. This may be of particular concern in studies where outcomes are patient-reported, and with products which have a characteristic adverse event profile. We report the results of an evidence-based statistical approach to exploring the possible impact of unblinding to a cannabis-based medicine (Sativex®) in people with muscle spasticity due to multiple sclerosis.

Methods

All 666 patients included in three Phase III placebo-controlled studies were included in this analysis. The relationship between factors that might permit patients to identify their treatment allocation and the effect of treatment on the self-reported primary outcome measure was investigated using a general linear model where the dependent variable was the change from baseline in patient self-reported spasticity severity, and the various possible explanatory factors were regarded as fixed factors in the model.

Results

There was no significant relationship between the effect of Sativex® on spasticity and the prior use of cannabis or the incidence of ‘typical’ adverse events. Nor was there any significant relationship between the prior use of cannabis and the incidence of ‘typical’ adverse events, nor between prior use of cannabis and dose of Sativex®.

Conclusions

There is no evidence to suggest that there was widespread unblinding to treatment allocation in these three studies. If any patients did become unblinded, then there is no evidence that this led to bias in the assessment of the treatment difference between Sativex® and Placebo for efficacy, adverse events or study drug dosing. This methodology may be suitable for assessment of the integrity of the blind in other randomized clinical trials
Literature
1.
go back to reference Day SJ, Altman DG: Statistics notes: blinding in clinical trials and other studies. Br Med J. 2000, 321: 504-10.1136/bmj.321.7259.504.CrossRef Day SJ, Altman DG: Statistics notes: blinding in clinical trials and other studies. Br Med J. 2000, 321: 504-10.1136/bmj.321.7259.504.CrossRef
2.
go back to reference Schulz KF, Chalmers I, Altman DG: The landscape and lexicon of blinding in randomized trials. Ann Intern Med. 2002, 136: 254-259.CrossRefPubMed Schulz KF, Chalmers I, Altman DG: The landscape and lexicon of blinding in randomized trials. Ann Intern Med. 2002, 136: 254-259.CrossRefPubMed
3.
go back to reference Schulz KF, Grimes DA: Blinding in randomized trials: hiding who got what. Lancet. 2002, 359: 696-700. 10.1016/S0140-6736(02)07816-9.CrossRefPubMed Schulz KF, Grimes DA: Blinding in randomized trials: hiding who got what. Lancet. 2002, 359: 696-700. 10.1016/S0140-6736(02)07816-9.CrossRefPubMed
4.
go back to reference Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin R, Wood AJG, Sterne JAC: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336: 601-605. 10.1136/bmj.39465.451748.AD.CrossRefPubMedPubMedCentral Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin R, Wood AJG, Sterne JAC: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336: 601-605. 10.1136/bmj.39465.451748.AD.CrossRefPubMedPubMedCentral
7.
go back to reference Schulz KF, Altman DG, Moher D, Fergusson D: CONSORT 2010 changes and testing blindness in RCTs. Lancet. 2010, 375: 1144-1146. 10.1016/S0140-6736(10)60413-8.CrossRefPubMed Schulz KF, Altman DG, Moher D, Fergusson D: CONSORT 2010 changes and testing blindness in RCTs. Lancet. 2010, 375: 1144-1146. 10.1016/S0140-6736(10)60413-8.CrossRefPubMed
8.
go back to reference Sackett DL: Clinician-trialist rounds: 6. testing for blindness at the end of your trial is a mug's game. Clin Trials. 2011, 8: 674-676. 10.1177/1740774511419685.CrossRefPubMed Sackett DL: Clinician-trialist rounds: 6. testing for blindness at the end of your trial is a mug's game. Clin Trials. 2011, 8: 674-676. 10.1177/1740774511419685.CrossRefPubMed
9.
go back to reference Wade DT, Makela P, Robson P, House H, Bateman C: Do cannabis-based medicines have general or specific effects on symptoms in MS? A double-blind, randomized, placebo-controlled study on 160 patients. Mult Scler. 2004, 10: 434-441. 10.1191/1352458504ms1082oa.CrossRefPubMed Wade DT, Makela P, Robson P, House H, Bateman C: Do cannabis-based medicines have general or specific effects on symptoms in MS? A double-blind, randomized, placebo-controlled study on 160 patients. Mult Scler. 2004, 10: 434-441. 10.1191/1352458504ms1082oa.CrossRefPubMed
10.
go back to reference Collin C, Ehler E, Waberzinek G, AlSindi Z, Davies P, Powell K, Notcutt W, O'Leary C, Ratcliffe S, Nováková I, Zapletalova O, Piková J, Ambler Z: A double-blind, randomized, placebo-controlled parallel-group study of Sativex in subjects with symptoms of spasticity due to multiple sclerosis. Neurol Res. 2010, 32: 451-459. 10.1179/016164109X12590518685660.CrossRefPubMed Collin C, Ehler E, Waberzinek G, AlSindi Z, Davies P, Powell K, Notcutt W, O'Leary C, Ratcliffe S, Nováková I, Zapletalova O, Piková J, Ambler Z: A double-blind, randomized, placebo-controlled parallel-group study of Sativex in subjects with symptoms of spasticity due to multiple sclerosis. Neurol Res. 2010, 32: 451-459. 10.1179/016164109X12590518685660.CrossRefPubMed
11.
go back to reference Collin C, Davies P, Mutiboko IK, Ratcliffe S: Randomised controlled trial of a cannabis-based medicine in spasticity caused by MS. Eur J Neurol. 2007, 14: 290-296. 10.1111/j.1468-1331.2006.01639.x.CrossRefPubMed Collin C, Davies P, Mutiboko IK, Ratcliffe S: Randomised controlled trial of a cannabis-based medicine in spasticity caused by MS. Eur J Neurol. 2007, 14: 290-296. 10.1111/j.1468-1331.2006.01639.x.CrossRefPubMed
12.
go back to reference Shakespeare DT, Boggild M, Young C: Anti-spasticity agents for multiple sclerosis. Cochrane Database Syst Rev. 2003, CD001332- Shakespeare DT, Boggild M, Young C: Anti-spasticity agents for multiple sclerosis. Cochrane Database Syst Rev. 2003, CD001332-
13.
go back to reference Fleuren JFM, Voerman GE, Erren-Wolters CV, Snoek GJ, Rietman JS, Hermens HJ, Nene AV: Stop using the Ashworth Scale for the assessment of spasticity. J Neurol Neurosurg Psychiatry. 2010, 81: 46-52. 10.1136/jnnp.2009.177071.CrossRefPubMed Fleuren JFM, Voerman GE, Erren-Wolters CV, Snoek GJ, Rietman JS, Hermens HJ, Nene AV: Stop using the Ashworth Scale for the assessment of spasticity. J Neurol Neurosurg Psychiatry. 2010, 81: 46-52. 10.1136/jnnp.2009.177071.CrossRefPubMed
14.
go back to reference Farrar JT, Troxel AB, Scott C, Duncombe P, Jensen MP: Validity, reliability and clinical importance of change in a 0–10 numeric rating scale measure of spasticity: a post hoc analysis of a randomized, double-blind placebo-controlled trial. Clin Ther. 2008, 30: 974-985. 10.1016/j.clinthera.2008.05.011.CrossRefPubMed Farrar JT, Troxel AB, Scott C, Duncombe P, Jensen MP: Validity, reliability and clinical importance of change in a 0–10 numeric rating scale measure of spasticity: a post hoc analysis of a randomized, double-blind placebo-controlled trial. Clin Ther. 2008, 30: 974-985. 10.1016/j.clinthera.2008.05.011.CrossRefPubMed
15.
go back to reference Anwar K, Barnes MP: A pilot study of a comparison between a patient scored numeric rating scale and clinician scored measures of spasticity in multiple sclerosis. NeuroRehabilitation. 2009, 24: 333-340.PubMed Anwar K, Barnes MP: A pilot study of a comparison between a patient scored numeric rating scale and clinician scored measures of spasticity in multiple sclerosis. NeuroRehabilitation. 2009, 24: 333-340.PubMed
16.
go back to reference Wade DT, Collin C, Stott C, Duncombe P: Meta-analysis of the efficacy and safety of Sativex (nabiximols) on spasticity in people with multiple sclerosis. Mult Scler. 2010, 16: 707-714. 10.1177/1352458510367462.CrossRefPubMed Wade DT, Collin C, Stott C, Duncombe P: Meta-analysis of the efficacy and safety of Sativex (nabiximols) on spasticity in people with multiple sclerosis. Mult Scler. 2010, 16: 707-714. 10.1177/1352458510367462.CrossRefPubMed
17.
go back to reference Fergusson D, Glass KC, Waring D, Shapiro S: Turning a blind eye: the success of blinding reported in a random sample of randomized, placebo-controlled clinical trials. BMJ. 2004, 328: 432-437. 10.1136/bmj.37952.631667.EE.CrossRefPubMedPubMedCentral Fergusson D, Glass KC, Waring D, Shapiro S: Turning a blind eye: the success of blinding reported in a random sample of randomized, placebo-controlled clinical trials. BMJ. 2004, 328: 432-437. 10.1136/bmj.37952.631667.EE.CrossRefPubMedPubMedCentral
18.
go back to reference Hrobjartsson A, Forfang E, Haahr MT, Als-Nielsen B, Brorson S: Blinded trials taken to the test: an analysis of randomized clinical trials that repoprt tests for the success of blinding. Int J Epidemiol. 2007, 36: 654-663. 10.1093/ije/dym020.CrossRefPubMed Hrobjartsson A, Forfang E, Haahr MT, Als-Nielsen B, Brorson S: Blinded trials taken to the test: an analysis of randomized clinical trials that repoprt tests for the success of blinding. Int J Epidemiol. 2007, 36: 654-663. 10.1093/ije/dym020.CrossRefPubMed
19.
go back to reference James KE, Bloch DA, Lee KK, Kraemer HC, Fuller RK: An index for assessing blindness in a multi-centre clinical trial: disulfiram for alcohol cessation - a VA cooperative study. Stat Med. 1996, 15: 1421-1434. 10.1002/(SICI)1097-0258(19960715)15:13<1421::AID-SIM266>3.0.CO;2-H.CrossRefPubMed James KE, Bloch DA, Lee KK, Kraemer HC, Fuller RK: An index for assessing blindness in a multi-centre clinical trial: disulfiram for alcohol cessation - a VA cooperative study. Stat Med. 1996, 15: 1421-1434. 10.1002/(SICI)1097-0258(19960715)15:13<1421::AID-SIM266>3.0.CO;2-H.CrossRefPubMed
20.
go back to reference Bang H, Ni L, Davis CE: Assessment of blinding in clinical trials. Control Clin Trials. 2004, 25: 143-156. 10.1016/j.cct.2003.10.016.CrossRefPubMed Bang H, Ni L, Davis CE: Assessment of blinding in clinical trials. Control Clin Trials. 2004, 25: 143-156. 10.1016/j.cct.2003.10.016.CrossRefPubMed
21.
go back to reference Zajicek J, Fox P, Sanders H, Wright D, Vickery J, Nunn A, Thompson A, UK MS Research Group: Cannabinoids for treatment of spasticity and other symptoms related to multiple sclerosis (CAMS study): multicenter, randomized, placebo-controlled study. Lancet. 2003, 362: 1517-1526. 10.1016/S0140-6736(03)14738-1.CrossRefPubMed Zajicek J, Fox P, Sanders H, Wright D, Vickery J, Nunn A, Thompson A, UK MS Research Group: Cannabinoids for treatment of spasticity and other symptoms related to multiple sclerosis (CAMS study): multicenter, randomized, placebo-controlled study. Lancet. 2003, 362: 1517-1526. 10.1016/S0140-6736(03)14738-1.CrossRefPubMed
22.
go back to reference Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R: The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology. 1994, 44: 16-20. 10.1212/WNL.44.1.16.CrossRefPubMed Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R: The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology. 1994, 44: 16-20. 10.1212/WNL.44.1.16.CrossRefPubMed
23.
go back to reference Fisher RA: The principles of experiment. The Design of Experiments. 1949, Edinburgh and London: Oliver and Boyd, 11-25. Chapter 2, 5 Fisher RA: The principles of experiment. The Design of Experiments. 1949, Edinburgh and London: Oliver and Boyd, 11-25. Chapter 2, 5
Metadata
Title
Assessment of blinding to treatment allocation in studies of a cannabis-based medicine (Sativex®) in people with multiple sclerosis: a new approach
Authors
Stephen Wright
Paul Duncombe
Douglas G Altman
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Trials / Issue 1/2012
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-13-189

Other articles of this Issue 1/2012

Trials 1/2012 Go to the issue