Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Assessing potential sources of clustering in individually randomised trials

Authors: Brennan C Kahan, Tim P Morris

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Recent reviews have shown that while clustering is extremely common in individually randomised trials (for example, clustering within centre, therapist, or surgeon), it is rarely accounted for in the trial analysis. Our aim is to develop a general framework for assessing whether potential sources of clustering must be accounted for in the trial analysis to obtain valid type I error rates (non-ignorable clustering), with a particular focus on individually randomised trials.

Methods

A general framework for assessing clustering is developed based on theoretical results and a case study of a recently published trial is used to illustrate the concepts. A simulation study is used to explore the impact of not accounting for non-ignorable clustering in practice.

Results

Clustering is non-ignorable when there is both correlation between patient outcomes within clusters, and correlation between treatment assignments within clusters. This occurs when the intraclass correlation coefficient is non-zero, and when the cluster has been used in the randomisation process (e.g. stratified blocks within centre) or when patients are assigned to clusters after randomisation with different probabilities (e.g. a surgery trial in which surgeons treat patients in only one arm). A case study of an individually randomised trial found multiple sources of clustering, including centre of recruitment, attending surgeon, and site of rehabilitation class. Simulations show that failure to account for non-ignorable clustering in trial analyses can lead to type I error rates over 20% in certain cases; conversely, adjusting for the clustering in the trial analysis gave correct type I error rates.

Conclusions

Clustering is common in individually randomised trials. Trialists should assess potential sources of clustering during the planning stages of a trial, and account for any sources of non-ignorable clustering in the trial analysis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Liang KY, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika. 1986, 73: 13-22. 10.1093/biomet/73.1.13.CrossRef Liang KY, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika. 1986, 73: 13-22. 10.1093/biomet/73.1.13.CrossRef
2.
go back to reference Hayes RJ, Moulton LH: Cluster Randomised Trials. 2009, Boca Raton: Chapman & Hall/CRCCrossRef Hayes RJ, Moulton LH: Cluster Randomised Trials. 2009, Boca Raton: Chapman & Hall/CRCCrossRef
3.
go back to reference Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. 2000, New York: Oxford University Press Inc. Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. 2000, New York: Oxford University Press Inc.
4.
5.
go back to reference Biau DJ, Porcher R, Boutron I: The account for provider and center effects in multicenter interventional and surgical randomized controlled trials is in need of improvement: a review. J Clin Epidemiol. 2008, 61 (5): 435-439. 10.1016/j.jclinepi.2007.10.018.CrossRefPubMed Biau DJ, Porcher R, Boutron I: The account for provider and center effects in multicenter interventional and surgical randomized controlled trials is in need of improvement: a review. J Clin Epidemiol. 2008, 61 (5): 435-439. 10.1016/j.jclinepi.2007.10.018.CrossRefPubMed
6.
go back to reference Localio AR, Berlin JA, Ten Have TR, Kimmel SE: Adjustments for center in multicenter studies: an overview. Ann Intern Med. 2001, 135 (2): 112-123. 10.7326/0003-4819-135-2-200107170-00012.CrossRefPubMed Localio AR, Berlin JA, Ten Have TR, Kimmel SE: Adjustments for center in multicenter studies: an overview. Ann Intern Med. 2001, 135 (2): 112-123. 10.7326/0003-4819-135-2-200107170-00012.CrossRefPubMed
7.
go back to reference Parzen M, Lipsitz SR, Dear KBG: Does clustering affect the usual test statistics of no treatment effect in a randomized clinical trial?. Biom J. 1998, 40: 385-402. 10.1002/(SICI)1521-4036(199808)40:4<385::AID-BIMJ385>3.0.CO;2-#.CrossRef Parzen M, Lipsitz SR, Dear KBG: Does clustering affect the usual test statistics of no treatment effect in a randomized clinical trial?. Biom J. 1998, 40: 385-402. 10.1002/(SICI)1521-4036(199808)40:4<385::AID-BIMJ385>3.0.CO;2-#.CrossRef
8.
go back to reference Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21 (4): 330-342. 10.1016/S0197-2456(00)00061-1.CrossRefPubMed Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21 (4): 330-342. 10.1016/S0197-2456(00)00061-1.CrossRefPubMed
9.
go back to reference McGregor AH, Dore CJ, Morris TP, Morris S, Jamrozik K: ISSLS prize winner: function after spinal treatment, exercise, and rehabilitation (FASTER): a factorial randomized trial to determine whether the functional outcome of spinal surgery can be improved. Spine (Phila Pa 1976). 2011, 36 (21): 1711-1720. 10.1097/BRS.0b013e318214e3e6.CrossRef McGregor AH, Dore CJ, Morris TP, Morris S, Jamrozik K: ISSLS prize winner: function after spinal treatment, exercise, and rehabilitation (FASTER): a factorial randomized trial to determine whether the functional outcome of spinal surgery can be improved. Spine (Phila Pa 1976). 2011, 36 (21): 1711-1720. 10.1097/BRS.0b013e318214e3e6.CrossRef
10.
go back to reference Cook JA, Bruckner T, MacLennan GS, Seiler CM: Clustering in surgical trials–database of intracluster correlations. Trials. 2012, 13: 2-10.1186/1745-6215-13-2.CrossRefPubMedPubMedCentral Cook JA, Bruckner T, MacLennan GS, Seiler CM: Clustering in surgical trials–database of intracluster correlations. Trials. 2012, 13: 2-10.1186/1745-6215-13-2.CrossRefPubMedPubMedCentral
11.
go back to reference Kahan BC, Morris TP: Improper analysis of trials randomised using stratified blocks or minimisation. Stat Med. 2012, 31 (4): 328-340. 10.1002/sim.4431.CrossRefPubMed Kahan BC, Morris TP: Improper analysis of trials randomised using stratified blocks or minimisation. Stat Med. 2012, 31 (4): 328-340. 10.1002/sim.4431.CrossRefPubMed
12.
go back to reference Kahan BC, Morris TP: Analysis of multicentre trials with continuous outcomes: when and how should we account for centre effects?. Stat Med. 2013, 32 (7): 1136-49. 10.1002/sim.5667.CrossRefPubMed Kahan BC, Morris TP: Analysis of multicentre trials with continuous outcomes: when and how should we account for centre effects?. Stat Med. 2013, 32 (7): 1136-49. 10.1002/sim.5667.CrossRefPubMed
13.
go back to reference Kahan BC, Morris TP: Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis. BMJ. 2012, 345: e5840-10.1136/bmj.e5840.CrossRefPubMedPubMedCentral Kahan BC, Morris TP: Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis. BMJ. 2012, 345: e5840-10.1136/bmj.e5840.CrossRefPubMedPubMedCentral
14.
go back to reference Follmann D, Fay M: Exact inference for complex clustered data using within-cluster resampling. J Biopharm Stat. 2010, 20 (4): 850-869. 10.1080/10543401003618884.CrossRefPubMed Follmann D, Fay M: Exact inference for complex clustered data using within-cluster resampling. J Biopharm Stat. 2010, 20 (4): 850-869. 10.1080/10543401003618884.CrossRefPubMed
15.
go back to reference Proschan M, Follmann D: Cluster without fluster: the effect of correlated outcomes on inference in randomized clinical trials. Stat Med. 2008, 27 (6): 795-809. 10.1002/sim.2977.CrossRefPubMed Proschan M, Follmann D: Cluster without fluster: the effect of correlated outcomes on inference in randomized clinical trials. Stat Med. 2008, 27 (6): 795-809. 10.1002/sim.2977.CrossRefPubMed
16.
go back to reference Hernandez AV, Steyerberg EW, Habbema JD: Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. J Clin Epidemiol. 2004, 57 (5): 454-460. 10.1016/j.jclinepi.2003.09.014.CrossRefPubMed Hernandez AV, Steyerberg EW, Habbema JD: Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. J Clin Epidemiol. 2004, 57 (5): 454-460. 10.1016/j.jclinepi.2003.09.014.CrossRefPubMed
17.
go back to reference Turner EL, Perel P, Clayton T, Edwards P, Hernandez AV, Roberts I, Shakur H, Steyerberg EW: Covariate adjustment increased power in randomized controlled trials: an example in traumatic brain injury. J Clin Epidemiol. 2012, 65 (5): 474-481. 10.1016/j.jclinepi.2011.08.012.CrossRefPubMed Turner EL, Perel P, Clayton T, Edwards P, Hernandez AV, Roberts I, Shakur H, Steyerberg EW: Covariate adjustment increased power in randomized controlled trials: an example in traumatic brain injury. J Clin Epidemiol. 2012, 65 (5): 474-481. 10.1016/j.jclinepi.2011.08.012.CrossRefPubMed
18.
go back to reference International Conference on Harmonisation E9 Expert Working Group: ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. Stat Med. 1999, 18: 1905-1942. International Conference on Harmonisation E9 Expert Working Group: ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. Stat Med. 1999, 18: 1905-1942.
Metadata
Title
Assessing potential sources of clustering in individually randomised trials
Authors
Brennan C Kahan
Tim P Morris
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-58

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue