Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research Article

Recommendations for the analysis of individually randomised controlled trials with clustering in one arm – a case of continuous outcomes

Authors: Laura Flight, Annabel Allison, Munyaradzi Dimairo, Ellen Lee, Laura Mandefield, Stephen J. Walters

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

In an individually randomised controlled trial where the treatment is delivered by a health professional it seems likely that the effectiveness of the treatment, independent of any treatment effect, could depend on the skill, training or even enthusiasm of the health professional delivering it. This may then lead to a potential clustering of the outcomes for patients treated by the same health professional, but similar clustering may not occur in the control arm. Using four case studies, we aim to provide practical guidance and recommendations for the analysis of trials with some element of clustering in one arm.

Methods

Five approaches to the analysis of outcomes from an individually randomised controlled trial with clustering in one arm are identified in the literature. Some of these methods are applied to four case studies of completed randomised controlled trials with clustering in one arm with sample sizes ranging from 56 to 539. Results are obtained using the statistical packages R and Stata and summarised using a forest plot.

Results

The intra-cluster correlation coefficient (ICC) for each of the case studies was small (<0.05) indicating little dependence on the outcomes related to cluster allocations. All models fitted produced similar results, including the simplest approach of ignoring clustering for the case studies considered.

Conclusions

A partially clustered approach, modelling the clustering in just one arm, most accurately represents the trial design and provides valid results. Modelling homogeneous variances between the clustered and unclustered arm is adequate in scenarios similar to the case studies considered. We recommend treating each participant in the unclustered arm as a single cluster. This approach is simple to implement in R and Stata and is recommended for the analysis of trials with clustering in one arm only. However, the case studies considered had small ICC values, limiting the generalisability of these results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Walters SJ. Therapist effects in randomised controlled trials: what to do about them. J Clin Nurs. 2010; 19:1102–1112.CrossRefPubMed Walters SJ. Therapist effects in randomised controlled trials: what to do about them. J Clin Nurs. 2010; 19:1102–1112.CrossRefPubMed
2.
go back to reference Campbell MJ, Walters SJ. How to Design, Analyses and Report Cluster Randomised Trials in Medicine and Health Related Research. West Sussex: Statistics in Practice, Wiley; 2014.CrossRef Campbell MJ, Walters SJ. How to Design, Analyses and Report Cluster Randomised Trials in Medicine and Health Related Research. West Sussex: Statistics in Practice, Wiley; 2014.CrossRef
3.
go back to reference Campbell MJ, Machin D, Walters SJ. Medical Statistics. A Textbook for the Health Sciences, 4th Edition. Chester: Wiley; 2007. Campbell MJ, Machin D, Walters SJ. Medical Statistics. A Textbook for the Health Sciences, 4th Edition. Chester: Wiley; 2007.
4.
go back to reference Baldwin SA, Stice E, Rohde P. Statistical analysis of group-administered intervention data: Reanalysis of two randomized trials. Psychother Res. 2008; 18(4):365–76.CrossRefPubMed Baldwin SA, Stice E, Rohde P. Statistical analysis of group-administered intervention data: Reanalysis of two randomized trials. Psychother Res. 2008; 18(4):365–76.CrossRefPubMed
6.
go back to reference Weatherley-Jones E, Nicholl JP, Thomas KJ, Parry GJ, McKendrick MW, Green ST, Stanley PJ, Lynch SPJ. A randomised,controlled, triple-blind trial of the efficacy of homeopathic treatment for chronic fatigue syndrome. J Psychosom Res. 2004; 56:189–97.CrossRefPubMed Weatherley-Jones E, Nicholl JP, Thomas KJ, Parry GJ, McKendrick MW, Green ST, Stanley PJ, Lynch SPJ. A randomised,controlled, triple-blind trial of the efficacy of homeopathic treatment for chronic fatigue syndrome. J Psychosom Res. 2004; 56:189–97.CrossRefPubMed
7.
go back to reference Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, Roman M, Walters SJ, Nicholl J. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006; 333:623.CrossRefPubMedPubMedCentral Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, Roman M, Walters SJ, Nicholl J. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006; 333:623.CrossRefPubMedPubMedCentral
8.
go back to reference Bauer DJ, Sterba SK, Hallfors DD. Evaluating group-based interventions when control participants are ungrouped. Multivar Behav Res. 2008; 43:210–36.CrossRef Bauer DJ, Sterba SK, Hallfors DD. Evaluating group-based interventions when control participants are ungrouped. Multivar Behav Res. 2008; 43:210–36.CrossRef
10.
go back to reference Heo M, Litwin AH, Blackstock O, Kim N, Arnsten JH. Sample size determinations for group-based randomized clinical trials with different levels of data hierarchy between experimental and control arms. Stat Methods Med Res. 2014; 0:1–15. Heo M, Litwin AH, Blackstock O, Kim N, Arnsten JH. Sample size determinations for group-based randomized clinical trials with different levels of data hierarchy between experimental and control arms. Stat Methods Med Res. 2014; 0:1–15.
11.
go back to reference Galbraith S, Daniel JA, Vissel B. A study of clustered data and approaches to its analysis. J Neurosci. 2010; 30(32):10601–10608.CrossRefPubMed Galbraith S, Daniel JA, Vissel B. A study of clustered data and approaches to its analysis. J Neurosci. 2010; 30(32):10601–10608.CrossRefPubMed
12.
go back to reference Faes MC, Reelick MF, Perry M, Rikkert MGO, Borm GF. Studies with group treatments required special power calculations, allocation methods, and statistical analyses. J Clin Epidemiol. 2012; 65(2):138–46.CrossRefPubMed Faes MC, Reelick MF, Perry M, Rikkert MGO, Borm GF. Studies with group treatments required special power calculations, allocation methods, and statistical analyses. J Clin Epidemiol. 2012; 65(2):138–46.CrossRefPubMed
13.
go back to reference Moerbeek M, Wong WK. Sample size formulae for trials comparing group and individual treatments in a multilevel model. Stat Med. 2008; 27:2850–864.CrossRefPubMed Moerbeek M, Wong WK. Sample size formulae for trials comparing group and individual treatments in a multilevel model. Stat Med. 2008; 27:2850–864.CrossRefPubMed
15.
go back to reference Morrell CJ, Walters SJ, Dixon S, Collins KA, Brereton LML, Peters J, Brooker CGD. Cost effectiveness of community leg ulcer clinics: randomised controlled trial. BMJ. 1998; 316:1487–1497.CrossRefPubMedPubMedCentral Morrell CJ, Walters SJ, Dixon S, Collins KA, Brereton LML, Peters J, Brooker CGD. Cost effectiveness of community leg ulcer clinics: randomised controlled trial. BMJ. 1998; 316:1487–1497.CrossRefPubMedPubMedCentral
16.
go back to reference Morrell CJ, Spiby H, Stewart P, Walters S, Morgan A. Costs and effectiveness of community postnatal support workers: randomised controlled trial. BMJ. 2000; 321:593–8.CrossRefPubMedPubMedCentral Morrell CJ, Spiby H, Stewart P, Walters S, Morgan A. Costs and effectiveness of community postnatal support workers: randomised controlled trial. BMJ. 2000; 321:593–8.CrossRefPubMedPubMedCentral
17.
go back to reference Gail M, Hind D, Gossage-Worrall R, Walters S, Duncan R, Newbould L, Rex S, Jones C, Bowling A, Cattan M, Cairns A, Cooper C, Edwards R, Goyder E. ’Putting Life in Years’ (PLINY) telephone friendship groups research study: pilot randomised controlled trial. Trials. 2014; 15(1):141.CrossRef Gail M, Hind D, Gossage-Worrall R, Walters S, Duncan R, Newbould L, Rex S, Jones C, Bowling A, Cattan M, Cairns A, Cooper C, Edwards R, Goyder E. ’Putting Life in Years’ (PLINY) telephone friendship groups research study: pilot randomised controlled trial. Trials. 2014; 15(1):141.CrossRef
18.
19.
go back to reference Kahan BC, Forbes G, Ali Y, Jairath V, Bremner S, Harhay MO, Hooper R, Wright N, Eldridge SM, Leyrat C. Increased risk of type i errors in cluster randomised trials with small or medium numbers of clusters: a review, reanalysis, and simulation study. Trials. 2016; 17(1):438.CrossRefPubMedPubMedCentral Kahan BC, Forbes G, Ali Y, Jairath V, Bremner S, Harhay MO, Hooper R, Wright N, Eldridge SM, Leyrat C. Increased risk of type i errors in cluster randomised trials with small or medium numbers of clusters: a review, reanalysis, and simulation study. Trials. 2016; 17(1):438.CrossRefPubMedPubMedCentral
20.
go back to reference Satterthwaite FE. An approximate distribution of estimates of variance components. Biom Bull. 1946; 2(6):110–4.CrossRef Satterthwaite FE. An approximate distribution of estimates of variance components. Biom Bull. 1946; 2(6):110–4.CrossRef
21.
go back to reference Kenward MG, Roger JH. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics. 1997; 53(3):983–997.CrossRefPubMed Kenward MG, Roger JH. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics. 1997; 53(3):983–997.CrossRefPubMed
25.
go back to reference Pinheiro J, Bates D. Mixed-effects models in S and S-PLUS.Springer Science & Business Media. 2006. Pinheiro J, Bates D. Mixed-effects models in S and S-PLUS.Springer Science & Business Media. 2006.
26.
go back to reference Cook JA, Bruckner T, MacLennan GS, Seiler CM. Clustering in surgical trials-database of intracluster correlations. Trials. 2012; 13(1):1.CrossRef Cook JA, Bruckner T, MacLennan GS, Seiler CM. Clustering in surgical trials-database of intracluster correlations. Trials. 2012; 13(1):1.CrossRef
27.
go back to reference Browne WJ, Goldstein H, Rasbash J. Multiple membership multiple classification (MMMC) models. Stat Model. 2001; 1(2):103–24.CrossRef Browne WJ, Goldstein H, Rasbash J. Multiple membership multiple classification (MMMC) models. Stat Model. 2001; 1(2):103–24.CrossRef
28.
go back to reference Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992; 30:473–83.CrossRefPubMed Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992; 30:473–83.CrossRefPubMed
Metadata
Title
Recommendations for the analysis of individually randomised controlled trials with clustering in one arm – a case of continuous outcomes
Authors
Laura Flight
Annabel Allison
Munyaradzi Dimairo
Ellen Lee
Laura Mandefield
Stephen J. Walters
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0249-5

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue