Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Methodology

Managing clustering effects and learning effects in the design and analysis of multicentre randomised trials: a survey to establish current practice

Authors: Elizabeth J. Conroy, Jane M. Blazeby, Girvan Burnside, Jonathan A. Cook, Carrol Gamble

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

Patient outcomes can depend on the treating centre, or health professional, delivering the intervention. A health professional’s skill in delivery improves with experience, meaning that outcomes may be associated with learning. Considering differences in intervention delivery at trial design will ensure that any appropriate adjustments can be made during analysis. This work aimed to establish practice for the allowance of clustering and learning effects in the design and analysis of randomised multicentre trials.

Methods

A survey that drew upon quotes from existing guidelines, references to relevant publications and example trial scenarios was delivered. Registered UK Clinical Research Collaboration Registered Clinical Trials Units were invited to participate.

Results

Forty-four Units participated (N = 50). Clustering was managed through design by stratification, more commonly by centre than by treatment provider. Managing learning by design through defining a minimum expertise level for treatment provider was common (89%). One-third reported experience in expertise-based designs. The majority of Units had adjusted for clustering during analysis, although approaches varied. Analysis of learning was rarely performed for the main analysis (n = 1), although it was explored by other means. The insight behind the approaches used within and reasons for, or against, alternative approaches were provided.

Conclusions

Widespread awareness of challenges in designing and analysing multicentre trials is identified. Approaches used, and opinions on these, vary both across and within Units, indicating that approaches are dependent on the type of trial. Agreeing principles to guide trial design and analysis across a range of realistic clinical scenarios should be considered.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lee KJ, Thompson SG. Clustering by health professional in individually randomised trials. BMJ. 2005;330:142.CrossRef Lee KJ, Thompson SG. Clustering by health professional in individually randomised trials. BMJ. 2005;330:142.CrossRef
2.
go back to reference Cook JA, Bruckner T, MacLennan GS, Seller CM. Clustering in surgical trials–database of intracluster correlations. Trials. 2012;13:2.CrossRef Cook JA, Bruckner T, MacLennan GS, Seller CM. Clustering in surgical trials–database of intracluster correlations. Trials. 2012;13:2.CrossRef
3.
go back to reference Cook JA, Ramsay CR, Fayers P. Statistical evaluation of learning effects in surgical trials. Clinical Trials. 2004;1(5):421–7.CrossRef Cook JA, Ramsay CR, Fayers P. Statistical evaluation of learning effects in surgical trials. Clinical Trials. 2004;1(5):421–7.CrossRef
4.
go back to reference ICH E9 Expert Working Group. ICH Harmonized Tripartite Guideline. Statistical principles for clinical trials. Stats Med. 1999;18:1905–42. ICH E9 Expert Working Group. ICH Harmonized Tripartite Guideline. Statistical principles for clinical trials. Stats Med. 1999;18:1905–42.
5.
go back to reference Conroy EJ, Rosala-Hallas A, Blazeby JM, Burnside G, Cook JA, Gamble C. Funders improved the management of learning and clustering effects through design and analysis of randomised trials involving surgery. J Clin Epidemiol. 2019;446:28–35.CrossRef Conroy EJ, Rosala-Hallas A, Blazeby JM, Burnside G, Cook JA, Gamble C. Funders improved the management of learning and clustering effects through design and analysis of randomised trials involving surgery. J Clin Epidemiol. 2019;446:28–35.CrossRef
6.
go back to reference Ergina PL, Cook JA, Blazeby JM, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374(9695):1097–104.CrossRef Ergina PL, Cook JA, Blazeby JM, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374(9695):1097–104.CrossRef
7.
go back to reference Conroy EJ, Rosala-Hallas A, Blazeby JM, Burnside G, Cook JA, Gamble C. Randomized trials involving surgery did not routinely report considerations of learning and clustering effects. J Clin Epidemiol. 2019;107:27–35.CrossRef Conroy EJ, Rosala-Hallas A, Blazeby JM, Burnside G, Cook JA, Gamble C. Randomized trials involving surgery did not routinely report considerations of learning and clustering effects. J Clin Epidemiol. 2019;107:27–35.CrossRef
8.
go back to reference Roberts C, Roberts SA. Design and analysis of clinical trials with clustering effects due to treatment. Clinical Trials. 2005;2:152–62.CrossRef Roberts C, Roberts SA. Design and analysis of clinical trials with clustering effects due to treatment. Clinical Trials. 2005;2:152–62.CrossRef
9.
go back to reference Cook JA. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials. 2009;10:9.CrossRef Cook JA. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials. 2009;10:9.CrossRef
12.
go back to reference Kahan, B.C., Rehal, S. & Cro, S. Risk of selection bias in randomised trials. Trials 16, 405 (2015). https://doi.org/10.1186/s13063-015-0920-x.CrossRef Kahan, B.C., Rehal, S. & Cro, S. Risk of selection bias in randomised trials. Trials 16, 405 (2015). https://​doi.​org/​10.​1186/​s13063-015-0920-x.​CrossRef
13.
go back to reference Biggs K, Hind D, Gossage-Worrall R, et al. Challenges in the design, planning and implementation of trials evaluating group interventions. Trials. 2020;21:116.CrossRef Biggs K, Hind D, Gossage-Worrall R, et al. Challenges in the design, planning and implementation of trials evaluating group interventions. Trials. 2020;21:116.CrossRef
14.
go back to reference Cook JA, Campbell MK, Gillis K, Skea Z. Surgeons’ and methodologists’ perceptions of utilising an expertise based randomised controlled trial design: a qualitative study. Trials. 2018;19:478.CrossRef Cook JA, Campbell MK, Gillis K, Skea Z. Surgeons’ and methodologists’ perceptions of utilising an expertise based randomised controlled trial design: a qualitative study. Trials. 2018;19:478.CrossRef
17.
go back to reference Boutron I, Moher SD, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacological treatments. Ann Intern Med. 2008;148:60–6.CrossRef Boutron I, Moher SD, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacological treatments. Ann Intern Med. 2008;148:60–6.CrossRef
18.
go back to reference Boutron I, Altman DG, Moher D, Schulz KF. Ravaud P; CONSORT NPT Group. CONSORT Statement for randomized trials of nonpharmacologic treatments: a 2017 update and a CONSORT extension for nonpharmacologic trial abstracts. Ann Intern Med. 2017;167(1):40–7.CrossRef Boutron I, Altman DG, Moher D, Schulz KF. Ravaud P; CONSORT NPT Group. CONSORT Statement for randomized trials of nonpharmacologic treatments: a 2017 update and a CONSORT extension for nonpharmacologic trial abstracts. Ann Intern Med. 2017;167(1):40–7.CrossRef
19.
go back to reference Loudon K, Treweek S, Sullivan F, et al. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:b2147.CrossRef Loudon K, Treweek S, Sullivan F, et al. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:b2147.CrossRef
20.
go back to reference McFadden E, Bashir S, Canham S, et al. The impact of registration of clinical trials units: the UK experience. Clinical Trials. 2015;12:166–73.CrossRef McFadden E, Bashir S, Canham S, et al. The impact of registration of clinical trials units: the UK experience. Clinical Trials. 2015;12:166–73.CrossRef
21.
go back to reference Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.CrossRef Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.CrossRef
Metadata
Title
Managing clustering effects and learning effects in the design and analysis of multicentre randomised trials: a survey to establish current practice
Authors
Elizabeth J. Conroy
Jane M. Blazeby
Girvan Burnside
Jonathan A. Cook
Carrol Gamble
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-04318-x

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue