Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2005

Open Access 01-12-2005 | Research article

Methodological bias in cluster randomised trials

Authors: Seokyung Hahn, Suezann Puffer, David J Torgerson, Judith Watson

Published in: BMC Medical Research Methodology | Issue 1/2005

Login to get access

Abstract

Background

Cluster randomised trials can be susceptible to a range of methodological problems. These problems are not commonly recognised by many researchers. In this paper we discuss the issues that can lead to bias in cluster trials.

Methods

We used a sample of cluster randomised trials from a recent review and from a systematic review of hip protectors. We compared the mean age of participants between intervention groups in a sample of 'good' cluster trials with a sample of potentially biased trials. We also compared the effect sizes, in a funnel plot, between hip protector trials that used individual randomisation compared with those that used cluster randomisation.

Results

There is a tendency for cluster trials, with evidence methodological biases, to also show an age imbalance between treatment groups. In a funnel plot we show that all cluster trials show a large positive effect of hip protectors whilst individually randomised trials show a range of positive and negative effects, suggesting that cluster trials may be producing a biased estimate of effect.

Conclusion

Methodological biases in the design and execution of cluster randomised trials is frequent. Some of these biases associated with the use of cluster designs can be avoided through careful attention to the design of cluster trials. Firstly, if possible, individual allocation should be used. Secondly, if cluster allocation is required, then ideally participants should be identified before random allocation of the clusters. Third, if prior identification is not possible, then an independent recruiter should be used to recruit participants.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lindqust EF: Statistical Analysis in Educational Research. 1940, Houghton Mifflin Co, New York Lindqust EF: Statistical Analysis in Educational Research. 1940, Houghton Mifflin Co, New York
2.
go back to reference Donner A, Klar NS: Design and Analysis of Cluster Randomisation Trials in Health Research. 2000, Hodder Arnold London Donner A, Klar NS: Design and Analysis of Cluster Randomisation Trials in Health Research. 2000, Hodder Arnold London
4.
go back to reference Puffer S, Torgerson D, Watson J: Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ. 2003, 327: 785-788. 10.1136/bmj.327.7418.785.CrossRefPubMedPubMedCentral Puffer S, Torgerson D, Watson J: Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ. 2003, 327: 785-788. 10.1136/bmj.327.7418.785.CrossRefPubMedPubMedCentral
5.
go back to reference Schulz KF: Subverting randomisation in controlled trials. JAMA. 1995, 456-8. Schulz KF: Subverting randomisation in controlled trials. JAMA. 1995, 456-8.
6.
go back to reference Kennedy AM, Grant A: Subversion of allocation in a randomised controlled trial. Control Clin Trials. 1997, 18 (suppl 3): 77-8S. 10.1016/S0197-2456(97)91044-8.CrossRef Kennedy AM, Grant A: Subversion of allocation in a randomised controlled trial. Control Clin Trials. 1997, 18 (suppl 3): 77-8S. 10.1016/S0197-2456(97)91044-8.CrossRef
7.
go back to reference Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials in obstetrics and gynaecology journals. JAMA. 1994, 272: 125-28. 10.1001/jama.272.2.125.CrossRefPubMed Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials in obstetrics and gynaecology journals. JAMA. 1994, 272: 125-28. 10.1001/jama.272.2.125.CrossRefPubMed
8.
go back to reference Kjaergaard LL, Villumsen J, Cluud C: Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses. Ann Intern Med. 2001, 135: 982-89.CrossRef Kjaergaard LL, Villumsen J, Cluud C: Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses. Ann Intern Med. 2001, 135: 982-89.CrossRef
9.
go back to reference Grossman DC, Neckerman HJ, Koepsall TD, Liu PY, Asher KN, Beland K, Frey K, Rivara FP: Effectiveness of a violence prevention curriculum among children in elementary school: A randomized controlled trial. JAMA. 1997, 277: 1605-11. 10.1001/jama.277.20.1605.CrossRefPubMed Grossman DC, Neckerman HJ, Koepsall TD, Liu PY, Asher KN, Beland K, Frey K, Rivara FP: Effectiveness of a violence prevention curriculum among children in elementary school: A randomized controlled trial. JAMA. 1997, 277: 1605-11. 10.1001/jama.277.20.1605.CrossRefPubMed
10.
go back to reference Jordhoy MS, Fayers PM, Ahlner-Elmqvist M, Kaasa S: Lack of concealment may lead to selection bias in cluster randomized trials of palliative care. Palliative Medicine. 2002, 16: 43-9. 10.1191/0269216302pm523oa.CrossRefPubMed Jordhoy MS, Fayers PM, Ahlner-Elmqvist M, Kaasa S: Lack of concealment may lead to selection bias in cluster randomized trials of palliative care. Palliative Medicine. 2002, 16: 43-9. 10.1191/0269216302pm523oa.CrossRefPubMed
11.
go back to reference Molloy DW, Guyatt GH, Russo R, Goeree R, O'Brien BJ, et al: Systematic implementation of and advance directive program in nursing homes: A randomized controlled trial. JAMA. 2000, 283: 1437-44. 10.1001/jama.283.11.1437.CrossRefPubMed Molloy DW, Guyatt GH, Russo R, Goeree R, O'Brien BJ, et al: Systematic implementation of and advance directive program in nursing homes: A randomized controlled trial. JAMA. 2000, 283: 1437-44. 10.1001/jama.283.11.1437.CrossRefPubMed
12.
go back to reference Farrin AJ, Russell IT, Torgerson D, Underwood M: Differential recruitment in a cluster-randomised trial in primary care – the experience of the UK Back pain, Exercise, Active management and Manipulation (UK BEAM) feasibility study. Clinical Trials. 2005, Farrin AJ, Russell IT, Torgerson D, Underwood M: Differential recruitment in a cluster-randomised trial in primary care – the experience of the UK Back pain, Exercise, Active management and Manipulation (UK BEAM) feasibility study. Clinical Trials. 2005,
13.
go back to reference Kendrick D, Marsh P, Fielding K, Miller P: Preventing injuries in children: cluster randomised controlled trial in primary care. BMJ. 1999, 318: 980-3.CrossRefPubMedPubMedCentral Kendrick D, Marsh P, Fielding K, Miller P: Preventing injuries in children: cluster randomised controlled trial in primary care. BMJ. 1999, 318: 980-3.CrossRefPubMedPubMedCentral
14.
go back to reference Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC: Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clinical Trials. 2004, 1: 80-90.CrossRefPubMed Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC: Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clinical Trials. 2004, 1: 80-90.CrossRefPubMed
15.
go back to reference Parker MJ, Gillespie LD, Gillespie WJ: Hip Protectors for preventing hip fractures in the elderly (Cochrane Review). The Cochrane Library. 2004, Chichester, UK: John Wiley & Sons, Ltd, 2 Parker MJ, Gillespie LD, Gillespie WJ: Hip Protectors for preventing hip fractures in the elderly (Cochrane Review). The Cochrane Library. 2004, Chichester, UK: John Wiley & Sons, Ltd, 2
16.
go back to reference Birks YF, Porthouse J, Addie C, Loughney K, Saxon L, Baverstock M, Francis R, Reid DM, Watt I, Torgerson DJ, the Primary Care Hip Protector Trial Group: Randomised Controlled Trial of Hip Protectors among Women Living in the Community. Osteoporosis International. 2004, 15: 701-06. 10.1007/s00198-004-1599-0.CrossRefPubMed Birks YF, Porthouse J, Addie C, Loughney K, Saxon L, Baverstock M, Francis R, Reid DM, Watt I, Torgerson DJ, the Primary Care Hip Protector Trial Group: Randomised Controlled Trial of Hip Protectors among Women Living in the Community. Osteoporosis International. 2004, 15: 701-06. 10.1007/s00198-004-1599-0.CrossRefPubMed
17.
go back to reference Kannus P, Parkkari J, Niemi S, Pasanen M, Palvanen M, Javinen M, Vouri I: Prevention of hip fracture in elderly people with use of hip protector. N Engl J Med. 2000, 343: 1506-13. 10.1056/NEJM200011233432101.CrossRefPubMed Kannus P, Parkkari J, Niemi S, Pasanen M, Palvanen M, Javinen M, Vouri I: Prevention of hip fracture in elderly people with use of hip protector. N Engl J Med. 2000, 343: 1506-13. 10.1056/NEJM200011233432101.CrossRefPubMed
18.
go back to reference King M, Davidson O, Taylor F, Haines A, Sharp D, Turner R: Effectiveness of teaching general practitioners skills in brief cognitive behaviour therapy to treat patients with depression: randomised controlled trial. BMJ. 2002, 324: 947-52. 10.1136/bmj.324.7343.947.CrossRefPubMedPubMedCentral King M, Davidson O, Taylor F, Haines A, Sharp D, Turner R: Effectiveness of teaching general practitioners skills in brief cognitive behaviour therapy to treat patients with depression: randomised controlled trial. BMJ. 2002, 324: 947-52. 10.1136/bmj.324.7343.947.CrossRefPubMedPubMedCentral
19.
go back to reference Bland JM: Cluster randomised trials in the medical literature: two bibliometric surveys. BMC Medical Research Methodology. 2004, 4: 21-10.1186/1471-2288-4-21.CrossRefPubMedPubMedCentral Bland JM: Cluster randomised trials in the medical literature: two bibliometric surveys. BMC Medical Research Methodology. 2004, 4: 21-10.1186/1471-2288-4-21.CrossRefPubMedPubMedCentral
Metadata
Title
Methodological bias in cluster randomised trials
Authors
Seokyung Hahn
Suezann Puffer
David J Torgerson
Judith Watson
Publication date
01-12-2005
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2005
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-5-10

Other articles of this Issue 1/2005

BMC Medical Research Methodology 1/2005 Go to the issue