Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

A systematic review of cluster randomised trials in residential facilities for older people suggests how to improve quality

Authors: Karla Diaz-Ordaz, Robert Froud, Bart Sheehan, Sandra Eldridge

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Previous reviews of cluster randomised trials have been critical of the quality of the trials reviewed, but none has explored determinants of the quality of these trials in a specific field over an extended period of time. Recent work suggests that correct conduct and reporting of these trials may require more than published guidelines. In this review, our aim was to assess the quality of cluster randomised trials conducted in residential facilities for older people, and to determine whether (1) statistician involvement in the trial and (2) strength of journal endorsement of the Consolidated Standards of Reporting Trials (CONSORT) statement influence quality.

Methods

We systematically identified trials randomising residential facilities for older people, or parts thereof, without language restrictions, up to the end of 2010, using National Library of Medicine (Medline) via PubMed and hand-searching. We based quality assessment criteria largely on the extended CONSORT statement for cluster randomised trials. We assessed statistician involvement based on statistician co-authorship, and strength of journal endorsement of the CONSORT statement from journal websites.

Results

73 trials met our inclusion criteria. Of these, 20 (27%) reported accounting for clustering in sample size calculations and 54 (74%) in the analyses. In 29 trials (40%), methods used to identify/recruit participants were judged by us to have potentially caused bias or reporting was unclear to reach a conclusion. Some elements of quality improved over time but this appeared not to be related to the publication of the extended CONSORT statement for these trials. Trials with statistician/epidemiologist co-authors were more likely to account for clustering in sample size calculations (unadjusted odds ratio 5.4, 95% confidence interval 1.1 to 26.0) and analyses (unadjusted OR 3.2, 1.2 to 8.5). Journal endorsement of the CONSORT statement was not associated with trial quality.

Conclusions

Despite international attempts to improve methods in cluster randomised trials, important quality limitations remain amongst these trials in residential facilities. Statistician involvement on trial teams may be more effective in promoting quality than further journal endorsement of the CONSORT statement. Funding bodies and journals should promote statistician involvement and co-authorship in addition to adherence to CONSORT guidelines.
Appendix
Available only for authorised users
Literature
1.
Kerry SM, Bland JM: Trials which randomize practices I: how should they be analysed?. Fam Pract. 1998, 15: 80-83.CrossRefPubMed
2.
3.
Puffer S, Torgerson D, Watson J: Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ. 2003, 327 (7418): 785-789.CrossRefPubMedPubMedCentral
4.
Eldridge S, Ashby D, Bennett C, Wakelin M, Feder G: Internal and external validity of cluster randomised trials: systematic review of recent trials. BMJ. 2008, 336 (7649): 876-880.CrossRefPubMedPubMedCentral
5.
Donner A, Brown KS, Brasher P: A methodological review of non-therapeutic intervention trials employing cluster randomization, 1979–1989. Int J Epidemiol. 1990, 19 (4): 795-800.CrossRefPubMed
6.
Simpson JM, Klar N, Donnor A: Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. American journal of public health. 1995, 85 (10): 1378-1383.CrossRefPubMedPubMedCentral
7.
Chuang JH, Hripcsak G, Jenders RA: Considering clustering: a methodological review of clinical decision support system studies. Proceedings/AMIA Annual Symposium. 2000, 146-150.
8.
Isaakidis P, Ioannidis JP: Evaluation of cluster randomized controlled trials in sub-Saharan Africa. Am J Epidemiol. 2003, 158 (9): 921-926.CrossRefPubMed
9.
10.
Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC: Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials. 2004, 1 (1): 80-90.CrossRefPubMed
11.
Bowater RJ, Abdelmalik SM, Lilford RJ: The methodological quality of cluster randomised controlled trials for managing tropical parasitic disease: a review of trials published from 1998 to 2007. Trans R Soc Trop Med Hyg. 2009, 103 (5): 429-436.CrossRefPubMed
12.
Ivers NM, Taljaard M, Dixon S, Bennett C, McRae A, Taleban J, Skea Z, Brehaut JC, Boruch RF, Eccles MP, et al: Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000–8. BMJ. 2011, 343: d5886-CrossRefPubMedPubMedCentral
13.
14.
15.
Delgado-Rodriguez M, Ruiz-Canela M, De Irala-Estevez J, Llorca J, Martinez-Gonzalez A: Participation of epidemiologists and/or biostatisticians and methodological quality of published controlled clinical trials. J Epidemiol Community Health. 2001, 55 (8): 569-572.CrossRefPubMedPubMedCentral
16.
Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH: The reporting of methodological factors in randomized controlled trials and the association with a journal policy to promote adherence to the consolidated standards of reporting trials (CONSORT) checklist. Control Clin Trials. 2002, 23 (4): 380-388.CrossRefPubMed
17.
Eisses AM, Kluiter H, Jongenelis K, Pot AM, Beekman AT, Ormel J: Care staff training in detection of depression in residential homes for the elderly: randomised trial. Br J Psychiatry. 2005, 186: 404-409.CrossRefPubMed
18.
Underwood M, Atherton N, Bremner S, Devine A, Diaz-Ordaz K, Eldridge S, Ellard D, Lamb SE, Potter R, Sheehan B, et al: Exercise for depression in care home residents. A randomised controlled trial with cost-effectiveness analysis (OPERA). Health Technol Assess. In press
19.
Derek King JM-H: Projections of demand for residential care for older people in England. 2010, England: Report for BUPA
20.
Macdonald A, Cooper B: Long-term care and dementia services: an impending crisis. Age Ageing. 2007, 36 (1): 16-22.CrossRefPubMed
21.
Care homes for older people in the UK: A market study edited by office of fair trading. 2005, London, United Kingdom: Crown copyright
22.
Spillman BC, Lubitz J: New estimates of lifetime nursing home use: have patterns of use changed?. Med Care. 2002, 40 (10): 965-975.CrossRefPubMed
23.
Morrison RS: Suffering in silence: addressing the needs of nursing home residents. J Palliat Med. 2009, 12 (8): 671-672.CrossRefPubMed
24.
Handlos LN, Chakraborty H, Sen PK: Evaluation of cluster-randomized trials on maternal and child health research in developing countries. Trop Med Int Health. 2009, 14 (8): 947-956.CrossRefPubMed
25.
Huizing AR, Hamers JP, Gulpers MJ, Berger MP: A cluster-randomized trial of an educational intervention to reduce the use of physical restraints with psychogeriatric nursing home residents. J Am Geriatr Soc. 2009, 57 (7): 1139-1148.CrossRefPubMed
26.
Jensen J, Nyberg L, Gustafson Y, Lundin-Olsson L: Fall and injury prevention in residential care–effects in residents with higher and lower levels of cognition. J Am Geriatr Soc. 2003, 51 (5): 627-635.CrossRefPubMed
27.
Froud R, Eldridge S, Diaz Ordaz K, Marinho VC, Donner A: Quality of cluster randomized controlled trials in oral health: a systematic review of reports published between 2005 and 2009. Community Dent Oral Epidemiol. 2012, 40 (Suppl 1): 3-14.CrossRefPubMed
28.
29.
Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials. 2008, 9: 20-CrossRefPubMedPubMedCentral
30.
Dechartres A, Charles P, Hopewell S, Ravaud P, Altman DG: Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2010, 64 (2): 136-144.CrossRefPubMed
31.
32.
Eldridge S, Kerry S, Torgerson DJ: Bias in identifying and recruiting participants in cluster randomised trials: what can be done?. BMJ. 2009, 339: b4006-doi: 10.1136/bmj.b4006CrossRefPubMed
33.
StataCorp: Stata statistical software: release 11 in. 2009, College Station, TX: StataCorp LP, 11
34.
Sloane PD, Williams CS, Mitchell CM, Preisser JS, Wood W, Barrick AL, Hickman SE, Gill KS, Connell BR, Edinger J, et al: High-intensity environmental light in dementia: effect on sleep and activity. J Am Geriatr Soc. 2007, 55 (10): 1524-1533.CrossRefPubMed
35.
der Lek RF R-v, Swaab DF, Twisk J, Hol EM, Hoogendijk WJ, Van Someren EJ: Effect of bright light and melatonin on cognitive and noncognitive function in elderly residents of group care facilities: a randomized controlled trial. JAMA. 2008, 299 (22): 2642-2655.CrossRef
36.
Taljaard M, McGowan J, Grimshaw JM, Brehaut JC, McRae A, Eccles MP, Donner A: Electronic search strategies to identify reports of cluster randomized trials in MEDLINE: low precision will improve with adherence to reporting standards. BMC Med Res Methodol. 2010, 10: 15-CrossRefPubMedPubMedCentral
37.
Campbell MK, Piaggio G, Elbourne DR, Altman D: CONSORT 2010 statement extension to cluster randomised trials. BMJ. 2012, 345: 5661-CrossRef
38.
Murray DM, Pals SL, Blitstein JL, Alfano CM, Lehman J: Design and analysis of group-randomized trials in cancer: a review of current practices. J Natl Cancer Inst. 2008, 100 (7): 483-491.CrossRefPubMed
39.
Varnell SP, Murray DM, Janega JB, Blitstein JL: Design and analysis of group-randomized trials: a review of recent practices. American journal of public health. 2004, 94 (3): 393-399.CrossRefPubMedPubMedCentral
40.
Taljaard M, McRae AD, Weijer C, Bennett C, Dixon S, Taleban J, Skea Z, Eccles MP, Brehaut JC, Donner A, et al: Inadequate reporting of research ethics review and informed consent in cluster randomised trials: review of random sample of published trials. BMJ. 2011, 342: d2496-CrossRefPubMedPubMedCentral
Metadata
Title
A systematic review of cluster randomised trials in residential facilities for older people suggests how to improve quality
Authors
Karla Diaz-Ordaz
Robert Froud
Bart Sheehan
Sandra Eldridge
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-127

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue

Research article

How experiences become data: the process of eliciting adverse event, medical history and concomitant medication reports in antimalarial and antiretroviral interaction trials

Research article

A threshold method for immunological correlates of protection

Research article

Ensemble-based methods for forecasting census in hospital units

Research article

Assessing potential sources of clustering in individually randomised trials

Erratum

Erratum to: Qualitative systematic reviews of treatment burden in stroke, heart failure and diabetes - Methodological challenges and solutions

Research article

The impact of deployment experience and prior healthcare utilization on enrollment in a large military cohort study