Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Review

Stepped wedge cluster randomized controlled trial designs: a review of reporting quality and design features

Authors: Michael J. Grayling, James M. S. Wason, Adrian P. Mander

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

The stepped wedge (SW) cluster randomized controlled trial (CRCT) design is being used with increasing frequency. However, there is limited published research on the quality of reporting of SW-CRCTs. We address this issue by conducting a literature review.

Methods

Medline, Ovid, Web of Knowledge, the Cochrane Library, PsycINFO, the ISRCTN registry, and ClinicalTrials.gov were searched to identify investigations employing the SW-CRCT design up to February 2015. For each included completed study, information was extracted on a selection of criteria, based on the CONSORT extension to CRCTs, to assess the quality of reporting.

Results

A total of 123 studies were included in our review, of which 39 were completed trial reports. The standard of reporting of SW-CRCTs varied in quality. The percentage of trials reporting each criterion varied to as low as 15.4%, with a median of 66.7%.

Conclusions

There is much room for improvement in the quality of reporting of SW-CRCTs. This is consistent with recent findings for CRCTs. A CONSORT extension for SW-CRCTs is warranted to standardize the reporting of SW-CRCTs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Machin D, Campbell MJ. The design of studies for medical research. Chichester: John Wiley & Sons; 2005.CrossRef Machin D, Campbell MJ. The design of studies for medical research. Chichester: John Wiley & Sons; 2005.CrossRef
2.
go back to reference Friedman LM, Furberg CD, DeMets D, Reboussin DM, Granger CB. Fundamentals of clinical trials. New York: Springer; 2015.CrossRef Friedman LM, Furberg CD, DeMets D, Reboussin DM, Granger CB. Fundamentals of clinical trials. New York: Springer; 2015.CrossRef
3.
go back to reference Meinert CL, Tonascia S. Clinical trials: design, conduct, and analysis. Oxford: Oxford University Press; 1986.CrossRef Meinert CL, Tonascia S. Clinical trials: design, conduct, and analysis. Oxford: Oxford University Press; 1986.CrossRef
4.
go back to reference Wang D, Bakhai A. Clinical trials: a practical guide to design, analysis, and reporting. London: Remedica; 2006. Wang D, Bakhai A. Clinical trials: a practical guide to design, analysis, and reporting. London: Remedica; 2006.
5.
go back to reference Bland JM. Cluster randomised trials in the medical literature: two bibliometric surveys. BMC Med Res Meth. 2004;4(1):21.CrossRef Bland JM. Cluster randomised trials in the medical literature: two bibliometric surveys. BMC Med Res Meth. 2004;4(1):21.CrossRef
6.
go back to reference Hayes RJ, Moulton LH. Cluster randomised trials. Boca Raton: Chapman & Hall/ CRC Press; 2009.CrossRef Hayes RJ, Moulton LH. Cluster randomised trials. Boca Raton: Chapman & Hall/ CRC Press; 2009.CrossRef
7.
go back to reference Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Boston: Houghton Mifflin Company; 1979. Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Boston: Houghton Mifflin Company; 1979.
8.
go back to reference Gambia Hepatitis Study Group. The Gambia Hepatitis Intervention Study. Cancer Res. 1987;47(21):5782–7. Gambia Hepatitis Study Group. The Gambia Hepatitis Intervention Study. Cancer Res. 1987;47(21):5782–7.
9.
go back to reference Hemming K, Lilford R, Girling A. Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs. Stat Med. 2015;34(2):181–96.CrossRefPubMed Hemming K, Lilford R, Girling A. Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs. Stat Med. 2015;34(2):181–96.CrossRefPubMed
10.
go back to reference Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8.CrossRefPubMed Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8.CrossRefPubMed
11.
go back to reference Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med. 2016;35(26):4718–28.CrossRefPubMed Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med. 2016;35(26):4718–28.CrossRefPubMed
12.
go back to reference Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomised trials. Contemp Clin Trials. 2007;28(2):182–91.CrossRefPubMed Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomised trials. Contemp Clin Trials. 2007;28(2):182–91.CrossRefPubMed
13.
go back to reference Hemming K, Taljaard M. Sample size calculations for stepped wedge and cluster randomised trials: a unified approach. J Clin Epidemiol. 2015;69:137–46.CrossRefPubMed Hemming K, Taljaard M. Sample size calculations for stepped wedge and cluster randomised trials: a unified approach. J Clin Epidemiol. 2015;69:137–46.CrossRefPubMed
15.
go back to reference Hemming K, Girling A. A menu-driven facility for power and detectable difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2):363–80. Hemming K, Girling A. A menu-driven facility for power and detectable difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2):363–80.
16.
go back to reference Lawrie J, Carlin JB, Forbes AB. Optimal stepped wedge designs. Stat Probabil Lett. 2015;99:210–4.CrossRef Lawrie J, Carlin JB, Forbes AB. Optimal stepped wedge designs. Stat Probabil Lett. 2015;99:210–4.CrossRef
17.
go back to reference Girling AJ, Hemming K. Statistical efficiency and optimal design for stepped cluster studies under linear mixed effects models. Stat Med. 2016;35(13):2149–66.CrossRefPubMedPubMedCentral Girling AJ, Hemming K. Statistical efficiency and optimal design for stepped cluster studies under linear mixed effects models. Stat Med. 2016;35(13):2149–66.CrossRefPubMedPubMedCentral
18.
go back to reference Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. Use of the stepped wedge design cannot be recommended: a critical appraisal and comparison with the classic cluster randomized controlled trial design. J Clin Epidemiol. 2012;65(12):1249–52.CrossRefPubMed Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. Use of the stepped wedge design cannot be recommended: a critical appraisal and comparison with the classic cluster randomized controlled trial design. J Clin Epidemiol. 2012;65(12):1249–52.CrossRefPubMed
19.
go back to reference Mdege ND, Man M-S. Taylor (nee Brown) CA, Torgerson DJ. There are some circumstances where the stepped-wedge cluster randomized trial is preferable to the alternative: no randomized trial at all. Response to the commentary by Kotz and colleagues. J Clin Epidemiol. 2012;65(12):1253–4.CrossRefPubMed Mdege ND, Man M-S. Taylor (nee Brown) CA, Torgerson DJ. There are some circumstances where the stepped-wedge cluster randomized trial is preferable to the alternative: no randomized trial at all. Response to the commentary by Kotz and colleagues. J Clin Epidemiol. 2012;65(12):1253–4.CrossRefPubMed
20.
go back to reference Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. Researchers should convince policy makers to perform a classic cluster randomized controlled trial instead of a stepped wedge design when an intervention is rolled out. J Clin Epidemiol. 2012;65(12):1255–6.CrossRefPubMed Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. Researchers should convince policy makers to perform a classic cluster randomized controlled trial instead of a stepped wedge design when an intervention is rolled out. J Clin Epidemiol. 2012;65(12):1255–6.CrossRefPubMed
21.
go back to reference Hemming K, Girling A, Martin J, Bond SJ. Stepped wedge cluster randomized trials are efficient and provide a method of evaluation without which some interventions would not be evaluated. J Clin Epidemiol. 2013;66(9):1058–9.CrossRefPubMed Hemming K, Girling A, Martin J, Bond SJ. Stepped wedge cluster randomized trials are efficient and provide a method of evaluation without which some interventions would not be evaluated. J Clin Epidemiol. 2013;66(9):1058–9.CrossRefPubMed
22.
go back to reference Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. The stepped wedge design does not inherently have more power than a cluster randomized controlled trial. J Clin Epidemiol. 2013;66(9):1059–60.CrossRefPubMed Kotz D, Spigt M, Arts ICW, Crutzen R, Viechtbauer W. The stepped wedge design does not inherently have more power than a cluster randomized controlled trial. J Clin Epidemiol. 2013;66(9):1059–60.CrossRefPubMed
23.
go back to reference Hemming K, Girling A. The efficiency of stepped wedge vs. cluster randomized trials: stepped wedge studies do not always require a smaller sample size. J Clin Epidemiol. 2013;66(12):1427–8.CrossRefPubMed Hemming K, Girling A. The efficiency of stepped wedge vs. cluster randomized trials: stepped wedge studies do not always require a smaller sample size. J Clin Epidemiol. 2013;66(12):1427–8.CrossRefPubMed
24.
go back to reference de Hoop E, Woertman W, Teerenstra S. The stepped wedge cluster randomized trial always required fewer clusters but not always fewer measurements, that is, participants than a parallel cluster randomized trial in a cross-sectional design. J Clin Epidemiol. 2013;66(12):1428.CrossRefPubMed de Hoop E, Woertman W, Teerenstra S. The stepped wedge cluster randomized trial always required fewer clusters but not always fewer measurements, that is, participants than a parallel cluster randomized trial in a cross-sectional design. J Clin Epidemiol. 2013;66(12):1428.CrossRefPubMed
25.
go back to reference Keriel-Gascou M, Buchet-Poyau K, Rabilloud M, Duclos A, Colin C. A stepped wedge cluster randomized trial is preferable for assessing complex health interventions. J Clin Epidemiol. 2014;67(7):831–3.CrossRefPubMed Keriel-Gascou M, Buchet-Poyau K, Rabilloud M, Duclos A, Colin C. A stepped wedge cluster randomized trial is preferable for assessing complex health interventions. J Clin Epidemiol. 2014;67(7):831–3.CrossRefPubMed
26.
go back to reference Mdege N, Kanaan M. Response to Keriel-Gascou et al. Addressing assumptions on the stepped wedge randomized trial design. J Clin Epidemiol. 2014;67(7):833–4.CrossRefPubMed Mdege N, Kanaan M. Response to Keriel-Gascou et al. Addressing assumptions on the stepped wedge randomized trial design. J Clin Epidemiol. 2014;67(7):833–4.CrossRefPubMed
27.
go back to reference Viechtbauer W, Kotz D, Spigt M, Arts ICW, Crutzen R. Response to Keriel-Gascou et al.: Higher efficiency and other alleged advantages are not inherent to the stepped wedge design. J Clin Epidemiol. 2014; 67(7):834–6. Viechtbauer W, Kotz D, Spigt M, Arts ICW, Crutzen R. Response to Keriel-Gascou et al.: Higher efficiency and other alleged advantages are not inherent to the stepped wedge design. J Clin Epidemiol. 2014; 67(7):834–6.
28.
go back to reference Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.CrossRefPubMed Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.CrossRefPubMed
29.
go back to reference de Hoop E, van der Tweel I, van der Graaf R, Moons KG, van Delden JJ, Reitsma JB, Koffijberg H. The need to balance merits and limitations from different disciplines when considering the stepped wedge cluster randomized trial design. BMC Med Res Methodol. 2015;15:93.CrossRefPubMedPubMedCentral de Hoop E, van der Tweel I, van der Graaf R, Moons KG, van Delden JJ, Reitsma JB, Koffijberg H. The need to balance merits and limitations from different disciplines when considering the stepped wedge cluster randomized trial design. BMC Med Res Methodol. 2015;15:93.CrossRefPubMedPubMedCentral
30.
go back to reference Hargreaves JR, Copas AJ, Bear E, Osrin D, Lewis JJ, Davey C, Thompson JA, Baio G, Fielding KL, Prost A. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16:350.CrossRefPubMedPubMedCentral Hargreaves JR, Copas AJ, Bear E, Osrin D, Lewis JJ, Davey C, Thompson JA, Baio G, Fielding KL, Prost A. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16:350.CrossRefPubMedPubMedCentral
31.
go back to reference Prost A, Bink A, Abubakar I, Roy A, De Allegri M, Mouchoux C, Dreischulte T, Ayles H, Lewis JJ, Osrin D. Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies. Trials. 2015;16:351.CrossRefPubMedPubMedCentral Prost A, Bink A, Abubakar I, Roy A, De Allegri M, Mouchoux C, Dreischulte T, Ayles H, Lewis JJ, Osrin D. Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies. Trials. 2015;16:351.CrossRefPubMedPubMedCentral
33.
go back to reference Mdege N, Man M, Taylor (nee Brown) CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routing implementation. J Clin Epidemiol. 2011;64(9):936–48.CrossRefPubMed Mdege N, Man M, Taylor (nee Brown) CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routing implementation. J Clin Epidemiol. 2011;64(9):936–48.CrossRefPubMed
34.
go back to reference Davey C, Hargreaves J, Thompson JA, Copas AJ, Beard E, Lewis JJ, Fielding KL. Analysis and reporting of stepped wedge randomised controlled trials: synthesis and critical appraisal of published studies 2010 to 2014. Trials. 2015;16:358.CrossRefPubMedPubMedCentral Davey C, Hargreaves J, Thompson JA, Copas AJ, Beard E, Lewis JJ, Fielding KL. Analysis and reporting of stepped wedge randomised controlled trials: synthesis and critical appraisal of published studies 2010 to 2014. Trials. 2015;16:358.CrossRefPubMedPubMedCentral
35.
go back to reference Martin J, Taljaard M, Girling A, Hemming K. Systematic review finds major deficiencies in sample size methodology and reporting for stepped-wedge cluster randomised trials. BMJ Open. 2016;6:e010166.CrossRefPubMedPubMedCentral Martin J, Taljaard M, Girling A, Hemming K. Systematic review finds major deficiencies in sample size methodology and reporting for stepped-wedge cluster randomised trials. BMJ Open. 2016;6:e010166.CrossRefPubMedPubMedCentral
36.
go back to reference Barker D, McElduff P, D’Este C, Campbell MJ. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016;16:69.CrossRefPubMedPubMedCentral Barker D, McElduff P, D’Este C, Campbell MJ. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016;16:69.CrossRefPubMedPubMedCentral
37.
38.
go back to reference Campbell MK, Elbourne DR, Altman DG, for the CONSORT Group. CONSORT 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRefPubMed Campbell MK, Elbourne DR, Altman DG, for the CONSORT Group. CONSORT 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRefPubMed
39.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PloS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PloS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral
41.
go back to reference Beard E, Lewis J, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, Hargreaves J, Prost A. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16:353.CrossRefPubMedPubMedCentral Beard E, Lewis J, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, Hargreaves J, Prost A. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16:353.CrossRefPubMedPubMedCentral
42.
go back to reference Dryden-Peterson S, Bennett K, Hughes MD, Veres A, John O, Pradhananga R, Boyer M, Brown C, Sakyi B, van Widenfelt E, Keapoletswe K, Mine M, Moyo S, Asmelash A, Siedner M, Mmalane M, Shapiro RL, Lockman S. An augmented SMS intervention to improve access to antenatal CD4 testing and ART initiation in HIV-infect pregnant women: a cluster randomized trial. PLoS One. 2015;10(2):e0117181.CrossRefPubMedPubMedCentral Dryden-Peterson S, Bennett K, Hughes MD, Veres A, John O, Pradhananga R, Boyer M, Brown C, Sakyi B, van Widenfelt E, Keapoletswe K, Mine M, Moyo S, Asmelash A, Siedner M, Mmalane M, Shapiro RL, Lockman S. An augmented SMS intervention to improve access to antenatal CD4 testing and ART initiation in HIV-infect pregnant women: a cluster randomized trial. PLoS One. 2015;10(2):e0117181.CrossRefPubMedPubMedCentral
43.
go back to reference Foster JM, Hoskins G, Smith B, Lee AJ, Price D, Pinnock H. Practice development plans to improve the primary care management of acute asthma: randomised controlled trial. BMC Fam Pract. 2007;8:23.CrossRefPubMedPubMedCentral Foster JM, Hoskins G, Smith B, Lee AJ, Price D, Pinnock H. Practice development plans to improve the primary care management of acute asthma: randomised controlled trial. BMC Fam Pract. 2007;8:23.CrossRefPubMedPubMedCentral
44.
go back to reference Fuller C, Michie S, Savage J, McAteer J, Besser S, Charlett A, Hayward A, Cookson BD, Cooper BS, Duckworth G, Jeanes A, Roberts J, Teare L, Stone S. The Feedback Intervention Trial (FIT) – improving hand-hygiene compliance in UK healthcare workers: a stepped wedge cluster randomised controlled trial. PLoS One. 2012;7(10):e41617.CrossRefPubMedPubMedCentral Fuller C, Michie S, Savage J, McAteer J, Besser S, Charlett A, Hayward A, Cookson BD, Cooper BS, Duckworth G, Jeanes A, Roberts J, Teare L, Stone S. The Feedback Intervention Trial (FIT) – improving hand-hygiene compliance in UK healthcare workers: a stepped wedge cluster randomised controlled trial. PLoS One. 2012;7(10):e41617.CrossRefPubMedPubMedCentral
45.
go back to reference Husaini BA, Reece MC, Emerson JS, Scales S, Hull PC, Levine RS. A church-based program on prostate cancer screening for African American men: reducing health disparities. Ethn Dis. 2008;18(2 Suppl 2):179–84. Husaini BA, Reece MC, Emerson JS, Scales S, Hull PC, Levine RS. A church-based program on prostate cancer screening for African American men: reducing health disparities. Ethn Dis. 2008;18(2 Suppl 2):179–84.
46.
go back to reference Gruber JS, Reygadas F, Arnold BF, Nelson K, Colford Jr JM. A stepped wedge, cluster-randomized trial of a household UV-disinfection and safe storage drinking water intervention in rural Baja California Sur, Mexico. Am J Trop Med Hyg. 2013;89(2):238–45.CrossRefPubMedPubMedCentral Gruber JS, Reygadas F, Arnold BF, Nelson K, Colford Jr JM. A stepped wedge, cluster-randomized trial of a household UV-disinfection and safe storage drinking water intervention in rural Baja California Sur, Mexico. Am J Trop Med Hyg. 2013;89(2):238–45.CrossRefPubMedPubMedCentral
47.
go back to reference Cleveland WS. Robust locally weighted regression and smoothing scatterplots. J Am Stat Assoc. 1979;74:829–36.CrossRef Cleveland WS. Robust locally weighted regression and smoothing scatterplots. J Am Stat Assoc. 1979;74:829–36.CrossRef
48.
go back to reference Isaakidis P, Ioannidis JP. Evaluation of cluster randomized controlled trials in sub-Saharan Africa. Am J Epidemiol. 2003;158(9):921–6.CrossRefPubMed Isaakidis P, Ioannidis JP. Evaluation of cluster randomized controlled trials in sub-Saharan Africa. Am J Epidemiol. 2003;158(9):921–6.CrossRefPubMed
49.
go back to reference Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC. Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials. 2004;1(1):80–90.CrossRefPubMed Eldridge SM, Ashby D, Feder GS, Rudnicka AR, Ukoumunne OC. Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials. 2004;1(1):80–90.CrossRefPubMed
50.
go back to reference Diaz-Ordaz K, Froud R, Sheehan B, Eldridge S. A systematic review of cluster randomised trials in residential facilities for older people suggests how to improve quality. BMC Med Res Methodol. 2013;13:237.CrossRef Diaz-Ordaz K, Froud R, Sheehan B, Eldridge S. A systematic review of cluster randomised trials in residential facilities for older people suggests how to improve quality. BMC Med Res Methodol. 2013;13:237.CrossRef
51.
go back to reference Ivers NM, Taljaard M, Dixon S, Bennett C, McRae A, Taleban J, Skea Z, Brehaut JC, Boruch RF, Eccles MP, Grimshaw JM, Weijer C, Zwarenstein M, Donner A. Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000–8. BMJ. 2011;343:d5886.CrossRefPubMedPubMedCentral Ivers NM, Taljaard M, Dixon S, Bennett C, McRae A, Taleban J, Skea Z, Brehaut JC, Boruch RF, Eccles MP, Grimshaw JM, Weijer C, Zwarenstein M, Donner A. Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000–8. BMJ. 2011;343:d5886.CrossRefPubMedPubMedCentral
Metadata
Title
Stepped wedge cluster randomized controlled trial designs: a review of reporting quality and design features
Authors
Michael J. Grayling
James M. S. Wason
Adrian P. Mander
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-1783-0

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue