Skip to main content
Top
Published in: Clinical Oral Investigations 1/2014

01-01-2014 | Original Article

Randomization in clinical trials: stratification or minimization? The HERMES free simulation software

Authors: Hélène Fron Chabouis, Francis Chabouis, Florence Gillaizeau, Pierre Durieux, Gilles Chatellier, N. Dorin Ruse, Jean-Pierre Attal

Published in: Clinical Oral Investigations | Issue 1/2014

Login to get access

Abstract

Objectives

Operative clinical trials are often small and open-label. Randomization is therefore very important. Stratification and minimization are two randomization options in such trials. The first aim of this study was to compare stratification and minimization in terms of predictability and balance in order to help investigators choose the most appropriate allocation method. Our second aim was to evaluate the influence of various parameters on the performance of these techniques.

Materials and methods

The created software generated patients according to chosen trial parameters (e.g., number of important prognostic factors, number of operators or centers, etc.) and computed predictability and balance indicators for several stratification and minimization methods over a given number of simulations. Block size and proportion of random allocations could be chosen. A reference trial was chosen (50 patients, 1 prognostic factor, and 2 operators) and eight other trials derived from this reference trial were modeled. Predictability and balance indicators were calculated from 10,000 simulations per trial.

Results

Minimization performed better with complex trials (e.g., smaller sample size, increasing number of prognostic factors, and operators); stratification imbalance increased when the number of strata increased. An inverse correlation between imbalance and predictability was observed.

Conclusions

A compromise between predictability and imbalance still has to be found by the investigator but our software (HERMES) gives concrete reasons for choosing between stratification and minimization; it can be downloaded free of charge.

Clinical relevance

This software will help investigators choose the appropriate randomization method in future two-arm trials.
Appendix
Available only for authorised users
Footnotes
1
This software can be downloaded at the following address: chabouis.​fr/​helene/​hermes
 
2
We could also do a simple sum of the absolute imbalance values, but this method allowed us to penalize more serious imbalances. [39]
 
Literature
1.
go back to reference Altman DG, Bland JM (1999) Statistics notes. Treatment allocation in controlled trials: why randomise? BMJ 318(7192):1209PubMedCrossRef Altman DG, Bland JM (1999) Statistics notes. Treatment allocation in controlled trials: why randomise? BMJ 318(7192):1209PubMedCrossRef
4.
go back to reference D'Agostino RB, Sr. and Massaro JM (2004) New developments in medical clinical trials. J Dent Res 83 Spec No C:C18-24 D'Agostino RB, Sr. and Massaro JM (2004) New developments in medical clinical trials. J Dent Res 83 Spec No C:C18-24
5.
go back to reference Pandis N, Polychronopoulou A, Eliades T (2011) Randomization in clinical trials in orthodontics: its significance in research design and methods to achieve it. Eur J Orthod. doi:10.1093/ejo/cjq141 Pandis N, Polychronopoulou A, Eliades T (2011) Randomization in clinical trials in orthodontics: its significance in research design and methods to achieve it. Eur J Orthod. doi:10.​1093/​ejo/​cjq141
6.
go back to reference Pocock SJ, Assmann SE, Enos LE, Kasten LE (2002) Subgroup analysis, covariate adjustment, and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med 21(19):2917–2930. doi:10.1002/sim.1296 PubMedCrossRef Pocock SJ, Assmann SE, Enos LE, Kasten LE (2002) Subgroup analysis, covariate adjustment, and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med 21(19):2917–2930. doi:10.​1002/​sim.​1296 PubMedCrossRef
8.
go back to reference Halpern J, Brown BW Jr (1986) Sequential treatment allocation procedures in clinical trials—with particular attention to the analysis of results for the biased coin design. Stat Med 5(3):211–229PubMedCrossRef Halpern J, Brown BW Jr (1986) Sequential treatment allocation procedures in clinical trials—with particular attention to the analysis of results for the biased coin design. Stat Med 5(3):211–229PubMedCrossRef
9.
go back to reference Watson HR, Pearce AC (1990) Treatment allocation in clinical trials: randomisation and minimisation compared in three test cases. Pharmaceutical Medicine 4(3):207–212 Watson HR, Pearce AC (1990) Treatment allocation in clinical trials: randomisation and minimisation compared in three test cases. Pharmaceutical Medicine 4(3):207–212
10.
go back to reference ICH Harmonised Tripartite Guideline, Statistical principles for clinical trials, International Conference on Harmonisation E9 Expert Working Group (1999) Stat Med 18(15):1905–1942 ICH Harmonised Tripartite Guideline, Statistical principles for clinical trials, International Conference on Harmonisation E9 Expert Working Group (1999) Stat Med 18(15):1905–1942
11.
go back to reference Buyse M (2000) Centralized treatment allocation in comparative clinical trials. Applied Clinical Trials 9:32–37 Buyse M (2000) Centralized treatment allocation in comparative clinical trials. Applied Clinical Trials 9:32–37
12.
go back to reference Green H, McEntegart DJ, Byrom B, Ghani S, Shepherd S (2001) Minimization in crossover trials with non-prognostic strata: theory and practical application. J Clin Pharm Ther 26(2):121–128PubMedCrossRef Green H, McEntegart DJ, Byrom B, Ghani S, Shepherd S (2001) Minimization in crossover trials with non-prognostic strata: theory and practical application. J Clin Pharm Ther 26(2):121–128PubMedCrossRef
13.
go back to reference McEntegart D (2003) The pursuit of balance using stratified and dynamic randomization techniques: an overview. Drug Information Journal 37:293–308CrossRef McEntegart D (2003) The pursuit of balance using stratified and dynamic randomization techniques: an overview. Drug Information Journal 37:293–308CrossRef
15.
16.
go back to reference Treasure T, MacRae KD (1998) Minimisation: the platinum standard for trials? Randomisation doesn’t guarantee similarity of groups; minimisation does. BMJ 317(7155):362–363PubMedCrossRef Treasure T, MacRae KD (1998) Minimisation: the platinum standard for trials? Randomisation doesn’t guarantee similarity of groups; minimisation does. BMJ 317(7155):362–363PubMedCrossRef
17.
go back to reference Rovers MM, Straatman H, Zielhuis GA, Ingels K, van der Wilt GJ (2000) Using a balancing procedure in multicenter clinical trials. Simulation of patient allocation based on a trial of ventilation tubes for otitis media with effusion in infants. Int J Technol Assess Health Care 16(1):276–281PubMedCrossRef Rovers MM, Straatman H, Zielhuis GA, Ingels K, van der Wilt GJ (2000) Using a balancing procedure in multicenter clinical trials. Simulation of patient allocation based on a trial of ventilation tubes for otitis media with effusion in infants. Int J Technol Assess Health Care 16(1):276–281PubMedCrossRef
18.
go back to reference Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG (1976) Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design. Br J Cancer 34(6):585–612PubMedCentralPubMedCrossRef Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG (1976) Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design. Br J Cancer 34(6):585–612PubMedCentralPubMedCrossRef
19.
go back to reference Nam JM (1995) Sample size determination in stratified trials to establish the equivalence of two treatments. Stat Med 14(18):2037–2049PubMedCrossRef Nam JM (1995) Sample size determination in stratified trials to establish the equivalence of two treatments. Stat Med 14(18):2037–2049PubMedCrossRef
20.
go back to reference Kernan WN, Viscoli CM, Makuch RW, Brass LM, Horwitz RI (1999) Stratified randomization for clinical trials. J Clin Epidemiol 52(1):19–26PubMedCrossRef Kernan WN, Viscoli CM, Makuch RW, Brass LM, Horwitz RI (1999) Stratified randomization for clinical trials. J Clin Epidemiol 52(1):19–26PubMedCrossRef
22.
go back to reference Efron B (1971) Forcing a sequential experiment to be balanced. Biometrika 58(1971):403–417CrossRef Efron B (1971) Forcing a sequential experiment to be balanced. Biometrika 58(1971):403–417CrossRef
23.
go back to reference Wei LJ (1977) A class of designs for sequential clinical trials. J Am Stat Assoc 72:382–386CrossRef Wei LJ (1977) A class of designs for sequential clinical trials. J Am Stat Assoc 72:382–386CrossRef
24.
go back to reference Soares JF, Wu CF (1983) Some restricted randomization rules in sequential designs. Communications in statistics—theory and methods 12:2017–2034CrossRef Soares JF, Wu CF (1983) Some restricted randomization rules in sequential designs. Communications in statistics—theory and methods 12:2017–2034CrossRef
25.
go back to reference Signorini DF, Leung O, Simes RJ, Beller E, Gebski VJ, Callaghan T (1993) Dynamic balanced randomization for clinical trials. Stat Med 12(24):2343–2350PubMedCrossRef Signorini DF, Leung O, Simes RJ, Beller E, Gebski VJ, Callaghan T (1993) Dynamic balanced randomization for clinical trials. Stat Med 12(24):2343–2350PubMedCrossRef
27.
go back to reference Therneau TM (1993) How many stratification factors are “too many” to use in a randomization plan? Control Clin Trials 14(2):98–108PubMedCrossRef Therneau TM (1993) How many stratification factors are “too many” to use in a randomization plan? Control Clin Trials 14(2):98–108PubMedCrossRef
28.
go back to reference Taves DR (1974) Minimization: a new method of assigning patients to treatment and control groups. Clin Pharmacol Ther 15(5):443–453PubMed Taves DR (1974) Minimization: a new method of assigning patients to treatment and control groups. Clin Pharmacol Ther 15(5):443–453PubMed
29.
go back to reference Pocock SJ, Simon R (1975) Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. Biometrics 31(1):103–115PubMedCrossRef Pocock SJ, Simon R (1975) Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. Biometrics 31(1):103–115PubMedCrossRef
30.
go back to reference Brown S, Thorpe H, Hawkins K, Brown J (2005) Minimization—reducing predictability for multi-centre trials whilst retaining balance within centre. Stat Med 24(24):3715–3727. doi:10.1002/sim.2391 PubMedCrossRef Brown S, Thorpe H, Hawkins K, Brown J (2005) Minimization—reducing predictability for multi-centre trials whilst retaining balance within centre. Stat Med 24(24):3715–3727. doi:10.​1002/​sim.​2391 PubMedCrossRef
31.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T (2001) The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 134(8):663–694PubMedCrossRef Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T (2001) The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 134(8):663–694PubMedCrossRef
33.
go back to reference Toorawa R, Adena M, Donovan M, Jones S, Conlon J (2009) Use of simulation to compare the performance of minimization with stratified blocked randomization. Pharm Stat 8(4):264–278. doi:10.1002/pst.346 PubMedCrossRef Toorawa R, Adena M, Donovan M, Jones S, Conlon J (2009) Use of simulation to compare the performance of minimization with stratified blocked randomization. Pharm Stat 8(4):264–278. doi:10.​1002/​pst.​346 PubMedCrossRef
34.
go back to reference Kundt G (2009) Comparative evaluation of balancing properties of stratified randomization procedures. Methods Inf Med 48(2):129–134. doi:10.3414/ME0538 PubMed Kundt G (2009) Comparative evaluation of balancing properties of stratified randomization procedures. Methods Inf Med 48(2):129–134. doi:10.​3414/​ME0538 PubMed
35.
go back to reference Birkett NJ (1985) Adaptive allocation in randomized controlled trials. Control Clin Trials 6(2):146–155PubMedCrossRef Birkett NJ (1985) Adaptive allocation in randomized controlled trials. Control Clin Trials 6(2):146–155PubMedCrossRef
37.
go back to reference Verberk WJ, Kroon AA, Kessels AG, Nelemans PJ, Van Ree JW, Lenders JW, Thien T, Bakx JC, Van Montfrans GA, Smit AJ, Beltman FW, De Leeuw PW (2005) Comparison of randomization techniques for clinical trials with data from the HOMERUS-trial. Blood Press 14(5):306–314. doi:10.1080/08037050500331538 PubMedCrossRef Verberk WJ, Kroon AA, Kessels AG, Nelemans PJ, Van Ree JW, Lenders JW, Thien T, Bakx JC, Van Montfrans GA, Smit AJ, Beltman FW, De Leeuw PW (2005) Comparison of randomization techniques for clinical trials with data from the HOMERUS-trial. Blood Press 14(5):306–314. doi:10.​1080/​0803705050033153​8 PubMedCrossRef
39.
go back to reference Scott NW, McPherson GC, Ramsay CR, Campbell MK (2002) The method of minimization for allocation to clinical trials. A review. Control Clin Trials 23(6):662–674PubMedCrossRef Scott NW, McPherson GC, Ramsay CR, Campbell MK (2002) The method of minimization for allocation to clinical trials. A review. Control Clin Trials 23(6):662–674PubMedCrossRef
40.
go back to reference Hills R, Gray R, Wheatley K (2003) High probability of guessing next treatment allocation with minimisation by clinician. Control Clin Trials 24(suppl 3S):70S Hills R, Gray R, Wheatley K (2003) High probability of guessing next treatment allocation with minimisation by clinician. Control Clin Trials 24(suppl 3S):70S
41.
go back to reference McPherson G, Campbell M, Elbourne D (2003) Minimisation: predictability versus imbalance. Control Clin Trials 24:133S McPherson G, Campbell M, Elbourne D (2003) Minimisation: predictability versus imbalance. Control Clin Trials 24:133S
42.
go back to reference Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36PubMed Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36PubMed
43.
44.
go back to reference Lachin JM, Matts JP, Wei LJ (1988) Randomization in clinical trials: conclusions and recommendations. Control Clin Trials 9(4):365–374PubMedCrossRef Lachin JM, Matts JP, Wei LJ (1988) Randomization in clinical trials: conclusions and recommendations. Control Clin Trials 9(4):365–374PubMedCrossRef
45.
go back to reference Forsythe AB (1987) Validity and power of tests when groups have been balanced for prognostic factors. Computational Statistics and Data Analysis 5:193–200CrossRef Forsythe AB (1987) Validity and power of tests when groups have been balanced for prognostic factors. Computational Statistics and Data Analysis 5:193–200CrossRef
46.
go back to reference Kalish LA, Begg CB (1985) Treatment allocation methods in clinical trials: a review. Stat Med 4(2):129–144PubMedCrossRef Kalish LA, Begg CB (1985) Treatment allocation methods in clinical trials: a review. Stat Med 4(2):129–144PubMedCrossRef
47.
go back to reference Bracken MB (2001) On stratification, minimization, and protection against types 1 and 2 error. J Clin Epidemiol 54(1):104–105PubMedCrossRef Bracken MB (2001) On stratification, minimization, and protection against types 1 and 2 error. J Clin Epidemiol 54(1):104–105PubMedCrossRef
48.
go back to reference Tu D, Shalay K, Pater J (2000) Adjustment of treatment effect for covariates in clinical trials: statistical and regulatory issues. Drug Inf J 34:511–523 Tu D, Shalay K, Pater J (2000) Adjustment of treatment effect for covariates in clinical trials: statistical and regulatory issues. Drug Inf J 34:511–523
49.
go back to reference Senn S (1995) A personal view of some controversies in allocating treatment to patients in clinical trials. Stat Med 14(24):2661–2674PubMedCrossRef Senn S (1995) A personal view of some controversies in allocating treatment to patients in clinical trials. Stat Med 14(24):2661–2674PubMedCrossRef
50.
go back to reference Senn SJ (1989) Covariate imbalance and random allocation in clinical trials. Stat Med 8(4):467–475PubMedCrossRef Senn SJ (1989) Covariate imbalance and random allocation in clinical trials. Stat Med 8(4):467–475PubMedCrossRef
51.
52.
Metadata
Title
Randomization in clinical trials: stratification or minimization? The HERMES free simulation software
Authors
Hélène Fron Chabouis
Francis Chabouis
Florence Gillaizeau
Pierre Durieux
Gilles Chatellier
N. Dorin Ruse
Jean-Pierre Attal
Publication date
01-01-2014
Publisher
Springer Berlin Heidelberg
Published in
Clinical Oral Investigations / Issue 1/2014
Print ISSN: 1432-6981
Electronic ISSN: 1436-3771
DOI
https://doi.org/10.1007/s00784-013-0949-8

Other articles of this Issue 1/2014

Clinical Oral Investigations 1/2014 Go to the issue