Skip to main content
Top
Published in: Trials 1/2014

Open Access 01-12-2014 | Review

Sample size calculations in pediatric clinical trials conducted in an ICU: a systematic review

Authors: Stavros Nikolakopoulos, Kit C B Roes, Johanna H van der Lee, Ingeborg van der Tweel

Published in: Trials | Issue 1/2014

Login to get access

Abstract

At the design stage of a clinical trial, several assumptions have to be made. These usually include guesses about parameters that are not of direct interest but must be accounted for in the analysis of the treatment effect and also in the sample size calculation (nuisance parameters, e.g. the standard deviation or the control group event rate). We conducted a systematic review to investigate the impact of misspecification of nuisance parameters in pediatric randomized controlled trials conducted in intensive care units. We searched MEDLINE through PubMed. We included all publications concerning two-arm RCTs where efficacy assessment was the main objective. We included trials with pharmacological interventions. Only trials with a dichotomous or a continuous outcome were included. This led to the inclusion of 70 articles describing 71 trials. In 49 trial reports a sample size calculation was reported. Relative misspecification could be calculated for 28 trials, 22 with a dichotomous and 6 with a continuous primary outcome. The median [inter-quartile range (IQR)] overestimation was 6.9 [-12.1, 57.8]% for the control group event rate in trials with dichotomous outcomes and -1.5 [-15.3, 5.1]% for the standard deviation in trials with continuous outcomes. Our results show that there is room for improvement in the clear reporting of sample size calculations in pediatric clinical trials conducted in ICUs. Researchers should be aware of the importance of nuisance parameters in study design and in the interpretation of the results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ: Sample size calculations: basic principles and common pitfalls. Nephrol Dial Transplant. 2010, 25: 1388-1393.CrossRefPubMed Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ: Sample size calculations: basic principles and common pitfalls. Nephrol Dial Transplant. 2010, 25: 1388-1393.CrossRefPubMed
2.
go back to reference Schulz KF, Grimes DA: Sample size calculations in randomised trials: mandatory and mystical. Lancet. 2005, 365: 1348-1353.CrossRefPubMed Schulz KF, Grimes DA: Sample size calculations in randomised trials: mandatory and mystical. Lancet. 2005, 365: 1348-1353.CrossRefPubMed
3.
go back to reference Eng J: Sample size estimation: how many individuals should be studied?. Radiology. 2003, 227: 309-313.CrossRefPubMed Eng J: Sample size estimation: how many individuals should be studied?. Radiology. 2003, 227: 309-313.CrossRefPubMed
4.
go back to reference Halpern SD, Karlawish JH, Berlin JA: The continuing unethical conduct of underpowered clinical trials. JAMA. 2002, 288: 358-362.CrossRefPubMed Halpern SD, Karlawish JH, Berlin JA: The continuing unethical conduct of underpowered clinical trials. JAMA. 2002, 288: 358-362.CrossRefPubMed
5.
go back to reference Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c332-CrossRefPubMedPubMedCentral
6.
go back to reference Harmonised ICH, Tripartite Guideline: Statistical principles for clinical trials: International Conference on Harmonisation E9 expert working group. Stat Med. 1999, 18: 1905-1942. Harmonised ICH, Tripartite Guideline: Statistical principles for clinical trials: International Conference on Harmonisation E9 expert working group. Stat Med. 1999, 18: 1905-1942.
7.
go back to reference De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB: Is this clinical trial fully registered? – A statement from the International Committee of Medical Journal Editors. N Engl J Med. 2005, 352: 2436-2438.CrossRefPubMed De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB: Is this clinical trial fully registered? – A statement from the International Committee of Medical Journal Editors. N Engl J Med. 2005, 352: 2436-2438.CrossRefPubMed
8.
go back to reference Pasquali SK, Lam WK, Chiswell K, Kemper AR, Li JS: Status of the pediatric clinical trials enterprise: an analysis of the US ClinicalTrials.gov registry. Pediatrics. 2012, 130 (5): 1269-1277.CrossRef Pasquali SK, Lam WK, Chiswell K, Kemper AR, Li JS: Status of the pediatric clinical trials enterprise: an analysis of the US ClinicalTrials.gov registry. Pediatrics. 2012, 130 (5): 1269-1277.CrossRef
9.
go back to reference Hartling L, Wittmeier KD, Caldwell P, van der Lee H, Klassen TP, Craig JC, Offringa M, StaR Child Health Group: StaR child health: developing evidence-based guidance for the design, conduct, and reporting of pediatric trials. Pediatrics. 2012, 129 (Suppl 3): S112-S117.CrossRefPubMed Hartling L, Wittmeier KD, Caldwell P, van der Lee H, Klassen TP, Craig JC, Offringa M, StaR Child Health Group: StaR child health: developing evidence-based guidance for the design, conduct, and reporting of pediatric trials. Pediatrics. 2012, 129 (Suppl 3): S112-S117.CrossRefPubMed
10.
go back to reference Wittmeier KD, Craig J, Klassen TP, Offringa M: The mission of StaR Child Health is to improve the quality of the design, conduct, and reporting of pediatric clinical research by promoting the use of modern research standards. Intro Pediatr. 2012, 129 (Suppl 3): S111-CrossRef Wittmeier KD, Craig J, Klassen TP, Offringa M: The mission of StaR Child Health is to improve the quality of the design, conduct, and reporting of pediatric clinical research by promoting the use of modern research standards. Intro Pediatr. 2012, 129 (Suppl 3): S111-CrossRef
11.
go back to reference Caldwell PH, Murphy SB, Butow PN, Craig JC: Clinical trials in children. Lancet. 2004, 364: 803-811.CrossRefPubMed Caldwell PH, Murphy SB, Butow PN, Craig JC: Clinical trials in children. Lancet. 2004, 364: 803-811.CrossRefPubMed
12.
go back to reference Klassen TP, Hartling L, Craig JC, Offringa M: Children are not just small adults: the urgent need for high-quality trial evidence in children. PLoS Med. 2008, 5: e127-CrossRef Klassen TP, Hartling L, Craig JC, Offringa M: Children are not just small adults: the urgent need for high-quality trial evidence in children. PLoS Med. 2008, 5: e127-CrossRef
13.
go back to reference Food and Drug Administration: International conference on harmonisation; guidance on E11 clinical investigation of medicinal products in the pediatric population; availability: notice. Fed Regist. 2000, 65: 78493-78494. Food and Drug Administration: International conference on harmonisation; guidance on E11 clinical investigation of medicinal products in the pediatric population; availability: notice. Fed Regist. 2000, 65: 78493-78494.
14.
15.
go back to reference Bosch X: Pediatric medicine: Europe follows US in testing drugs for children. Science. 2005, 309: 1799-CrossRefPubMed Bosch X: Pediatric medicine: Europe follows US in testing drugs for children. Science. 2005, 309: 1799-CrossRefPubMed
16.
go back to reference Caldwell PH, Butow PN, Craig JC: Parents’ attitudes to children’s participation in randomized controlled trials. J Pediatr. 2003, 142: 554-559.CrossRefPubMed Caldwell PH, Butow PN, Craig JC: Parents’ attitudes to children’s participation in randomized controlled trials. J Pediatr. 2003, 142: 554-559.CrossRefPubMed
17.
go back to reference Sureshkumar P, Caldwell P, Lowe A, Simpson JM, Williams G, Craig JC: Parental consent to participation in a randomised trial in children: associated child, family, and physician factors. Clin Trials. 2012, 9: 645-651.CrossRefPubMed Sureshkumar P, Caldwell P, Lowe A, Simpson JM, Williams G, Craig JC: Parental consent to participation in a randomised trial in children: associated child, family, and physician factors. Clin Trials. 2012, 9: 645-651.CrossRefPubMed
19.
go back to reference Gill D, Ethics Working Group of the Confederation of European Specialists in Paediatrics: Ethical principles and operational guidelines for good clinical practice in paediatric research. Recommendations of the Ethics Working Group of the Confederation of European Specialists in Paediatrics (CESP). Eur J Pediatr. 2004, 163: 53-57.CrossRefPubMed Gill D, Ethics Working Group of the Confederation of European Specialists in Paediatrics: Ethical principles and operational guidelines for good clinical practice in paediatric research. Recommendations of the Ethics Working Group of the Confederation of European Specialists in Paediatrics (CESP). Eur J Pediatr. 2004, 163: 53-57.CrossRefPubMed
20.
go back to reference van der Lee JH, Tanck MW, Wesseling J, Offringa M: Pitfalls in the design and analysis of paediatric clinical trials: a case of a ‘failed’ multi-centre study, and potential solutions. Acta Paediatr. 2009, 98: 385-391.CrossRefPubMedPubMedCentral van der Lee JH, Tanck MW, Wesseling J, Offringa M: Pitfalls in the design and analysis of paediatric clinical trials: a case of a ‘failed’ multi-centre study, and potential solutions. Acta Paediatr. 2009, 98: 385-391.CrossRefPubMedPubMedCentral
21.
go back to reference Proschan MA: Two-stage sample size re-estimation based on a nuisance parameter: a review. J Biopharm Stat. 2005, 15: 559-574.CrossRefPubMed Proschan MA: Two-stage sample size re-estimation based on a nuisance parameter: a review. J Biopharm Stat. 2005, 15: 559-574.CrossRefPubMed
22.
go back to reference Vickers AJ: Underpowering in randomized trials reporting a sample size calculation. J Clin Epidemiol. 2003, 56: 717-720.CrossRefPubMed Vickers AJ: Underpowering in randomized trials reporting a sample size calculation. J Clin Epidemiol. 2003, 56: 717-720.CrossRefPubMed
23.
go back to reference Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA: Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry. 2006, 63: 484-489.CrossRefPubMed Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA: Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry. 2006, 63: 484-489.CrossRefPubMed
24.
go back to reference Sim J, Lewis M: The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency. J Clin Epidemiol. 2012, 65: 301-308.CrossRefPubMed Sim J, Lewis M: The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency. J Clin Epidemiol. 2012, 65: 301-308.CrossRefPubMed
26.
go back to reference Chan AW, Hrobjartsson A, Jorgensen KJ, Gotzsche PC, Altman DG: Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. BMJ. 2008, 337: a2299-CrossRefPubMedPubMedCentral Chan AW, Hrobjartsson A, Jorgensen KJ, Gotzsche PC, Altman DG: Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. BMJ. 2008, 337: a2299-CrossRefPubMedPubMedCentral
27.
go back to reference Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-CrossRefPubMedPubMedCentral Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P: Reporting of sample size calculation in randomised controlled trials: review. BMJ. 2009, 338: b1732-CrossRefPubMedPubMedCentral
29.
30.
go back to reference Chuang-Stein C, Kirby S, Hirsch I, Atkinson G: The role of the minimum clinically important difference and its impact on designing a trial. Pharm Stat. 2011, 10: 250-256.CrossRefPubMed Chuang-Stein C, Kirby S, Hirsch I, Atkinson G: The role of the minimum clinically important difference and its impact on designing a trial. Pharm Stat. 2011, 10: 250-256.CrossRefPubMed
31.
go back to reference Hoenig JM, Heisey DM: The abuse of power: the pervasive fallacy of power calculations for data analysis. Am Statistician. 2001, 55: 19-24.CrossRef Hoenig JM, Heisey DM: The abuse of power: the pervasive fallacy of power calculations for data analysis. Am Statistician. 2001, 55: 19-24.CrossRef
33.
go back to reference van der Tweel I, Askie L, Vandermeer B, Ellenberg S, Fernandes RM, Saloojee H, Bassler D, Altman DG, Offringa M, Van der Lee JH, for the StaR Child Health Group: Standard 4: determining adequate sample sizes. Pediatrics. 2012, 129 (Suppl 3): S138-S145.CrossRefPubMed van der Tweel I, Askie L, Vandermeer B, Ellenberg S, Fernandes RM, Saloojee H, Bassler D, Altman DG, Offringa M, Van der Lee JH, for the StaR Child Health Group: Standard 4: determining adequate sample sizes. Pediatrics. 2012, 129 (Suppl 3): S138-S145.CrossRefPubMed
Metadata
Title
Sample size calculations in pediatric clinical trials conducted in an ICU: a systematic review
Authors
Stavros Nikolakopoulos
Kit C B Roes
Johanna H van der Lee
Ingeborg van der Tweel
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Trials / Issue 1/2014
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-15-274

Other articles of this Issue 1/2014

Trials 1/2014 Go to the issue