Skip to main content
Top
Published in: Intensive Care Medicine 5/2014

01-05-2014 | Original

Registration and design alterations of clinical trials in critical care: a cross-sectional observational study

Authors: Vijay Anand, Damon C. Scales, Christopher S. Parshuram, Brian P. Kavanagh

Published in: Intensive Care Medicine | Issue 5/2014

Login to get access

Abstract

Purpose

In 2005 the International Committee of Medical Journal Editors issued a requirement that all randomized controlled trials (RCTs) be registered primarily to prevent selective reporting (publication bias). However, registries allow for alterations in study protocol. Changes occurring before (or after) study completion could invalidate the original study intent, leading to publication of misleading conclusions. In RCTs involving critically ill patients, these concerns may be particularly acute because mortality is high and conditions investigated are usually syndromes rather than specific diseases. This study was conducted to estimate the registration rate of RCTs in critical care; and, among registered RCTs, to determine timing of registration and whether sample size or primary outcome were altered.

Methods

We searched the MEDLINE database for RCTs that began after or continued through July 2005. We determined whether each trial had been registered and, for registered trials, compared registry data to data in the published manuscript.

Results

Approximately two-thirds (66 %) of trials were registered. Of these, 66 % of registrations occurred after enrolment had commenced. Overall, 6 % (5/90) of trials appropriately registered a sample size which was unchanged from the interval between registration and publication, and only 12 % (11/90) reported primary outcomes that were both appropriately registered and unchanged.

Conclusions

Non-registration, or registration after trial initiation, are common in RCTs of critically ill patients. Among registered trials important protocol changes are often made between trial commencement and publication. This study identifies and quantifies the extent of this serious—but correctable—problem for RCTs in critically ill patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sacks H, Chalmers T, Smith H Jr (1982) Randomized versus historical controls for clinical trials. Am J Med 72:233–240PubMedCrossRef Sacks H, Chalmers T, Smith H Jr (1982) Randomized versus historical controls for clinical trials. Am J Med 72:233–240PubMedCrossRef
2.
go back to reference Sozu T, Sugimoto T, Hamasaki T (2010) Sample size determination in clinical trials with multiple co-primary binary endpoints. Stat Med 29(21):2169–2179PubMedCrossRef Sozu T, Sugimoto T, Hamasaki T (2010) Sample size determination in clinical trials with multiple co-primary binary endpoints. Stat Med 29(21):2169–2179PubMedCrossRef
3.
go back to reference De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R et al (2004) Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med 351(12):1250–1251PubMedCrossRef De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R et al (2004) Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med 351(12):1250–1251PubMedCrossRef
4.
go back to reference Abraham E (2005) The AJRCCM in 2005. Am J Respir Crit Care Med 171(1):1–2CrossRef Abraham E (2005) The AJRCCM in 2005. Am J Respir Crit Care Med 171(1):1–2CrossRef
6.
go back to reference Mathieu S, Moher D, Altman DG (2009) Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 302(9):977–984PubMedCrossRef Mathieu S, Moher D, Altman DG (2009) Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 302(9):977–984PubMedCrossRef
7.
go back to reference Silverman HJ (2004) The acute respiratory distress syndrome network controversy: lessons and legacy. Curr Opin Crit Care 10:560–564PubMedCrossRef Silverman HJ (2004) The acute respiratory distress syndrome network controversy: lessons and legacy. Curr Opin Crit Care 10:560–564PubMedCrossRef
8.
go back to reference Silverman WA (2004) Personal reflections on lessons learned from randomized trials involving newborn infants from 1951 to 1967. Clin Trials 1:179–184PubMedCrossRef Silverman WA (2004) Personal reflections on lessons learned from randomized trials involving newborn infants from 1951 to 1967. Clin Trials 1:179–184PubMedCrossRef
9.
go back to reference Flanagan BM, Philpott S, Strosberg MA (2011) Protecting participants of clinical trials conducted in the intensive care unit. J Intensive Care Med 26(4):237–249PubMedCrossRef Flanagan BM, Philpott S, Strosberg MA (2011) Protecting participants of clinical trials conducted in the intensive care unit. J Intensive Care Med 26(4):237–249PubMedCrossRef
10.
go back to reference Halpern SD (2002) Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. Control Clin Trials 23(3):274–288PubMedCrossRef Halpern SD (2002) Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. Control Clin Trials 23(3):274–288PubMedCrossRef
11.
go back to reference Ospina-Tascón GA, Büchele GL, Vincent J-L (2008) Multicenter, randomized, controlled trials evaluating mortality in intensive care: doomed to fail? Crit Care Med 36(4):1311–1322PubMedCrossRef Ospina-Tascón GA, Büchele GL, Vincent J-L (2008) Multicenter, randomized, controlled trials evaluating mortality in intensive care: doomed to fail? Crit Care Med 36(4):1311–1322PubMedCrossRef
12.
go back to reference Hannink G, Gooszen HG, Rovers MM (2013) Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions. Ann Surg 257(5):818–823PubMedCrossRef Hannink G, Gooszen HG, Rovers MM (2013) Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions. Ann Surg 257(5):818–823PubMedCrossRef
13.
go back to reference Milette K, Roseman M, Thombs BD (2011) Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosom Res 70(3):205–217PubMedCrossRef Milette K, Roseman M, Thombs BD (2011) Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosom Res 70(3):205–217PubMedCrossRef
15.
go back to reference Aberegg SK, Richards DR, O’Brien JM (2010) Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 14(2):R77PubMedCentralPubMedCrossRef Aberegg SK, Richards DR, O’Brien JM (2010) Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 14(2):R77PubMedCentralPubMedCrossRef
16.
go back to reference Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q et al (2010) Stopping randomized trials early for benefit and estimation of treatment effects. JAMA 303(12):1180–1187PubMedCrossRef Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q et al (2010) Stopping randomized trials early for benefit and estimation of treatment effects. JAMA 303(12):1180–1187PubMedCrossRef
17.
go back to reference Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G (2008) Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol 61(3):241–246PubMedCrossRef Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G (2008) Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol 61(3):241–246PubMedCrossRef
18.
go back to reference Phua J, Badia JR, Adhikari NK, Friedrich JO, Fowler RA, Singh JM et al (2009) Has mortality from acute respiratory distress syndrome decreased over time? A systematic review. Am J Respir Crit Care Med 179(3):220–227PubMedCrossRef Phua J, Badia JR, Adhikari NK, Friedrich JO, Fowler RA, Singh JM et al (2009) Has mortality from acute respiratory distress syndrome decreased over time? A systematic review. Am J Respir Crit Care Med 179(3):220–227PubMedCrossRef
19.
go back to reference Iwashyna TJ (2010) Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med 153:204–205PubMedCrossRef Iwashyna TJ (2010) Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med 153:204–205PubMedCrossRef
20.
go back to reference Kahn JM, Benson NM, Appleby D, Carson SS, Iwashyna TJ (2010) Long-term acute care hospital utilization after critical illness. JAMA 303(22):2253–2259PubMedCentralPubMedCrossRef Kahn JM, Benson NM, Appleby D, Carson SS, Iwashyna TJ (2010) Long-term acute care hospital utilization after critical illness. JAMA 303(22):2253–2259PubMedCentralPubMedCrossRef
21.
go back to reference Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794PubMedCentralPubMedCrossRef Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794PubMedCentralPubMedCrossRef
22.
go back to reference Herridge MS, Tansey CM, Matte A, Tomlinson G, Diaz-granados N, Cooper A et al (2011) Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med 364(14):1293–1304 Herridge MS, Tansey CM, Matte A, Tomlinson G, Diaz-granados N, Cooper A et al (2011) Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med 364(14):1293–1304
23.
go back to reference Bienvenu OJ, Colantuoni E, Mendez-Tellez PA, Dinglas VD, Shanholtz C, Husain N et al (2012) Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. Am J Respir Crit Care Med 185(5):517–524PubMedCentralPubMedCrossRef Bienvenu OJ, Colantuoni E, Mendez-Tellez PA, Dinglas VD, Shanholtz C, Husain N et al (2012) Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. Am J Respir Crit Care Med 185(5):517–524PubMedCentralPubMedCrossRef
24.
go back to reference Unroe M, Kahn JM, Carson SS, Govert JA, Martinu T, Sathy SJ et al (2013) One-year trajectories of care and resource utilization for recipients of prolonged mechanical ventilation. Ann Intern Med 153(3):167–175CrossRef Unroe M, Kahn JM, Carson SS, Govert JA, Martinu T, Sathy SJ et al (2013) One-year trajectories of care and resource utilization for recipients of prolonged mechanical ventilation. Ann Intern Med 153(3):167–175CrossRef
25.
go back to reference Silverman H (2011) Protecting vulnerable research subjects in critical care trials: enhancing the informed consent process and recommendations for safeguards. Ann Intensive Care 1(1):8PubMedCentralPubMedCrossRef Silverman H (2011) Protecting vulnerable research subjects in critical care trials: enhancing the informed consent process and recommendations for safeguards. Ann Intensive Care 1(1):8PubMedCentralPubMedCrossRef
26.
go back to reference Sekeres M, Gold JL, Chan A-W, Lexchin J, Moher D, Van Laethem MLP et al (2008) Poor reporting of scientific leadership information in clinical trial registers. PLoS One 3(2):e1610PubMedCentralPubMedCrossRef Sekeres M, Gold JL, Chan A-W, Lexchin J, Moher D, Van Laethem MLP et al (2008) Poor reporting of scientific leadership information in clinical trial registers. PLoS One 3(2):e1610PubMedCentralPubMedCrossRef
Metadata
Title
Registration and design alterations of clinical trials in critical care: a cross-sectional observational study
Authors
Vijay Anand
Damon C. Scales
Christopher S. Parshuram
Brian P. Kavanagh
Publication date
01-05-2014
Publisher
Springer Berlin Heidelberg
Published in
Intensive Care Medicine / Issue 5/2014
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-014-3250-7

Other articles of this Issue 5/2014

Intensive Care Medicine 5/2014 Go to the issue