Skip to main content
Top
Published in: Trials 1/2015

Open Access 01-12-2015 | Research

Is the relationship among outcome variables shown in randomized trials?

Authors: David L Schriger, Richelle J Cooper, Ana Lopez-O’Sullivan, Carter Wystrach, Douglas G Altman

Published in: Trials | Issue 1/2015

Login to get access

Abstract

Background

Randomized controlled trials (RCTs) often have more than one primary outcome and frequently have secondary and harm outcomes. Comparison of outcomes between study arms is the primary focus of RCTs, but there are times when the relation between outcomes is important, such as determining whether an intermediate outcome and a clinical outcome have a strong association. We sought to determine how often reports of RCTs depict the relations among outcomes at the individual patient level and, for those studies that use composite outcomes, how often the relations between component elements are depicted.

Methods

We selected 20 general, specialty and subspecialty medical journals with high impact factors that publish original clinical research. We identified every RCT in the 2011 and 2012 issues and randomly selected 10 articles per journal. For each article we recorded the number of outcomes, the number of composite outcomes and how often the relations between outcomes or elements of composite outcomes were portrayed.

Results

All but 16 of the 200 RCTs had more than one outcome. Thus, outcomes could have been related in 92% of studies, but such relations were only reported in 2 (1%). A total of 33 (17%) investigations measured a composite outcome, 32 of which showed data for each component. None, however, showed cross-tabulation of the components.

Conclusions

Readers are rarely shown the relation between outcomes. Mandatory posting of datasets or requirements for detailed appendices would allow readers to see these cross-tabulations, helping future investigators know which outcomes are redundant, which provide unique information and which are most responsive to changes in the independent variables. While not every relationship between outcomes requires depiction, at present such information is seldom portrayed.
Appendix
Available only for authorised users
Literature
5.
go back to reference Gelman A, Pasarica C, Dodhia R. Let’s practice what we preach: turning tables into graphs. Am Stat. 2002;56:121–30.CrossRef Gelman A, Pasarica C, Dodhia R. Let’s practice what we preach: turning tables into graphs. Am Stat. 2002;56:121–30.CrossRef
6.
go back to reference Schriger DL, Cooper RJ. Achieving graphical excellence: suggestions and methods for creating high-quality visual displays of experimental data. Ann Emerg Med. 2001;37:75–87.CrossRefPubMed Schriger DL, Cooper RJ. Achieving graphical excellence: suggestions and methods for creating high-quality visual displays of experimental data. Ann Emerg Med. 2001;37:75–87.CrossRefPubMed
8.
go back to reference Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;11:32.CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;11:32.CrossRefPubMedPubMedCentral
9.
go back to reference Mori E, Ikeda M, Kosaka K. Donepezil-DLB study investigators. Donepezil for dementia with Lewy bodies: a randomized, placebo-controlled trial. Ann Neurol. 2012;72:41–52.CrossRefPubMed Mori E, Ikeda M, Kosaka K. Donepezil-DLB study investigators. Donepezil for dementia with Lewy bodies: a randomized, placebo-controlled trial. Ann Neurol. 2012;72:41–52.CrossRefPubMed
10.
go back to reference Iezzi R, Santoro M, Marano R, Di Stasi C, Dattesi R, Kirchin M, et al. Low-dose multidetector CT angiography in the evaluation of infrarenal aorta and peripheral arterial occlusive disease. Radiology. 2012;263:287–98.CrossRefPubMed Iezzi R, Santoro M, Marano R, Di Stasi C, Dattesi R, Kirchin M, et al. Low-dose multidetector CT angiography in the evaluation of infrarenal aorta and peripheral arterial occlusive disease. Radiology. 2012;263:287–98.CrossRefPubMed
11.
go back to reference Moher D, Hopewell S, Schulz KF, CONSORT Group. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, CONSORT Group. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral
12.
go back to reference Wu RR, Jin H, Gao K, Twamley EW, Ou JJ, Shao P, et al. Metformin for treatment of antipsychotic-induced amenorrhea and weight gain in women with first-episode schizophrenia: a double-blind, randomized, placebo-controlled study. Am J Psychiatry. 2012;169:813–21.CrossRefPubMed Wu RR, Jin H, Gao K, Twamley EW, Ou JJ, Shao P, et al. Metformin for treatment of antipsychotic-induced amenorrhea and weight gain in women with first-episode schizophrenia: a double-blind, randomized, placebo-controlled study. Am J Psychiatry. 2012;169:813–21.CrossRefPubMed
13.
go back to reference Corbacioglu S, Cesaro S, Faraci M, Valteau-Couanet D, Gruhn B, Rovelli A, et al. Defibrotide for prophylaxis of hepatic veno-occlusive disease in paediatric haemopoietic stem-cell transplantation: an open-label, phase 3, randomised controlled trial. Lancet. 2012;379:1301–9.CrossRefPubMed Corbacioglu S, Cesaro S, Faraci M, Valteau-Couanet D, Gruhn B, Rovelli A, et al. Defibrotide for prophylaxis of hepatic veno-occlusive disease in paediatric haemopoietic stem-cell transplantation: an open-label, phase 3, randomised controlled trial. Lancet. 2012;379:1301–9.CrossRefPubMed
14.
15.
go back to reference May GS, DeMets DL, Friedman LM, Furberg C, Passamani E. The randomized clinical trial: bias in analysis. Circulation. 1981;64:669–73.CrossRefPubMed May GS, DeMets DL, Friedman LM, Furberg C, Passamani E. The randomized clinical trial: bias in analysis. Circulation. 1981;64:669–73.CrossRefPubMed
16.
go back to reference Anderson JR, Cain KC, Gelber RD. Analysis of survival by tumor response and other comparisons of time-to-event by outcome variables. J Clin Oncol. 2008;26:3913–5.CrossRefPubMed Anderson JR, Cain KC, Gelber RD. Analysis of survival by tumor response and other comparisons of time-to-event by outcome variables. J Clin Oncol. 2008;26:3913–5.CrossRefPubMed
17.
go back to reference Murphy TP, Reynolds MR, Cohen DJ, Regensteiner JG, Massaro JM, Cutlip DE, et al. Correlation of patient-reported symptom outcomes and treadmill test outcomes after treatment for aortoiliac claudication. J Vasc Interv Radiol. 2013;24:1427–35.CrossRefPubMedPubMedCentral Murphy TP, Reynolds MR, Cohen DJ, Regensteiner JG, Massaro JM, Cutlip DE, et al. Correlation of patient-reported symptom outcomes and treadmill test outcomes after treatment for aortoiliac claudication. J Vasc Interv Radiol. 2013;24:1427–35.CrossRefPubMedPubMedCentral
18.
go back to reference Henricson E, Abresch R, Han JJ, Nicorici A, Goude Keller E, de Bie E, et al. The 6-minute walk test and person-reported outcomes in boys with Duchenne muscular dystrophy and typically developing controls: longitudinal comparisons and clinically-meaningful changes over one year. PLoS Curr. 2013;5. doi:10.1371/currents.md.9e17658b007eb79fcd6f723089f79e06. Henricson E, Abresch R, Han JJ, Nicorici A, Goude Keller E, de Bie E, et al. The 6-minute walk test and person-reported outcomes in boys with Duchenne muscular dystrophy and typically developing controls: longitudinal comparisons and clinically-meaningful changes over one year. PLoS Curr. 2013;5. doi:10.1371/currents.md.9e17658b007eb79fcd6f723089f79e06.
19.
go back to reference Ditunno Jr JF, Barbeau H, Dobkin BH, Ditunno Jr JF, Barbeau H, Dobkin BH, et al. Validity of the walking scale for spinal cord injury and other domains of function in a multicenter clinical trial. Neurorehabil Neural Repair. 2007;21:539–50.CrossRefPubMedPubMedCentral Ditunno Jr JF, Barbeau H, Dobkin BH, Ditunno Jr JF, Barbeau H, Dobkin BH, et al. Validity of the walking scale for spinal cord injury and other domains of function in a multicenter clinical trial. Neurorehabil Neural Repair. 2007;21:539–50.CrossRefPubMedPubMedCentral
20.
go back to reference Lapperre TS, Snoeck-Stroband JB, Gosman MM, Jansen DF, van Schadewijk A, Thiadens HA, et al. Effect of fluticasone with and without salmeterol on pulmonary outcomes in chronic obstructive pulmonary disease: a randomized trial. Ann Intern Med. 2009;151:517–27.CrossRefPubMed Lapperre TS, Snoeck-Stroband JB, Gosman MM, Jansen DF, van Schadewijk A, Thiadens HA, et al. Effect of fluticasone with and without salmeterol on pulmonary outcomes in chronic obstructive pulmonary disease: a randomized trial. Ann Intern Med. 2009;151:517–27.CrossRefPubMed
21.
go back to reference Krasner MS, Epstein RM, Beckman H, Suchman AL, Chapman B, Mooney CJ, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA. 2009;302:1284–93.CrossRefPubMed Krasner MS, Epstein RM, Beckman H, Suchman AL, Chapman B, Mooney CJ, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA. 2009;302:1284–93.CrossRefPubMed
Metadata
Title
Is the relationship among outcome variables shown in randomized trials?
Authors
David L Schriger
Richelle J Cooper
Ana Lopez-O’Sullivan
Carter Wystrach
Douglas G Altman
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Trials / Issue 1/2015
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-015-0584-6

Other articles of this Issue 1/2015

Trials 1/2015 Go to the issue