Skip to main content
Top
Published in: Trials 1/2013

Open Access 01-12-2013 | Research

“Spin” in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes

Authors: Suzanne Lockyer, Rob Hodgson, Jo C Dumville, Nicky Cullum

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Background

Spin in the reporting of randomized controlled trials, where authors report research in a way that potentially misrepresents results and mislead readers, has been demonstrated in the broader medical literature. We investigated spin in wound care trials with (a) no statistically significant result for the primary outcome and (b) no clearly specified primary outcome.

Methods

We searched the Cochrane Wounds Group Specialised Register of Trials for randomized controlled trials (RCTs). Eligible studies were: Parallel-group RCTs of interventions for foot, leg or pressure ulcers published in 2004 to 2009 (inclusive) with either a clearly identified primary outcome for which there was a statistically non-significant result (Cohort A) or studies that had no clear primary outcome (Cohort B).
We extracted general study details. For both Cohorts A and B we then assessed for the presence of spin. For Cohort A we used a pre-defined process to assess reports for spin. For Cohort B we aimed to assess spin by recording the number of positive treatment effect claims made. We also compared the number of statistically significant and non-significant results reported in the main text and the abstract looking specifically for spin in the form of selective outcome reporting.

Results

Of the 71 eligible studies, 28 were eligible for Cohort A; of these, 71% (20/28) contained spin. Cohort B contained 43 studies; of these, 86% (37/43) had abstracts that claimed a favorable treatment claim. Whilst 74% (32/43) of main text results in Cohort B included at least one statistically non-significant result, this was not reflected in the abstract where only 28% contained (12/43) at least one statistically non-significant result.

Conclusions

Spin is a frequent phenomenon in reports of RCTs of wound treatments. Studies without statistically significant results for the primary outcome used spin in 71% of cases. Furthermore, 33% (43/132) of reports of wound RCTs did not specify a primary outcome and there was evidence of spin and selective outcome reporting in the abstracts of these. Readers should be wary of only reading the abstracts of reports of RCTs of wound treatments since they are frequently misleading regarding treatment effects.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moher D, Jones A, Lepage L, CONSORT Group: Use of the CONSORT statement and quality of reports of randomised trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, Lepage L, CONSORT Group: Use of the CONSORT statement and quality of reports of randomised trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed
2.
go back to reference Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral
3.
go back to reference Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2005, 291: 2457-2465.CrossRef Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2005, 291: 2457-2465.CrossRef
4.
go back to reference Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS ONE. 2008, 3: e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS ONE. 2008, 3: e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral
5.
go back to reference Boutron I, Dutton S, Ravaud P, Altman D: Reporting and interpretation of Randomized Controlled Trials with statistically non-significant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed Boutron I, Dutton S, Ravaud P, Altman D: Reporting and interpretation of Randomized Controlled Trials with statistically non-significant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed
6.
go back to reference Vera-Badillo R, Shapiro R, Ocana A, Amir E, Tannock I: Reporting of end points of efficacy and toxicity in randomized contro, linical trials for women with breast cancer. Ann Oncol. 2013, 24: 1238-1244. 10.1093/annonc/mds636.CrossRefPubMed Vera-Badillo R, Shapiro R, Ocana A, Amir E, Tannock I: Reporting of end points of efficacy and toxicity in randomized contro, linical trials for women with breast cancer. Ann Oncol. 2013, 24: 1238-1244. 10.1093/annonc/mds636.CrossRefPubMed
7.
go back to reference Vedula S, Goldman S, Rona I, Greene T, Dickersin K: Implementation of a publication strategy in the context of reporting biases. A case study based on new documents of Neurontin litigation. Trials. 2012, 13: 136-10.1186/1745-6215-13-136.CrossRefPubMedPubMedCentral Vedula S, Goldman S, Rona I, Greene T, Dickersin K: Implementation of a publication strategy in the context of reporting biases. A case study based on new documents of Neurontin litigation. Trials. 2012, 13: 136-10.1186/1745-6215-13-136.CrossRefPubMedPubMedCentral
12.
go back to reference Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral
13.
go back to reference Rattinger G, Bero L: Factors Associated with Results and Conclusions of Trials of Thiazolidinediones. PLoS ONE. 2009, 4: e5826-10.1371/journal.pone.0005826.CrossRefPubMedPubMedCentral Rattinger G, Bero L: Factors Associated with Results and Conclusions of Trials of Thiazolidinediones. PLoS ONE. 2009, 4: e5826-10.1371/journal.pone.0005826.CrossRefPubMedPubMedCentral
14.
15.
go back to reference Yank V, Rennie D, Bero LA: Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ. 2007, 335: 1202-1205. 10.1136/bmj.39376.447211.BE.CrossRefPubMedPubMedCentral Yank V, Rennie D, Bero LA: Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ. 2007, 335: 1202-1205. 10.1136/bmj.39376.447211.BE.CrossRefPubMedPubMedCentral
16.
go back to reference McCulloch P: The EU’s system for regulating medical devices. BMJ. 2012, 345: e7126-10.1136/bmj.e7126.CrossRefPubMed McCulloch P: The EU’s system for regulating medical devices. BMJ. 2012, 345: e7126-10.1136/bmj.e7126.CrossRefPubMed
17.
go back to reference Dumville JC, Petherick ES, O’Meara S, Raynor P, Cullum N: How is research evidence used to support claims made in advertisements for wound care products?. J Clin Nurs. 2009, 18: 1422-1429. 10.1111/j.1365-2702.2008.02293.x.CrossRefPubMed Dumville JC, Petherick ES, O’Meara S, Raynor P, Cullum N: How is research evidence used to support claims made in advertisements for wound care products?. J Clin Nurs. 2009, 18: 1422-1429. 10.1111/j.1365-2702.2008.02293.x.CrossRefPubMed
18.
go back to reference Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D: Systematic reviews of wound care management: (2) dressings and topical agents used in the healing of chronic wounds. Health Technol Assess. 1999, 3: 1-35.PubMed Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D: Systematic reviews of wound care management: (2) dressings and topical agents used in the healing of chronic wounds. Health Technol Assess. 1999, 3: 1-35.PubMed
19.
go back to reference Gottrup F, Apelqvist J, Price P, European Wound Management Association Patient Outcome Group: Outcomes in controlled and comparative studies on non-healing wounds: recommendations to improve the quality of evidence in wound management. J Wound Care. 2010, 19: 237-268.CrossRefPubMed Gottrup F, Apelqvist J, Price P, European Wound Management Association Patient Outcome Group: Outcomes in controlled and comparative studies on non-healing wounds: recommendations to improve the quality of evidence in wound management. J Wound Care. 2010, 19: 237-268.CrossRefPubMed
20.
go back to reference The Standards of Reporting Trials Group: A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994, 272: 1926-1931. 10.1001/jama.1994.03520240054041.CrossRef The Standards of Reporting Trials Group: A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994, 272: 1926-1931. 10.1001/jama.1994.03520240054041.CrossRef
21.
go back to reference PASW Statistics 18: Release Version 18.0.0. 2009, Chicago, IL, USA: SPSS, Inc PASW Statistics 18: Release Version 18.0.0. 2009, Chicago, IL, USA: SPSS, Inc
22.
go back to reference Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed
23.
go back to reference Altwairgi AK, Booth CM, Hopman WM, Baetz TD: Discordance between conclusions stated in the abstract and conclusions in the article: analysis of published randomized controlled trials of systemic therapy in lung cancer. J Clin Oncol. 2012, 30: 3552-3557. 10.1200/JCO.2012.41.8319.CrossRefPubMed Altwairgi AK, Booth CM, Hopman WM, Baetz TD: Discordance between conclusions stated in the abstract and conclusions in the article: analysis of published randomized controlled trials of systemic therapy in lung cancer. J Clin Oncol. 2012, 30: 3552-3557. 10.1200/JCO.2012.41.8319.CrossRefPubMed
24.
go back to reference Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomised controlled trials in journals and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomised controlled trials in journals and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral
25.
go back to reference Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2000, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRefPubMedPubMedCentral Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2000, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRefPubMedPubMedCentral
Metadata
Title
“Spin” in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes
Authors
Suzanne Lockyer
Rob Hodgson
Jo C Dumville
Nicky Cullum
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-371

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue