Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Research

Reporting of critical care trial abstracts: a comparison before and after the announcement of CONSORT guideline for abstracts

Authors: Akira Kuriyama, Naomi Takahashi, Takeo Nakayama

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

An extension of the Consolidated Standards of Reporting Trials (CONSORT) statement provides a checklist of items to improve the reporting quality of abstracts of randomized controlled trials (RCTs). However, authors of abstracts in some fields have poorly adhered to this guideline. We did an extensive literature survey to examine the quality of reporting trial abstracts in major critical care journals before and after announcement of the CONSORT guideline for abstracts.

Methods

We reviewed abstracts of RCTs published in four major critical care journals with publication dates ranging from 2006 to 2007 (pre-CONSORT) and from 2011 to 2012 (post-CONSORT): Intensive Care Medicine (ICM), Critical Care (CC), American Journal of Respiratory and Critical Care Medicine (AJRCCM), and Critical Care Medicine (CCM). For each item in the CONSORT guideline for abstracts, we considered that an abstract was well-reported when it reported a relevant item and adhered to the guideline. Our primary outcomes were to describe the proportion of abstracts that adhered to the guideline for each item in each period and the changes between the two periods. Pearson’s chi-square analysis was performed to compare adherence to the guideline between the two periods.

Results

Our inclusion criteria yielded 185 and 166 abstracts from pre- and post-CONSORT periods, respectively. Less than 50% of abstracts adequately reported trial design (16.3%), participants (44.0%), outcomes in methods (49.4%), randomization (1.8%), blinding (4.2%), numbers randomized (37.4%) and analyzed (8.4%), recruitment (4.2%), outcomes in results (16.9%), harms (27.7%), trial registration (42.2%), and funding (13.9%) in the recent period. There was significant improvement in reporting title, primary outcomes in both methods and results, interventions, harms, trial registration, and funding between the two periods (p < 0.05). Improvements were seen in reporting of participants in the Methods sections in CCM, as well as in outcomes in results and trial registration in AJRCCM and CCM, between the two periods. A significant decline was noted in reporting of interventions in Methods sections in AJRCCM and ICM, as well as the numbers randomized in Results sections in CC, over time.

Conclusions

Reporting of some items in abstracts for critical care trials improved over time, but the adherence to the CONSORT guideline for abstracts was still suboptimal.
Literature
1.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008;371:281–3.CrossRefPubMed Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008;371:281–3.CrossRefPubMed
2.
go back to reference PLoS Medicine E. The impact of open access upon public health. PLoS Med. 2006;3:e252.CrossRef PLoS Medicine E. The impact of open access upon public health. PLoS Med. 2006;3:e252.CrossRef
3.
go back to reference Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007;2, MR000010. Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007;2, MR000010.
4.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008;5:e20.CrossRefPubMedPubMedCentral Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008;5:e20.CrossRefPubMedPubMedCentral
5.
go back to reference Chen Y, Li J, Ai C, Duan Y, Wang L, Zhang M, Hopewell S. Assessment of the quality of reporting in abstracts of randomized controlled trials published in five leading Chinese medical journals. PLoS One. 2010;5:e11926.CrossRefPubMedPubMedCentral Chen Y, Li J, Ai C, Duan Y, Wang L, Zhang M, Hopewell S. Assessment of the quality of reporting in abstracts of randomized controlled trials published in five leading Chinese medical journals. PLoS One. 2010;5:e11926.CrossRefPubMedPubMedCentral
6.
go back to reference Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D. The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009;62:387–92.CrossRefPubMed Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D. The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009;62:387–92.CrossRefPubMed
7.
go back to reference Sivendran S, Newport K, Horst M, Albert A, Galsky MD. Reporting quality of abstracts in phase III clinical trials of systemic therapy in metastatic solid malignancies. Trials. 2015;16:341.CrossRefPubMedPubMedCentral Sivendran S, Newport K, Horst M, Albert A, Galsky MD. Reporting quality of abstracts in phase III clinical trials of systemic therapy in metastatic solid malignancies. Trials. 2015;16:341.CrossRefPubMedPubMedCentral
8.
go back to reference Knobloch K, Vogt PM. Adherence to CONSORT abstract reporting suggestions in surgical randomized-controlled trials published in Annals of Surgery. Ann Surg. 2011;254:546–7.CrossRefPubMed Knobloch K, Vogt PM. Adherence to CONSORT abstract reporting suggestions in surgical randomized-controlled trials published in Annals of Surgery. Ann Surg. 2011;254:546–7.CrossRefPubMed
9.
go back to reference Seehra J, Wright NS, Polychronopoulou A, Cobourne MT, Pandis N. Reporting quality of abstracts of randomized controlled trials published in dental specialty journals. J Evid Based Dent Pract. 2013;13:1–8.CrossRefPubMed Seehra J, Wright NS, Polychronopoulou A, Cobourne MT, Pandis N. Reporting quality of abstracts of randomized controlled trials published in dental specialty journals. J Evid Based Dent Pract. 2013;13:1–8.CrossRefPubMed
10.
go back to reference Kiriakou J, Pandis N, Madianos P, Polychronopoulou A. Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology. J Evid Based Dent Pract. 2014;14:9–15.CrossRefPubMed Kiriakou J, Pandis N, Madianos P, Polychronopoulou A. Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology. J Evid Based Dent Pract. 2014;14:9–15.CrossRefPubMed
11.
go back to reference Peters JP, Hooft L, Grolman W, Stegeman I. Assessment of the quality of reporting of randomised controlled trials in otorhinolaryngologic literature - adherence to the CONSORT statement. PLoS One. 2015;10, e0122328.CrossRefPubMedPubMedCentral Peters JP, Hooft L, Grolman W, Stegeman I. Assessment of the quality of reporting of randomised controlled trials in otorhinolaryngologic literature - adherence to the CONSORT statement. PLoS One. 2015;10, e0122328.CrossRefPubMedPubMedCentral
12.
go back to reference Wang L, Li Y, Li J, Zhang M, Xu L, Yuan W, Wang G, Hopewell S. Quality of reporting of trial abstracts needs to be improved: using the CONSORT for abstracts to assess the four leading Chinese medical journals of traditional Chinese medicine. Trials. 2010;11:75.CrossRefPubMedPubMedCentral Wang L, Li Y, Li J, Zhang M, Xu L, Yuan W, Wang G, Hopewell S. Quality of reporting of trial abstracts needs to be improved: using the CONSORT for abstracts to assess the four leading Chinese medical journals of traditional Chinese medicine. Trials. 2010;11:75.CrossRefPubMedPubMedCentral
13.
go back to reference Blair DA, Hughes PJ, Woolley Jr TW. Pharmacy journal abstracts published in PubMed that abide by the CONsolidated Standards Of Reporting Trials (CONSORT) guidelines. J Med Libr Assoc. 2014;102:110–4.CrossRefPubMedPubMedCentral Blair DA, Hughes PJ, Woolley Jr TW. Pharmacy journal abstracts published in PubMed that abide by the CONsolidated Standards Of Reporting Trials (CONSORT) guidelines. J Med Libr Assoc. 2014;102:110–4.CrossRefPubMedPubMedCentral
14.
go back to reference Ghimire S, Kyung E, Kang W, Kim E. Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals. Trials. 2012;13:77.CrossRefPubMedPubMedCentral Ghimire S, Kyung E, Kang W, Kim E. Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals. Trials. 2012;13:77.CrossRefPubMedPubMedCentral
15.
go back to reference Can OS, Yilmaz AA, Hasdogan M, Alkaya F, Turhan SC, Can MF, Alanoglu Z. Has the quality of abstracts for randomised controlled trials improved since the release of Consolidated Standards of Reporting Trial guideline for abstract reporting? A survey of four high-profile anaesthesia journals. Eur J Anaesthesiol. 2011;28:485–92.CrossRefPubMed Can OS, Yilmaz AA, Hasdogan M, Alkaya F, Turhan SC, Can MF, Alanoglu Z. Has the quality of abstracts for randomised controlled trials improved since the release of Consolidated Standards of Reporting Trial guideline for abstract reporting? A survey of four high-profile anaesthesia journals. Eur J Anaesthesiol. 2011;28:485–92.CrossRefPubMed
16.
go back to reference Ghimire S, Kyung E, Lee H, Kim E. Oncology trial abstracts showed suboptimal improvement in reporting: a comparative before-and-after evaluation using CONSORT for Abstract guidelines. J Clin Epidemiol. 2014;67:658–66.CrossRefPubMed Ghimire S, Kyung E, Lee H, Kim E. Oncology trial abstracts showed suboptimal improvement in reporting: a comparative before-and-after evaluation using CONSORT for Abstract guidelines. J Clin Epidemiol. 2014;67:658–66.CrossRefPubMed
17.
go back to reference Mbuagbaw L, Thabane M, Vanniyasingam T, Borg Debono V, Kosa S, Zhang S, Ye C, Parpia S, Dennis BB, Thabane L. Improvement in the quality of abstracts in major clinical journals since CONSORT extension for abstracts: a systematic review. Contemp Clin Trials. 2014;38:245–50.CrossRefPubMed Mbuagbaw L, Thabane M, Vanniyasingam T, Borg Debono V, Kosa S, Zhang S, Ye C, Parpia S, Dennis BB, Thabane L. Improvement in the quality of abstracts in major clinical journals since CONSORT extension for abstracts: a systematic review. Contemp Clin Trials. 2014;38:245–50.CrossRefPubMed
18.
go back to reference Prady SL, Richmond SJ, Morton VM, Macpherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008;3, e1577.CrossRefPubMedPubMedCentral Prady SL, Richmond SJ, Morton VM, Macpherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008;3, e1577.CrossRefPubMedPubMedCentral
19.
go back to reference Fleming PS, Buckley N, Seehra J, Polychronopoulou A, Pandis N. Reporting quality of abstracts of randomized controlled trials published in leading orthodontic journals from 2006 to 2011. Am J Orthod Dentofacial Orthop. 2012;142:451–8.CrossRefPubMed Fleming PS, Buckley N, Seehra J, Polychronopoulou A, Pandis N. Reporting quality of abstracts of randomized controlled trials published in leading orthodontic journals from 2006 to 2011. Am J Orthod Dentofacial Orthop. 2012;142:451–8.CrossRefPubMed
20.
go back to reference Hays M, Andrews M, Wilson R, Callender D, O’Malley PG, Douglas K. Reporting quality of randomised controlled trial abstracts among high-impact general medical journals: a review and analysis. BMJ Open. 2016;6:e011082.CrossRefPubMedPubMedCentral Hays M, Andrews M, Wilson R, Callender D, O’Malley PG, Douglas K. Reporting quality of randomised controlled trial abstracts among high-impact general medical journals: a review and analysis. BMJ Open. 2016;6:e011082.CrossRefPubMedPubMedCentral
21.
go back to reference Cobo E, Cortes J, Ribera JM, Cardellach F, Selva-O’Callaghan A, Kostov B, Garcia L, Cirugeda L, Altman DG, Gonzalez JA, et al. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ. 2011;343:d6783.CrossRefPubMedPubMedCentral Cobo E, Cortes J, Ribera JM, Cardellach F, Selva-O’Callaghan A, Kostov B, Garcia L, Cirugeda L, Altman DG, Gonzalez JA, et al. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ. 2011;343:d6783.CrossRefPubMedPubMedCentral
22.
go back to reference Hopewell S, Ravaud P, Baron G, Boutron I. Effect of editors’ implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. BMJ. 2012;344:e4178.CrossRefPubMedPubMedCentral Hopewell S, Ravaud P, Baron G, Boutron I. Effect of editors’ implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. BMJ. 2012;344:e4178.CrossRefPubMedPubMedCentral
23.
go back to reference Moher D, Jones A, Lepage L, CONSORT Group. Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285:1992–5.CrossRefPubMed Moher D, Jones A, Lepage L, CONSORT Group. Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285:1992–5.CrossRefPubMed
Metadata
Title
Reporting of critical care trial abstracts: a comparison before and after the announcement of CONSORT guideline for abstracts
Authors
Akira Kuriyama
Naomi Takahashi
Takeo Nakayama
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-1786-x

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue