Top

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine

Published in:

Open Access 01-12-2016 | Original research

Do emergency medicine journals promote trial registration and adherence to reporting guidelines? A survey of “Instructions for Authors”

Authors: Matthew T. Sims, Nolan M. Henning, C. Cole Wayant, Matt Vassar

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2016

Abstract

Background

Methods

We performed a web-based data abstraction from the “Instructions for Authors” of the 27 Emergency Medicine journals catalogued in the Expanded Science Citation Index of the 2014 Journal Citation Reports and Google Scholar Metrics h5-index to identify whether each journal required, recommended, or made no mention of the following reporting guidelines: EQUATOR Network, ICMJE, ARRIVE, CARE, CONSORT, STARD, TRIPOD, CHEERS, MOOSE, STROBE, COREQ, SRQR, SQUIRE, PRISMA-P, SPIRIT, PRISMA, and QUOROM. We also extracted whether journals required or recommended trial registration. Authors were blinded to one another’s ratings until completion of the data validation. Cross-tabulations and descriptive statistics were calculated using IBM SPSS 22.

Results

Of the 27 emergency medicine journals, 11 (11/27, 40.7%) did not mention a single guideline within their “Instructions for Authors,” while the remaining 16 (16/27, 59.3%) mentioned one or more guidelines. The QUOROM statement and SRQR were not mentioned by any journals whereas the ICMJE guidelines (18/27, 66.7%) and CONSORT statement (15/27, 55.6%) were mentioned most often. Of the 27 emergency medicine journals, 15 (15/27, 55.6%) did not mention trial or review registration, while the remaining 12 (12/27, 44.4%) at least mentioned one of the two. Trial registration through ClinicalTrials.gov was mentioned by seven (7/27, 25.9%) journals while the WHO registry was mentioned by four (4/27, 14.8%). Twelve (12/27, 44.4%) journals mentioned trial registration through any registry platform.

Discussion

The aim of this study was to evaluate the current state of two publication practices, reporting guidelines requirements and clinical trial registration requirements, by analyzing the “Instructions for Authors” of emergency medicine journals. In this study, there was not a single reporting guideline mentioned in more than half of the journals. This undermines efforts of other journals to improve the completeness and transparency of research reporting.

Conclusions

Reporting guidelines are infrequently required or recommended by emergency medicine journals. Furthermore, few require clinical trial registration. These two mechanisms may limit bias and should be considered for adoption by journal editors in emergency medicine.

Trial registration

UMIN000022486

Available only for authorised users

Smith TA, Kulatilake P, Brown LJ, Wigley J, Hameed W, Shantikumar S. Do surgery journals insist on reporting by CONSORT and PRISMA? A follow-up survey of “instructions to authors”. Ann Med Surg. 2015;4:17–21.CrossRef

Simera I, Moher D, Hoey J, Schulz KF, Altman DG. The EQUATOR Network and reporting guidelines: Helping to achieve high standards in reporting health research studies. Maturitas. 2009;63:4–6.CrossRefPubMed

Hirst A, Altman DG. Are peer reviewers encouraged to use reporting guidelines? A survey of 116 Health Research Journals. PLoS ONE. 2012;7(4):e35621. doi:10.1371/journal.pone.0035621.

Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006;185:263–7.PubMed

Prady SL, Richmond SJ, Morton VM, Macpherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS ONE. 2008;3(2):e1577. doi:10.1371/journal.pone.0001577.

Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG. Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 2010;8:24. doi:10.1186/1741-7015-8-24.

The EQUATOR Network. Enhancing the QUAlity and Transparency of health Research. [Internet]. Oxford; Centre for Statistics in Medicina. Available at http://www.equator-network.org/. Accessed on 18 Mar 2015.

Bonati M, Pandolfini C. Trial registration, the ICMJE statement, and paediatric journals. Arch Dis Child. 2006;91(1):93. doi:10.1136/adc.2005.085530.

Rivara FP. Registration of Clinical Trials. Arch Pediatr & Adolesc Med. 2005;1592005;159(7):685. doi:10.1001/archpedi.159.7.685.

10.

Jones CW, Keil LG, Holland WC, Caughey MC, Platts-Mills TF. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282. doi:10.1186/s12916-015-0520-3.

11.

International Committee of Medical Journal Editors (ICMJE). Clinical Trial Registration. Available at http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html. Accessed 18 Mar 2016.

12.

World Health Organization (WHO); International Clinical Trials Registry Platform (ICTRP). WHO Statement on Public Disclosure of Clinical Trial Results. Available at http://www.who.int/ictrp/results/WHO_Statement_results_reporting_clinical_trials.pdf?ua=1. Accessed on 18 Mar 2016.

13.

Lang TA, Altman DG. Basic statistical reporting for articles published in biomedical journals: The “Statistical Analyses and Methods in the Published Literature” or The “SAMPL Guidelines.” In: Smart P, Maisonneuve H, Polderman A (eds). Science Editors’ Handbook. Oxford: European Association of Science Editors; 2013.

14.

Onishi A, Furukawa TA. Publication bias is underreported in systematic reviews published in high-impact-factor journals: metaepidemiologic study. J Clin Epidemiol. 2014;67(12):1320–6.CrossRefPubMed

15.

Bonnot B, Yavchitz A, Mantz J, Paugam-Burtz C, Boutron I. Selective primary outcome reporting in high-impact journals of anaesthesia and pain. Br J Anaesth. 2016;117(4):542–3.CrossRef

16.

Helfer B, Prosser A, Samara MT, Geddes JR, Cipriani A, Davis JM, Mavridis D, Salanti G, Leucht S. Recent meta-analyses neglect previous systematic reviews and meta-analyses about the same topic: a systematic examination. BMC Med. 2015;13(1):1.CrossRef

17.

Uhlig C, Krause H, Koch T, de Abreu MG, Spieth PM. Anesthesia and monitoring in small laboratory mammals used in anesthesiology, respiratory and critical care research: a systematic review on the current reporting in top-10 impact factor ranked journals. PLoS One. 2015;10(8):e0134205.CrossRefPubMedPubMedCentral

18.

Tao KM, Li XQ, Zhou QH, Moher D, Ling CQ, Yu WF. From QUOROM to PRISMA: a survey of high-impact medical Journals’ instructions to authors and a review of systematic reviews in anesthesia literature. PLoS One. 2011;6(11):e27611. doi:10.1371/journal.pone.0027611.CrossRefPubMedPubMedCentral

19.

Tunis AS, McInnes MD, Hanna R, Esmail K. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013;269(2):413–26.CrossRefPubMed

20.

Panic N, Leoncini E, de Belvis G, Ricciardi W, Boccia S. Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. PLoS One. 2013;8(12):e83138.CrossRefPubMedPubMedCentral

21.

Bigna JJ, Um LN, Nansseu JR. A comparison of quality of abstracts of systematic reviews including meta-analysis of randomized controlled trials in high-impact general medicine journals before and after the publication of PRISMA extension for abstracts: a systematic review and meta-analysis. Syst Rev. 2016;5(1):174.CrossRefPubMedPubMedCentral

22.

Meerpohl JJ, Wolff RF, Niemeyer CM, Antes G, von Elm E. Editorial policies of pediatric journals: survey of instructions for authors. Arch Pediatr Adolesc Med. 2010;164(3):268–72.CrossRefPubMed

23.

Harzing AWK, van der Wal R. Google Scholar as a new source for citation analysis. Ethics Sci Environ Polit. 2008;8:61–73.CrossRef

24.

Delgado-Lopez-Cozar E, Cabezas-Clavijo A. Ranking journals: could Google scholar metrics be an alternative to journal citation reports and Scimago journal rank? Learn Publ. 2013;26(2):101–13.CrossRef

25.

Delgado E, Repiso R. The impact of scientific journals of communication: comparing Google scholar metrics, web of science and scopus. Comunicar. 2013;21(41):45.CrossRef

26.

Truex III DP, Cuellar MJ, Takeda H. Assessing scholarly influence: using the Hirsch indices to reframe the discourse. J Assoc Inf Syst. 2009;10(7):560–94.

27.

Mingers J, Macri F, Petrovici D. Using the h-index to measure the quality of journals in the field of business and management. Inform Process Manag. 2012;48(2):234–41.CrossRef

28.

Dillman DA, Smyth JD, Christian LM. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method 2013.

29.

Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001;357:1191–4.CrossRefPubMed

30.

Vandenbroucke JP. STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK… CONSORT: for whom does the guideline toll? J Clin Epidemiol. 2009;62:594–6.CrossRefPubMed

31.

Moher D, Schulz KF, Altman D, CONSORT Group (Consolidated Standards of Reporting Trials). The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001;285:1991.

32.

Moher D, Schulz KF, Altman DG, CONSORT GROUP (Consolidated Standards of Reporting Trials). . The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657–62.CrossRefPubMed

33.

Moher D. Reporting research results: a moral obligation for all researchers. Can J Anaesth. 2007;54:331–5.CrossRefPubMed

34.

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. doi:10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral

35.

Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723. doi:10.1136/bmj.c723.

36.

Moher D, Jones A, Lepage L, CONSORT Group (Consolidated Standards for Reporting of Trials). Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285:1992–5.CrossRefPubMed

37.

Weber WEJ, Merino JG, Loder E. Trial registration 10 years on. BMJ. 2015;351:h3572.CrossRefPubMed

38.

National Institute of Health (NIH); National Institute of Neurological Disorders and Stroke. ClinicalTrials.gov Registration and Reporting. Modified on September 18, 2015. Available at http://www.ninds.nih.gov/research/clinical_research/basics/clinicaltrials_required_registration.htm. Accessed 26 May 2016.

39.

ClinicalTrials.gov. FDAAA 801 Requirements. Modified on November 1, 2015. Available at https://clinicaltrials.gov/ct2/manage-recs/fdaaa. Accessed 26 May 2016.

40.

Malicki M, Marusic A, OPEN (to Overcome failure to Publish nEgative fiNdings) Consortium. Is there a solution to publication bias? Researchers call for changes in dissemination of clinical research results. J Clin Epidemiol. 2014;67:1103–10.CrossRefPubMed

41.

Reveiz L, Krleza-Jeric K, Chan AW, de Aguiar S. Do trialists endorse clinical trial registration? Survey of a Pubmed sample. Trials. 2007;8:30. doi:10.1186/1745-6215-8-30.

42.

Wager E, Williams P, Project Overcome failure to Publish nEgative fiNdings Consortium. “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study. BMJ. 2013;347:f5248.

43.

Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF. Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013;347:f6104. doi:10.1136/bmj.f6104.

44.

Prayle AP, Hurley MN, Smyth AR. Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study. BMJ. 2012;344:d7373.

45.

De Angelis C, Drazen JM, Frizelle FA, et al. International Committee of Medical Journal Editors. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. New Engl J Med. 2004;351:1250–1.CrossRefPubMed

46.

Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7(3):e1000251.

47.

Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302:977–84.CrossRefPubMed

48.

Van de Wetering FT, Scholten RJPM, Haring T, Clarke M, Hooft L. Trial registration numbers are underreported in biomedical publications. PloS One. 2012;7(11):e49599.

49.

Hardt JLS, Metzendorf MI, Meerpohl JJ. Surgical trials and trial registers: a cross-sectional study of randomized controlled trials published in journals requiring trial registration in the author insturctions. Trials. 2013;13:407.CrossRef

50.

Killeen S, Souralious P, Hunter IA, Hartley JE, Grady HL. Registration rates, adequacy of registration, and a comparison of registered and published primary outcomes in randomized controlled trials published in surgery journals. Ann Surg. 2014;259(1):193–6.CrossRefPubMed

51.

Hooft L, Korevaar DA, Molenaar N, Bossuyt PM, Scholten RJ. Endorsement of ICMJE’s clinical trial registration policy: A survey among journal editors. Neth J Med. 2014;72(7):349–55.PubMed

52.

Anand V, Scales DC, Parshuram CS, Kavanagh BP. Registration and design alterations of clinical trials in critical care: A cross-sectional observational study. Intensive Care Med. 2014;40(5):700–22.CrossRefPubMed

53.

Kunath F, Grobe HR, Keck Bastian, Rucker G, Wullich B, Antes G, Meerpohl JJ. Do urology journals enforce trial registration? A cross-sectional study of published trials. BMJ Open. 2011;1(2):e000430.

54.

Mann E, Nguyen N, Fleischer S, Meyer G. Compliance with trial registration in five core journals of clinical geriatrics: A survey of original publications on randomised controlled trials from 2008 to 2012. Age Ageing. 2014;43(6):872–6.CrossRefPubMed

55.

Huser V, Cimino JJ. Evaluating adherence to the International Committee of Medical Journal Editors’ policy of mandatory, timely clinical trial registration. J Am Med Informatics Assoc. 2013;20:e169–74.CrossRef

56.

The EQUATOR Network. Collaborative initiative involving 28 rehabilitation and disability journals | The Equator Network. 2016. Available at http://www.equator-network.org/2014/04/09/collaborative-initiative-involving-28-rehabilitation-and-disability-journals/. Accessed 26 July 2016.

Title: Do emergency medicine journals promote trial registration and adherence to reporting guidelines? A survey of “Instructions for Authors”
Authors: Matthew T. Sims
Nolan M. Henning
C. Cole Wayant
Matt Vassar
Publication date: 01-12-2016
Publisher: BioMed Central
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine / Issue 1/2016
Electronic ISSN: 1757-7241
DOI: https://doi.org/10.1186/s13049-016-0331-3

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Do emergency medicine journals promote trial registration and adherence to reporting guidelines? A survey of “Instructions for Authors”

Abstract

Background

Methods

Results

Discussion

Conclusions

Trial registration

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Discussion

Conclusions

Trial registration

Please log in to get access to this content

Other articles of this Issue 1/2016

Shock in the emergency department; a 12 year population based cohort study

Effect of ultrasound training of physicians working in the prehospital setting

A randomised controlled trial of cognitive aids for emergency airway equipment preparation in a Paediatric Emergency Department

Adult “termination-of-resuscitation” (TOR)-criteria may not be suitable for children - a retrospective analysis

Warming the head of hypothermic patient – is it always safe?

The assessment of circulating volume using inferior vena cava collapse index and carotid Doppler velocity time integral in healthy volunteers: a pilot study