Skip to main content
Top
Published in: Neurocritical Care 1/2022

02-03-2022 | Care | Original work

Twitter Journal Club Impact on Engagement Metrics of the Neurocritical Care Journal

Authors: Aarti Sarwal, Masoom Desai, Pallavi Juneja, Joni K. Evans, Abhay Kumar, Eelco Wijdicks

Published in: Neurocritical Care | Issue 1/2022

Login to get access

Abstract

Background

Twitter journal clubs are a modern way of highlighting articles published in a scientific journal. The Neurocritical Care journal (NCC) initiated a bimonthly, Twitter-based, online journal club in 2015 to increase the outreach of its published articles. We hypothesize that articles included in the Neurocritical Care Society Twitter Journal Club (NCSTJC) had greater engagement than other articles published during the same time period. We also investigated the relationship between number of citations and Altmetric score to assess whether the enhanced online activity resulted in higher citations.

Methods

We gathered data in August 2020 on engagement metrics (number of downloads, Altmetric score, relative citation ratio, and number of citations) of all articles published in NCC between 2015 and 2018. Articles were analyzed into two groups: one featured in NCSTJC and the rest that were not (non-NCSTJC1), and the other comprised those that were not in NCSTJC but published under a similar category of articles as NCSTJC (non-NCSTJC2). Results were analyzed using descriptive statistics, and summary measures were used to report the spread. The groups were compared by using the Wilcoxon rank sum test, given that the data were not normally distributed. Spearman’s rank correlation was used to assess correlation between Altmetric score and citations for the articles in the NCSTJC and non-NCSTJC groups. For comparison, the top ten cited articles in NCC were analyzed for similar correlations.

Results

Between 2015 and 2018, NCC published 529 articles, 24 of which were included in the Twitter journal club. A total of 406 articles were published in the same category as the category of articles selected for NCSTJC. The articles discussed as a part of NCSTJC had a statistically significant trend toward a higher number of downloads, Altmetric score, relative citation ratio, and number of citations than rest of the articles published in the journal during the same time period and the rest of the articles published in same categories. Three NCSTJC articles were among the ten most-cited articles published by NCC between 2015 and 2018. We did not find a correlation between Altmetric scores and number of citations in the NCSTJC or non-NCSTJC1 or non-NCSTJC2 group, but there was a strong correlation between these two variables in high performing articles when the top ten cited articles were analyzed.

Conclusions

Scientific journals are evolving their social media strategies in attempt to increase the outreach of their articles to the medical community. Platforms such as Twitter journal clubs can enhance such engagement. The long-term influence of such strategies on the impact factor of a medical journal and traditional engagement metrics, such as citations, calls for further research.
Appendix
Available only for authorised users
Literature
1.
go back to reference Linzer M. The journal club and medical education: over one hundred years of unrecorded history. Postgrad Med J. 1987;63(740):475–8.CrossRef Linzer M. The journal club and medical education: over one hundred years of unrecorded history. Postgrad Med J. 1987;63(740):475–8.CrossRef
2.
go back to reference Ahmadi N, McKenzie ME, Maclean A, Brown CJ, Mastracci T, McLeod RS. Teaching evidence based medicine to surgery residents-is journal club the best format? A systematic review of the literature. J Surg Educ. 2012;69(1):91–100.CrossRef Ahmadi N, McKenzie ME, Maclean A, Brown CJ, Mastracci T, McLeod RS. Teaching evidence based medicine to surgery residents-is journal club the best format? A systematic review of the literature. J Surg Educ. 2012;69(1):91–100.CrossRef
3.
go back to reference Topf JM, Sparks MA, Phelan PJ, et al. The evolution of the journal club: from Osler to Twitter. Am J Kidney Dis. 2017;69(6):827–36.CrossRef Topf JM, Sparks MA, Phelan PJ, et al. The evolution of the journal club: from Osler to Twitter. Am J Kidney Dis. 2017;69(6):827–36.CrossRef
5.
go back to reference Chang J, Desai N, Gosain A. Correlation between altmetric score and citations in pediatric surgery core journals. J Surg Res. 2019;243:52–8.CrossRef Chang J, Desai N, Gosain A. Correlation between altmetric score and citations in pediatric surgery core journals. J Surg Res. 2019;243:52–8.CrossRef
6.
go back to reference Mullins CH, Boyd CJ, Corey BL. Examining the correlation between altmetric score and citations in the general surgery literature. J Surg Res. 2020;248:159–64.CrossRef Mullins CH, Boyd CJ, Corey BL. Examining the correlation between altmetric score and citations in the general surgery literature. J Surg Res. 2020;248:159–64.CrossRef
7.
go back to reference Wijdicks EFM. The journal and social media. Neurocrit Care. 2016;26(1):1–2.CrossRef Wijdicks EFM. The journal and social media. Neurocrit Care. 2016;26(1):1–2.CrossRef
9.
go back to reference Bergstralh EJ, Kosanke JL, Jacobsen SJ. Software for optimal matching in observational studies. Epidemiology. 1996;7(3):331–2.PubMed Bergstralh EJ, Kosanke JL, Jacobsen SJ. Software for optimal matching in observational studies. Epidemiology. 1996;7(3):331–2.PubMed
10.
go back to reference Cosco TD. Medical journals, impact and social media: an ecological study of the Twittersphere. CMAJ. 2015;187(18):1353–7.CrossRef Cosco TD. Medical journals, impact and social media: an ecological study of the Twittersphere. CMAJ. 2015;187(18):1353–7.CrossRef
11.
go back to reference O’Kelly F, Nason GJ, Manecksha RP, et al. The effect of social media (#SoMe) on journal impact factor and parental awareness in paediatric urology. J Ped Urol. 2017;13(5):e1-513.e7. O’Kelly F, Nason GJ, Manecksha RP, et al. The effect of social media (#SoMe) on journal impact factor and parental awareness in paediatric urology. J Ped Urol. 2017;13(5):e1-513.e7.
12.
go back to reference Widmer JR, Mandrekar J, Ward A, et al. Effect of promotion via social media on access of articles in an academic medical journal: a randomized controlled Trial. Acad Med. 2019;94(10):1546–53.CrossRef Widmer JR, Mandrekar J, Ward A, et al. Effect of promotion via social media on access of articles in an academic medical journal: a randomized controlled Trial. Acad Med. 2019;94(10):1546–53.CrossRef
13.
go back to reference McNamara P, Usher K. Share or perish: social media and the International Journal of Mental Health Nursing. Int J Ment Health Nurs. 2019;28(4):960–70.CrossRef McNamara P, Usher K. Share or perish: social media and the International Journal of Mental Health Nursing. Int J Ment Health Nurs. 2019;28(4):960–70.CrossRef
14.
go back to reference Hepatology ZLS, Case Western Reserve U, Austin LC, et al. Longitudinal relationship between social media activity and article citations in the journal Gastrointestinal Endoscopy. Gastrointest Endosc. 2020;90(1):77–83. Hepatology ZLS, Case Western Reserve U, Austin LC, et al. Longitudinal relationship between social media activity and article citations in the journal Gastrointestinal Endoscopy. Gastrointest Endosc. 2020;90(1):77–83.
15.
go back to reference Eysenbach G. Can Tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. J Med Internet Res. 2011;13(4):e123.CrossRef Eysenbach G. Can Tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. J Med Internet Res. 2011;13(4):e123.CrossRef
16.
go back to reference Hawkins CM, Makeba H, Kolenic GE, Carlos RC. Social media and peer-reviewed medical journal readership: a randomized prospective controlled trial. J Am Coll Radiol. 2017;14(5):596–602.CrossRef Hawkins CM, Makeba H, Kolenic GE, Carlos RC. Social media and peer-reviewed medical journal readership: a randomized prospective controlled trial. J Am Coll Radiol. 2017;14(5):596–602.CrossRef
17.
go back to reference Fargen KM, Ducruet AF, Hyer M, et al. Expanding the social media presence of the editor’s report. J Neurointerv Surg. 2017;9(2):215–8.CrossRef Fargen KM, Ducruet AF, Hyer M, et al. Expanding the social media presence of the editor’s report. J Neurointerv Surg. 2017;9(2):215–8.CrossRef
18.
go back to reference Hawkins CM, Hillman BJ, Carlos RC, Rawson JV, Haines R, Duszak,. The impact of social media on readership of a peer-reviewed medical journal. J Am Coll Radiol. 2014;11(11):1038–43.CrossRef Hawkins CM, Hillman BJ, Carlos RC, Rawson JV, Haines R, Duszak,. The impact of social media on readership of a peer-reviewed medical journal. J Am Coll Radiol. 2014;11(11):1038–43.CrossRef
19.
go back to reference Baan CC, Dor FJMF. The transplantation journal on social media: the @transplantjrnl journey from impact factor to klout score. Transplantation. 2017;101(1):8–10.CrossRef Baan CC, Dor FJMF. The transplantation journal on social media: the @transplantjrnl journey from impact factor to klout score. Transplantation. 2017;101(1):8–10.CrossRef
20.
go back to reference Winter JCFD. The relationship between tweets, citations, and article views for PLOS ONE articles. Scientometrics. 2014;102(2):1773–9.CrossRef Winter JCFD. The relationship between tweets, citations, and article views for PLOS ONE articles. Scientometrics. 2014;102(2):1773–9.CrossRef
21.
go back to reference Fox CS, Bonaca MA, Ryan JJ, Massaro JM, Barry K, Loscalzo,. A randomized trial of social media from Circulation. Circulation. 2015;131(1):28–33.CrossRef Fox CS, Bonaca MA, Ryan JJ, Massaro JM, Barry K, Loscalzo,. A randomized trial of social media from Circulation. Circulation. 2015;131(1):28–33.CrossRef
22.
go back to reference Roberts JR, Perera M, Lawrentschuk N, Romanic D, Papa N, Bolton D. Globalization of continuing professional development by journal clubs via microblogging: a systematic review. J Med Internet Res. 2015;17(4):e103.CrossRef Roberts JR, Perera M, Lawrentschuk N, Romanic D, Papa N, Bolton D. Globalization of continuing professional development by journal clubs via microblogging: a systematic review. J Med Internet Res. 2015;17(4):e103.CrossRef
23.
go back to reference Niehaus WN, Silver JK, Katz MS. The PM&R journal implements a social media strategy to disseminate research and track alternative metrics in physical medicine and rehabilitation. PM R. 2018;10(5):538–43.CrossRef Niehaus WN, Silver JK, Katz MS. The PM&R journal implements a social media strategy to disseminate research and track alternative metrics in physical medicine and rehabilitation. PM R. 2018;10(5):538–43.CrossRef
24.
go back to reference Nocera AP, Boyd CJ, Boudreau H, Hakim O, Rais-Bahrami S. Examining the correlation between altmetric score and citations in the urology literature. Urology. 2019;134:45–50.CrossRef Nocera AP, Boyd CJ, Boudreau H, Hakim O, Rais-Bahrami S. Examining the correlation between altmetric score and citations in the urology literature. Urology. 2019;134:45–50.CrossRef
26.
go back to reference Torbey MT, Bösel J, Rhoney DH, et al. Evidence-based guidelines for the management of large hemispheric infarction: a statement for health care professionals from the Neurocritical Care Society and the German Society for Neuro-intensive Care and Emergency Medicine. Neurocrit Care. 2015;22(1):146–64. https://doi.org/10.1007/s12028-014-0085-6.CrossRefPubMed Torbey MT, Bösel J, Rhoney DH, et al. Evidence-based guidelines for the management of large hemispheric infarction: a statement for health care professionals from the Neurocritical Care Society and the German Society for Neuro-intensive Care and Emergency Medicine. Neurocrit Care. 2015;22(1):146–64. https://​doi.​org/​10.​1007/​s12028-014-0085-6.CrossRefPubMed
49.
go back to reference Frontera JA, Lewin JJ 3rd, Rabinstein AA, et al. Guideline for reversal of antithrombotics in intracranial hemorrhage: a statement for healthcare professionals from the neurocritical care society and society of critical care medicine. Neurocrit Care. 2016;24(1):6–46. https://doi.org/10.1007/s12028-015-0222-x. Frontera JA, Lewin JJ 3rd, Rabinstein AA, et al. Guideline for reversal of antithrombotics in intracranial hemorrhage: a statement for healthcare professionals from the neurocritical care society and society of critical care medicine. Neurocrit Care. 2016;24(1):6–46. https://​doi.​org/​10.​1007/​s12028-015-0222-x.
52.
go back to reference Souter MJ, Blissitt PA, Blosser S, et al. Recommendations for the critical care management of devastating brain injury: prognostication, psychosocial, and ethical management: a position statement for healthcare professionals from the neurocritical care society. Neurocrit Care. 2015;23(1):4–13. https://doi.org/10.1007/s12028-015-0137-6. Souter MJ, Blissitt PA, Blosser S, et al. Recommendations for the critical care management of devastating brain injury: prognostication, psychosocial, and ethical management: a position statement for healthcare professionals from the neurocritical care society. Neurocrit Care. 2015;23(1):4–13. https://​doi.​org/​10.​1007/​s12028-015-0137-6.
53.
go back to reference Nyquist P, Bautista C, Jichici D, et al. Prophylaxis of venous thrombosis in neurocritical care patients: an evidence-based guideline: a statement for healthcare professionals from the neurocritical care society. Neurocrit Care. 2016;24(1):47–60. https://doi.org/10.1007/s12028-015-0221-y. Nyquist P, Bautista C, Jichici D, et al. Prophylaxis of venous thrombosis in neurocritical care patients: an evidence-based guideline: a statement for healthcare professionals from the neurocritical care society. Neurocrit Care. 2016;24(1):47–60. https://​doi.​org/​10.​1007/​s12028-015-0221-y.
Metadata
Title
Twitter Journal Club Impact on Engagement Metrics of the Neurocritical Care Journal
Authors
Aarti Sarwal
Masoom Desai
Pallavi Juneja
Joni K. Evans
Abhay Kumar
Eelco Wijdicks
Publication date
02-03-2022
Publisher
Springer US
Keyword
Care
Published in
Neurocritical Care / Issue 1/2022
Print ISSN: 1541-6933
Electronic ISSN: 1556-0961
DOI
https://doi.org/10.1007/s12028-022-01458-7

Other articles of this Issue 1/2022

Neurocritical Care 1/2022 Go to the issue