Top

Published in:

Open Access 01-12-2021 | Research

What are the variables associated with Altmetric scores?

Authors: Amanda Costa Araujo, Adriane Aver Vanin, Dafne Port Nascimento, Gabrielle Zoldan Gonzalez, Leonardo Oliveira Pena Costa

Published in: Systematic Reviews | Issue 1/2021

Abstract

Background

Social media has been used to disseminate the contents of scientific articles. To measure the impact of this, a new tool called Altmetric was created. Altmetric aims to quantify the impact of each article through online media. This systematic review aims to describe the associations between the publishing journal and published article variables and Altmetric scores.

Methods

Searches on MEDLINE, EMBASE, CINAHL, CENTRAL, and Cochrane Library were conducted. We extracted data related to both the publishing article and the publishing journal associated with Altmetric scores. The methodological quality of included articles was analyzed by the Appraisal Tool for Cross-sectional Studies.

Results

A total of 19 articles were considered eligible. These articles summarized a total of 573,842 studies. Citation counts, journal impact factor, access counts, papers published as open access, and press releases generated by the publishing journal were associated with Altmetric scores. The magnitude of these associations ranged from weak to strong.

Conclusion

Citation counts and journal impact factor are the most common variables associated with Altmetric scores. Other variables such as access counts, papers published in open access journals, and the use of press releases are also likely to be associated with online media attention.

Systematic review registration

This review does not contain health-related outcomes. Therefore, it is not eligible for registration.

Dinsmore A, Allen L, Dolby K. Alternative perspectives on impact: the potential of ALMs and Altmetrics to inform funders about research impact. PLOS Biol 2014;12(11):1–4. PMID:25423184, e1002003, DOI: https://doi.org/10.1371/journal.pbio.1002003

Patthi B, Prasad M, Gupta R, Singla A. Altmetrics – a collated adjunct beyond citations for scholarly impact: a systematic review. J Clin Diagnostic Res 2017;11(6):16–20. PMID:28764311

Brigham T. An introduction to Altmetrics. Med Ref Serv Q 2014;33(4):438–447. PMID:25316077, DOI: https://doi.org/10.1080/02763869.2014.957093

Melero R. Altmetrics- a complement conventional metrics. Biochem Medica 2015;2(25):152–160. PMID:26110028

Araujo AC, Nascimento DP, Gonzalez GZ, Oliveira L, Costa P. How to increase the visibility of scientific articles through social media? Braz J Phys Ther [Internet]. 2018;22(6):435–6. https://doi.org/10.1016/j.bjpt.2018.08.009.CrossRef

Rhee JS. High-impact articles — citations, downloads, and Altmetric score. JAMA Facial Plast Surg 2015;17(5):1–2. PMID:26226501

Fabry G. Beyond the impact factor – what do alternative metrics have to offer? GMS J Med Educ 2017;34(2):1–8. PMID:28584875

Eysenbach G. Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. J Med Internet Res 2011;14(1):e123. PMID:22173204

Rosenkrantz AB, Ayoola A, Singh K, Jr RD. Alternative metrics (“Altmetrics”) for assessing article impact in popular general radiology journals. Acad Radiol 2017;24(7):1–7. PMID:28256440

10.

Finch T, O’Hanlon N, Dudley SP. Tweeting birds: online mentions predict future citations in ornithology. R Soc Open Sci. 2017;4(11):1–11. https://doi.org/10.1098/rsos.171371.CrossRef

11.

Araujo AC, Nascimento DP, Gonzalez GZ, Maher CG, Costa LOP. Impact of low back pain clinical trials measured by the altmetric score: cross-sectional study. J Med Internet Res 2018;20(4):1–9. PMID:29622526

12.

Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ WV. Cochrane handbook for systematic reviews of interventions version [Internet]. Cochrane B Ser. 2021. PMID:21050962

13.

Page MJ, Shamseer L, Tricco AC. Registration of systematic reviews in PROSPERO: 30,000 records and counting. Syst Rev 2018;7(32):1–9. PMID:29463298

14.

Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open 2016;6(12):1–7. PMID:27932337

15.

Amath A, Ambacher K, Leddy JJ, Wood TJ, Ramnanan CJ. Comparing alternative and traditional dissemination metrics in medical education. Med Educ. 2017;51(9):935–41. 28719136. https://doi.org/10.1111/medu.13359.CrossRefPubMed

16.

Araujo AC, Gonzalez GZ, Nascimento DP, Costa LOP. The impact of low back pain systematic reviews and clinical practice guidelines measured by the Altmetric score: cross-sectional study. Brazilian J Phys Ther [Internet] 2021;25(1):48–55. PMID:32067898, DOI: https://doi.org/10.1016/j.bjpt.2020.01.002

17.

Assad MD, Howell SM, Rajesh A, Meaike J, Nho V, Tran M. Altmetrics in plastic surgery journals: does it correlate with citation count? Aesthetic Surg J. 2020;40(11):1–19. https://doi.org/10.1093/asj/sjaa158.CrossRef

18.

Barakat AF, Nimri N, Shokr M, Mahtta D, Mansoor H, Masri A, et al. Correlation of altmetric attention score and citations for high-impact general medicine journals: a cross-sectional study. JGIM. 2019;34(6):825–7. https://doi.org/10.1007/s11606-019-04838-6.CrossRefPubMedPubMedCentral

19.

Barbic D, Tubman M, Lam H, Barbic S, Carpenter CR. An analysis of Altmetrics in emergency medicine. Acad Emerg Med [Internet]. 2016;23(3):251–68. https://doi.org/10.1111/acem.12898.CrossRef

20.

Bornmann L, Haunschild R. Do Altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. PLoS One [Internet] United States; 2018;13(5):e0197133. [doi: 10.1371/journal.pone.0197133]

21.

Chen WMY, Bukhari M, Cockshull F, Galloway J. The relationship between citations, downloads and alternative metrics in rheumatology publications: a bibliometric study. Rheumatology. 2020;59(2):277–80. 31074830. https://doi.org/10.1093/rheumatology/kez163.CrossRefPubMed

22.

Costas R, Zahedi Z, Wouters P. Do “Altmetrics” correlate with citations? Extensive comparison of Altmetric indicators with citations from a multidisciplinary perspective. J Assoc Inf Sci Technol 2015;66(10):2003–2019. [doi: 10.1002/asi]

23.

Dagar A, Falcone T. Altmetric scores analysis reveals a high demand for psychiatry research on social media. Psychiatry Res [Internet]. 2021;298(113782):1–5. https://doi.org/10.1016/j.psychres.2021.113782.CrossRef

24.

Haneef R, Ravaud P, Baron G, Ghosn L, Boutron I. Factors associated with online media attention to research: a cohort study of articles evaluating cancer treatments. Res Integr peer Rev [Internet]. 2017;2(9):1–8. https://doi.org/10.1186/s41073-017-0033-z.CrossRef

25.

Didegah F, Bowman TD, Holmberg K. On the differences between citations and Altmetrics: an investigation of factors driving Altmetrics versus citations for Finnish articles. J Assoc Sci Tecnol. 2018;69(6):832–43. https://doi.org/10.1002/asi.23934.CrossRef

26.

Ayoub F, Ouni A, Case R, Ladna M, Shah H, Rubin DT. Dissemination of gastroenterology and hepatology research on social media platforms is associated with increased citation count. Am J Gastroenterol [Internet] 2021;1–3. [https://doi.org/10.14309/ajg.0000000000001240]. in press.

27.

Knight SR. Social media and online attention as an early measure of the impact of research in solid organ transplantation. Transplantation. 2014;98(5):490–6. https://doi.org/10.1097/TP.0000000000000307.CrossRefPubMed

28.

Richardson MA, Bernstein DN, Mesfin A. Manuscript characteristics associated with the altmetrics score and social media presence: an analysis of seven spine journals. Spine J. 2021;21(4):548–54.

29.

Kunze KN, Richardson M, Bernstein DN, Premkumar A, Piuzzi NS, McLawhorn AS. Altmetrics attention scores for randomized controlled trials in total joint arthroplasty are reflective of high scientific quality: an Altmetrics-based methodological quality and bias analysis. J Am Acad Orthop Surg Glob Res Rev [Internet]. 2020;4(12):1–10. https://doi.org/10.5435/JAAOSGlobal-D-20-00187.CrossRef

30.

Lamb CT, Gilbert SL, Ford AT. Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation. PeerJ Life Eviron. 2018;12(6):1–14. https://doi.org/10.7717/peerj.4564.CrossRef

31.

Richardson MA, Park W, Echternacht SR, Bell DE. Altmetric attention score: evaluating the social media impact of burn research. J Burn Care Res. 2021:1–5. https://doi.org/10.1093/jbcr/irab026. in press.

32.

Rosenkrantz AB, Ayoola A, Singh K, JrDuszak R, Duszak RJ, A.B. R, A. A, K. S. Alternative metrics (“Altmetrics”) for assessing article impact in popular general radiology journals. Acad Radiol [Internet] 2017;24(7):891–897. [doi: 10.1016/j.acra.2016.11.019]

33.

Araujo AC, Gonzalez GZ, Nascimento DP, Costa LOP, A.C. A, G.Z. G, D.P. N. Deep impact: 4 tips for authors and journal editors to improve Altmetric scores. Phys Ther [Internet] 2020;100(11):2060–2062. [doi: 10.1093/ptj/pzaa145]

Title: What are the variables associated with Altmetric scores?
Authors: Amanda Costa Araujo
Adriane Aver Vanin
Dafne Port Nascimento
Gabrielle Zoldan Gonzalez
Leonardo Oliveira Pena Costa
Publication date: 01-12-2021
Publisher: BioMed Central
Published in: Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI: https://doi.org/10.1186/s13643-021-01735-0

At a glance: The STEP trials

Springer Medicine

What are the variables associated with Altmetric scores?

Abstract

Background

Methods

Results

Conclusion

Systematic review registration

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Systematic review registration

Please log in to get access to this content

Other articles of this Issue 1/2021

Correction to: Community mobilisation approaches to preventing and reducing adolescent multiple risk behaviour: a realist review protocol

The views of health guideline developers on the use of automation in health evidence synthesis

Effectiveness of personal letters to healthcare professionals in changing professional behaviours: a systematic review protocol

Effect modification of the association between comorbidities and severe course of COVID-19 disease by age of study participants: a systematic review and meta-analysis

A characterization of cortisol level and adrenal reservation in human cardiopulmonary arrest: systematic review and meta-analysis

Determinants of adolescent substance use in Africa: a systematic review and meta-analysis protocol