Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Reference management software for systematic reviews and meta-analyses: an exploration of usage and usability

Authors: Diane L Lorenzetti, William A Ghali

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Reference management software programs enable researchers to more easily organize and manage large volumes of references typically identified during the production of systematic reviews. The purpose of this study was to determine the extent to which authors are using reference management software to produce systematic reviews; identify which programs are used most frequently and rate their ease of use; and assess the degree to which software usage is documented in published studies.

Methods

We reviewed the full text of systematic reviews published in core clinical journals indexed in ACP Journal Club from 2008 to November 2011 to determine the extent to which reference management software usage is reported in published reviews. We surveyed corresponding authors to verify and supplement information in published reports, and gather frequency and ease-of-use data on individual reference management programs.

Results

Of the 78 researchers who responded to our survey, 79.5% reported that they had used a reference management software package to prepare their review. Of these, 4.8% reported this usage in their published studies. EndNote, Reference Manager, and RefWorks were the programs of choice for more than 98% of authors who used this software. Comments with respect to ease-of-use issues focused on the integration of this software with other programs and computer interfaces, and the sharing of reference databases among researchers.

Conclusions

Despite underreporting of use, reference management software is frequently adopted by authors of systematic reviews. The transparency, reproducibility and quality of systematic reviews may be enhanced through increased reporting of reference management software usage.
Literature
1.
go back to reference Nashelsky J, Earley J: Reference management software: selection and uses. Libr Software Rev. 1991, 10: 174-178. Nashelsky J, Earley J: Reference management software: selection and uses. Libr Software Rev. 1991, 10: 174-178.
2.
go back to reference Garfield JM, Flanagan H, Fox J: A comparison of two microcomputer-based programs for bibliographic retrieval and formatting. J Clin Monit. 1989, 5: 177-185. 10.1007/BF01627450.CrossRefPubMed Garfield JM, Flanagan H, Fox J: A comparison of two microcomputer-based programs for bibliographic retrieval and formatting. J Clin Monit. 1989, 5: 177-185. 10.1007/BF01627450.CrossRefPubMed
3.
go back to reference Gilmour R, Cobus-Kuo L: Reference management software: a comparative analysis of four products. Issues Sci Technol Libr. 2011, 66: doi:10.5062/F4Z60KZF Gilmour R, Cobus-Kuo L: Reference management software: a comparative analysis of four products. Issues Sci Technol Libr. 2011, 66: doi:10.5062/F4Z60KZF
4.
go back to reference Wachtel R: Personal bibliographic databases. Science. 1987, 235: 1093-1096. 10.1126/science.235.4792.1093.CrossRefPubMed Wachtel R: Personal bibliographic databases. Science. 1987, 235: 1093-1096. 10.1126/science.235.4792.1093.CrossRefPubMed
6.
go back to reference King R, Hooper B, Wood W: Using bibliographic software to appraise and code data in educational systematic review research. Med Teach. 2011, 33: 719-723. 10.3109/0142159X.2011.558138.CrossRefPubMed King R, Hooper B, Wood W: Using bibliographic software to appraise and code data in educational systematic review research. Med Teach. 2011, 33: 719-723. 10.3109/0142159X.2011.558138.CrossRefPubMed
8.
go back to reference Senarath U: Bibliographic referencing made easy: use of bibliographic software in health research. Ceylon Med J. 2007, 52: 38-39.PubMed Senarath U: Bibliographic referencing made easy: use of bibliographic software in health research. Ceylon Med J. 2007, 52: 38-39.PubMed
9.
go back to reference Steele SE: Bibliographic citation management software as a tool for building knowledge. J Wound Ostomy Continence Nurs. 2008, 35: 463-466. 10.1097/01.WON.0000335956.45311.69.CrossRefPubMed Steele SE: Bibliographic citation management software as a tool for building knowledge. J Wound Ostomy Continence Nurs. 2008, 35: 463-466. 10.1097/01.WON.0000335956.45311.69.CrossRefPubMed
10.
go back to reference Ware M, Mabe M: The STM report: an overview of scientific and scholarly journal publishing. 2012, The Netherlands Ware M, Mabe M: The STM report: an overview of scientific and scholarly journal publishing. 2012, The Netherlands
11.
go back to reference Betran AP, Say L, Gulmezoglu AM, Allen T, Hampson L: Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005, 5: 6-10.1186/1471-2288-5-6.CrossRefPubMedPubMedCentral Betran AP, Say L, Gulmezoglu AM, Allen T, Hampson L: Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005, 5: 6-10.1186/1471-2288-5-6.CrossRefPubMedPubMedCentral
12.
go back to reference Lohonen J, Isohanni M, Nieminen P, Miettunen J: Coverage of the bibliographic databases in mental health research. Nord J Psychiatry. 2010, 64: 181-188. 10.3109/08039480903337378.CrossRefPubMed Lohonen J, Isohanni M, Nieminen P, Miettunen J: Coverage of the bibliographic databases in mental health research. Nord J Psychiatry. 2010, 64: 181-188. 10.3109/08039480903337378.CrossRefPubMed
13.
go back to reference Royle P, Waugh N: Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the national institute for clinical excellence appraisal system. Health Technol Assess. 2003, 7: iii-64.CrossRef Royle P, Waugh N: Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the national institute for clinical excellence appraisal system. Health Technol Assess. 2003, 7: iii-64.CrossRef
14.
go back to reference Royle P, Milne R: Literature searching for randomized controlled trials used in cochrane reviews: rapid versus exhaustive searches. Int J Technol Assess Health Care. 2003, 19: 591-603.CrossRefPubMed Royle P, Milne R: Literature searching for randomized controlled trials used in cochrane reviews: rapid versus exhaustive searches. Int J Technol Assess Health Care. 2003, 19: 591-603.CrossRefPubMed
15.
go back to reference Dembe AE, Partridge JS, Geist LC: Statistical software applications used in health services research: analysis of published studies in the U.S. BMC Health Serv Res. 2011, 11: 252-10.1186/1472-6963-11-252.CrossRefPubMedPubMedCentral Dembe AE, Partridge JS, Geist LC: Statistical software applications used in health services research: analysis of published studies in the U.S. BMC Health Serv Res. 2011, 11: 252-10.1186/1472-6963-11-252.CrossRefPubMedPubMedCentral
17.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.CrossRefPubMedPubMedCentral
18.
go back to reference Bax L, Yu LM, Ikeda N, Moons KG: A systematic comparison of software dedicated to meta-analysis of causal studies. BMC Med Res Methodol. 2007, 7: 40-10.1186/1471-2288-7-40.CrossRefPubMedPubMedCentral Bax L, Yu LM, Ikeda N, Moons KG: A systematic comparison of software dedicated to meta-analysis of causal studies. BMC Med Res Methodol. 2007, 7: 40-10.1186/1471-2288-7-40.CrossRefPubMedPubMedCentral
19.
go back to reference Brantz MH, Galla J: Is there an optimal bibliographic software product for end users?. Bull Med Libr Assoc. 1988, 76: 216-220.PubMedPubMedCentral Brantz MH, Galla J: Is there an optimal bibliographic software product for end users?. Bull Med Libr Assoc. 1988, 76: 216-220.PubMedPubMedCentral
20.
go back to reference Hernandez DA, El-Masri MM, Hernandez CA: Choosing and using citation and bibliographic database software (BDS). Diabetes Educ. 2008, 34: 457-474. 10.1177/0145721708317875.CrossRefPubMed Hernandez DA, El-Masri MM, Hernandez CA: Choosing and using citation and bibliographic database software (BDS). Diabetes Educ. 2008, 34: 457-474. 10.1177/0145721708317875.CrossRefPubMed
21.
go back to reference Ovadia S: Managing citations with cost-free tools. Behav Soc Sci Librar. 2011, 30: 107-111. 10.1080/01639269.2011.565408.CrossRef Ovadia S: Managing citations with cost-free tools. Behav Soc Sci Librar. 2011, 30: 107-111. 10.1080/01639269.2011.565408.CrossRef
22.
go back to reference Wallace BC, Schmid CH, Lau J, Trikalinos TA: Meta-analyst: software for meta-analysis of binary, continuous and diagnostic data. BMC Med Res Methodol. 2009, 9: 80-10.1186/1471-2288-9-80.CrossRefPubMedPubMedCentral Wallace BC, Schmid CH, Lau J, Trikalinos TA: Meta-analyst: software for meta-analysis of binary, continuous and diagnostic data. BMC Med Res Methodol. 2009, 9: 80-10.1186/1471-2288-9-80.CrossRefPubMedPubMedCentral
Metadata
Title
Reference management software for systematic reviews and meta-analyses: an exploration of usage and usability
Authors
Diane L Lorenzetti
William A Ghali
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-141

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue