Skip to main content
Top
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Research

An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks

Authors: Yoojin Kwon, Susan E Powelson, Holly Wong, William A Ghali, John M Conly

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

The purpose of our study is to determine the value and efficacy of searching biomedical databases beyond MEDLINE for systematic reviews.

Methods

We analyzed the results from a systematic review conducted by the authors and others on ward closure as an infection control practice. Ovid MEDLINE including In-Process & Other Non-Indexed Citations, Ovid Embase, CINAHL Plus, LILACS, and IndMED were systematically searched for articles of any study type discussing ward closure, as were bibliographies of selected articles and recent infection control conference abstracts. Search results were tracked, recorded, and analyzed using a relative recall method. The sensitivity of searching in each database was calculated.

Results

Two thousand ninety-five unique citations were identified and screened for inclusion in the systematic review: 2,060 from database searching and 35 from hand searching and other sources. Ninety-seven citations were included in the final review. MEDLINE and Embase searches each retrieved 80 of the 97 articles included, only 4 articles from each database were unique. The CINAHL search retrieved 35 included articles, and 4 were unique. The IndMED and LILACS searches did not retrieve any included articles, although 75 of the included articles were indexed in LILACS. The true value of using regional databases, particularly LILACS, may lie with the ability to search in the language spoken in the region. Eight articles were found only through hand searching.

Conclusions

Identifying studies for a systematic review where the research is observational is complex. The value each individual study contributes to the review cannot be accurately measured. Consequently, we could not determine the value of results found from searching beyond MEDLINE, Embase, and CINAHL with accuracy. However, hand searching for serendipitous retrieval remains an important aspect due to indexing and keyword challenges inherent in this literature.
Literature
2.
go back to reference Dickersin K, Scherer R, Lefebvre C: Systematic reviews: identifying relevant studies for systematic reviews. BMJ. 1994, 309 (6964): 1286-1291. 10.1136/bmj.309.6964.1286.CrossRefPubMedPubMedCentral Dickersin K, Scherer R, Lefebvre C: Systematic reviews: identifying relevant studies for systematic reviews. BMJ. 1994, 309 (6964): 1286-1291. 10.1136/bmj.309.6964.1286.CrossRefPubMedPubMedCentral
3.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009, 151 (4): 264-269. 10.7326/0003-4819-151-4-200908180-00135.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009, 151 (4): 264-269. 10.7326/0003-4819-151-4-200908180-00135.CrossRefPubMed
4.
go back to reference Fraser C, Murray A, Burr J: Identifying observational studies of surgical interventions in MEDLINE and EMBASE. BMC Med Res Methodol. 2006, 6 (1): 41-10.1186/1471-2288-6-41.CrossRefPubMedPubMedCentral Fraser C, Murray A, Burr J: Identifying observational studies of surgical interventions in MEDLINE and EMBASE. BMC Med Res Methodol. 2006, 6 (1): 41-10.1186/1471-2288-6-41.CrossRefPubMedPubMedCentral
5.
go back to reference Dalziel K, Round A, Stein K, Garside R, Castelnuovo E, Payne L: Do the findings of case series studies vary significantly according to methodological characteristics?. Health Technol Assess. 2005, 9 (2): iii-iv. 1–146CrossRefPubMed Dalziel K, Round A, Stein K, Garside R, Castelnuovo E, Payne L: Do the findings of case series studies vary significantly according to methodological characteristics?. Health Technol Assess. 2005, 9 (2): iii-iv. 1–146CrossRefPubMed
6.
go back to reference Betrán AP, Say L, Gülmezoglu AM, Allen T, Hampson L: Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005, 5 (1): 6-10.1186/1471-2288-5-6.CrossRefPubMedPubMedCentral Betrán AP, Say L, Gülmezoglu AM, Allen T, Hampson L: Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005, 5 (1): 6-10.1186/1471-2288-5-6.CrossRefPubMedPubMedCentral
7.
go back to reference Stevinson C, Lawlor DA: Searching multiple databases for systematic reviews: added value or diminishing returns?. Complement Ther Med. 2004, 12 (4): 228-232. 10.1016/j.ctim.2004.09.003.CrossRefPubMed Stevinson C, Lawlor DA: Searching multiple databases for systematic reviews: added value or diminishing returns?. Complement Ther Med. 2004, 12 (4): 228-232. 10.1016/j.ctim.2004.09.003.CrossRefPubMed
8.
go back to reference Lemeshow AR, Blum RE, Berlin JA, Stoto MA, Colditz GA: Searching one or two databases was insufficient for meta-analysis of observational studies. J Clin Epidemiol. 2005, 58 (9): 867-873. 10.1016/j.jclinepi.2005.03.004.CrossRefPubMed Lemeshow AR, Blum RE, Berlin JA, Stoto MA, Colditz GA: Searching one or two databases was insufficient for meta-analysis of observational studies. J Clin Epidemiol. 2005, 58 (9): 867-873. 10.1016/j.jclinepi.2005.03.004.CrossRefPubMed
9.
go back to reference Wilkins T, Gillies RA, Davies K: EMBASE versus MEDLINE for family medicine searches: can MEDLINE searches find the forest or a tree?. Can Fam Physician. 2005, 51 (6): 848-849.PubMed Wilkins T, Gillies RA, Davies K: EMBASE versus MEDLINE for family medicine searches: can MEDLINE searches find the forest or a tree?. Can Fam Physician. 2005, 51 (6): 848-849.PubMed
10.
go back to reference Ogilvie D, Hamilton V, Egan M, Petticrew M: Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go?. J Epidemiol Community Health. 2005, 59 (9): 804-808. 10.1136/jech.2005.034181.CrossRefPubMedPubMedCentral Ogilvie D, Hamilton V, Egan M, Petticrew M: Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go?. J Epidemiol Community Health. 2005, 59 (9): 804-808. 10.1136/jech.2005.034181.CrossRefPubMedPubMedCentral
11.
go back to reference Crumley ET, Wiebe N, Cramer K, Klassen TP, Hartling L: Which resources should be used to identify RCT/CCTs for systematic reviews: a systematic review. BMC Med Res Methodol. 2005, 5: 24-10.1186/1471-2288-5-24.CrossRefPubMedPubMedCentral Crumley ET, Wiebe N, Cramer K, Klassen TP, Hartling L: Which resources should be used to identify RCT/CCTs for systematic reviews: a systematic review. BMC Med Res Methodol. 2005, 5: 24-10.1186/1471-2288-5-24.CrossRefPubMedPubMedCentral
12.
go back to reference Lawrence DW: What is lost when searching only one literature database for articles relevant to injury prevention and safety promotion?. Inj Prev. 2008, 14 (6): 401-404. 10.1136/ip.2008.019430.CrossRefPubMed Lawrence DW: What is lost when searching only one literature database for articles relevant to injury prevention and safety promotion?. Inj Prev. 2008, 14 (6): 401-404. 10.1136/ip.2008.019430.CrossRefPubMed
13.
go back to reference Whiting P, Westwood M, Burke M, Sterne J, Glanville J: Systematic reviews of test accuracy should search a range of databases to identify primary studies. J Clin Epidemiol. 2008, 61 (4): 357-364.CrossRefPubMed Whiting P, Westwood M, Burke M, Sterne J, Glanville J: Systematic reviews of test accuracy should search a range of databases to identify primary studies. J Clin Epidemiol. 2008, 61 (4): 357-364.CrossRefPubMed
14.
go back to reference Slobogean GP, Verma A, Giustini D, Slobogean BL, Mulpuri K: MEDLINE, EMBASE, and Cochrane index most primary studies but not abstracts included in orthopedic meta-analyses. J Clin Epidemiol. 2009, 62 (12): 1261-1267. 10.1016/j.jclinepi.2009.01.013.CrossRefPubMed Slobogean GP, Verma A, Giustini D, Slobogean BL, Mulpuri K: MEDLINE, EMBASE, and Cochrane index most primary studies but not abstracts included in orthopedic meta-analyses. J Clin Epidemiol. 2009, 62 (12): 1261-1267. 10.1016/j.jclinepi.2009.01.013.CrossRefPubMed
15.
go back to reference Fell DW, Burnham JF, Buchanan MJ, Horchen HA, Scherr JA: Mapping the core journals of the physical therapy literature. J Med Libr Assoc. 2011, 99 (3): 202-207. 10.3163/1536-5050.99.3.007.CrossRefPubMedPubMedCentral Fell DW, Burnham JF, Buchanan MJ, Horchen HA, Scherr JA: Mapping the core journals of the physical therapy literature. J Med Libr Assoc. 2011, 99 (3): 202-207. 10.3163/1536-5050.99.3.007.CrossRefPubMedPubMedCentral
16.
go back to reference Beyer FR, Wright K: Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. Health Inf Libr J. 2013, 30 (1): 49-58. 10.1111/hir.12009.CrossRef Beyer FR, Wright K: Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. Health Inf Libr J. 2013, 30 (1): 49-58. 10.1111/hir.12009.CrossRef
17.
go back to reference Lorenzetti DL, Topfer L-A, Dennett L, Clement F: Value of databases other than Medline for rapid health technology assessments. Int J Technol Assess Health Care. 2014, 30 (2): 173-178. 10.1017/S0266462314000166.CrossRefPubMed Lorenzetti DL, Topfer L-A, Dennett L, Clement F: Value of databases other than Medline for rapid health technology assessments. Int J Technol Assess Health Care. 2014, 30 (2): 173-178. 10.1017/S0266462314000166.CrossRefPubMed
18.
go back to reference Golder S, Mason A, Spilsbury K: Systematic searches for the effectiveness of respite care. J Med Libr Assoc. 2008, 96 (2): 147-10.3163/1536-5050.96.2.147.CrossRefPubMedPubMedCentral Golder S, Mason A, Spilsbury K: Systematic searches for the effectiveness of respite care. J Med Libr Assoc. 2008, 96 (2): 147-10.3163/1536-5050.96.2.147.CrossRefPubMedPubMedCentral
19.
go back to reference Golder S, Loke YK: The contribution of different information sources for adverse effects data. Int J Technol Assess Health Care. 2012, 28 (02): 133-137. 10.1017/S0266462312000128.CrossRefPubMed Golder S, Loke YK: The contribution of different information sources for adverse effects data. Int J Technol Assess Health Care. 2012, 28 (02): 133-137. 10.1017/S0266462312000128.CrossRefPubMed
20.
go back to reference Egger M, Juni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7 (1): 1-76.PubMed Egger M, Juni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7 (1): 1-76.PubMed
21.
go back to reference Sampson M: Should meta-analysts search Embase in addition to Medline?. J Clin Epidemiol. 2003, 56 (10): 943-955. 10.1016/S0895-4356(03)00110-0.CrossRefPubMed Sampson M: Should meta-analysts search Embase in addition to Medline?. J Clin Epidemiol. 2003, 56 (10): 943-955. 10.1016/S0895-4356(03)00110-0.CrossRefPubMed
23.
go back to reference Clark OAC, Castro AA: Searching the Literatura Latino Americana e do Caribe em Ciencias da Saude (LILACS) database improves systematic reviews. Int J Epidemiol. 2002, 31 (1): 112-114. 10.1093/ije/31.1.112.CrossRefPubMed Clark OAC, Castro AA: Searching the Literatura Latino Americana e do Caribe em Ciencias da Saude (LILACS) database improves systematic reviews. Int J Epidemiol. 2002, 31 (1): 112-114. 10.1093/ije/31.1.112.CrossRefPubMed
24.
go back to reference Greenhalgh T, Peacock R: Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005, 331 (7524): 1064-1065. 10.1136/bmj.38636.593461.68.CrossRefPubMedPubMedCentral Greenhalgh T, Peacock R: Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005, 331 (7524): 1064-1065. 10.1136/bmj.38636.593461.68.CrossRefPubMedPubMedCentral
Metadata
Title
An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks
Authors
Yoojin Kwon
Susan E Powelson
Holly Wong
William A Ghali
John M Conly
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-135

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue