Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

An optimal search filter for retrieving systematic reviews and meta-analyses

Authors: Edwin Lee, Maureen Dobbins, Kara DeCorby, Lyndsey McRae, Daiva Tirilis, Heather Husson

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters.

Methods

This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter.

Results

Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened.

Conclusions

The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bero L, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.CrossRef Bero L, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.CrossRef
2.
go back to reference Chan KS, Morton SC, Shekelle PG: Systematic reviews for evidence-based management: How to find them and what to do with them. Am J Manag. 2004, 10: 806-812. Chan KS, Morton SC, Shekelle PG: Systematic reviews for evidence-based management: How to find them and what to do with them. Am J Manag. 2004, 10: 806-812.
3.
go back to reference Fineout-Overholt E, O'Mathuna DP, Kent B: How systematic reviews can foster evidence-based clinical decisions. World Views Evid Base Nurs. 2008, 5: 45-48. 10.1111/j.1741-6787.2008.00116.x.CrossRef Fineout-Overholt E, O'Mathuna DP, Kent B: How systematic reviews can foster evidence-based clinical decisions. World Views Evid Base Nurs. 2008, 5: 45-48. 10.1111/j.1741-6787.2008.00116.x.CrossRef
4.
go back to reference Grol R, Grimshaw J: Evidence-based implementation of evidence-based medicine. Jt Comm J Qual Improv. 1999, 25: 503-513.PubMed Grol R, Grimshaw J: Evidence-based implementation of evidence-based medicine. Jt Comm J Qual Improv. 1999, 25: 503-513.PubMed
5.
go back to reference Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Pol. 2005, 10: 35-48. 10.1258/1355819054308549.CrossRef Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Pol. 2005, 10: 35-48. 10.1258/1355819054308549.CrossRef
6.
go back to reference Dobbins M, Cockerill R, Barnsley J, Ciliska D: Factors of the innovation, organization, environment, and individual that predict the influence five systematic reviews had on public health decisions. Int J Technol Assess Health Care. 2001, 17: 467-478.CrossRefPubMed Dobbins M, Cockerill R, Barnsley J, Ciliska D: Factors of the innovation, organization, environment, and individual that predict the influence five systematic reviews had on public health decisions. Int J Technol Assess Health Care. 2001, 17: 467-478.CrossRefPubMed
7.
go back to reference Dobbins M, Thomas H, O'Brien MA, Duggan M: The Use of Systematic Reviews in the Development of New Provincial Public Health Policies in Ontario. Int J Technol Assess Health Care. 2004, 20: 399-404.CrossRefPubMed Dobbins M, Thomas H, O'Brien MA, Duggan M: The Use of Systematic Reviews in the Development of New Provincial Public Health Policies in Ontario. Int J Technol Assess Health Care. 2004, 20: 399-404.CrossRefPubMed
8.
go back to reference LaPelle NR, Luckmann R, Hatheway , Simpson E, Martin ER: Identifying strategies to improve access to credible and relevant information for public health professionals: a qualitative study. BMC Publ Health. 2006, 6: 89-101. 10.1186/1471-2458-6-89.CrossRef LaPelle NR, Luckmann R, Hatheway , Simpson E, Martin ER: Identifying strategies to improve access to credible and relevant information for public health professionals: a qualitative study. BMC Publ Health. 2006, 6: 89-101. 10.1186/1471-2458-6-89.CrossRef
9.
go back to reference Sweet M, Moynihan R: Improving population health: The uses of systematic reviews. 2007 Sweet M, Moynihan R: Improving population health: The uses of systematic reviews. 2007
11.
go back to reference Ciliska D, DiCenso A, Guyatt G, St. Louis MO: Summarizing the evidence through systematic reviews. Evidence-based nursing: a guide to clinical practice. Edited by: DiCenso A, Guyatt G, Ciliska D. 2005, Elsevier Mosby, 137-153. Ciliska D, DiCenso A, Guyatt G, St. Louis MO: Summarizing the evidence through systematic reviews. Evidence-based nursing: a guide to clinical practice. Edited by: DiCenso A, Guyatt G, Ciliska D. 2005, Elsevier Mosby, 137-153.
12.
go back to reference Dobbins M, Jack S, Thomas H, Kothari A: Public health decision-makers' informational needs and preferences for receiving research evidence. World Views Evid Base Nurs. 2007, 4: 156-163. 10.1111/j.1741-6787.2007.00089.x.CrossRef Dobbins M, Jack S, Thomas H, Kothari A: Public health decision-makers' informational needs and preferences for receiving research evidence. World Views Evid Base Nurs. 2007, 4: 156-163. 10.1111/j.1741-6787.2007.00089.x.CrossRef
13.
go back to reference Funk SG, Tornquist EM, Champagne MT: Barriers and facilitators of research utilization: an integrative review. Nurs Clin North Am. 1995, 30: 395-407.PubMed Funk SG, Tornquist EM, Champagne MT: Barriers and facilitators of research utilization: an integrative review. Nurs Clin North Am. 1995, 30: 395-407.PubMed
14.
go back to reference Hannes K, Vandersmissen J, De Blaeser L, Peeters G, Goedhuys J, Aertgeerts B: Barriers to evidence-based nursing: a focus group study. J Adv Nurs. 2007, 60: 162-171. 10.1111/j.1365-2648.2007.04389.x.CrossRefPubMed Hannes K, Vandersmissen J, De Blaeser L, Peeters G, Goedhuys J, Aertgeerts B: Barriers to evidence-based nursing: a focus group study. J Adv Nurs. 2007, 60: 162-171. 10.1111/j.1365-2648.2007.04389.x.CrossRefPubMed
17.
go back to reference Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585.CrossRefPubMedPubMedCentral Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585.CrossRefPubMedPubMedCentral
19.
go back to reference Howes F, Doyle J, Jackson N, Waters E: Evidence-based public health: The importance of finding 'difficult to locate' public health and health promotion intervention studies for systematic reviews. J Publ Health (Oxf). 2004, 26: 101-104. 10.1093/pubmed/fdh119.CrossRef Howes F, Doyle J, Jackson N, Waters E: Evidence-based public health: The importance of finding 'difficult to locate' public health and health promotion intervention studies for systematic reviews. J Publ Health (Oxf). 2004, 26: 101-104. 10.1093/pubmed/fdh119.CrossRef
20.
go back to reference Wilczynski NL, Haynes RB, Team H: Optimal search strategies for identifying mental health content in MEDLINE: An analytic survey. Ann Gen Psychiatr. 2006, 23: 4-8.CrossRef Wilczynski NL, Haynes RB, Team H: Optimal search strategies for identifying mental health content in MEDLINE: An analytic survey. Ann Gen Psychiatr. 2006, 23: 4-8.CrossRef
21.
go back to reference Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral
23.
go back to reference White VJ, Glanville JM, Lefebvre C, Sheldon TA: A statistical approach to designing search filters to find systematic reviews: Objectivity enhances accuracy. J Inform Sci. 2001, 27: 357-370. 10.1177/016555150102700601.CrossRef White VJ, Glanville JM, Lefebvre C, Sheldon TA: A statistical approach to designing search filters to find systematic reviews: Objectivity enhances accuracy. J Inform Sci. 2001, 27: 357-370. 10.1177/016555150102700601.CrossRef
24.
go back to reference Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: Analytical survey. BMJ. 2005, 330: 68-73. 10.1136/bmj.38336.804167.47.CrossRefPubMedPubMedCentral Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: Analytical survey. BMJ. 2005, 330: 68-73. 10.1136/bmj.38336.804167.47.CrossRefPubMedPubMedCentral
25.
go back to reference Shojania KG, Bero LA: Taking advantage of the explosion of systematic reviews: An efficient MEDLINE search strategy. Eff Clin Pract. 2001, 4: 157-162.PubMed Shojania KG, Bero LA: Taking advantage of the explosion of systematic reviews: An efficient MEDLINE search strategy. Eff Clin Pract. 2001, 4: 157-162.PubMed
26.
go back to reference Wilczynski NL, Haynes RB: EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. J Clin Epidemiol. 2007, 60: 29-33. 10.1016/j.jclinepi.2006.04.001.CrossRefPubMed Wilczynski NL, Haynes RB: EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. J Clin Epidemiol. 2007, 60: 29-33. 10.1016/j.jclinepi.2006.04.001.CrossRefPubMed
27.
go back to reference Wong SS, Wilczynski NL, Haynes RB: Optimal CINAHL search strategies for identifying therapy studies and review articles. J Nurs Scholarship. 2006, 38: 194-199. 10.1111/j.1547-5069.2006.00100.x.CrossRef Wong SS, Wilczynski NL, Haynes RB: Optimal CINAHL search strategies for identifying therapy studies and review articles. J Nurs Scholarship. 2006, 38: 194-199. 10.1111/j.1547-5069.2006.00100.x.CrossRef
28.
go back to reference Jenkins M: Evaluation of methodological search filters: A review. Health Inform Libr J. 2004, 21: 148-163. 10.1111/j.1471-1842.2004.00511.x.CrossRef Jenkins M: Evaluation of methodological search filters: A review. Health Inform Libr J. 2004, 21: 148-163. 10.1111/j.1471-1842.2004.00511.x.CrossRef
29.
go back to reference Hunt DL, McKibbon KA: Locating and appraising systematic reviews. Ann Intern Med. 1997, 126: 532-538.CrossRefPubMed Hunt DL, McKibbon KA: Locating and appraising systematic reviews. Ann Intern Med. 1997, 126: 532-538.CrossRefPubMed
33.
go back to reference McKibbon AK, Marks S: Searching for the best evidence. Part 2: searching CINAHL and Medline. Evid Based Nurs. 1998, 1: 105-107. 10.1136/ebn.1.4.105.CrossRef McKibbon AK, Marks S: Searching for the best evidence. Part 2: searching CINAHL and Medline. Evid Based Nurs. 1998, 1: 105-107. 10.1136/ebn.1.4.105.CrossRef
34.
go back to reference Fraser C, Murray A, Burr J: BMC Medical Research Methodology. Identifying observational studies of surgical interventions in MEDLINE and EMBASE, 6: Fraser C, Murray A, Burr J: BMC Medical Research Methodology. Identifying observational studies of surgical interventions in MEDLINE and EMBASE, 6:
35.
go back to reference Jenkins M, Johnson F: Awareness, use and opinions of methodological search filters used for the retrieval of evidence-based medical literature-a questionnaire survey. Health Inform Libr J. 2004, 21: 33-43.CrossRef Jenkins M, Johnson F: Awareness, use and opinions of methodological search filters used for the retrieval of evidence-based medical literature-a questionnaire survey. Health Inform Libr J. 2004, 21: 33-43.CrossRef
36.
go back to reference Wilczynski NL, Haynes RB: The Hedges Team: EMBASE search strategies for identifying methodologically sound diagnostic studies for use by clinicians and researchers. BMC Med. 2005, 3: 7-10.1186/1741-7015-3-7.CrossRefPubMedPubMedCentral Wilczynski NL, Haynes RB: The Hedges Team: EMBASE search strategies for identifying methodologically sound diagnostic studies for use by clinicians and researchers. BMC Med. 2005, 3: 7-10.1186/1741-7015-3-7.CrossRefPubMedPubMedCentral
37.
go back to reference Wong SSL, Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE. Stud Health Technol Inform. 2004, 107: 311-316.PubMed Wong SSL, Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE. Stud Health Technol Inform. 2004, 107: 311-316.PubMed
38.
go back to reference Ciliska D, Dobbins M, Thomas H: Using systematic reviews in health services. Reviewing research evidence for nursing practice: Systematic reviews. Edited by: Webb C, Roe B, Malden MA. 2007, Wiley-Blackwell, USA, 245-253. Ciliska D, Dobbins M, Thomas H: Using systematic reviews in health services. Reviewing research evidence for nursing practice: Systematic reviews. Edited by: Webb C, Roe B, Malden MA. 2007, Wiley-Blackwell, USA, 245-253.
39.
go back to reference McKibbon KA, Wilczynski NL, Haynes RB: Retrieving randomized controlled trials from MEDLINE: A comparison of 38 published search filters. Health Inform Libr J. 2008, 26: 187-202.CrossRef McKibbon KA, Wilczynski NL, Haynes RB: Retrieving randomized controlled trials from MEDLINE: A comparison of 38 published search filters. Health Inform Libr J. 2008, 26: 187-202.CrossRef
40.
go back to reference McAuley L, Pham B, Tugwell P, Moher D: Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. Lancet. 2000, 356: 1228-1231. 10.1016/S0140-6736(00)02786-0.CrossRefPubMed McAuley L, Pham B, Tugwell P, Moher D: Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. Lancet. 2000, 356: 1228-1231. 10.1016/S0140-6736(00)02786-0.CrossRefPubMed
41.
go back to reference Bero L, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.CrossRef Bero L, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. Br Med J. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.CrossRef
42.
go back to reference Beahler CC, Sundheim JJ, Trapp NI: Information retrieval in systematic reviews: Challenges in the public health arena. Am J Prev Med. 2000, 18: 6-10.CrossRefPubMed Beahler CC, Sundheim JJ, Trapp NI: Information retrieval in systematic reviews: Challenges in the public health arena. Am J Prev Med. 2000, 18: 6-10.CrossRefPubMed
43.
go back to reference Boynton J, Glanville J, McDaid D, Lefebvre C: Identifying systematic reviews in MEDLINE: Developing an objective approach to search strategy design. J Inform Sci. 1998, 24: 137-154.CrossRef Boynton J, Glanville J, McDaid D, Lefebvre C: Identifying systematic reviews in MEDLINE: Developing an objective approach to search strategy design. J Inform Sci. 1998, 24: 137-154.CrossRef
Metadata
Title
An optimal search filter for retrieving systematic reviews and meta-analyses
Authors
Edwin Lee
Maureen Dobbins
Kara DeCorby
Lyndsey McRae
Daiva Tirilis
Heather Husson
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-51

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue