Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Research article

Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study

Authors: Käthe Goossen, Simone Hess, Carole Lunny, Dawid Pieper

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

When conducting an Overviews of Reviews on health-related topics, it is unclear which combination of bibliographic databases authors should use for searching for SRs. Our goal was to determine which databases included the most systematic reviews and identify an optimal database combination for searching systematic reviews.

Methods

A set of 86 Overviews of Reviews with 1219 included systematic reviews was extracted from a previous study. Inclusion of the systematic reviews was assessed in MEDLINE, CINAHL, Embase, Epistemonikos, PsycINFO, and TRIP. The mean inclusion rate (% of included systematic reviews) and corresponding 95% confidence interval were calculated for each database individually, as well as for combinations of MEDLINE with each other database and reference checking.

Results

Inclusion of systematic reviews was higher in MEDLINE than in any other single database (mean inclusion rate 89.7%; 95% confidence interval [89.0–90.3%]). Combined with reference checking, this value increased to 93.7% [93.2–94.2%]. The best combination of two databases plus reference checking consisted of MEDLINE and Epistemonikos (99.2% [99.0–99.3%]). Stratification by Health Technology Assessment reports (97.7% [96.5–98.9%]) vs. Cochrane Overviews (100.0%) vs. non-Cochrane Overviews (99.3% [99.1–99.4%]) showed that inclusion was only slightly lower for Health Technology Assessment reports. However, MEDLINE, Epistemonikos, and reference checking remained the best combination. Among the 10/1219 systematic reviews not identified by this combination, five were published as websites rather than journals, two were included in CINAHL and Embase, and one was included in the database ERIC.

Conclusions

MEDLINE and Epistemonikos, complemented by reference checking of included studies, is the best database combination to identify systematic reviews on health-related topics.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pollock M, Fernandes RM, Becker LA, Pieper D, Hartling L. Chapter V: Overviews of Reviews. In: JPT H, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated March 2020): Cochrane; 2020. Available from www.training.cochrane.org/handbook. Pollock M, Fernandes RM, Becker LA, Pieper D, Hartling L. Chapter V: Overviews of Reviews. In: JPT H, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated March 2020): Cochrane; 2020. Available from www.​training.​cochrane.​org/​handbook.
44.
go back to reference Gorenoi V, Schönermark MP, Hagen A. Perkutane Koronarinterventionen zusätzlich zur optimalen medikamentösen Therapie bei stabiler Angina Pectoris Schriftenreihe Health Technology Assessment; 2011. p. Bd. 115. https://doi.org/10.3205/hta000098L. Gorenoi V, Schönermark MP, Hagen A. Perkutane Koronarinterventionen zusätzlich zur optimalen medikamentösen Therapie bei stabiler Angina Pectoris Schriftenreihe Health Technology Assessment; 2011. p. Bd. 115. https://​doi.​org/​10.​3205/​hta000098L.
47.
go back to reference Ernst E, Lee M. Ayurvedic medicine: an overview of systematic reviews. Perfusion. 2010;23:132–40. Ernst E, Lee M. Ayurvedic medicine: an overview of systematic reviews. Perfusion. 2010;23:132–40.
55.
go back to reference Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011;(7):Cd009255. https://doi.org/10.1002/14651858.cd009255. Epub 2011/07/08. PubMed PMID: 21735443; PubMed Central PMCID: PMCPmc4204491. Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011;(7):Cd009255. https://​doi.​org/​10.​1002/​14651858.​cd009255. Epub 2011/07/08. PubMed PMID: 21735443; PubMed Central PMCID: PMCPmc4204491.
67.
69.
go back to reference Keus F, Gooszen HG, van Laarhoven CJ. Open, small-incision, or laparoscopic cholecystectomy for patients with symptomatic cholecystolithiasis. An overview of Cochrane Hepato-Biliary Group reviews. Cochrane Database Syst Rev. 2010;(1):Cd008318. https://doi.org/10.1002/14651858.cd008318. Epub 2010/01/22. PubMed PMID: 20091665. Keus F, Gooszen HG, van Laarhoven CJ. Open, small-incision, or laparoscopic cholecystectomy for patients with symptomatic cholecystolithiasis. An overview of Cochrane Hepato-Biliary Group reviews. Cochrane Database Syst Rev. 2010;(1):Cd008318. https://​doi.​org/​10.​1002/​14651858.​cd008318. Epub 2010/01/22. PubMed PMID: 20091665.
72.
82.
go back to reference Melnik T, Soares BG, Puga ME, Atallah AN. Efficacy and safety of atypical antipsychotic drugs (quetiapine, risperidone, aripiprazole and paliperidone) compared with placebo or typical antipsychotic drugs for treating refractory schizophrenia: overview of systematic reviews. Sao Paulo Med J. 2010;128(3):141–66. https://doi.org/10.1590/S1516-31802010000300007. Epub 2010/10/22. PubMed PMID: 20963366.PubMedCrossRef Melnik T, Soares BG, Puga ME, Atallah AN. Efficacy and safety of atypical antipsychotic drugs (quetiapine, risperidone, aripiprazole and paliperidone) compared with placebo or typical antipsychotic drugs for treating refractory schizophrenia: overview of systematic reviews. Sao Paulo Med J. 2010;128(3):141–66. https://​doi.​org/​10.​1590/​S1516-3180201000030000​7. Epub 2010/10/22. PubMed PMID: 20963366.PubMedCrossRef
85.
go back to reference Moe RH, Kjeken I, Uhlig T, Hagen KB. There is inadequate evidence to determine the effectiveness of nonpharmacological and nonsurgical interventions for hand osteoarthritis: an overview of high-quality systematic reviews. Phys Ther. 2009;89(12):1363–70. https://doi.org/10.2522/ptj.20080398. Epub 2009/10/24. PubMed PMID: 19850713.PubMedCrossRef Moe RH, Kjeken I, Uhlig T, Hagen KB. There is inadequate evidence to determine the effectiveness of nonpharmacological and nonsurgical interventions for hand osteoarthritis: an overview of high-quality systematic reviews. Phys Ther. 2009;89(12):1363–70. https://​doi.​org/​10.​2522/​ptj.​20080398. Epub 2009/10/24. PubMed PMID: 19850713.PubMedCrossRef
92.
go back to reference Palmateer N, Kimber J, Hickman M, Hutchinson S, Rhodes T, Goldberg D. Evidence for the effectiveness of sterile injecting equipment provision in preventing hepatitis C and human immunodeficiency virus transmission among injecting drug users: a review of reviews. Addiction (Abingdon, England). 2010;105(5):844–59 https://doi.org/10.1111/j.1360-0443.2009.02888.x Epub 2010/03/12. PubMed PMID: 20219055.CrossRef Palmateer N, Kimber J, Hickman M, Hutchinson S, Rhodes T, Goldberg D. Evidence for the effectiveness of sterile injecting equipment provision in preventing hepatitis C and human immunodeficiency virus transmission among injecting drug users: a review of reviews. Addiction (Abingdon, England). 2010;105(5):844–59 https://​doi.​org/​10.​1111/​j.​1360-0443.​2009.​02888.​x Epub 2010/03/12. PubMed PMID: 20219055.CrossRef
95.
go back to reference Posadzki P, Ernst E. Systematic reviews of spinal manipulations for headaches: an attempt to clear up the confusion. Headache. 2011;51(9):1419–25 https://doi.org/10.1111/j.1526-4610.2011.01888.x Epub 2011/04/02. PubMed PMID: 21453329.PubMedCrossRef Posadzki P, Ernst E. Systematic reviews of spinal manipulations for headaches: an attempt to clear up the confusion. Headache. 2011;51(9):1419–25 https://​doi.​org/​10.​1111/​j.​1526-4610.​2011.​01888.​x Epub 2011/04/02. PubMed PMID: 21453329.PubMedCrossRef
96.
99.
go back to reference Salvo F, Fourrier-Reglat A, Bazin F, Robinson P, Riera-Guardia N, Haag M, et al. Cardiovascular and gastrointestinal safety of NSAIDs: a systematic review of meta-analyses of randomized clinical trials. Clin Pharmacol Ther. 2011;89(6):855–66. https://doi.org/10.1038/clpt.2011.45. Epub 2011/04/08. PubMed PMID: 21471964.PubMedCrossRef Salvo F, Fourrier-Reglat A, Bazin F, Robinson P, Riera-Guardia N, Haag M, et al. Cardiovascular and gastrointestinal safety of NSAIDs: a systematic review of meta-analyses of randomized clinical trials. Clin Pharmacol Ther. 2011;89(6):855–66. https://​doi.​org/​10.​1038/​clpt.​2011.​45. Epub 2011/04/08. PubMed PMID: 21471964.PubMedCrossRef
111.
go back to reference van Achterberg T, Huisman-de Waal GG, Ketelaar NA, Oostendorp RA, Jacobs JE, Wollersheim HC. How to promote healthy behaviours in patients? An overview of evidence for behaviour change techniques. Health Promot Int. 2011;26(2):148–62. https://doi.org/10.1093/heapro/daq050. Epub 2010/08/27. PubMed PMID: 20739325; PubMed Central PMCID: PMCPMC3090154.PubMedCrossRef van Achterberg T, Huisman-de Waal GG, Ketelaar NA, Oostendorp RA, Jacobs JE, Wollersheim HC. How to promote healthy behaviours in patients? An overview of evidence for behaviour change techniques. Health Promot Int. 2011;26(2):148–62. https://​doi.​org/​10.​1093/​heapro/​daq050. Epub 2010/08/27. PubMed PMID: 20739325; PubMed Central PMCID: PMCPMC3090154.PubMedCrossRef
116.
go back to reference Brunton G, Harden A, Rees R, Kavanagh J, Oliver S, Oakley A. Promoting physical activity amongst children outside of physical education classes: a systematic review integrating intervention and qualitative studies. London: EPPI Centre; 2003. Brunton G, Harden A, Rees R, Kavanagh J, Oliver S, Oakley A. Promoting physical activity amongst children outside of physical education classes: a systematic review integrating intervention and qualitative studies. London: EPPI Centre; 2003.
117.
go back to reference Büssing A, Schnepp W, Ostermann T, Neugebauer E. Impact of yoga on chronic pain – a review. Eur J Integr Med. 2009;1:236–7.CrossRef Büssing A, Schnepp W, Ostermann T, Neugebauer E. Impact of yoga on chronic pain – a review. Eur J Integr Med. 2009;1:236–7.CrossRef
120.
go back to reference Erny-Albrecht K, Valentine WJ, Christensen J, Vestenbaek U, Palmer AJ. Sublingual immunotherapy in allergic rhinitis and asthma: a review of recent clinical evidence. J Appl Res. 2007;7(1):17–31. Erny-Albrecht K, Valentine WJ, Christensen J, Vestenbaek U, Palmer AJ. Sublingual immunotherapy in allergic rhinitis and asthma: a review of recent clinical evidence. J Appl Res. 2007;7(1):17–31.
126.
128.
go back to reference Lunny C, Brennan SE, McDonald S, McKenzie JE. Toward a comprehensive evidence map of overview of systematic review methods: paper 2-risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence. Syst Rev. 2018;7(1):159. https://doi.org/10.1186/s13643-018-0784-8. Epub 2018/10/14. PubMed PMID: 30314530; PubMed Central PMCID: PMCPMC6186052.PubMedPubMedCentralCrossRef Lunny C, Brennan SE, McDonald S, McKenzie JE. Toward a comprehensive evidence map of overview of systematic review methods: paper 2-risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence. Syst Rev. 2018;7(1):159. https://​doi.​org/​10.​1186/​s13643-018-0784-8. Epub 2018/10/14. PubMed PMID: 30314530; PubMed Central PMCID: PMCPMC6186052.PubMedPubMedCentralCrossRef
131.
go back to reference National Library of Medicine: Search Strategy Used to Create the PubMed Systematic Reviews Filter. www.nlm.nih.gov/bsd/pubmed_subsets/sysreviews_strategy.html. Accessed 20 Feb 2020. National Library of Medicine: Search Strategy Used to Create the PubMed Systematic Reviews Filter. www.nlm.nih.gov/bsd/pubmed_subsets/sysreviews_strategy.html. Accessed 20 Feb 2020.
132.
Metadata
Title
Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study
Authors
Käthe Goossen
Simone Hess
Carole Lunny
Dawid Pieper
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-00983-3

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue