Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Research article

Is the coverage of google scholar enough to be used alone for systematic reviews

Authors: Jean-François Gehanno, Laetitia Rollin, Stefan Darmoni

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

In searches for clinical trials and systematic reviews, it is said that Google Scholar (GS) should never be used in isolation, but in addition to PubMed, Cochrane, and other trusted sources of information. We therefore performed a study to assess the coverage of GS specifically for the studies included in systematic reviews and evaluate if GS was sensitive enough to be used alone for systematic reviews.

Methods

All the original studies included in 29 systematic reviews published in the Cochrane Database Syst Rev or in the JAMA in 2009 were gathered in a gold standard database. GS was searched for all these studies one by one to assess the percentage of studies which could have been identified by searching only GS.

Results

All the 738 original studies included in the gold standard database were retrieved in GS (100%).

Conclusion

The coverage of GS for the studies included in the systematic reviews is 100%. If the authors of the 29 systematic reviews had used only GS, no reference would have been missed. With some improvement in the research options, to increase its precision, GS could become the leading bibliographic database in medicine and could be used alone for systematic reviews.
Literature
2.
go back to reference Lindberg DA: Searching the medical literature. NEJM. 2006, 354: 2393-PubMed Lindberg DA: Searching the medical literature. NEJM. 2006, 354: 2393-PubMed
3.
go back to reference Wang Y, Howard P: Google Scholar Usage: An Academic Library's Experience. J Web Librarianship. 2012, 6 (2): 94-108. 10.1080/19322909.2012.672067.CrossRef Wang Y, Howard P: Google Scholar Usage: An Academic Library's Experience. J Web Librarianship. 2012, 6 (2): 94-108. 10.1080/19322909.2012.672067.CrossRef
4.
go back to reference Freeman MK, Lauderdale SA, Kendrach MG, Woolley TW: Google Scholar versus PubMed in locating primary literature to answer drug-related questions. Ann Pharmacother. 2009, 43: 478-484. 10.1345/aph.1L223.CrossRefPubMed Freeman MK, Lauderdale SA, Kendrach MG, Woolley TW: Google Scholar versus PubMed in locating primary literature to answer drug-related questions. Ann Pharmacother. 2009, 43: 478-484. 10.1345/aph.1L223.CrossRefPubMed
6.
go back to reference Wilkins T, Gillies RA, Davies K: EMBASE versus MEDLINE for family medicine searches: can MEDLINE searches find the forest or a tree?. Can Fam Physician. 2005, 51: 849-PubMedCentral Wilkins T, Gillies RA, Davies K: EMBASE versus MEDLINE for family medicine searches: can MEDLINE searches find the forest or a tree?. Can Fam Physician. 2005, 51: 849-PubMedCentral
7.
go back to reference Verbeek J, Salmi J, Pasternack I, Jauhiainen M, Laamanen I, Schaafsma F, Hulshof C, van Dijk F: A search strategy for occupational health intervention studies. Occup Environ Med. 2005, 62: 682-687. 10.1136/oem.2004.019117.CrossRefPubMedPubMedCentral Verbeek J, Salmi J, Pasternack I, Jauhiainen M, Laamanen I, Schaafsma F, Hulshof C, van Dijk F: A search strategy for occupational health intervention studies. Occup Environ Med. 2005, 62: 682-687. 10.1136/oem.2004.019117.CrossRefPubMedPubMedCentral
8.
go back to reference Minozzi S, Pistotti V, Forni M: Searching for rehabilitation articles on MEDLINE and EMBASE. An example with cross-over design. Arch Phys Med Rehabil. 2000, 81: 720-722.CrossRefPubMed Minozzi S, Pistotti V, Forni M: Searching for rehabilitation articles on MEDLINE and EMBASE. An example with cross-over design. Arch Phys Med Rehabil. 2000, 81: 720-722.CrossRefPubMed
9.
go back to reference McDonald S, Taylor L, Adams C: Searching the right database. A comparison of four databases for psychiatry journals. Health Libr Rev. 1999, 16: 151-156. 10.1046/j.1365-2532.1999.00222.x.CrossRefPubMed McDonald S, Taylor L, Adams C: Searching the right database. A comparison of four databases for psychiatry journals. Health Libr Rev. 1999, 16: 151-156. 10.1046/j.1365-2532.1999.00222.x.CrossRefPubMed
10.
go back to reference Watson RJ, Richardson PH: Identifying randomized controlled trials of cognitive therapy for depression: comparing the efficiency of Embase, Medline and PsycINFO bibliographic databases. Br J Med Psychol. 1999, 72: 535-542. 10.1348/000711299160220.CrossRefPubMed Watson RJ, Richardson PH: Identifying randomized controlled trials of cognitive therapy for depression: comparing the efficiency of Embase, Medline and PsycINFO bibliographic databases. Br J Med Psychol. 1999, 72: 535-542. 10.1348/000711299160220.CrossRefPubMed
11.
go back to reference Farriol M, Jordà-Olives M, Padró JB: Bibliographic information retrieval in the field of artificial nutrition. Clin Nutr. 1998, 17: 217-222. 10.1016/S0261-5614(98)80062-9.CrossRefPubMed Farriol M, Jordà-Olives M, Padró JB: Bibliographic information retrieval in the field of artificial nutrition. Clin Nutr. 1998, 17: 217-222. 10.1016/S0261-5614(98)80062-9.CrossRefPubMed
12.
go back to reference Gehanno JF, Paris C, Thirion B, Caillard JF: Assessment of bibliographic databases performance in information retrieval for occupational and environmental toxicology. Occup Environ Med. 1998, 55: 562-566. 10.1136/oem.55.8.562.CrossRefPubMedPubMedCentral Gehanno JF, Paris C, Thirion B, Caillard JF: Assessment of bibliographic databases performance in information retrieval for occupational and environmental toxicology. Occup Environ Med. 1998, 55: 562-566. 10.1136/oem.55.8.562.CrossRefPubMedPubMedCentral
14.
go back to reference Barillot MJ, Sarrut B, Doreau CG: Evaluation of drug interaction document citation in nine on-line bibliographic databases. Ann Pharmacother. 1997, 31: 45-49.PubMed Barillot MJ, Sarrut B, Doreau CG: Evaluation of drug interaction document citation in nine on-line bibliographic databases. Ann Pharmacother. 1997, 31: 45-49.PubMed
15.
go back to reference Brazier H, Begley CM: Selecting a database for literature searches in nursing: MEDLINE or CINAHL?. J Adv Nurs. 1996, 24: 868-875. 10.1046/j.1365-2648.1996.26426.x.CrossRefPubMed Brazier H, Begley CM: Selecting a database for literature searches in nursing: MEDLINE or CINAHL?. J Adv Nurs. 1996, 24: 868-875. 10.1046/j.1365-2648.1996.26426.x.CrossRefPubMed
16.
go back to reference Burnham J, Shearer B: Comparison of CINAHL, EMBASE, and MEDLINE databases for the nurse researcher. Med Ref Serv Q. 1993, 12: 45-57.CrossRefPubMed Burnham J, Shearer B: Comparison of CINAHL, EMBASE, and MEDLINE databases for the nurse researcher. Med Ref Serv Q. 1993, 12: 45-57.CrossRefPubMed
17.
go back to reference Gallagher KE, Hulbert LA, Sullivan CP: Full-text and bibliographic database searching in the health sciences: an exploratory study comparing CCML and MEDLINE. Med Ref Serv Q. 1990, 9: 17-25.CrossRefPubMed Gallagher KE, Hulbert LA, Sullivan CP: Full-text and bibliographic database searching in the health sciences: an exploratory study comparing CCML and MEDLINE. Med Ref Serv Q. 1990, 9: 17-25.CrossRefPubMed
18.
go back to reference Beckmann M, von Wehrden H: Where you search is what you get: literature mining – Google Scholar versus Web of Science using a data set from a literature search in vegetation science. J Veg Sci. 2012, 23 (6): 1197-1199. 10.1111/j.1654-1103.2012.01454.x.CrossRef Beckmann M, von Wehrden H: Where you search is what you get: literature mining – Google Scholar versus Web of Science using a data set from a literature search in vegetation science. J Veg Sci. 2012, 23 (6): 1197-1199. 10.1111/j.1654-1103.2012.01454.x.CrossRef
19.
go back to reference Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005, 330: 68-10.1136/bmj.38336.804167.47.CrossRefPubMedPubMedCentral Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005, 330: 68-10.1136/bmj.38336.804167.47.CrossRefPubMedPubMedCentral
20.
go back to reference Gehanno JF, Darmoni SJ, Caillard JF: Major inaccuracies in articles citing occupational or environmental medicine papers and their implications. J Med Libr Assoc. 2005, 93: 118-121.PubMedPubMedCentral Gehanno JF, Darmoni SJ, Caillard JF: Major inaccuracies in articles citing occupational or environmental medicine papers and their implications. J Med Libr Assoc. 2005, 93: 118-121.PubMedPubMedCentral
21.
go back to reference Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: MR000005-PubMed Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: MR000005-PubMed
22.
go back to reference Rollin L, Darmoni S, Caillard J, Gehanno J: Fate of abstracts presented at an International Commission on Occupational Health (ICOH) congress - followed by publication in peer-reviewed journals?. Scand J Work Environ Health. 2009, 35: 461-465. 10.5271/sjweh.1362.CrossRefPubMed Rollin L, Darmoni S, Caillard J, Gehanno J: Fate of abstracts presented at an International Commission on Occupational Health (ICOH) congress - followed by publication in peer-reviewed journals?. Scand J Work Environ Health. 2009, 35: 461-465. 10.5271/sjweh.1362.CrossRefPubMed
23.
go back to reference Türp JC, Schulte J, Antes G: Nearly half of dental randomized controlled trials published in German are not included in Medline. Eur J Oral Sci. 2002, 110: 405-411. 10.1034/j.1600-0722.2002.21343.x.CrossRefPubMed Türp JC, Schulte J, Antes G: Nearly half of dental randomized controlled trials published in German are not included in Medline. Eur J Oral Sci. 2002, 110: 405-411. 10.1034/j.1600-0722.2002.21343.x.CrossRefPubMed
24.
go back to reference Hopewell S, Clarke M, Lusher A, Lefebvre C, Westby M: A comparison of hand searching versus MEDLINE searching to identify reports of randomized controlled trials. Stat Med. 2002, 21: 1625-1634. 10.1002/sim.1191.CrossRefPubMed Hopewell S, Clarke M, Lusher A, Lefebvre C, Westby M: A comparison of hand searching versus MEDLINE searching to identify reports of randomized controlled trials. Stat Med. 2002, 21: 1625-1634. 10.1002/sim.1191.CrossRefPubMed
25.
go back to reference Aguillo IF: Is Google Scholar useful for bibliometrics? A webometric analysis. Scientometrics. 2012, 91: 343-351. 10.1007/s11192-011-0582-8.CrossRef Aguillo IF: Is Google Scholar useful for bibliometrics? A webometric analysis. Scientometrics. 2012, 91: 343-351. 10.1007/s11192-011-0582-8.CrossRef
28.
go back to reference Nourbakhsh E, Nugent R, Wang H, Cevik C, Nugent K: Medical literature searches: a comparison of PubMed and Google Scholar. Health Info Libr J. 2012, 29 (3): 214-222. 10.1111/j.1471-1842.2012.00992.x.CrossRefPubMed Nourbakhsh E, Nugent R, Wang H, Cevik C, Nugent K: Medical literature searches: a comparison of PubMed and Google Scholar. Health Info Libr J. 2012, 29 (3): 214-222. 10.1111/j.1471-1842.2012.00992.x.CrossRefPubMed
29.
go back to reference Anders ME, Evans DP: Comparison of PubMed and Google Scholar literature searches. Respir Care. 2012, 55: 578-583. Anders ME, Evans DP: Comparison of PubMed and Google Scholar literature searches. Respir Care. 2012, 55: 578-583.
30.
go back to reference Mastrangelo G, Fadda E, Rossi CR, Zamprogno E, Buja A, Cegolon L: Literature search on risk factors for sarcoma: PubMed and Google Scholar may be complementary sources. BMC Res Notes. 2010, 3: 131-10.1186/1756-0500-3-131.CrossRefPubMedPubMedCentral Mastrangelo G, Fadda E, Rossi CR, Zamprogno E, Buja A, Cegolon L: Literature search on risk factors for sarcoma: PubMed and Google Scholar may be complementary sources. BMC Res Notes. 2010, 3: 131-10.1186/1756-0500-3-131.CrossRefPubMedPubMedCentral
31.
go back to reference Hersh WR, Hickam DH: How well do physicians use electronic information retrieval systems? A framework for investigation and systematic review. JAMA. 1998, 280: 1347-1352. 10.1001/jama.280.15.1347.CrossRefPubMed Hersh WR, Hickam DH: How well do physicians use electronic information retrieval systems? A framework for investigation and systematic review. JAMA. 1998, 280: 1347-1352. 10.1001/jama.280.15.1347.CrossRefPubMed
32.
go back to reference Haynes RB, McKibbon KA, Walker CJ, Ryan N, Fitzgerald D, Ramsden MF: Online access to MEDLINE in clinical settings. A study of use and usefulness. Ann Intern Med. 1990, 112: 78-84.CrossRefPubMed Haynes RB, McKibbon KA, Walker CJ, Ryan N, Fitzgerald D, Ramsden MF: Online access to MEDLINE in clinical settings. A study of use and usefulness. Ann Intern Med. 1990, 112: 78-84.CrossRefPubMed
Metadata
Title
Is the coverage of google scholar enough to be used alone for systematic reviews
Authors
Jean-François Gehanno
Laetitia Rollin
Stefan Darmoni
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-7

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue