Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2012

Open Access 01-12-2012 | Research article

Performance evaluation of unified medical language system®'s synonyms expansion to query PubMed

Authors: Nicolas Griffon, Wiem Chebil, Laetitia Rollin, Gaetan Kerdelhue, Benoit Thirion, Jean-François Gehanno, Stéfan Jacques Darmoni

Published in: BMC Medical Informatics and Decision Making | Issue 1/2012

Login to get access

Abstract

Background

PubMed is the main access to medical literature on the Internet. In order to enhance the performance of its information retrieval tools, primarily non-indexed citations, the authors propose a method: expanding users' queries using Unified Medical Language System' (UMLS) synonyms i.e. all the terms gathered under one unique Concept Unique Identifier.

Methods

This method was evaluated using queries constructed to emphasize the differences between this new method and the current PubMed automatic term mapping. Four experts assessed citation relevance.

Results

Using UMLS, we were able to retrieve new citations in 45.5% of queries, which implies a small increase in recall. The new strategy led to a heterogeneous 23.7% mean increase in non-indexed citation retrieved. Of these, 82% have been published less than 4 months earlier. The overall mean precision was 48.4% but differed according to the evaluators, ranging from 36.7% to 88.1% (Inter rater agreement was poor: kappa = 0.34).

Conclusions

This study highlights the need for specific search tools for each type of user and use-cases. The proposed strategy may be useful to retrieve recent scientific advancement.
Literature
1.
go back to reference Nelson SJ, Johnson WD, Humphreys BL: Relationship in medical subject headings. Relationships in the Organization of Knowledge. Edited by: Bean CA, Green R. 2001, New York: Kluwer Academic Publishers, 171-84.CrossRef Nelson SJ, Johnson WD, Humphreys BL: Relationship in medical subject headings. Relationships in the Organization of Knowledge. Edited by: Bean CA, Green R. 2001, New York: Kluwer Academic Publishers, 171-84.CrossRef
3.
go back to reference Herskovic JR, Tanaka LY, Hersh W, Bernstam EV: A day in the life of PubMed: Analysis of a typical day's query log. J Am Med Inform Assoc. 2007, 14 (2): 212-20. 10.1197/jamia.M2191.CrossRefPubMedPubMedCentral Herskovic JR, Tanaka LY, Hersh W, Bernstam EV: A day in the life of PubMed: Analysis of a typical day's query log. J Am Med Inform Assoc. 2007, 14 (2): 212-20. 10.1197/jamia.M2191.CrossRefPubMedPubMedCentral
4.
go back to reference Hoogendam A, Stalenhoef AF, Robbé PF, Overbeke AJ: Analysis of queries sent to PubMed at the point of care: observation of search behaviour in a medical teaching hospital. BMC Med Inform Decis Mak. 2008, 8: 42-10.1186/1472-6947-8-42.CrossRefPubMedPubMedCentral Hoogendam A, Stalenhoef AF, Robbé PF, Overbeke AJ: Analysis of queries sent to PubMed at the point of care: observation of search behaviour in a medical teaching hospital. BMC Med Inform Decis Mak. 2008, 8: 42-10.1186/1472-6947-8-42.CrossRefPubMedPubMedCentral
7.
go back to reference Thirion B, Robu I, Darmoni SJ: Optimization of the PubMed Automatic Term Mapping. Stud Health Technol Inform. 2009, 150: 238-42.PubMed Thirion B, Robu I, Darmoni SJ: Optimization of the PubMed Automatic Term Mapping. Stud Health Technol Inform. 2009, 150: 238-42.PubMed
8.
go back to reference Huang M, Névéol A, Lu Z: Recommending MeSH terms for annotating biomedical articles. J Am Med Inform Assoc. 2011, 18 (5): 660-7. 10.1136/amiajnl-2010-000055. Epub 2011 May 25CrossRefPubMedPubMedCentral Huang M, Névéol A, Lu Z: Recommending MeSH terms for annotating biomedical articles. J Am Med Inform Assoc. 2011, 18 (5): 660-7. 10.1136/amiajnl-2010-000055. Epub 2011 May 25CrossRefPubMedPubMedCentral
9.
go back to reference Grosjean J, Merabti T, Dahamna B, Kergourlay I, Thirion B, Soualmia LF, Darmoni SJ: Health multi-terminology portal: a semantic added-value for patient safety. Stud Health Technol Inform. 2011, 166: 129-38.PubMed Grosjean J, Merabti T, Dahamna B, Kergourlay I, Thirion B, Soualmia LF, Darmoni SJ: Health multi-terminology portal: a semantic added-value for patient safety. Stud Health Technol Inform. 2011, 166: 129-38.PubMed
10.
go back to reference Hersh W, Buckley C, Leone TJ, Hickam D: OHSUmed: An interactive retrieval evaluation and new large test collection for research. Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval: 1994. 1994, Springer-Verlag New York, 192-201. Hersh W, Buckley C, Leone TJ, Hickam D: OHSUmed: An interactive retrieval evaluation and new large test collection for research. Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval: 1994. 1994, Springer-Verlag New York, 192-201.
11.
go back to reference Chen B, Zaebst D, Seel L: A Macro to Calculate Kappa Statistics for Categorizations by Multiple Raters. Proceedings of the 30th SAS User Group International conference:. 2005, 155-30. April ; Philadelphia Chen B, Zaebst D, Seel L: A Macro to Calculate Kappa Statistics for Categorizations by Multiple Raters. Proceedings of the 30th SAS User Group International conference:. 2005, 155-30. April ; Philadelphia
12.
go back to reference Hersh W, Price S, Donohoe L: Assessing thesaurus based query expansion using the UMLS metathesaurus. Proceedings of AMIA symposium: November 4-8. 2000, 344-8. ; Los Angeles Hersh W, Price S, Donohoe L: Assessing thesaurus based query expansion using the UMLS metathesaurus. Proceedings of AMIA symposium: November 4-8. 2000, 344-8. ; Los Angeles
14.
go back to reference Funk ME, Reid CA: Indexing consistency in MEDLINE. Bulletin of the Medical Library Association. 1983, 2 (71): 176-83. Funk ME, Reid CA: Indexing consistency in MEDLINE. Bulletin of the Medical Library Association. 1983, 2 (71): 176-83.
15.
go back to reference Darmoni SJ, Pereira S, Névéol A, Massari P, Dahamna B, Letord C, Kedelhué G, Piot J, Derville A, Thirion B: French Infobutton: an academic and... business perspective. AMIA Symp. 2008, IOS Press, 920- Darmoni SJ, Pereira S, Névéol A, Massari P, Dahamna B, Letord C, Kedelhué G, Piot J, Derville A, Thirion B: French Infobutton: an academic and... business perspective. AMIA Symp. 2008, IOS Press, 920-
16.
go back to reference Islamaj Doğan R, Murray GC, Névéol A, Lu Z: Understanding PubMed user search behavior through log analysis. Database. 2009, bap018- Islamaj Doğan R, Murray GC, Névéol A, Lu Z: Understanding PubMed user search behavior through log analysis. Database. 2009, bap018-
Metadata
Title
Performance evaluation of unified medical language system®'s synonyms expansion to query PubMed
Authors
Nicolas Griffon
Wiem Chebil
Laetitia Rollin
Gaetan Kerdelhue
Benoit Thirion
Jean-François Gehanno
Stéfan Jacques Darmoni
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2012
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-12-12

Other articles of this Issue 1/2012

BMC Medical Informatics and Decision Making 1/2012 Go to the issue