Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2010

Open Access 01-12-2010 | Research article

Combining classifiers for robust PICO element detection

Authors: Florian Boudin, Jian-Yun Nie, Joan C Bartlett, Roland Grad, Pierre Pluye, Martin Dawes

Published in: BMC Medical Informatics and Decision Making | Issue 1/2010

Login to get access

Abstract

Background

Formulating a clinical information need in terms of the four atomic parts which are Population/Problem, Intervention, Comparison and Outcome (known as PICO elements) facilitates searching for a precise answer within a large medical citation database. However, using PICO defined items in the information retrieval process requires a search engine to be able to detect and index PICO elements in the collection in order for the system to retrieve relevant documents.

Methods

In this study, we tested multiple supervised classification algorithms and their combinations for detecting PICO elements within medical abstracts. Using the structural descriptors that are embedded in some medical abstracts, we have automatically gathered large training/testing data sets for each PICO element.

Results

Combining multiple classifiers using a weighted linear combination of their prediction scores achieves promising results with an f-measure score of 86.3% for P, 67% for I and 56.6% for O.

Conclusions

Our experiments on the identification of PICO elements showed that the task is very challenging. Nevertheless, the performance achieved by our identification method is competitive with previously published results and shows that this task can be achieved with a high accuracy for the P element but lower ones for I and O elements.
Literature
1.
go back to reference Schardt C, Adams M, Owens T, Keitz S, Fontelo P: Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Medical Informatics and Decision Making. 2007, 7 (1): 16-10.1186/1472-6947-7-16.CrossRefPubMedPubMedCentral Schardt C, Adams M, Owens T, Keitz S, Fontelo P: Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Medical Informatics and Decision Making. 2007, 7 (1): 16-10.1186/1472-6947-7-16.CrossRefPubMedPubMedCentral
2.
go back to reference Richardson WS, Wilson MC, Nishikawa J, Hayward RS: The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995, 123 (3): 12-3. Richardson WS, Wilson MC, Nishikawa J, Hayward RS: The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995, 123 (3): 12-3.
3.
go back to reference Dawes M, Pluye P, Shea L, Grad R, Greenberg A, Nie JY: The identification of clinically important elements within medical journal abstracts: Patient Population Problem, Exposure Intervention, Comparison, Outcome, Duration and Results (PECODR). Informatics in Primary Care. 2007, 15: 9-16.PubMed Dawes M, Pluye P, Shea L, Grad R, Greenberg A, Nie JY: The identification of clinically important elements within medical journal abstracts: Patient Population Problem, Exposure Intervention, Comparison, Outcome, Duration and Results (PECODR). Informatics in Primary Care. 2007, 15: 9-16.PubMed
4.
go back to reference Demner-Fushman D, Lin J: Answer extraction, semantic clustering, and extractive summarization for clinical question answering. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL 2006), Sydney, Australia. 2006, 841-848. Demner-Fushman D, Lin J: Answer extraction, semantic clustering, and extractive summarization for clinical question answering. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL 2006), Sydney, Australia. 2006, 841-848.
5.
go back to reference McKnight L, Srinivasan P: Categorization of sentence types in medical abstracts. Annual Symposium of the American Medical Informatics Association (AMIA), AMIA. 2003, 440-444. McKnight L, Srinivasan P: Categorization of sentence types in medical abstracts. Annual Symposium of the American Medical Informatics Association (AMIA), AMIA. 2003, 440-444.
6.
go back to reference Demner-Fushman D, Lin J: Answering clinical questions with knowledge-based and statistical techniques. Computational Linguistics. 2007, 33 (1): 63-103. 10.1162/coli.2007.33.1.63.CrossRef Demner-Fushman D, Lin J: Answering clinical questions with knowledge-based and statistical techniques. Computational Linguistics. 2007, 33 (1): 63-103. 10.1162/coli.2007.33.1.63.CrossRef
7.
go back to reference Hansen MJ, Rasmussen NO, Chung G: A method of extracting the number of trial participants from abstracts describing randomized controlled trials. Journal of Telemedicine and Telecare. 2008, 14 (7): 354-358. 10.1258/jtt.2008.007007.CrossRefPubMed Hansen MJ, Rasmussen NO, Chung G: A method of extracting the number of trial participants from abstracts describing randomized controlled trials. Journal of Telemedicine and Telecare. 2008, 14 (7): 354-358. 10.1258/jtt.2008.007007.CrossRefPubMed
8.
go back to reference Chung G: Sentence retrieval for abstracts of randomized controlled trials. BMC Medical Informatics and Decision Making. 2009, 9 (1): 10-10.1186/1472-6947-9-10.CrossRefPubMedPubMedCentral Chung G: Sentence retrieval for abstracts of randomized controlled trials. BMC Medical Informatics and Decision Making. 2009, 9 (1): 10-10.1186/1472-6947-9-10.CrossRefPubMedPubMedCentral
9.
go back to reference Aronson A: Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Annual Symposium of the American Medical Informatics Association (AMIA), AMIA. 2001, 17-21. Aronson A: Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Annual Symposium of the American Medical Informatics Association (AMIA), AMIA. 2001, 17-21.
10.
go back to reference Rindflesch T, Fiszman M: The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text. Journal of Biomedical Informatics. 2003, 36 (6): 462-477. 10.1016/j.jbi.2003.11.003.CrossRefPubMed Rindflesch T, Fiszman M: The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text. Journal of Biomedical Informatics. 2003, 36 (6): 462-477. 10.1016/j.jbi.2003.11.003.CrossRefPubMed
11.
go back to reference Hripcsak G, Rothschild AS: Agreement, the F-Measure, and Reliability in Information Retrieval. J Am Med Inform Assoc. 2005, 12 (3): 296-298. 10.1197/jamia.M1733.CrossRefPubMedPubMedCentral Hripcsak G, Rothschild AS: Agreement, the F-Measure, and Reliability in Information Retrieval. J Am Med Inform Assoc. 2005, 12 (3): 296-298. 10.1197/jamia.M1733.CrossRefPubMedPubMedCentral
Metadata
Title
Combining classifiers for robust PICO element detection
Authors
Florian Boudin
Jian-Yun Nie
Joan C Bartlett
Roland Grad
Pierre Pluye
Martin Dawes
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2010
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-10-29

Other articles of this Issue 1/2010

BMC Medical Informatics and Decision Making 1/2010 Go to the issue