Top

International Journal of Computer Assisted Radiology and Surgery

Published in:

01-03-2017 | Original Article

A new method for the automatic retrieval of medical cases based on the RadLex ontology

Authors: A. B. Spanier, D. Cohen, L. Joskowicz

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2017

Abstract

Purpose

The goal of medical case-based image retrieval (M-CBIR) is to assist radiologists in the clinical decision-making process by finding medical cases in large archives that most resemble a given case. Cases are described by radiology reports comprised of radiological images and textual information on the anatomy and pathology findings. The textual information, when available in standardized terminology, e.g., the RadLex ontology, and used in conjunction with the radiological images, provides a substantial advantage for M-CBIR systems.

Methods

We present a new method for incorporating textual radiological findings from medical case reports in M-CBIR. The input is a database of medical cases, a query case, and the number of desired relevant cases. The output is an ordered list of the most relevant cases in the database. The method is based on a new case formulation, the Augmented RadLex Graph and an Anatomy–Pathology List. It uses a new case relatedness metric \({\textit{relCase}}\) that prioritizes more specific medical terms in the RadLex tree over less specific ones and that incorporates the length of the query case.

Results

An experimental study on 8 CT queries from the 2015 VISCERAL 3D Case Retrieval Challenge database consisting of 1497 volumetric CT scans shows that our method has accuracy rates of 82 and 70% on the first 10 and 30 most relevant cases, respectively, thereby outperforming six other methods.

Conclusions

The increasing amount of medical imaging data acquired in clinical practice constitutes a vast database of untapped diagnostically relevant information. This paper presents a new hybrid approach to retrieving the most relevant medical cases based on textual and image information.

Langs G, Hanbury A, Menze B (2013) VISCERAL: towards large data in medical imaging—challenges and directions. Med Content Based Retr Clin Decis Support 7723:92–98

Akgül CB, Rubin DL, Napel S, Beaulieu CF, Greenspan H, Acar B (2011) Content-based image retrieval in radiology: current status and future directions. J Digit Imaging 24:208–222CrossRefPubMed

Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54CrossRef

Liu Y, Zhang D, Lu G, Ma WY (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recognit 40:262–282CrossRef

Shore MW, Rubin DL, Kahn CE (2012) Integration of imaging signs into RadLex. J Digit Imaging 25:50–55CrossRefPubMed

Hwang KH, Lee H, Choi D (2012) Medical image retrieval: past and present. Healthc Inform Res 18:3–9CrossRefPubMedPubMedCentral

Langlotz CP (2006) RadLex: a new method for indexing online educational materials. Radiographics 26:1595–1597CrossRefPubMed

Marwede D, Schulz T, Kahn T (2008) Indexing thoracic CT reports using a preliminary version of a standardized radiological lexicon (RadLex). J Digit Imaging 21:363–370CrossRefPubMed

Rubin DL (2008) Creating and curating a terminology for radiology: ontology modeling and analysis. J Digit Imaging 21:355–362CrossRefPubMed

10.

Rada R, Mili H, Bicknell E, Bletner M (1989) Development and applications of a metric on semantic nets. IEEE Trans Syst Man Cybern 1:17–30CrossRef

11.

Leacock C, Chodorow M (1998) Combining local context and WordNet similarity for word sense identification. WordNet An Electron Lex Database 49:265–283

12.

Lee W-N, Shah N, Sundlass K, Musen M (2008) Comparison of ontology-based semantic-similarity measures. AMIA Annu Symp Proc 6:384–388

13.

Al-Mubaid H, Nguyen HA (2006) A cluster-based approach for semantic similarity in the biomedical domain. Annu Int Conf IEEE Eng Med Biol-Proc 1:2713–2717

14.

Sánchez D, Batet M (2011) Semantic similarity estimation in the biomedical domain: an ontology-based information-theoretic perspective. J Biomed Inform 44:749–759CrossRefPubMed

15.

Pedersen T, Pakhomov SVS, Patwardhan S, Chute CG (2007) Measures of semantic similarity and relatedness in the biomedical domain. J Biomed Inform 40:288–299CrossRefPubMed

16.

Seco N, Veale T, Hayes J (2004) An intrinsic information content metric for semantic similarity in WordNet. ECAI 16:1089–1094

17.

Zhou Z, Wang Y, Gu J (2008) A new model of information content for semantic similarity in WordNet. Second Int Conf Futur Gener Commun Netw Symp 1:85–89CrossRef

18.

Sánchez D, Batet M, Isern D (2011) Ontology-based information content computation. Knowledge-Based Syst 24:297–303CrossRef

19.

Li Y, Bandar ZA, McLean D (2003) An approach for measuring semantic similarity between words using multiple information sources. IEEE Trans Knowl Data Eng 15:871–882CrossRef

20.

Batet M, Sánchez D, Valls A (2011) An ontology-based measure to compute semantic similarity in biomedicine. J Biomed Inform 44:118–125CrossRefPubMed

21.

Rubner Y, Tomasi C, Guibas LJ (2000) The earth mover’s distance as a metric for image retrieval. Int J Comput Vis 40:99–121CrossRef

22.

Batet M, Erola A, Sánchez D, Castellà-Roca J (2013) Utility preserving query log anonymization via semantic microaggregation. Inf Sci 242:49–63CrossRef

23.

Terrovitis M, Mamoulis N, Kalnis P (2008) Privacy-preserving anonymization of set-valued data. Proc VLDB Endow 1:115–125CrossRef

24.

Kurtz C, Gançarski P, Passat N, Puissant A (2013) A hierarchical semantic-based distance for nominal histogram comparison. Data Knowl Eng 87:206–225CrossRef

25.

Kurtz C, Depeursinge A, Napel S, Beaulieu CF, Rubin DL (2014) On combining image-based and ontological semantic dissimilarities for medical image retrieval applications. Med Image Anal 18:1082–1100CrossRefPubMedPubMedCentral

26.

Spanier AB, Joskowicz L (2015) Medical case-based retrieval of patient records using the RadLex hierarchical lexicon. In: Multimodal retrieval in the medical domain. pp 129–138

27.

del–Toro OA, Hanbury A, Langs G, Foncubierta–Rodríguez A, Müller H (2015) Overview of the VISCERAL retrieval benchmark 2015. In: Multimodal retrieval in the medical domain. pp 115–123

28.

Schroeder V (2006) Quasi-metric and metric spaces. Conform Geom Dyn Am Math Soc 10:355–360CrossRef

29.

Lord PW, Stevens RD, Brass A, Goble CA (2003) Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation. Bioinformatics 19:1275–1283CrossRefPubMed

30.

Batet M, Erola A, Sánchez D, Castellà-Roca J (2014) Semantic anonymisation of set-valued data. In: ICAART. pp 102–112

31.

Spanier AB, Joskowicz L (2014) Rule-based ventral cavity multi-organ automatic segmentation in CT scans. In: International MICCAI workshop on medical computer vision. pp 163–170

32.

Kurtz C, Beaulieu CF, Napel S, Rubin DL (2014) A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations. J Biomed Inform 49:227–244CrossRefPubMed

33.

Voorhees EM, Harman DK (2005) TREC: Experiment and evaluation in information retrieval. Cambridge MIT Press, Cambridge

34.

Chen H, Karger DR (2006) Less is more: probabilistic models for retrieving fewer relevant documents. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval. pp 429–436

35.

Pirró G, Euzenat J (2010) A feature and information theoretic framework for semantic similarity and relatedness. In: International semantic web conference. pp 615–630

36.

Hirst G, St-Onge D (1998) Lexical chains as representations of context for the detection and correction of malapropisms. WordNet An Electron Lex Database 305:305–332

37.

Rogers LJ (1991) Determination of the number and waveshapes of event related potential components using comparative factor analysis. Int J Neurosci 56:219–246CrossRefPubMed

38.

Choudhari M, Pedersen T (2012) Extending the hirst and st-onge measure of semantic relatedness for the unified medical language system. Dissertation University of Minnesota

Title: A new method for the automatic retrieval of medical cases based on the RadLex ontology
Authors: A. B. Spanier
D. Cohen
L. Joskowicz
Publication date: 01-03-2017
Publisher: Springer International Publishing
Published in: International Journal of Computer Assisted Radiology and Surgery / Issue 3/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-016-1496-y

Keynote webinar | Spotlight on medication adherence

Springer Medicine

A new method for the automatic retrieval of medical cases based on the RadLex ontology

Abstract

Purpose

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 3/2017

Selecting relevant 3D image features of margin sharpness and texture for lung nodule retrieval

Haustral loop extraction for CT colonography using geodesics

Breast ultrasound image segmentation: a survey

Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets

Bayesian pretest probability estimation for primary malignant bone tumors based on the Surveillance, Epidemiology and End Results Program (SEER) database

Handling topological changes during elastic registration