Skip to main content
Top
Published in: Journal of Digital Imaging 5/2013

01-10-2013

A Novel Similarity Learning Method via Relative Comparison for Content-Based Medical Image Retrieval

Authors: Wei Huang, Peng Zhang, Min Wan

Published in: Journal of Imaging Informatics in Medicine | Issue 5/2013

Login to get access

Abstract

Nowadays, the huge volume of medical images represents an enormous challenge towards health-care organizations, as it is often hard for clinicians and researchers to manage, access, and share the image database easily. Content-based medical image retrieval (CBMIR) techniques are employed to facilitate the above process. It is known that a few concrete factors, including visual attributes extracted from images, measures encoding the similarity between images, user interaction, etc. play important roles in determining the retrieval performance. This paper concentrates on the similarity learning problem of CBMIR. A novel similarity learning paradigm is proposed via relative comparison, and a large database composed of 5,000 images is utilized to evaluate the retrieval performance. Extensive experimental results and comprehensive statistical analysis demonstrate the superiority of adopting the newly introduced learning paradigm, compared with several conventional supervised and semi-supervised similarity learning methods, in the presented CBMIR application.
Appendix
Available only for authorised users
Literature
3.
go back to reference Hearst M, Divoli A, Guturu H, Ksikes A, Nakov P, Wooldridge M, Ye J: BioText search engine: beyond abstract search. Bioinformatics 23(16):2196–2197, 2007PubMedCrossRef Hearst M, Divoli A, Guturu H, Ksikes A, Nakov P, Wooldridge M, Ye J: BioText search engine: beyond abstract search. Bioinformatics 23(16):2196–2197, 2007PubMedCrossRef
5.
go back to reference Müller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. Int J Med Inform 73(1):1–23, 2004PubMedCrossRef Müller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. Int J Med Inform 73(1):1–23, 2004PubMedCrossRef
7.
go back to reference Tagare H, Jaffe C, Duncan J: Medical image databases: a content-based retrieval approach. J Am Med Inform Assoc 4(3):184–198, 1997PubMedCrossRef Tagare H, Jaffe C, Duncan J: Medical image databases: a content-based retrieval approach. J Am Med Inform Assoc 4(3):184–198, 1997PubMedCrossRef
8.
go back to reference Ghosh P, Antani S, Long R, Thoma G: Review of medical image retrieval systems and future directions. IEEE Int Symp Computer-Based Med Syst 1:1–16, 2011 Ghosh P, Antani S, Long R, Thoma G: Review of medical image retrieval systems and future directions. IEEE Int Symp Computer-Based Med Syst 1:1–16, 2011
9.
go back to reference Sweet H, Mutalik P, Neklesa V, Horvath L, Lee C, Richter J, Tocino I, Fisher P: Voice-activated retrieval of mammography reference images. J Digit Imaging 11(2):65–73, 1998CrossRef Sweet H, Mutalik P, Neklesa V, Horvath L, Lee C, Richter J, Tocino I, Fisher P: Voice-activated retrieval of mammography reference images. J Digit Imaging 11(2):65–73, 1998CrossRef
10.
go back to reference Oh J, Yang Y, El Naqa I: Adaptive learning for relevance feedback: application to digital mammography. Med Phys 37(8):4432–4444, 2010PubMedCrossRef Oh J, Yang Y, El Naqa I: Adaptive learning for relevance feedback: application to digital mammography. Med Phys 37(8):4432–4444, 2010PubMedCrossRef
11.
go back to reference El Naqa I, Yang Y, Galatsanos N, Nishikawa R, Wernick M: A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23(10):1233–1244, 2004PubMedCrossRef El Naqa I, Yang Y, Galatsanos N, Nishikawa R, Wernick M: A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23(10):1233–1244, 2004PubMedCrossRef
12.
go back to reference Kinoshita S, de Azevedo-Marques P, Pereira R, Rodrigues J, Rangayyan R: Content-based retrieval of mammograms using visual features related to breast density patterns. J Digit Imaging 20(2):172–190, 2007PubMedCrossRef Kinoshita S, de Azevedo-Marques P, Pereira R, Rodrigues J, Rangayyan R: Content-based retrieval of mammograms using visual features related to breast density patterns. J Digit Imaging 20(2):172–190, 2007PubMedCrossRef
13.
go back to reference Tourassi G, Harrawood B, Singh S, Lo J, Floyd C: Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammography. Med Phys 34(1):140–150, 2007PubMedCrossRef Tourassi G, Harrawood B, Singh S, Lo J, Floyd C: Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammography. Med Phys 34(1):140–150, 2007PubMedCrossRef
14.
go back to reference Zheng B, Lu A, Hardesty L, Sumkin J, Hakim C, Ganott M, Gur D: A Method to improve visual similarity of breast masses for an interactive computer-aided diagnosis environment. Med Phys 33(1):111–117, 2006PubMedCrossRef Zheng B, Lu A, Hardesty L, Sumkin J, Hakim C, Ganott M, Gur D: A Method to improve visual similarity of breast masses for an interactive computer-aided diagnosis environment. Med Phys 33(1):111–117, 2006PubMedCrossRef
15.
go back to reference Mazurowski M, Habas P, Zurada J, Tourassi G: Decision optimization of case-based computer-aided decision systems using genetic algorithms with application to mammography. Phys Med Biol 53(4):895–908, 2008PubMedCrossRef Mazurowski M, Habas P, Zurada J, Tourassi G: Decision optimization of case-based computer-aided decision systems using genetic algorithms with application to mammography. Phys Med Biol 53(4):895–908, 2008PubMedCrossRef
16.
go back to reference Dy J, Brodley C, Kak A, Broderick L, Aisen A: Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Trans on Pattern Anal Mach Intell 25(3):373–378, 2003CrossRef Dy J, Brodley C, Kak A, Broderick L, Aisen A: Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Trans on Pattern Anal Mach Intell 25(3):373–378, 2003CrossRef
17.
go back to reference Shyu C, Brodley C, Kak A, Kosaka A, Aisen A, Broderick L: ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comp Vision Image Underst 75(1–2):111–132, 1999CrossRef Shyu C, Brodley C, Kak A, Kosaka A, Aisen A, Broderick L: ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comp Vision Image Underst 75(1–2):111–132, 1999CrossRef
18.
go back to reference Lehmann T, Güld M, Thies C, Fischer B, Spitzer K, Keysers D, Ney H, Kohnen M, Schubert H, Wein B: Content-based image retrieval in medical applications. Methods Inf Med 43:354–361, 2004PubMed Lehmann T, Güld M, Thies C, Fischer B, Spitzer K, Keysers D, Ney H, Kohnen M, Schubert H, Wein B: Content-based image retrieval in medical applications. Methods Inf Med 43:354–361, 2004PubMed
19.
go back to reference Huang W, Chan K, Li H, Lim J, Liu J, Wong T: A computer assisted method for nuclear cataract grading from slit-lamp images using ranking. IEEE Trans Med Imaging 30(1):94–107, 2011PubMedCrossRef Huang W, Chan K, Li H, Lim J, Liu J, Wong T: A computer assisted method for nuclear cataract grading from slit-lamp images using ranking. IEEE Trans Med Imaging 30(1):94–107, 2011PubMedCrossRef
21.
go back to reference Guo G, Jain A, Ma W, Zhang H: Learning similarity measure for natural image retrieval with relevance feedback. IEEE Trans Neural Netw 13:811–820, 2002PubMedCrossRef Guo G, Jain A, Ma W, Zhang H: Learning similarity measure for natural image retrieval with relevance feedback. IEEE Trans Neural Netw 13:811–820, 2002PubMedCrossRef
22.
go back to reference Hertz T, Bar-Hillel A, Weinshall D: Learning distance functions for image retrieval. IEEE Conf Comput Vis Pattern Recognit 2:570–577, 2004 Hertz T, Bar-Hillel A, Weinshall D: Learning distance functions for image retrieval. IEEE Conf Comput Vis Pattern Recognit 2:570–577, 2004
23.
go back to reference Si L, Jin R, Hoi S, Lyu M: Collaborative image retrieval via regularized metric learning. Mulitmedia Systems 12:34–44, 2006CrossRef Si L, Jin R, Hoi S, Lyu M: Collaborative image retrieval via regularized metric learning. Mulitmedia Systems 12:34–44, 2006CrossRef
24.
go back to reference Globerson A, Roweis S: Metric learning by collapsing classes. Adv Neural Inf Process Syst 1:451–458, 2005 Globerson A, Roweis S: Metric learning by collapsing classes. Adv Neural Inf Process Syst 1:451–458, 2005
25.
go back to reference Weinberger K, Blitzer J, Saul L: Distance metric learning for large margin nearest neighbor classification. Adv Neural Inf Process Syst 1:1473–1480, 2006 Weinberger K, Blitzer J, Saul L: Distance metric learning for large margin nearest neighbor classification. Adv Neural Inf Process Syst 1:1473–1480, 2006
27.
go back to reference Chapelle O, Scholkopf B, Zien A: Semi-supervised learning. MIT Press, 2006 Chapelle O, Scholkopf B, Zien A: Semi-supervised learning. MIT Press, 2006
28.
go back to reference Xing E, Ng A, Jordan M, Russell S: Distance metric learning, with application to clustering with side-information. Adv Neural Inf Process Syst 1:505–512, 2003 Xing E, Ng A, Jordan M, Russell S: Distance metric learning, with application to clustering with side-information. Adv Neural Inf Process Syst 1:505–512, 2003
29.
go back to reference Schultz M, Joachims T: Learning a distance metric from relative comparisons. Adv Neural Inf Process Syst 1:41–48, 2004 Schultz M, Joachims T: Learning a distance metric from relative comparisons. Adv Neural Inf Process Syst 1:41–48, 2004
30.
go back to reference Schroff F: Harvesting image databases from the web. IEEE Trans Pattern Anal Mach Intell 33(4):754–766, 2011PubMedCrossRef Schroff F: Harvesting image databases from the web. IEEE Trans Pattern Anal Mach Intell 33(4):754–766, 2011PubMedCrossRef
31.
go back to reference Jing Y: VisualRank: applying pagerank to large-scale image search. IEEE Trans Pattern Anal Mach Intell 30(11):1877–1890, 2008PubMedCrossRef Jing Y: VisualRank: applying pagerank to large-scale image search. IEEE Trans Pattern Anal Mach Intell 30(11):1877–1890, 2008PubMedCrossRef
32.
go back to reference Siddiquie B: Image ranking and retrieval based on multi-attribute queries. IEEE Conf Comput Vis Pattern Recognit 1:801–808, 2011 Siddiquie B: Image ranking and retrieval based on multi-attribute queries. IEEE Conf Comput Vis Pattern Recognit 1:801–808, 2011
33.
go back to reference Datta R, Joshi D, Li J, Wang J: Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):5:1–5:60, 2008CrossRef Datta R, Joshi D, Li J, Wang J: Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):5:1–5:60, 2008CrossRef
34.
go back to reference Kendall M: A new measure of rank correlation. Biometrika 30:81–93, 1938 Kendall M: A new measure of rank correlation. Biometrika 30:81–93, 1938
36.
go back to reference Klein B, Klein R, Linton K, Magli Y, Neider M: Assessment of cataracts from photographs in the Beaver dam eye study. Ophthalmology 97(11):1428–1433, 1990PubMed Klein B, Klein R, Linton K, Magli Y, Neider M: Assessment of cataracts from photographs in the Beaver dam eye study. Ophthalmology 97(11):1428–1433, 1990PubMed
37.
go back to reference Li C, Kao C, Gore J, Ding Z: Implicit active contours driven by local binary fitting energy. IEEE Conf Comput Vis Pattern Recognit 1:1–7, 2007 Li C, Kao C, Gore J, Ding Z: Implicit active contours driven by local binary fitting energy. IEEE Conf Comput Vis Pattern Recognit 1:1–7, 2007
38.
go back to reference Rice J: Mathematical Statistics and Data Analysis, 2nd edition. Duxbury Press, 2007 Rice J: Mathematical Statistics and Data Analysis, 2nd edition. Duxbury Press, 2007
39.
go back to reference Gold C, Sollich P: Model selection for support vector machine classification. Neurocomputing 55:221–249, 2003CrossRef Gold C, Sollich P: Model selection for support vector machine classification. Neurocomputing 55:221–249, 2003CrossRef
40.
go back to reference Weston J: Leave-one-out support vector machines. Int Joint Conf Artif Intell 1:727–733, 1999 Weston J: Leave-one-out support vector machines. Int Joint Conf Artif Intell 1:727–733, 1999
41.
go back to reference Chapelle O, Vapnik V, Bousquet O, Mukherjee S: Choosing multiple parameters for support vector machines. Mach Learn 46(1–3):131–159, 2002CrossRef Chapelle O, Vapnik V, Bousquet O, Mukherjee S: Choosing multiple parameters for support vector machines. Mach Learn 46(1–3):131–159, 2002CrossRef
44.
go back to reference Congdon N, Chang N, Botelho P, Stark W, Datiles III M: Cataract: clinical types. Duane’s Ophthalmology, 2006 edition, vol 1, chapter 73(B). Lippincott: Williams & Wilkins, 2006 Congdon N, Chang N, Botelho P, Stark W, Datiles III M: Cataract: clinical types. Duane’s Ophthalmology, 2006 edition, vol 1, chapter 73(B). Lippincott: Williams & Wilkins, 2006
45.
go back to reference Zigler Jr J, Datiles III M: Pathogenesis of cataracts. Duane’s Ophthalmology, 2006 edition, vol 1, chapter 72(B). Lippincott: Williams & Wilkins, 2006 Zigler Jr J, Datiles III M: Pathogenesis of cataracts. Duane’s Ophthalmology, 2006 edition, vol 1, chapter 72(B). Lippincott: Williams & Wilkins, 2006
Metadata
Title
A Novel Similarity Learning Method via Relative Comparison for Content-Based Medical Image Retrieval
Authors
Wei Huang
Peng Zhang
Min Wan
Publication date
01-10-2013
Publisher
Springer US
Published in
Journal of Imaging Informatics in Medicine / Issue 5/2013
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-013-9591-x

Other articles of this Issue 5/2013

Journal of Digital Imaging 5/2013 Go to the issue