skip to main content
10.1145/1743384.1743405acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Incremental indexing and distributed image search using shared randomized vocabularies

Published:29 March 2010Publication History

ABSTRACT

We present a cooperative framework for content-based image retrieval for the realistic setting where images are distributed across multiple cooperating servers. The proposed method is in line with bag-of-features approaches but uses fully data-independent, randomized structures, shared by the cooperating servers, to map image features to common visual words. A coherent, global image similarity measure (which is a kernel) is computed in a distributed fashion over visual words, by only requiring a small amount of data transfers between nodes. Our experiments on various image types show that this framework is a very promising step towards large-scale, distributed content-based image retrieval.

References

  1. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison Wesley, May 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. P. Bolettieri, A. Esuli, F. Falchi, C. Lucchese, R. Perego, T. Piccioli, and F. Rabitti. CoPhIR: a test collection for content-based image retrieval. CoRR, abs/0905.4627v2, 2009.Google ScholarGoogle Scholar
  3. A. Bosch, A. Zisserman, and X. Munoz. Image classification using random forests and ferns. In Proc. ICCV, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  4. C. Dance, J. Willamowski, L. Fan, C. Bray, and G. Csurka. Visual categorization with bags of keypoints. In ECCV International Workshop on Statistical Learning in Computer Vision, 2004.Google ScholarGoogle Scholar
  5. R. Datta, D. Joshi, J. Li, and J. Z. Wang. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 39(65), 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In Proc. CVPR, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  7. T. Deselaers, H. Müller, P. Clogh, H. Ney, and T. M. Lehmann. The CLEF 2005 automatic medical image annotation task. IJCV, 74(1):51--58, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. Douze, H. Jégou, H. Singh, L. Amsaleg, and C. Schmid. Evaluation of gist descriptors for web-scale image search. In International Conference on Image and Video Retrieval (CIVR). ACM, july 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. W. G. Finn. Diagnostic pathology and laboratory medicine in the age of 'omics'. Journal of Molecular Diagnostics, 9(4), 2007.Google ScholarGoogle ScholarCross RefCross Ref
  10. P. Geurts, D. Ernst, and L. Wehenkel. Extremely randomized trees. Machine Learning, 36(1):3--42, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Gionis, P. Indyk, and R. Motwani. Similarity search in high dimensions via hashing. In Proc. VLDB, pages 518--529, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Halevy, P. Norvig, and F. Pereira. The unreasonable effectiveness of data. IEEE Intelligent Systems, 24(2):8--12, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. Hays and A. A. Efros. Scene completion using millions of photographs. ACM Transactions on Graphics (SIGGRAPH 2007), 26(3), 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. V. Jain, A. Singhal, and J. Luo. Selective hidden random fields: Exploiting domain specific saliency for event classification. In Proc. CVPR, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  15. S. Lazebnik and M. Raginsky. Supervised learning of quantizer codebooks by information loss minimization. IEEE Transactions on PAMI, 31(7):1294--1309, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. Leung and J. Malik. Representing and recognizing the visual appearance of materials using three--dimensional textons. IJCV, 43(1):29--44, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. P. Lyman and H. R. Varian. How much information. Technical report, University of California at Berkeley, 2003. Retrieved from http://www.sims.berkeley.edu/how-much-info-2003 on 8th September 2009.Google ScholarGoogle Scholar
  18. R. Marée, P. Geurts, J. Piater, and L. Wehenkel. Random subwindows for robust image classification. In Proc. IEEE CVPR, volume 1, pages 34--40. IEEE, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. R. Marée, P. Geurts, and L. Wehenkel. Content-based image retrieval by indexing random subwindows with randomized trees. IPSJ Transactions on Computer Vision and Applications, 1(1):46--57, jan 2009.Google ScholarGoogle ScholarCross RefCross Ref
  20. K. Mikolajczyk and C. Schmid. A performance evaluation of local descriptors. IEEE Transactions on PAMI, 27(10):1615--1630, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. H. Müller, A. Rosset, A. Garcia, J.-P. Vallée, and A. Geissbuhler. Benefits of content-based visual data access in radiology. RadioGraphics, 25:849--858, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  22. F. Moosmann, E. Nowak, and F. Jurie. Randomized clustering forests for image classification. IEEE Transactions on PAMI, 30(9):1632--1646, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. D. Nistér and H. Stewénius. Scalable recognition with a vocabulary tree. In Proc. IEEE CVPR, volume 2, pages 2161--2168, June 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Ozuysal, P. Fua, and V. Lepetit. Fast keypoint recognition in ten lines of code. In Proc. CVPR, June 2007.Google ScholarGoogle ScholarCross RefCross Ref
  25. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In Proc. CVPR, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  26. A. Rahimi and B. Recht. Random features for large-scale kernel machines. In Neural Information Processing Systems (NIPS), 2007.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. S. Rajaram and M. Scholz. Client-friendly classification over random hyperplane hashes. In Proc. ECML/PKDD (2), pages 250--265, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  28. J. Sivic and A. Zisserman. Video Google: A text retrieval approach to object matching in videos. In Proc. ICCV, volume 2, pages 1470--1477, Oct. 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Transactions on PAMI, 30(11):1958--1970, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. A. Torralba, R. Fergus, and Y. Weiss. Small codes and large image databases for recognition. Proc. CVPR, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  31. T. Tuytelaars and K. Mikolajczyk. Local invariant feature detectors: A survey. Foundations and Trends in Computer Graphics and Vision, 3(3):177--280, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. T. Tuytelaars and C. Schmid. Vector quantizing feature space with a regular lattice. In Proc. ICCV, oct 2007.Google ScholarGoogle ScholarCross RefCross Ref
  33. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. Evaluation of color descriptors for object and scene recognition. In Proc. CVPR, 2008.Google ScholarGoogle Scholar
  34. B. Williams, G. Klein, and I. Reid. Real-time SLAM relocalisation. In Proc. ICCV, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  35. I. H. Witten, A. Moffat, and T. C. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishers, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. T. Yan, D. Ganesan, and R. Manmatha. Distributed image search in camera sensor networks. In Proceedings of the 6th ACM Conference on Embedded Networked Sensor Systems, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. T. Yeh, J. Lee, and T. Darrell. Adaptive vocabulary forests br dynamic indexing and category learning. In Proc. ICCV, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  38. J. Zhang, M. Marsza lek, S. Lazebnik, and C. Schmid. Local features and kernels for classification of texture and object categories: a comprehensive study. IJCV, 73(2):213--238, jun 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Incremental indexing and distributed image search using shared randomized vocabularies

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MIR '10: Proceedings of the international conference on Multimedia information retrieval
        March 2010
        600 pages
        ISBN:9781605588155
        DOI:10.1145/1743384

        Copyright © 2010 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 March 2010

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader