A Bayesian Approach to Hybrid Image Retrieval

  • Pradhee Tandon
  • C. V. Jawahar
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5909)


Content based image retrieval (CBIR) has been well studied in the computer vision and multimedia community. Content free image retrieval (CFIR) methods, and their complementary characteristics to CBIR has not received enough attention in the literature. Performance of CBIR is constrained by the semantic gap between the feature representations and user expectations, while CFIR suffers with sparse logs and cold starts. We fuse both of them in a Bayesian framework to design a hybrid image retrieval system by overcoming their shortcomings. We validate our ideas and report experimental results, both qualitatively and quantitatively. We use our indexing scheme to efficiently represent both features and logs, thereby enabling scalability to millions of images.


  1. 1.
    Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Survey, 1–60 (2008)Google Scholar
  2. 2.
    Tandon, P., Nigam, P., Pudi, V., Jawahar, C.V.: FISH: a practical system for fast interactive image search in huge databases. In: ACM CIVR, pp. 369–378 (2008)Google Scholar
  3. 3.
    Su, Z., Zhang, H., Li, S.Z., Ma, S.: Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Transactions on Image Processing, 924–937 (2003)Google Scholar
  4. 4.
    Zhou, X.S., Huang, T.S.: Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems 6, 536–544 (2003)CrossRefMathSciNetGoogle Scholar
  5. 5.
    Zhou, X., Zhang, Q., Zhang, L., Liu, L., Shi, B.: An Image Retrieval Method Based on Collaborative Filtering. In: Liu, J., Cheung, Y.-m., Yin, H. (eds.) IDEAL 2003. LNCS, vol. 2690. Springer, Heidelberg (2003)Google Scholar
  6. 6.
    Melville, P., Mooney, R.J., Nagarajan, R.: Content-boosted collaborative filtering for improved recommendations. In: NCAI, pp. 187–192 (2002)Google Scholar
  7. 7.
    Jammalamadaka, N., Pudi, V., Jawahar, C.V.: Efficient Search with Changing Similarity Measures on Large Multimedia Datasets. In: Cham, T.-J., Cai, J., Dorai, C., Rajan, D., Chua, T.-S., Chia, L.-T. (eds.) MMM 2007. LNCS, vol. 4352, pp. 206–215. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Yu, K., Schwaighofer, A., Tresp, V., Ma, W.-Y., Zhang, H.: Collaborative Ensemble Learning: Combining Collaborative and Content-Based Information Filtering via Hierarchical Bayes. In: UAI, pp. 616–623 (2003)Google Scholar
  9. 9.
    Heisterkamp, D.R.: Building a latent semantic index of an image database from patterns of relevance feedback. In: ICPR, pp. 134–137 (2002)Google Scholar
  10. 10.
    Han, J., Ngan, K., Li, M., Zhang, H.: A Memory Learning Framework for Effective Image Retrieval. IEEE Trans. on Image Processing, 511–524 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Pradhee Tandon
    • 1
  • C. V. Jawahar
    • 1
  1. 1.Center for Visual Information TechnologyiNameInternational Institute of Information TechnologyHyderabadIndia

Personalised recommendations