Abstract
In this paper, we propose to rerank the image retrieval results using a novel method which can be fitted to both objects classes and scenes classes. We first introduce the two methods: Exemplar model and Saliency Map (SM). Exemplar model is a top-down method which considers region of interest (ROI) of images from the same class containing lots of similar discriminative local features. These discriminative local features can be trained as the model of the specific class and to rerank the retrieved images by their similarities with the trained model of the query class. On the other hand, SM is a bottom-up method which uses winner-take-all and inhibition-of-return mechanisms to draw different locations in descending saliency order, and the images can be reranked by their salient scores. In experimental results, we observe that Exemplar Model performs well in object classes and SM performs well in scene classes for these two methods focus on different aspects to rerank images. Then we propose a method named ExSM which combines the advantage of Exemplar model and SM. ExSM inherits the superiority of Exemplar model in object classes and SM in scene classes and outperforms both of them in general.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hsu, W.H., Kennedy, L.S., Chang, S.F.: Reranking Methods for Visual Search. IEEE MultiMedia 14(3), 14–22 (2007)
Yan, R., Hauptmann, A.G.: Co-retrieval: a boosted reranking approach for video retrieval. IEE Proceedings - Vision, Image and Signal Processing 152(6), 888–895 (2005)
Tan, H.-K., Ngo, C.-W., Wu, X.: Modeling video hyperlinks with hypergraph for web video reranking. In: Proceeding of the 16th ACM International Conference on Multimedia, pp. 659–662. ACM, New York (2008)
Hsu, W.H., Kennedy, L.S., Chang, S.-F.: Video search reranking through random walk over document-level context graph. In: Proceedings of the 15th International Conference on Multimedia, pp. 971–980. ACM, New York (2007)
Jing, Y., Baluja, S.: VisualRank: Applying PageRank to Large-Scale Image Search. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 1877–1890 (2008)
Tian, X., Yang, L., Wang, J., Yang, Y., Wu, X., Hua, X.S.: Bayesian video search reranking. In: ACM Multimedia Conference, pp. 131–140 (2008)
Jing, Y., Baluja, S.: Pagerank for product image search. In: Proceeding of the 17th International Conference on World Wide Web, pp. 307–316. ACM, New York (2008)
Schroff, F., Criminisi, A., Zisserman, A.: Harvesting image databases from the web. In: IEEE 11th International Conference on Computer Vision, pp. 1–8 (2007)
Yang, L., Hanjalic, A.: Supervised reranking for web image search. In: Proceedings of the International Conference on Multimedia, pp. 183–192. ACM, New York (2010)
Liu, Y., Mei, T., Hua, X.-S., Tang, J., Wu, X., Li, S.: Learning to video search rerank via pseudo preference feedback. In: IEEE International Conference on Multimedia and Expo (23, 2008)
Yan, R., Hauptmann, E., Jin, R.: Multimedia search with pseudo-relevance feedback. In: Intl Conf. on Image and Video Retrieval, pp. 238–247 (2003)
Yang, Y.-H., Hsu, W.H.: Video search reranking via online ordinal reranking. In: IEEE International Conference on Multimedia and Expo, pp. 285–288 (2008)
van Leuken, R.H., Garcia, L., Olivares, X., van Zwol, R.: Visual diversification of image search results. In: Proceedings of the 18th International Conference on World Wide Web, pp. 341–350. ACM, New York (2009)
Elazary, L., Itti, L.: Interesting objects are visually salient. Journal of Vision 8(3), 1–15 (2008)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. TPAMI 20(11), 1254–1259 (1998)
Chum, O., Zisserman, A.: An exemplar model for learning object classes. In: CVPR (2007)
Wei, R., Lu, H., Zheng, Y., Cen, L., Jin, C., Xue, X., Wu, W.: How context helps: A discriminative codeword selection method for object detection. In: 17th IEEE International Conference on Image Processing, pp. 3905–3908 (2010)
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Advances in Neural Information Processing Systems 19, pp. 545–552. MIT Press (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lu, H., Chen, K., Jiang, G., Wei, R., Xue, X. (2012). Leveraging Exemplar and Saliency Model for Image Search Reranking. In: Lin, W., et al. Advances in Multimedia Information Processing – PCM 2012. PCM 2012. Lecture Notes in Computer Science, vol 7674. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34778-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-34778-8_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34777-1
Online ISBN: 978-3-642-34778-8
eBook Packages: Computer ScienceComputer Science (R0)