Abstract
This article presents a method for re-ranking images retrieved by classical search engine using key words for entering queries. This method uses the visual content of the images and it is based on the idea that the relevant images should be similar to each other while the non-relevant images should be different from each other and from relevant images. This idea has been implemented by ranking the images according to their average distances to their nearest neighbors. This query-dependent re-ranking is completed by a query-independent re-ranking taking into account the fact that some types of images are non-relevant for almost all queries. This idea is implemented by training a classifier on results from all queries in the training set. The re-ranking is successfully evaluated on classical datasets built with Exalead TM and Google Images TM search engines.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cui, J., Wen, F., Tang, X.: Real time google and live image search re-ranking. In: ACM Multimedia, Vancouver (2008)
Jain, V., Varma, M.: Learning to re-rank: query-dependent image re-ranking using click data. In: Proceedings of the 20th Intl. Conf. on WWW, pp. 277–286 (2011)
Schroff, F., Criminisi, A., Zisserman, A.: Harvesting image databases from the web. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 754–766 (2011)
Fergus, R., Li, F.F., Perona, P., Zisserman, A.: Learning object categories from google’s image search. In: ICCV, pp. 1816–1823 (2005)
Jing, Y., Baluja, S.: Visualrank: Applying pagerank to large-scale image search. IEE Trans. PAMI 30(11), 1877–1890 (2008)
Liu, W., Jiang, Y.G., Luo, J., Chang, S.F.: Noise resistant graph ranking for improved web image search. In: CVPR, pp. 849–856. IEEE (2011)
Lin, W.H., Jin, R., Alexander Hauptmann, A.G.: Web image retrieval re-ranking with relevance model. In: Intl Conf. on Web Intelligence (WIC), Halifax, Canada, pp. 13–17. IEEE (2003)
Coelho, T.A.S., Calado, P., Souza, L.V., Ribeiro-Neto, B.A., Muntz, R.R.: Image retrieval using multiple evidence ranking. IEEE Trans. Knowl. Data Eng. 16(4), 408–417 (2004)
Krapac, J., Allan, M., Verbeek, J., Jurie, F.: Improving web-image search results using query-relative classiers. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 1094–1101 (June 2010)
Moulin, C., Largeron, C., Géry, M.: Impact of Visual Information on Text and Content Based Image Retrieval. In: Hancock, E.R., Wilson, R.C., Windeatt, T., Ulusoy, I., Escolano, F. (eds.) SSPR&SPR 2010. LNCS, vol. 6218, pp. 159–169. Springer, Heidelberg (2010)
Ben-Haim, N., Babenko, B., Belongie, S.: Improving web-based image search via content based clustering. In: SLAM, New York City (2006)
Zitouni, H., Sevil, S.G., Ozkan, D., Duygulu, P.: Re-ranking of web image search results using a graph algorithm. In: ICPR 2008, pp. 1–4 (2008)
Zou, D., Weston, J., Gretton, A., Bousquet, O., Schlkopf, B.: Ranking on data manifolds. In: NIPS, vol. 16 (2004)
Schroff, F., Criminisi, A., Zisserman, A.: Harvesting image databases from the web. In: CVPR (2007)
Su, Y., Jurie, F.: Visual word disambiguation by semantic contexts. In: ICCV, pp. 311–318 (2011), dataset: https://jurie.users.greyc.fr/datasets/quaero-still.html
van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. on PAMI 32(9), 1582–1596 (2010)
Quénot, G., Delezoide, B., le Borgne, H., Moëllic, P.A., Gorisse, D., Precioso, F., Wang, F., Merialdo, B., Gosselin, P., Granjon, L., Pellerin, D., Rombaut, M., Bredin, H., Koenig, L., Lachambre, H., Khoury, E.E., Mansencal, B., Benois-Pineau, J., Jégou, H., Ayache, S., Safadi, B., Fabrizio, J., Cord, M., Glotin, H., Zhao, Z., Dumont, E., Augereau, B.: Irim at trecvid 2009: High level feature extraction. In: TREC 2009 Notebook, November 16-17 (2009)
Tollari, S., Mulhem, P., Ferecatu, M., Glotin, H., Detyniecki, M., Gallinari, P., Sahbi, H., Zhao, Z.-Q.: A Comparative Study of Diversity Methods for Hybrid Text and Image Retrieval Approaches. In: Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G.J.F., Kurimo, M., Mandl, T., Peñas, A., Petras, V. (eds.) CLEF 2008. LNCS, vol. 5706, pp. 585–592. Springer, Heidelberg (2009)
Arampatzis, A., Zagoris, K., Chatzichristofis, S.A.: Dynamic Two-Stage Image Retrieval from Large Multimodal Databases. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 326–337. Springer, Heidelberg (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Thollard, F., Quénot, G. (2013). Content-Based Re-ranking of Text-Based Image Search Results. In: Serdyukov, P., et al. Advances in Information Retrieval. ECIR 2013. Lecture Notes in Computer Science, vol 7814. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36973-5_52
Download citation
DOI: https://doi.org/10.1007/978-3-642-36973-5_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36972-8
Online ISBN: 978-3-642-36973-5
eBook Packages: Computer ScienceComputer Science (R0)