Abstract
We introduce a new multimodal retrieval technique which combines query reformulation and visual image reranking in order to deal with results sparsity and imprecision, respectively. Textual queries are reformulated using Wikipedia knowledge and results are then reordered using a k-NN based reranking method. We compare textual and multimodal retrieval and show that introducing visual reranking results in a significant improvement of performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arni, T., Clough, P., Sanderson, M., Grubinger, M.: Overview of the ImageCLEFphoto 2008 photographic retrieval task. In: Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G.J.F., Kurimo, M., Mandl, T., Peñas, A., Petras, V. (eds.) CLEF 2008. LNCS, vol. 5706, pp. 500–511. Springer, Heidelberg (2009)
Cheng, Y.-C., Chen, S.-Y.: Image classification using color, texture and regions. In: Image Vision Computing (2003)
Deselaers, T., Gass, T., Dreuw, P., Ney, H.: Jointly Optimising Relevance and Diversity in Image Retrieval. In: Proc. of CIVR (2009)
Gabrilovich, E., Markovich, S.: Computing Semantic Relatedness using Wikipedia-based Explicit Semantic Analysis. In: Proc. of IJCAI (2007)
Jing, Y., Baluja, S.: VisualRank: Applying PageRank to Large-Scale Image Search. PAMI (2008)
Milne, D., Witten, I.H.: An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In: Proc. of WIKIAI (2008)
Moëllic, P.-A., Haugeard, J.-E., Pitel, G.: Image clustering based on a shared nearest neighbors approach for tagged collections. In: Proc. of CIVR (2008)
Popescu, A., Le Borgne, H., Moëllic, P.-A.: Conceptual Image retrieval over a Large Scale Database. In: Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G.J.F., Kurimo, M., Mandl, T., Peñas, A., Petras, V. (eds.) CLEF 2008. LNCS, vol. 5706. Springer, Heidelberg (2009)
Strube, M., Ponzetto, S.P.: WikiRelate! Computing Semantic Relatedness Using Wikipedia. In: Proc. of AAAI (2006)
Tsikrika, T., Kludas, J.: Overview of the wikipediaMM task at ImageCLEF 2009. In: CLEF 2009 Workshop, Part II. LNCS, vol. 6242, pp. 60–71. Springer, Heidelberg (2010)
Van Leuken, R.H., Garcia, L., Olivares, X., van Zwol, R.: Visual Diversification of Image Search Results. In: Proc. of WWW (2009)
Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classifcation of texture and object categories: An in-depth study. Technical Report RR-5737, INRIA (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Myoupo, D., Popescu, A., Le Borgne, H., Moëllic, PA. (2010). Multimodal Image Retrieval over a Large Database. In: Peters, C., et al. Multilingual Information Access Evaluation II. Multimedia Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6242. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15751-6_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-15751-6_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15750-9
Online ISBN: 978-3-642-15751-6
eBook Packages: Computer ScienceComputer Science (R0)