Abstract
The recognition of object categories is one of the most challenging problems in computer vision field.It is still an open problem , especially in content based image retrieval (CBIR).When using analysis algorithm, a trade-off must be found between the quality of the results expected, and the amount of computer resources allocated to manage huge amount of generated data. In human, the mechanisms of evolution have generated the visual attention system which selects the most important information in order to reduce both cognitive load and scene understanding ambiguity. In computer science, most powerful algorithms use local approaches as bag-of-features or sparse local features. In this article, we propose to evaluate the integration of one of the most recent visual attention model in one of the most efficient CBIR method. First, we present these two algorithms and the database used to test results. Then, we present our approach which consists in pruning interest points in order to select a certain percentage of them (40% to 10% ). This filtering is guided by a saliency map provided by a visual attention system. Finally, we present our results which clearly demonstrate that interest points used in classical CBIR methods can be drastically pruned without seriously impacting results. We also demonstrate that we have to smartly filter learning and training data set to obtain such results.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Marszaek, M., Schmid, C.: Spatial Weighting for Bag-of-Features. IEEE, 2118–2125 (2006)
Everingham, M., Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The Pascal Visual Object Classes (VOC) Challenge, pp. 303–338 (2009)
Tuytelaars, T., Mikolajczyk, K.: Local Invariant Feature Detectors: A Survey. Foundations and Trends in Computer Graphics and Vision 3(3), 177–280 (2008)
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints, pp. 91–110 (2004)
Santini, S., Gupta, A., Jain, R.: Emergent Semantics Through Interaction in Image Databases. IEEE Transactions on knowledge and Data Engineering 13(3), 337–351 (2001)
Foo, J.J.: Pruning SIFT for Scalable Near-Duplicate Image Matching 9 (2007)
Frintrop, S., Rome, E., Christensen, H.I.: Computational visual attention systems and their cognitive foundations. ACM Transactions on Applied Perception 7(1), 1–39 (2010)
VOC, VOC 2005 (2005)
Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., Freeman, W.T.: Discovering objects and their location in images. Russell The Journal of The Bertrand Russell Archives
Kondor, R., Jebara, T.: A Kernel Between Sets of Vectors (2003)
Laaksonen, J.: PicSOM content based image retrieval with self organizing maps, pp. 1199–1207 (2000)
Mikolajczyk, K.: Scale and Affine Invariant Interest Point Detectors, pp. 63–86 (2004)
Lindeberg, T.: Feature Detection with Automatic Scale Selection 96 (1998)
Itti, L., Koch, C., Niebur, E., et al.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Perreira da Silva, M., Courboulay, V., Prigent, A., Estraillier, P.: Evaluation of preys / predators systems for visual attention simulation, in VISAPP, - International Conference on Computer Vision Theory and Applications Angers: INSTICC, pp. 275–282 (2010)
Fawcett, T.: An introduction to ROC analysis, 861–874 (2006)
Perreira da Silva, M., Courboulay, V., Estraillier, P., Rochelle, L., Cedex, L.R.: Objective validation of a dynamical and plausible computational model of visual attention. In: EUVIP, Paris (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Awad, D., Courboulay, V., Revel, A. (2012). Saliency Filtering of SIFT Detectors: Application to CBIR. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P., Zemčík, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2012. Lecture Notes in Computer Science, vol 7517. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33140-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-33140-4_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33139-8
Online ISBN: 978-3-642-33140-4
eBook Packages: Computer ScienceComputer Science (R0)