Content Based Image Retrieval Based on Modelling Human Visual Attention
In this paper we propose to employ human visual attention models for content based image retrieval. This approach is called query by saliency content retrieval (QSCR) and considers visual saliency at both local and global image levels. Each image, from a given database, is segmented and specific features are evaluated locally for each of its regions. The global saliency is evaluated based on edge distribution and orientation. During the retrieval stage, the most similar images are retrieved by using an optimization approach such as the Earth Moving Distance (EMD) algorithm. The proposed method ranks the similarity between the query image and a set of given images based on their similarity in the features associated with the salient regions.
KeywordsContent based image retrieval Human visual attention models Earth moving distance Local and global saliency
Unable to display preview. Download preview PDF.
- 1.Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 1597–1604 (2009)Google Scholar
- 2.Chen, Y., Wang, J. Z.: Image categorization by learning and reasoning with images. J. of Machine Learning Research, 913–939 (2004)Google Scholar
- 6.Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proc. Advances in Neural Information Processing Systems (NIPS), vol. 19, pp. 545–552 (2007)Google Scholar
- 9.Itti, L., Ullman, S.: Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 4(4), 219–227 (1985)Google Scholar
- 17.Zhang, L., Tong, M.H., Marks, T.K., Shan, H., Cottrell, G.W.: SUN: A Bayesian framework for saliency using natural statistics. Jour. of Vision 8(7), 32.1–32.20 (2008)Google Scholar