Bayesian Modeling of Visual Attention
The mechanism in the brain that determines which part of the multitude of sensory data is currently of most interest is called selective attention. There are two kinds of attention cues, stimulus-driven bottom-up cues and goal-driven top-down cues determined by cognitive phenomena like knowledge, expectations, reward, and current goals. In this paper, we propose a Bayesian approach that explains the optimal integration of top-down cues and bottom-up cues. The top down cues include appearance feature, contexts, and locations of a target. The bottom up attention (saliency) is defined as the joint probability of the local feature and context at a location in the scene. The feature and context is organized in a pyramid structure. In this way, multiscale saliency is easily implemented. We demonstrate that the proposed visual saliency effectively predicts human gaze in free-viewing of natural scenes.
KeywordsVisual attention Visual saliency Bayesian modeling
Unable to display preview. Download preview PDF.
- 2.Frintrop, S., Rome, E., Christensen, H.I.: Computational Visual Attention Systems and Their Cognitive Foundations: A Survey. ACM Trans. Appl. Percept. 7 (2010)Google Scholar
- 5.Borji, A., Itti, L.: State-of-the-Art in Visual Attention Modeling. IEEE Trans. Pattern Anal. Mach. Intell. (2012)Google Scholar
- 7.Bruce, N.D., Tsotsos, J.K.: Saliency, Attention, and Visual Search: an Information Theoretic Approach. J. Vis. 9, 5, 1–24 (2009)Google Scholar
- 8.Zhang, L., Tong, M.H., Marks, T.K., Shan, H., Cottrell, G.W.: SUN: A Bayesian Framework for Saliency Using Natural Statistics. J. Vis. 8, 32, 1–20 (2008)Google Scholar
- 13.Xu, J., Yang, Z., Tsien, J.Z.: Emergence of Visual Saliency from Natural Scenes via Context-Mediated Probability Distributions Coding. PLoS One 5 (2010)Google Scholar
- 15.Olmos, A., Kingdom, F.A.: McGill Calibrated Color Image Database (2004)Google Scholar
- 21.Bruce, N.D.B., Tsotsos, J.K.: Saliency Based on Information Maximization. In: Advances in Neural Information Processing Systems, pp. 155–162 (2006)Google Scholar
- 22.Gao, D., Vasconcelos, N.: Bottom-up Saliency Is a Discriminant Process. In: ICCV, Rio de Janeiro, Brazil (2007)Google Scholar