A Goal Oriented Attention Guidance Model

  • Vidhya Navalpakkam
  • Laurent Itti
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2525)


Previous experiments have shown that human attention is influenced by high level task demands. In this paper, we propose an architecture to estimate the task-relevance of attended locations in a scene.We maintain a task graph and compute relevance of fixations using an ontology that contains a description of real world entities and their relationships. Our model guides attention according to a topographic attention guidance map that encodes the bottom-up salience and task-relevance of all locations in the scene.We have demonstrated that our model detects entities that are salient and relevant to the task even on natural cluttered scenes and arbitrary tasks.


Visual Attention Task Graph Salience Model Visual Brain Attention Guidance 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M Corbetta, J M Kincade, J M Ollinger, M P McAvoy, and G L Shulman. Voluntary orienting is dissociated from target detection in human posterior parietal cortex [published erratum appears in nat neurosci 2000 may;3(5):521]. Nature Neuroscience, 3(3):292–297, Mar 2000.CrossRefGoogle Scholar
  2. 2.
    D Walther, L Itti, M Reisenhuber, T Poggio, C Koch. Attentional Selection for Object Recognition—a GentleWay. BMCV2002, in press.Google Scholar
  3. 3.
    Gerd Herzog and Peter Wazinski. VIsual TRAnslator: Linking perceptions and natural language descriptions. Artificial Intelligence Review, 8(2–3):175–187, 1994.CrossRefGoogle Scholar
  4. 4.
    J B Hopfinger, M H Buonocore, and G R Mangun. The neural mechanisms of top-down attentional control. Nature Neuroscience, 3(3):284–291, Mar 2000.CrossRefGoogle Scholar
  5. 5.
    L. Itti and C. Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40(10–12):1489–1506, May 2000.CrossRefGoogle Scholar
  6. 6.
    L. Itti and C. Koch. Computational modeling of visual attention. Nature Reviews Neuroscience, 2(3):194–203, Mar 2001.CrossRefGoogle Scholar
  7. 7.
    L. Itti and C. Koch. Feature Combination Strategies for Saliency-Based Visual Attention Systems. Journal of Electronic Imaging, 10(1):161–169, Jan 2001.CrossRefGoogle Scholar
  8. 8.
    L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1254–1259, Nov 1998.CrossRefGoogle Scholar
  9. 9.
    C Koch and S Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology, 4(4):219–27, 1985.Google Scholar
  10. 10.
    Nuria M. Oliver, Barbara Rosario, and Alex Pentland. A bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):831–843, 2000.CrossRefGoogle Scholar
  11. 11.
    D. Parkhurst, K. Law, and E. Niebur. Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42(1):107–123, Jan 2002.CrossRefGoogle Scholar
  12. 12.
    I. A. Rybak, V. I. Gusakova, A. V. Golovan, L. N. Podladchikova, and N. A. Shevtsova. A model of attention-guided visual perception and recognition. Vision Research, 38:2387–2400, 1998.CrossRefGoogle Scholar
  13. 13.
    A M Treisman and G Gelade. Afeature-integration theory of attention. Cognitive Pyschology, 12(1):97–136, Jan 1980.CrossRefGoogle Scholar
  14. 14.
    J K Tsotsos. Computation, pet images, and attention. Behavioral and Brain Sciences, 18(2):372, 1995.MathSciNetCrossRefGoogle Scholar
  15. 15.
    van de P. Laar, T. Heskes, and S. Gielen. Task-dependent learning of attention. Neural Networks, 10(6):981–992, 1997.CrossRefGoogle Scholar
  16. 16.
    J M Wolfe. Visual search in continuous, naturalistic stimuli. Vision Research, 34(9):1187–95, May 1994.MathSciNetCrossRefGoogle Scholar
  17. 17.
    A Yarbus. Eye Movements and Vision. Plenum Press, NewYork, 1967.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Vidhya Navalpakkam
    • 1
  • Laurent Itti
    • 1
  1. 1.Departments of Computer SciencePsychology and Neuroscience Graduate Program University of Southern CaliforniaLos Angeles

Personalised recommendations