Lessons from the Primate Visual System

  • Guy A. Orban
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7583)


The primate visual system can perform an astonishing array of tasks as reflected by the correspondingly large portion of the cerebral cortex devoted to analyzing retinal signals. Although a potential source of inspiration for computer vision, with a few exceptions, progress has been slow in this field. Principal obstacles are the lack of any exhaustive list of what vision achieves in humans and the restricting of areas of investigation to a few topics such as motion, object categories and the control of a few actions such as reaching or saccades. Here I will review how we integrated several experimental techniques to address a question that arose from interactions with computer vision scientists more than fifteen years ago: the extraction of 3D surfaces. This goal is achieved by a new type of higher-order visual neuron: the gradient-selective neurons. Neurons selective for speed gradients were initially discovered in motion processing areas, such as MT/V5, MSTd and FST, located in the monkey superior temporal sulcus (STS). Subsequently, neurons selective for disparity gradients were discovered in shape processing areas, such as TEs and AIP. By combining these single-cell studies with fMRI in human and awake monkey, we were able to localize similar neurons to human cortical areas. In the second part I address my present interest in understanding the visual signals related to the actions of conspecifics, which is perhaps the ultimate challenge of motion processing, but which receives surprisingly little attention in vision. The understanding of observed actions exemplifies my statement that to be useful visual signals have to leave the visual system, as signals related to biological motion in the STS are indeed relayed to parietal regions involved in the control of diverse actions to be understood as actions.


Posterior Parietal Cortex Biological Motion Superior Temporal Sulcus Visual Cortical Area Speed Gradient 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Van Essen, D.C., Glasser, M.F., Dierker, D.L., Harwell, J., Coalson, T.: Parcellations and Hemispheric Asymmetries of Human Cerebral Cortex Analyzed on Surface-Based Atlases. Cereb. Cortex. e-Pub. (2011)Google Scholar
  2. 2.
    Van Essen, D.C., Glasser, M.F., Dierker, D.L., Harwell, J.: Cortical Parcellations of the Macaque Monkey Analyzed on Surface-Based Atlases. Cereb. Cortex. e-Pub. (2011)Google Scholar
  3. 3.
    Felleman, D.J., Van Essen, D.C.: Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1–47 (1991)CrossRefGoogle Scholar
  4. 4.
    Kolster, H., Peeters, R., Orban, G.A.: The retinotopic organization of the human middle temporal area MT/V5 and its cortical neighbors. J. Neurosci. 30, 9801–9820 (2010)CrossRefGoogle Scholar
  5. 5.
    La vision, mission du cerveau. Orban GA, College de France/Fayard, Paris (2007)Google Scholar
  6. 6.
    Goodale, M.A., Milner, A.D.: Separate visual pathways for perception and action. Trends Neurosci. 15, 20–25 (1992)CrossRefGoogle Scholar
  7. 7.
    Rizzolatti, G., Matelli, M.: Two different streams form the dorsal visual system: anatomy and functions. Exp. Brain Res. 153, 146–157 (2003)CrossRefGoogle Scholar
  8. 8.
    Vanduffel, W., Fize, D., Mandeville, J.B., Nelissen, K., Van Hecke, P., Rosen, B.R., Tootell, R.B., Orban, G.A.: Visual motion processing investigated using contrast agent-enhanced fMRI in awake behaving monkeys. Neuron. 32, 565–577 (2001)CrossRefGoogle Scholar
  9. 9.
    Orban, G.: The extraction of 3D shape in the visual system of human and nonhuman primates. Annu. Rev. Neurosci. 34, 361–388 (2011)CrossRefGoogle Scholar
  10. 10.
    Xiao, D.K., Marcar, V.L., Raiguel, S.E., Orban, G.A.: Selectivity of macaque MT/V5 neurons for surface orientation in depth specified by motion. Eur. J. Neurosci. 9, 956–964 (1997)CrossRefGoogle Scholar
  11. 11.
    Sugihara, H., Murakami, I., Shenoy, K.V., Andersen, R.A., Komatsu, H.: Response of MSTd neurons to simulated 3D orientation of rotating planes. J. Neurophysiol. 87, 273–285 (2002)Google Scholar
  12. 12.
    Mysore, S.G., Vogels, R., Raiguel, S.E., Todd, J.T., Orban, G.A.: The selectivity of neurons in the macaque fundus of the superior temporal area for three-dimensional structure from motion. J. Neurosci. 30, 15491–15508 (2010)CrossRefGoogle Scholar
  13. 13.
    Orban, G.A., Sunaert, S., Todd, J.T., Van Hecke, P., Marchal, G.: Human cortical regions involved in extracting depth from motion. Neuron. 24, 929–940 (1999)CrossRefGoogle Scholar
  14. 14.
    Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotor cortex. Brain 119, 593–609 (1996)CrossRefGoogle Scholar
  15. 15.
    Fogassi, L., Ferrari, P.F., Gesierich, B., Rozzi, S., Chersi, F., Rizzolatti, G.: Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)CrossRefGoogle Scholar
  16. 16.
    Rizzolatti, G., Luppino, G.: The cortical motor system. Neuron. 31, 889–901 (2001)CrossRefGoogle Scholar
  17. 17.
    Nelissen, K., Borra, E., Gerbella, M., Rozzi, S., Luppino, G., Vanduffel, W., Rizzolatti, G., Orban, G.A.: Action observation circuits in the macaque monkey cortex. J. Neurosci. 31, 3743–3756 (2011)CrossRefGoogle Scholar
  18. 18.
    Nelissen, K., Vanduffel, W., Orban, G.A.: Charting the lower superior temporal region, a new motion-sensitive region in monkey superior temporal sulcus. J. Neurosci. 26, 5929–5947 (2006)CrossRefGoogle Scholar
  19. 19.
    Jastorff, J., Popivanov, I.D., Vogels, R., Vanduffel, W., Orban, G.A.: Integration of shape and motion cues in biological motion processing in the monkey STS. Neuroimage 60, 911–921 (2012)CrossRefGoogle Scholar
  20. 20.
    Durand, J.B., Peeters, R., Norman, J.F., Todd, J.T., Orban, G.A.: Parietal regions processing visual 3D shape extracted from disparity. Neuroimage 46, 1114–1126 (2009)CrossRefGoogle Scholar
  21. 21.
    Stirrat, M., Perrett, D.I.: Valid facial cues to cooperation and trust: male facial width and trustworthiness. Psychol. Sci. 21, 349–354 (2010)CrossRefGoogle Scholar
  22. 22.
    Jastorff, J., Clavagnier, S., Gergely, G., Orban, G.A.: Neural mechanisms of understanding rational actions: middle temporal gyrus activation by contextual violation. Cereb. Cortex 21, 318–329 (2011)CrossRefGoogle Scholar
  23. 23.
    Pichon, S., Degelder, B., Grèzes, J.: Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions. J. Neuroimage 47, 1873–1883 (2009)CrossRefGoogle Scholar
  24. 24.
    Stern, D.N.: Forms of Vitality: Exploring Dynamic Experience in Psychology and the Arts. Oxford University Press (2010)Google Scholar
  25. 25.
    Campanella, S., Belin, P.: Integrating face and voice in person perception. Trends Cogn. Sci. 11, 535–543 (2007)CrossRefGoogle Scholar
  26. 26.
    Andersen, R.A., Buneo, C.A.: Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25, 189–220 (2002)CrossRefGoogle Scholar
  27. 27.
    Bruggeman, H., Warren, W.H.: The direction of walking–but not throwing or kicking–is adapted by optic flow. Psychol. Sci. 21, 1006–1013 (2010)CrossRefGoogle Scholar
  28. 28.
    Andersen, R.A., Cui, H.: Intention, action planning, and decision making in parietal-frontal circuits. Neuron. 63, 568–583 (2009)CrossRefGoogle Scholar
  29. 29.
    Jastorff, J., Begliomini, C., Fabbri-Destro, M., Rizzolatti, G., Orban, G.A.: Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. J. Neurophysiol. 104, 128–140 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Guy A. Orban
    • 1
    • 2
  1. 1.Departments of NeuroscienceKU LeuvenBelgium
  2. 2.University of ParmaItaly

Personalised recommendations