Abstract
The primate visual system can perform an astonishing array of tasks as reflected by the correspondingly large portion of the cerebral cortex devoted to analyzing retinal signals. Although a potential source of inspiration for computer vision, with a few exceptions, progress has been slow in this field. Principal obstacles are the lack of any exhaustive list of what vision achieves in humans and the restricting of areas of investigation to a few topics such as motion, object categories and the control of a few actions such as reaching or saccades. Here I will review how we integrated several experimental techniques to address a question that arose from interactions with computer vision scientists more than fifteen years ago: the extraction of 3D surfaces. This goal is achieved by a new type of higher-order visual neuron: the gradient-selective neurons. Neurons selective for speed gradients were initially discovered in motion processing areas, such as MT/V5, MSTd and FST, located in the monkey superior temporal sulcus (STS). Subsequently, neurons selective for disparity gradients were discovered in shape processing areas, such as TEs and AIP. By combining these single-cell studies with fMRI in human and awake monkey, we were able to localize similar neurons to human cortical areas. In the second part I address my present interest in understanding the visual signals related to the actions of conspecifics, which is perhaps the ultimate challenge of motion processing, but which receives surprisingly little attention in vision. The understanding of observed actions exemplifies my statement that to be useful visual signals have to leave the visual system, as signals related to biological motion in the STS are indeed relayed to parietal regions involved in the control of diverse actions to be understood as actions.
Chapter PDF
Similar content being viewed by others
Keywords
- Posterior Parietal Cortex
- Biological Motion
- Superior Temporal Sulcus
- Visual Cortical Area
- Speed Gradient
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Van Essen, D.C., Glasser, M.F., Dierker, D.L., Harwell, J., Coalson, T.: Parcellations and Hemispheric Asymmetries of Human Cerebral Cortex Analyzed on Surface-Based Atlases. Cereb. Cortex. e-Pub. (2011)
Van Essen, D.C., Glasser, M.F., Dierker, D.L., Harwell, J.: Cortical Parcellations of the Macaque Monkey Analyzed on Surface-Based Atlases. Cereb. Cortex. e-Pub. (2011)
Felleman, D.J., Van Essen, D.C.: Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1–47 (1991)
Kolster, H., Peeters, R., Orban, G.A.: The retinotopic organization of the human middle temporal area MT/V5 and its cortical neighbors. J. Neurosci. 30, 9801–9820 (2010)
La vision, mission du cerveau. Orban GA, College de France/Fayard, Paris (2007)
Goodale, M.A., Milner, A.D.: Separate visual pathways for perception and action. Trends Neurosci. 15, 20–25 (1992)
Rizzolatti, G., Matelli, M.: Two different streams form the dorsal visual system: anatomy and functions. Exp. Brain Res. 153, 146–157 (2003)
Vanduffel, W., Fize, D., Mandeville, J.B., Nelissen, K., Van Hecke, P., Rosen, B.R., Tootell, R.B., Orban, G.A.: Visual motion processing investigated using contrast agent-enhanced fMRI in awake behaving monkeys. Neuron. 32, 565–577 (2001)
Orban, G.: The extraction of 3D shape in the visual system of human and nonhuman primates. Annu. Rev. Neurosci. 34, 361–388 (2011)
Xiao, D.K., Marcar, V.L., Raiguel, S.E., Orban, G.A.: Selectivity of macaque MT/V5 neurons for surface orientation in depth specified by motion. Eur. J. Neurosci. 9, 956–964 (1997)
Sugihara, H., Murakami, I., Shenoy, K.V., Andersen, R.A., Komatsu, H.: Response of MSTd neurons to simulated 3D orientation of rotating planes. J. Neurophysiol. 87, 273–285 (2002)
Mysore, S.G., Vogels, R., Raiguel, S.E., Todd, J.T., Orban, G.A.: The selectivity of neurons in the macaque fundus of the superior temporal area for three-dimensional structure from motion. J. Neurosci. 30, 15491–15508 (2010)
Orban, G.A., Sunaert, S., Todd, J.T., Van Hecke, P., Marchal, G.: Human cortical regions involved in extracting depth from motion. Neuron. 24, 929–940 (1999)
Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotor cortex. Brain 119, 593–609 (1996)
Fogassi, L., Ferrari, P.F., Gesierich, B., Rozzi, S., Chersi, F., Rizzolatti, G.: Parietal lobe: from action organization to intention understanding. Science 308, 662–667 (2005)
Rizzolatti, G., Luppino, G.: The cortical motor system. Neuron. 31, 889–901 (2001)
Nelissen, K., Borra, E., Gerbella, M., Rozzi, S., Luppino, G., Vanduffel, W., Rizzolatti, G., Orban, G.A.: Action observation circuits in the macaque monkey cortex. J. Neurosci. 31, 3743–3756 (2011)
Nelissen, K., Vanduffel, W., Orban, G.A.: Charting the lower superior temporal region, a new motion-sensitive region in monkey superior temporal sulcus. J. Neurosci. 26, 5929–5947 (2006)
Jastorff, J., Popivanov, I.D., Vogels, R., Vanduffel, W., Orban, G.A.: Integration of shape and motion cues in biological motion processing in the monkey STS. Neuroimage 60, 911–921 (2012)
Durand, J.B., Peeters, R., Norman, J.F., Todd, J.T., Orban, G.A.: Parietal regions processing visual 3D shape extracted from disparity. Neuroimage 46, 1114–1126 (2009)
Stirrat, M., Perrett, D.I.: Valid facial cues to cooperation and trust: male facial width and trustworthiness. Psychol. Sci. 21, 349–354 (2010)
Jastorff, J., Clavagnier, S., Gergely, G., Orban, G.A.: Neural mechanisms of understanding rational actions: middle temporal gyrus activation by contextual violation. Cereb. Cortex 21, 318–329 (2011)
Pichon, S., Degelder, B., Grèzes, J.: Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions. J. Neuroimage 47, 1873–1883 (2009)
Stern, D.N.: Forms of Vitality: Exploring Dynamic Experience in Psychology and the Arts. Oxford University Press (2010)
Campanella, S., Belin, P.: Integrating face and voice in person perception. Trends Cogn. Sci. 11, 535–543 (2007)
Andersen, R.A., Buneo, C.A.: Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25, 189–220 (2002)
Bruggeman, H., Warren, W.H.: The direction of walking–but not throwing or kicking–is adapted by optic flow. Psychol. Sci. 21, 1006–1013 (2010)
Andersen, R.A., Cui, H.: Intention, action planning, and decision making in parietal-frontal circuits. Neuron. 63, 568–583 (2009)
Jastorff, J., Begliomini, C., Fabbri-Destro, M., Rizzolatti, G., Orban, G.A.: Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. J. Neurophysiol. 104, 128–140 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Orban, G.A. (2012). Lessons from the Primate Visual System. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7583. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33863-2_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-33863-2_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33862-5
Online ISBN: 978-3-642-33863-2
eBook Packages: Computer ScienceComputer Science (R0)