Abstract
Biological movements and actions are important visual stimuli. Their recognition is a highly relevant problem for biological as well as for technical systems. In the domain of stationary object recognition the concept of a prototype-based representation of object shape has been quite inspiring for research in computer vision as well as in neuroscience. The paper presents an overview of some recent work aiming at a generalization of such concepts for the domain of complex movements. First, a technical method is presented that allows to represent classes of complex movements by linear combinations of learned example trajectories. Applications of this method in computer vision and computer graphics are briefly discussed. The relevance of prototype-based representations for the recognition of complex movements in the visual cortex is discussed in the second part of the paper. By devising a simple neurophysiologically plausible model it is demonstrated that many experimental findings on the visual recognition of “biological motion” can be accounted for by a neural representation of learned prototypical motion patterns.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D Beymer and T Poggio. Image representations for visual learning. Science, 272:1905–1909, 1996.
V Blanz and T Vetter. Morphable model for the synthesis of 3d faces. In Proceedings of SIGGRAPH 99, Los Angeles, pages 187–194, 1999.
M Brand. Style machines. In Proceedings of SIGGRAPH 2000, New Orleans, Lousiana, USA, pages 23–28, 2000.
A Bruderlin and L Williams. Motion signal processing. In Proceedings of SIGGRAPH 95, Los Angeles, pages 97–104, 1995.
H H Bülthoff and S Edelman. Psychophysical support for a 2D-view interpolation theory of object recognition. Proceedings of the National Academy of Sciences (USA), 89:60–64, 1992.
J E Cutting and L T Kozlowski. Recognising friends by their walk: Gait perception without familiarity cues. Bulletin of the Psychonomic Society, 9:353–356, 1977.
S Edelman. Representation and Recognition in Vision. MIT Press, Cambridge, USA, 1999.
D M Gavrila. The visual analysis of human movement: A survey. Computer Vision and Image Understanding, 73:82–98, 1999.
M A Giese. Dynamit neural model for the recognition of biological motion. In H Neumann and G Barato., editors, Dynamische Perzeption 9, pages 829–835. In.x, Sankt Augustin, 2000.
M A Giese and M Lappe. Measuring generalization fields of biological motion. Vision Research, 42:1847–1858, 2002.
M A Giese and T Poggio. Morphable models for the analysis and Synthesis of complex motion Pattern. International Journal of Computer Vision, 38:59–73, 2000.
M A Giese and T Poggio. Neural mechanisms for the recognition of biological movements and actions. Nature Neuroscience, (submitted), 2002.
M A Giese and L M Vaina. Pathways in the analysis of biological motion: computational model and fMRI results. Perception, 30 (Suppl.):ll6, 2001.
G Johansson. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14:201–211, 1973.
M J Jones and T Poggio. Multidimensional morphable models: A framework for representing and matching object classes. International Journal of Computer Vision, 29:107–131, 1998.
J Lee and S Y Shin. A hierarchical approach to interactive motion editing for human-like figures. In Proceedings of SIGGRAPH 99, Los Angeles, pages 39–48, 1999.
N K Logothetis, J Pauls, and T Poggio. Shape representation in the inferior temporal cortex of monkeys. Current Biology, 5:552–563, 1995.
S E Palmer. Vision Science. MIT Press, Cambridge, USA, 1999.
D I Perrett, P A J Smith, A J Mistlin, A J Chitty, A S Head, D D Potter, Broennimann R, A D Milner, and M A Jeeves. Visual analysis of body movements by neurons in the temporal cortex of the macaque monkey: a preliminary report. Behavioral Brain Research, 16:153–170, 1985.
T Poggio and S Edelman. A network that learns to recognize three-dimensional objects. Nature, 343:263–266, 1990.
M K Riesenhuber and T Poggio. A hierarchical model for visual object recognition. Nature Neuroscience, 11:1019–1025, 1999.
S Ullman and R Basri. Recognition by linear combination of models. IEEE Transactions on Pattern Recognition and Machine Intelligence, 13:992–1006, 1991.
T Valentine. A unified account of the effects of distinctiveness, inversion and rate in face recognition. Quarterly Journal of Experimental Psychology, 43A:161–204, 1991.
T Vetter and T Poggio. Linear object classes and image synthesis from a single example. IEEE Transactions on Pattern Recognition and Machine Intelligence, 19(7):733–742, 1997.
X Xie and M A Giese. Nonlinear dynamics of direction-selective recurrent neural media. Phys Rev E Stat Nonlin Soft Matter Phys, 65 (5 Pt 1):051904, 2002.
Y Yacoob and M J Black. Parameterized modeling and recognition of activities. Computer Vision and Image Understanding, (in press), 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giese, M.A. (2002). Prototypes of Biological Movements in Brains and Machines. In: Bülthoff, H.H., Wallraven, C., Lee, SW., Poggio, T.A. (eds) Biologically Motivated Computer Vision. BMCV 2002. Lecture Notes in Computer Science, vol 2525. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36181-2_16
Download citation
DOI: https://doi.org/10.1007/3-540-36181-2_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00174-4
Online ISBN: 978-3-540-36181-7
eBook Packages: Springer Book Archive