Encoding and Decoding of Patterns which are Correlated in Space and Time
In the late forties, Hebb postulated his mechanism for learning: Information presented to a neural network during a learning session is stored in the synaptic efficacies in such a way that at a synapse only concurrent events are correlated and encoded. In this paper, three things are done. We study the performance of Hebbian learning in networks with a broad distribution of transmission delays and show that it can handle both stationary and dynamic objects such as single patterns and cycles by the very same principle, the delays taking care of temporal changes, if any. Second, we discuss unlearning, an unsupervised anti-Hebbian procedure that can deal with unbiased and correlated patterns alike and greatly improves the efficiency of a neural network. Finally, we indicate how to code and retrieve correlated (slow) motion. Here the key idea is to code the changes (per unit of time) and use an asymmetric learning rule.
Unable to display preview. Download preview PDF.
- 3.J.L. van Hemmen, in Neural Networks and Spin Glasses, edited by W. K. Theumann and R. Köberle ( World Scientific, Singapore, 1990 ) 91–114Google Scholar
- 4.D.O. Hebb, The Organization of Behavior (Wiley, New York, 1949) p. 62Google Scholar
- M. Vaas, diploma thesis (Heidelberg, October 1989), and to be publishedGoogle Scholar
- 9.M. Jeannerod, The Neural and Behavioural Organization of Goal-Directed Movements ( Clarendon, Oxford, 1988 )Google Scholar
- 10.W. Reichardt, Z. Naturforschg. 12 b (1957) 448–457Google Scholar
- 11.W. Gerstner, J. L. van Hemmen, and A. Herz, preprint TU München (1990)Google Scholar