Advertisement

Encoding and Decoding of Patterns which are Correlated in Space and Time

  • J. L. van Hemmen
  • W. Gerstner
  • A. Herz
  • R. Kühn
  • B. Sulzer
  • M. Vaas
Part of the Informatik-Fachberichte book series (INFORMATIK, volume 252)

Abstract

In the late forties, Hebb postulated his mechanism for learning: Information presented to a neural network during a learning session is stored in the synaptic efficacies in such a way that at a synapse only concurrent events are correlated and encoded. In this paper, three things are done. We study the performance of Hebbian learning in networks with a broad distribution of transmission delays and show that it can handle both stationary and dynamic objects such as single patterns and cycles by the very same principle, the delays taking care of temporal changes, if any. Second, we discuss unlearning, an unsupervised anti-Hebbian procedure that can deal with unbiased and correlated patterns alike and greatly improves the efficiency of a neural network. Finally, we indicate how to code and retrieve correlated (slow) motion. Here the key idea is to code the changes (per unit of time) and use an asymmetric learning rule.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    A. Herz, B. Sulzer, R. Kühn, and J. L. van Hemmen, Europhys. Lett. 7 (1988) 663–9CrossRefGoogle Scholar
  2. 2.
    A. Herz, B. Sulzer, R. Kühn, and J. L. van Hemmen, Biol. Cybem. 60 (1989) 457–467zbMATHCrossRefGoogle Scholar
  3. 3.
    J.L. van Hemmen, in Neural Networks and Spin Glasses, edited by W. K. Theumann and R. Köberle ( World Scientific, Singapore, 1990 ) 91–114Google Scholar
  4. 4.
    D.O. Hebb, The Organization of Behavior (Wiley, New York, 1949) p. 62Google Scholar
  5. 5.
    F. Crick and G. Mitchison, Nature 304 (1983) 111–114CrossRefGoogle Scholar
  6. 6.
    J. J. Hopfield, D. I. Feinstein, and R. G. Palmer, Nature 304 (1983) 158–159CrossRefGoogle Scholar
  7. 7.
    J. L. van Hemmen, L. B. Ioffe, R. Kühn, and M. Vaas, Physica A 163 (1990) 386–392CrossRefGoogle Scholar
  8. M. Vaas, diploma thesis (Heidelberg, October 1989), and to be publishedGoogle Scholar
  9. 8.
    J. Lisman, Proc. Natl. Acad. Sci. USA 86 (1989) 9574–9578CrossRefGoogle Scholar
  10. 9.
    M. Jeannerod, The Neural and Behavioural Organization of Goal-Directed Movements ( Clarendon, Oxford, 1988 )Google Scholar
  11. 10.
    W. Reichardt, Z. Naturforschg. 12 b (1957) 448–457Google Scholar
  12. 11.
    W. Gerstner, J. L. van Hemmen, and A. Herz, preprint TU München (1990)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1990

Authors and Affiliations

  • J. L. van Hemmen
    • 1
  • W. Gerstner
    • 3
  • A. Herz
    • 2
  • R. Kühn
    • 2
  • B. Sulzer
    • 2
  • M. Vaas
    • 2
  1. 1.Physik-DepartmentTU MünchenGarching (bei München)Germany
  2. 2.Sonderforschungsbereich 123Universität HeidelbergHeidelbergGermany
  3. 3.Dept. of PhysicsUniversity of CaliforniaBerkeleyUSA

Personalised recommendations