Temporal Coding Is Not Only About Cooperation—It Is Also About Competition

Part of the Springer Series in Cognitive and Neural Systems book series (SSCNS, volume 3)

Abstract

Temporal coding is commonly understood as a cooperative mechanism, realizing a grouping of neural units into assemblies based on temporal correlation. However, restricting the view on temporal coding to this perspective may miss an essential aspect. For example, with only synchronizing couplings present, the well-known superposition catastrophe may arise through states of global synchrony. Therefore, also desynchronizing tendencies have to be included, preferably in a manner that introduces an appropriate form of competition. In the context of phase model oscillator networks with Hebbian couplings, already a study of a “second-simplest” choice of model reveals a surprising property: temporal coding introduces a “competition for coherence” among stored patterns without need to include inhibitory couplings. Here, we refer to the corresponding models as Patterned Coherence Models (PCMs). This denotation is chosen with regard to the tendency of such models to establish coherence of parts of the network that correspond to the stored patterns, a valuable property with respect to pattern recognition. We review and discuss recent progress in studying such models, concentrating on models that complement synchronization with so-called acceleration. The latter mechanism implies an increased phase velocity of neural units in case of stronger and/or more coherent input from the connected units. Assuming Hebbian storage of patterns, it is demonstrated that the inclusion of acceleration introduces a competition for coherence that has a profound and favorable effect on pattern recognition. Outlook is given on paths towards including inhibition, hierarchical processing, and zero-lag synchronization despite time delays. We also mention possible relations to recent neurophysiological experiments that study the recoding of excitatory drive into phase shifts.

Keywords

Coherence Assure Sine 

Notes

Acknowledgements

The author is thankful to Christoph von der Malsburg for inspiring and helpful discussions on self-organization mechanisms in general and temporal coding in particular. Moreover, it is a pleasure to thank Danko Nikolić, Martha Havenith and Gordon Pipa from the Max-Plack-Institute for Brain Research, Frankfurt, for insightful discussions on temporal coding with respect to observed brain dynamics.

References

  1. 1.
    Roskies AL (1999) Reviews on the binding problem. Neuron 24:7–9 PubMedCrossRefGoogle Scholar
  2. 2.
    von der Malsburg C (1999) The what and why of binding: the modeler’s perspective. Neuron 24:95–104 PubMedCrossRefGoogle Scholar
  3. 3.
    Haken H (1980) Synergetics. Are cooperative phenomena governed by universal principles? Naturwissenschaften 67:121–128 CrossRefGoogle Scholar
  4. 4.
    Burwick T (2007) Oscillatory neural networks with self-organized segmentation of overlapping patterns. Neural Comput 19:2093–2123 PubMedCrossRefGoogle Scholar
  5. 5.
    Burwick T (2008) Temporal coding: assembly formation through constructive interference. Neural Comput 20:1796–1820 PubMedCrossRefGoogle Scholar
  6. 6.
    Burwick T (2008) Temporal coding with synchronization and acceleration as complementary mechanisms. Neurocomputing 71:1121–1133 CrossRefGoogle Scholar
  7. 7.
    Burwick T (2008) Temporal coding: the relevance of classical activity, its relation to pattern frequency bands, and a remark on recoding of excitatory drive into phase shifts. Biosystems 94:75–86 PubMedCrossRefGoogle Scholar
  8. 8.
    Burwick T (2008) Assemblies as phase-locked pattern sets that collectively win the competition for coherence. In: Proceedings of 18th international conference on artificial neural networks (ICANN’2008), Part II, Prague, Czech Republic, 3–6 September. Lecture notes in computer science. Springer, Berlin, pp 617–626 Google Scholar
  9. 9.
    Burwick T (2006) Oscillatory networks: pattern recognition without a superposition problem. Neural Comput 18:356–380 PubMedCrossRefGoogle Scholar
  10. 10.
    Cohen MA, Grossberg S (1983) Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Trans Syst Man Cybern SMC-13:815–826 Google Scholar
  11. 11.
    Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 81:3088–3092 PubMedCrossRefGoogle Scholar
  12. 12.
    Burwick T (2009) On the relevance of local synchronization for establishing a winner-take-all functionality of the gamma cycle. Neurocomputing 72:1525–1533 CrossRefGoogle Scholar
  13. 13.
    Burwick T (2009) Zero phase-lag synchronization through short-term modulations. In: Proceedings of the 17th European symposium on artificial neural networks (ESANN’2009), Bruges, Belgium, 22–24 April, pp 403–408 Google Scholar
  14. 14.
    Haykin S (1999) Neural networks—a comprehensive foundation, 2nd edn. Prentice Hall, New York Google Scholar
  15. 15.
    Sakagushi H, Shinomoto S, Kuramoto Y (1988) Mutual entrainment in oscillator lattices with nonvariational type interaction. Prog Theor Phys 79:1069–1079 CrossRefGoogle Scholar
  16. 16.
    von der Malsburg C (1981) The correlation theory of brain function. Max-Planck Institute for Biophysical Chemistry, Internal Report 81-2 Google Scholar
  17. 17.
    von der Malsburg C (1983) How are nervous structures organized. In: Basar E, Flor H, Haken H, Mandell AJ (eds) Synergetics of the brain. Springer series in synergentics, vol 23. Springer, Berlin, pp 238–249 CrossRefGoogle Scholar
  18. 18.
    von der Malsburg C (1986) Am I thinking assemblies. In: Palm G, Aertsen A (eds) Brain theory, October 1–4, 1984. Proceedings of first Trieste meeting on brain theory. Springer, Berlin, pp 161–176 CrossRefGoogle Scholar
  19. 19.
    Shimizu H, Yamaguchi Y, Tsuda I, Yano M (1985) Pattern recognition based on holonic information dynamics: towards synergetic computers. In: Haken H (ed) Complex systems—operational approaches in neurobiology, physics, and computers. Springer series in synergetics. Springer, Berlin, pp 225–239 CrossRefGoogle Scholar
  20. 20.
    von der Malsburg C, Schneider W (1986) A neural cocktail-party processor. Biol Cybern 54:29–40 PubMedCrossRefGoogle Scholar
  21. 21.
    Baird B (1986) Nonlinear dynamics of pattern formation and pattern recognition in the rabbit olfactory bulb. Physica D 22:242–252 CrossRefGoogle Scholar
  22. 22.
    Freeman WJ, Yao Y, Burke B (1988) Central pattern generating and recognizing in olfactory bulb: a correlation learning rule. Neural Netw 1:277–288 CrossRefGoogle Scholar
  23. 23.
    Li Z, Hopfield JJ (1989) Modeling the olfactory bulb and its neural oscillatory processings. Biol Cybern 61:379–392 PubMedCrossRefGoogle Scholar
  24. 24.
    Kuramoto Y (1984) Chemical oscillations, waves, and turbulence. Springer series in synergetics. Springer, Berlin CrossRefGoogle Scholar
  25. 25.
    Acebrón JA, Bonilla LL, Vicente CJP, Ritort F, Spigler R (2005) The Kuramoto model: a simple paradigma for synchronization phenomena. Rev Mod Phys 77:137–185 CrossRefGoogle Scholar
  26. 26.
    Hoppensteadt FC, Izhikevich EM (1997) Weakly connected neural networks. Springer, New York CrossRefGoogle Scholar
  27. 27.
    Hirose A (ed) (2003) Complex-valued neural networks. World Scientific, Singapore Google Scholar
  28. 28.
    Hirose A (2006) Complex-valued neural networks. Springer, Berlin CrossRefGoogle Scholar
  29. 29.
    Rosenblatt F (1961) Principles of neurodynamics: perceptrons and the theory of brain mechanism. Spartan Books, Washington Google Scholar
  30. 30.
    Winfree AT (1980) The geometry of biological time. Springer, New York Google Scholar
  31. 31.
    Ermentrout G, Kopell N (1984) Frequency plateaus in a chain of weakly coupled oscillators. SIAM J Appl Math 15:215–237 CrossRefGoogle Scholar
  32. 32.
    Borisyuk RM, Kazanovich YB (1994) Synchronization in a neural network of phase oscillators with the central element. Biol Cybern 71:177–185 CrossRefGoogle Scholar
  33. 33.
    Borisyuk RM, Kazanovich YB (2004) Oscillatory model of attention-guided object selection and novelty detection. Neural Netw 17:899–915 PubMedCrossRefGoogle Scholar
  34. 34.
    Börgers C, Kopell NJ (2005) Effects of noisy drive on rhythms in networks of excitatory and inhibitory neurons. Neural Comput 17:557–608 PubMedCrossRefGoogle Scholar
  35. 35.
    Whittington MA, Traub RD, Kopell N, Ermentrout B, Buhl EH (2000) Inhibition-based rhythms: experimental and mathematical observations on network dynamics. Int J Psychophysiol 38:315–336 PubMedCrossRefGoogle Scholar
  36. 36.
    Burwick T (2011) Pattern recognition through compatibility of excitatory and inhibitory rhythms. Neurocomputing 74:1315–1328 CrossRefGoogle Scholar
  37. 37.
    Biederman I (1987) Recognition-by-components: a theory of human image understanding. Psychol Rev 94:115–147 PubMedCrossRefGoogle Scholar
  38. 38.
    Tass PA (1999) Phase resetting in medicine and biology. Springer, Berlin Google Scholar
  39. 39.
    Haken H (2002) Brain dynamics: synchronization and activity patterns in pulse-coupled neural nets with delays and noise. Springer, Berlin Google Scholar
  40. 40.
    Fries P, Nicolić D, Singer W (2007) The gamma cycle. Trends Neurosci 30(7):309–316 PubMedCrossRefGoogle Scholar
  41. 41.
    Schneider G, Havenith M, Nikolić D (2006) Spatio-temporal structure in large neuronal networks detected from cross correlation. Neural Comput 18:2387–2413 PubMedCrossRefGoogle Scholar
  42. 42.
    Nikolić D (2007) Non-parametric detection of temporal order across pairwise measurements of time delays. J Comput Neurosci 22:5–19 PubMedCrossRefGoogle Scholar
  43. 43.
    Havenith M, Zemmar A, Yu S, Baudrexel S, Singer W, Nikolić D (2009) Measuring sub-millisecond delays in spiking activity with millisecond time-bins. Neurosci Lett 450:296–300 PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.Frankfurt Institute for Advanced Studies (FIAS)Goethe-UniversitätFrankfurt am MainGermany

Personalised recommendations