Coupling BCM and Neural Fields for the Emergence of Self-organization Consensus

  • Mathieu Lefort
  • Yann Boniface
  • Bernard Girau
Part of the Advances in Experimental Medicine and Biology book series (AEMB, volume 718)


Human beings interact with the environment through different modalities, i.e. perceptions and actions, processed in the cortex by dedicated brain areas. These areas are self-organized, so that spatially close neurons are sensitive to close stimuli, providing generalization from previously learned examples. Although perceptive flows are picked up by different spatially separated sensors, their processings are not isolated. On the contrary, they are constantly interacting, as illustrated by the McGurk effect. When the auditory stimulus /ba/ and the /ga/ lip movement are presented simultaneously, people perceive a /da/, which does not correspond to any of the stimuli. Merging several stimuli into one multimodal perception reduces ambiguities and noises and is essential to interact with the environment. This article proposes a model for modality association, inspired by the biological properties of the cortex. The model consists of modality maps interacting through an associative map to raise a consistent multimodal perception of the environment. We propose the coupling of BCM learning rule and neural maps to obtain the decentralized and unsupervised self-organization of each modal map influenced by the multisensory context. We obtain local self-organization of modal maps with various inputs and discretizations.


Long Term Potentiation Spatial Competition Current Perception Sensory Layer Cortical Column 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Amari, S.-I.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27, 77–87 (1977) PubMedCrossRefGoogle Scholar
  2. 2.
    Bear, M.F.: Mechanism for a sliding synaptic modification threshold. Neuron 15(1), 1–4 (1995) PubMedCrossRefGoogle Scholar
  3. 3.
    Bienenstock, E.L., Cooper, L.N., Munro, P.W.: Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2(1), 32–48 (1982) PubMedGoogle Scholar
  4. 4.
    Bonath, B., Noesselt, T., Martinez, A., Mishra, J., Schwiecker, K., Heinze, H.-J., Hillyard, S.A.: Neural basis of the ventriloquist illusion. Curr. Biol. 17(19), 1697–1703 (2007). doi: 10.1016/j.cub.2007.08.050 PubMedCrossRefGoogle Scholar
  5. 5.
    Bosking, W.H., Zhang, Y., Schofield, B., Fitzpatrick, D.: Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. J. Neurosci. 17(6), 2112–2127 (1997) PubMedGoogle Scholar
  6. 6.
    Burnod, Y.: An Adaptive Neural Network: The Cerebral Cortex. Masson, Paris (1990) Google Scholar
  7. 7.
    Cooper, L.N., Intrator, N., Blais, B.S., Shouval, H.Z.: Theory of Cortical Plasticity. World Scientific, Singapore (2004) CrossRefGoogle Scholar
  8. 8.
    Cooper, L.N., Liberman, F., Oja, E.: A theory for the acquisition and loss of neuron specificity in visual cortex (1979) Google Scholar
  9. 9.
    Elbert, T., Rockstroh, B.: Reorganization of human cerebral cortex: the range of changes following use and injury. The Neuroscientist 10(2), 129 (2004) PubMedCrossRefGoogle Scholar
  10. 10.
    Gibson, J.J.: The Theory of Affordances. In: Shaw, R., Bransford, J. (eds.) Perceiving, Acting, and Knowing: Toward an Ecological Psychology, pp. 67–82 (1977) Google Scholar
  11. 11.
    Girod, T., Alexandre, F.: Effects of a modulatory feedback upon the BCM learning rule. In: CNS, 2009 Google Scholar
  12. 12.
    Goldring, J.E., Dorris, M.C., Corneil, B.D., Ballantyne, P.A., Munoz, D.R.: Combined eye-head gaze shifts to visual and auditory targets in humans. Exp. Brain Res. 111, 68–78 (1996). doi: 10.1007/BF00229557 PubMedCrossRefGoogle Scholar
  13. 13.
    Kohonen, T.: Self-organization and associative memory. Appl. Opt. 24, 145–147 (1985) Google Scholar
  14. 14.
    Ménard, O., Frezza-Buet, H.: Model of multi-modal cortical processing: coherent learning in self-organizing modules. Neural Netw. 18(5–6), 646–655 (2005). doi: 10.1016/j.neunet.2005.06.036 PubMedCrossRefGoogle Scholar
  15. 15.
    Mountcastle, V.B.: The columnar organization of the neocortex. Brain 120(4), 701 (1997) PubMedCrossRefGoogle Scholar
  16. 16.
    Noë, A.: Action in Perception. MIT Press, Cambridge (2004) Google Scholar
  17. 17.
    Rougier, N.P., Vitay, J.: Emergence of attention within a neural population. Neural Netw. 19(5), 573–581 (2006) PubMedCrossRefGoogle Scholar
  18. 18.
    Salinas, E., Thier, P.: Gain modulation: a major computational principle of the central nervous system. Neuron 27(1), 15–21 (2000) PubMedCrossRefGoogle Scholar
  19. 19.
    Wallace, M.T.: The development of multisensory processes. Cogn. Process. 5, 69–83 (2004). doi: 10.1007/s10339-004-0017-z CrossRefGoogle Scholar
  20. 20.
    Widrow, B., Hoff, M.E.: Adaptive switching circuits. Neurocomp. Fund. Res. 123–134 (1988) Google Scholar
  21. 21.
    Wilson, H.R., Cowan, J.D.: A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Biol. Cybern. 13(2), 55–80 (1973) Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.LORIAVandoeuvre-lès-Nancy CedexFrance
  2. 2.INRIA/LORIA LaboratoryCampus ScientifiqueVandoeuvre-lès-Nancy CedexFrance

Personalised recommendations