Abstract
The authors have proposed a computational model of the cerebral cortex, called the BESOM model, that combines a Bayesian network and Self-Organizing Maps. In this paper, we add another model of the cerebral cortex, called sparse coding, into our model in a biologically plausible way. In the BESOM model, hyper-columns in the cerebral cortex are interpreted as random variables in a Bayesian network. We extend our model so that random variables can become “inactive.” In addition, we apply bias at the time of recognition so that almost all of the random variables may become inactive. This mechanism realizes sparse coding without breaking the theoretical framework of the model based on the Bayesian networks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Fukushima, K.: Neural network model for selective attention in visual-pattern recognition and associative recall. Applied Optics 26(23), 4985–4992 (1987)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco (1988)
Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (1995)
Olshausen, B.A., Field, D.J.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583), 607–609 (1996)
Coward, L.A.: The Recommendation Architecture: lessons from the design of large scale electronic systems for cognitive science. Journal of Cognitive Systems Research 2(2), 111–156 (2001)
Lee, T.S., Mumford, D.: Hierarchical Bayesian inference in the visual cortex. Journal of Optical Society of America, A. 20(7), 1434–1448 (2003)
Olshausen, B.A., Field, D.J.: Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research 37(23), 3311–3325 (2003)
George, D., Hawkins, J.: A hierarchical Bayesian model of invariant pattern recognition in the visual cortex. In: Proc. of IJCNN 2005, vol. 3, pp. 1812–1817 (2005)
Rao, R.: Bayesian inference and attention in the visual cortex. Neuroreport 16(16), 1843–1848 (2005)
Oshiro, N., Kurata, K.: Separating visual information into position and direction by two inhibitory-connected SOMs. Artif. Life and Robotics 9(2), 86–89 (2005)
Ichisugi, Y.: The cerebral cortex model that self-organizes conditional probability tables and executes belief propagation. In: Proc. of International Joint Conference on Neural Networks (IJCNN 2007), pp. 1065–1070 (August 2007)
Roehrbein, F., Eggert, J., Koerner, E.: Bayesian Columnar Networks for Grounded Cognitive Systems. In: Proc. of the 30th Annual Conference of the Cognitive Science Society, pp. 1423–1428 (2008)
Hosoya, H.: A motor learning neural model based on Bayesian network and reinforcement learning. In: Proceedings of International Joint Conference on Neural Networks (2009)
Litvak, S., Ullman, S.: Cortical Circuitry Implementing Graphical Models. Neural Computation 21, 3010–3056 (2009)
Chikkerur, S., Serre, T., Tan, C., Poggio, T.: What and Where: A Bayesian Inference Theory of Attention, Vision Research (2010)
Terashima, H., Hosoya, H.: Sparse codes of harmonic natural sounds and their modulatory interactions. Network: Computation in Neural Systems 20(4), 253–267 (2009)
Furukawa, T.: SOM of SOMs. Neural Networks 22(4), 463–478 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ichisugi, Y., Hosoya, H. (2010). Computational Model of the Cerebral Cortex That Performs Sparse Coding Using a Bayesian Network and Self-Organizing Maps. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds) Neural Information Processing. Theory and Algorithms. ICONIP 2010. Lecture Notes in Computer Science, vol 6443. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17537-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-17537-4_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17536-7
Online ISBN: 978-3-642-17537-4
eBook Packages: Computer ScienceComputer Science (R0)