Selective Weight Update for Neural Network – Its Backgrounds
VSF–Network, Vibration Synchronizing Function Network, is a hybrid neural network combining Chaos Neural Network and hierarchical neural network. VSF–Network is designed for symbol learning. VSF–Network finds unknown parts of input data by comparing to stored pattern and it learns unknown patterns using unused part of the network. New patterns are learned incrementally and they are stored as sub-networks . Combinations of patterns are represented as combinations of the sub-networks. In this paper, the two theoretical backgrounds of VSF–Network are introduced. At the first, an incremental learning framework with Chaos Neural Networks is introduced. Next, the pattern recognition with the combined with symbols is introduced. From the viewpoints of9 differential topology and mixture distribution, the combined pattern recognition by VSF-Network is explained. Through an experiment, both the incremental learning capability and the pattern recognition with pattern combination are shown.
Index TermsIncremental learning Chaos Neural network nonlinear dynamics catastrophe theory
Unable to display preview. Download preview PDF.
- 2.Kakemoto, Y., Nakasuka, S.: Neural assembly generation by selective connection weight updating. In: Proc. IjCNN 2010 (2010)Google Scholar
- 3.Inamura, T., Tanie, H., Nakamura, Y.: Proto-symbol development and manipulation in the geometry of stochastic model for motion generation and recognition. Technical Report NC2003-65, IEICE (2003)Google Scholar
- 4.Chandler, D.: Semiotics for Beginners. Routledge (1995)Google Scholar
- 6.Lin, M., Tang, K., Yao, X.: Incremental learning by negative correlation leaning. In: Proc. of IJCNN 2008 (2008)Google Scholar
- 11.Komuro, M.: A mechanism of chaotic itinerancy in globally coupled maps. In: Dynamical Systems (NDDS 2002) (2002)Google Scholar
- 14.Thom, R.: Stability and Morphogenesis.: Essai D’une Theorie Generale Des Modeles. W. A. Benjamin, California (1973)Google Scholar
- 15.Grasman, R., van der Maas, H., Wagenmakers, E.: Journal of statistical software. Mathematical Modelling 32, 1–27 (2009)Google Scholar