Learning Process in a Neural Network Model
- 5 Downloads
The firing and the learning processes are the dynamics in a neural system on fast and slow time scales. In this paper, we study a neural network model that describes the two different dynamics in a unified manner. The model makes it possible to predict the firing probability or the firing correlation in a biological neural system much exactly via a path integral formulation. Also, an ideal learning process in the model system is defined to minimize the path-integral free energy. The learning principle explains how the typical form of plasticity in a biological synapse is determined. Further, the model makes it possible to understand or predict the emergent structures in a biological neural system through the basic principles in (statistical) physics. We investigate how the thermodynamic potentials in the free energy, such as the internal energy, the Gibbs potential, and the entropy, exert effects on the general learning behavior of the model system. In addition, we demonstrate that the derivative of an effective free energy leads to a learning equation for feature map formation.
KeywordsNeural network Learning theory Free energy principle
Unable to display preview. Download preview PDF.
- D. O. Hebb, The Organization of Behavior: A Neurophysiological Theory (Wiley, New York, 1949).Google Scholar
- J. C. Principe, N. R. Euliano and W. C. Lefebvre, Neural and Adaptive Systems: Fundamentals through Simulations (John Wiley & Sons, New York, 2000).Google Scholar
- S. Haykin, Neural Networks and Learning Machines (Pearson Education, New York, 2009).Google Scholar
- M. W. Cho, New Physics: Sae Mulli 67, 862 (2017).Google Scholar
- M. W. Cho, New Physics: Sae Mulli 67, 357 (2017).Google Scholar
- M. W. Cho, New Physics: Sae Mulli 65, 456 (2015).Google Scholar