Training of Multi-Layer Neural Network

  • Phil Kim


In an effort to overcome the practical limitations of the single-layer, the neural network evolved into a multi-layer architecture. However, it has taken approximately 30 years to just add on the hidden layer to the single-layer neural network. It’s not easy to understand why this took so long, but the problem involved the learning rule. As the training process is the only method for the neural network to store information, untrainable neural networks are useless. A proper learning rule for the multi-layer neural network took quite some time to develop.


Neural Network Cost Function Hide Layer Hide Node Output Node 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Copyright information

© Phil Kim 2017

Authors and Affiliations

  • Phil Kim
    • 1
  1. 1.SeoulKorea (Republic of)

Personalised recommendations