Neural networks are networks of nerve cells in the brains of humans and animals. The human brain has about 100 billion nerve cells. We humans owe our intelligence and our ability to learn various motor skills and intellectual capabilities to the brain’s complex relays and adaptivity. The nerve cells and their connections are responsible for awareness, associations, thoughts, consciousness and the ability to learn. Mathematical models of neural networks and their implementation on computers are nowadays used in many applications such as pattern recognition or robot learning. The power of this fascinating bionics branch of AI is demonstrated on some popular network models applied to various tasks.
KeywordsNeural Network Support Vector Machine Sigmoid Function Output Neuron Associative Memory
- [Alp04]E. Alpaydin. Introduction to Machine Learning. MIT Press, Cambridge, 2004. Google Scholar
- [APR90]J. Anderson, A. Pellionisz, and E. Rosenfeld. Neurocomputing (vol. 2): Directions for Research. MIT Press, Cambridge, 1990. Google Scholar
- [AR88]J. Anderson and E. Rosenfeld. Neurocomputing: Foundations of Research. MIT Press, Cambridge, 1988. Collection of fundamental original papers. Google Scholar
- [Bis05]C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, London, 2005. Google Scholar
- [ESS89]W. Ertel, J. Schumann, and Ch. Suttner. Learning heuristics for a theorem prover using back propagation. In J. Retti and K. Leidlmair, editors, 5. Österreichische Artificial-Intelligence-Tagung. Informatik-Fachberichte, volume 208, pages 87–95. Springer, Berlin, 1989. Google Scholar
- [HKP91]J. Hertz, A. Krogh, and R. Palmer. Introduction to the Theory of Neural Computation. Addison–Wesley, Reading, 1991. Google Scholar
- [Pal91]G. Palm. Memory capacities of local rules for synaptic modification. Concepts Neurosci., 2(1):97–128, 1991. MPI Tübingen. Google Scholar
- [RHR86]D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. In [RM86]. Google Scholar
- [RM86]D. Rumelhart and J. McClelland. Parallel Distributed Processing, volume 1. MIT Press, Cambridge, 1986. Google Scholar
- [Roj96]R. Rojas. Neural Networks: A Systematic Introduction. Springer, Berlin, 1996. Google Scholar
- [SE90]Ch. Suttner and W. Ertel. Automatic acquisition of search guiding heuristics. In 10th Int. Conf. on Automated Deduction. LNAI, volume 449, pages 470–484. Springer, Berlin, 1990. Google Scholar
- [SR86]T. J. Sejnowski and C. R. Rosenberg. NETtalk: a parallel network that learns to read aloud. Technical Report JHU/EECS-86/01. The John Hopkins University Electrical Engineering and Computer Science Technical Report, 1986. Reprint in [AR88], pages 661–672. Google Scholar
- [SS02]S. Schölkopf and A. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, 2002. Google Scholar
- [Wik10]Wikipedia, the free encyclopedia, 2010. http://en.wikipedia.org.