Neural networks are networks of nerve cells in the brains of humans and animals. The human brain has about 100 billion nerve cells. We humans owe our intelligence and our ability to learn various motor skills and intellectual capabilities to the brain’s complex relays and adaptivity. The nerve cells and their connections are responsible for awareness, associations, thoughts, consciousness and the ability to learn. Mathematical models of neural networks and their implementation on computers are nowadays used in many applications such as pattern recognition or robot learning. The power of this fascinating bionics branch of AI is demonstrated on some popular network models applied to various tasks.


Neural Network Support Vector Machine Sigmoid Function Output Neuron Associative Memory 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. [Alp04]
    E. Alpaydin. Introduction to Machine Learning. MIT Press, Cambridge, 2004. Google Scholar
  2. [APR90]
    J. Anderson, A. Pellionisz, and E. Rosenfeld. Neurocomputing (vol. 2): Directions for Research. MIT Press, Cambridge, 1990. Google Scholar
  3. [AR88]
    J. Anderson and E. Rosenfeld. Neurocomputing: Foundations of Research. MIT Press, Cambridge, 1988. Collection of fundamental original papers. Google Scholar
  4. [Bis05]
    C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, London, 2005. Google Scholar
  5. [Bur98]
    C. J. Burges. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov., 2(2):121–167, 1998. CrossRefGoogle Scholar
  6. [ESS89]
    W. Ertel, J. Schumann, and Ch. Suttner. Learning heuristics for a theorem prover using back propagation. In J. Retti and K. Leidlmair, editors, 5. Österreichische Artificial-Intelligence-Tagung. Informatik-Fachberichte, volume 208, pages 87–95. Springer, Berlin, 1989. Google Scholar
  7. [HKP91]
    J. Hertz, A. Krogh, and R. Palmer. Introduction to the Theory of Neural Computation. Addison–Wesley, Reading, 1991. Google Scholar
  8. [Hop82]
    J. J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA, 79:2554–2558, 1982. Reprint in [AR88], pages 460–464. CrossRefMathSciNetGoogle Scholar
  9. [HT85]
    J. J. Hopfield and D. W. Tank. “Neural” computation of decisions in optimization problems. Biol. Cybern., 52(3):141–152, 1985. Springer. MATHMathSciNetGoogle Scholar
  10. [Koh72]
    T. Kohonen. Correlation matrix memories. IEEE Trans. Comput., C-21(4):353–359, 1972. Reprint in [AR88], pages 171–174. CrossRefGoogle Scholar
  11. [Pal80]
    G. Palm. On associative memory. Biol. Cybern., 36:19–31, 1980. CrossRefMATHGoogle Scholar
  12. [Pal91]
    G. Palm. Memory capacities of local rules for synaptic modification. Concepts Neurosci., 2(1):97–128, 1991. MPI Tübingen. Google Scholar
  13. [RB93]
    M. Riedmiller and H. Braun. A direct adaptive method for faster backpropagation learning: the rprop algorithm. In Proceedings of the IEEE International Conference on Neural Networks, pages 586–591, 1993. CrossRefGoogle Scholar
  14. [RHR86]
    D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. In [RM86]. Google Scholar
  15. [RM86]
    D. Rumelhart and J. McClelland. Parallel Distributed Processing, volume 1. MIT Press, Cambridge, 1986. Google Scholar
  16. [RMS92]
    H. Ritter, T. Martinez, and K. Schulten. Neural Computation and Self-organizing Maps. Addison–Wesley, Reading, 1992. MATHGoogle Scholar
  17. [Roj96]
    R. Rojas. Neural Networks: A Systematic Introduction. Springer, Berlin, 1996. Google Scholar
  18. [SE90]
    Ch. Suttner and W. Ertel. Automatic acquisition of search guiding heuristics. In 10th Int. Conf. on Automated Deduction. LNAI, volume 449, pages 470–484. Springer, Berlin, 1990. Google Scholar
  19. [SR86]
    T. J. Sejnowski and C. R. Rosenberg. NETtalk: a parallel network that learns to read aloud. Technical Report JHU/EECS-86/01. The John Hopkins University Electrical Engineering and Computer Science Technical Report, 1986. Reprint in [AR88], pages 661–672. Google Scholar
  20. [SS02]
    S. Schölkopf and A. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, 2002. Google Scholar
  21. [Wik10]
    Wikipedia, the free encyclopedia, 2010.
  22. [Zel94]
    A. Zell. Simulation Neuronaler Netze. Addison–Wesley, Reading, 1994. Description of SNNS and JNNS: MATHGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.FB Elektrotechnik und InformatikHochschule Ravensburg-Weingarten, University of Applied SciencesWeingartenGermany

Personalised recommendations