Networks that Learn

  • V. Srinivasa ChakravarthyEmail author


Walter Pitts and Warren McCulloch had a challenging task ahead of them. They wanted to take a first shot at developing the mathematics of the brain. When faced with the unknown, it is natural to try to express it in terms of the known. McCulloch and Pitts knew something about the mathematics of the modern computer. They worked at the time of WWII. It was also the time when the first general-purpose electronic computer, the ENIAC, was built at the University of Pennsylvania. It performed computations a thousand times faster than the electromechanical computers that existed before. Most importantly, it could be programmed. The full power of the logic of computation, the Boolean logic, was at work in ENIAC. Popular media of those days described it as a “giant brain,” referring to its monstrous size.


  1. Buchanan, B. G. (2005, Winter) A (Very) brief history of artificial intelligence. AI Magazine, pp. 53–60.
  2. Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function mathematics of control. Signals, and Systems, 2(4), 303–314.MathSciNetCrossRefGoogle Scholar
  3. Kumar, S. (2004). Neural networks: A classroom approach (736 pages). New York: Tata McGraw-Hill Education.Google Scholar
  4. McCulloch, W., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 7, 115–133.MathSciNetCrossRefGoogle Scholar
  5. Minsky, M. L., & Papert, S. A. (1969). Perceptrons. Cambridge, MA: MIT Press.zbMATHGoogle Scholar
  6. Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6), 386–408. Scholar
  7. Rosenblatt, F. (1962). Principles of neurodynamics. Washington, DC: Spartan Books.zbMATHGoogle Scholar
  8. Rumelhart, D. E., & McClelland, J. L. (Eds.). (1982). Parallel distributed processing: Explorations in microcognition (Vols. 1 and II). Cambridge, MA: MIT Press.Google Scholar
  9. Sejnowski, T. J., & Rosenberg, C. R. (1988). NETtalk: A parallel network that learns to read aloud. In J. A. Anderson & E. Rosenfeld (Eds.), Neurocomputing foundations of research (pp. 663–672). Cambridge, MA: The MIT Press.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Indian Institute of Technology MadrasChennaiIndia

Personalised recommendations