Skip to main content
SpringerLink
Log in
Book cover

Advances in Cognitive Neurodynamics (III) pp 31–36Cite as

Mathematical Theory of Neural Networks: A Personal and Historical Survey

  • Conference paper
  • First Online:

  • 848 Accesses

Abstract

Mathematical neuroscience has become an important discipline of neuroscience, although it has not yet been fully established. We state historical remarks on the progress of mathematical neuroscience from the personal viewpoint. We also show some formulations of mathematical neuroscience with historical comments. We conclude with long-standing unsolved problems.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Amari, S.: Mathematical Theory of Neural Networks (in Japanese). Sangyou-tosyo (1978).

    Google Scholar 

  2. Amari, S.: Theory of Adaptive Pattern Classifiers. IEEE Trans. EC-16(3)(1967) 299–307.

    Google Scholar 

  3. Amari, S.: Characteristics of Randomly Connected Threshold-Element Networks and Network Systems. Proc. IEEE. 59(1)(1971) 35–47.

    Article  Google Scholar 

  4. Amari, S.: Neural Theory of Association and Concept -Formation. Biological Cybernetics 26(1977) 175–185.

    Article  CAS  PubMed  Google Scholar 

  5. Amari, S., Yoshida, K., Kanatani, K.: A Mathematical Foundation for Statistical Neurodynamics. SIAM J. Appl. Math. 33(1977) 95–126.

    Article  Google Scholar 

  6. Amari, S.: Dynamics of Pattern Formation in Lateral-Inhibition Type Neural Fields. Biological Cybernetics 27(1977) 77–87.

    Article  CAS  PubMed  Google Scholar 

  7. Amari, S.: Characteristics of Random Nets of Analog Neuron-Like Elements. IEEE Trans. Systems, Man and Cybernetics SMC-2(5)(1972) 643–657. (also Artificial Neural Networks Theoretical Concepts. ed. Vemri, V.. IEEE Comp. Soc. (1988))

    Google Scholar 

  8. Amari, S.: Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements. IEEE Trans. Computers C-21(11)(1972) 1197–1206.

    Article  Google Scholar 

  9. Amari, S.: A Method of Statistical Neurodynamics. Kybernetik 14(1974) 201–215.

    CAS  Google Scholar 

  10. Amari, S., Takeuchi, A.: Mathematical Theory on Formation of Category Detecting Nerve Cells. Biol. Cybernetics 29(1978) 127–136.

    Article  CAS  Google Scholar 

  11. Takeuchi, A., Amari, S.: Formation of Topographic Maps and Columnar Microstructures. Biol. Cybernetics 35(1979) 63–72.

    Article  CAS  Google Scholar 

  12. Amari, S.: Field theory of self-organizing neural nets. IEEE Trans. Systems, Man and Cybernetics SMC-13(9&10)(1983) 741–748.

    Google Scholar 

  13. Amari, S., Maginu, K.: Statistical neurodynamics of associative memory. Neural Networks 1(1)(1988) 63–73.

    Article  Google Scholar 

  14. Amari, S.: Mathematical Foundations of Neurocomputing. Proceedings of the IEEE 78(9)(1990) 1443–1463.

    Article  Google Scholar 

  15. Amari, S.: A Universal Theorem on Learning Curves. Neural Networks 6(2)(1993) 161–166.

    Article  Google Scholar 

  16. Amari, S., Kurata, K., Nagaoka, H.: Information Geometry of Boltzmann Machines. IEEE Trans. on Neural Networks 3(2)(1992) 260–271.

    Article  CAS  Google Scholar 

  17. Amari, S.: The EM Algorithm and Information Geometry in Neural Network Learning. Neural Computation 7(1)(1995) 13–18.

    Article  Google Scholar 

  18. Amari, S.: Natural Gradient Works Efficiently in Learning. Neural Computation 10(2)(1998) 251–276.

    Article  Google Scholar 

  19. Amari, S., Ozeki, T., Park, H.: Learning and Inference in Hierarchical Models with Singularities. Systems and Computers in Japan 34(7)(2003) 34–42.

    Article  Google Scholar 

  20. Amari, S.: Conditional Mixture Model for Correlated Neuronal Spikes. Neural Computation 22(7)(2010) 1718–1736.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory for Mathematical Neuroscience, RIKEN Brain Science Institute, Saitama, 351-0198, Japan

    Shun-ichi Amari

Authors
  1. Shun-ichi Amari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shun-ichi Amari .

Editor information

Editors and Affiliations

  1. Lab. for Dynamics of Emergent Intelligen, RIKEN Brain Science Institute Lab. for Dynamics of Emergent Intelligen, Wako City, Japan

    Yoko Yamaguchi

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht

About this paper

Cite this paper

Amari, Si. (2013). Mathematical Theory of Neural Networks: A Personal and Historical Survey. In: Yamaguchi, Y. (eds) Advances in Cognitive Neurodynamics (III). Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4792-0_5

Download citation

Publish with us

Policies and ethics

Search

Navigation