Skip to main content

Toward Human-Level Massively-Parallel Neural Networks with Hodgkin-Huxley Neurons

  • Conference paper
  • First Online:
Artificial General Intelligence (AGI 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9782))

Included in the following conference series:

Abstract

This paper describes neural network algorithms and software that scale up to massively parallel computers. The neuron model used is the best available at this time, the Hodgkin-Huxley equations. Most massively parallel simulations use very simplified neuron models, which cannot accurately simulate biological neurons and the wide variety of neuron types. Using C++ and MPI we can scale these networks to human-level sizes. Computers such as the Chinese TianHe computer are capable of human level neural networks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. http://www.wormatlas.org/

  2. Skocik, M.J., Long, L.N.: On the capabilities and computational costs of neuron models. IEEE Trans. Neural Netw. Learn. 25(8), 1474–1483 (2014)

    Article  Google Scholar 

  3. Long, L.N.: Efficient neural network simulations using the Hodgkin-Huxley equations. In: Conference on 60 Years of Hodgkin and Huxley, Trinity College, Cambridge, 12–13 July 2012

    Google Scholar 

  4. www.top500.org

  5. Markram, H., et al.: Reconstruction and simulation of neocortical microcircuitry. Cell 163(2), 456–492 (2015)

    Article  Google Scholar 

  6. www.nest-initiative.org

  7. https://www.neuron.yale.edu/

  8. Bower, J.M., David, B.: The Book of GENESIS: Exploring Realistic Neural Models with the GEneral NEural SImulation System. Springer, Heidelberg (2012)

    MATH  Google Scholar 

  9. Reimann, M.W., Anastassiou, C.A., Perin, R., Hill, S.L., Markram, H., Koch, C.: Biophysically detailed model of neocortical local field potentials predicts the critical role of active membrane currents. Neuron 79, 375–390 (2013)

    Article  Google Scholar 

  10. Kelley, T.D., Avery, E., Long, L.N., Dimperio, E.: A hybrid symbolic and sub-symbolic intelligent system for mobile robots. In: InfoTech@Aerospace Conference, Seattle, WA, AIAA, Reston, VA, AIAA Paper 2009–1976 (2009)

    Google Scholar 

  11. Hodgkin, A.L., Huxley, A.F.: A quantitative description of ion currents and its applications to conduction and excitation in nerve membranes. J. Physiol. 117, 500–544 (1952)

    Article  Google Scholar 

  12. Izhikevich, E.M.: Which model to use for cortical spiking neurons? IEEE Trans. Neural Netw. 15(5), 1063–1070 (2004)

    Article  Google Scholar 

  13. http://www.mpi-forum.org/docs/mpi-3.0/mpi30-report.pdf

  14. Bostrom, N.: SuperIntelligence: Paths, Dangers, Strategies, Oxford Press, Oxford, England (2014)

    Google Scholar 

  15. Long, L.N., Gupta, A., Fang, G.: A computational approach to neurogenesis and synaptogenesis using biologically plausible models with learning. In: Frontiers in Systems Neuroscience, Conference Abstract: Computational and Systems Neuroscience (COSYNE) Meeting, Salt Lake City, Utah, Feb. 25–28 2010

    Google Scholar 

  16. French, R.M.: Catastrophic forgetting in connectionist networks. Trends Cogn. Sci. 3(4), 128–135 (1999)

    Article  MathSciNet  Google Scholar 

  17. Long, L.N., Gupta, A.: Scalable massively parallel artifical neural networks. J. Aerosp. Comput. Inf. Commun. (JACIC), 5(1), 3–15 (2008)

    Article  Google Scholar 

  18. Gupta, A., Long, L.N.: Hebbian learning with winner take all for spiking neural networks. In: IEEE International Joint Conference on Neural Networks (IJCNN), Atlanta, Georgia, June 14–19 (2009)

    Google Scholar 

  19. Long, L.N.: An adaptive spiking neural network with hebbian learning. In: Presented at the IEEE Workshop on Evolving and Adaptive Intelligent Systems, Symposium Series on Computational Intelligence, Paris, France, April 11–15 (2011)

    Google Scholar 

  20. Long, L.N.: Scalable biologically inspired neural networks with spike time based learning. In: Invited Paper, IEEE Symposium on Learning and Adaptive Behavior in Robotic Systems, Edinburgh, Scotland, Aug. 6–8 2008

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lyle N. Long .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Long, L.N. (2016). Toward Human-Level Massively-Parallel Neural Networks with Hodgkin-Huxley Neurons. In: Steunebrink, B., Wang, P., Goertzel, B. (eds) Artificial General Intelligence. AGI 2016. Lecture Notes in Computer Science(), vol 9782. Springer, Cham. https://doi.org/10.1007/978-3-319-41649-6_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41649-6_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41648-9

  • Online ISBN: 978-3-319-41649-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics