Journal of Computational Neuroscience

, Volume 31, Issue 3, pp 485–507 | Cite as

A Markovian event-based framework for stochastic spiking neural networks



In spiking neural networks, the information is conveyed by the spike times, that depend on the intrinsic dynamics of each neuron, the input they receive and on the connections between neurons. In this article we study the Markovian nature of the sequence of spike times in stochastic neural networks, and in particular the ability to deduce from a spike train the next spike time, and therefore produce a description of the network activity only based on the spike times regardless of the membrane potential process. To study this question in a rigorous manner, we introduce and study an event-based description of networks of noisy integrate-and-fire neurons, i.e. that is based on the computation of the spike times. We show that the firing times of the neurons in the networks constitute a Markov chain, whose transition probability is related to the probability distribution of the interspike interval of the neurons in the network. In the cases where the Markovian model can be developed, the transition probability is explicitly derived in such classical cases of neural networks as the linear integrate-and-fire neuron models with excitatory and inhibitory interactions, for different types of synapses, possibly featuring noisy synaptic integration, transmission delays and absolute and relative refractory period. This covers most of the cases that have been investigated in the event-based description of spiking deterministic neural networks.


Stochastic network Linear integrate-and-fire neurons Event-based model Event-based simulation 



The authors warmly acknowledge Romain Brette for very insightful discussions on the concepts, Philippe Robert for interesting discussions and for reading suggestions, Olivier Rochel for his introduction to MVA Spike and for sharing his code, and Renaud Keriven and Alexandre Chariot for developing a GPU simulation code (not presented here). This work was partially supported by the ERC advanced grant NerVi number 227747.


  1. Arbib (1998). The handbook of brain theory and neural networks. Cambridge: MIT Press.Google Scholar
  2. Asmussen, S., & Turova, T. S. (1998). Stationarity properties of neural networks. Journal of Applied Probabilities, 35, 783–794.CrossRefGoogle Scholar
  3. Brette, R. (2006). Exact simulation of integrate-and-fire models with synaptic conductances. Neural Computation, 18(8), 2004–2027.PubMedCrossRefGoogle Scholar
  4. Brette, R. (2007). Exact simulation of integrate-and-fire models with exponential currents. Neural Computation, 19(10), 2604–2609.PubMedCrossRefGoogle Scholar
  5. Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J. M., et al. (2007). Simulation of networks of spiking neurons: A review of tools and strategies. Journal of Computational Neuroscience, 23(3), 349–398.PubMedCrossRefGoogle Scholar
  6. Brunel, N., & Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Computation, 11, 1621–1671.PubMedCrossRefGoogle Scholar
  7. Cessac, B. (2008). A discrete time neural network model with spiking neurons. Journal of Mathematical Biology, 56(3), 311–345. doi: 10.1007/s00285-007-0117-3.PubMedCrossRefGoogle Scholar
  8. Cessac, B. (2010). A discrete time neural network model with spiking neurons: II: Dynamics with noise. Journal of Mathematical Biology, 1–38. doi: 10.1007/s00285-010-0358-4.
  9. Claverol, E., Brown, A., & Chad, J. (2002). Discrete simulation of large aggregates of neurons. Neurocomputing, 47, 277–297.CrossRefGoogle Scholar
  10. Cottrell, M. (1992). Mathematical analysis of a neural network with inhibitory coupling. Stochastic Processes and their Applications, 40, 103–127.CrossRefGoogle Scholar
  11. Cottrell, M., & Turova, T. (2000). Use of an hourglass model in neuronal coding. Journal of applied probability, 37, 168–186.CrossRefGoogle Scholar
  12. Davis, M. (1984). Piecewise-deterministic markov processes: A general class of non-diffusion stochastic models. Journal of the Royal Society, Series B (Methodological), 46, 353–388.Google Scholar
  13. Delorme, A., & Thorpe, S. (2001). Face processing using one spike per neuron: resistance to image degradation. Neural Networks, 14, 795–804.PubMedCrossRefGoogle Scholar
  14. Delorme, A., & Thorpe, S. (2003). 57 spikenet: An event-driven simulation package for modelling large networks of spiking neurons. Network, 14(4), 613–627.PubMedCrossRefGoogle Scholar
  15. Fabre-Thorpe, M., Richard, G., & Thorpe, S. (1998). Rapid categorization of natural images by rhesus monkeys. Neuroreport, 9(2), 303–308.PubMedCrossRefGoogle Scholar
  16. Fricker, C., Robert, P., Saada, E., & Tibi, D. (1994). Analysis of some networks with interaction. Annals of Applied Probability, 4, 1112–1128.CrossRefGoogle Scholar
  17. Gerstner, W., & Kistler, W. (2002a). Spiking neuron models. Cambridge: Cambridge University Press.Google Scholar
  18. Gerstner, W., & Kistler, W. M. (2002b). Mathematical formulations of hebbian learning. Biological Cybernetics, 87, 404–415.PubMedCrossRefGoogle Scholar
  19. Gobet, E. (2000). Weak approximation of killed diffusion using Euler schemes. Stochastic Processes and their Applications, 87(2), 167–197.CrossRefGoogle Scholar
  20. Goldman, M. (1971). On the first passage of the integrated Wiener process. Annals of Mathematical Statistics, 42, 2150–2155.CrossRefGoogle Scholar
  21. Gromoll, H., Robert, P., & Zwart, B. (2008). Fluid limits for processor sharing queues with impatience. Mathematics of Operations Research, 33(2), 375–402.CrossRefGoogle Scholar
  22. Holden, A. (1976). Models of the stochastic activity of neurones. Lecture Notes in Biomathematics, 12, 1–368.Google Scholar
  23. Izhikevich, E. M., & Edelman, G. M. (2008). Large-scale model of mammalian thalamocortical systems. Proceedings of the National Academy of Sciences of the United States of America, 105(9), 3593–3598.PubMedCrossRefGoogle Scholar
  24. Kandel, E., Schwartz, J., & Jessel, T. (2000). Principles of neural science (4th ed.). New York: McGraw-Hill.Google Scholar
  25. Karatzas, I., & Shreve, S. (1987). Brownian motion and stochatic calculus. New York: Springer.Google Scholar
  26. Kloeden, P., & Platen, E. (1992). Numerical solution of stochastic differential equations. New York: Springer.Google Scholar
  27. Lachal, A. (1991). Sur le premier instant de passage de l’intégrale du mouvement brownien. Annales de l’IHP, Section B, 27, 385–405.Google Scholar
  28. Lachal, A. (1996). Sur la distribution de certaines fonctionnelles de l’int’egrale du mouvement Brownien avec d’erives parabolique et cubique. Communications on Pure and Applied Mathematics, 49, 1299–1338.CrossRefGoogle Scholar
  29. Makino, T. (2003). A discrete-event neural network simulator for general neuron models. Neural Computing & Applications, 11, 210–223.CrossRefGoogle Scholar
  30. Marian, I., Reilly, R., & Mackey, D. (2002). Efficient event-driven simulation of spiking neural networks. In Proceedings of the 3rd WSEAS international conference on neural networks and applications.Google Scholar
  31. McKean, H. P. (1963). A winding problem for a resonator driven by a white noise. Journal of Mathematics of Kyoto University, 2, 227–235.Google Scholar
  32. Plesser, H. E. (1999). Aspects of signal processing in noisy neurons. PhD thesis, Georg-August-Universität.Google Scholar
  33. Ricciardi, L., & Smith, C. (1977). Diffusion processes and related topics in biology. New York: Springer.Google Scholar
  34. Rolls, E., & Deco, G. (2010). The noisy brain: Stochastic dynamics as a principle of brain function. London: Oxford University Press.Google Scholar
  35. Roxin, A., Brunel, N., & Hansel, D. (2005). Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. Physical Review Letters, 94(23), 238103.PubMedCrossRefGoogle Scholar
  36. Rudolph, M., & Destexhe, A. (2006). Analytical integrate-and-fire neuron models with conductance-based dynamics for event-driven simulation strategies. Neural Computation, 18, 2146–2210.PubMedCrossRefGoogle Scholar
  37. Shadlen, M. N., & Newsome, W. T. (1994). Noise, neural codes and cortical organization. Current Opinion in Neurobiology, 4(4), 569–579.PubMedCrossRefGoogle Scholar
  38. Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps. Journal of Neuroscience, 13, 334–350.PubMedGoogle Scholar
  39. Thorpe, S., Delorme, A., & VanRullen, R. (2001). Spike based strategies for rapid processing. Neural Networks, 14, 715–726.PubMedCrossRefGoogle Scholar
  40. Tonnelier, A., Belmabrouk, H., & Martinez, D. (2007). Event-driven simulations of nonlinear integrate-and-fire neurons. Neural Computation, 19(12), 3226–3238.PubMedCrossRefGoogle Scholar
  41. Touboul, J. (2008). Nonlinear and stochastic models in neuroscience. PhD thesis, Ecole Polytechnique.Google Scholar
  42. Touboul, J., & Faugeras, O. (2007). The spikes trains probability distributions: A stochastic calculus approach. Journal of Physiology, Paris, 101(1–3), 78–98.PubMedCrossRefGoogle Scholar
  43. Touboul, J., & Faugeras, O. (2008). First hitting time of double integral processes to curved boundaries. Advances in Applied Probability, 40(2), 501–528.CrossRefGoogle Scholar
  44. Tuckwell, H. C. (1988). Introduction to theoretical neurobiology. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  45. Turova, T. (2000). Neural networks through the hourglass. BioSystems, 58, 159–165.PubMedCrossRefGoogle Scholar
  46. Turova, T. S. (1996). Analysis of a biological plausible neural network via an hourglass model. Markov Processes and Related Fields, 2, 487–510.Google Scholar
  47. Watts, L. (1994). Event-driven simulation of networks of spiking neurons. Advances in Neural Information Processing System, 7, 927–934.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  1. 1.NeuroMathComp LaboratoryINRIASophia AntipolisFrance

Personalised recommendations