A Markovian event-based framework for stochastic spiking neural networks
In spiking neural networks, the information is conveyed by the spike times, that depend on the intrinsic dynamics of each neuron, the input they receive and on the connections between neurons. In this article we study the Markovian nature of the sequence of spike times in stochastic neural networks, and in particular the ability to deduce from a spike train the next spike time, and therefore produce a description of the network activity only based on the spike times regardless of the membrane potential process. To study this question in a rigorous manner, we introduce and study an event-based description of networks of noisy integrate-and-fire neurons, i.e. that is based on the computation of the spike times. We show that the firing times of the neurons in the networks constitute a Markov chain, whose transition probability is related to the probability distribution of the interspike interval of the neurons in the network. In the cases where the Markovian model can be developed, the transition probability is explicitly derived in such classical cases of neural networks as the linear integrate-and-fire neuron models with excitatory and inhibitory interactions, for different types of synapses, possibly featuring noisy synaptic integration, transmission delays and absolute and relative refractory period. This covers most of the cases that have been investigated in the event-based description of spiking deterministic neural networks.
KeywordsStochastic network Linear integrate-and-fire neurons Event-based model Event-based simulation
The authors warmly acknowledge Romain Brette for very insightful discussions on the concepts, Philippe Robert for interesting discussions and for reading suggestions, Olivier Rochel for his introduction to MVA Spike and for sharing his code, and Renaud Keriven and Alexandre Chariot for developing a GPU simulation code (not presented here). This work was partially supported by the ERC advanced grant NerVi number 227747.
- Arbib (1998). The handbook of brain theory and neural networks. Cambridge: MIT Press.Google Scholar
- Cessac, B. (2010). A discrete time neural network model with spiking neurons: II: Dynamics with noise. Journal of Mathematical Biology, 1–38. doi: 10.1007/s00285-010-0358-4.
- Davis, M. (1984). Piecewise-deterministic markov processes: A general class of non-diffusion stochastic models. Journal of the Royal Society, Series B (Methodological), 46, 353–388.Google Scholar
- Gerstner, W., & Kistler, W. (2002a). Spiking neuron models. Cambridge: Cambridge University Press.Google Scholar
- Holden, A. (1976). Models of the stochastic activity of neurones. Lecture Notes in Biomathematics, 12, 1–368.Google Scholar
- Kandel, E., Schwartz, J., & Jessel, T. (2000). Principles of neural science (4th ed.). New York: McGraw-Hill.Google Scholar
- Karatzas, I., & Shreve, S. (1987). Brownian motion and stochatic calculus. New York: Springer.Google Scholar
- Kloeden, P., & Platen, E. (1992). Numerical solution of stochastic differential equations. New York: Springer.Google Scholar
- Lachal, A. (1991). Sur le premier instant de passage de l’intégrale du mouvement brownien. Annales de l’IHP, Section B, 27, 385–405.Google Scholar
- Marian, I., Reilly, R., & Mackey, D. (2002). Efficient event-driven simulation of spiking neural networks. In Proceedings of the 3rd WSEAS international conference on neural networks and applications.Google Scholar
- McKean, H. P. (1963). A winding problem for a resonator driven by a white noise. Journal of Mathematics of Kyoto University, 2, 227–235.Google Scholar
- Plesser, H. E. (1999). Aspects of signal processing in noisy neurons. PhD thesis, Georg-August-Universität.Google Scholar
- Ricciardi, L., & Smith, C. (1977). Diffusion processes and related topics in biology. New York: Springer.Google Scholar
- Rolls, E., & Deco, G. (2010). The noisy brain: Stochastic dynamics as a principle of brain function. London: Oxford University Press.Google Scholar
- Touboul, J. (2008). Nonlinear and stochastic models in neuroscience. PhD thesis, Ecole Polytechnique.Google Scholar
- Turova, T. S. (1996). Analysis of a biological plausible neural network via an hourglass model. Markov Processes and Related Fields, 2, 487–510.Google Scholar
- Watts, L. (1994). Event-driven simulation of networks of spiking neurons. Advances in Neural Information Processing System, 7, 927–934.Google Scholar