# A Markovian event-based framework for stochastic spiking neural networks

## Abstract

In spiking neural networks, the information is conveyed by the spike times, that depend on the intrinsic dynamics of each neuron, the input they receive and on the connections between neurons. In this article we study the Markovian nature of the sequence of spike times in stochastic neural networks, and in particular the ability to deduce from a spike train the next spike time, and therefore produce a description of the network activity only based on the spike times regardless of the membrane potential process. To study this question in a rigorous manner, we introduce and study an event-based description of networks of noisy integrate-and-fire neurons, i.e. that is based on the computation of the spike times. We show that the firing times of the neurons in the networks constitute a Markov chain, whose transition probability is related to the probability distribution of the interspike interval of the neurons in the network. In the cases where the Markovian model can be developed, the transition probability is explicitly derived in such classical cases of neural networks as the linear integrate-and-fire neuron models with excitatory and inhibitory interactions, for different types of synapses, possibly featuring noisy synaptic integration, transmission delays and absolute and relative refractory period. This covers most of the cases that have been investigated in the event-based description of spiking deterministic neural networks.

## Keywords

Stochastic network Linear integrate-and-fire neurons Event-based model Event-based simulation## Notes

### Acknowledgements

The authors warmly acknowledge Romain Brette for very insightful discussions on the concepts, Philippe Robert for interesting discussions and for reading suggestions, Olivier Rochel for his introduction to MVA Spike and for sharing his code, and Renaud Keriven and Alexandre Chariot for developing a GPU simulation code (not presented here). This work was partially supported by the ERC advanced grant NerVi number 227747.

## References

- Arbib (1998).
*The handbook of brain theory and neural networks*. Cambridge: MIT Press.Google Scholar - Asmussen, S., & Turova, T. S. (1998). Stationarity properties of neural networks.
*Journal of Applied Probabilities, 35*, 783–794.CrossRefGoogle Scholar - Brette, R. (2006). Exact simulation of integrate-and-fire models with synaptic conductances.
*Neural Computation, 18*(8), 2004–2027.PubMedCrossRefGoogle Scholar - Brette, R. (2007). Exact simulation of integrate-and-fire models with exponential currents.
*Neural Computation, 19*(10), 2604–2609.PubMedCrossRefGoogle Scholar - Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J. M., et al. (2007). Simulation of networks of spiking neurons: A review of tools and strategies.
*Journal of Computational Neuroscience, 23*(3), 349–398.PubMedCrossRefGoogle Scholar - Brunel, N., & Hakim, V. (1999). Fast global oscillations in networks of integrate-and-fire neurons with low firing rates.
*Neural Computation, 11*, 1621–1671.PubMedCrossRefGoogle Scholar - Cessac, B. (2008). A discrete time neural network model with spiking neurons.
*Journal of Mathematical Biology, 56*(3), 311–345. doi: 10.1007/s00285-007-0117-3.PubMedCrossRefGoogle Scholar - Cessac, B. (2010). A discrete time neural network model with spiking neurons: II: Dynamics with noise.
*Journal of Mathematical Biology*, 1–38. doi: 10.1007/s00285-010-0358-4. - Claverol, E., Brown, A., & Chad, J. (2002). Discrete simulation of large aggregates of neurons.
*Neurocomputing, 47*, 277–297.CrossRefGoogle Scholar - Cottrell, M. (1992). Mathematical analysis of a neural network with inhibitory coupling.
*Stochastic Processes and their Applications, 40*, 103–127.CrossRefGoogle Scholar - Cottrell, M., & Turova, T. (2000). Use of an hourglass model in neuronal coding.
*Journal of applied probability, 37*, 168–186.CrossRefGoogle Scholar - Davis, M. (1984). Piecewise-deterministic markov processes: A general class of non-diffusion stochastic models.
*Journal of the Royal Society, Series B (Methodological), 46*, 353–388.Google Scholar - Delorme, A., & Thorpe, S. (2001). Face processing using one spike per neuron: resistance to image degradation.
*Neural Networks, 14*, 795–804.PubMedCrossRefGoogle Scholar - Delorme, A., & Thorpe, S. (2003). 57 spikenet: An event-driven simulation package for modelling large networks of spiking neurons.
*Network, 14*(4), 613–627.PubMedCrossRefGoogle Scholar - Fabre-Thorpe, M., Richard, G., & Thorpe, S. (1998). Rapid categorization of natural images by rhesus monkeys.
*Neuroreport, 9*(2), 303–308.PubMedCrossRefGoogle Scholar - Fricker, C., Robert, P., Saada, E., & Tibi, D. (1994). Analysis of some networks with interaction.
*Annals of Applied Probability, 4*, 1112–1128.CrossRefGoogle Scholar - Gerstner, W., & Kistler, W. (2002a).
*Spiking neuron models*. Cambridge: Cambridge University Press.Google Scholar - Gerstner, W., & Kistler, W. M. (2002b). Mathematical formulations of hebbian learning.
*Biological Cybernetics, 87*, 404–415.PubMedCrossRefGoogle Scholar - Gobet, E. (2000). Weak approximation of killed diffusion using Euler schemes.
*Stochastic Processes and their Applications, 87*(2), 167–197.CrossRefGoogle Scholar - Goldman, M. (1971). On the first passage of the integrated Wiener process.
*Annals of Mathematical Statistics, 42*, 2150–2155.CrossRefGoogle Scholar - Gromoll, H., Robert, P., & Zwart, B. (2008). Fluid limits for processor sharing queues with impatience.
*Mathematics of Operations Research, 33*(2), 375–402.CrossRefGoogle Scholar - Holden, A. (1976). Models of the stochastic activity of neurones.
*Lecture Notes in Biomathematics, 12*, 1–368.Google Scholar - Izhikevich, E. M., & Edelman, G. M. (2008). Large-scale model of mammalian thalamocortical systems.
*Proceedings of the National Academy of Sciences of the United States of America, 105*(9), 3593–3598.PubMedCrossRefGoogle Scholar - Kandel, E., Schwartz, J., & Jessel, T. (2000).
*Principles of neural science*(4th ed.). New York: McGraw-Hill.Google Scholar - Karatzas, I., & Shreve, S. (1987).
*Brownian motion and stochatic calculus*. New York: Springer.Google Scholar - Kloeden, P., & Platen, E. (1992).
*Numerical solution of stochastic differential equations*. New York: Springer.Google Scholar - Lachal, A. (1991). Sur le premier instant de passage de l’intégrale du mouvement brownien.
*Annales de l’IHP, Section B, 27*, 385–405.Google Scholar - Lachal, A. (1996). Sur la distribution de certaines fonctionnelles de l’int’egrale du mouvement Brownien avec d’erives parabolique et cubique.
*Communications on Pure and Applied Mathematics, 49*, 1299–1338.CrossRefGoogle Scholar - Makino, T. (2003). A discrete-event neural network simulator for general neuron models.
*Neural Computing & Applications, 11*, 210–223.CrossRefGoogle Scholar - Marian, I., Reilly, R., & Mackey, D. (2002). Efficient event-driven simulation of spiking neural networks. In
*Proceedings of the 3rd WSEAS international conference on neural networks and applications*.Google Scholar - McKean, H. P. (1963). A winding problem for a resonator driven by a white noise.
*Journal of Mathematics of Kyoto University, 2*, 227–235.Google Scholar - Plesser, H. E. (1999).
*Aspects of signal processing in noisy neurons*. PhD thesis, Georg-August-Universität.Google Scholar - Ricciardi, L., & Smith, C. (1977).
*Diffusion processes and related topics in biology*. New York: Springer.Google Scholar - Rolls, E., & Deco, G. (2010).
*The noisy brain: Stochastic dynamics as a principle of brain function*. London: Oxford University Press.Google Scholar - Roxin, A., Brunel, N., & Hansel, D. (2005). Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks.
*Physical Review Letters, 94*(23), 238103.PubMedCrossRefGoogle Scholar - Rudolph, M., & Destexhe, A. (2006). Analytical integrate-and-fire neuron models with conductance-based dynamics for event-driven simulation strategies.
*Neural Computation, 18*, 2146–2210.PubMedCrossRefGoogle Scholar - Shadlen, M. N., & Newsome, W. T. (1994). Noise, neural codes and cortical organization.
*Current Opinion in Neurobiology, 4*(4), 569–579.PubMedCrossRefGoogle Scholar - Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps.
*Journal of Neuroscience, 13*, 334–350.PubMedGoogle Scholar - Thorpe, S., Delorme, A., & VanRullen, R. (2001). Spike based strategies for rapid processing.
*Neural Networks, 14*, 715–726.PubMedCrossRefGoogle Scholar - Tonnelier, A., Belmabrouk, H., & Martinez, D. (2007). Event-driven simulations of nonlinear integrate-and-fire neurons.
*Neural Computation, 19*(12), 3226–3238.PubMedCrossRefGoogle Scholar - Touboul, J. (2008).
*Nonlinear and stochastic models in neuroscience*. PhD thesis, Ecole Polytechnique.Google Scholar - Touboul, J., & Faugeras, O. (2007). The spikes trains probability distributions: A stochastic calculus approach.
*Journal of Physiology, Paris, 101*(1–3), 78–98.PubMedCrossRefGoogle Scholar - Touboul, J., & Faugeras, O. (2008). First hitting time of double integral processes to curved boundaries.
*Advances in Applied Probability, 40*(2), 501–528.CrossRefGoogle Scholar - Tuckwell, H. C. (1988).
*Introduction to theoretical neurobiology*. Cambridge: Cambridge University Press.CrossRefGoogle Scholar - Turova, T. (2000). Neural networks through the hourglass.
*BioSystems, 58*, 159–165.PubMedCrossRefGoogle Scholar - Turova, T. S. (1996). Analysis of a biological plausible neural network via an hourglass model.
*Markov Processes and Related Fields, 2*, 487–510.Google Scholar - Watts, L. (1994). Event-driven simulation of networks of spiking neurons.
*Advances in Neural Information Processing System, 7*, 927–934.Google Scholar