Fitting of dynamic recurrent neural network models to sensory stimulus-response data
We present a theoretical study aiming at model fitting for sensory neurons. Conventional neural network training approaches are not applicable to this problem due to lack of continuous data. Although the stimulus can be considered as a smooth time-dependent variable, the associated response will be a set of neural spike timings (roughly the instants of successive action potential peaks) that have no amplitude information. A recurrent neural network model can be fitted to such a stimulus-response data pair by using the maximum likelihood estimation method where the likelihood function is derived from Poisson statistics of neural spiking. The universal approximation feature of the recurrent dynamical neuron network models allows us to describe excitatory-inhibitory characteristics of an actual sensory neural network with any desired number of neurons. The stimulus data are generated by a phased cosine Fourier series having a fixed amplitude and frequency but a randomly shot phase. Various values of amplitude, stimulus component size, and sample size are applied in order to examine the effect of the stimulus to the identification process. Results are presented in tabular and graphical forms at the end of this text. In addition, to demonstrate the success of this research, a study involving the same model, nominal parameters and stimulus structure, and another study that works on different models are compared to that of this research.
KeywordsSensory neurons Recurrent neural network Excitatory neuron Inhibitory neuron Neural spiking Maximum likelihood estimation
This study was partially supported by the Turkish Scientific and Technological Research Council’s DB-2219 Grant Program.
Compliance with Ethical Standards
Conflict of interests
The authors declare that they have no conflict of interest.
- 4.Ledoux, E., Brunel, N.: Dynamics of networks of excitatory and inhibitory neurons in response to time-dependent inputs. Frontiers in Computational Neuroscience, 5 (2011)Google Scholar
- 14.Eden, U.T.: Point process models for neural spike trains. Neural Signal Processing: Quantitative Analysis of Neural Activity, 45–51 (2008)Google Scholar
- 25.DiMattina, C., Zhang, K.: Adaptive stimulus optimization for sensory systems neuroscience. Front. Neural Circuit, 7 (2013)Google Scholar
- 26.Pham, T., Haas, J.: Electrical synapses between inhibitory neurons shape the responses of principal neurons to transient inputs in the thalamus. bioRxiv p 186585 (2017)Google Scholar
- 28.Doruk, O., Zhang, K.: Building a dynamical network model from neural spiking data: Application of Poisson likelihood. arXiv:1710.03071 (2017)
- 31.Doruk, R.O., Zhang, K.: Adaptive stimulus design for dynamic recurrent neural network models. arXiv:1610.05561 (2016)