Abstract
This paper presents a concept of a non-fully-connected spiking network capable of solving a classification task by means of the local bio-inspired learning rule of Spike-Timing-Dependent Plasticity. The network comprises one layer of neurons, each neuron receiving a subset of the input vector components. Input vectors are encoded by mean rates of Poisson input sequences. After training several networks each on its own class, the output spiking rates contain the information on the classes, which can be extracted with a conventional learning algorithm. We demonstrate that the STDP-based classification algorithm proposed achieves competitive accuracy on both discrete-data task of handwritten digits recognition (96% ± 1%) and classification of real-valued vectors of Fisher’s Iris (93% ± 3%). The attractive feature of the algorithm is the simplicity of the network structure without much loss in classification accuracy. This property gives the possibility to implement classifiers based on the proposed algorithm in robotic devices with limited resources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Saïghi, S., Mayr, C.G., Serrano-Gotarredona, T., Schmidt, H., Lecerf, G., Tomas, J., Grollier, J., Boyn, S., Vincent, A.F., Querlioz, D., La Barbera, S., Alibart, F., Vuillaume, D., Bichler, O., Gamrat, C., Linares-Barranco. B.: Plasticity in memristive devices for spiking neural networks. Front. Neurosci. 9(MAR), 51 (32 pp.) (2015)
Merolla, P.A., Arthur, J.V., Alvarez-Icaza, R., Cassidy, A.S., Sawada, J., Akopyan, F., Jackson, B.L., Imam, N., Guo, C., Nakamura, Y., Brezzo, B., Vo, I., Esser, S.K., Appuswamy, R., Taba, B., Amir, A., Flickner, M.D., Risk, W.P., Manohar, R., Modha, D.S.: A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345(6197), 668–673 (2014)
Esser, S.K., Merolla, P.A., Arthur, J.V., Cassidy, A.S., Appuswamy, R., Andreopoulos, A., Berg, D.J., McKinstry, J.L., Melano, T., Barch, D.R., Di Nolfo, C., Datta, P., Amir, A., Taba, B., Flickner, M.D., Modha, D.S.: Convolutional networks for fast, energy-efficient neuromorphic computing. Proc. Natl. Acad. Sci. U. S. A. 113(41), 11441–11446 (2016)
Tavanaei, A., Maida, A.S.: Bio-inspired spiking convolutional neural network using layer-wise sparse coding and STDP learning. https://arxiv.org/abs/1611.03000 (2016)
Mozafari, M., Ganjtabesh, M., Nowzari-Dalini, A., Thorpe, S.J., Masquelier, T.: Combining STDP and reward-modulated STDP in deep convolutional spiking neural networks for digit recognition. https://www.reddit.com/r/MachineLearning/comments/8v5lrk/r_combining_stdp_and_rewardmodulated_stdp_in_deep/ (2018)
Mozafari, M., Ganjtabesh, M., Nowzari-Dalini, A., Thorpe, S.J., Masquelier, T.: Bio-inspired digit recognition using reward-modulated spike-timing-dependent plasticity in deep convolutional networks. Pattern Recognit. 94, 87–95. https://arxiv.org/abs/1804.00227 (2019)
Kheradpisheh, S.R., Ganjtabesh, M., Thorpe, S.J., Masquelier, T.: STDP-based spiking deep convolutional neural networks for object recognition. Neural Netw. 99, 56–67 (2018)
Lee, J.H., Delbruck, T., Pfeiffer, M.: Training deep spiking neural networks using backpropagation. Front. Neurosci. 10, 508 (13 pp.) (2016)
O’Connor, P., Welling, M.: Deep spiking networks (16 pp.). https://arxiv.org/abs/1602.08323 (2016)
Beyeler, M., Dutt, N.D., Krichmar, J.L.: Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule. Neural Netw. 48, 109–124 (2013)
Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G., Linares-Barranco, B.: STDP and STDP variations with memristors for spiking neuromorphic learning systems. Front. Neurosci. 7(7), 2 (15 pp.) (2013)
Bi, G.-Q., Poo, M.-M.: Synaptic modification by correlated activity: Hebb’s postulate revisited. Annu. Rev. Neurosci. 24, 139–166 (2001)
Dua, D., Graff, C.: UCI machine learning repository. http://archive.ics.uci.edu/ml, University of California, Irvine (2017)
Alpaydin, E., Kaynak. C.: Optical recognition of handwritten digits data set. UCI: Machine Learning Repository, vol. 64 (1995)
Sboev, A., Serenko, A., Rybka, R., Vlasov. D.: Influence of input encoding on solving a classification task by spiking neural network with STDP. In: International Conference of Numerical Analysis and Applied Mathematics (ICNAAM 2018). AIP Conference Proceedings, vol. 2116, p. 270007 (4 pp.) (2019)
Sboev, A., Serenko, A., Rybka, R., Vlasov, D., Filchenkov, A.: Estimation of the influence of spiking neural network parameters on classification accuracy using a genetic algorithm. Procedia Comput. Sci. 145, 488–494 (2018)
Sotelo, D., Velásquez, D., Cobos, C., Mendoza, M., Gómez, L.: Optimization of neural network training with ELM based on the iterative hybridization of differential evolution with local search and restarts. In: Nicosia, G., Pardalos, P., Giuffrida, G., Umeton, R., Sciacca, V. (eds.) Machine Learning, Optimization, and Data Science. LOD 2018. LNCS, vol. 11331, pp. 38–50. Springer, Cham, Volterra, Italy (2018)
Diehl, P.U., Cook, M.: Unsupervised learning of digit recognition using spike-timing-dependent plasticity. Front. Comput. Neurosci. 9, 99 (9 pp.) (2015)
Abdulkadir, R.A., Imam, K.A., Jibril, M.B.: Simulation of back propagation neural network for iris flower classification. Am. J. Eng. Res. 6(1), 200–205 (2017)
Patil, P.M., Sontakke, T.R.: Rotation, scale and translation invariant handwritten Devanagari numeral character recognition using general fuzzy neural network. Pattern Recognit. 40(7), 2110–2117 (2007)
Ghosh-Dastidar, S., Adeli, H.: A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection. Neural Netw. 22(10), 1419–1431 (2009)
Acknowledgements
The study was carried out by a Russian Science Foundation grant 17-71-20111. The work was carried out using computing resources of the federal collective usage center Complex for Simulation and Data Processing for Mega-science Facilities at NRC “Kurchatov Institute”, http://ckp.nrcki.ru/.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Sboev, A., Rybka, R., Serenko, A., Vlasov, D. (2020). A Non-fully-Connected Spiking Neural Network with STDP for Solving a Classification Task. In: Misyurin, S., Arakelian, V., Avetisyan, A. (eds) Advanced Technologies in Robotics and Intelligent Systems. Mechanisms and Machine Science, vol 80. Springer, Cham. https://doi.org/10.1007/978-3-030-33491-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-33491-8_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33490-1
Online ISBN: 978-3-030-33491-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)