An Unsupervised Spiking Deep Neural Network for Object Recognition

  • Zeyang Song
  • Xi Wu
  • Mengwen Yuan
  • Huajin TangEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11555)


In this paper, we propose an unsupervised HMAX-based Spiking Deep Neural Network (HMAX-SDNN) for object recognition. HMAX is a biologically plausible model based on the hierarchical activity of object recognition in visual cortex. In HMAX-SDNN, input layer with HMAX structure is followed by a stacked convolution-pooling structure, in which convolutional layers are hierarchically trained with STDP. After that, a linear SVM is used for classification. Then, we demonstrate that the firing threshold has positive correlation with receptive fields size in convolutional layers, and optimize HMAX-SDNN with this conclusion. With the optimized structure, we validate HMAX-SDNN on Caltech dataset, and HMAX-SDNN outperforms other SNNs by reaching 99.2% recognition accuracy. Furthermore, the experiments show that HMAX-SDNN is robust to different kinds of objects.


HMAX Spiking Deep Neural Network STDP Deep learning Object recognition 



This work was supported by the National Key R&D Program of China under Grant 2017YFB1300201 and the National Natural Science Foundation of China under Grant 61673283.


  1. 1.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  2. 2.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). Scholar
  3. 3.
    Cao, Y., Chen, Y., Khosla, D.: Spiking deep convolutional neural networks for energy-efficient object recognition. Int. J. Comput. Vis. 113(1), 54–66 (2015)Google Scholar
  4. 4.
    Diehl, P.U., Zarrella, G., Cassidy, A., Pedroni, B.U., Neftci, E.: Conversion of artfiicial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware. In: IEEE International Conference on Rebooting Computing (2016)Google Scholar
  5. 5.
    Lee, J.H., Delbruck, T., Pfeiffer, M.: Training deep spiking neural networks using backpropagation. Front. Neurosci. 10, 508 (2016)Google Scholar
  6. 6.
    Bliss, T.V., Collingridge, G.L.: A synaptic model of memory: long-term potentiation in the hippocampus. Nature 361, 31–39 (1993)Google Scholar
  7. 7.
    Shiyong, H., et al.: Associative Hebbian synaptic plasticity in primate visual cortex. J. Neurosci. Off. J. Soc. Neurosc. 34(22), 7575–7579 (2014)Google Scholar
  8. 8.
    Diehl, P.U., Cook, M.: Unsupervised learning of digit recognition using spike-timing-dependent plasticity. Front. Comput. Neurosci. 9, 99 (2015)Google Scholar
  9. 9.
    Kheradpisheh, S.R., Ganjtabesh, M., Thorpe, S.J., Masquelier, T.: STDP-based spiking deep convolutional neural networks for object recognition. Neural Netw. 99, 56–67 (2018)Google Scholar
  10. 10.
    Xu, X., Jin, X., Yan, R., Fang, Q., Lu, W.: Visual pattern recognition using enhanced visual features and PSD-based learning rule. IEEE Trans. Cogn. Dev. Syst. 10(2), 205–212 (2018)Google Scholar
  11. 11.
    Yu, Q., Tang, H., Tan, K.C., Li, H.: Rapid feedforward computation by temporal encoding and learning with spiking neurons. IEEE Trans. Neural Netw. Learn. Syst. 24(10), 1539–1552 (2013)Google Scholar
  12. 12.
    Xu, Q., Qi, Y., Yu, H., Shen, J., Tang, H., Pan, G.: CSNN: an augmented spiking based framework with perceptron-inception. In: IJCAI, pp. 1646–1652 (2018)Google Scholar
  13. 13.
    Xi, W., Yixuan, W., Huajin, T., Rui, Y.: A structure-time parallel implementation of spike-based deep learning. Neural Netw. 113, 72–78 (2019)Google Scholar
  14. 14.
    Riesenhuber, M., Poggio, T.: Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019–1025 (1999)Google Scholar
  15. 15.
    Gerstner, W.: Spiking neuron models: single neurons, populations, plasticity. Kybernetes 4(7/8), 277–280 (2002)Google Scholar
  16. 16.
    Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. Bull. Math. Biol. 52(1–2), 25–71 (1989)Google Scholar
  17. 17.
    Izhikevich, E.M.: Simple model of spiking neurons. IEEE Trans. Neural Netw. 14(6), 1569–72 (2003)Google Scholar
  18. 18.
    Lee, C., Srinivasan, G., Panda, P., Roy, K.: Deep spiking convolutional neural network trained with unsupervised spike timing dependent plasticity. IEEE Trans. Cogn. Dev. Syst. (2018). Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Neuromorphic Computing Research Center, College of Computer ScienceSichuan UniversityChengduChina

Personalised recommendations