Deep Learning and Vector Space Model

  • Grigori Sidorov
Part of the SpringerBriefs in Computer Science book series (BRIEFSCOMPUTER)


In recent years, a novel paradigm appeared related to application of neural networks to any tasks related to artificial intelligence [59], in particular, in natural language processing [39]. It became extremely popular in NLP area after works of Mikolov et al. starting in 2013 [74, 75]. The main idea of this paradigm is to apply neural networks for automatic learning of relevant features with various levels of generalization in vector space model. Sometimes this model of representation of objects is called continuous vector space model. In general, this paradigm is called “deep learning.”


  1. 23.
    Firth, J.R.: A Synopsis of Linguistic Theory. In: Palmer, F.R. (ed), (1968) Selected Papers of J.R. Firth 1952-59. London/Harlow: Longmans (1957)Google Scholar
  2. 39.
    Goldberg, Y: A Primer on Neural Network Models for Natural Language Processing. Journal of Artificial Intelligence Research 57:345–420 (2016)MathSciNetCrossRefGoogle Scholar
  3. 47.
    Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R.: Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580 (2012)Google Scholar
  4. 59.
    LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature, Vol. 521, 436–445 (2015)CrossRefGoogle Scholar
  5. 60.
    LeCun, Y., Bottou, L., Orr, G., Muller, K.: Efficient BackProp. In: Neural Networks: Tricks of the trade. Springer (1998)Google Scholar
  6. 74.
    Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 (2013)Google Scholar
  7. 75.
    Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed Representations of Words and Phrases and their Compositionality. In: Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., Weinberger, K.Q. (Eds.), Advances in Neural Information Processing Systems 26, pp. 3111–3119 (2013)Google Scholar

Copyright information

© The Author(s), under exclusive licence to Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Grigori Sidorov
    • 1
  1. 1.Instituto Politécnico NacionalCentro de Investigación en ComputaciónMexico CityMexico

Personalised recommendations