Skip to main content
SpringerLink
Log in

Recognition of Multiword Expressions Using Word Embeddings

  • Conference paper
  • First Online:
Artificial Intelligence (RCAI 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 934))

Included in the following conference series:

Abstract

In this paper we consider the task of extracting multiword expressions (MWE) for Russian thesaurus RuThes, which contains various types of phrases, including non-compositional phrases, multiword terms and their variants, light verb constructions, and others. We study several embedding-based features for phrases and their components and estimate their contribution to finding multiword expressions of different types comparing them with traditional association and context measures. We found that one of the distributional features has relatively high results of MWE extraction even when used alone. Different forms of its combination with other features (phrase frequency, association measures) improve both initial orderings. Besides, we demonstrate significant potential of an existing thesaurus for recognition of new multiword expressions for adding to the thesaurus.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Astrakhantsev, N.: ATR4S: toolkit with state-of-the-art automatic terms recognition methods in scala. Lang. Resour. Eval. 52(3), 853–872 (2018)

    Article  Google Scholar 

  2. Biemann, C., Giesbrecht, E.: Distributional semantics and compositionality 2011: shared task description and results. In: Proceedings of the Workshop on Distributional Semantics and Compositionality, pp. 21–28. Association for Computational Linguistics (2011)

    Google Scholar 

  3. Bond, F., Foster, R.: Linking and extending an open multilingual wordnet. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics: Long Papers, vol. 1, pp. 1352–1362 (2013)

    Google Scholar 

  4. Bouma, G.: Normalized (pointwise) mutual information in collocation extraction. In: Proceedings of GSCL, pp. 31–40 (2009)

    Google Scholar 

  5. Cordeiro, S., Ramisch, C., Idiart, M., Villavicencio, A.: Predicting the compositionality of nominal compounds: giving word embeddings a hard time. In: Proceedings of ACL-2016g Papers. vol. 1, pp. 1986–1997 (2016)

    Google Scholar 

  6. Daille, B.: Term Variation in Specialised Corpora: Characterisation, Automatic Discovery and Applications, vol. 19. John Benjamins Publishing Company, Amsterdam (2017)

    Book  Google Scholar 

  7. Daille, B.: Combined approach for terminology extraction: lexical statistics and linguistic filtering. Ph.D. thesis, University Paris 7 (1994)

    Google Scholar 

  8. Farahmand, M., Smith, A., Nivre, J.: A multiword expression data set: annotating non-compositionality and conventionalization for English noun compounds. In: Proceedings of the 11th Workshop on Multiword Expressions, pp. 29–33 (2015)

    Google Scholar 

  9. Fazly, A., Cook, P., Stevenson, S.: Unsupervised type and token identification of idiomatic expressions. Comput. Linguist. 35(1), 61–103 (2009)

    Article  Google Scholar 

  10. Fellbaum, C.: WordNet. Wiley Online Library (1998)

    Google Scholar 

  11. Frantzi, K., Ananiadou, S., Mima, H.: Automatic recognition of multi-word terms: the C-value/NC-value method. Int. J. Digit. Libr. 3(2), 115–130 (2000)

    Article  Google Scholar 

  12. Gharbieh, W., Bhavsar, V.C., Cook, P.: A word embedding approach to identifying verb-noun idiomatic combinations, pp. 112–118 (2016)

    Google Scholar 

  13. Lin, D.: Automatic retrieval and clustering of similar words. In: Proceedings of ACL-1998, pp. 768–774. Association for Computational Linguistics (1998)

    Google Scholar 

  14. Loukachevitch, N., Dobrov, B.: RuThes linguistic ontology vs. Russian wordnets. In: Proceedings of the Seventh Global Wordnet Conference, pp. 154–162 (2014)

    Google Scholar 

  15. Loukachevitch, N., Nokel, M.: An experimental study of term extraction for real information-retrieval thesauri. In: Proceedings of TIA-2013, pp. 69–76 (2013)

    Google Scholar 

  16. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)

  17. Pecina, P.: Lexical association measures and collocation extraction. Lang. Resour. Eval. 44(1–2), 137–158 (2010)

    Article  Google Scholar 

  18. Piasecki, M., Wendelberger, M., Maziarz, M.: Extraction of the multi-word lexical units in the perspective of the wordnet expansion. In: RANLP-2015, pp. 512–520 (2015)

    Google Scholar 

  19. Sag, I.A., Baldwin, T., Bond, F., Copestake, A., Flickinger, D.: Multiword expressions: a pain in the neck for NLP. In: Gelbukh, A. (ed.) CICLing 2002. LNCS, vol. 2276, pp. 1–15. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45715-1_1

    Chapter  Google Scholar 

  20. Salehi, B., Cook, P., Baldwin, T.: A word embedding approach to predicting the compositionality of multiword expressions. In: Proceedings of NAACL-2015, pp. 977–983 (2015)

    Google Scholar 

Download references

Acknowledgments

This work was partially supported by Russian Science Foundation, grant N16-18-02074.

Author information

Authors and Affiliations

  1. Tatarstan Academy of Sciences, Kazan, Russia

    Natalia Loukachevitch

  2. Lomonosov Moscow State University, Moscow, Russia

    Natalia Loukachevitch & Ekaterina Parkhomenko

Authors
  1. Natalia Loukachevitch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ekaterina Parkhomenko
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Natalia Loukachevitch .

Editor information

Editors and Affiliations

  1. Department of Data Analysis and Artificial Intelligence, National Research University Higher School of Economics, Moscow, Russia

    Sergei O. Kuznetsov

  2. Federal Research Center Computer Science and Control, Institute of Informatics Problems, Moscow, Russia

    Gennady S. Osipov

  3. Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia

    Vadim L. Stefanuk

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Loukachevitch, N., Parkhomenko, E. (2018). Recognition of Multiword Expressions Using Word Embeddings. In: Kuznetsov, S., Osipov, G., Stefanuk, V. (eds) Artificial Intelligence. RCAI 2018. Communications in Computer and Information Science, vol 934. Springer, Cham. https://doi.org/10.1007/978-3-030-00617-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00617-4_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00616-7

  • Online ISBN: 978-3-030-00617-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation