Skip to main content

Semantic Composition Inspired by Quantum Measurement

  • Conference paper
  • First Online:
  • 916 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8951))

Abstract

We represent the meaning of words with density operators learned from a large corpus of dependency-parsed English sentences in an unsupervised way. This generalizes vector-space semantics in a straightforward manner by allowing an arbitrary number of subspaces. Our lexical density operators encode syntactic and semantic information. These structures allow us to compose the meaning of a sentence from the meaning of its words, again without any supervision. This model is able to detect whether a pair of sentences constitutes a paraphrase. We also analyse the entanglement among syntactic relations within linguistic density operators.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Baroni, M., Lenci, A.: Distributional memory: a general framework for corpus-based semantics. Comput. Linguist. 36(4), 673–721 (2010)

    Article  Google Scholar 

  2. Baroni, M., Bernardini, S., Ferraresi, A., Zanchetta, E.: The wacky wide web: a collection of very large linguistically processed web-crawled corpora. Lang. Resour. Eval. 43(3), 209–226 (2009)

    Article  Google Scholar 

  3. Blacoe, W., Kashefi, E., Lapata, M.: A quantum-theoretic approach to distributional semantics. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 847–857 (2013)

    Google Scholar 

  4. Bruza, P.D., Cole, R.J.: Quantum logic of semantic space: an exploratory investigation of context effects in practical reasoning. In: Artemov, S., Barringer, H., d’Avila Garcez, S.A., Lamb, L.C., Woods, J. (eds.) We Will Show Them: Essays in Honour of Dov Gabbay, vol. 1, pp. 339–361. College Publications, London (2005)

    Google Scholar 

  5. Carroll, J.B. (ed.): Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf. MIT Press, Cambridge (1956)

    Google Scholar 

  6. Clauser, J.F., Horne, M.A., Shimony, A., Holt, R.A.: Proposed experiment to test local hidden-variable theories. Phys. Rev. Lett. 23, 880–884 (1969)

    Article  Google Scholar 

  7. Dolan, B., Quirk, C., Brockett, C.: Unsupervised construction of large paraphrase corpora: exploiting massively parallel news sources. In: Proceedings of the 17th International Conference on Computational Linguistics, pp. 350–356 (2004)

    Google Scholar 

  8. Grefenstette, E., Sadrzadeh, M.: Experimental support for a categorical compositional distributional model of meaning. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 1394–1404 (2011)

    Google Scholar 

  9. Ji, Y., Eisenstein, J.: Discriminative improvements to distributional sentence similarity. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 891–896 (2013)

    Google Scholar 

  10. Lund, K., Burgess, C.: Producing high-dimensional semantic spaces from lexical co-occurrence. Behav. Res. Methods Instrum. Comput. 28(2), 203–208 (1996)

    Article  Google Scholar 

  11. Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cogn. Sci. 38(8), 1388–1429 (2010)

    Article  Google Scholar 

  12. von Neumann, J.: Mathematische Grundlagen der Quantenmechanik. Springer, Berlin (1932)

    MATH  Google Scholar 

  13. Nielsen, M.A., Chuang, I.L.: Quantum Computation and Information Theory. Cambridge University Press, Cambridge (2010)

    Google Scholar 

  14. Nivre, J., Hall, J., Nilsson, J., Chanev, A., Eryigit, G., Kübler, S., Marinov, S., Marsi, E.: Maltparser: a language independent system for data-driven dependency parsing. Nat. Lang. Eng. 13(2), 95–135 (2007)

    Google Scholar 

  15. Horodecki, R., Horodecki, P., Horodecki, M., Horodecki, K.: Quantum entanglement. Rev. Mod. Phys. 81, 865–942 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  16. Horodecki, R., Horodecki, P., Horodecki, M.: Quantum \(\alpha \)-entropy inequalities: independent condition for local realism? Phys. Lett. A 210, 377–381 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  17. Renyi, A.: On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 547–561. University of California Press, Berkeley (1961)

    Google Scholar 

  18. van Rijsbergen, K.: The Geometry of Information Retrieval. Cambridge University Press, Cambridge (2014)

    Google Scholar 

  19. Socher, R., Huval, B., Manning, C.D., Ng, A.Y.: Semantic compositionality through recursive matrix-vector spaces. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 1201–1211 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to William Blacoe .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Blacoe, W. (2015). Semantic Composition Inspired by Quantum Measurement. In: Atmanspacher, H., Bergomi, C., Filk, T., Kitto, K. (eds) Quantum Interaction. QI 2014. Lecture Notes in Computer Science(), vol 8951. Springer, Cham. https://doi.org/10.1007/978-3-319-15931-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-15931-7_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-15930-0

  • Online ISBN: 978-3-319-15931-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics