Abstract
We represent the meaning of words with density operators learned from a large corpus of dependency-parsed English sentences in an unsupervised way. This generalizes vector-space semantics in a straightforward manner by allowing an arbitrary number of subspaces. Our lexical density operators encode syntactic and semantic information. These structures allow us to compose the meaning of a sentence from the meaning of its words, again without any supervision. This model is able to detect whether a pair of sentences constitutes a paraphrase. We also analyse the entanglement among syntactic relations within linguistic density operators.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Baroni, M., Lenci, A.: Distributional memory: a general framework for corpus-based semantics. Comput. Linguist. 36(4), 673–721 (2010)
Baroni, M., Bernardini, S., Ferraresi, A., Zanchetta, E.: The wacky wide web: a collection of very large linguistically processed web-crawled corpora. Lang. Resour. Eval. 43(3), 209–226 (2009)
Blacoe, W., Kashefi, E., Lapata, M.: A quantum-theoretic approach to distributional semantics. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 847–857 (2013)
Bruza, P.D., Cole, R.J.: Quantum logic of semantic space: an exploratory investigation of context effects in practical reasoning. In: Artemov, S., Barringer, H., d’Avila Garcez, S.A., Lamb, L.C., Woods, J. (eds.) We Will Show Them: Essays in Honour of Dov Gabbay, vol. 1, pp. 339–361. College Publications, London (2005)
Carroll, J.B. (ed.): Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf. MIT Press, Cambridge (1956)
Clauser, J.F., Horne, M.A., Shimony, A., Holt, R.A.: Proposed experiment to test local hidden-variable theories. Phys. Rev. Lett. 23, 880–884 (1969)
Dolan, B., Quirk, C., Brockett, C.: Unsupervised construction of large paraphrase corpora: exploiting massively parallel news sources. In: Proceedings of the 17th International Conference on Computational Linguistics, pp. 350–356 (2004)
Grefenstette, E., Sadrzadeh, M.: Experimental support for a categorical compositional distributional model of meaning. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 1394–1404 (2011)
Ji, Y., Eisenstein, J.: Discriminative improvements to distributional sentence similarity. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 891–896 (2013)
Lund, K., Burgess, C.: Producing high-dimensional semantic spaces from lexical co-occurrence. Behav. Res. Methods Instrum. Comput. 28(2), 203–208 (1996)
Mitchell, J., Lapata, M.: Composition in distributional models of semantics. Cogn. Sci. 38(8), 1388–1429 (2010)
von Neumann, J.: Mathematische Grundlagen der Quantenmechanik. Springer, Berlin (1932)
Nielsen, M.A., Chuang, I.L.: Quantum Computation and Information Theory. Cambridge University Press, Cambridge (2010)
Nivre, J., Hall, J., Nilsson, J., Chanev, A., Eryigit, G., Kübler, S., Marinov, S., Marsi, E.: Maltparser: a language independent system for data-driven dependency parsing. Nat. Lang. Eng. 13(2), 95–135 (2007)
Horodecki, R., Horodecki, P., Horodecki, M., Horodecki, K.: Quantum entanglement. Rev. Mod. Phys. 81, 865–942 (2009)
Horodecki, R., Horodecki, P., Horodecki, M.: Quantum \(\alpha \)-entropy inequalities: independent condition for local realism? Phys. Lett. A 210, 377–381 (1996)
Renyi, A.: On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 547–561. University of California Press, Berkeley (1961)
van Rijsbergen, K.: The Geometry of Information Retrieval. Cambridge University Press, Cambridge (2014)
Socher, R., Huval, B., Manning, C.D., Ng, A.Y.: Semantic compositionality through recursive matrix-vector spaces. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 1201–1211 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Blacoe, W. (2015). Semantic Composition Inspired by Quantum Measurement. In: Atmanspacher, H., Bergomi, C., Filk, T., Kitto, K. (eds) Quantum Interaction. QI 2014. Lecture Notes in Computer Science(), vol 8951. Springer, Cham. https://doi.org/10.1007/978-3-319-15931-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-15931-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15930-0
Online ISBN: 978-3-319-15931-7
eBook Packages: Computer ScienceComputer Science (R0)