Skip to main content

Characterizing Pure High-Order Entanglements in Lexical Semantic Spaces via Information Geometry

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5494))

Abstract

An emerging topic in Quantuam Interaction is the use of lexical semantic spaces, as Hilbert spaces, to capture the meaning of words. There has been some initial evidence that the phenomenon of quantum entanglement exists in a semantic space and can potentially play a crucial role in determining the embeded semantics. In this paper, we propose to consider pure high-order entanglements that cannot be reduced to the compositional effect of lower-order ones, as an indicator of high-level semantic entities. To characterize the intrinsic order of entanglements and distinguish pure high-order entanglements from lower-order ones, we develop a set of methods in the framework of Information Geometry. Based on the developed methods, we propose an expanded vector space model that involves context-sensitive high-order information and aims at characterizing high-level retrieval contexts. Some initial ideas on applying the proposed methods in query expansion and text classification are also presented.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Salton, Gerard, Buckley, C.: Term-weighting approaches in automatic text retrieval. Information Processing & Management 24(5), 513–523 (1988)

    Article  Google Scholar 

  2. Nielsen, M., Chuang, I.: Quantum Computation and Quantum Information. Cambridge University Press, Cambridge (2000)

    MATH  Google Scholar 

  3. Horodecki, R., Horodecki, P., Horodecki, M., Horodecki, K.: Quantum entanglement, http://arxiv.org/abs/quant-ph/0702225

  4. Amari, S., et al.: Method of Information Geometry. AMS series. Oxford University Press, Oxford (2000)

    Google Scholar 

  5. Amari, S.: Differential Geometrical Method in Statistics. Springer, Heidelberg (1985)

    Book  MATH  Google Scholar 

  6. Amari, S.: Information Geometry on Hierarchy of Probability Distributions. IEEE Transactions on Information Theory 47, 1701–1711 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  7. Nakahara, H., Amari, S.: Information-Geometric Measure for Neural Spikes. Neural Computation 14, 2269–2316 (2002)

    Article  MATH  Google Scholar 

  8. Rao, C.R.: Information and accuracy attainable in the estimation of statistical parameters. Bull. Calcutta. Math. Soc. 37 (1945)

    Google Scholar 

  9. Jeffreys, H.: An invariant form for the prior probability in estimation problems. Proc. Roy. Soc., A 196 (1946)

    Google Scholar 

  10. Christensen, R.: Log-Linear Models and Logistic Regression. Springer, Heidelberg (1997)

    MATH  Google Scholar 

  11. Orlitsky, A., Santhanam, N., Zhang, J.: Always Good-Turing: Asymptotically optimal probability estimation. Science 302

    Google Scholar 

  12. Bruza, P.D., Kitto, K., Nelson, D., McEvoy, C.L.: Entangling Words and Meaning. In: Proceedings of the Second Quantum Interaction Symposium, pp. 118–124. College Publications (2008)

    Google Scholar 

  13. Bruza, P.D., Woods, J.: Quantum Collapse in Semantic space: Interpreting Natural Language Argumentation. In: Proceedings of the Second Quantum Interaction Symposium, pp. 141–147. College Publications (2008)

    Google Scholar 

  14. Bruza, P.D., Cole, R.J.: Quantum Logic of Semantic Space: An Exploratory Investigation of Context Effects in Practical Reasoning. In: Artemov, S., Barringer, H., d’Avila Garcez, A.S., Lamb, L.C., Woods, J. (eds.) We Will Show Them: Essays in Honour of Dov Gabbay. College Publications (2005)

    Google Scholar 

  15. Burgess, C., Livesay, L., Lund, K.: Explorations in Context Space: Words, Sentences, Discourse. In: Foltz, P.W. (ed.) Quantitative Approaches to Semantic Knowledge Representation, Discourse Processes vol. 25(2,3), pp. 179–210 (1998)

    Google Scholar 

  16. Landauer, T., Dumais, S.: A Solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104(2), 211–240 (1997)

    Article  Google Scholar 

  17. Widdows, D.: The Geometry of Meaning. Center for the Study of Language and Information/SRI (2004)

    Google Scholar 

  18. Plenio, M.B., Virmani, S.: Quant. Inf. Comp. 7, 1 (2007)

    Google Scholar 

  19. Eisert, J., Gross, D.: Lectures on Quantum Information. In: Bruß, D., Leuchs, G. (eds.). Wiley-VCH, Weinheim (2007)

    Google Scholar 

  20. Adesso, G., Illuminati1, F.: Genuine multipartite entanglement of symmetric Gaussian states: Strong monogamy, unitary localization, scaling behavior, and molecular sharing structure, October 11 (2008), arXiv:0805.2942v2 [quant-ph]

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hou, Y., Song, D. (2009). Characterizing Pure High-Order Entanglements in Lexical Semantic Spaces via Information Geometry. In: Bruza, P., Sofge, D., Lawless, W., van Rijsbergen, K., Klusch, M. (eds) Quantum Interaction. QI 2009. Lecture Notes in Computer Science(), vol 5494. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00834-4_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-00834-4_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-00833-7

  • Online ISBN: 978-3-642-00834-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics