Skip to main content

An Axiomatic Approach to Exploit Term Dependencies in Language Model

  • Conference paper
Information Retrieval Technology (AIRS 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4993))

Included in the following conference series:

Abstract

One of important problems of dependence retrieval model is the challenge to integrate both single words and dependencies in one weighting schema. Although there are many retrieval models that exploit term dependencies in language modeling framework, seldom of them simultaneously study the problem on different query types, e.g., short queries and verbose queries. In this paper, we derive an axiomatic dependence model by defining several basic desirable constraints that a retrieval model should meet. The experiment results show that our model significantly and robustly improves retrieval accuracy over the baseline (unigram model) in verbose queries and achieves better performance than some state-of-art dependence models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Alvarez, C., Langlais, P., Nie, J.-Y.: Word Pairs in Language Modeling for Information Retrieval. In: Proceedings of RIAO 2004, pp. 686–705 (2004)

    Google Scholar 

  2. Metzler, D., Croft, W.B.: A Markov random field model for term dependencies. In: Proceedings of SIGIR 2005, pp. 472–479 (2005)

    Google Scholar 

  3. Song, F., Croft, W.B.: A general language model for information retrieval. In: Proceedings of SIGIR 1999, pp. 279–280 (1999)

    Google Scholar 

  4. Fang, H., Zhai, C.: An Exploration of Axiomatic Approaches to Information Retrieval. In: Proceedings of SIGIR 2005, pp. 480–487 (2005)

    Google Scholar 

  5. Gao, J., Nie, J.-Y., Wu, G., Cao, G.: Dependence Language Model for Information Retrieval. In: Proceedings of SIGIR 2004, pp. 170–177 (2004)

    Google Scholar 

  6. Srikanth, M., Srihari, R.: Exploiting Syntactic Structure of Queries in a Language Modeling Approach to IR. In: Proceedings of CIKM 2003, pp. 476–483 (2003)

    Google Scholar 

  7. Geng, X., Liu, T.-Y., Qin, T., Li, H.: Learning to Rank II: Feature selection for ranking. In: Proceedings of SIGIR 2007, pp. 407–414 (2007)

    Google Scholar 

  8. Losee, R.M.: Term dependence: Truncating the Bahadur Lazarsfeld expansion. Information Processing and Management 30(2), 293–303 (1994)

    Article  Google Scholar 

  9. Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: Proceedings of SIGIR 2001, pp. 334–342 (2001)

    Google Scholar 

  10. Zhai, C., Lafferty, J.: Model-based feedback in the KL-divergence retrieval model. In: Proceedings of CIKM 2001, pp. 403–410 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Hang Li Ting Liu Wei-Ying Ma Tetsuya Sakai Kam-Fai Wong Guodong Zhou

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ding, F., Wang, B. (2008). An Axiomatic Approach to Exploit Term Dependencies in Language Model. In: Li, H., Liu, T., Ma, WY., Sakai, T., Wong, KF., Zhou, G. (eds) Information Retrieval Technology. AIRS 2008. Lecture Notes in Computer Science, vol 4993. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68636-1_68

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-68636-1_68

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-68633-0

  • Online ISBN: 978-3-540-68636-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics