Advertisement

Bridging the Gap – Using External Knowledge Bases for Context-Aware Document Retrieval

  • Benjamin Köhncke
  • Patrick Siehndel
  • Wolf-Tilo Balke
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8279)

Abstract

Today, a vast amount of information is made available over the Web in the form of unstructured text indexed by Web search engines. But especially for searches on abstract concepts or context terms, a simple keyword-based Web search may compromise retrieval quality, because query terms may or may not directly occur in the texts (vocabulary problem). The respective state-of-the-art solution is query expansion leading to an increase in recall, although it often also leads to a steep decrease of retrieval precision. This decrease however is a severe problem for digital library providers: in libraries it is vital to ensure high quality retrieval meeting current standards. In this paper we present an approach allowing even for abstract context searches (conceptual queries) with high retrieval quality by using Wikipedia to semantically bridge the gap between query terms and textual content. We do not expand queries, but extract the most important terms from each text document in a focused Web collection and then enrich them with features gathered from Wikipedia. These enriched terms are further used to compute the relevance of a document with respect to a conceptual query. The evaluation shows significant improvements over query expansion approaches: the overall retrieval quality is increased up to 74.5% in mean average precision.

Keywords

conceptual query query expansion semantic enrichment 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Furnas, G.W., et al.: The vocabulary problem in human-system communication. Communications of the ACM 30(11), 964–971 (1987)CrossRefGoogle Scholar
  2. 2.
    Kraft, R., Zien, J.: Mining anchor text for query refinement. In: Proc. of Int. Conf. on World Wide Web, WWW (2004)Google Scholar
  3. 3.
    Köhncke, B., Balke, W.-T.: Using Wikipedia categories for compact representations of chemical documents. In: Proc. of Int. Conf. on Information and Knowledge Management, CIKM (2010)Google Scholar
  4. 4.
    Carpineto, C., Romano, G.: A Survey of Automatic Query Expansion in Information Retrieval. ACM Computing Surveys 44(1), 1–50 (2012)CrossRefGoogle Scholar
  5. 5.
    Lüke, T., Schaer, P., Mayr, P.: Improving Retrieval Results with discipline-specific Query Expansion. In: Zaphiris, P., Buchanan, G., Rasmussen, E., Loizides, F. (eds.) TPDL 2012. LNCS, vol. 7489, pp. 408–413. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  6. 6.
    Xu, J., Croft, W.: Query expansion using local and global document analysis. In: Proc. of Int. Conf. on Research and Development in Information Retrieval, SIGIR (1996)Google Scholar
  7. 7.
    Jing, Y., Croft, W.: An association thesaurus for information retrieval. In: Proceedings of RIAO, pp. 1–15 (1994)Google Scholar
  8. 8.
    Cao, G., et al.: Selecting good expansion terms for pseudo-relevance feedback. In: Proc. of Int. Conf. on Research and Development in Information Retrieval, SIGIR (2008)Google Scholar
  9. 9.
    Metzler, D., Croft, W.B.: Latent concept expansion using markov random fields. In: Proc. of Int. Conf. on Research and Development in Information Retrieval, SIGIR (2007)Google Scholar
  10. 10.
    Cui, H., Wen, J., Nie, J., Ma, W.: Query expansion by mining user logs. IEEE Transactions on Knowledge and Data Engineering 15(4), 829–839 (2003)CrossRefGoogle Scholar
  11. 11.
    Wang, X., Zhai, C.X.: Mining term association patterns from search logs for effective query reformulation. In: Proc. of Int. Conf. on Information and Knowledge Management, CIKM (2008)Google Scholar
  12. 12.
    Gao, J., Nie, J.: Towards Concept-Based Translation Models Using Search Logs for Query Expansion. In: Proc. of Int. Conf. on Inf. and Knowledge Management, CIKM (2012)Google Scholar
  13. 13.
    Deerwester, S., et al.: Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science 41(6), 391–407 (1998)CrossRefGoogle Scholar
  14. 14.
    Hu, J., Wang, G., Lochovsky, F., Sun, J., Chen, Z.: Understanding user’s query intent with wikipedia. In: Proc. of Int. Conf. on World Wide Web, WWW (2009)Google Scholar
  15. 15.
    Xu, Y., et al.: Query dependent pseudo-relevance feedback based on wikipedia. In: Proc. of Int. Conf. on Research and Development in Information Retrieval, SIGIR (2009)Google Scholar
  16. 16.
    Bendersky, M., et al.: Effective query formulation with multiple information sources. In: Proc. of Int. Conf. on Web Search and Data Mining, WSDM (2012)Google Scholar
  17. 17.
    Milne, D., et al.: A knowledge-based search engine powered by wikipedia. In: Proc. of Int. Conf. on Information and Knowledge Management, CIKM (2007)Google Scholar
  18. 18.
    Surowiecki, J.: The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business. Economies, Societies and Nations (2004)Google Scholar
  19. 19.
    Milne, D., Witten, I.H.: An open-source toolkit for mining Wikipedia. Artificial Intelligence 194, 222–239 (2012)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Köhncke, B., Balke, W.-T.: Context-Sensitive Ranking Using Cross-Domain Knowledge for Chemical Digital Libraries. In: Aalberg, T., Papatheodorou, C., Dobreva, M., Tsakonas, G., Farrugia, C.J. (eds.) TPDL 2013. LNCS, vol. 8092, pp. 285–296. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  21. 21.
    Sahlgren, M.: An Introduction to Random Indexing. In: Proc. of the Methods and Applications of Semantic Indexing Workshop (2005)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Benjamin Köhncke
    • 1
  • Patrick Siehndel
    • 1
  • Wolf-Tilo Balke
    • 2
  1. 1.L3S Research CenterHannoverGermany
  2. 2.TU BraunschweigGermany

Personalised recommendations