Evaluating Word Sense Disambiguation Tools for Information Retrieval Task
The main interest of this paper is the characterization of queries where WSD is a useful tool. That is, which issues must be fulfilled by a query in order to apply an state-of-art WSD tool? In addition, we have evaluated several approaches in order to apply WSD. We have used several types of indices. Thus, we have generated 13 indices and we have carried out 39 different experiments, obtaining that some indices based on WSD tools even outperforms slightly the non disambiguated baseline case. After the interpretation of our experiments, we think that only queries with terms very polysemous and very high IDF value are improved by using WSD.
KeywordsUser Query Baseline Case Word Sense Disambiguation Index Type Semantic Evaluation
Unable to display preview. Download preview PDF.
- 1.Cai, J.F., Lee, W.S., Teh, Y.W.: Nus-ml:improving word sense disambiguation using topic features. In: Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval 2007), Prague, Czech Republic, pp. 249–252 (2007)Google Scholar
- 2.Agirre, E., de Lacalle, O.L.: Ubc-alm: Combining k-nn with svd for wsd. In: Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval 2007), Prague, Czech Republic, pp. 342–345 (2007)Google Scholar
- 3.Agirre, E., Nunzio, G.M.D., Ferro, N., Mandl, T., Peters, C.: CLEF 2008: Ad Hoc Track Overview. In: Peters, C., et al. (eds.) CLEF 2008. LNCS, vol. 5706, pp. 15–37. Springer, Heidelberg (2008)Google Scholar