Abstract
Words in the explanatory dictionary have different meanings (senses) described using natural language definitions. If the definitions of two senses of the same word are too similar, it is difficult to grasp the difference and thus it is difficult to judge which of the two senses is intended in a particular contexts, especially when such a decision is to be made automatically as in the task of automatic word sense disambiguation. We suggest a method of formal evaluation of this aspect of quality of an explanatory dictionary by calculating the similarity of different senses of the same word. We calculate the similarity between two given senses as the relative number of equal or synonymous words in their definitions. In addition to the general assessment of the dictionary, the individual suspicious definitions are reported for possible improvement. In our experiments we used the Anaya explanatory dictionary of Spanish. Our experiments show that there are about 10% of substantially similar definitions in this dictionary, which indicates rather low quality.
Work done under partial support of Mexican Government (CONACyT, SNI), IPN (CGEPI, COFAA, PIFI), and Korean Government (KIPA Professorship for Visiting Faculty Positions in Korea). The first author is currently on Sabbatical leave at Chung-Ang University.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Burton-Jones, A., Storey, V.C., Sugumaran, V., Ahluwalia, P.: Assessing the Effectiveness of the DAML Ontologies for the Semantic Web. In: Proc. NLDB-2003, Applications of Natural Language to Information Systems, Berlin. Lecture Notes in Informatics (2003)
Gelbukh, A., Sidorov, G.: Morphological Analysis of Inflective Languages Through Generation. J. Procesamiento de Lenguaje Natural (29), 105–112 (2002)
Jiang, J.J., Conrad, D.W.: From object comparison to semantic similarity. In: Proc. of Pacling 1999 (Pacific association for computational linguistics), Waterloo, Canada, August 1999, pp. 256–263 (1999)
Lesk, M.: Automatic sense disambiguation using machine readable dictionaries: How to tell a pine cone from a ice cream cone. In: Proceedings of SIGDOC 1986 (1986)
Magnini, B., Strapparava, C.: Experiments in Word Domain Disambiguation for Parallel Texts. In: Proceedings of the ACL Workshop on Word Senses and Multilinguality, Hong Kong, China (2000)
Manning, C.D., Shutze, H.: Foundations of statistical natural language processing, p. 680. MIT Press, Cambridge (1999)
Suárez, A., Palomar, M.: Word Sense vs. Word Domain Disambiguation: a Maximum Entropy approach. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2002. LNCS (LNAI), vol. 2448, p. 131. Springer, Heidelberg (2002)
Porter, M.F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)
Rasmussen, E.: Clustering algorithms. In: Frakes, W.B., Baeza-Yates, R. (eds.) Information Retrieval: Data Structures and Algorithms, pp. 419–442. Prentice Hall, Upper Saddle River (1992)
Sidorov, G., Gelbukh, A.: Word sense disambiguation in a Spanish explanatory dictionary. In: Proc. of TALN 2001, Traitement Automatique du Langage Naturel, Tours, France, July 2-5, pp. 398–402 (2001)
Fellbaum, C. (ed.): WordNet: an electronic lexical database, p. 423. MIT, Cambridge (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gelbukh, A., Sidorov, G., Han, S., Chanona-Hernandez, L. (2004). Automatic Evaluation of Quality of an Explanatory Dictionary by Comparison of Word Senses. In: Broy, M., Zamulin, A.V. (eds) Perspectives of System Informatics. PSI 2003. Lecture Notes in Computer Science, vol 2890. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39866-0_54
Download citation
DOI: https://doi.org/10.1007/978-3-540-39866-0_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20813-6
Online ISBN: 978-3-540-39866-0
eBook Packages: Springer Book Archive