Abstract
In this paper, we propose a new learning method for extraction of low-frequency bilingual word pairs from parallel corpora with various languages. It is important to extract low-frequency bilingual word pairs because the frequencies of many bilingual word pairs are very low when large-scale parallel corpora are unobtainable. We use the following inference to extract low frequency bilingual word pairs: the word equivalents that adjoin the source language words of bilingual word pairs also adjoin the target language words of bilingual word pairs in local parts of bilingual sentence pairs. Evaluation experiments indicated that the extraction rate of our system was more than 8.0 percentage points higher than the extraction rate of the system based on the Dice coefficient. Moreover, the extraction rates of bilingual word pairs for which the frequencies are one and two respectively improved 11.0 and 6.6 percentage points using AIL.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge (1999)
Smadja, F., McKeown, K.R., Hatzivassiloglou, V.: Translating Collocations for Bilingual Lexicons: A Statistical Approach. Computational Linguistics 22(1), 1–38 (1996)
Echizen-ya, H., Araki, K., Momouchi, Y., Tochinai, K.: Study of Practical Effectiveness for Machine Translation Using Recursive Chain-link-type Learning. In: Proceedings of COLING 2002, pp. 246–252 (2002)
Pedersen, T., Varma, N.: K-vec++: Approach For Finding Word Correspondences (2003), Available at http://www.d.umn.edu/~tpederse/Code/Readme.K-vec++.v02.txt
Utsuro, T., Hino, K., Kida, M.: Integrating Cross-Lingually Relevant News Articles and Monolingual Web Documents in Bilingual Lexicon Acquisition. In: Proceedings of COLING 2004, pp. 1036–1042 (2004)
Tanaka, K., Iwasaki, H.: Extraction of Lexical Translation from Non-Aligned Corpora. In: Proceedings of COLING 1996, pp. 580–585 (1996)
McTait, K., Trujillo, A.: A Language-Neutral Sparse-Data Algorithm for Extracting Translation Patterns. In: Proceedings of TMI 1999, pp. 98–108 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Echizen-ya, H., Araki, K., Momouchi, Y. (2005). Automatic Extraction of Low Frequency Bilingual Word Pairs from Parallel Corpora with Various Languages. In: Ho, T.B., Cheung, D., Liu, H. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2005. Lecture Notes in Computer Science(), vol 3518. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11430919_5
Download citation
DOI: https://doi.org/10.1007/11430919_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26076-9
Online ISBN: 978-3-540-31935-1
eBook Packages: Computer ScienceComputer Science (R0)