Abstract
This paper proposes an approach to improve statistical word alignment with ensemble methods. Two ensemble methods are investigated: bagging and cross-validation committees. On these two methods, both weighted voting and unweighted voting are compared under the word alignment task. In addition, we analyze the effect of different sizes of training sets on the bagging method. Experimental results indicate that both bagging and cross-validation committees improve the word alignment results regardless of weighted voting or unweighted voting. Weighted voting performs consistently better than unweighted voting on different sizes of training sets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ahrenberg, L., Merkel, M., Andersson, M.: A Simple Hybrid Aligner for Generating Lexical Correspondences in Parallel Texts. In: Proc. of the 36th Annual Meeting of the Association for Computational Linguistics and the 17th Int. Conf. on Computational Linguistics (ACL/COLING-1998), pp. 29–35 (1998)
Breiman, L.: Bagging Predicators. Machine Learning 24(1), 123–140 (1996)
Brown, P.F., Pietra, S.D., Pietra, V.D., Mercer, R.: The Mathematics of Statistical Machine Translation: Parameter Estimation. Computational Linguistics 19(2), 263–311 (1993)
Cherry, C., Lin, D.: A Probability Model to Improve Word Alignment. In: Proc. of the 41st Annual Meeting of the Association for Computational Linguistics (ACL-2003), pp. 88–95 (2003)
Dietterich, T.: Machine Learning Research: Four Current Directions. AI Magazine 18(4), 97–136 (1997)
Dietterich, T.: Ensemble Methods in Machine Learning. In: Proc. of the First Int. Workshop on Multiple Classifier Systems, pp. 1–15 (2000)
Freund, Y., Schapire, R.: Experiments with a new boosting algorithm. In: Machine Learning: Proc. of the Thirteenth International Conference, pp. 148–156 (1996)
Matusov, E., Zens, R., Ney, H.: Symmetric Word Alignments for Statistical Machine Translation. In: Proc. of the 20th Int. Conf. on Computational Linguistics (COLING-2004), pp. 219–225 (2004)
Melamed, I.D.: Automatic Construction of Clean Broad-Coverage Translation Lexicons. In: Proc. of the 2nd Conf. of the Association for Machine Translation in the Americas (AMTA-1996), pp. 125–134 (1996)
Menezes, A., Richardson, S.D.: A Best-first Alignment Algorithm for Automatic Extraction of Transfer Mappings from Bilingual Corpora. In: Proc. of the ACL 2001 Workshop on Data-Driven Methods in Machine Translation, pp. 39–46 (2001)
Och, F.J., Ney, H.: Improved Statistical Alignment Models. In: Proc. of the 38th Annual Meeting of the Association for Computational Linguistics (ACL-2000), pp. 440–447 (2000)
Parmanto, B., Munro, P., Doyle, H.: Improving Committee Diagnosis with Resampling Techniques. In: Touretzky, D., Mozer, M., Hasselmo, M. (eds.) Advances in Neural Information Processing Systems, vol. 8, pp. 882–888 (1996)
Smadja, F.A., McKeown, K.R., Hatzivassiloglou, V.: Translating Collocations for Bilingual Lexicons: a Statistical Approach. Computational Linguistics 22(1), 1–38 (1996)
Somers, H.: Review Article: Example-Based Machine Translation. Machine Translation 14, 113–157 (1999)
Tufis, D., Barbu, M.: Lexical Token Alignment: Experiments, Results and Application. In: Proc. of the 3rd Int. Conf. on Language Resources and Evaluation (LREC-2002), pp. 458–465 (2002)
Wu, D.: Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora. Computational Linguistics 23(3), 377–403 (1997)
Wu, H., Wang, H.: Improving Domain-Specific Word Alignment with a General Bilingual Corpus. In: Frederking, R., Taylor, K. (eds.) Machine Translation: From Real Users to Research: 6th Conf. of the Association for Machine Translation in the Americas (AMTA- 2004), pp. 262–271 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wu, H., Wang, H. (2005). Improving Statistical Word Alignment with Ensemble Methods. In: Dale, R., Wong, KF., Su, J., Kwong, O.Y. (eds) Natural Language Processing – IJCNLP 2005. IJCNLP 2005. Lecture Notes in Computer Science(), vol 3651. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11562214_41
Download citation
DOI: https://doi.org/10.1007/11562214_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29172-5
Online ISBN: 978-3-540-31724-1
eBook Packages: Computer ScienceComputer Science (R0)