Abstract
We describe two new strategies to automatic bracketing of parallel corpora, with particular application to languages where prior grammar resources are scarce: (1) coarse bilingual grammars, and (2) unsupervised training of such grammars via EM (expectation-maximization). Both methods build upon a formalism we recently introduced called stochastic inversion transduction grammars. The first approach borrows a coarse monolingual grammar into our bilingual formalism, in order to transfer knowledge of one languageās constraints to the task of bracketing the texts in both languages. The second approach generalizes the inside-outside algorithm to adjust the grammar parameters so as to improve the likelihood of a training corpus. Preliminary experiments on parallel English-Chinese text are supportive of these strategies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baker, J. K. 1979. Trainable grammars for speech recognition. In Klatt and Wolf (eds), Speech Communication Papers for the 97th Meeting of the Acoustic Society of America, 547ā550.
Black, E., Garside, R. and Leech, G. (eds). 1993. Statistically-driven computer gram- mars of English: The IBM/Lancaster approach. Amsterdam: Editions Rodopi.
Brill, E. 1993. A corpus-based approach to language learning. University of Pennsylvania dissertation.
Brown, P. F., Cocke, J., DellaPietra, S. A., DellaPietra, V. J., Jelinek, F., Lafferty, J. D., Mercer, R. L. and Roossin, P. S. 1990. A statistical approach to machine translation. Computational Linguistics, 16 (2): 29ā85.
Brown, P. F., DellaPietra, S. A., DellaPietra, V. J. and Mercer, R. L. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19 (2): 263ā311.
Church, K. W. 1993. Char-align: A program for aligning parallel texts at the character level. In Proceedings of the 31st Annual Conference of the Association for Computational Linguistics1ā8, Columbus, OH.
Cranias, L., Papageorgiou, H. and Peperidis, S. 1994. A matching technique in example-based machine translation. In Proceedings of the Fifteenth International Conference on Computational Linguistics 100-104, Kyoto.
Dagan, I., Church, K. W. and Gale, W. A. 1993. Robust bilingual word alignment for machine aided translation. In Proceedings of the Workshop on Very Large Corpora 1-8, Columbus, OH.
Fung, P. and Church, K. W. 1994. K-vec: A new approach for aligning parallel texts. In Proceedings of the Fifteenth International Conference on Computational Linguistics,1096ā1102, Kyoto.
Fung, P. and McKeown, K. 1994. Aligning noisy parallel corpora across language groups: Word pair feature matching by dynamic time warping. In AMTA-94 Association for Machine Translation in the Americas81ā88, Columbia, Maryland.
Fung, P. and Wu, D. 1994. Statistical augmentation of a Chinese machine-readable dictionary. In Proceedings of the Second Annual Workshop on Very Large Corpora, 69ā85, Kyoto.
Gale, W. A. and Church, K. W. 1991. A program for aligning sentences in bilingual corpora. In Proceedings of the 29th Annual Conference of the Association for Computational Linguistics, 177ā184, Berkeley.
Gale, W. A., Church, K. W. and Yarowsky, D. 1992. Using bilingual materials to develop word sense disambiguation methods. In TMI-92, Proceedings of the Fourth International Conference on Theoretical and Methodological Issues in Machine Translation, 101ā112, Montreal.
Grishman, R. 1994. Iterative alignment of syntactic structures for a bilingual corpus. In Proceedings of the Second Annual Workshop on Very Large Corpora,57ā68, Kyoto.
Kaji, H., Kida, Y. and Morimoto, Y. 1992. Learning translation templates from bilingual text. In Proceedings of the Fourteenth International Conference on Computational Linguistics,672ā678, Nantes.
Lari, K. and Young, S.-J. 1990. The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer Speech and Language, 4: 35ā56.
Marcus, M. 1991. The automatic acquisition of linguistic structure from large corpora: An overview of work at the university of pennsylvania. In Working Notes from the Spring Symposium on Machine Learning of Natural Language and Ontology 123ā125, Stanford University, Stanford, CA. AAAI.
Matsumoto, Y., Ishimoto, H. and Utsuro, T. 1993. Structural matching of parallel texts. In Proceedings of the 31st Annual Conference of the Association for Computational Linguistics, 23ā30, Columbus, OH.
Pereira, F. and Schabes, Y. 1992. Inside-outside reestimation from partially bracketed corpora. In Proceedings of the 30th Annual Conference of the Association for Computational Linguistics, 128ā135, Newark, DE.
Sadler, V. and Vendelmans, R. 1990. Pilot implementation of a bilingual knowledge bank. In Proceedings of the Thirteenth International Conference on Computational Linguistics,449ā451, Helsinki.
Wu, D. 1994. Aligning a parallel English-Chinese corpus statistically with lexical criteria. In Proceedings of the 32nd Annual Conference of the Association for Computational Linguistics, 80ā87, Las Cruces, New Mexico.
Wu, D. 1995a. Grammarless extraction of phrasal translation examples from parallel texts. In TMI-95, Proceedings of the Sixth International Conference on Theoretical and Methodological Issues in Machine Translation, volume 2, 354ā372, Leuven, Belgium.
Wu, D. 1995b. Stochastic inversion transduction grammars, with application to segmentation, bracketing, and alignment of parallel corpora. In Proceedings of IJCAI-95 Fourteenth International Joint Conference on Artificial Intelligence 1328ā1334, Montreal.
Wu, D. and Fung, P. 1994. Improving Chinese tokenization with linguistic filters on statistical lexical acquisition. In Proceedings of the Fourth Conference on Applied Natural Language Processing,180ā181, Stuttgart.
Wu, D. and Xia, X. 1995. Large-scale automatic extraction of an English-Chinese lexicon. Machine Translation, 9 (3ā4): 285ā313.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 1997 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Wu, D. (1997). Trainable Coarse Bilingual Grammars for Parallel Text Bracketing. In: Armstrong, S., Church, K., Isabelle, P., Manzi, S., Tzoukermann, E., Yarowsky, D. (eds) Natural Language Processing Using Very Large Corpora. Text, Speech and Language Technology, vol 11. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-2390-9_15
Download citation
DOI: https://doi.org/10.1007/978-94-017-2390-9_15
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-5349-7
Online ISBN: 978-94-017-2390-9
eBook Packages: Springer Book Archive