Text Chunking Using Transformation-Based Learning
Transformation-based learning, a technique introduced by Eric Brill (1993b), has been shown to do part-of-speech tagging with fairly high accuracy. This same method can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks. For this purpose, it is convenient to view chunking as a tagging problem by encoding the chunk structure in new tags attached to each word. In automatic tests using Treebank-derived data, this technique achieved recall and precision rates of roughly 93% for baseNP chunks (trained on 950K words) and 88% for somewhat more complex chunks that partition the sentence (trained on 200K words). Working in this new application and with larger template and training sets has also required some interesting adaptations to the transformation-based learning approach.
KeywordsNoun Phrase Prepositional Phrase Lexical Rule Apply Natural Language Processing Rule Template
Unable to display preview. Download preview PDF.
- Abney, S. 1991. Parsing by chunks. In Berwick, Abney, and Tenny, editors, Principle-Based Parsing. Kluwer Academic Publishers, pp. 257–278.Google Scholar
- Bourigault, D. 1992. Surface grammatical analysis for the extraction of terminological noun phrases. In Proceedings of the Fifteenth International Conference on Computational Linguistics, pp. 977–981.Google Scholar
- Brill, E. 1993a. Automatic grammar induction and parsing free text: A transformation-based approach. In Proceedings of the DARPA Speech and Natural Language Workshop, 1993, pp. 237–242.Google Scholar
- Brill, E. 1993b. A Corpus-Based Approach to Language Learning. Ph.D. thesis, University of Pennsylvania.Google Scholar
- Brill, E. 1993c. Rule based tagger, version 1.14. Available via ftp from the directory ftp://ft.p.cs.jhu.edu/pub/brill/programs/.
- Brill, E. 1994. Sonie advances in transformation-based part of speech tagging. In Proceedings of the Twelfth. National Conference on Artificial Intelligence, pp. 722–727.Google Scholar
- Brill, E. and Resnik, P. 1994. A rule-based approach to prepositional attachment disambiguation. In Proceedings of the Fifteenth International Conference on Computational Linguistics, Kyoto, Japan.Google Scholar
- Church, K. 1988. A stochastic parts program and noun phrase parser for unrestricted text. In Second Conference on Applied Natural Language Processing. Association for Computational Linguistics.Google Scholar
- Ejerhed, E. I. 1988. Finding clauses in unrestricted text by finitary and stochastic methods. In Second Conference on Applied Natural Language Processing,pp. 219–227. Association for Computational Linguistics.Google Scholar
- Kupiec, J. 1993. An algorithm for finding noun phrase correspondences in bilingual corpora. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pp. 17–22.Google Scholar
- Mitchell, M., Kim, G., Marcinkiewicz, M. A., Maclntyre, R., Bies, A., Ferguson, M., Katz, K. and Schasberger, B. 1994. The Penn Treebank: A revised corpus design for extracting predicate argument structure. In Human Language Technology, ARPA March 1994 Workshop. Morgan Kaufmann.Google Scholar
- Ramshaw, L. A. and Mitchell, P. M. 1994. Exploring the statistical derivation of transformational rule sequences for part-of-speech tagging. In Proceedings of the Balancing Act Workshop on Combining Symbolic and Statistical Approaches to Language, Association for Computational Linguistics, pp. 86–95.Google Scholar
- Voutilainen, A. 1993. NPToo1, a detector of English noun phrases. In Proceedings of the Workshop on Very Large Corpora, pp. 48–57. Association for Computational Linguistics.Google Scholar