Minimum Description Length and Compositionality
- 149 Downloads
In (Zadrozny, 1994) we have shown that the standard definition of compositionality is formally vacuous; that is, any semantics can be easily encoded as a compositional semantics. We have also shown that when compositional semantics is required to be ‘systematic’, it is possible to introduce a non-vacuous concept of compositionality. However, a technical definition of systematicity was not given in that paper; only examples of systematic and non-systematic semantics were presented. As a result, although our paper clarified the concept of compositionality, it did not solve the problem of the systematic assignment of meanings. In other words, we have shown that the concept of compositionality is vacuous, but we have not replaced it with a better definition; a definition that would both be mathematically correct and would satisfy the common intuitions that there are parts of grammars which seem to have compositional semantics, and others, like idioms, that do not. We present such a non-vacuous definition of compositionality in this chapter.
KeywordsMinimum Description Length Grammar Rule Language Understanding Compositional Semantic Minimum Description Length Principle
Unable to display preview. Download preview PDF.
- Brown, P.F., V.J. Della Pietra, P.V. deSouza, J.C. Lai and R.L. Mercer (1992) Class-based n-gram Models of Natural Language. Computational Linguistics 18(4):467-480.Google Scholar
- Dixon, R.M.W. (1991) A New Approach to English Grammar on Semantic Principles. Clarendon Press, OxfordGoogle Scholar
- Keenan, E.L. and L.M. Faltz (1985) Boolean Semantics for Natural Language. D Reidel, Dordrecht, Holland.Google Scholar
- Li, M., and P. Vitanyi (1993) An Introduction to Kolmogorv Complexity and Its Applications. Springer, New York.Google Scholar
- Simon, H.A. (1981) The Sciences of the Artificial. MIT Press, Cambridge, MA.Google Scholar
- Zadrozny, W. (1995) The Compactnes of Construction Grammars. IBM Research, T.J. Watson Research Center; Report RC 20003 (88493).Google Scholar