Skip to main content

Minimum Description Length and Compositionality

  • Chapter
Computing Meaning

Part of the book series: Studies in Linguistics and Philosophy ((SLAP,volume 73))

Abstract

In (Zadrozny, 1994) we have shown that the standard definition of compositionality is formally vacuous; that is, any semantics can be easily encoded as a compositional semantics. We have also shown that when compositional semantics is required to be ‘systematic’, it is possible to introduce a non-vacuous concept of compositionality. However, a technical definition of systematicity was not given in that paper; only examples of systematic and non-systematic semantics were presented. As a result, although our paper clarified the concept of compositionality, it did not solve the problem of the systematic assignment of meanings. In other words, we have shown that the concept of compositionality is vacuous, but we have not replaced it with a better definition; a definition that would both be mathematically correct and would satisfy the common intuitions that there are parts of grammars which seem to have compositional semantics, and others, like idioms, that do not. We present such a non-vacuous definition of compositionality in this chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Brown, P.F., V.J. Della Pietra, P.V. deSouza, J.C. Lai and R.L. Mercer (1992) Class-based n-gram Models of Natural Language. Computational Linguistics 18(4):467-480.

    Google Scholar 

  • Dixon, R.M.W. (1991) A New Approach to English Grammar on Semantic Principles. Clarendon Press, Oxford

    Google Scholar 

  • Fillmore, C.J., P. Kay, and M.C. O’Connor (1988) Regularity and idiomaticity in grammatical constructions. Language, 64(3):501-538.

    Article  Google Scholar 

  • Grunwald, P. (1996) A Minimum Description Length Approach to Grammar Inference. In S. Wermter et al., editors, Symbolic, Connectionist and Statistical Approach to Learning for Natural Language Processing, pages 203–216, Springer, Berlin.

    Chapter  Google Scholar 

  • Hirst, G. (1987) Semantic interpretation and the resolution of ambiguity. Cambridge University Press, Cambridge, Great Britain.

    Book  Google Scholar 

  • Keenan, E.L. and L.M. Faltz (1985) Boolean Semantics for Natural Language. D Reidel, Dordrecht, Holland.

    Google Scholar 

  • Li, M., and P. Vitanyi (1993) An Introduction to Kolmogorv Complexity and Its Applications. Springer, New York.

    Google Scholar 

  • Partee, B.H., A. ter Meulen, and R.E. Wall (1990) Mathematical Methods in Lingusitics. Kluwer, Dordrecht, The Netherlands.

    Book  Google Scholar 

  • Savitch, W.J. (1993) Why it might pay to assume that languages are infinite. Annals of Mathematics and Artificial Intelligence, 8(1,2):17–26.

    Article  Google Scholar 

  • Rissanen, J. (1982) A universal prior for integers and estimation by minimum description length. Annals of Statistics, 11:416–431.

    Article  Google Scholar 

  • Simon, H.A. (1981) The Sciences of the Artificial. MIT Press, Cambridge, MA.

    Google Scholar 

  • Zadrozny, W. (1994) From compositional to systematic semantics. Linguistics and Philosophy 17(4):329–342.

    Article  Google Scholar 

  • Zadrozny, W. (1995) The Compactnes of Construction Grammars. IBM Research, T.J. Watson Research Center; Report RC 20003 (88493).

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Zadrozny, W. (1999). Minimum Description Length and Compositionality. In: Bunt, H., Muskens, R. (eds) Computing Meaning. Studies in Linguistics and Philosophy, vol 73. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4231-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-4231-1_6

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-0290-8

  • Online ISBN: 978-94-011-4231-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics