Abstract
We describe a method for learning an incremental semantic grammar from a corpus in which sentences are paired with logical forms as predicate-argument structure trees. Working in the framework of Dynamic Syntax, and assuming a set of generally available compositional mechanisms, we show how lexical entries can be learned as probabilistic procedures for the incremental projection of semantic structure, providing a grammar suitable for use in an incremental probabilistic parser. By inducing these from a corpus generated using an existing grammar, we demonstrate that this results in both good coverage and compatibility with the original entries, without requiring annotation at the word level. We show that this semantic approach to grammar induction has the novel ability to learn the syntactic and semantic constraints on pronouns.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Crocker, M., Pickering, M., Clifton, C. (eds.): Architectures and Mechanisms in Sentence Comprehension. Cambridge University Press (2000)
Ferreira, V.: Is it better to give than to donate? Syntactic flexibility in language production. Journal of Memory and Language 35, 724–755 (1996)
Howes, C., Purver, M., McCabe, R., Healey, P.G.T., Lavelle, M.: Predicting adherence to treatment for schizophrenia from dialogue transcripts. In: Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2012 Conference), pp. 79–83 (2012)
Kempson, R., Meyer-Viol, W., Gabbay, D.: Dynamic Syntax: The Flow of Language Understanding. Blackwell (2001)
Cann, R., Kempson, R., Marten, L.: The Dynamics of Language. Elsevier, Oxford (2005)
Gargett, A., Gregoromichelaki, E., Kempson, R., Purver, M., Sato, Y.: Grammar resources for modelling dialogue dynamically. Cognitive Neurodynamics 3(4), 347–363 (2009)
Charniak, E.: Statistical Language Learning. MIT Press (1996)
Gold, E.M.: Language identification in the limit. Information and Control 10(5), 447–474 (1967)
Klein, D., Manning, C.D.: Natural language grammar induction with a generative constituent-context mode. Pattern Recognition 38(9), 1407–1419 (2005)
Pereira, F., Schabes, Y.: Inside-outside reestimation from partially bracketed corpora. In: Proceedings of the 30th Annual Meeting of the Association for Computational Linguistics, pp. 128–135 (1992)
Steedman, M.: The Syntactic Process. MIT Press, Cambridge (2000)
Zettlemoyer, L., Collins, M.: Online learning of relaxed CCG grammars for parsing to logical form. In: Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL) (2007)
Kwiatkowski, T., Zettlemoyer, L., Goldwater, S., Steedman, M.: Inducing probabilistic CCG grammars from logical form with higher-order unification. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 1223–1233 (2010)
Sato, Y., Tam, W.: Underspecified types and semantic bootstrapping of common nouns and adjectives. In: Proceedings of Language Engineering and Natural Language Semantics (2012)
Lombardo, V., Sturt, P.: Incremental processing and infinite local ambiguity. In: Proceedings of the 1997 Cognitive Science Conference (1997)
Ferreira, F., Swets, B.: How incremental is language production? evidence from the production of utterances requiring the computation of arithmetic sums. Journal of Memory and Language 46, 57–84 (2002)
Hale, J.: A probabilistic Earley parser as a psycholinguistic model. In: Proceedings of the 2nd Conference of the North American Chapter of the Association for Computational Linguistics (2001)
Collins, M., Roark, B.: Incremental parsing with the perceptron algorithm. In: Proceedings of the 42nd Meeting of the ACL, pp. 111–118 (2004)
Clark, S., Curran, J.: Wide-coverage efficient statistical parsing with CCG and log-linear models. Computational Linguistics 33(4), 493–552 (2007)
Blackburn, P., Meyer-Viol, W.: Linguistics, logic and finite trees. Logic Journal of the Interest Group of Pure and Applied Logics 2(1), 3–29 (1994)
Sato, Y.: Local ambiguity, search strategies and parsing in Dynamic Syntax. In: The Dynamics of Lexical Interfaces. CSLI Publications (2011)
Purver, M., Eshghi, A., Hough, J.: Incremental semantic construction in a dialogue system. In: Proceedings of the 9th International Conference on Computational Semantics, pp. 365–369 (2011)
Dempster, A., Laird, N., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological) 39(1), 1–38 (1977)
MacWhinney, B.: The CHILDES Project: Tools for Analyzing Talk, 3rd edn. Lawrence Erlbaum Associates, Mahwah (2000)
Kwiatkowski, T., Goldwater, S., Zettlemoyer, L., Steedman, M.: A probabilistic model of syntactic and semantic acquisition from child-directed utterances and their meanings. In: Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL) (2012)
Cooper, R.: Records and record types in semantic theory. Journal of Logic and Computation 15(2), 99–112 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Eshghi, A., Purver, M., Hough, J., Sato, Y. (2013). Probabilistic Grammar Induction in an Incremental Semantic Framework. In: Duchier, D., Parmentier, Y. (eds) Constraint Solving and Language Processing. CSLP 2012. Lecture Notes in Computer Science, vol 8114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41578-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-41578-4_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41577-7
Online ISBN: 978-3-642-41578-4
eBook Packages: Computer ScienceComputer Science (R0)