Skip to main content

Learning for Semantic Parsing

  • Conference paper
Computational Linguistics and Intelligent Text Processing (CICLing 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4394))

Abstract

Semantic parsing is the task of mapping a natural language sentence into a complete, formal meaning representation. Over the past decade, we have developed a number of machine learning methods for inducing semantic parsers by training on a corpus of sentences paired with their meaning representations in a specified formal language. We have demonstrated these methods on the automated construction of natural-language interfaces to databases and robot command languages. This paper reviews our prior work on this topic and discusses directions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aho, A.V., Ullman, J.D.: The Theory of Parsing, Translation, and Compiling. Prentice-Hall, Englewood Cliffs (1972)

    MATH  Google Scholar 

  2. Bailey, D., Feldman, J., Narayanan, S., Lakoff, G.: Modeling embodied lexical development. In: Proceedings of the Nineteenth Annual Conference of the Cognitive Science Society (1997)

    Google Scholar 

  3. Borland International: Turbo Prolog 2.0 Reference Guide. Borland International, Scotts Valley, CA (1988)

    Google Scholar 

  4. Brown, P.F., Cocke, J., Della Pietra, S.A., Della Pietra, V.J., Jelinek, F., Lafferty, J.D., Mercer, R.L., Roossin, P.S.: A statistical approach to machine translation. Computational Linguistics 16(2), 79–85 (1990)

    Google Scholar 

  5. Brown, P.F., Della Pietra, V.J., Della Pietra, S.A., Mercer, R.L.: The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics 19(2), 263–312 (1993)

    Google Scholar 

  6. Bunescu, R.C., Mooney, R.J.: A shortest path dependency kernel for relation extraction. In: Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Vancouver, BC, pp. 724–731 (2005)

    Google Scholar 

  7. Bunescu, R.C., Mooney, R.J.: Subsequence kernels for relation extraction. In: Weiss, Y., Schölkopf, B., Platt, J. (eds.) Advances in Neural Information Processing Systems 18: Proceedings of the 2005 Conference (2006)

    Google Scholar 

  8. Carreras, X., Marquez, L.: Introduction to the CoNLL-2004 shared task: Semantic role labeling. In: Proceedings of the Eighth Conference on Computational Natural Language Learning (CoNLL-2004), Boston, MA (2004)

    Google Scholar 

  9. Chen, M., Foroughi, E., Heintz, F., Kapetanakis, S., Kostiadis, K., Kummeneje, J., Noda, I., Obst, O., Riley, P., Steffens, T., Wang, Y., Yin, X.: Users manual: RoboCup soccer server manual for soccer server version 7.07 and later (2003), Available at http://sourceforge.net/projects/sserver/

  10. Chiang, D.: A hierarchical phrase-based model for statistical machine translation. In: Proceedings of the 43nd Annual Meeting of the Association for Computational Linguistics (ACL-05), Ann Arbor, MI, June, pp. 263–270 (2005)

    Google Scholar 

  11. Collins, M.: New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-2002), Philadelphia, PA, July, pp. 263–270 (2002)

    Google Scholar 

  12. Collins, M.J.: Three generative, lexicalised models for statistical parsing. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics (ACL-97), pp. 16–23 (1997)

    Google Scholar 

  13. Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, Cambridge (2000)

    Book  MATH  Google Scholar 

  14. Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B 39, 1–38 (1977)

    MathSciNet  MATH  Google Scholar 

  15. Earley, J.: An efficient context-free parsing algorithm. Communications of the Association for Computing Machinery 6(8), 451–455 (1970)

    MATH  Google Scholar 

  16. Fillmore, C.J., Baker, C.F., Sato, H.: The FrameNet database and software tools. In: Proceedings of the Third International Conference on Language Resources and Evaluation (LREC), Las Palmas, pp. 1157–1160 (2002)

    Google Scholar 

  17. Ge, R., Mooney, R.J.: A statistical semantic parser that integrates syntax and semantics. In: Proceedings of the Ninth Conference on Computational Natural Language Learning (CoNLL-2005), Ann Arbor, MI, July, pp. 9–16 (2005)

    Google Scholar 

  18. Ge, R., Mooney, R.J.: Discriminative reranking for semantic parsing. In: Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics (COLING-ACL-06), Sydney, Australia, July (2006)

    Google Scholar 

  19. Harnad, S.: The symbol grounding problem. Physica D 42, 335–346 (2004)

    Article  Google Scholar 

  20. Hendrix, G.G., Sacerdoti, E., Sagalowicz, D., Slocum, J.: Developing a natural language interface to complex data. ACM Transactions on Database Systems 3(2), 105–147 (1978)

    Article  Google Scholar 

  21. Hovy, E.H., Marcus, M., Palmer, M., Pradhan, S., Ramshaw, L., Weischedel, R.: OntoNotes: The 90% solution. In: Proceedings of Human Language Technology Conference / North American Association for Computational Linguistics Annual Meeting (HLT-NAACL-06), New York, NY (2006)

    Google Scholar 

  22. Joachims, T.: Text categorization with support vector machines: Learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) Machine Learning: ECML-98. LNCS, vol. 1398, pp. 137–142. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  23. Kate, R., Mooney, R.J.: Using string-kernels for learning semantic parsers. In: Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics (COLING-ACL-06), Sydney, Australia, July (2006)

    Google Scholar 

  24. Kate, R.J., Wong, Y.W., Mooney, R.J.: Learning to transform natural to formal languages. In: Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI-2005), Pittsburgh, PA, July, pp. 1062–1068 (2005)

    Google Scholar 

  25. Kuhlmann, G., Stone, P., Mooney, R.J., Shavlik, J.W.: Guiding a reinforcement learner with natural language advice: Initial results in RoboCup soccer. In: Proceedings of the AAAI-04 Workshop on Supervisory Control of Learning and Adaptive Systems, San Jose, CA, July (2004)

    Google Scholar 

  26. Lavrac, N., Dzeroski, S.: Inductive Logic Programming: Techniques and Applications. Ellis Horwood, Chichester (1994)

    MATH  Google Scholar 

  27. Lodhi, H., Saunders, C., Shawe-Taylor, J., Cristianini, N., Watkins, C.: Text classification using string kernels. Journal of Machine Learning Research 2, 419–444 (2002)

    MATH  Google Scholar 

  28. Och, F.J., Ney, H.: A systematic comparison of various statistical alignment models. Computational Linguistics 29(1), 19–51 (2003)

    Article  MATH  Google Scholar 

  29. Popescu, A.-M., Armanasu, A., Etzioni, O., Ko, D., Yates, A.: Modern natural language interfaces to databases: Composing statistical parsing with semantic tractability. In: Proceedings of the Twentieth International Conference on Computational Linguistics (COLING-04), Geneva, Switzerland, August (2004)

    Google Scholar 

  30. Riezler, S., Prescher, D., Kuhn, J., Johnson, M.: Lexicalized stochastic modeling of constraint-based grammars using log-linear measures and EM training. In: Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL-2000), Hong Kong, pp. 480–487 (2000)

    Google Scholar 

  31. Roy, D.: Learning visually grounded words and syntax for a scene description task. Computer Speech and Language 16(3), 353–385 (2002)

    Article  MathSciNet  Google Scholar 

  32. Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)

    Book  MATH  Google Scholar 

  33. Siskind, J.M.: A computational study of cross-situational techniques for learning word-to-meaning mappings. Cognition 61(1), 39–91 (1996)

    Article  Google Scholar 

  34. Stolcke, A.: An efficient probabilistic context-free parsing algorithm that computes prefix probabilities. Computational Linguistics 21(2), 165–201 (1995)

    MathSciNet  Google Scholar 

  35. Tang, L.R., Mooney, R.J.: Using multiple clause constructors in inductive logic programming for semantic parsing. In: Proceedings of the 12th European Conference on Machine Learning, Freiburg, Germany, pp. 466–477 (2001)

    Google Scholar 

  36. Tang, L.R., Mooney, R.J.: Automated construction of database interfaces: Integrating statistical and relational learning for semantic parsing. In: Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora(EMNLP/VLC-2000), Hong Kong, October, pp. 133–141 (2000)

    Google Scholar 

  37. Thompson, C.A., Mooney, R.J.: Acquiring word-meaning mappings for natural language interfaces. Journal of Artificial Intelligence Research 18, 1–44 (2003)

    MATH  Google Scholar 

  38. Waltz, D.L.: An English language question answering system for a large relational database. Communications of the Association for Computing Machinery 21(7), 526–539 (1978)

    Article  MATH  Google Scholar 

  39. Wong, Y.W., Mooney, R.J.: Learning for semantic parsing with statistical machine translation. In: Proceedings of the 2006 Human Language Technology Conference - North American Chapter of the Association for Computational Linguistics Annual Meeting (HLT/NAACL-06), New York City, NY, June, pp. 439–446 (2006)

    Google Scholar 

  40. Woods, W.A.: Lunar rocks in natural English: Explorations in natural language question answering. In: Zampoli, A. (ed.) Linguistic Structures Processing, Elsevier North-Holland, New York (1977)

    Google Scholar 

  41. Yamada, K., Knight, K.: A syntax-based statistical translation model. In: Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL-2001), Toulouse, France, pp. 523–530 (2001)

    Google Scholar 

  42. Yu, C., Ballard, D.H.: On the integration of grounding language and learning objects. In: Proceedings of the Nineteenth National Conference on Artificial Intelligence (AAAI-2004), pp. 488–493 (2004)

    Google Scholar 

  43. Zelenko, D., Aone, C., Richardella, A.: Kernel methods for relation extraction. Journal of Machine Learning Research 3, 1083–1106 (2003)

    MathSciNet  MATH  Google Scholar 

  44. Zelle, J.M., Mooney, R.J.: Learning to parse database queries using inductive logic programming. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence (AAAI-96), Portland, OR, August, pp. 1050–1055 (1996)

    Google Scholar 

  45. Zettlemoyer, L.S., Collins, M.: Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars. In: Proceedings of 21th Conference on Uncertainty in Artificial Intelligence (UAI-2005), Edinburgh, Scotland, July (2005)

    Google Scholar 

  46. Zue, V.W., Glass, J.R.: Conversational interfaces: Advances and challenges. Proceedings of the IEEE 88(8), 1166–1180 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Alexander Gelbukh

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mooney, R.J. (2007). Learning for Semantic Parsing. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2007. Lecture Notes in Computer Science, vol 4394. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70939-8_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-70939-8_28

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-70938-1

  • Online ISBN: 978-3-540-70939-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics