Skip to main content

Evaluating Supervised Semantic Parsing Methods on Application-Independent Data

  • Conference paper
  • 504 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8607))

Abstract

While supervised statistical semantic parsing methods have received a good amount of attention in recent years, this research has largely been done on small and specialized data sets. This paper introduces a work-in-progress with the objective of examining the applicability of supervised statistical semantic parsing to application-independent data with linguistically motivated meaning representations. The approach discussed in this paper has three key aspects: The circumvention of data scarcity using automatic annotation, experimentation with different types of meaning representations, and the design of a suitable graded evaluation measure.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wong, Y.W., Mooney, R.: Learning synchronous grammars for semantic parsing with lambda calculus. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, Prague, Czech Republic, pp. 960–967. Association for Computational Linguistics (June 2007)

    Google Scholar 

  2. Bos, J.: Wide-coverage semantic analysis with boxer. In: Semantics in Text Processing, STEP 2008 Conference Proceedings. Research in Computational Semantics, vol. 1, pp. 277–286. College Publications (2008)

    Google Scholar 

  3. Le, P., Zuidema, W.: Learning compositional semantics for open domain semantic parsing. In: Proceedings of COLING 2012, Mumbai, India, pp. 1535–1552. The COLING 2012 Organizing Committee (December 2012)

    Google Scholar 

  4. Kamp, H., Reyle, U.: From Discourse to Logic: Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory. Kluwer, Dordrecht (December 1993)

    Google Scholar 

  5. Basile, V., Bos, J., Evang, K., Venhuizen, N.: Developing a large semantically annotated corpus. In: Calzolari, N., Choukri, K., Declerck, T., Doğan, M.U., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S. (eds.) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, Turkey, pp. 3196–3200. European Language Resources Association (ELRA) (2012); ACL Anthology Identifier: L12-1299

    Google Scholar 

  6. Ide, N., Baker, C., Fellbaum, C., Passonneau, R.: The manually annotated subcorpus: A community resource for and by the people. In: Proceedings of the ACL 2010 Conference Short Papers, Uppsala, Sweden, pp. 68–73. Association for Computational Linguistics (July 2010)

    Google Scholar 

  7. Lu, W., Ng, H.T., Lee, W.S., Zettlemoyer, L.S.: A generative model for parsing natural language to meaning representations. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 783–792 (2008)

    Google Scholar 

  8. Kwiatkowski, T., Zettlemoyer, L., Goldwater, S., Steedman, M.: Inducing probabilistic CCG grammars from logical form with higher-order unification. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Cambridge, MA, pp. 1223–1233. Association for Computational Linguistics (October 2010)

    Google Scholar 

  9. Liang, P., Jordan, M., Klein, D.: Learning dependency-based compositional semantics. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, Oregon, USA, pp. 590–599. Association for Computational Linguistics (June 2011)

    Google Scholar 

  10. Alshawi, H., Chang, P.C., Ringgaard, M.: Deterministic statistical mapping of sentences to underspecified semantics. In: Bos, J., Pulman, S. (eds.) Proceedings of the Ninth International Conference on Computational Semantics (IWCS 2011), Oxford, UK, pp. 15–24 (2011)

    Google Scholar 

  11. Richter, F., Sailer, M.: Basic concepts of lexical resource semantics. In: Collegium Logicum. ESSLLI 2003 - Course Material I. Collegium Logicum, vol. 5, pp. 87–143. Kurt Gödel Society, Wien (2004)

    Google Scholar 

  12. Shieber, S.M.: The problem of logical-form equivalence. Computational Linguistics 19(1), 179–190 (1993)

    Google Scholar 

  13. Allen, J.F., Swift, M., de Beaumont, W.: Deep semantic analysis of text. In: Bos, J., Delmonte, R. (eds.) Semantics in Text Processing, STEP 2008 Conference Proceedings. Research in Computational Semantics, vol. 1, pp. 343–354. College Publications (2008)

    Google Scholar 

  14. Steedman, M.: The Syntactic Process. MIT Press, Cambridge (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Beschke, S. (2014). Evaluating Supervised Semantic Parsing Methods on Application-Independent Data. In: Colinet, M., Katrenko, S., Rendsvig, R.K. (eds) Pristine Perspectives on Logic, Language, and Computation. ESSLLI ESSLLI 2013 2012. Lecture Notes in Computer Science, vol 8607. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44116-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44116-9_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44115-2

  • Online ISBN: 978-3-662-44116-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics