Skip to main content

Joint Labeling of Syntactic Function and Semantic Role Using Probabilistic Finite State Automata

  • Conference paper
  • First Online:
Intelligent Systems and Applications (IntelliSys 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 869))

Included in the following conference series:

  • 1785 Accesses

Abstract

Syntactic parsing and semantic labeling are common natural language processing tasks. Traditionally, they were mostly arranged in a pipeline architecture. During the last decade, however, different joint parsing approaches have been introduced where the sequential dependency between the two levels is reduced. In this paper, we present a model for a simplified joint parsing, namely, labeling, based on probabilistic finite state automata through the extended label set paradigm. The parsing (labeling) we present in this research considers syntactic dependency annotation and semantic role labeling without constructing a complete dependency hierarchy. In our experiment, we show that the proposed model outperforms the standard finite transducer approach (Hidden Markov Model). In spite of the considerably increased search space for the joint syntactic and semantic labeling, the proposed solution keeps a high accuracy of the syntactic labeling on par with the quality of syntax-only models. In addition to that it provides a reasonable semantic annotation quality without a separate processing step.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lluis, X.: Joint parsing of syntactic and semantic dependencies, Ph.D. dissertation. Universitat Politècnica de Catalunya (2015)

    Google Scholar 

  2. Nivre, J.: Incrementality in deterministic dependency parsing. In: Proceedings of the Workshop on Incremental Parsing: Bringing Engineering and Cognition Together, ser. IncrementParsing ’04. Stroudsburg, PA, USA: Association for Computational Linguistics, 2004, pp. 50–57

    Google Scholar 

  3. Nivre, J., Nilsson, J.: Memory-based dependency parsing. In: Proceedings of CoNLL (2004)

    Google Scholar 

  4. Nivre, J.: Constraints on non-projective dependency parsing. In: Proceedings of EACL, pp. 73–80 (2006)

    Google Scholar 

  5. Palmer, M., Gildea, D., Kingsbury, P.: The proposition bank: an annotated corpus of semantic roles. Comput. Linguist. 31(1), 71–106 (2005)

    Article  Google Scholar 

  6. Kipper, K., Korhonen, A., Ryant, N., Palmer, M.: Extending verbnet with novel verb classes. In: Proceedings of the Fifth International Conference on Language Resources and Evaluation – LREC’06 (http://verbs.colorado.edu/~mpalmer/projects/verbnet.html) (2006)

  7. Che, W., Li, Z., Li, Y., Guo, Y., Qin, B., Liu, T.: Multilingual dependency-based syntactic and semantic parsing. In: Proceedings of the Thirteenth Conference on Computational Natural Language Learning: Shared Task, ser. CoNLL ’09, pp. 49–54. Association for Computational Linguistics, Stroudsburg, PA, USA (2009)

    Google Scholar 

  8. Gildea, D., Jurafsky, D.: Automatic labeling of semantic roles. Comput. Linguist. 28(3), 245–288 (2002)

    Article  Google Scholar 

  9. Johansson, R., Nugues, P.: Dependency-based syntactic-semantic analysis with propbank and nombank. In: Proceedings of the Twelfth Conference on Computational Natural Language Learning, ser. CoNLL ’08, pp. 183–187. Association for Computational Linguistics, Stroudsburg, PA, USA (2008)

    Google Scholar 

  10. Musillo, G., Merlo, P.: Accurate parsing of the proposition bank. In: Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, ser. NAACL-Short ’06, pp. 101–104. Association for Computational Linguistics, Stroudsburg, PA, USA (2006)

    Google Scholar 

  11. Hopcroft, J.E., Motwani, R., Ullman, J.D.: Introduction to Automata Theory, Languages, and Computation, 3rd edn. Addison-Wesley Longman Publishing Co., Inc, Boston, MA (2006)

    MATH  Google Scholar 

  12. Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. In: Proceedings of the IEEE, pp. 257–286 (1989)

    Article  Google Scholar 

  13. Ning, H., Yang, H., Li, Z.: A method integrating rule and hmm for Chinese part-of-speech tagging. In: 2nd IEEE Conference on Industrial Electronics and Applications, 2007. ICIEA 2007, pp. 723–725. IEEE, New York (2007)

    Google Scholar 

  14. Jayaweera, A.J.P.M.P., Dias, N.G.J.: Hidden Markov model based part of speech tagger for sinhala language. CoRR, vol. abs/1407.2989 (2014)

    Article  Google Scholar 

  15. Navigli, R.: Word sense disambiguation: a survey. ACM Comput. Surv. 41(2), 10:1–10:69 (2009)

    Article  Google Scholar 

  16. Varona, A., Torres, I.: Scaling smoothed language models. Int. J. Speech Technol. 8(4), 341–361 (2005)

    Article  Google Scholar 

  17. Salama, A.R., Menzel, W.: Multimodal graph-based dependency parsing of natural language. In: Proceedings of the International Conference on Advanced Intelligent Systems and Informatics, AISI 2016, Cairo, Egypt, October 24-26, 2016, pp. 22–31 (2016)

    Google Scholar 

  18. Baumgartner, C.: On-line cross-modal context integration for natural language parsing, Ph.D. dissertation, Universitat Hamburg (2013)

    Google Scholar 

  19. McCrae, P.: A model for the cross-modal influence of visual context upon language processing. In: RANLP, pp. 230–235 (2009)

    Google Scholar 

  20. Surdeanu, M., Johansson, R., Meyers, A., Màrquez, L., Nivre, J.: The Conll-2008 shared task on joint parsing of syntactic and semantic dependencies. In: Proceedings of the Twelfth Conference on Computational Natural Language Learning, ser. CoNLL ’08, pp. 159–177. Association for Computational Linguistics, Stroudsburg, PA, USA (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amr Rekaby Salama .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rekaby Salama, A., Menzel, W. (2019). Joint Labeling of Syntactic Function and Semantic Role Using Probabilistic Finite State Automata. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2018. Advances in Intelligent Systems and Computing, vol 869. Springer, Cham. https://doi.org/10.1007/978-3-030-01057-7_46

Download citation

Publish with us

Policies and ethics