Skip to main content
SpringerLink
Log in

Modeling of the Question Answering Task in the YodaQA System

  • Conference paper
  • First Online:
Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9283))

Abstract

We briefly survey the current state of art in the field of Question Answering and present the YodaQA system, an open source framework for this task and a baseline pipeline with reasonable performance. We take a holistic approach, reviewing and aiming to integrate many different question answering task definitions and approaches concerning classes of knowledge bases, question representation and answer generation. To ease performance comparisons of general-purpose QA systems, we also propose an effort in building a new reference QA testing corpus which is a curated and extended version of the TREC corpus.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baudiš, P.: YodaQA: a modular question answering system pipeline. In: POSTER 2015–19th International Student Conference on Electrical Engineering (2015)

    Google Scholar 

  2. Berant, J., Chou, A., Frostig, R., Liang, P.: Semantic parsing on freebase from question-answer pairs. In: EMNLP, pp. 1533–1544 (2013)

    Google Scholar 

  3. Bordes, A., Chopra, S., Weston, J.: Question answering with subgraph embeddings (2014). arXiv preprint arXiv:1406.3676

  4. Brill, E., Dumais, S., Banko, M.: An analysis of the AskMSR question-answering system. In: Proceedings of the ACL 2002 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 257–264. Association for Computational Linguistics (2002)

    Google Scholar 

  5. Chu-Carroll, J., Fan, J., Boguraev, B., Carmel, D., Sheinwald, D., Welty, C.: Finding needles in the haystack: Search and candidate generation. IBM Journal of Research and Development 56(3.4), 6:1–6:12 (2012)

    Article  Google Scholar 

  6. Epstein, E.A., Schor, M.I., Iyer, B., Lally, A., et al.: Making watson fast. IBM Journal of Research and Development 56(3.4), 15:1–15:12 (2012)

    Article  Google Scholar 

  7. Fader, A., Zettlemoyer, L., Etzioni, O.: Open question answering over curated and extracted knowledge bases. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1156–1165. ACM (2014)

    Google Scholar 

  8. Fader, A., Zettlemoyer, L.S., Etzioni, O.: Paraphrase-driven learning for open question answering. In: ACL (1), pp. 1608–1618 (2013)

    Google Scholar 

  9. Gondek, D., Lally, A., Kalyanpur, A., Murdock, J.W., Duboué, P.A., Zhang, L., et al.: A framework for merging and ranking of answers in DeepQA. IBM Journal of Research and Development 56(3.4), 14:1–14:12 (2012)

    Article  Google Scholar 

  10. Harabagiu, S.M., Moldovan, D.I., Clark, C., Bowden, M., Williams, J., Bensley, J.: Answer mining by combining extraction techniques with abductive reasoning. In: TREC, pp. 375–382 (2003)

    Google Scholar 

  11. Heilman, M., Smith, N.A.: Tree edit models for recognizing textual entailments, paraphrases, and answers to questions. In: Human Language Technologies: The Annual Conference of the North American Chapter of the ACL (2010), pp. 1011–1019. Association for Computational Linguistics (2010)

    Google Scholar 

  12. Iyyer, M., Boyd-Graber, J., Claudino, L., Socher, R., Daumé III, H.: A neural network for factoid question answering over paragraphs. In: Empirical Methods in Natural Language Processing (2014)

    Google Scholar 

  13. Lally, A., Prager, J.M., McCord, M.C., Boguraev, B., Patwardhan, S., Fan, J., Fodor, P., Chu-Carroll, J.: Question analysis: how watson reads a clue. IBM Journal of Research and Development 56(3.4), 2:1–2:14 (2012)

    Article  Google Scholar 

  14. Schlaefer, N., Gieselmann, P., Schaaf, T., Waibel, A.: A pattern learning approach to question answering within the ephyra framework. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2006. LNCS (LNAI), vol. 4188, pp. 687–694. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  15. Unger, C.: Multilingual question answering over linked data: Qald-4 dataset (2014)

    Google Scholar 

  16. Yao, X., Van Durme, B., Clark, P.: Automatic coupling of answer extraction and information retrieval. In: ACL (2), pp. 159–165. Citeseer (2013)

    Google Scholar 

  17. Yao, X., Van Durme, B., et al.: Answer extraction as sequence tagging with tree edit distance. In: HLT-NAACL, pp. 858–867 (2013)

    Google Scholar 

  18. Yu, L., Hermann, K.M., Blunsom, P., Pulman, S.: Deep learning for answer sentence selection. In: NIPS Deep Learning Workshop, December 2014

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Cybernetics, Czech Technical University, Technická 2, Praha, Czech Republic

    Petr Baudiš & Jan Šedivý

Authors
  1. Petr Baudiš
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jan Šedivý
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Petr Baudiš .

Editor information

Editors and Affiliations

  1. Institut de Recherche en Informatique de Toulouse, Toulouse , France

    Josanne Mothe

  2. Department of Computer Science, University of Neuchatel, Neuchâtel, Switzerland

    Jacques Savoy

  3. Faculteit der Geesteswetenschappen, Universiteit Amsterdam, Amsterdam, The Netherlands

    Jaap Kamps

  4. Institut de Recherche en Informatique de Toulouse, Toulouse, France

    Karen Pinel-Sauvagnat

  5. School of Computing, Dublin City University, Dublin, Ireland

    Gareth Jones

  6. LIA - CERI, Université d'Avignon et des Pays de Vaucluse, Avignon, France

    Eric San Juan

  7. Department of Information Engineering, University of Padua, Padua, Italy

    Linda Capellato

  8. of Information Engineering (DEI), University of Padua, Department, Padova, Italy

    Nicola Ferro

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Baudiš, P., Šedivý, J. (2015). Modeling of the Question Answering Task in the YodaQA System. In: Mothe, J., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2015. Lecture Notes in Computer Science(), vol 9283. Springer, Cham. https://doi.org/10.1007/978-3-319-24027-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24027-5_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24026-8

  • Online ISBN: 978-3-319-24027-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation