Advertisement

Analyzing the Use of Non-overlap Features for Supervised Answer Validation

  • Alberto Téllez-Valero
  • Antonio Juárez-González
  • Manuel Montes-y-Gómez
  • Luis Villaseñor-Pineda
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Abstract

This year we evaluated our supervised answer validation method at both, the Spanish Answer Validation Exercise (AVE) and the Spanish Question Answering Main Task. This paper describes and analyzes our evaluation results from both tracks. In resume, the F-measure of the proposed method outperformed the baseline result of the AVE 2008 task by more than 100%, and enhanced the performance of our question answering system, showing a gain in accuracy of 22% for answering factoid questions. A detailed analysis of the results shows that the proposed non–overlap features are most discriminative than the traditional overlap ones. In particular, these novel features allowed increasing the F-measure result of our method by 26%.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Téllez-Valero, A., et al.: INAOE’s participation at QA@CLEF 2007. In: CLEF 2007 Working Notes, Budapest, Hungary (2007)Google Scholar
  2. 2.
    Téllez-Valero, A., et al.: INAOE at QA@CLEF 2008: Evaluating answer validation in spanish question answering. In: CLEF 2008 Working Notes, Denmark (2008)Google Scholar
  3. 3.
    Rodrigo, Á., Peñas, A., Verdejo, F.: Overview of the answer validation exercise 2008. In: CLEF 2008 Working Notes, Aarhus, Denmark (2008)Google Scholar
  4. 4.
    Forner, P., et al.: Overview of the CLEF 2008 multilingual question answering track. In: CLEF 2008 Working Notes, Aarhus, Denmark (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Alberto Téllez-Valero
    • 1
  • Antonio Juárez-González
    • 1
  • Manuel Montes-y-Gómez
    • 1
  • Luis Villaseñor-Pineda
    • 1
  1. 1.Laboratory of Language TechnologiesINAOEMexico

Personalised recommendations