Abstract
In this paper we study whether a question and its answer can be related using analogical reasoning by using various kinds of textual occurrences in a question answering (QA) task. We argue that in a QA passage retrieval context, low cost language features can contribute some positive influence in the representation of the information need that also appears in other passages, which have some analogical features. We attempt to leverage this through query expansion and query stopwords exchange strategies among analogical question answer pairs, which are modeled by a Bayesian Analogical Reasoning framework. Our study by using ResPubliQA 2009 and 2010 dataset shows that the predicted analogical relation between question answer pairs can be used to maintain the information need of the QA passage retrieval task, but has a poor performance in determining the question type. Our best accuracy score was achieved by using‘bigram occurrences by using stemmer and TF-IDF weighting completed with named-entity’ feature set for the query expansion approach, and ‘bigram occurrences by using stemmer and TF-IDF weighting’ feature set for the stopwords exchanged approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Lin, J., Quan, D., Sinha, V., Bakshi, K., Huynh, D., Katz, B., Karger, D.R.: The Role of Context in Question Answering Systems. In: Extended Abstracts on Human Factors in Computing Systems, Fort Lauderdale, Florida, pp. 1006–1007 (2003)
Schlaefer, N., Gieselmann, P., Schaaf, T., Waibel, A.: A Pattern Learning Approach to Question Answering Within the Ephyra Framework. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2006. LNCS (LNAI), vol. 4188, pp. 687–694. Springer, Heidelberg (2006)
Bilotti, M.W.: Linguistic and Semantic Passage Retrieval Strategies for Question Answering. Dissertation Thesis. Language Technologies Institute. School of Computer Science, Carnegie Mellon University (2009)
Aktolga, E., Allan, J., Smith, D.A.: Passage Reranking for Question Answering Using Syntactic Structures and Answer Types. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 617–628. Springer, Heidelberg (2011)
Cui, H., Sun, R., Li, K., Kan, M.-Y., Chua, T.-S.: Question answering passage retrieval using dependency relations. In: SIGIR 2005, pp. 400–407. ACM, New York (2005)
Bilotti, M.W., Elsas, J., Carbonell, J., Nyberg, E.: Rank Learning for Factoid Question Answering with Linguistic and Semantic Constraints. In: Proceedings of CIKM (2010)
Pizzato, L.A., Molla, D., Paris, C.: Pseudo-Relevance Feedback using Named Entities for Question Answering. In: Australasian Language Technology Workshop, ALTW (2006)
Pizzato, L.A., Molla, D.: Indexing on Semantic Roles for Question Answering. In: Proceedings of the 2nd Workshop on Information Retrieval for Question Answering (2008)
Ahn, K., Webber, B.: Topic Indexing and Information Retrieval for Factoid QA. In: Proceedings of the 2nd ACL Workshop on Information Retrieval for Question Answering (2008)
Wang, X.-J., Tu, X., Feng, D., Zhang, L.: Ranking Community Answers by Modeling Question-Answer Relationship via Analogical Reasoning. In: Proceedings of SIGIR Conference (2009)
Silva, R., Heller, K., Ghahramani, Z.: Analogical Reasoning with Relational Bayesian-sets. In: Proceedings of AISTATS (2007)
Silva, R., Heller, K., Ghahramani, Z., Airoldi, E.: Ranking Relations Using Analogies in Biological and Information Networks. The Annals of Applied Statistics 4(2), 615–644 (2010)
Strohman, T., Metzler, D., Turtle, H., Croft, W.B.: Indri: A language-model based search engine for complex queries, http://ciir.cs.umass.edu
Metzler, D.: Indri Retrieval Model Overview, http://ciir.cs.umass.edu/~metzler/indriretmodel.html
Peñas, A., Forner, P., Rodrigo, A., Sutcliffe, R., Forascu, C., Mota, C.: Overview of ResPubliQA 2010: Question Answering Evaluation over European Legislation. In: Working Notes of CLEF ResPubliQA (2010)
Fang, H., Tao, T., Zhai, C.X.: A Formal Study of information Retrieval Heuristics. In: Proceeding of SIGIR. ACM, New York (2005)
Sun, R., Jiang, J., Tan, Y.F., Cui, H., Chua, T.S., Kan, M.Y.: Using syntactic and semantic relation analysis in question answering. In: Proceedings of the 14th Text REtrieval Conference (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Toba, H., Adriani, M., Manurung, R. (2011). Maintaining Passage Retrieval Information Need Using Analogical Reasoning in a Question Answering Task. In: Salem, M.V.M., Shaalan, K., Oroumchian, F., Shakery, A., Khelalfa, H. (eds) Information Retrieval Technology. AIRS 2011. Lecture Notes in Computer Science, vol 7097. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25631-8_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-25631-8_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25630-1
Online ISBN: 978-3-642-25631-8
eBook Packages: Computer ScienceComputer Science (R0)