Abstract
Community Question Answering (CQA) services have accumulated large archives of question-answer pairs, which are usually organized into a hierarchy of categories. To reuse the invaluable resources, it’s essential to develop effective Question Retrieval (QR) models to retrieve similar questions from CQA archives given a queried question. This paper studies the integration of category information of questions into the unigram Language Model (LM). Specifically, a novel Category-integrated Language Model (CLM) is proposed which views category-specific term saliency as the Dirichlet hyper-parameter that weights the parameters of LM. A point-wise divergence based measure is introduced to compute a term’s category-specific term saliency. Experiments conducted on a real world dataset from Yahoo! Answers show that the proposed CLM which integrates the category information into LM internally at the word level can significantly outperform the previous work that incorporates the category information into LM externally at the word level or at the document level.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cai, L., Zhou, G., Liu, K., Zhao, J.: Learning the latent topics for question retrieval in community qa. In: IJCNLP, pp. 273–281 (2011)
Cao, X., Cong, G., Cui, B., Jensen, C.S., Zhang, C.: The use of categorization information in language models for question retrieval. In: CIKM, pp. 265–274 (2009)
Cao, X., Cong, G., Cui, B., Jensen, C.S.: A generalized framework of exploring category information for question retrieval in community question answer archives. In: WWW, pp. 201–210 (2010)
Jeon, J., Bruce Croft, W., Lee, J.H.: Finding similar questions in large question and answer archives. In: CIKM, pp. 84–90 (2005)
Ji, Z., Xu, F., Wang, B., He, B.: Question-answer topic model for question retrieval in community question answering. In: CIKM (2012)
Lafferty, J., Zhai, C.: Document language models, query models, and risk minimization for information retrieval. In: SIGIR, pp. 111–119 (2001)
Lee, J.-T., Kim, S.-B., Song, Y.-I., Rim, H.-C.: Bridging lexical gaps between queries and questions on large online q&a collections with compact translation models. In: EMNLP, pp. 410–418 (2008)
Ming, Z.-Y., Chua, T.-S., Cong, G.: Exploring domain-specific term weight in archived question search. In: CIKM, pp. 1605–1608 (2010)
Wang, K., Ming, Z., Chua, T.-S.: A syntactic tree matching approach to finding similar questions in community-based qa services. In: SIGIR, pp. 187–194 (2009)
Xue, X., Jeon, J., Bruce Croft, W.: Retrieval models for question and answer archives. In: SIGIR, pp. 475–482 (2008)
Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: SIGIR, pp. 334–342 (2001)
Zhou, G., Cai, L., Zhao, J., Liu, K.: Phrase-based translation model for question retrieval in community question answer archives. In: ACL-HLT, pp. 653–662 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ji, Z., Xu, F., Wang, B. (2012). A Category-integrated Language Model for Question Retrieval in Community Question Answering. In: Hou, Y., Nie, JY., Sun, L., Wang, B., Zhang, P. (eds) Information Retrieval Technology. AIRS 2012. Lecture Notes in Computer Science, vol 7675. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35341-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-35341-3_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35340-6
Online ISBN: 978-3-642-35341-3
eBook Packages: Computer ScienceComputer Science (R0)