Abstract
The personalized and collaborative information retrieval (PIR) track at FIRE 2011 was organized with the aim of extending standard information retrieval (IR) ad-hoc test collection design to facilitate research on personalized and collaborative IR by collecting additional meta-information during the topic (query) development process. A controlled query generation process through task-based activities with activity logging was used by each topic developer to construct a final set of topics. The standard ad-hoc collection is thus accompanied by a new set of thematically related topics and the associated log information. This better simulates a real-world search scenario and encourages mining user information from the logs to improve IR effectiveness. A set of 25 TREC formatted topics and the associated metadata of activity logs were released for the participants to use. We illustrate the data construction phase in detail and also outline simple ways of using the additional information from the logs, such as query and document click history, to improve retrieval effectiveness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arvola, P., Geva, S., Kamps, J., Schenkel, R., Trotman, A., Vainio, J.: Overview of the INEX 2010 ad hoc track. In: Geva, S., Kamps, J., Schenkel, R., Trotman, A. (eds.) INEX 2010. LNCS, vol. 6932, pp. 1–32. Springer, Heidelberg (2011)
Bates, M.J.: The Design of Browsing and Berrypicking Techniques for the Online Search Interface. Online Review 13(5), 407–424 (1989)
Di Nunzio, G.M., Leveling, J., Mandl, T.: Multilingual log analysis: LogCLEF. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 675–678. Springer, Heidelberg (2011)
Harman, D.: Overview of the third text retrieval conference (TREC-3). In: TREC (1994)
Kanoulas, E., Carterette, B., Hall, M., Clough, P., Sanderson, M.: Overview of the TREC 2011 session track. In: TREC (2011)
Kanoulas, E., Clough, P., Carterette, B., Sanderson, M.: Session track at TREC 2010. In: SIMINT Workshop SIGIR 2010. ACM (2010)
Kellar, M., Watters, C.R., Shepherd, M.A.: A field study characterizing web-based information-seeking tasks. JASIST 58(7), 999–1018 (2007)
Kelly, D., Belkin, N.J.: Display time as implicit feedback: understanding task effects. In: Proceedings of SIGIR 2004, pp. 377–384. ACM (2004)
Li, W., Ganguly, D., Jones, G.J.F.: Enhanced information retrieval using domain-specific recommender models. In: Amati, G., Crestani, F. (eds.) ICTIR 2011. LNCS, vol. 6931, pp. 201–212. Springer, Heidelberg (2011)
Liu, J., Belkin, N.J.: Personalizing information retrieval for multi-session tasks: the roles of task stage and task type. In: Proceedings of SIGIR 2010, pp. 26–33. ACM (2010)
Matthijs, N., Radlinski, F.: Personalizing web search using long term browsing history. In: Proceedings of WSDM 2011, pp. 25–34. ACM (2011)
Ponte, J.M.: A language modeling approach to information retrieval. PhD thesis, University of Massachusetts (1998)
Ponte, J.M., Croft, W.B.: A language modeling approach to information retrieval. In: Proceedings of SIGIR 1998, pp. 275–281. ACM (1998)
Sontag, D., Collins-Thompson, K., Bennett, P.N., White, R.W., Dumais, S., Billerbeck, B.: Probabilistic models for personalizing web search. In: Proceedings of WSDM 2012, pp. 433–442. ACM (2012)
Tan, B., Shen, X., Zhai, C.: Mining long-term search history to improve search accuracy. In: Proceedings of KDD 2006, pp. 718–723. ACM (2006)
Teevan, J., Dumais, S.T., Liebling, D.J.: To personalize or not to personalize: modeling queries with variation in user intent. In: Proceedings of SIGIR 2008, pp. 163–170. ACM (2008)
White, R.W., Kelly, D.: A study on the effects of personalization and task information on implicit feedback performance. In: Proceedings of CIKM 2006, pp. 297–306. ACM (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ganguly, D., Leveling, J., Jones, G.J.F. (2013). Overview of the Personalized and Collaborative Information Retrieval (PIR) Track at FIRE-2011. In: Majumder, P., Mitra, M., Bhattacharyya, P., Subramaniam, L.V., Contractor, D., Rosso, P. (eds) Multilingual Information Access in South Asian Languages. Lecture Notes in Computer Science, vol 7536. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40087-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-40087-2_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40086-5
Online ISBN: 978-3-642-40087-2
eBook Packages: Computer ScienceComputer Science (R0)