Combining Interaction and Content for Feedback-Based Ranking

  • Emanuele Di Buccio
  • Massimo Melucci
  • Dawei Song
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6653)


The paper is concerned with the design and the evaluation of the combination of user interaction and informative content features for implicit and pseudo feedback-based document re-ranking. The features are observed during the visit of the top-ranked documents returned in response to a query. Experiments on a TREC Web test collection have been carried out and the experimental results are illustrated. We report that the effectiveness of the combination of user interaction for implicit feedback depends on whether document re-ranking is on a single-user or a user-group basis. Moreover, the adoption of document re-ranking on a user-group basis can improve pseudo-relevance feedback by providing more effective document for expanding queries.


Relevant Document User Study User Behavior Query Expansion Test Collection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Teevan, J., Dumais, S.T., Horvitz, E.: Potential for personalization. ACM Transactions on Computer-Human Interaction 17, 4:1–4:31 (2010),, doi:10.1145/1721831.1721835
  2. 2.
    Jansen, B.J., Spink, A.: An analysis of web searching by european users. Information Processing and Management 41, 361–381 (2005), doi:10.1016/S0306-4573(03)00067-0CrossRefGoogle Scholar
  3. 3.
    Jansen, B.J., Spink, A.: How are we searching the world wide web?: a comparison of nine search engine transaction logs. Information Processing and Management 42, 248–263 (2006),, doi:10.1016/j.ipm.2004.10.007CrossRefGoogle Scholar
  4. 4.
    Melucci, M.: A basis for information retrieval in context. ACM Transaction on Information Systems 26, 14:1–14:41 (2008),, doi:10.1145/1361684.1361687
  5. 5.
    Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems 20, 422–446 (2002),, doi:10.1145/582415.582418CrossRefGoogle Scholar
  6. 6.
    Pearson, K.: On lines and planes of closest fit to systems of points in space. Philosophical Magazine 2, 559–572 (1901)CrossRefzbMATHGoogle Scholar
  7. 7.
    Croft, B., Metzler, D., Strohman, T.: Search Engines: Information Retrieval in Practice, 1st edn. Addison-Wesley Publishing Company, USA (2009)Google Scholar
  8. 8.
    Lavrenko, V., Croft, W.B.: Relevance based language models. In: Proceedings of SIGIR 2001, New Orleans, Louisiana, United States, pp. 120–127. ACM, New York (2001),, doi:10.1145/383952.383972Google Scholar
  9. 9.
    Di Buccio, E., Melucci, M., Song, D.: Exploring Combinations of Sources for Interaction Features for Document Re-ranking. In: Proceedings of HCIR 2010, New Brunswick, NJ, USA, pp. 63–66 (2010)Google Scholar
  10. 10.
    Kelly, D., Teevan, J.: Implicit feedback for inferring user preference: a bibliography. SIGIR Forum 37, 18–28 (2003),, doi:10.1145/959258.959260CrossRefGoogle Scholar
  11. 11.
    Smyth, B.: A community-based approach to personalizing web search. Computer 40, 42–50 (2007), doi:10.1109/MC.2007.259CrossRefGoogle Scholar
  12. 12.
    Rae, A., Sigurbjörnsson, B., van Zwol, R.: Improving tag recommendation using social networks. In: Proceedings of RIAO 2010, Paris, France, pp. 92–99 (2010)Google Scholar
  13. 13.
    Teevan, J., Morris, M.R., Bush, S.: Discovering and using groups to improve personalized search. In: Proceedings of WSDM 2009, Barcelona, Spain, pp. 15–24. ACM, New York (2009),, doi:10.1145/1498759.1498786Google Scholar
  14. 14.
    Fox, S., Karnawat, K., Mydland, M., Dumais, S., White, T.: Evaluating implicit measures to improve web search. ACM Transactions on Information Systems 23, 147–168 (2005),, doi:10.1145/1059981.1059982CrossRefGoogle Scholar
  15. 15.
    Agichtein, E., Brill, E., Dumais, S., Ragno, R.: Learning user interaction models for predicting web search result preferences. In: Proceedings of SIGIR 2006, Seattle, Washington, USA, pp. 3–10. ACM, New York (2006),, doi:10.1145/1148170.1148175Google Scholar
  16. 16.
    Melucci, M., White, R.W.: Utilizing a geometry of context for enhanced implicit feedback. In: Proceedings of CIKM 2007, Lisbon, Portugal, pp. 273–282. ACM, New York (2007),, doi:10.1145/1321440.1321480Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Emanuele Di Buccio
    • 1
  • Massimo Melucci
    • 1
  • Dawei Song
    • 2
  1. 1.University of PaduaItaly
  2. 2.The Robert Gordon UniversityUK

Personalised recommendations