Capturing User Interests by Both Exploitation and Exploration

  • Ka Cheung Sia
  • Shenghuo Zhu
  • Yun Chi
  • Koji Hino
  • Belle L. Tseng
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4511)


Personalization is one of the important research issues in the areas of information retrieval and Web search. Providing personalized services that are tailored toward the specific preferences and interests of a given user can enhance her experience and satisfaction. However, to effectively capture user interests is a challenging research problem. Some challenges include how to quickly capture user interests in an unobtrusive way, how to provide diversified recommendations, and how to track the drifts of user interests in a timely fashion. In this paper, we propose a model for learning user interests and an algorithm that actively captures user interests through an interactive recommendation process. The key advantage of our algorithm is that it takes into account both exploitation (recommending items that belong to users’ core interest) and exploration (discovering potential interests of users). Extensive experiments using synthetic data and a user study show that our algorithm can quickly capture diversified user interests in an unobtrusive way, even when the user interests may drift along time.


User Study Query Expansion User Interest Important Research Issue Exploration Bonus 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jameson, A.: User modeling meets usability goals. In: Ardissono, L., Brna, P., Mitrović, A. (eds.) UM 2005. LNCS (LNAI), vol. 3538, Springer, Heidelberg (2005)Google Scholar
  2. 2.
    Ziegler, C.N., McNee, S.M., Konstan, J.A., Lausen, G.: Improving recommendation lists through topic diversification. In: WWW 2005 (2005)Google Scholar
  3. 3.
    Webb, G.I., Pazzani, M.J., Billsus, D.: Machine learning for user modeling. User Modeling and User-Adapted Interaction 11(1-2), 19–29 (2001)zbMATHCrossRefGoogle Scholar
  4. 4.
    Efthimiadis, E.N.: Interactive query expansion: A user-based evaluation in a relevance feedback environment. Journal of the American Society for Information Science, 51(11) (2000)Google Scholar
  5. 5.
    Kelly, D., Dollu, V.D., Fu, X.: The loquacious user: a document-independent source of terms for query expansion. In: SIGIR (2005)Google Scholar
  6. 6.
    Mobasher, B., Cooley, R., Srivastava, J.: Automatic personalization based on web usage mining. Communications of the ACM, 43(8) (2000)Google Scholar
  7. 7.
    Mobasher, B., Dai, H., Luo, T., Nakagawa, M.: Discovery and evaluation of aggregate usage profiles for web personalization. Data Mining and Knowledge Discovery, 6(1) (2002)Google Scholar
  8. 8.
    Agichtein, E., Brill, E., Dumais, S.: Improving web search ranking by incorporating user behavior information. In: SIGIR (2006)Google Scholar
  9. 9.
    Agichtein, E., Brill, E., Dumais, S., Ragno, R.: Learning user interaction models for predicting web search result preferences. In: SIGIR (2006)Google Scholar
  10. 10.
    Qiu, F., Cho, J.: Automatic identification of user interest for personalized search. In: WWW 2006 (2006)Google Scholar
  11. 11.
    Jin, X., Zhou, Y., Mobasher, B.: Task-oriented web user modeling for recommendation. In: Ardissono, L., Brna, P., Mitrović, A. (eds.) UM 2005. LNCS (LNAI), vol. 3538, Springer, Heidelberg (2005)Google Scholar
  12. 12.
    Joachims, T.: Optimizing search engines using clickthrough data. In: SIGKDD (2002)Google Scholar
  13. 13.
    Kelly, D., Belkin, N.J.: Display time as implicit feedback: understanding task effects. In: SIGIR (2004)Google Scholar
  14. 14.
    Sugiyama, K., Hatano, K., Yoshikawa, M.: Adaptive web search based on user profile constructed without any effort from users. In: WWW 2004 (2004)Google Scholar
  15. 15.
    Shen, X., Zhai, C.: Active feedback in ad hoc information retrieval. In: SIGIR (2005)Google Scholar
  16. 16.
    Gittins, J.C., Jones, D.M.: A dynamic allocation index for the sequential design of experiments. In: Gani, J., et al. (eds.) Progress in Statistics, vol. I, pp. 241–266. North-Holland, Amsterdam-London (1974)Google Scholar
  17. 17.
    Sutton, R.S.: Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In: ICML 1990, pp. 216–224. Morgan Kaufman, San Mateo CA (1990)Google Scholar
  18. 18.
    Sia, K.C., Zhu, S., Chi, Y., Hino, K., Tseng, B.L.: Capturing User Interests by Both Exploitation and Exploration. Technical report, NEC Labs America (2006)Google Scholar
  19. 19.
    Netscape: Dmoz open directory project,

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Ka Cheung Sia
    • 1
  • Shenghuo Zhu
    • 2
  • Yun Chi
    • 2
  • Koji Hino
    • 2
  • Belle L. Tseng
    • 2
  1. 1.University of California, Los Angeles, CA 90095USA
  2. 2.NEC Laboratories America, 10080 N. Wolfe Rd, SW3-350, Cupertino, CA 95014USA

Personalised recommendations