Dynamic Diversification for Interactive Complex Search

  • Ameer AlbahemEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11438)


Many real-world searches are examples of complex information needs such as exploratory, comparative or survey oriented searches. In these search scenarios, users engage interactively with search systems to tackle their information needs. On one hand, user interactions can be leveraged to induce search intents and reformulate queries. On the other hand, the nature of these scenarios introduces constraints in the search process. For instance, systems are expected to satisfy the information needs earlier in the interaction. This research investigates a dynamic diversification approach that observes user interactions and dynamically changes its behaviour in response. In this research, we investigated how dynamic diversification methods should be evaluated. In that regard, we studied and analysed a wide range of offline metrics that model topical relevance novelty and user effort. In addition, this research investigates how to exploit user interactions to develop dynamic diversification methods. In particular, we study the impact of the different dimensions of user relevance feedback, the internal components of relevance feedback algorithms and diversification methods on the overall performance of dynamic diversification methods. Lastly, we intend to measure user satisfaction with these methods using a controlled user study.


Evaluation Dynamic search Relevance feedback Diversification 



This research was partially supported by Australian Research Council (projects LP130100563 and LP150100252), and Real Thing Entertainment Pty Ltd.


  1. 1.
    Albahem, A., Spina, D., Scholer, F., Cavedon, L.: Meta-evaluation of dynamic search: How do metrics capture topical relevance, diversity and user effort? In: Proceedings of ECIR (2019, to appear)Google Scholar
  2. 2.
    Albahem, A., Spina, D., Scholer, F., Moffat, A., Cavedon, L.: Desirable properties for diversity and truncated effectiveness metrics. In: Proceedings of Australasian Document Computing Symposium, pp. 9:1–9:7 (2018)Google Scholar
  3. 3.
    Amigó, E., Spina, D., Carrillo-de Albornoz, J.: An axiomatic analysis of diversity evaluation metrics: introducing the rank-biased utility metric. In: Proceedings of SIGIR, pp. 625–634 (2018)Google Scholar
  4. 4.
    Brondwine, E., Shtok, A., Kurland, O.: Utilizing focused relevance feedback. In: Proceedings of SIGIR, pp. 1061–1064 (2016)Google Scholar
  5. 5.
    Carbonell, J., Goldstein, J.: The use of MMR, diversity-based reranking for reordering documents and producing summaries. In: Proceedings of SIGIR, pp. 335–336 (1998)Google Scholar
  6. 6.
    Dang, V., Croft, W.B.: Diversity by proportionality: an election-based approach to search result diversification. In: Proceedings of SIGIR, pp. 65–74 (2012)Google Scholar
  7. 7.
    Ferro, N., Silvello, G.: Toward an anatomy of IR system component performances. J. Assoc. Inf. Sci. Technol. 69(2), 187–200 (2018)CrossRefGoogle Scholar
  8. 8.
    Jiang, J., He, D., Allan, J.: Comparing in situ and multidimensional relevance judgments. In: Proceedings of SIGIR, pp. 405–414 (2017)Google Scholar
  9. 9.
    Joganah, R., Khoury, R., Lamontagne, L.: Laval university and lakehead university at TREC dynamic domain 2015: combination of techniques for subtopics coverage. In: Proceedings of TREC (2015)Google Scholar
  10. 10.
    Moraes, F., Santos, R.L.T., Ziviani, N.: UFMG at the TREC 2016 dynamic domain track. In: Proceedings of TREC (2016)Google Scholar
  11. 11.
    Rocchio, J.: Relevance Feedback in Information Retrieval. Prentice Hall, Upper Saddle River (1971)Google Scholar
  12. 12.
    Sakai, T.: Evaluation with informational and navigational intents. In: Proceedings of WWW, pp. 499–508 (2012)Google Scholar
  13. 13.
    Santos, R.L., Macdonald, C., Ounis, I.: Exploiting query reformulations for web search result diversification. In: Proceedings of WWW, pp. 881–890 (2010)Google Scholar
  14. 14.
    Santos, R.L., Macdonald, C., Ounis, I.: Search result diversification. Found. Trends Inf. Retrieval 9(1), 1–90 (2015)CrossRefGoogle Scholar
  15. 15.
    Sloan, M., Wang, J.: Dynamic information retrieval: Theoretical framework and application. In: Proceedings of ICTIR, pp. 61–70 (2015)Google Scholar
  16. 16.
    Trippas, J.R., Spina, D., Cavedon, L., Sanderson, M.: How do people interact in conversational speech-only search tasks: a preliminary analysis. In: Proceedings of CHIIR, pp. 325–328 (2017)Google Scholar
  17. 17.
    Yang, H., Frank, J., Soboroff, I.: TREC 2015 dynamic domain track overview. In: Proceedings of TREC (2015)Google Scholar
  18. 18.
    Zhai, C., Lafferty, J.: Model-based feedback in the language modeling approach to information retrieval. In: Proceedings of CIKM, pp. 403–410 (2001)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.RMIT UniversityMelbourneAustralia

Personalised recommendations