Skip to main content

Directing and Combining Multiple Queries for Exploratory Search by Visual Interactive Intent Modeling

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Abstract

In interactive information-seeking, a user often performs many interrelated queries and interactions covering multiple aspects of a broad topic of interest. Especially in difficult information-seeking tasks the user may need to find what is in common among such multiple aspects. Therefore, the user may need to compare and combine results across queries. While methods to combine queries or rankings have been proposed, little attention has been paid to interactive support for combining multiple queries in exploratory search. We introduce an interactive information retrieval system for exploratory search with multiple simultaneous search queries that can be combined. The user is able to direct search in the multiple queries, and combine queries by two operations: intersection and difference, which reveal what is relevant to the user intent of two queries, and what is relevant to one but not the other. Search is directed by relevance feedback on visualized user intent models of each query. Operations on queries act directly on the intent models inferring a combined user intent model. Each combination yields a new result (ranking) and acts as a new search that can be interactively directed and further combined. User experiments on difficult information-seeking tasks show that our novel system with query operations yields more relevant top-ranked documents in a shorter time than a baseline multiple-query system.

Work supported by Academy of Finland (FCAI flagship and grants 313748 & 327352), Business Finland (grants 2115754 & 211548), and Aalto Science-IT.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahn, J., Brusilovsky, P.: Adaptive visualization for exploratory information retrieval. Inf. Process. Manag. 49(5), 1139–1164 (2013). https://doi.org/10.1016/j.ipm.2013.01.007

    Article  Google Scholar 

  2. Anava, Y., Shtok, A., Kurland, O., Rabinovich, E.: A probabilistic fusion framework. In: Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM’16), pp. 1463–1472. ACM (2016)

    Google Scholar 

  3. Andolina, S., et al.: IntentStreams: smart parallel search streams for branching exploratory search. In: Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI’15), pp. 300–305. ACM (2015)

    Google Scholar 

  4. Auer, P.: Using confidence bounds for exploitation-exploration trade-offs. J. Mach. Learn. Res. 3(Nov), 397–422 (2002)

    MathSciNet  MATH  Google Scholar 

  5. Backhausen, D.T.J.: Adaptive IR for exploratory search support. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’12), p. 992. ACM (2012). https://doi.org/10.1145/2348283.2348416

  6. Belkin, N.J., Kantor, P., Fox, E.A., Shaw, J.A.: Combining the evidence of multiple query representations for information retrieval. Inf. Process. Manag. 31(3), 431–448 (1995). https://doi.org/10.1016/0306-4573(94)00057-A

    Article  Google Scholar 

  7. Bilenko, M., White, R.W.: Mining the search trails of surfing crowds: identifying relevant websites from user activity. In: Proceedings of the 17th International Conference on World Wide Web (WWW’08), pp. 51–60. ACM (2008)

    Google Scholar 

  8. Brooke, J.: SUS: A ‘quick and dirty’ usability scale. In: Jordan, P. W., Thomas, B., McClelland, I. L., Weerdmeester B. (eds.) Usability Evaluation In Industry, pp. 189–194. Taylor & Francis (1996)

    Google Scholar 

  9. Byström, K., Kumpulainen, S.: Vertical and horizontal relationships amongst task-based information needs. Inf. Process. Manag. 57(2), 102065 (2020). https://doi.org/10.1016/j.ipm.2019.102065

    Article  Google Scholar 

  10. Carmel, D., Yom-Tov, E., Darlow, A., Pelleg, D.: What makes a query difficult? In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’06), pp. 390–397. ACM (2006)

    Google Scholar 

  11. Chang, J.C., Hahn, N., Kittur, A.: Mesh: Scaffolding comparison tables for online decision making. In: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST’20), pp. 391–405. ACM (2020). https://doi.org/10.1145/3379337.3415865

  12. Chang, J.C., Hahn, N., Perer, A., Kittur, A.: SearchLens: composing and capturing complex user interests for exploratory search. In: Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI’19), pp. 498–509. ACM (2019). https://doi.org/10.1145/3301275.3302321

  13. Croft, W.B.: Combining approaches to information retrieval. In: Croft, W.B. (ed.) Advances in Information Retrieval: Recent Research from the Center for Intelligent Information Retrieval, vol. 7, pp. 1–36. Springer, New York (2000). https://doi.org/10.1007/0-306-47019-5_1

    Chapter  MATH  Google Scholar 

  14. Du, J.T., Evans, N.: Academic users’ information searching on research topics: characteristics of research tasks and search strategies. J. Acad. Librariansh. 37(4), 299–306 (2011). https://doi.org/10.1016/j.acalib.2011.04.003

    Article  Google Scholar 

  15. Fluit, C., Sabou, M., van Harmelen, F.: Ontology-based information visualization: toward semantic web applications. In: Geroimenko, V., Chen, C. (eds.) Visualizing the Semantic Web: XML-based Internet and Information Visualization, pp. 45–58. Springer, Heidelberg (2002). https://doi.org/10.1007/1-84628-290-X_3

    Chapter  Google Scholar 

  16. Hearst, M.A.: Search User Interfaces, 1st edn. Cambridge University Press, Cambridge (2009)

    Book  Google Scholar 

  17. Huang, J., Lin, T., White, R.W.: No search result left behind: branching behavior with browser tabs. In: Proceedings of the Fifth ACM International Conference on Web Search and Data Mining (WSDM’12), pp. 203–212. ACM (2012)

    Google Scholar 

  18. Huang, J., White, R.W.: Parallel browsing behavior on the web. In: Proceedings of the 21st ACM Conference on Hypertext and Hypermedia (HT’10), pp. 13–18. ACM (2010)

    Google Scholar 

  19. Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. (TOIS) 20(4), 422–446 (2002)

    Article  Google Scholar 

  20. Krishnamurthy, Y., Pham, K., Santos, A., Freire, J.: Interactive exploration for domain discovery on the web. In: Proceedings of the ACM KDD Workshop on Interactive Data Exploration and Analytics (IDEA’16), pp. 64–71 (2016)

    Google Scholar 

  21. Marchionini, G.: Exploratory search: from finding to understanding. Commun. ACM 49(4), 41–46 (2006)

    Article  Google Scholar 

  22. Mizzaro, S., Mothe, J.: Why do you think this query is difficult?: A user study on human query prediction. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’16), pp. 1073–1076. ACM (2016)

    Google Scholar 

  23. Moraes, F., Santos, R.L., Ziviani, N.: On effective dynamic search in specialized domains. In: Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR’17), pp. 177–184. ACM (2017)

    Google Scholar 

  24. Nitsche, M., Nürnberger, A.: QUEST: querying complex information by direct manipulation. In: Yamamoto, S. (ed.) HIMI 2013. LNCS, vol. 8016, pp. 240–249. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39209-2_28

    Chapter  Google Scholar 

  25. Oppenlaender, J., Kuosmanen, E., Goncalves, J., Hosio, S.: Search support for exploratory writing. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11748, pp. 314–336. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29387-1_18

    Chapter  Google Scholar 

  26. Peltonen, J., Belorustceva, K., Ruotsalo, T.: Topic-relevance map: visualization for improving search result comprehension. In: Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI’17), pp. 611–622. ACM (2017). https://doi.org/10.1145/3025171.3025223

  27. Peltonen, J., Strahl, J., Floréen, P.: Negative relevance feedback for exploratory search with visual interactive intent modeling. In: Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI’17), pp. 149–159. ACM (2017). https://doi.org/10.1145/3025171.3025222

  28. Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of the Fifth ACM Conference on Recommender Systems (RecSys’11), pp. 157–164. ACM (2011)

    Google Scholar 

  29. Ruotsalo, T., et al.: Directing exploratory search with interactive intent modeling. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management (CIKM’13), pp. 1759–1764. ACM (2013)

    Google Scholar 

  30. Ruotsalo, T., et al.: Interactive intent modeling for exploratory search. ACM Trans. Inf. Syst. (TOIS) 36(4), 44 (2018)

    Article  Google Scholar 

  31. Russell-Rose, T., Chamberlain, J., Shokraneh, F.: A visual approach to query formulation for systematic search. In: Proceedings of the Conference on Human Information Interaction and Retrieval (CHIIR’19), pp. 379–383. ACM (2019)

    Google Scholar 

  32. di Sciascio, C., Sabol, V., Veas, E.E.: Rank as you go: user-driven exploration of search results. In: Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI’16), pp. 118–129. ACM (2016). https://doi.org/10.1145/2856767.2856797

  33. di Sciascio, C., Veas, E., Barria-Pineda, J., Culley, C.: Understanding the effects of control and transparency in searching as learning. In: Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI’20), pp. 498–509. ACM (2020). https://doi.org/10.1145/3377325.3377524

  34. Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996)

    Google Scholar 

  35. Shokouhi, M., Si, L.: Federated search. Found. Trends Inf. Retr. 5(1), 1–102 (2011). https://doi.org/10.1561/1500000010

    Article  Google Scholar 

  36. Srinivas, N., Krause, A., Kakade, S., Seeger, M.: Gaussian process optimization in the bandit setting: no regret and experimental design. In: Proceedings of the 27th International Conference on Machine Learning (ICML’10), pp. 1015–1022. Omnipress (2010)

    Google Scholar 

  37. Umemoto, K., Yamamoto, T., Tanaka, K.: Search support tools. In: Fu, W.T., van Oostendorp, H. (eds.) Understanding and Improving Information Search. HIS, pp. 139–160. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-38825-6_8

    Chapter  Google Scholar 

  38. Venna, J., Peltonen, J., Nybo, K., Aidos, H., Kaski, S.: Information retrieval perspective to nonlinear dimensionality reduction for data visualization. J. Mach. Learn. Res. 11(Feb), 451–490 (2010)

    MathSciNet  MATH  Google Scholar 

  39. Verbert, K., Parra, D., Brusilovsky, P.: Agents vs. users: visual recommendation of research talks with multiple dimension of relevance. ACM Trans. Interact. Intell. Syst. (TiiS) 6(2), 1–42 (2016). https://doi.org/10.1145/2946794

    Article  Google Scholar 

  40. White, R.W., Roth, R.A.: Exploratory search: beyond the query-response paradigm. In: Synthesis Lectures on Information Concepts, Retrieval, and Services, Morgan & Claypool Publishers (2009)

    Google Scholar 

  41. Xiang, B., Jiang, D., Pei, J., Sun, X., Chen, E., Li, H.: Context-aware ranking in web search. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’10, pp. 451–458. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1835449.1835525

  42. Yogev, S.: Exploratory search interfaces: blending relevance, diversity, relationships and categories. In: Proceedings of the Companion Publication of the 19th International Conference on Intelligent User Interfaces (IUI Companion ’14), pp. 61–64. ACM (2014). https://doi.org/10.1145/2559184.2559187

  43. Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’01), pp. 334–342. ACM (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jaakko Peltonen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Strahl, J., Peltonen, J., Floréen, P. (2021). Directing and Combining Multiple Queries for Exploratory Search by Visual Interactive Intent Modeling. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12934. Springer, Cham. https://doi.org/10.1007/978-3-030-85613-7_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85613-7_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85612-0

  • Online ISBN: 978-3-030-85613-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics