Advertisement

An Information Visualization Tool for the Interactive Component-Based Evaluation of Search Engines

  • Giacomo Rocco
  • Gianmaria SilvelloEmail author
Conference paper
  • 203 Downloads
Part of the Communications in Computer and Information Science book series (CCIS, volume 1177)

Abstract

In this paper, we present an InfoVis tool based on SanKey diagrams for the exploration of large combinatorial combinations of IR components – the Grid of Points (GoP).

The goal of this tool is to ease the comprehension of the behavior of single IR components within fully functioning off-the-shelf IR systems without recurring to complex statistical tools. In order to assess the quality of the proposed SanKey-based InfoVis tool we conduceted an initial user study that led to interesting conclusions, yet to be validated in a future and more comprehensive study.

Keywords

Information Retrieval Evaluation Grid of Points Information visualization Sankey 

References

  1. 1.
    Angelini, M., Fazzini, V., Ferro, N., Santucci, G., Silvello, G.: CLAIRE: A combinatorial visual analytics system for information retrieval evaluation. Inf. Process. Manag. (2018).  https://doi.org/10.1016/j.jvlc.2013.12.003. in printGoogle Scholar
  2. 2.
    Angelini, M., Ferro, N., Santucci, G., Silvello, G.: VIRTUE: a visual tool for information retrieval performance evaluation and failure analysis. J. Vis. Lang. Comput. (JVLC) 25(4), 394–413 (2014)Google Scholar
  3. 3.
    Angelini, M., Ferro, N., Santucci, G., Silvello, G.: A visual analytics approach for what-if analysis of information retrieval systems. In: Perego et al. [14], pp. 1081–1084 (2016)Google Scholar
  4. 4.
    Crestani, F., Vegas, J., de la Fuente, P.: A graphical user interface for the retrieval of hierarchically structured documents. Inf. Process. Manag. 40(2), 269–289 (2004)Google Scholar
  5. 5.
    Dunnett, C.W.: A multiple comparison procedure for comparing several treatments with a control. J. Am. Stat. Assoc. 50(272), 1096–1121 (1955)zbMATHGoogle Scholar
  6. 6.
    Ferro, N., Silvello, G.: A general linear mixed models approach to study system component effects. In: Perego et al. [14], pp. 25–34Google Scholar
  7. 7.
    Ferro, N., Silvello, G.: 3.5K runs, 5K topics, 3M assessments and 70M measures: what trends in 10 years of Adhoc-ish CLEF?.Inf. Process. Manag. 53(1), 175–202 (2017)Google Scholar
  8. 8.
    Ferro, N., Silvello, G.: Towards an anatomy of IR system component performances. J. Am. Soc. Inf. Sci. Technol. (JASIST) 69(2), 187–200 (2017)Google Scholar
  9. 9.
    Fowler, R.H., Lawrence-Fowler, W.A., Wilson, B.A.: Integrating query, thesaurus, and documents through a common visual representation. In: Fox, E.A. (ed.) Proc. 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1991). ACM Press, New York, USA (1991)Google Scholar
  10. 10.
    Hearst, M.A.: “Natural” search user interfaces. Commun. ACM (CACM) 54(11), 60–67 (2011)Google Scholar
  11. 11.
    Koshman, S.: Testing user interaction with a prototype visualization-based information retrieval system. J. Am. Soc. Inf. Sci. Technol. (JASIST) 56(8), 824–833 (2005).  https://doi.org/10.1002/asi.20175Google Scholar
  12. 12.
    Lipani, A., Lupu, M., Hanbury, A.: Visual pool: a tool to visualize and interact with the pooling method. In: Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A.P., White, R.W. (eds.) Proceedings of 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017). ACM Press, New York (2017)Google Scholar
  13. 13.
    Morse, E.L., Lewis, M., Olsen, K.A.: Testing visual information retrieval methodologies case study: comparative analysis of textual, icon, graphical, and spring displays. J. Am. Soc. Inf. Sci. Technol. (JASIST) 53(1), 28–40 (2002)Google Scholar
  14. 14.
    Perego, R., Sebastiani, F., Aslam, J., Ruthven, I., Zobel, J. (eds.): Proceedings of 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2016). ACM Press, New York (2016)Google Scholar
  15. 15.
    Zhang, J.: TOFIR: a tool of facilitating information retrieval - introduce a visual retrieval model. Inf. Process. Manag. 37(4), 639–657 (2001)zbMATHGoogle Scholar
  16. 16.
    Zhang, J.: Visualization for Information Retrieval. Springer, Heidelberg, Germany (2008)zbMATHGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Information EngineeringUniversity of PaduaPaduaItaly

Personalised recommendations