Abstract
The lack of user activity on search results was until recently perceived as a sign of user dissatisfaction from retrieval performance, often, referring to such inactivity as a failed search (negative search abandonment). However, recent studies suggest that some search tasks can be achieved in the contents of the results displayed without the need to click through them (positive search abandonment); thus they emphasize the need to discriminate between successful and failed searches without follow-up clicks. In this paper, we study users’ inactivity on search results in relation to their pursued search goals and investigate the impact of displayed results on user clicking decisions. Our study examines two types of post-query user inactivity: pre-determined and post-determined depending on whether the user started searching with a preset intention to look for answers only within the result snippets and did not intend to click through the results, or the user inactivity was decided after the user had reviewed the list of retrieved documents. Our findings indicate that 27% of web searches in our sample are conducted with a pre-determined intention to look for answers in the results’ list and 75% of them can be satisfied in the contents of the displayed results. Moreover, in nearly half the queries that did not yield result visits, the desired information is found in the result snippets.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Agichtein, E., Brill, E., Dumais, S., Rango, R.: Learning user interaction models for predicting search result preferences. In: Proceedings of the 29th ACM SIGIR Conference (2006)
Belkin, N.: Some(what) grand challenges for information retrieval. ACM SIGIR Forum 42(1), 47–54 (2008)
Broder, A.: A taxonomy of web search. SIGIR Forum 36(2), 3–10 (2002)
Claypool, M., Le, P., Waseda, M., Brown, D.: Implicit interest indicators. In: Proceedings of the International Conference on Intelligent User Interfaces, pp. 33–40 (2001)
Callan, J., Allan, J., Clarke, C.L.A., Dumais, S., Evans, D.A., Sanderson, M., Zhai, C.: Meeting of the MINDS: an information retrieval research agenda. ACM SIGIR Forum 41(2), 25–34 (2007)
Cutrell, E., Guan, Z.: What are you looking for? an eye-tracking study of information usage in web search. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 407–416 (2007)
Fox, S., Karnawat, K., Mydland, M., Dumais, S., White, T.: Evaluating implicit measures to improve web search. ACM Transactions on Information Systems 23(2), 147–168 (2005)
Granka, L.A., Joachims, T., Gay, G.: Eye-tracking analysis of user behaviour in www results. In: Proceedings of the ACM SIGIR Conference, pp. 478–479 (2004)
Huang, J., Efthimiadis, E.N.: Analyzing and Evaluating Query Reformulation Strategies in Web Search Logs. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management (CIKM), Hong Kong, November 2-6, pp. 77–86 (2009)
Jansen, B.J., Spink, A.: How are we searching the www: a comparison of nine search engine transaction logs. Information Processing & Management 42(1), 248–263 (2006)
Jansen, B.J., Booth, D.L., Spink, A.: Determining the informational, navigational and transactional intent of web queries. Information Processing & Management 44, 1251–1266 (2008)
Joachims, T., Granka, L., Pan, B., Hembrooke, H., Padlinski, F., Gay, G.: Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Transactions on Information Systems 25(2), 1–26 (2007)
Joachims, T., Radlinski, F.: Search engines that learn from implicit feedback. Computer 40, 34–40 (2007)
Jung, S., Herlocker, J.L., Webster, J.: Click data as implicit relevance feedback in web search. Information Processing & Management 43(3), 791–807 (2007)
Kelly, D., Teevan, J.: Implicit feedback for inferring user preference: a bibliography. ACM SIGIR Forum 37(2), 18–28 (2003)
Qiu, F., Liu, Z., Cho, J.: Analysis of user web traffic with a focus on search activities. In: Proceedings of the International Workshop on the Web and Databases, WebDB (2005)
Radlinski, F., Kurup, M., Joachims, T.: How does clickthrough data reflect retrieval quality. In: Proceedings of the CIKM Conference (2008)
Rose, D.E., Levinson, D.: Understanding user goals in web search. In: Proceedings of the 13th International Conference on World Wide Web (WWW 2004), pp. 13–19. ACM Press, New York (2004)
Sarma, A., Gollapudi, S., Ieong, S.: Bypass rates: reducing query abandonment using negative inferences. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 177–185 (2008)
Scott, J.L., Huffman, B., Tokuda, A.: Good abandonment in mobile and pc internet search. In: Proceedings of the 32nd Annual ACM SIGIR Conference, Boston, MA, pp. 43–50 (2009)
Sharma, H., Jansen, B.J.: Automated evaluation of search engine performance via implicit user feedback. In: Proceedings of the 28th ACM SIGIR Conference, pp. 649–650 (2005)
Spink, A.: A user centered approach to evaluating human interaction with web search engines: an exploratory study. Information Processing & Management 38(3), 401–426 (2002)
Stamou, S., Efthimiadis, E.N.: Queries without clicks: successful or failed searches? In: Proceedings of the SIGIR Workshop on the Future of Information Retrieval Evaluation, Boston, MA, USA (2009)
Taksa, I., Spink, A., Goldberg, R.: A task-oriented approach to search engine usability studies. Journal of Software 3(1), 63–73 (2008)
Teevan, J., Adar, E., Jones, R., Potts, M.: Information re-retrieval: repeat queries in Yahoo’s logs. In: Proceedings of the 30th ACM SIGIR Conference (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stamou, S., Efthimiadis, E.N. (2010). Interpreting User Inactivity on Search Results. In: Gurrin, C., et al. Advances in Information Retrieval. ECIR 2010. Lecture Notes in Computer Science, vol 5993. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12275-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-12275-0_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12274-3
Online ISBN: 978-3-642-12275-0
eBook Packages: Computer ScienceComputer Science (R0)