Abstract
Search engines allow users to retrieve documents with respect to a given query. These provide advanced search options, such as query operators (e.g., +term, term^10). Previous work studied how query operators are employed by end-users. In this paper, we study the extent to which using query operators may lead to improved results, regardless of specific users. We hypothesize that the proper use of query operators improves search results. To validate this hypothesis, we present a methodology relying on standard IR test collections. We applied this methodology to TREC-7 and TREC-8 test collections with five IR models implemented in the Terrier search engine. Experiments show that queries enriched with operators give an improvement in effectiveness up to 35.1% over regular queries. This result suggests that end-users would benefit from using operators more often.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aula, A., Khan, R.M., Guan, Z.: How does search behavior change as search becomes more difficult? In: CHI 2010: Proceedings of the 28th International Conference on Human Factors in Computing Systems, pp. 35–44. ACM, New York (2010)
Buckley, C., Voorhees, E.M.: Retrieval System Evaluation. In: Voorhees and Harman [22], ch. 3, pp. 53–75
Croft, W.B., Metzler, D., Strohman, T.: Search Engines: Information Retrieval in Practice. Addison-Wesley, Reading (2010)
Eastman, C.M., Jansen, B.J.: Coverage, relevance, and ranking: The impact of query operators on web search engine results. ACM Trans. Inf. Syst. 21(4), 383–411 (2003)
Eastman, C.M., Jansen, B.J.: The appropriate (and inappropriate) use of query operators and their effect on web search results. Proceedings of the American Society for Information Science and Technology 41(1), 274–279 (2004)
Gospodnetić, O., Hatcher, E.: Lucene in Action. Manning Publications (2005)
Harman, D.K.: The TREC Test Collections. In: Voorhees and Harman [22], ch. 2, pp. 21–53
Hölscher, C., Strube, G.: Web search behavior of internet experts and newbies. Comput. Netw. 33, 337–346 (2000)
Jansen, B.J., Pooch, U.: A review of web searching studies and a framework for future research. J. Am. Soc. Inf. Sci. Technol. 52(3), 235–246 (2001)
Jansen, B.J., Spink, A., Saracevic, T.: Real life, real users, and real needs: a study and analysis of user queries on the web. Inf. Process. Manage. 36(2), 207–227 (2000)
Lucas, W., Topi, H.: Form and function: the impact of query term and operator usage on Web search results. J. Am. Soc. Inf. Sci. Technol. 53(2), 95–108 (2002)
Ogilvie, P., Callan, J.P.: Experiments Using the Lemur Toolkit. In: TREC 2001: Proceedings of the 9th Text REtrieval Conference. NIST, Gaithersburg (2001)
Ounis, I., Amati, G., Plachouras, V., He, B., Macdonald, C., Lioma, C.: Terrier: A high performance and scalable information retrieval platform. In: OSIR 2006: Proceedings of ACM SIGIR 2006 Workshop on Open Source Information Retrieval (2006)
Palacio, D., Cabanac, G., Sallaberry, C., Hubert, G.: Measuring Effectiveness of Geographic IR Systems in Digital Libraries: Evaluation Framework and Case Study. In: Lalmas, M., Jose, J., Rauber, A., Sebastiani, F., Frommholz, I. (eds.) ECDL 2010. LNCS, vol. 6273, pp. 340–351. Springer, Heidelberg (2010)
Purday, J.: Think culture: Europeana.eu from concept to construction. The Electronic Library 27(6), 919–937 (2009)
Sanderson, M.: Test collection based evaluation of information retrieval systems. Found. Trends Inf. Retr. 4(4), 247–375 (2010)
Silverstein, C., Marais, H., Henzinger, M., Moricz, M.: Analysis of a very large web search engine query log. SIGIR Forum 33(1), 6–12 (1999)
Spink, A., Wolfram, D., Jansen, M.B.J., Saracevic, T.: Searching the web: the public and their queries. J. Am. Soc. Inf. Sci. Technol. 52(3), 226–234 (2001)
Tukey, J.W.: Exploratory data analysis. Addison-Wesley, Reading (1977)
Voorhees, E.M., Harman, D.K.: Overview of the Seventh Text REtrieval Conference (TREC-7). In: TREC-7: Proceedings of the 7th Text REtrieval Conference, pp. 1–23 (1998)
Voorhees, E.M., Harman, D.K.: Overview of the Seventh Text REtrieval Conference (TREC-8). In: TREC-8: Proceedings of the 8th Text REtrieval Conference, pp. 1–23 (1999)
Voorhees, E.M., Harman, D.K.: TREC: Experiment and Evaluation in Information Retrieval. MIT Press, Cambridge (2005)
White, R.W., Morris, D.: Investigating the querying and browsing behavior of advanced search engine users. In: SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference, pp. 255–262. ACM, New York (2007)
Williamson, D.F., Parker, R.A., Kendrick, J.S.: The box plot: A simple visual method to interpret data. Ann. Intern. Med. 110(11), 916–921 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hubert, G., Cabanac, G., Sallaberry, C., Palacio, D. (2011). Query Operators Shown Beneficial for Improving Search Results. In: Gradmann, S., Borri, F., Meghini, C., Schuldt, H. (eds) Research and Advanced Technology for Digital Libraries. TPDL 2011. Lecture Notes in Computer Science, vol 6966. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24469-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-24469-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24468-1
Online ISBN: 978-3-642-24469-8
eBook Packages: Computer ScienceComputer Science (R0)