Skip to main content
SpringerLink
Log in

Techniques for Efficient Query Expansion

  • Conference paper
String Processing and Information Retrieval (SPIRE 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3246))

Included in the following conference series:

Abstract

Query expansion is a well-known method for improving average effectiveness in information retrieval. However, the most effective query expansion methods rely on costly retrieval and processing of feedback documents. We explore alternative methods for reducing query-evaluation costs, and propose a new method based on keeping a brief summary of each document in memory. This method allows query expansion to proceed three times faster than previously, while approximating the effectiveness of standard expansion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Anh, V.N., Moffat, A.: Impact transformation: effective and efficient web retrieval. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 3–10. ACM Press, New York (2002)

    Chapter  Google Scholar 

  • Bailey, P., Craswell, N., Hawking, D.: Engineering a multi-purpose test collection for web retrieval experiments. Information Processing & Management 39(6), 853–871 (2003)

    Article  Google Scholar 

  • Billerbeck, B., Scholer, F., Williams, H.E., Zobel, J.: Query expansion using associated queries. In: Proc. Int. Conf. on Information and Knowledge Management, pp. 2–9. ACM Press, New York (2003)

    Google Scholar 

  • Billerbeck, B., Zobel, J.: Questioning query expansion: An examination of behaviour and parameters. In: Schewe, K.-D., Williams, H.E. (eds.) Proc. Australasian Database Conf., vol. 27, pp. 69–76. CRPIT (2004)

    Google Scholar 

  • Carpineto, C., de Mori, R., Romano, G., Bigi, B.: An information-theoretic approach to automatic query expansion. ACM Transactions on Information Systems 19(1), 1–27 (2001)

    Article  Google Scholar 

  • Garcia, S., Williams, H.E., Cannane, A.: Access-ordered indexes. In: Estivill-Castro, V. (ed.) Proceedings of the 27th Australasian Computer Science Conference, Dunedin, New Zealand, vol. 26, pp. 7–14 (January 2004)

    Google Scholar 

  • Gauch, S., Wang, J.: A corpus analysis approach for automatic query expansion. In: Proc. Int. Conf. on Information and Knowledge Management, pp. 278–284. ACM Press, New York (1997)

    Google Scholar 

  • Goldstein, J., Kantrowitz, M., Mittal, V., Carbonell, J.: Summarizing text documents: sentence selection and evaluation metrics. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 121–128. ACM Press, New York (1999)

    Google Scholar 

  • Harman, D.: Overview of the second Text REtrieval Conference (TREC-2). Information Processing & Management 31(3), 271–289 (1995)

    Article  Google Scholar 

  • Hawking, D., Robertson, S.E.: On collection size and retrieval effectiveness. Kluwer International Journal of Information Retrieval 6(1), 99–150 (2003)

    Article  Google Scholar 

  • Kwok, K.L., Chan, M.: Improving two-stage ad-hoc retrieval for short queries. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 250–256. ACM Press, New York (1998)

    Google Scholar 

  • Lam-Adesina, A.M., Jones, G.J.F.: Applying summarization techniques for term selection in relevance feedback. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, New Orleans, Louisiana, United States, pp. 1–9. ACM Press, New York (2001)

    Google Scholar 

  • Magennis, M., van Rijsbergen, C.J.: The potential and actual effectiveness of interactive query expansion. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 324–332. ACM Press, New York (1997)

    Chapter  Google Scholar 

  • Mandala, R., Tokunaga, T., Tanaka, H.: Combining multiple evidence from different types of thesaurus for query expansion. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, Berkeley, California, United States, pp. 191–197. ACM Press, New York (1999)

    Google Scholar 

  • Mitra, M., Singhal, A., Buckley, C.: Improving automatic query expansion. In: Croft, W.B., Moffat, A., van Rijsbergen, C.J., Wilkinson, R., Zobel, J. (eds.) Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, Melbourne, Australia, August 1998, pp. 206–214. ACM Press, New York (1998)

    Google Scholar 

  • Moffat, A., Zobel, J.: Self-indexing inverted files for fast text retrieval. ACM Transactions on Information Systems 14(4), 349–379 (1996)

    Article  Google Scholar 

  • Qiu, Y., Frei, H.-P.: Concept based query expansion. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 160–169. ACM Press, New York (1993)

    Chapter  Google Scholar 

  • Robertson, S.E., Walker, S.: Okapi/Keenbow at TREC-8. In: Proc. Text Retrieval Conf (TREC), pp. 151–161, Gaithersburg, Maryland, NIST Special Publication, pp. 264–500 (1999)

    Google Scholar 

  • Robertson, S.E., Walker, S., Hancock-Beaulieu, M., Gull, A., Lau, M.: Okapi at TREC. In: Proc. Text Retrieval Conf. (TREC), pp. 21–30 (1992)

    Google Scholar 

  • Rocchio, J.J.: Relevance feedback in information retrieval. In: Ide, E., Salton, G. (eds.) The Smart Retrieval System — Experiments in Automatic Document Processing, pp. 313–323. Prentice-Hall, Englewood Cliffs (1971)

    Google Scholar 

  • Ruthven, I.: Re-examining the potential effectiveness of interactive query expansion. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 213–220. ACM Press, New York (2003)

    Google Scholar 

  • Ruthven, I., Lalmas, M.: A survey on the use of relevance feedback for information access systems. Knowledge Engineering Review 18(2), 95–145 (2003)

    Article  Google Scholar 

  • Scholer, F., Williams, H.E.: Query association for effective retrieval. In: Nicholas, C., Grossman, D., Kalpakis, K., Qureshi, S., van Dissel, H., Seligman, L. (eds.) Proc. Int. Conf. on Information and Knowledge Management, McLean, Virginia, pp. 324–331 (2002)

    Google Scholar 

  • Scholer, F., Williams, H.E., Yiannis, J., Zobel, J.: Compression of inverted indexes for fast query evaluation. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 222–229. ACM Press, New York (2002)

    Chapter  Google Scholar 

  • Sparck-Jones, K., Walker, S., Robertson, S.E.: A probabilistic model of information retrieval: development and comparative experiments. Parts 1&2. Information Processing & Management 36(6), 779–840 (2000)

    Article  Google Scholar 

  • Spink, A., Wolfram, D., Jansen, M.B.J., Saracevic, T.: From e-sex to e-commerce: Web search changes. IEEE Computer 35(3), 107–109 (2002)

    Google Scholar 

  • Tombros, A., Sanderson, M.: Advantages of query biased summaries in information retrieval. In: Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, pp. 2–10. ACM Press, New York (1998)

    Google Scholar 

  • Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes: Compressing and Indexing Documents and Images, 2nd edn. Morgan Kaufman, San Francisco (1999)

    Google Scholar 

  • Xu, J., Croft, W.B.: Improving the effectiveness of information retrieval with local context analysis. ACM Transactions on Information Systems 18(1), 79–112 (2000)

    Article  Google Scholar 

  • Zobel, J.: How reliable are the results of large-scale information retrieval experiments? In: Croft, W.B., Moffat, A., van Rijsbergen, C.J., Wilkinson, R., Zobel, J. (eds.) Proc. ACM-SIGIR Int. Conf. on Research and Development in Information Retrieval, Melbourne, Australia, August 1998, pp. 307–314. ACM Press, New York (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Information Technology, RMIT University, Melbourne, Australia

    Bodo Billerbeck & Justin Zobel

Authors
  1. Bodo Billerbeck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Justin Zobel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Georgia Institute of Technology and Università di Padova,  

    Alberto Apostolico

  2. Department of Information Engineering, University of Padova,  

    Massimo Melucci

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Billerbeck, B., Zobel, J. (2004). Techniques for Efficient Query Expansion. In: Apostolico, A., Melucci, M. (eds) String Processing and Information Retrieval. SPIRE 2004. Lecture Notes in Computer Science, vol 3246. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30213-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30213-1_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23210-0

  • Online ISBN: 978-3-540-30213-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation