Abstract
The paper discusses briefly user-oriented evaluation in test collections with simulated users and real users, as well as operational systems evaluation. It concludes by a glimpse of issues beyond evaluation. The paper provides pointers to literature where much more thorough discussion of each topic may be found.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Azzopardi, L.: The economics of interactive information retrieval. In: 34th ACM SIGIR Conference (ACM SIGIR 2011), pp. 15–24. ACM Press, New York (2011)
Baskaya, F., Keskustalo, H., Järvelin, K.: Simulating Simple and Fallible Relevance Feedback. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 593–604. Springer, Heidelberg (2011)
Baskaya, F., Keskustalo, H., Järvelin, K.: Time Drives Interaction: Simulating Sessions in Diverse Searching Environments. In: 35th ACM SIGIR Conference (ACM SIGIR 2012), pp. 97–106. ACM Press, New York (2011, 2012)
Harman, D.: Information retrieval evaluation. Morgan & Claypool (2011)
Ingwersen, P., Järvelin, K.: The Turn: Integration of Information Seeking and Retrieval in Context. Springer, Heidelberg (2005)
Järvelin, K.: An Analysis of Two Approaches in Information Retrieval: From Frameworks to Study Designs. Journal of the American Society for Information Science and Technology (JASIST) 58, 971–986 (2007)
Järvelin, K.: Evaluation. In: Ruthven, I., Kelly, D. (eds.) Interactive Information Seeking, Behaviour and Retrieval, pp. 113–138. Facet Publishing, London (2011)
Järvelin, K.: IR Research: Systems, Interaction, Evaluation and Theories. ACM SIGIR Forum 45, 17–31 (2011), http://www.sigir.org/forum/2011D/conferences/2011d_sigirforum_jarvelin.pdf
Kelly, D.: Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval (FnTIR) 3, 1–224 (2009)
Kumpulainen, S., Järvelin, K.: Information Interaction in Molecular Medicine: Integrated Use of Multiple Channels. In: 3rd Information Interaction in Context Conference (IIiX 2010), pp. 95–104. ACM Press, New York (2010)
Kumpulainen, S., Järvelin, K.: Barriers to Task-based Information Access in Molecular Medicine. Journal of the American Society for Information Science and Technology (JASIST) 63, 86–97 (2012)
Sanderson, M.: Test Collection Based Evaluation of Information Retrieval Systems. Foundations and Trends in Information Retrieval (FnTIR) 4, 247–375 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Järvelin, K. (2013). User-Oriented Evaluation in IR. In: Agosti, M., Ferro, N., Forner, P., Müller, H., Santucci, G. (eds) Information Retrieval Meets Information Visualization. PROMISE 2012. Lecture Notes in Computer Science, vol 7757. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36415-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-36415-0_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36414-3
Online ISBN: 978-3-642-36415-0
eBook Packages: Computer ScienceComputer Science (R0)