Abstract
In interactive image retrieval systems, from the image search results, a user can select an image and click to view its similar or related images until he reaches the targets. Existing evaluation approaches for image retrieval methods only focus on local performance of single-round search results on some selected samples. We propose a novel approach to evaluate their performance in the scenario of interactive image retrieval. It provides a global evaluation considering multi-round user interactions and the whole image collection. We model the interactive image search behaviors as navigation on an information network constructed by the image collection by using images as graph nodes. We leverage the properties of this constructed image information network to propose our evaluation metrics. We use a public image dataset and three image retrieval methods to show the usage of our evaluation approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys (CSUR) 40(2), 1–60 (2008)
Huiskes, M.J., Lew, M.S.: The MIR Flickr Retrieval Evaluation. In: Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval (MIR 2008), pp. 39–43. ACM, New York (2008)
Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans. on CSVT. 8(5), 644–655 (1998)
Porkaew, K., Mehrotra, S., Ortega, M.: Query reformulation for content based multimedia retrieval in MARS. In: Proceedings of the IEEE International Conference on Multimedia Computing and Systems (ICMCS 1999), vol. 2, pp. 747–751. IEEE Computer Society, Washington, DC (1999)
Tang, X.O., Liu, K., Cui, J.Y., Wen, F., Wang, X.G.: IntentSearch: Capturing User Intention for One-Click Internet Image Search. IEEE Trans. on PAMI 34(7), 1342–1353 (2012)
West, R., Leskovec, J.: Human wayfinding in information networks. In: Proceedings of the 21st International Conference on World Wide Web (WWW 2012), pp. 619–628. ACM, New York (2012)
Jain, V., Varma, M.: Learning to re-rank: query-dependent image re-ranking using click data. In: Proceedings of the 20th International Conference on World Wide Web (WWW 2011), pp. 277–286. ACM, New York (2011)
Kleinberg, J.: The small-world phenomenon: an algorithmic perspective. In: Proceedings of the Thirty-Second Annual ACM Symposium on Theory of Computing (STOC 2000), pp. 163–170. ACM, New York (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Li, J. (2015). A Multi-round Global Performance Evaluation Method for Interactive Image Retrieval. In: Dong, X., Yu, X., Li, J., Sun, Y. (eds) Web-Age Information Management. WAIM 2015. Lecture Notes in Computer Science(), vol 9098. Springer, Cham. https://doi.org/10.1007/978-3-319-21042-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-21042-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-21041-4
Online ISBN: 978-3-319-21042-1
eBook Packages: Computer ScienceComputer Science (R0)