Abstract
An active development of semantic-based visual information retrieval methods was made in an attempt to reduce the semantic gap. The semantic-based image retrieval task aims to discover high-level semantic meaning within an image. The main obstacle in realizing semantic-based image retrieval activities is represented by the fact that it is very difficult to describe the semantic content of an image. In this chapter, we are presenting an overview of existing methods that can be applied for semantic-based image retrieval and also a description of the experimental results we have obtained after using the two models for semantic-based image retrieval provided by cross-media relevance model. Given a query word, the first model is using a language-modeling approach to rank the images from a training set. The second model is using an approach based on query expansion to rank the images being more effective than the previous one.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Zhang YJ (2007) Semantic-based visual information retrieval. IRM Press, Hershey
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380
Zhang YJ (2007) Chapter I: Toward high-level visual information retrieval. In: Zhang Y-J (ed) Semantic-based visual information retrieval. IRM Press, Hershey
Chang SF, Chen W, Meng HJ, Sundaram H, Zhong D (1998) A fully automated content-based video search engine supporting spatiotemporal queries. IEEE CSVT 8(5):602–615
Naphade MR, Huang TS (2002) Extracting semantics from audiovisual content: The final frontier in multimedia retrieval. IEEE NN 13(4):793–810
Xu Y, Zhang YJ (2003) Semantic retrieval based on feature element constructional model and bias competition mechanism. SPIE 5021:77–88
Hanjalic A (2001) Video and image retrieval beyond the cognitive level: The needs and possibilities. SPIE 4315:130–140
Dasiopoulou S, Doulaverakis C, Mezaris V, Kompatsiaris I, Strintzis MG (2007) Chapter X: An ontology-based framework for semantic image analysis and retrieval. In: Zhang Y-J (ed) Semantic-based visual information retrieval. IRM Press, Hershey
Sesame. http://www.openrdf.org/. Accessed 24 Aug 2011
Cheng SC, Chou TC, Yang CL et al (2005) A semantic learning for content-based image retrieval using analytical hierarchy process. Expert Syst Appl 28(3):495–505
Schreiber A, Dubbeldam B, Wielemaker J, Wielinga BJ (2001) IEEE Intell Syst 16(3):66–74
Hollink L, Schreiber A, Wielemaker J, Wielinga B (2003) Semantic annotation of image collections. In: Proceedings of the workshop on knowledge markup and semantic annotation, Sanibel Island, 2003
Chen YX, Wang JZ, Krovetz R (2005) CLUE: cluster-based retrieval of images by unsupervised learning. IEEE IP 14(8):1187–1201
Reidsma D, Kuper J, Declerck T, Saggion H, Cunningham H (2003) Cross document annotation for multimedia retrieval. In: Proceedings of the 10th conference of the European chapter of the association for computational linguistics (EACL), Budapest, 2003
Lim JH, Jin JS (2005) Combining intra-image and inter-class semantics for consumer image retrieval. Pattern Recognit 38(6):847–864
Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, New York
Thomure M (2004) Toward semantic image retrieval. Portland State University
Mitchell M, Hofstadter DR (1990) The emergence of understanding in a computer model of concepts and analogy-making. Phys D Nonlinear Phenom 42(1–3):322–334
Vogel J, Schiele B (2006) Performance evaluation and optimization for content-based image retrieval. Pattern Recognit 39:897–909
Maillot N, Thonnat M, Hudelot C (2004) Ontology based object learning and recognition: application to image retrieval. In: Proceedings of the 16th IEEE international conference on tools with artificial intelligence (ICTAI ’04), Boca Raton, 2004, pp 620–625
Celebi E, Alpkocak A (2005) Combining textual and visual clusters for semantic image retrieval and auto-annotation. In: Proceedings of the 2nd European workshop on the integration of knowledge, semantics and digital media technology, London, 2005, pp 219–225
Fazli Can, Esen A. Ozkarahan (1985) Concepts of the cover coefficient-based clustering methodology. In: SIGIR ’85: proceedings of the 8th annual international ACM SIGIR conference on research and development in information retrieval, New York, 1985
Mezaris V, Kompatsiaris I, Strintzis MG (2003) An ontology approach to object-based image retrieval. In: Proceedings of the 2003 international conference on image processing, Barcelona, 2003, vol 2, pp 511–514
Yoon J, Jayant M (2001) Relevance feedback for semantics based image retrieval. In: Proceedings of the international conference on image processing, Thessaloniki, 2001
Zhang D, Islam MM, Lu G, Hou J (2009) Semantic image retrieval using region based inverted file. In: Digital image computing: techniques and applications (DICTA ’09), Melbourne, 2009, pp 242–249
Zhang R, Zhang Z, Li M, Ma W-Y, Zhang HJ (2005) A probabilistic semantic model for image annotation and multi-modal image retrieval. In: Proceedings of the international conference on computer vision, Beijing, 2005
IRMA. http://irma-project.org/index_en.php. Accessed 24 Aug 2011
Jeon J, Lavrenko V, Manmatha R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: Proceedings of ACM SIGIR international conference on research and development in information retrieval (SIGIR), Toronto, 2003, pp 119–126
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Stanescu, L., Burdescu, D.D., Brezovan, M., Mihai, C.G. (2012). Semantic-Based Image Retrieval. In: Creating New Medical Ontologies for Image Annotation. SpringerBriefs in Electrical and Computer Engineering(). Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1909-9_6
Download citation
DOI: https://doi.org/10.1007/978-1-4614-1909-9_6
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-1908-2
Online ISBN: 978-1-4614-1909-9
eBook Packages: EngineeringEngineering (R0)