Abstract
The increasing amount of digital images available on the Internet has made searching, browsing, and organizing such resources a major challenge. This paper proposes a semantic approach to text-based image retrieval of manually annotated digital images. The approach uses statistical models based on Semantic DNA (SDNA) extracted from the structure of a lexical ontology called OntoRo. The approach involves three main techniques: (a) SDNA extraction, (b) word sense disambiguation using statistical models based on the extracted SDNA, and (c) applying semantic similarity measures using SDNA. The experiments performed show that the proposed approach retrieves images based on their conceptual meaning rather than the use of specific keywords in their annotations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Comput. Surv., 1–60 (2008)
Fellbaum, C.: WordNet: An Electronic Lexical Database. The MIT Press, Cambridge (1998)
Tang, Q.: Knowledge Management Using Machine Learning, Natural Language Processing and Ontology. Cardiff University, Cardiff (2006)
Setchi, R., Tang, Q., Bouchard, C.: Ontology-Based Concept Indexing of Images. In: Velásquez, J.D., Ríos, S.A., Howlett, R.J., Jain, L.C. (eds.) Knowledge-Based and Intelligent Information and Engineering Systems. LNCS, vol. 5711, pp. 293–300. Springer, Heidelberg (2009)
Fadzli, S.A., Setchi, R.: Semantic Approach to Text-based Image Retrieval Using a Lexical Ontology. In: Proc. of the Knowledge Engineering and Emotion Research Int. Conf., Paris, France, March 2-4, pp. 866–876 (2010)
Sigurbjornsson, B., van Zwol, R.: Flickr tag recommendation based on collective knowledge. In: WWW 2008: Proceeding of the 17th International Conference on World Wide Web, pp. 327–336. ACM Press, New York (2008)
Garg, N., Weber, I.: Personalized, interactive tag recommendation for flickr. In: RecSys 2008: Proceedings of the 2008 ACM Conference on Recommender Systems, pp. 67–74. ACM, New York (2008)
Takashita, T., Itokawa, T., Kitasuka, T., Aritsugi, M.: Tag Recommendation for Flickr Using Web Browsing Behavior. In: Taniar, D., Gervasi, O., Murgante, B., Pardede, E., Apduhan, B.O. (eds.) ICCSA 2010. LNCS, vol. 6017, pp. 412–421. Springer, Heidelberg (2010)
Goldstone, R.L., Son, J.: Similarity. In: Holyoak, K., Morrison, R. (eds.) Cambridge Handbook of Thinking and Reasoning, pp. 13–36. Cambridge University Press, Cambridge (2005)
Rada, R., Mili, H., Bicknell, E., Blettner, M.: Development and Application of a Metric on Semantic Nets. IEEE Transactions on Systems, Man and Cybernetics 19(1), 17–30 (1989)
Leacock, C., Chodorow, M.: Combining Local Context and WordNet Similarity for Word Sense Identification. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 265–283. The MIT Press, Cambridge (1998)
Hirst, G., St-Onge, D.: Lexical Chains as Representations of Context for the Detection and Correction of Malapropisms. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 305–332. The MIT Press, Cambridge (1998)
Resnik, P.: Using Information Content to Evaluate Semantic Similarity in a Taxonomy. In: 14th Int Joint Conf. on AI, Montreal, Canada, pp. 448–453 (1995)
Jiang, J.J., Conrath, D.W.: Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy. In: 10th International Conference on Research on Computational Linguistics, ACL, Taiwan (1997)
Lin, D.: An Information Theoretic Definition of Similarity. In: International Conference on Machine Learning, Madison, WI (1998)
Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recognition 40(1), 262–282 (2007)
Mueller, H., Marchand-Maillet, S., Pun, T.: The truth about Corel—evaluation in image retrieval. In: Lew, M., Sebe, N., Eakins, J.P. (eds.) CIVR 2002. LNCS, vol. 2383, pp. 38–50. Springer, Heidelberg (2002)
fotoLIBRA, http://www.fotolibra.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fadzli, S.A., Setchi, R. (2010). Semantic Approach to Image Retrieval Using Statistical Models Based on a Lexical Ontology. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2010. Lecture Notes in Computer Science(), vol 6279. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15384-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-15384-6_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15383-9
Online ISBN: 978-3-642-15384-6
eBook Packages: Computer ScienceComputer Science (R0)