Abstract
Research in image analysis has reached a point where detectors can be learned in a generic fashion for a significant number of conceptual entities. The obtained performance however exhibits versatile behaviour, reflecting implications over the training set selection, similarities in visual manifestations of distinct conceptual entities, and appearance variations of the conceptual entities. In this paper, we investigate the use of formal semantics in order to benefit from the logical associations between the conceptual entities, and thereby alleviate part of the challenges involved in extracting semantic descriptions. More specifically, a fuzzy DL based reasoning framework is proposed for the extraction of enhanced image descriptions based on an initial set of graded annotations, generated through generic image analysis techniques. Under the proposed reasoning framework, the initial descriptions are integrated and further enriched at a semantic level, while additionally inconsistencies emanating from conflicting descriptions are resolved. Experimentation in the domain of outdoor images has shown very promising results, demonstrating the added value in terms of accuracy and completeness of the resulting content descriptions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1380 (2000)
Rao, A., Jain, R.: Knowledge representation and control in computer vision systems. In: IEEE Expert, pp. 64–79 (1988)
Draper, B., Hanson, A., Riseman, E.: Knowledge-directed vision: control, learning and integration. Proc. of the IEEE 84(11), 1625–1681 (1996)
Little, S., Hunter, J.: Rules-by-example - a novel approach to semantic indexing and querying of images. In: International Semantic Web Conference (ISWC), Hiroshima, Japan, November 7-11, pp. 534–548 (2004)
Schober, J.P., Hermes, T., Herzog, O.: Content-based image retrieval by ontology-based object recognition. In: Biundo, S., Frühwirth, T., Palm, G. (eds.) KI 2004. LNCS (LNAI), vol. 3238, Springer, Heidelberg (2004)
Neumann, B., Moller, R.: On scene interpretation with description logics (FBI-B-257/04) (2004)
Dasiopoulou, S., Mezaris, V., Kompatsiaris, I., Papastathis, V.K., Strintzis, M.G.: Knowledge-assisted semantic video object detection. IEEE Trans. Circuits Syst. Video Techn. 15(10), 1210–1224 (2005)
Espinosa, S., Kaya, A., Melzer, S., Möller, R., Wessel, M.: Multimedia interpretation as abduction. In: Proc. International Workshop on Description Logics (DL), Brixen-Bressanone, Italy, June 8-10 (2007)
Hollink, L., Little, S., Hunter, J.: Evaluating the application of semantic inferencing rules to image annotation. In: Proc. International Conference on Knowledge Capture (K-CAP), Banff, Alberta, Canada, October 2-5, pp. 91–98 (2005)
Petridis, K., Bloehdorn, S., Saathoff, C., Simou, N., Dasiopoulou, S., Tzouvaras, V., Handschuh, S., Avrithis, Y., Kompatsiaris, I., Staab, S.: Knowledge representation and semantic annotation of multimedia content. In: IEE Proceedings on Vision Image and Signal Processing, Special issue on Knowledge-Based Digital Media Processing 153 (June 2006)
Bagdanov, A., Bertini, M., DelBimbo, A., Serra, G., Torniai, C.: Semantic annotation and retrieval of video events using multimedia ontologies. In: Proc. IEEE International Conference on Semantic Computing (ICSC), Irvine, CA, USA (2007)
Dasiopoulou, S., Heinecke, J., Saathoff, C., Strintzis, M.: Multimedia reasoning with natural language support. In: Proc. IEEE International Conference on Semantic Computing (ICSC), Irvine, CA, USA, September 17-19 (2007)
Straccia, U.: A fuzzy description logic for the semantic web. In: Sanchez, E. (ed.) Fuzzy Logic and the Semantic Web. Capturing Intelligence, pp. 73–90. Elsevier, Amsterdam (2006)
Stoilos, G., Stamou, G., Tzouvaras, V., Pan, J., Horrocks, I.: The fuzzy description logic f-SHIN. In: International Workshop on Uncertainty Reasoning For the Semantic Web (URSW), Galway, Ireland, November 7 (2005)
Baader, F., Calvanese, D., McGuinness, D.L., Nardi, D., Patel-Schneider, P.F. (eds.): The description logic handbook: Theory, implementation, and applications. In: Description Logic Handbook. Cambridge University Press, Cambridge (2003)
Stoilos, G., Stamou, G., Pan, J.: Handling imprecise knowledge with fuzzy description logic. In: Proc. International Workshop on Description Logics (DL), Lake District, UK (2006)
Straccia, U.: Reasoning within fuzzy description logics. J. Artif. Intell. Res (JAIR) 14, 137–166 (2001)
Straccia, U.: Transforming fuzzy description logics into classical description logics. In: Proc. European Conference on Logics in Artificial Intelligence (JELIA), Lisbon, Portugal, September 27-30, pp. 385–399 (2004)
Haase, P., van Harmelen, F., Huang, Z., Stuckenschmidt, H., Sure, Y.: A framework for handling inconsistency in changing ontologies. In: Proc. of International Semantic Web Conference (ISWC), Galway, Ireland, November 6-10, pp. 353–367 (2005)
Kalyanpur, A., Parsia, B., Sirin, E., Grau, B.C.: Repairing unsatisfiable concepts in owl ontologies. In: Proc. of European Semantic Web Conference (ESWC), Budva, Montenegro, June 11-14, pp. 170–184 (2006)
LeBorgne, H., Guérin-Dugué, A., O’Connor, N.E.: Learning midlevel image features for natural scene and texture classification. IEEE Trans. Circuits Syst. Video Techn. 17(3), 286–297 (2007)
Moosmann, F., Triggs, B., Jurie, F.: Randomized clustering forests for building fast and discriminative visual vocabularies. In: Neural Information Processing Systems (NIPS) (November 2006)
Moller, R., Neumann, B., Wessel, M.: Towards computer vision with description logics: Some recent progress. In: Proceedings Integration of Speech and Image Understanding, Corfu, Greece, pp. 101–115 (1999)
Umberto, S., Giulio, V.: Dlmedia: an ontology mediated multimedia information retrieval system. In: Proc. International Workshop on Description Logics (DL), Brixen-Bressanone, Italy, June 8-10 (2007)
Simou, N., Athanasiadis, T., Tzouvaras, V., Kollias, S.: Multimedia reasoning with f-shin. In: 2nd International Workshop on Semantic Media Adaptation and Personalization, London, UK (2007)
Mylonas, P., Simou, N., Tzouvaras, V., Avrithis, Y.: Towards semantic multimedia indexing by classification and reasoning on textual metadata. In: Knowledge Acquisition from Multimedia Content Workshop, Genova, Italy (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dasiopoulou, S., Kompatsiaris, I., Strintzis, M.G. (2008). Using Fuzzy DLs to Enhance Semantic Image Analysis. In: Duke, D., Hardman, L., Hauptmann, A., Paulus, D., Staab, S. (eds) Semantic Multimedia. SAMT 2008. Lecture Notes in Computer Science, vol 5392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92235-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-92235-3_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92234-6
Online ISBN: 978-3-540-92235-3
eBook Packages: Computer ScienceComputer Science (R0)