Abstract
Annotations of multimedia documents typically have been pursued in two different directions. Either previous approaches have focused on low level descriptors, such as dominant color, or they have focused on the content dimension and corresponding annotations, such as person or vehicle. In this paper, we present a software environment to bridge between the two directions. M-OntoMat-Annotizer allows for linking low level MPEG-7 visual descriptions to conventional Semantic Web ontologies and annotations. We use M-OntoMat-Annotizer in order to construct ontologies that include prototypical instances of high-level domain concepts together with a formal specification of corresponding visual descriptors. Thus, we formalize the interrelationship of high- and low-level multimedia concept descriptions allowing for new kinds of multimedia content analysis and reasoning.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Chang, S.-F., Sikora, T., Puri, A.: Overview of the MPEG-7 standard. IEEE Trans. on Circuits and Systems for Video Technology 11(6), 688–695 (2001)
Mich, O., Brunelli, R., Modena, C.M.: A survey on video indexing. Journal of Visual Communications and Image Representation 10, 78–112 (1999)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12)
Handschuh, S., Staab, S.: Cream - creating metadata for the semantic web. Computer Networks 42, 579–598 (2003)
Wielemaker, J., Schreiber, A.T., Dubbeldam, B., Wielinga, B.J.: Ontology-based photo annotation. IEEE Intelligent Systems, May/June 2001 (2001)
Hollink, L., Schreiber, A.T., Wielemaker, J., Wielinga, B.: Semantic annotation of image collections. In: Proceedings of the K-CAP 2003 Workshop on Knowledge Markup and Semantic Annotation, Florida (2003)
Wittenburg, P., Thierry, D., Cunningham, H.: The Automatic Generation of Formal Annotations in a Multimedia Indexing and Searching Environment. In: Proc. ACL/EACL Workshop on Human Language Technology and Knowledge Management, Toulouse, France (2001)
Hunter, J., Drennan, J., Little, S.: Realizing the hydrogen economy through semantic web technologies. IEEE Intelligent Systems Journal - Special Issue on eScience 19, 40–47 (2004)
Yoshitaka, A., Kishida, S., Hirakawa, M., Ichikawa, T.: Knowledge-assisted content-based retrieval for multimedia databases. IEEE Multimedia 1(4), 12–21 (Winter 1994)
Tansley, R., Bird, C., Hall, W., Lewis, P., Weal, M.: Automating the linking of content and concept. In: Proc. ACM Int. Multimedia Conf. and Exhibition (ACM MM 2000), October/November 2000 (2000)
Maillot, N., Thonnat, M., Hudelot, C.: Ontology based object learning and recognition: Application to image retrieval. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004), Boca Raton, FL, USA, November 15-17, pp. 620–625 (2004)
Kompatsiaris, I., Mezaris, V., Strintzis, M.G.: Multimedia content indexing and retrieval using an object ontology. In: Stamou, G. (ed.) Multimedia Content and Semantic Web - Methods, Standards and Tools. Wiley, New York (2004)
Handschuh, S., Staab, S. (eds.): Annotation for the Semantic Web. IOS Press, Amsterdam (2003)
Bloehdorn, S., Staab, S., Handschuh, S., Avrithis, Y., Tzouvaras, V., Simou, N., Strintzis, M.G., Kompatsiaris, Y., Petridis, K.: Knowledge representation for semantic multimedia content analysis and reasoning. In: Proceedings of the European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology (EWIMT), Novemebr (2004)
Sikora, T.: The MPEG-7 Visual standard for content description - an overview. IEEE Trans. on Circuits and Systems for Video Technology, special issue on MPEG-7 11(6), 696–702 (2001)
ISO/IEC 15938-5 FCD Information Technology - Multimedia Content Description Interface - Part 5: Multimedia Description Scemes, Singapore (March 2001)
Gangemi, A., Guarino, N., Masolo, C., Oltramari, A., Schneider, L.: Sweetening Ontologies with DOLCE. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, p. 166. Springer, Heidelberg (2002)
ISO/IEC 15938-3 FCD Information Technology - Multimedia Content Description Interface - Part 3: Visual, Singapore (March 2001)
Voisine, N., Dasiopoulou, S., Mezaris, V., Spyrou, E., Athanasiadis, T., Kompatsiaris, I., Avrithis, Y., Strintzis, M.G.: Knowledge-Assisted Video Analysis Using A Genetic Algorithm. In: Proc. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2005) (April 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bloehdorn, S. et al. (2005). Semantic Annotation of Images and Videos for Multimedia Analysis. In: Gómez-Pérez, A., Euzenat, J. (eds) The Semantic Web: Research and Applications. ESWC 2005. Lecture Notes in Computer Science, vol 3532. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11431053_40
Download citation
DOI: https://doi.org/10.1007/11431053_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26124-7
Online ISBN: 978-3-540-31547-6
eBook Packages: Computer ScienceComputer Science (R0)