Skip to main content
SpringerLink
Log in

Semantic Representation of Multimedia Content

  • Chapter
Knowledge-Driven Multimedia Information Extraction and Ontology Evolution

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6050))

Abstract

Multimedia documents constitute extremely rich information resources, whose efficacious management is intertwined with the effective capturing of the underlying semantics. The conveyed meaning may span along multiple levels and relates to search and retrieval tasks, much as to the very extraction and interpretation of content descriptions. In this chapter we consider the formal representation of multimedia semantics that pertain to media and domain specific descriptions, for the purpose of supporting both the extraction and subsequent semantic management of such descriptions. To this end, firstly, we present first an overview of existing approaches to the representation of multimedia content and discuss open issues. Subsequently, we present the ontology infrastructure developed in the context of the BOEMIE project tailored towards the formal representation of multimedia content. Concluding, we present what can non-standard formal representation technologies, such as fuzzy knowledge representation formalisms bring to multimedia document processing and management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arndt, R., Troncy, R., Staab, S., Hardman, L., Vacura, M.: COMM: Designing a Well-Founded Multimedia Ontology for the Web. In: Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L.J.B., Golbeck, J., Mika, P., Maynard, D., Mizoguchi, R., Schreiber, G., Cudré-Mauroux, P. (eds.) ASWC 2007 and ISWC 2007. LNCS, vol. 4825, pp. 30–43. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  2. Baader, F., Nutt, W.: Basic description logics. In: Baader, F., Calvanese, D., McGuinness, D., Nardi, D., Patel-Schneider, P.F. (eds.) The Description Logic Handbook: Theory, Implementation, and Applications, pp. 43–95. Cambridge University Press, Cambridge (2003)

    Google Scholar 

  3. Berners-Lee, T., Hendler, J., Lassila, O.: The semantic web. Scientific American (2001)

    Google Scholar 

  4. Bertini, M., Del Bimbo, A., Torniai, C.: Enhanced ontologies for video annotation and retrieval. In: Multimedia Information Retrieval, pp. 89–96 (2005)

    Google Scholar 

  5. Bloehdorn, S., Petridis, K., Saathoff, C., Simou, N., Tzouvaras, V., Avrithis, Y., Handschuh, S., Kompatsiaris, Y., Staab, S., Strintzis, M.G.: Semantic annotation of images and videos for multimedia analysis. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 592–607. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  6. Brickley, D., Guha, R.V.: OWL Web Ontology Language Overview, W3C Recommendation February 10 (2004), http://www.w3.org/TR/owl-features/

  7. Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2(2), 121–167 (1998)

    Article  Google Scholar 

  8. Dasiopoulou, S., Heinecke, J., Saathoff, C., Strintzis, M.G.: Multimedia reasoning with natural language support. In: 1st IEEE International Conference on Semantic Computing (ICSC), Irvine, CA, USA (2007)

    Google Scholar 

  9. Dasiopoulou, S., Kompatsiaris, I., Strintzis, M.G.: Investigating fuzzy DLs-based reasoning in semantic image analysis. In: Multimedia Tools Appl., S.I. Semantic Multimedia (2009), doi:10.1007/s11042-009-0393-6

    Google Scholar 

  10. Dasiopoulou, S., Mezaris, V., Kompatsiaris, I., Papastathis, V.K., Strintzis, M.G.: Knowledge-assisted semantic video object detection. IEEE Trans. Circuits Syst. Video Techn. 15(10), 1210–1224 (2005)

    Article  Google Scholar 

  11. Dasiopoulou, S., Tzouvaras, V., Kompatsiaris, I., Strintzis, M.G.: Enquiring MPEG-7 based multimedia ontologies. Multimedia Tools and Applications 46(2-3), 331–370 (2010)

    Article  Google Scholar 

  12. Ding, Z., Peng, Y.: A Probabilistic Extension to Ontology Language OWL. In: Proceedings of the 37th Hawaii International Conference on System Sciences (HICSS-37), Big Island, Hawaii, p. 10 (January 2004)

    Google Scholar 

  13. Gangemi, A.: Ontology design patterns for semantic web content. In: Gil, Y., Motta, E., Benjamins, V.R., Musen, M.A. (eds.) ISWC 2005. LNCS, vol. 3729, pp. 262–276. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  14. Gangemi, A., Guarino, N., Masolo, C., Oltramari, A., Schneider, L.: Sweetening ontologies with DOLCE. In: Gómez-Pérez, A., Benjamins, V.R. (eds.) EKAW 2002. LNCS (LNAI), vol. 2473, pp. 166–181. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  15. Gangemi, A., Mika, P.: Understanding the Semantic Web through descriptions and situations. In: Chung, S., Schmidt, D.C. (eds.) CoopIS 2003, DOA 2003, and ODBASE 2003. LNCS, vol. 2888, pp. 689–706. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  16. Giugno, R., Lukasiewicz, T.: P-\(\mathcal{SHOQ}({\bf D})\): A probabilistic extension of \(\mathcal{SHOQ}({\bf D})\) for probabilistic ontologies in the semantic web. In: Flesca, S., Greco, S., Leone, N., Ianni, G. (eds.) JELIA 2002. LNCS (LNAI), vol. 2424, pp. 86–97. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  17. Gruber, T.R.: Toward principles for the design of ontologies used for knowledge sharing. In: Inter. Workshop on Formal Ontology, Padua, Italy (March 1993)

    Google Scholar 

  18. Heckerman, D.: A tutorial on learning with bayesian networks. Learning in Graphical Models, 301–354 (1998)

    Google Scholar 

  19. Hollink, L., Little, S., Hunter, J.: Evaluating the application of semantic inferencing rules to image annotation. In: 3rd International Conference on Knowledge Capture (K-CAP), Banff, Alberta, Canada, pp. 91–98 (2005)

    Google Scholar 

  20. Hollink, L., Worring, M.: Building a visual ontology for video retrieval. In: Proc. 13th ACM International Conference on Multimedia, Singapore, November 6-11, pp. 479–482 (2005)

    Google Scholar 

  21. Horrocks, I., Patel-Schneider, P.F.: Reducing OWL entailment to Description Logic satisfiability. J. Web Sem. 1(4), 345–357 (2004)

    Article  Google Scholar 

  22. Horrocks, I., Sattler, U., Tobies, S.: Practical reasoning for expressive description logics. In: Ganzinger, H., McAllester, D., Voronkov, A. (eds.) LPAR 1999. LNCS (LNAI), vol. 1705, pp. 161–180. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  23. Hu, B., Dasmahapatra, S., Lewis, P.H., Shadbolt, N.: Ontology-based medical image annotation with Description Logics. In: Proc. Inter. Conference on Tools with Artifical Intelligence (ICTAI), Sacramento, California, November 3-5 (2003)

    Google Scholar 

  24. Hudelot, C., Thonnat, M.: A cognitive vision platform for automatic recognition of natural complex objects. In: ICTAI, pp. 398–405 (2003)

    Google Scholar 

  25. Hunter, J.: Adding Multimedia to the Semantic Web: Building an MPEG-7 Ontology. In: Proc. The First Semantic Web Working Symposium, SWWS 2001. Stanford University, California (July 2001)

    Google Scholar 

  26. Hunter, J., Drennan, J., Little, S.: Realizing the hydrogen economy through Semantic Web technologies. IEEE Intelligent Systems 19(1), 40–47 (2004)

    Article  Google Scholar 

  27. Hyvonen, E., Styrman, A., Saarela, S.: Ontology-based image retrieval. In: XML Finland Conference, October 21-22, pp. 15–27 (2002)

    Google Scholar 

  28. Jaimes, A., Tseng, B.L., Smith, J.R.: Modal keywords, ontologies, and reasoning for video understanding. In: Bakker, E.M., Lew, M., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) CIVR 2003. LNCS, vol. 2728, pp. 248–259. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  29. Klir, G.J., Yuan, B.: Fuzzy Sets and Fuzzy Logic: Theory and Applications. Prentice-Hall, Englewood Cliffs (1995)

    MATH  Google Scholar 

  30. Goodall, S., Grimwood, P., Kim, S., Lewis, P., Martinez, K., Stevenson, A., Addis, M., Boniface, M.: Sculpteur: Towards a new paradigm for multimedia museum information handling. In: Fensel, D., Sycara, K., Mylopoulos, J. (eds.) ISWC 2003. LNCS, vol. 2870, pp. 582–596. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  31. Maillot, N., Thonnat, M.: A weakly supervised approach for semantic image indexing and retrieval. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 629–638. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  32. Martínez, J.M.: MPEG-7: Overview of MPEG-7 Description Tools, Part 2. IEEE MultiMedia 9(3), 83–93 (2002)

    Article  Google Scholar 

  33. Meghini, C., Sebastiani, F., Straccia, U.: A model of multimedia information retrieval. Journal of the ACM 48(5), 909–970 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  34. Möller, R., Neumann, B.: Ontology-based reasoning techniques for multimedia interpretation and retrieval. In: Semantic Multimedia and Ontologies: Theory and Applications (2008) (to appear)

    Google Scholar 

  35. MPEG-21. Multimedia Framework (MPEG-21) - ISO/IEC TR 21000-1:2004 (2002)

    Google Scholar 

  36. Nack, F., van Ossenbruggen, J., Hardman, L.: That obscure object of desire: Multimedia metadata on the Web, Part 2. IEEE MultiMedia 12(1), 54–63 (2005)

    Article  Google Scholar 

  37. Neumann, B., Möller, R.: On scene interpretation with description logics. Technical Report FBI-B-257/04 (2004)

    Google Scholar 

  38. Oberle, D., Ankolekar, A., Hitzler, P., Cimiano, P., Sintek, M., Kiesel, M., Mougouie, B., Baumann, S., Vembu, S., Romanelli, M.: DOLCE ergo SUMO: On foundational and domain models in the SmartWeb Integrated Ontology (SWIntO). J. Web Sem. 5(3), 156–174 (2007)

    Article  Google Scholar 

  39. Petridis, K., Anastasopoulos, D., Saathoff, C., Timmermann, N., Kompatsiaris, Y., Staab, S.: M-ontoMat-annotizer: Image annotation linking ontologies and multimedia low-level features. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds.) KES 2006. LNCS (LNAI), vol. 4253, pp. 633–640. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  40. Qi, G., Pan, J.Z., Ji, Q.: Extending description logics with uncertainty reasoning in possibilistic logic. In: Mellouli, K. (ed.) ECSQARU 2007. LNCS (LNAI), vol. 4724, pp. 828–839. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  41. Celma, O., García, R.: Semantic Integration and Retrieval of Multimedia Metadata. In: Proc. International Semantic Web Conference (ISWC), Galway, Ireland, November 6-10 (2005)

    Google Scholar 

  42. Celma, O., Halaschek-Wiener, C., Mannens, E., Troncy, R., Boll, S., Burger, T.: Multimedia vocabularies on the Semantic Web. In: W3Cu Incubator Group Report, July 24 (2007)

    Google Scholar 

  43. Schober, J.P., Hermes, T., Herzog, O.: Content-based image retrieval by ontology-based object recognition. In: Haarslev, V., Lutz, C., Möller, R. (eds.) Proc. Workshop on Applications of Description Logics, Ulm, Germany (2004)

    Google Scholar 

  44. Schreiber, A.T., Dubbeldam, B., Wielemaker, J., Wielinga, B.J.: Ontology-based photo annotation. IEEE Intelligent Systems 16(3), 66–74 (2001)

    Article  Google Scholar 

  45. Di Sciascio, E., Donini, F.: Description logics for image recognition: a preliminary proposal. In: Proceedings of the International Workshop on Description Logics (DL 1999) (1999)

    Google Scholar 

  46. Simou, N., Athanasiadis, T., Tzouvaras, V., Kollias, S.: Multimedia reasoning with f-\(\mathcal{SHIN}\). In: 2nd International Workshop on Semantic Media Adaptation and Personalization, London, United Kingdom, December 17-18 (2007)

    Google Scholar 

  47. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1380 (2000)

    Article  Google Scholar 

  48. Staab, S., Studer, R. (eds.): Handbook on Ontologies, 2nd edn. Springer, Heidelberg (2009)

    MATH  Google Scholar 

  49. Stoilos, G., Stamou, G.: Extending fuzzy description logics for the semantic web. In: Proceedings of the 3rd International Workshop on OWL Experiences and Direction (OWL ED 2007) (2007)

    Google Scholar 

  50. Stoilos, G., Stamou, G., Tzouvaras, V., Pan, J.Z., Horrocks, I.: Reasoning with very expressive fuzzy description logics. Journal of Artificial Intelligence Research 30(5), 273–320 (2007)

    MathSciNet  MATH  Google Scholar 

  51. Stoilos, G., Stamou, G., Tzouvaras, V., Pan, J.Z., Horrocks, I.: Fuzzy OWL: Uncertainty and the semantic web. In: Proc. of the International Workshop on OWL: Experiences and Directions (2005)

    Google Scholar 

  52. Straccia, U.: Reasoning within fuzzy description logics. Journal of Artificial Intelligence Research 14, 137–166 (2001)

    MathSciNet  MATH  Google Scholar 

  53. Straccia, U.: Towards a fuzzy description logic for the semantic web. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 167–181. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  54. Troncy, R., Celma, O., Little, S., GarciaGarcía, R., Tsinaraki, C.: Mpeg-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? In: Proc. 1st Workshop on Multimedia Annotation and Retrieval enabled by Shared Ontologies (MARESO), Genova, Italy, pp. 2–16 (2007)

    Google Scholar 

  55. Tsinaraki, C., Polydoros, P., Christodoulakis, S.: Integration of OWL ontologies in MPEG-7 and TV-anytime compliant semantic indexing. In: Persson, A., Stirna, J. (eds.) CAiSE 2004. LNCS, vol. 3084, pp. 398–413. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  56. Tsinaraki, C., Polydoros, P., Christodoulakis, S.: Interoperability support between mpeg-7/21 and OWL in ds-mirf. IEEE Trans. Knowl. Data Eng. 19(2), 219–232 (2007)

    Article  Google Scholar 

  57. van Ossenbruggen, J., Nack, F., Hardman, L.: That obscure object of desire: Multimedia metadata on the web, part 1. IEEE MultiMedia 11(4), 38–48 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electrical and Computer Engineering, National Technical University of Athens, Zographou, 15780, Athens, Greece

    Kalliopi Dalakleidi, Giorgos Stoilos, Vassilis Tzouvaras & Giorgos Stamou

  2. Centre for Research and Technology Hellas, Informatics and Telematics Institute, Thermi-Thessaloniki, Greece

    Stamatia Dasiopoulou & Yiannis Kompatsiaris

Authors
  1. Kalliopi Dalakleidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stamatia Dasiopoulou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Giorgos Stoilos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vassilis Tzouvaras
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giorgos Stamou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yiannis Kompatsiaris
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Informatics and Telecommunications, National Centre for Scientific Research “Demokritos”, P.O. box 60228, 15310, Ag. Paraskevi, Athens, Greece

    Georgios Paliouras  & Constantine D. Spyropoulos  & 

  2. Biotechnology Center (BIOTEC), TU Dresden, Tatzberg 47-51, 01307, Dresden, Germany

    George Tsatsaronis

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Dalakleidi, K., Dasiopoulou, S., Stoilos, G., Tzouvaras, V., Stamou, G., Kompatsiaris, Y. (2011). Semantic Representation of Multimedia Content. In: Paliouras, G., Spyropoulos, C.D., Tsatsaronis, G. (eds) Knowledge-Driven Multimedia Information Extraction and Ontology Evolution. Lecture Notes in Computer Science(), vol 6050. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20795-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20795-2_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20794-5

  • Online ISBN: 978-3-642-20795-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation