Legal Multimedia Ontologies and Semantic Annotation for Search and Retrieval

  • Jorge González-ConejeroEmail author
Part of the Law, Governance and Technology Series book series (LGTS, volume 1)


In this work, we study the possibilities of multimedia management and semantic annotation focused on the legal domain and on multimedia ontologies. In this field, professionals are used to consuming the most of their time searching and retrieving legal information. For instance, search and retrieval of multimedia contents are the basis of the whole applications in scenarios such as e-discovery and e-learning. In addition, the legal multimedia explosion increases the need of storing these files in a structured form to facilitate the access to this information in an efficient and effective way. Several drawbacks appear when a multimedia ontology is used to represent the knowledge extracted from multimedia files due to the semantic gap. In this work, this topic is also discussed.


Multimedia Content Semantic Concept Semantic Annotation Multimedia Document Dominant Color 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work has been partially supported by the Spanish Government (Ministerio de Ciencia e Innovación and Ministerio de Industria, Turismo y Comercio) under Grants TSI-020501-2008-131 and CSO2008-05536.


  1. Alan, O., S. Akpinar, O. Sabuncu, N. Cicekli, F. Alpaslan (2008). Ontological Video Annotation and Querying System for Soccer Games. In International Symposium on Computer and Information Sciences, 1–6.Google Scholar
  2. Avaro, O., P. Salembier (2001). MPEG-7 Systems: Overview. IEEE Transactions on Circuits and Systems for Video Technology, 11(6): 760–764.CrossRefGoogle Scholar
  3. Ballan, L., M. Bertini, A. Del Bimbo, G. Serra (2010). Video Annotation and Retrieval Using Ontologies and Rule Learning. IEEE Multimedia, in press.Google Scholar
  4. Baron, J.R., P. Thompson (2007). The Search Problem Posed by Large Heterogeneous Data Sets in Litigation: Possible Future Approaches to Research. In International Conference on Artificial Intelligence and Law. ACM, Barcelona, 141–147.Google Scholar
  5. Berners-Lee, T., J. Hendler, O. Lassila (2001). The Semantic Web. Scientific American, 284(5): 34–43.CrossRefGoogle Scholar
  6. Bertini, M., A.D. Bimbo, C. Torniai (2007). Soccer Video Annotation Using Ontologies Extended with Visual Prototypes. In International Workshop Content-Based Multimedia Indexing, 212–218.Google Scholar
  7. Bertini, M., A.D. Bimbo, C. Torniai, R. Cucchiara, C. Grana (2006). MOM: Multimedia Ontology Manager. A Framework for Automatic Annotation and Semantic Retrieval of Video Sequences. In International Multimedia Conference. Proceedings of the 14th annual ACM international conference on Multimedia, 787–788.Google Scholar
  8. Brickell, J.L., A.M. Langer (2009). Adapting to the Data Explosion: Ensuring Justice For All. In IEEE International Conference on Systems, Man and Cibernet-ics Society. IEEE, 86–90.Google Scholar
  9. Casanovas, P., X. Binefa, C. Gracia, E. Teodoro, N. Galera, M. Blazquez, M. Poblet, J. Carrabina, M. Monton, C. Montero, J. Serrano, J.M. Lopez-Cobo (2009). Law, Ontologies and the Semantic Web: Channeling the Legal Information Flood, vol. 188 of Frontiers in Artificial Intelligence and Applications, Chapter The e-Sentencias Prototype: A Procedural Ontology for Legal Multimedia Applications. IOS Press, Amsterdam, Netherlands, 199–219.Google Scholar
  10. Chang, H., S. Chang, T. Hou, A. Hsu (1995). The Management and the Applications of Tele-Action Objects. ACM Journal of Multimedia Systems, 3(5–6): 204–216.CrossRefGoogle Scholar
  11. Dasiopoulou, S., V. Mezaris, I. Kompatsiaris, V. Papastathis, M. Strintzis (2005). Knowledge-Assisted Semantic Video Objectdetection. IEEE Transactions on Circuits andSystems for Video Technology, 15(10): 1210–1224.CrossRefGoogle Scholar
  12. Dong, A., H. Li (2006). Multi-Ontology Based Multimedia Annotation for Domain-Specific Information Retrieval. In IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing, 158–165.Google Scholar
  13. Ghosh, H., S. Chaudhury, K. Kashyap, B. Maiti (2007). Ontologies. A Handbook of Principles, Concepts and Applications in Information Systems, vol. 14 of Information Systems. Springer, US, 265–296.Google Scholar
  14. Gonzalez, J., D. Rowe, J. Varona, F.X. Roca (2008). Understanding Dynamic Scenes Based on Human Sequence Evaluation. Image and Vision Computing, 27(10):1433–1444.CrossRefGoogle Scholar
  15. Gonzalez-Conejero, J., E. Teodoro, N. Galera (2010). Intelligent Multimedia: Managing Creative Works in a Digital World, vol. 8 of Legal Information and Communication Technologies, Chapter Legal Multimedia Management and Semantic Annotation for Improved Search and Retrieval. EPAP, 395–408.Google Scholar
  16. Gracia, C., X. Binefa, M. Poblet (2010). Intelligent Multimedia: Managing Creative Works in a Digital World, vol. 8 of Legal Information and Communication Technologies, Chapter Emotional Speech Analysis in Mediation and Court Environments. EPAP, 364–378.Google Scholar
  17. Gracia, C., X. Binefa, E. Teodoro, N. Galera (2010). Intelligent Multimedia: Managing Creative Works in a Digital World, vol. 8 of Legal Information and Communication Technologies, chapter Diarization for the Annotation of Legal Videos. EPAP, 379–393.Google Scholar
  18. Gruber, T.A. (1993). A Translation Approach to Portable Ontology Specifications. Knowledge Acquisition, 5(2): 199–220.CrossRefGoogle Scholar
  19. Guarino, N. (1998). Formal Ontology in Information Systems, Chapter Formal Ontology and Information Systems. IOS Press, Amsterdam, Netherlands, 3–15.Google Scholar
  20. Hunter, J. (2001). An Overview of the MPEG-7 Description Definition Language (DDL). IEEE Transactions on Circuits and Systems for Video Technology, 11(6): 765–772.CrossRefGoogle Scholar
  21. Jaimes, A., B. Tseng, J. Smith (2003). Modal Keywords, Ontologies, and Reasoning for Video Understanding. In International Conference on Image and Video Retrieval (CIVR 2003).Google Scholar
  22. Koskela, M., A.F. Smeaton, J. Laaksonen (2007). Measuring Concept Similarities in Multimedia Ontologies: Analysis and Evaluations. IEEE Transactions on Multimedia, 9(5): 912–922.CrossRefGoogle Scholar
  23. Mezaris, V., I. Kompatsiaris, N. Boulgouris, M. Strintzis (2004). Real-Time Compressed-Domain Spatiotemporal Segmentation and Ontologies for Video Indexing and Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 14(5): 606–621.Google Scholar
  24. Petridis, K., D. Anastasopoulos, C. Saathoff, C. Timmermann, I. Kompatsiaris, S. Staab (2006). M-OntoMat-Annotizer: Image Annotation. Linking Ontologies and Multimedia Low-Level Features. In Engineered Applications ofSe-mantic Web Session (SWEA) at the 10th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2006).Google Scholar
  25. Sikora, T. (2001). The MPEG-7 Visual Standard for Content Description – An Overview. IEEE Transactions on Circuits and Systems for Video Technology, 11(6): 696–702.CrossRefGoogle Scholar
  26. A. Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain (2000). Content-Based Image Retrieval at the End of the Early Years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12): 1349–1380.CrossRefGoogle Scholar
  27. Snoek, C.G., B. Huurnink, L. Hollink, M. de Rijke, G. Schreiber, M. Worring (2007). Adding Semantics to Detectors for Video Retrieval. IEEE Transactions on Multimedia, 9(5): 975–986.CrossRefGoogle Scholar
  28. Snoek, C.G., M. Worring, J. van Gemert, J. Geusebroek, A. Smeulders (2006). The Challenge Problem for Automated Detection of 101 Semantic Concepts in Multimedia. In MULTIMEDIA ’06: Proceedings of the 14th annual ACM international conference on Multimedia, New York, NY, 421–430.Google Scholar
  29. Vembu, S., M. Kiesel, M. Sintek, S. Bauman (2006). Towards Bridging the Semantic Gap in the Multimedia Annotation and Retrieval. In First International Workshop on Semantic Web Annotations for Multimedia (SWAMM).Google Scholar
  30. Xin, C. (2009). E-Learning Applications and Challenges. In International Conference on Future Information Technology and Management Engineering. IEEE, 580–583.Google Scholar
  31. Zha, Z.-J., T. Mei, Z. Wang, X.-S. Hua (2007). Building a Comprehensive Ontology to Refine Video Concept Detection. In Proceedings of the International Workshop On Multimedia Information Retrieval, 227–236.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.UAB Institute of Law and TechnologyAutonomous University of BarcelonaBarcelonaSpain

Personalised recommendations