Abstract
We first insist on the need for conceptual and knowledge-based audiovisual (AV) models in AV and multimedia information retrieval systems.We then propose several criteria for characterizing audiovisual representation approaches, and present a new approach for modeling and structuring AV documents with Annotations Interconnected Strata (AI-STRATA). This consists in analyzing AV documents through analysis dimensions allowing the detection of objects of interest of any type (structural, conceptual,...). Annotations are structured by annotation elements (AE) representing both objects of interest and relationships. A knowledge base is used in order to monitor the annotation process. We show how to use annotations to link different strata on the base of explicit or implicit contexts and how AI-Strata can be used to build contextual views of a stratum, using both annotation and knowledge levels. We finally show how the model can efficiently support different description tasks such as indexing, searching and browsing audiovisual material.
This work is partially supported by France Télécom (through CNET/CCETT), research contract N° 96 ME 17.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. AAmodt and E. Plaza. Case based reasoning: Foundational issues, methodological variations, and system approaches. AICOM, 7(1):39–59, Mars 1994.
S. Adali, K.S. Candan, S. Chen, K. Erol, and V.S. Subrahmanian. Advanced video information system: Data structures and query processing. Multimedia Systems, 4:172–186, 1996.
P. Aigrain, D. Petkovic, and H.J. Zhang. Content-based representation and retrieval of visual media: A state-of-the-art review. Multimedia Tools and Applications special issue on Representation and Retrieval of Visual Media, 1996.
N. Belkin. Braque: Design of interface to support user interaction in information retrieval. Information Processing and Management, 29(3):29–38, 1993.
S.F. Chang, J.R. Smith, M. Beigi, and A. Benitez. Visual information retrieval from large distributed online repositories. Communications of the ACM, 40(12):63–71, Dec. 1997.
T.-S. Chua and L.-Q. Ruan. A video retrieval and sequencing system. ACM Transactions on Information Systems, 13(4):372–407, October 1995.
J. M. Corridoni, A. Del Bimbo, D. Lucarella, and H. Wenxue. Multi-perspective navigation of movies. Journal of Visual Languages and Computing, 7:445–466, 1996.
G. Davenport. Indexes are out, models are in. IEEE Multimedia, pages 10–15, 1996.
G. Davenport, T. Aguierre Smith, and N. Pincever. Cinematic primitives for multimedia. IEEE Computer Graphics and Applications, pages 67–74, Jul. 1991.
M. Davis. Media streams: An iconic visual language for video annotation. In Proceedings of the 1993 IEEE Symposium on Visual Languages, pages 196–203, Bergen, Norway, August1993. IEEE Computer Society Press.
W.I. Grosky. Managing multimedia information in database systems. Communications of the ACM, 40(12):73–80, Dec. 1997.
A. Gupta, S. Santini, and R. Jain. In search of information in visual media. Communications of the ACM, 40(12):35–42, Dec. 1997.
R. Jain. Visual information management. Communications of the ACM, 40(12):31–32, Dec. 1997.
R. Lienhart, S. Pfeiffer, and W. Effelsberg. Video abstracting. Communications of the ACM, 40(12):55–62, Dec. 1997.
J. Nanard and M. Nanard. Adding macroscopic semantics to anchors in knowledge-based hypertext. Int. J. Human-Computer Studies, 43:363–382, 1995.
C. Nastar, M. Mitschke, C. Meilhac, and N. Boujemaa. Surfimage: a flexible content-based image retrieval system. In ACM Multimedia 98, Bristol, Sept 1998.
E. Oomoto and K. Tanaka. Ovid: Design and implementation of a videoobject database system. IEEE Transactions on Knowledge and Data Engineering, 5(4):629–643, Aug. 1993.
F. Pereira. Mpeg-7: A standard for content-based audiovisual description. In 2nd Int. Conf. on Visual Information Systems, pages 1–4, San Diego, Dec. 1997.
Y. Prie, J.-M. Jolion, and A. Mille. Sesame: audiovisual documents conceptual description model and content annotation assistants. In CORESA’98, 4th. Workshop on COmpression and REpresentation of Audiovisual Signals, Lannion-France, Juin 1998. CNET-France Telecom.
J.-F. Sowa. Conceptual Structures-Information Processing in Mind and Machine. Addison-Wesley, 1984.
R. Weiss, A. Duda, and D.K. Gifford. Composition and search with a video algebra. IEEE Multimedia, 2(1):12–25, 1995.
B.L. Yeo and M.M. Yeung. Retrieving and visualizing video. Communications of the ACM, 40(12):43–52, Dec. 1997.
K. Zettsu, K. Uehara, K. Tanaka, and N. Kimura. A time-stamped authoring graph for video databases. In Databases and Expert Systems Applications, LNCS 1308, pages 192–201. Springer-Verlag, 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Prié, Y., Mille, A., Pinon, JM. (1999). AI-STRATA: A User-Centered Model for Content-Based Description and Retrieval of Audiovisual Sequences. In: Nishio, S., Kishino, F. (eds) Advanced Multimedia Content Processing. AMCP 1998. Lecture Notes in Computer Science, vol 1554. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48962-2_22
Download citation
DOI: https://doi.org/10.1007/3-540-48962-2_22
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65762-0
Online ISBN: 978-3-540-48962-7
eBook Packages: Springer Book Archive