Modeling Color Dynamics for the Semantics of Commercials
Retrieval of video based on content semantics requires that models are developed to map low level perceptual features into high level semantic concepts. Commercials are a video category where the link between low level perceptual features and high level semantics is stressed, since the way colors are chosen and modified throughout a commercial creates a large part of its message. In this chapter, we propose a model for the representation and comparison of video content based on dynamics of color regions in the video. A model is presented to define an intermediate level representation of color dynamics in terms of spatial arrangement of color flows. The model for representation and comparison of spatial relationships between extended sets of pixels in a 3D space is introduced by developing on the concept of weighted walkthroughs. Results of preliminary experiments are reported for a library of video commercials.
KeywordsVideo retrieval by semantic content representation of color dynamics spatio-temporal modeling color flows video commercials
Unable to display preview. Download preview PDF.
- Ahuja, R.K., Magnanti, T.L., and Orlin, J.B. Network Flows, Prentice Hall, 1993.Google Scholar
- Arndt, T. and Chang, S.K. Image sequence compression by iconic indexing. In IEEE VL '89 Workshop on Visual Languages, Roma, Italy, September 1989, pp. 177–182.Google Scholar
- ASSAVID: Automatic Segmentation and Semantic Annotation of Sports Videos. European Project IST-1999-13082.Google Scholar
- Berretti, S., Del Bimbo, A., and Vicario, E. Weighting spatial arrangement of colors in content based image retrieval. In IEEE Int. Conf. Multimedia Computing and Systems, Firenze, June 99.Google Scholar
- Bertelli, B. La pubblicitazione: la citazione delle avanguardie storiche nelle pubblicità video e stampa. Ph.D. Thesis, Dept. of Visual Arts, University of Siena, Italy, 1997.Google Scholar
- Del Bimbo, A. Visual Information Retrieval, Academic Press, London, 1999.Google Scholar
- Del Bimbo, A. and Vicario, E. Weighted walkthroughs between extended entities for retrieval by spatial arrangement. To appear, IEEE Trans, on Multimedia.Google Scholar
- Floch, J.-M. Sémiotique, marketing et communication. Sous les signes, les stratégies. Presses Universitaires de France, Paris, France, 1990.Google Scholar
- Gudivada, V.N. and Raghavan, V.V. Design and evaluation of algorithms for image retrieval by spatial similarity. ACM Trans, on Information Systems, Vol. 13, No. 2, April 1995.Google Scholar
- Gupta, A., Jain, R., and Santini, S. Querying multiple perspective video. In Proc. of SPIE Vol. 3656, Storage and Retrieval for Image and Video Databases VII, San Jose, USA, January 1999.Google Scholar
- Jain, A.K. and Dubes, R.C. Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs (NJ), 1991.Google Scholar
- Pike, J.M. and Harris, C.G. A combined corner and edge detector. In Proc. Fourth Alvey Vision Conference, pp. 147–151, 1988.Google Scholar