Abstract
Video information processing and retrieval is a key aspect of future multimedia technologies and applications. Commercial videos encode several planes of expression through a rich and dense use of colors, editing effects, viewpoints and rhythms, which are exploited together to attract potential purchasers. Databases of commercials can be accessed in order to analyze how a commercial has been developed, retrieve commercials similar to an example, catalog commercials according to the kind of message conveyed to the user. In this paper, we present a system allowing the retrieval of commercial streams based on their salient semantics. Semantics is regarded from the semiotics perspective: collections of signs and semantic features like colors, editing effects, motion, etc. are used as basic blocks with which the meaning of a commercial is constructed. In our system, it is possible to retrieve commercials according to both the meaning they convey and to their similarity to examples.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
P. Aigrain, P. Joly, P. Lepain, and V. Longueville, “Medium knowledge-based macro segmentation of video sequences,” in Intelligent Multimedia Information Retrieval, M. Maybury (Ed.), 1996.
F. Arman, A. Hsu, and M. Chi, “Feature management for large video databases,” in Conf. on Storage and Retrieval for Image and Video Databases, W. Niblack (Ed.), San Jose, CA, May 1993, pp. 2–12.
D.H. Ballard and C.M. Brown, Computer Vision, Prentice-Hall: Engelwood Cliffs, NJ, 1982.
B. Bertelli, “La pubblicitazione: la citazione delle avanguardie storiche nelle pubblicità video e stampa,” Ph.D. Thesis, Dept. of Visual Arts, Univerity of Siena, Italy, 1997.
M. Caliani, “ Ricerca per contenuto di filmati pubblicitari,” Master's Thesis, Dept. of Systems and Informatics, University of Florence, Italy, 1997.
M. Caliani, C. Colombo, A. Del Bimbo, and P. Pala, “Commercial video retrieval by induced semantics,” in Proc. IEEE Int'l Workshop on Content-based Access of Image and Video Databases CAIVD'98, Bombay, India, Jan. 1998, pp. 72–80.
J.M. Corridoni and A. Del Bimbo, “Film editing reconstruction and semantic analysis,” in Proc. CAIP'95, Prague, Czech Republic, Sept. 1995.
J.M. Corridoni and A. Del Bimbo, “Structured digital video indexing,” in Proc. 13th Int'l Conf. on Pattern Recognition ICPR'96, Wien, Austria. Aug. 1996, pp. (III):125–129.
J.M. Corridoni, A. Del Bimbo, and P. Pala, “Sensations and psychological effects in color image databases,” ACM Multimedia Systems Journal, Vol. 7, No. 3, May 1999, pp. 175–183.
J.-M. Floch, Sémiotique, marketing et communication. Sous les signes, les stratégies. Presses Universitaires de France, Paris, France, 1990.
A.J. Greimas, Sémantique structurale. Larousse, Paris, 1966.
C.R. Haas, Pratique de la publicité, Bordas: Paris, France, 1988.
A. Hampapur, R. Jain, and T. Weymouth, “Digital video segmentation,” in 2nd Annual ACM Multimedia Conference and Exposition, San Francisco, CA, Oct. 1994.
A.K. Jain, Algorithms for Clustering Data, Prentice Hall: Englewood Cliffs, NJ, 1991.
R. Lienhart, C. Kuhmünch, and W. Effelsberg, “On the detection and recognition of television commercials,” in Proc. Int'l Conf. on Multimedia Computing and Systems, Ottawa, Canada, June 1997, pp. 509–516.
A. Nagasaka and Y. Tanaka, “Automatic video indexing and full video search for object appearances,” in IFIP Trans., Visual Database Systems II, W.E. Knuth (Ed.), 1992, pp. 113–128.
J.M. Pike and C.G. Harris, “A combined corner and edge detector,” in Proc. Fourth Alvey Vision Conference, 1988, pp. 147–151.
S. Smoliar and H. Zhang, “Content-based video indexing and retrieval,” IEEE Multimedia, Vol. 2, No. 1, pp. 63–75, Summer 1994.
D. Swanberg, C.F. Shu, and R. Jain, “Knowledge guided parsing in video databases,” in Conf. on Storage and Retrieval for Image and Video Databases, W. Niblack (Ed.), San Jose, CA, May 1993, pp. 13–24.
Y. Tonomura, A. Akutsu, Y. Taniguchi, and G. Suzuki, “Structured video computing,” IEEE Multimedia, Vol. 1, No. 3, pp. 35–43, Fall 1994.
T. Uchiyama and M.A. Arbib, “Color image segmentation using competitive learning,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 16, No. 12, pp. 1197–1206, Dec. 1994.
M. Yeung, B.L. Yeo, and B. Liu, “Extracting story units from long programs for video browsing and navigation,” in Proc. IEEE Int'l Conf. on Multimedia Computing and Systems, Hiroshima, Japan, June 1996, pp. 296–305.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Colombo, C., Bimbo, A.D. & Pala, P. Retrieval of Commercials by Semantic Content: The Semiotic Perspective. Multimedia Tools and Applications 13, 93–118 (2001). https://doi.org/10.1023/A:1009681324605
Issue Date:
DOI: https://doi.org/10.1023/A:1009681324605