Feature Driven Visualization of Video Content for Interactive Indexing
When using visual video features in an interactive video in- dexing environment, it is necessary to visualize the meaning and impact of features to people that are not image processing experts, such as video librarians. An important method to visualize the relationship between the feature and the video is projection of feature values on the original video data.
In this paper, we describe the characteristics of video feature types with respect to visualization. In addition, requirements for the visualization of video features are distinguished. Several video visualization methods are evaluated against the requirements. Furthermore, for feature visualization we propose the backprojection method in combination with the evaluated video visualization methods.
We have developed the VidDex system which uses backprojection on various video visualization modes. By combining the visualization modes, the requirements for the feature characteristics identified can be met.
KeywordsVideo Stream Video Content Video Shot Interactive Indexing Video Feature
Unable to display preview. Download preview PDF.
- 1.Z. Aghbari, K. Kaneko, and A. Makinouchi. Vst-model: A uniform topological modeling of the visual-spatio-temporal video features. In Proc. of the 6th IEEE Int. Conf. on Multimedia Systems, volume 2, pages 163–168, 1999.Google Scholar
- 2.J.M. Boggs and D.W. Petrie. The art of watching films. Mayfield Publishing Company, Mountain View, CA, 5th edition, 2000.Google Scholar
- 4.G. Davenport, T. Aguierre Smith, and N. Pincever. Cinematic principles for multimedia. IEEE Computer Graphics & Applications, pages 67–74, July 1991.Google Scholar
- 5.A. Hanjalic, R.L. Lagendijk, and J. Biemond. Automatically segmenting movies into logical story units, volume 1614 of Lecture Notes in Computer Science, pages 229–236. Springer-Verlag, Berlin, 1999.Google Scholar
- 6.H. Müller and E. Tan. Movie maps. In International Conference on Information Visualization, London, England, 1999. IEEE.Google Scholar
- 7.G.S. Pingali, Y. Jean, and I. Carlbom. LucentVision: A System for Enhanced Sports Viewing, volume 1614 of Lecture Notes in Computer Science, pages 689–696. Springer-Verlag, Berlin, 1999.Google Scholar
- 8.Y. Rui, T.S. Huang, and S. Mehrotra. Constructing table-of-content for videos. Multimedia Systems, Special section on Video Libraries, 7(5):359–368, 1999.Google Scholar
- 10.L. Teodosio and W. Bender. Salient video stills: Content and context preserved. In Proc. of the First ACM Int’l Conf. on Multimedia, pages 39–46, 1993.Google Scholar
- 11.K. Weixin, R. Yao, and L. Hanqing. A new scene breakpoint detection algorithm using slice of video stream. In H.H.S. Ip and A.W.M. Smeulders, editors, MI-NAR’98, pages 175–180, Hongkong, China, 1998. IAPR.Google Scholar