Abstract
We present an original approach for motion-based retrieval involving partial query. More precisely, we propose an unified statistical framework both to extract entities of interest in video shots and to achieve the associated content-based characterization to be exploited for retrieval issues. These two stages rely on the characterization of scene activity in video sequences based on a non-parametric statistical modeling of motion information. Areas comprising relevant scene activity are extracted from an ascendant hierarchical classiffcation applied to the adjacency graph of an initial block-based partition of the image. Therefore, given a video base, we are able to construct a base of samples of entities of interest characterized by their associated scene activity model. The retrieval operations is then formulated as a Bayesian inference issue using the MAP criterion. We report different results of extraction of entities of interest in video sequences and examples of retrieval operations performed on a video base composed of a hundred samples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P. Aigrain, H-J. Zhang, and D. Petkovic. Content-based representation and retrieval of visual media: A state-of-the-art review. Multimedia Tools and Applications, 3(3):179–202, September 1996.
P. Bouthemy, M. Gelgon, and F. Ganansia. A unified approach to shot change detection and camera motion characterization. IEEE Trans. on Circuits and Systems for Video Technology, 9(7):1030–1044, 1999.
R. Brunelli, O. Mich, and C.M. Modena. A survey on the automatic indexing of video data. Jal of Vis. Comm. and Im. Repr., 10(2):78–112, 1999.
S.-F. Chang, W. Chen, H.J. Meng, H. Sundaram, and D. Zhong. VideoQ-an Automatic content-based video search system using visual cues. In Proc. ACM Multimedia Conf., Seattle, November 1997.
R. Fablet and P. Bouthemy. Motion-based feature extraction and ascendant hierarchical classiffcation for video indexing and retrieval. In Proc. of 3rd Int. Conf. on Visual Information Systems, VISUAL’99, LNCS Vol 1614, pages 221–228, Amsterdam, June 1999. Springer.
R. Fablet, P. Bouthemy, and P. Pérez. Statistical motion-based video indexing and retrieval. In Proc. of 6th Int. Conf. on Content-Based Multimedia Information Access, RIAO’2000, pages 602–619, Paris, April 2000.
A.K. Jain, A. Vailaya, and W. Xiong. Query by video clip. Multimedia Systems, 7(5):369–384, 1999.
A. Mitiche and P. Bouthemy. Computation and analysis of image motion: a synopsis of current problems and methods. Int. Journal of Computer Vision, 19(1):29–55, 1996.
M.R. Naphade, T.T. Kristjansson, B.J. Frey, and T. Huang. Probabilistic multimedia objects (Multijects): a novel approach to video indexing and retrieval in multimedia systems. In Proc. of 5th IEEE Int. Conf. on Image Processing, ICIP’98, pages 536–5450, Chicago, October 1998.
C. Nastar, M. Mitschke, and C. Meilhac. Effcient query refinement for image retrieval. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, CVPR’98, Santa Barbara, June 1998.
R. Nelson and R. Polana. Qualitative recognition of motion using temporal texture. Computer Vision, Graphics, and Image Processing, 56(1):78–99, July 1992.
J.M. Odobez and P. Bouthemy. Robust multiresolution estimation of parametric motion models. Jal of Vis. Comm. and Im. Repr., 6(4):348–365, 1995.
J.M. Odobez and P. Bouthemy. Separation of moving regions from background in an image sequence acquired with a mobile camera. In Video Data Compression for Multimedia Computing, chapter 8, pages 295–311. H. H. Li, S. Sun, and H. Derin,eds, Kluwer, 1997.
N. Vasconcelos and A. Lippman. A Bayesian framework for semantic content characterization. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, CVPR’98, pages 566–571, Santa-Barbara, June 1998.
N. Vasconcelos and A. Lippman. A probabilistic architecture for content-based image retrieval. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, CVPR’2000, Hilton Head, June 2000.
V. Vinod. Activity based video shot retrieval and ranking. In Proc. of 14th Int. Conf. on Pattern Recognition, ICPR’98, pages 682–684, Brisbane, August 1998.
H. Wactlar, T. Kanade, M. Smith, and S. Stevens. Intelligent access to digital video: The informedia project. IEEE Computer, 29(5):46–52, 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fablet, R., Bouthemy, P. (2000). Statistical Motion-Based Retrieval with Partial Query. In: Laurini, R. (eds) Advances in Visual Information Systems. VISUAL 2000. Lecture Notes in Computer Science, vol 1929. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-40053-2_9
Download citation
DOI: https://doi.org/10.1007/3-540-40053-2_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41177-2
Online ISBN: 978-3-540-40053-0
eBook Packages: Springer Book Archive