Abstract
We propose a closed form solution for segmenting mixtures of 2-D translational and 2-D affine motion models directly from the image intensities. Our approach exploits the fact that the spatial-temporal image derivatives generated by a mixture of these motion models must satisfy a bi-homogeneous polynomial called the multibody brightness constancy constraint (MBCC). We show that the degrees of the MBCC are related to the number of motions models of each kind. Such degrees can be automatically computed using a one-dimensional search. We then demonstrate that a sub-matrix of the Hessian of the MBCC encodes information about the type of motion models. For instance, the matrix is rank-1 for 2-D translational models and rank-3 for 2-D affine models. Once the type of motion model has been identified, one can obtain the parameters of each type of motion model at every image measurement from the cross products of the derivatives of the MBCC. We then demonstrate that accounting for a 2-D translational motion model as a 2-D affine one would result in erroneous estimation of the motion models, thus motivating our aim to account for different types of motion models. We apply our method to segmenting various dynamic scenes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Irani, M., Rousso, B., Peleg, S.: Detecting and tracking multiple moving objects using temporal integration. In: European Conference on Computer Vision, pp. 282–287 (1992)
Wang, J., Adelson, E.: Layered representation for motion analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 361–366. IEEE Computer Society Press, Los Alamitos (1993)
Darrel, T., Pentland, A.: Robust estimation of a multi-layered motion representation. In: IEEE Workshop on Visual Motion, pp. 173–178. IEEE Computer Society Press, Los Alamitos (1991)
Jepson, A., Black, M.: Mixture models for optical flow computation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 760–761. IEEE Computer Society Press, Los Alamitos (1993)
Ayer, S., Sawhney, H.: Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding. In: IEEE International Conference on Computer Vision, pp. 777–785. IEEE Computer Society Press, Los Alamitos (1995)
Weiss, Y.: A unified mixture framework for motion segmentation: incoprporating spatial coherence and estimating the number of models. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 321–326. IEEE Computer Society Press, Los Alamitos (1996)
Weiss, Y.: Smoothness in layers: Motion segmentation using nonparametric mixture estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 520–526. IEEE Computer Society Press, Los Alamitos (1997)
Torr, P., Szeliski, R., Anandan, P.: An integrated Bayesian approach to layer extraction from image sequences. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(3), 297–303 (2001)
Cremers, D., Soatto, S.: Motion competition: A variational framework for piecewise parametric motion segmentation. International Journal of Computer Vision 62(3), 249–265 (2005)
Shizawa, M., Mase, K.: A unified computational theory for motion transparency and motion boundaries based on eigenenergy analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 289–295. IEEE Computer Society Press, Los Alamitos (1991)
Vidal, R., Sastry, S.: Segmentation of dynamic scenes from image intensities. In: IEEE Workshop on Motion and Video Computing, pp. 44–49. IEEE Computer Society Press, Los Alamitos (2002)
Vidal, R., Ma, Y.: A unified algebraic approach to 2-D and 3-D motion segmentation. In: European Conference on Computer Vision, pp. 1–15 (2004)
Vidal, R., Singaraju, D.: A closed-form solution to direct motion segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 510–515. IEEE Computer Society Press, Los Alamitos (2005)
Singaraju, D., Vidal, R.: A bottom up algebraic approach to motion segmentation. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3851, pp. 286–296. Springer, Heidelberg (2006)
Fischler, M.A., Bolles, R.C.: RANSAC random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 26, 381–395 (1981)
Rao, S., Yang, A.Y., Wagner, A., Ma, Y.: Segmentation of hybrid motions via hybrid quadratic surface analysis. In: ICCV, pp. 2–9 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Singaraju, D., Vidal, R. (2007). Direct Segmentation of Multiple 2-D Motion Models of Different Types. In: Vidal, R., Heyden, A., Ma, Y. (eds) Dynamical Vision. WDV WDV 2006 2005. Lecture Notes in Computer Science, vol 4358. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70932-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-70932-9_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70931-2
Online ISBN: 978-3-540-70932-9
eBook Packages: Computer ScienceComputer Science (R0)