Abstract
The chapter addresses an alternative method for structure and motion factorization of nonrigid objects. We present a rotation constrained power factorization (RCPF) algorithm that integrates orthonormality and replicated block structure of the motion matrix directly into iterations. The algorithm is easy to implement and can work with incomplete tracking matrix. Based on the shape bases recovered by the batch-type factorization, we introduce a sequential factorization technique to compute the shape and motion of new frames efficiently. Extensive experiments show the effectiveness of the proposed algorithm.
We must confine ourselves to those forms that we know how to handle, or for which any tables which may be necessary have been constructed.
Sir Ronald Aylmer Fisher (1890–1962)
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proc. of SIGGRAPH, pp. 187–194 (1999)
Brand, M.: Morphable 3D models from video. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 456–463 (2001)
Brand, M.: Incremental singular value decomposition of uncertain data with missing values. In: Proc. of European Conference on Computer Vision, pp. 707–721 (2002)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 690–696 (2000)
Buchanan, A.M., Fitzgibbon, A.W.: Damped Newton algorithms for matrix factorization with missing data. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 316–322 (2005)
Chen, P.: Optimization algorithms on subspaces: Revisiting missing data problem in low-rank matrix. Int. J. Comput. Vis.80(1), 125–142 (2008)
Chen, P., Suter, D.: Recovering the missing components in a large noisy low-rank matrix: Application to SFM. IEEE Trans. Pattern Anal. Mach. Intell.26(8), 1051–1063 (2004)
Christy, S., Horaud, R.: Euclidean shape and motion from multiple perspective views by affine iterations. IEEE Trans. Pattern Anal. Mach. Intell.18(11), 1098–1104 (1996)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell.23(6), 681–685 (2001)
Golub, G., Loan, C.V.: Matrix Computations. John Hopkins University Press, Baltimore (1983)
Gruber, A., Weiss, Y.: Factorization with uncertainty and missing data: Exploiting temporal coherence. In: Advances in Neural Information Processing Systems (2003)
Gruber, A., Weiss, Y.: Multibody factorization with uncertainty and missing data using the em algorithm. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 707–714 (2004)
Hartley, R., Schaffalizky, F.: Powerfactorization: 3D reconstruction with missing or uncertain data. In: Proc. of Australia-Japan Advanced Workshop on Computer Vision (2003)
Hung, Y., Tang, W.: Projective reconstruction from multiple views with minimization of 2D reprojection error. Int. J. Comput. Vis.66(3), 305–317 (2006)
Jacobs, D.: Linear fitting with missing data for structure-from-motion. Comput. Vis. Image Underst.82(1), 57–81 (2001)
Martinec, D., Pajdla, T.: Structure from many perspective images with occlusion. In: Proc. of European Conference on Computer Vision, pp. 355–369 (2002)
Morita, T., Kanade, T.: A sequential factorization method for recovering shape and motion from image streams. IEEE Trans. Pattern Anal. Mach. Intell.19(8), 858–867 (1997)
Poelman, C., Kanade, T.: A paraperspective factorization method for shape and motion recovery. IEEE Trans. Pattern Anal. Mach. Intell.19(3), 206–218 (1997)
Quan, L.: Self-calibration of an affine camera from multiple views. Int. J. Comput. Vis.19(1), 93–105 (1996)
Sturm, P.F., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Proc. of European Conference on Computer Vision, vol. 2, pp. 709–720 (1996)
Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: A factorization method. Int. J. Comput. Vis.9(2), 137–154 (1992)
Torresani, L., Hertzmann, A., Bregler, C.: Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors. IEEE Trans. Pattern Anal. Mach. Intell.30(5), 878–892 (2008)
Torresani, L., Yang, D.B., Alexander, E.J., Bregler, C.: Tracking and modeling non-rigid objects with rank constraints. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 493–500 (2001)
Vidal, R., Hartley, R.I.: Motion segmentation with missing data using powerfactorization and GPCA. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 310–316 (2004)
Wang, G.: A hybrid system for feature matching based on SIFT and epipolar constraints. Tech. Rep. Department of ECE, University of Windsor (2006)
Wang, G., Tsui, H.T., Wu, J.: Rotation constrained power factorization for structure from motion of nonrigid objects. Pattern Recogn. Lett.29(1), 72–80 (2008)
Wang, G., Wu, J.: Stratification approach for 3-D Euclidean reconstruction of nonrigid objects from uncalibrated image sequences. IEEE Trans. Syst. Man Cybern., Part B38(1), 90–101 (2008)
Xiao, J., Chai, J.X., Kanade, T.: A closed-form solution to non-rigid shape and motion recovery. In: Proc. of European Conference on Computer Vision, vol. 4, pp. 573–587 (2004)
Xiao, J., Kanade, T.: Non-rigid shape and motion recovery: Degenerate deformations. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 668–675 (2004)
Yao, J., Cham, W.: Feature matching and scene reconstruction from multiple widely separated views. Tech. Rep., Chinese University of Hong Kong (2005)
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Wang, G., Wu, Q.M.J. (2011). Rotation Constrained Power Factorization. In: Guide to Three Dimensional Structure and Motion Factorization. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-0-85729-046-5_7
Download citation
DOI: https://doi.org/10.1007/978-0-85729-046-5_7
Publisher Name: Springer, London
Print ISBN: 978-0-85729-045-8
Online ISBN: 978-0-85729-046-5
eBook Packages: Computer ScienceComputer Science (R0)