Abstract
The problem of 3D reconstruction of nonrigid objects from uncalibrated image sequences is addressed in the paper. Our method assumes that the nonrigid object is composed of rigid part and deformation part. We first recover the affine structure of the object and separate the rigid features from the deformation ones. Then stratify the structure from affine to Euclidean space by virtue of the rigid features. The novelty of the paper lies in two aspects. First, we propose a deformation weight constraint to the problem and prove that the recovered shape bases and shapes are transformation invariant under this constraint. Second, we propose a constrained power factorization (CPF) algorithm to recover the deformation structure in affine space. The algorithm overcomes the limitations of previous SVD-based methods and can work with missing data in the tracking matrix. Extensive experiments on synthetic data and real sequences validate the proposed method and show improvements over existing solutions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bascle, B., Blake, A.: Separability of pose and expression in facial tracing and animation. In: Proc. of ICCV, pp. 323–328 (1998)
Brand, M.: Morphable 3D models from video. In: Proc. of CVPR, vol. 2, pp. 456–463 (2001)
Brand, M.: A direct method for 3D factorization of nonrigid motion observed in 2D. In: Proc. of CVPR, vol. 2, pp. 122–128 (2005)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: Proc. of CVPR, vol. 2, pp. 690–696 (2000)
Christy, S., Horaud, R.: Euclidean shape and motion from multiple perspective views by affine iterations. IEEE T-PAMI 18(11), 1098–1104 (1996)
Costeira, J., Kanade, T.: A multibody factorization method for independently moving objects. Intern. J. Comput. Vis. 29(3), 159–179 (1998)
Del Bue, A., Lladó, X., de Agapito, L.: Non-rigid face modelling using shape priors. In: Proc. of AMFG, pp. 97–108 (2005)
Del Bue, A., Lladó, X., de Agapito, L.: Non-rigid metric shape and motion recovery from uncalibrated images using priors. In: Proc. of CVPR, pp. 1191–1198 (2006)
Hartley, R., Schaffalizky, F.: Powerfactorization: 3D reconstruction with missing or uncertain data. In: Proc. of Australia-Japan Advanced Workshop on Computer Vision (2003)
Heyden, A., Berthilsson, R., Sparr, G.: An iterative factorization method for projective structure and motion from image sequences. Image Vision Comput. 17(13), 981–991 (1999)
Morita, T., Kanade, T.: A sequential factorization method for recovering shape and motion from image streams. IEEE T-PAMI 19(8), 858–867 (1997)
Poelman, C., Kanade, T.: A paraperspective factorization method for shape and motion recovery. IEEE T-PAMI 19(3), 206–218 (1997)
Quan, L.: Self-calibration of an affine camera from multiple views. Intern. J. Comput. Vis. 19(1), 93–105 (1996)
Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Intern. J. Comput. Vis. 9(2), 137–154 (1992)
Torresani, L., Yang, D.B., Alexander, E.J., Bregler, C.: Tracking and modeling non-rigid objects with rank constraints. In: Proc. of CVPR, pp. 493–500 (2001)
Triggs, B.: Factorization methods for projective structure and motion. In: Proc. of CVPR, pp. 845–851 (1996)
Vidal, R., Hartley, R.: Motion segmentation with missing data using powerfactorization and gpca. In: Proc. of CVPR, vol. 2, pp. 310–316 (2004)
Wang, G.H., Tsui, H.T., Hu, Z.Y.: Structure and motion of nonrigid object under perspective projection. Pattern Recognition Letters 28(4), 507–515 (2007)
Wang, G.H., Wu, J.: Deformation detection and 3D Euclidean reconstruction of nonrigid objects from uncalibrated image sequences. Technical Report of the University of Windsor (November 2006)
Xiao, J., Chai, J.X., Kanade, T.: A closed-form solution to non-rigid shape and motion recovery. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 573–587. Springer, Heidelberg (2004)
Xiao, J., Kanade, T.: Uncalibrated perspective reconstruction of deformable structures. In: Proc. of ICCV, vol. 2, pp. 1075–1082 (2005)
Yao, J., Cham, W.: Feature matching and scene reconstruction from multiple widely separated views. Technical Report of Department of Electronic Engineering, The Chinese University of Hong Kong (August 2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, G., Wu, Q.M.J. (2007). Deformation Weight Constraint and 3D Reconstruction of Nonrigid Objects. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2007. Lecture Notes in Computer Science, vol 4633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74260-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-74260-9_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74258-6
Online ISBN: 978-3-540-74260-9
eBook Packages: Computer ScienceComputer Science (R0)