Advertisement

Multilinear Analysis of Image Ensembles: TensorFaces

  • M. Alex O. Vasilescu
  • Demetri Terzopoulos
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2350)

Abstract

Natural images are the composite consequence of multiple factors related to scene structure, illumination, and imaging. Multilinear algebra, the algebra of higher-order tensors, offers a potent mathematical framework for analyzing the multifactor structure of image ensembles and for addressing the difficult problem of disentangling the constituent factors or modes. Our multilinear modeling technique employs a tensor extension of the conventional matrix singular value decomposition (SVD), known as the N-mode SVD. As a concrete example, we consider the multilinear analysis of ensembles of facial images that combine several modes, including different facial geometries (people), expressions, head poses, and lighting conditions. Our resulting “TensorFaces” representation has several advantages over conventional eigenfaces. More generally, multilinear analysis shows promise as a unifying framework for a variety of computer vision problems.

Keywords

Singular Value Decomposition Independent Component Analysis Facial Image Independent Component Analysis Multilinear Algebra 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full conference paper text

References

  1. 1.
    P.N. Belhumeur, J. Hespanha, and D.J. Kriegman. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. In Proceedings of the European Conference on Computer Vision, pages 45–58, 1996.Google Scholar
  2. 2.
    R. Chellappa, C.L. Wilson, and S. Sirohey. Human and machine recognition of faces: A survey. Proceedings of the IEEE, 83(5):705–740, May 1995.Google Scholar
  3. 3.
    L. de Lathauwer. Signal Processing Based on Multilinear Algebra. PhD thesis, Katholieke Univ. Leuven, Belgium, 1997.Google Scholar
  4. 4.
    W. Freeman and J. Tenenbaum. Learing bilinear models for two-factor problems in vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 554–560, 1997.Google Scholar
  5. 5.
    A. Kapteyn, H. Neudecker, and T. Wansbeek. An approach to n-mode component analysis. Psychometrika, 51(2):269–275, June 1986.Google Scholar
  6. 6.
    T. G. Kolda. Orthogonal tensor decompositions. SIAM Journal on Matrix Analysis and Applications, 23(1):243–255, 2001.zbMATHCrossRefMathSciNetGoogle Scholar
  7. 7.
    J. B. Kruskal. Rank, decomposition, and uniqueness for 3-way and n-way array. In R. Coppi and S. Bolasco, editors, Multiway Data Analysis, pages 7–18, Amsterdam, 1989. North Holland.Google Scholar
  8. 8.
    J. R. Magnus and H. Neudecker. Matrix Differential Calculus with Applications in Statistics and Econometrics. John Wiley & Sons, New York, New York, 1988.zbMATHGoogle Scholar
  9. 9.
    D.H. Marimont and B.A. Wandell. Linear models of surface and illuminance spectra. J. Optical Society of America, A., 9:1905–1913, 1992.Google Scholar
  10. 10.
    Y. Moses, S. Edelman, and S. Ullman. Generalization to novel images in upright and inverted faces. Perception, 25:443–461, 1996.CrossRefGoogle Scholar
  11. 11.
    A. Pentland and B. Moghaddam. View-based and modular eigenspaces for face recognition. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1994.Google Scholar
  12. 12.
    A. Shashua and A. Levin. Linear image coding for regression and classification using the tensor-rank principle. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, page in press, Hawai, 2001.Google Scholar
  13. 13.
    L. Sirovich and M. Kirby. Low dimensional procedure for the characterization of human faces. Journal of the Optical Society of America A., 4:519–524, 1987.CrossRefGoogle Scholar
  14. 14.
    J.B. Tenenbaum and W.T. Freeman. Separating style and content. In M. Moser, M. Jordan, and T. Petsche, editors, Advances in Neural Information Processing Systems, pages 662–668. MIT Press, 1997.Google Scholar
  15. 15.
    M. E. Tipping and C. M. Bishop. Mixtures of probabilistic principal component analysers. Neural Computation, 11(2):443–482, 1999.CrossRefGoogle Scholar
  16. 16.
    L. R. Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31:279–311, 1966.CrossRefMathSciNetGoogle Scholar
  17. 17.
    M.A. Turk and A. P. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71–86, 1991.CrossRefGoogle Scholar
  18. 18.
    M.A.O. Vasilescu. An algorithm for extracting human motion signatures. In IEEE Conference on Computer Vision and Pattern Recognition, Hawai, 2001. in press.Google Scholar
  19. 19.
    M. A. O. Vasilescu. Human motion signatures for character animation. In ACM SIGGRAPH 2001 Conf. Abstracts and Applications, page 200, Los Angeles, August 2001.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • M. Alex O. Vasilescu
    • 1
    • 2
  • Demetri Terzopoulos
    • 1
    • 2
  1. 1.Courant InstituteNew York UniversityUSA
  2. 2.Department of Computer ScienceUniversity of TorontoCanada

Personalised recommendations

Cite paper