Abstract
We present a new framework to represent and analyze dynamic facial motions using a decomposable generative model. In this paper, we consider facial expressions which lie on a one dimensional closed manifold, i.e., start from some configuration and coming back to the same configuration, while there are other sources of variability such as different classes of expression, and different people, etc., all of which are needed to be parameterized. The learned model supports tasks such as facial expression recognition, person identification, and synthesis. We aim to learn a generative model that can generate different dynamic facial appearances for different people and for different expressions. Given a single image or a sequence of images, we can use the model to solve for the temporal embedding, expression type and person identification parameters. As a result we can directly infer intensity of facial expression, expression type, and person identity from the visual input. The model can successfully be used to recognize expressions performed by different people never seen during training. We show experiment results for applying the framework for simultaneous face and facial expression recognition.
Sub-categories: 1.1 Novel algorithms, 1.6 Others: modeling facial expression.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science 16(5), 403–410 (2005)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Expression-invariant 3d face recognition. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 62–70. Springer, Heidelberg (2003)
Chang, Y., Hu, C., Turk, M.: Probabilistic expression analysis on manifolds. In: Proc. of CVPR, pp. 520–527 (2004)
Chuang, E.S., Deshpande, H., Bregler, C.: Facial expression space learning. In: Pacific Conference on Computer Graphics and Applications, pp. 68–76 (2002)
Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: Temporal and static modeling. In: CVIU, pp. 160–187 (2003)
Elgammal, A.: Nonlinear manifold learning for dynamic shape and dynamic appearance. In: Workshop Proc. of GMBV (2004)
Elgammal, A., Lee, C.-S.: Separating style and content on a nonlinear manifold. In: Proc. of CVPR, vol. 1, pp. 478–485 (2004)
Jain, A.K., Li, S.Z. (eds.): Handbook of Face Recognition. In: Face Expression Analysis, ch 11. Springer, Heidelberg (2005)
Kanade, T., Tian, Y., Cohn, J.F.: Comprehensive database for facial expression analysis. In: Proc. of FGR, pp. 46–53 (2000)
Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic interpretation and coding of face images using flexible models. IEEE Trans. PAMI 19(7), 743–756 (1997)
Lathauwer, L.D., de Moor, B., Vandewalle, J.: A multilinear singular value decomposiiton. SIAM Journal on Matrix Analysis and Applications 21(4), 1253–1278 (2000)
Lathauwer, L.D., de Moor, B., Vandewalle, J.: On the best rank-1 and rank-(r1, r2,..., rn) approximation of higher-order tensors. SIAM Journal on Matrix Analysis and Applications 21(4), 1324–1342 (2000)
li Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Trans. PAMI, 23(2) (2001)
Liu, X., Chen, T., Kumar, B.V.: Face authentication for multiple subjects using eigenflow. Pattern Recognitioin 36, 313–328 (2003)
Martinez, A.M.: Recognizing expression variant faces from a single sample image per class. In: Proc. of CVPR, pp. 353–358 (2003)
Poggio, T., Girosi, F.: Networks for approximation and learning. Proceedings of the IEEE 78(9), 1481–1497 (1990)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
Schölkopf, B., Smola, A.: Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge (2002)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Tenenbaum, J.B., Freeman, W.T.: Separating style and content with biliear models. Neural Computation 12, 1247–1283 (2000)
Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)
Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: Tensorfaces. In: 7th European Conference on Computer Vision, pp. 447–460 (2002)
Wang, H., Ahuja, N.: Facial expression decomposition. In: Proc. of ICCV, vol. 2, pp. 958–965 (2003)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, CS., Elgammal, A. (2005). Facial Expression Analysis Using Nonlinear Decomposable Generative Models. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_3
Download citation
DOI: https://doi.org/10.1007/11564386_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29229-6
Online ISBN: 978-3-540-32074-6
eBook Packages: Computer ScienceComputer Science (R0)