Abstract
This paper is engaged in the holistic spatial analysis on facial expression images. We present a systematic comparison of machine learning methods applied to the problem of automatic facial expression recognition, including supervised and unsupervised subspace analysis, SVM classifier and their nonlinear versions. Image-based holistic spatial analysis is more adaptive to recognition task in that it automatically learns the inner structure of training samples and extracts the most pertinent features for classification. Nonlinear analysis methods which could extract higher order dependencies among input patterns are supposed to promote the performance of classification. Surprisingly, the linear classifiers outperformed their nonlinear versions in our experiments. We proposed a new feature selection method named the Weighted Saliency Maps(WSM). Compared to other feature selection schemes such as Adaboost and PCA, WSM has the advantage of being simple, fast and flexible.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bartlett, M.S.: Face Image Analysis by Unsupervised Learning. Kluwer Academic Publishers, Boston (2001)
Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face Recognition by Independent Component Analysis. IEEE Transaction on Neural Networks 13, 1450–1460 (2002)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Transaction on Pattern Analysis and Machine Intelligence 19, 711–720 (1997)
Dailey, M.N., Cottrell, G.W.: PCA = Gabor for Expression Recognition. UCSD Computer Science and Engineering Technical Report CS-629, October 26 (1999)
Donato, G., Bartlett, M.S., et al.: Classifying Facial Actions. IEEE Transaction on Pattern Analysis and Machine Intelligence 21, 974–989 (1999)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2000)
Fasel, B., Luettin, J.: Automatic Facial Expression Analysis: A Survey. Pattern Recognition 36, 259–275 (2003)
Littlewort, G., Bartlett, M.S., Fasel, I., Susskind, J., Movellan, J.: Dynamics of Facial Expression Extracted Automatically from Video. In: IEEE Conference on Computer Vision and Pattern Recognition. Workshop on Face Processing in Video (2004)
Lyons, M.J., Budynek, J., Akamatsu, S.: Automatic Classification of Single Facial Images. IEEE Transaction on Pattern Analysis and Machine Intelligence 21, 1357–1362 (1999)
Scholkopf, B., Smola, A., Muller, K.R.: Nonlinear Component Analysis as A Kernel Eigenvalue Problem. Neural Computation 10, 1299–1319 (1998)
Chang, Y., Hu, C., Turk, M.: Probabilistic Expression Analysis on Manifolds. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 520–527 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ma, R., Wang, J. (2005). Automatic Facial Expression Recognition Using Linear and Nonlinear Holistic Spatial Analysis. In: Tao, J., Tan, T., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol 3784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573548_19
Download citation
DOI: https://doi.org/10.1007/11573548_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29621-8
Online ISBN: 978-3-540-32273-3
eBook Packages: Computer ScienceComputer Science (R0)