Abstract
In this paper, we present a facial expression recognition method using feature-adaptive motion energy analysis. Our method is simplicity-oriented and avoids complicated face model representations or computationally expensive algorithms to estimate facial motions. Instead, the proposed method uses a simplified action-based face model to reduce the computational complexity of the entire facial expression analysis and recognition process. Feature-adaptive motion energy analysis estimates facial motions in a cost-effective manner by assigning more computational complexity on selected discriminative facial features. Facial motion intensity and orientation evaluation are then performed accordingly. Both facial motion intensity and orientation evaluation are based on simple calculations by exploiting a few motion energy values in the difference image, or optimizing the characteristics of feature-adaptive facial feature regions. For facial expression classification, a computationally inexpensive decision tree is used since the information gain heuristics of ID3 decision tree forces the classification to be done with minimal Boolean comparisons. The feasibility of the proposed method is shown through the experimental results as the proposed method recognized every facial expression in the JAFFE database by up to 75% with very low computational complexity.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Chow, G., Li, X.: Toward a System for Automatic Facial Feature Detection. Proc. of Pattern Recognition 26, 1739–1755 (1993)
Donato, G., Bartlett, M., Hager, J., Ekman, P., Sejnowski, T.: Classifying facial actions. IEEE Transactions on PAMI 21, 974–989 (1999)
Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press Inc. (1978)
Ekman, P.: Facial Expression and Emotion. American Psychologists Col. 48(4), 384–392 (1993)
Essa, I., Pentland, A.: Coding, Analysis, Interpretation, Recognition of Facial Expressions. IEEE Transactions on PAMI 19, 757–763 (1999)
Fasel, B., Luttin, J.: Automatic facial expression analysis: Survey. Pattern Recognition 36, 269–275 (2003)
Gokturk, S., Bouguet, J., Tomasi, C., Girod, B.: Model-based face tracking for view-independent facial expression recognition. In: Proc. of IEEE Int. Conf. on FGR, IEEE Computer Society Press, Los Alamitos (2002)
Lienhart, R., Maydt, J.: An Extended Set of Harr-Like Features for Rapid Object Detection. Proc. of IEEE ICIP 1, 900–903 (2002)
Lin, C., Wu, L.: Automatic Facial Feature Extraction by Genetic Algorithms. Image Processing 8, 834–845 (1999)
Mitchell, T.: Decision Tree Learning. In: Machine Learning, pp. 52–81, ch. 3, McGraw-Hill, New York (1997)
Pantic, M., Rothkrantz, L.J.M.: Automatic Analysis of Facial Expressions: the State of the Art. IEEE Transactions on PAMI 22, 1424–1445 (2000)
Pantic, M., Rothkrantz, L.: Facial action recognition for facial expression analysis from static face images. IEEE Transactions on SMC-Part B: Cybernetics 34, 1449–1461 (2004)
Park, H., Park, J.: Analysis and Recognition of Facial Expression Based on Point-Wise Motion Energy. In: Proc. of ICIAR, pp. 700–708 (2004)
Shinohara, Y., Otsu, N.: Facial Expression Recognition Using Fisher Weight Maps. In: Proc. of IEEE Int. Conf. on FGR, IEEE Computer Society Press, Los Alamitos (2004)
Tian, Y., Kanade, T., Cohn, J.: Recognizing action units for facial expression analysis. IEEE Transactions on PAMI 23, 1–9 (2001)
Viola, P., Jones, M.: Rapid Object Detection Using a Boosted Cascade of Simple Features. Proc. of IEEE CVPR 1, 511–518 (2001)
Yepeng, G.: Automatic 3D Face Reconstruction based on Single 2D Image. In: Proc. of Multimedia and Ubiquitous Engineering (2007)
Zalewski, L., Gong, S.: Synthesis and recognition of facial expressions virtual 3d views. In: Proc. of IEEE Int. Conf. on FGR, IEEE Computer Society Press, Los Alamitos (2004)
Zhang, Y., Ji, Q.: Active dynamic information fusion for facial expression understanding from image sequences. IEEE Transactions on PAMI 27, 699–714 (2005)
DataFace, Available at: http://face-and-emotion.com/dataface/emotion/expression.jsp
ID3 algorith, Available at: http://www.cise.ufl.edu/~ddd/cap6635/Fall-97/Short-papers/2.htm
JAFFE database, Available at: http://www.kasrl.org/jaffe.html
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Noh, S., Park, H., Jin, Y., Park, JI. (2007). Feature-Adaptive Motion Energy Analysis for Facial Expression Recognition. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2007. Lecture Notes in Computer Science, vol 4841. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76858-6_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-76858-6_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76857-9
Online ISBN: 978-3-540-76858-6
eBook Packages: Computer ScienceComputer Science (R0)