Abstract
This paper presents a new approach method to recognize facial expressions in various internal states using manifold learning (ML). The manifold learning of facial expressions reflects the local features of facial deformations such as concavities and protrusions. We developed a representation of facial expression images based on manifold learning for feature extraction of facial expressions. First, we propose a zero-phase whitening step for illumination-invariant images. Second, facial expression representation from locally linear embedding (LLE) was developed. Finally, classification of facial expressions in emotion dimensions was generated on two dimensional structure of emotion with pleasure/displeasure dimension and arousal/sleep dimension. The proposed system maps facial expressions in various internal states into the embedding space described by LLE. We explore locally linear embedding space as a facial expression space in continuous dimension of emotion.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Russell, J.A.: Evidence of convergent validity on the dimension of affect. Journal of Personality and Social Psychology 30, 1152–1168 (1978)
Peter, J.L.: The emotion probe: Studies of motivation and attention. American Psychologist 50(5), 372–385 (1995)
Donato, G., Bartlett, M., Hager, J., Ekman, P., Sejnowski, T.: Classifying facial actions. IEEE PAMI 21(10), 974–989 (1999)
Schmidt, K., Cohn, J.: Dynamics of facial expression:Normative characteristics and individual difference. In: Intl. Conf. On Multimedia and Expo (2001)
Pantic, M., Rothkrantz, L.J.M.: Towards an Affect-Sensitive Multimodal Human Computer Interaction. Proc. Of IEEE 91, 1370–1390 (2003)
Shin, Y.-s., Ahn, Y.J.: Facial expression recognition based on two dimensions without neutral expressions. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) ICEC 2005. LNCS, vol. 3711, pp. 215–222. Springer, Heidelberg (2005)
Bartlett, M.: Face Image analysis by unsupervised learning. Kluwer Academic Publishers, Dordrecht (2001)
Seung, H.S., Lee, D.D.: The manifold ways of perception. Science 290, 2268–2269 (2000)
Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Bahn, S., Han, J., Chung, C.: Facial expression database for mapping facial expression onto internal state. In: ’97 Emotion Conference of Korea, pp. 215–219 (1997)
Osgood, C.E., May, W.H., Miron, M.S.: Cross-curtral universals of affective meaning. University of Illinoise Press, Urbana (1975)
Russell, J.A., Lewicka, M., Nitt, T.: A cross-cultural study of a circumplex model of affect. Journal of Personality and Social Psychology 57, 848–856 (1989)
Kim, Y., Kim, J., Park, S., Oh, K., Chung, C.: The study of dimension of internal states through word analysis about emotion. Korean Journal of the Science of Emotion and Sensibility 1, 145–152 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Shin, Ys. (2007). Facial Expression Recognition Based on Emotion Dimensions on Manifold Learning. In: Shi, Y., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds) Computational Science – ICCS 2007. ICCS 2007. Lecture Notes in Computer Science, vol 4488. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72586-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-72586-2_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72585-5
Online ISBN: 978-3-540-72586-2
eBook Packages: Computer ScienceComputer Science (R0)