Abstract
Obtaining reliable and complete systems able to extract human emotional status from streaming videos is of paramount importance to Human Machine Interaction (HMI) applications. Side views, unnatural postures and context are challenges. This paper presents a semi-supervised fuzzy emotional classification system based on Russell’s circumplex model. This emotional inference system relies only on face related features codified with the Facial Action Coding System (FACS). These features are provided by a morphable 3D tracking system robust to posture, occlusion and illumination changes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Andreoni, G., Anisetti, M., Apolloni, B., Bellandi, V., Balzarotti, S., Beverina, F., Campadelli, P., Ciceri, M.R., Colombo, P., Fumagalli, F., Palmas, G., Piccini, L.: Emotional interfaces with ambient intelligence. In: Vasilakos, A., Pedrycz, W. (eds.) Ambient Intelligence, Wireless Networking and Ubiquitous Computing, ch. 7. Artech House, USA (2006)
Anisetti, M., Bellandi, V., Damiani, E., Beverina, F.: 3d espressive face model-based tracking algorithm. In: Signal Processing, Pattern Recognition, And Applications (SPPRA), Innsbruck (2006)
Anisetti, M., Bellandi, V., Beverina, F.: Face tracking algorithm robust to pose, illumination and face expression changes: a 3d parametric model approach. In: International Conference on Computer Vision Theory and Applications, Setubal, Portugal (2006)
Ekman, P., Friesen, W.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press (1978)
Damiani, E., Anisetti, M., Bellandi, V., Beverina, F., Ciceri, M.R., Balzarotti, S.: Psychology-aware video-enabled workplace. In: 3rd International Conference on Ubiquitous Intelligence and Computing, Whuan and Three Georges, China (2006)
Russell, J., Mehrabian, A.: Evidence for a three-factor theory of emotions, vol. 11, pp. 273–294 (1977)
Russell, J.: Core affect and the psychological construction of emotion. Psychological Review 110, 145–172 (2003)
Kanade, T., Cohn, J., Tian, Y.: Comprehensive database for facial expression analysis. In: Proc. 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), Grenoble, France, pp. 46–53 (2000)
Pantic, M., Valstar, M., Rademaker, R., Maat, L.: Web-based database for facial expression analysis. In: Proc. IEEE Int’l Conf. Multimedia and Expo. (ICME 2005), Amsterdam, The Netherlands (2005)
Hammal, Z., Caplier, A., Rombaut, M.: A fusion process based on belief theory for classification of facial basic emotions. In: Proc. Fusion 2005 the 8th International Conference on Information fusion (ISIF 2005) (2005)
Scherer, K.: “J”. In: Strongman, K. (ed.) International reviews of studies of emotion, vol. 2 (1992)
Frijda, N.: The place of appraisal in emotion. In: Cognition and Emotion, pp. 357–387 (1993)
Essa, I., Darrell, T., Pentland, A.: Tracking facial motion (1994)
Abboud, B., Davoine, F., Dang, M.: Expressive face recognition and synthesis (2003)
Mase, K.: Recognition of facial expression from optical flow. IEICE Transaction E74, 3474–3483 (1991)
Lien, J.: Automatic recognition of facial expressions using hidden markov models and estimation of expression. Ph.D. dissertation, Carnegie Mellon University (1998)
li Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)
Grammer, K., Tessarek, A., Hofer, G.: From emoticons to avatars: simulation of facial expression. In: Proc. European Science Foundation Workshop on emotions and new media
Ricci, G.P., Bitti, P.E., Caterina, R.: Different behavioural markers in different smiles. In: Proceedings of the IXth Conferences of the International Society for Research on emotion, Isre, Toronto (1996)
Oster, D.H., Nagel, L.: Adult judgment and finegrained analysis of inant facil expressions: Testing the validity of a priori coding formulas. In: Developmental Psychology (1992)
Knez, Hygge: The circumplex structure of affect: A swedish version. Scandinavian Journal of Psychology 42(5) (December 2001)
Davidson, R.J.: Anterior cerebral asymmetry and the nature of emotion. Brain and Cognition (1992)
Bensaid, A.M., Hall, I.L.O., Bezdek, J.C., Clarke, L.P.: Partially supervised custering for image segmentation. Pattern Recognition 29(5), 859–871 (1996)
Pedrycz, W.: Shadowed sets: representing and processing fuzzy sets. IEEE Transactions on Systems, Man and Cybernetics, Part B 28, 103–109
Bellandi, V., Anisetti, M., Beverina, F.: Upper-face expression features extraction system for video sequences. In: Proc. of International Conference on Visualization, Imaging, and Image Processing (VIIP 2005), September 2005, pp. 83–88 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Anisetti, M., Bellandi, V. (2009). Emotional State Inference Using Face Related Features. In: Damiani, E., Jeong, J., Howlett, R.J., Jain, L.C. (eds) New Directions in Intelligent Interactive Multimedia Systems and Services - 2. Studies in Computational Intelligence, vol 226. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02937-0_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-02937-0_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02936-3
Online ISBN: 978-3-642-02937-0
eBook Packages: EngineeringEngineering (R0)