Abstract
Towards building new, friendlier human-computer interaction and multimedia interactive services systems, new computer techniques are applied which aim at revealing information about the affective state, cognitive activity, personality, intention and psychological state of a person. In this paper we conduct a survey on systems which attempt to recognize human emotion from body movements and/or hand/arm gestures. Our survey shows that, although there are a lot of researches on human tracking, human motion analysis and gesture analysis, there are not many researches regarding emotion recognition from body movements and gestures. Moreover, there is a lack of databases depicting human movements and/or hand gestures in different states of emotions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gavrila, D.M.: The visual analysis of human movement: a survey. Computer Vision and Image Understanding 73, 82–98 (1999)
Bianchi-Berthouze, N., Kleinsmith, A.: A categorical approach to affective gesture recognition. Connection Science 15, 259–269 (2003)
Bernhardt, D., Robinson, P.: Detecting emotions from everyday body movements. In: Presenccia PhD Symposium, Barcelona, Spain (2007)
Camurri, A., Lagerlof, I., Volpe, G.: Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies 59, 213–225 (2003); Applications of Affective Computing in Human-Computer Interaction
Camurri, A., Mazzarino, B., Ricchetti, M., Timmers, R., Volpe, G.: Multimodal analysis of expressive gesture in music and dance performances. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 20–39. Springer, Heidelberg (2004)
Castellano, G., Villalba, S.D., Camurri, A.: Recognising human emotions from body movement and gesture dynamics. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 71–82. Springer, Heidelberg (2007)
Burgoon, J.K., Meservy, L.J.M., Kruse, T.O., Nunamaker, J., Augmenting, J.F.: human identification of emotional states in video. In: Proceedings of the International Conference on Intelligent Data Analysis (2005)
Kapur, A., Kapur, A., Virji-Babul, N., Tzanetakis, G., Driessen, P.F.: Gesture-based affective computing on motion capture data. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 1–7. Springer, Heidelberg (2005)
Murre, J.M.J., Phaf, R.H., Wolters, G.: Original contribution: Calm: Categorizing and learning module. Neural Netw 5, 55–82 (1992)
Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, 51–61 (2001)
Camurri, A., Coletta, P., Massari, A., Mazzarino, B., Peri, M., Ricchetti, M., Ricci, A.G.: Toward real-time multimodal processing: Eyesweb 4.0. In: AISB 2004 Convention: Motion, Emotion and Cognition (2004)
Lu, S., Tsechpenakis, G., Metaxas, D.N.: Blob analysis of the head and hands: A method for deception detection. In: Hawaii International Conference on System Sciences and Emotional State Identification, Big Island (2005)
Balomenos, T., Raouzaiou, A., Ioannou, S., Drosopoulos, A., Karpouzis, K., Kollias, S.D.: Emotion Analysis in Man-Machine Interaction Systems. In: Bengio, S., Bourlard, H. (eds.) MLMI 2004. LNCS, vol. 3361, pp. 318–328. Springer, Heidelberg (2005)
Gunes, H., Piccardi, M.: Bi-modal emotion recognition from expressive face and body gestures. J. Netw. Comput. Appl. 30, 1334–1345 (2007)
Gunes, H., Piccardi, M.: A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior. In: ICPR 2006: Proceedings of the 18th International Conference on Pattern Recognition, pp. 1148–1153. IEEE Computer Society, Washington, DC, USA (2006)
el Kaliouby, R., Robinson, P.: Generalization of a vision-based computational model of mind-reading. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 582–589. Springer, Heidelberg (2005)
Baron-Cohen, S., Golan, O., Wheelwright, S., Hill, J.J.: Mind Reading: The Interactive Guide to Emotions. Jessica Kingsley Publishers, London (2004)
De Meijer, M.: The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behaviour 13, 247–268 (1989)
Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28, 879–896 (1998)
Shaarani, A., Romano, D.: Basic emotions from body movements. In: Proc of CCID 2006:The First International Symposium on Culture, Creativity and Interaction Design. HCI 2006 Workshops, The 20th BCS HCI Group Conference. University of London, Queen Mary (2006)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stathopoulou, IO., Tsihrintzis, G.A. (2011). Emotion Recognition from Body Movements and Gestures. In: Tsihrintzis, G.A., Virvou, M., Jain, L.C., Howlett, R.J. (eds) Intelligent Interactive Multimedia Systems and Services. Smart Innovation, Systems and Technologies, vol 11. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22158-3_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-22158-3_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22157-6
Online ISBN: 978-3-642-22158-3
eBook Packages: EngineeringEngineering (R0)