Emotion Recognition System by Gesture Analysis Using Fuzzy Sets
Gestures have been called the leaky source of emotional information. Also gestures are easy to retrieve from a distance by ordinary cameras. Thus as many would agree gestures become an important clue to the emotional state of a person. In this paper we have worked on recognizing emotions of a person by analyzing only gestural information. Subjects are initially trained to perform emotionally expressive gestures by a professional actor. The same actor trained the system to recognize the emotional context of gestures. Finally the gestural performances of the subjects are evaluated by the system to identify the class of emotion indicated. Our system yields an accuracy of 94.4% with a training set of only one gesture per emotion. Apart from this our system is also computationally efficient. Our work analyses emotions from only gestures, which is a significant step towards reducing the cost efficiency of emotion recognition. It may be noted here that this system may also be used for the purpose of general gesture recognition. We have proposed new features and a new classifying approach using fuzzy sets. We have achieved state of art accuracy with minimal complexity as each motion trajectory along each axis generates only 4 displacement features. Each axis generates a trajectory and only 6 joint trajectories among all joint trajectories are compared. The 6 motion trajectories are selected based on maximum motion, as maximum moving regions give more information on gestures. The experiments have been performed on data obtained from Microsoft Kinect sensors. Training and Testing were subject gender independent.
KeywordsType-1 Fuzzy Sets Gesture Recognition One-shot Learning Emotion Recognition
Unable to display preview. Download preview PDF.
- 9.Sarkar, N., Smith, C.A.: A novel interface system for seamlessly integrating human-robot cooperative activities in space. Technical Report, NASA Institute for Advanced Concepts (2002)Google Scholar
- 10.Jiang, M., Wang, Z.: A method for stress detection based on FCM algorithm. In: 2nd International Congress on Image and Signal Processing, CISP 2009, pp. 1–5. IEEE (2009)Google Scholar
- 12.Bailador, G., Guadarrama, S.: Robust gesture recognition using a prediction-error-classification approach. In: IEEE International Fuzzy Systems Conference, 2007 (FUZZ-IEEE 2007), pp. 1–7. IEEE (2007)Google Scholar
- 13.de Santos Sierra, A., Sánchez Ávila, C., Casanova, J.G., del Pozo, G.B.: A stress-detection system based on physiological signals and fuzzy logic. IEEE Transactions on Industrial Electronics, 58(10), 4857-4865 (2011)Google Scholar
- 21.Gunes, H., Shan, C., Chen, S., Tian, Y.: Bodily Expression for Automatic Affect Recognition. Advances in Emotion Recognition. Wiley-BlackwellGoogle Scholar