Abstract
This paper explores the emotion recognition techniques in children and adults and identifies the differentiating features. There is decent literature reported on facial emotion recognition (FER) in adults but limited focus on children. We propose the use of a light-weight model incorporating a geometric-based approach known as facial landmarks combined with a simple Deep Neural Network (DNN) architecture. The findings from this research led to a detailed analysis to determine the most expressive features on the human face, the features sufficient or necessary for FER, and how this set of necessary features varies in children and adults. Furthermore, this paper aims to establish an estimate of the optimal number of facial landmark points that are sufficient to obtain appreciable results for emotion classification. Child Affective Facial Expression (CAFE) dataset and the Extended Cohn–Kanade (CK+) dataset have been used in this work.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Fridlund, A.J.: Human Facial Expression: An Evolutionary View. Academic Press, San Diego, CA, USA (1994)
Niedenthal, P.M., Brauer, M.: Social functionality of human emotion. Annu. Rev. Psychol. 63, 259–285 (2012). https://doi.org/10.1146/annurev.psych.121208.131605
Khan, F.: Facial expression recognition using facial landmark detection and feature extraction on neural networks. arXiv:1812.04510v2 [cs.CV] (2018)
Tarnowski, P., Kolodziej, M., Majkowski, A., Rak, R.J.: Emotion recognition using facial expressions. In: International Conference on Computational Science, ICCS 2017, Zurich, Switzerland, 12–14 June 2017 (2017)
Chang, F.-J., Tran, A.T., Hassner, T., Masi, I., Nevatia, R., Medioni, G.G.: ExpNet: landmark-free, deep, 3D facial expressions. In: 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 122–129 (2018)
Mahpod, S., Das, R., Maiorana, E., Keller, Y., Campisi, P.: Facial landmark point localization using coarse-to-fine deep recurrent neural network. arXiv:1805.01760 (2018)
Ko, B.C.: A brief review of facial emotion recognition based on visual information. Sensors 18(2) (2018)
Bebawy, M., Anwar, S., Milanova, M.: Active Shape Model vs. Deep Learning for Facial Emotion Recognition in Security, pp. 1–11. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59259-6
Wegrzyn, M., Vogt, M., Kireclioglu, B., Schneider, J., Kissler, J.: Mapping the emotional face. How individual face parts contribute to successful emotion recognition. PLoS ONE 12(5), e0177239 (2017). https://doi.org/10.1371/journal.pone.0177239
Zeng, X., Wu, Q., Zhang, S., Liu, Z., Zhou, Q., Zhang, M.: A false trail to follow: differential effects of the facial feedback signals from the upper and lower face on the recognition of micro-expressions. Front. Psychol. 9, 2015 (2018). https://doi.org/10.3389/fpsyg.2018.02015
Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: database and results. Image Vision Comput. 47, 3–18 (2016)
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: A semi-automatic methodology for facial landmark annotation. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR-W), 5th Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2013), Oregon, USA, June (2013)
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: the first facial landmark localization challenge. In: Proceedings of IEEE International Conference on Computer Vision (ICCV-W), 300 Faces in-the-Wild Challenge (300-W), Sydney, Australia, December (2013)
LoBue, V., Thrasher, C.: The Child Affective Facial Expression (CAFE) set. Databrary. Retrieved 7 Oct 2019 from: https://doi.org/10.17910/B7301K (2019)
Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG00), Grenoble, France, pp. 46–53 (2000)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete expression dataset for action unit and emotion-specified expression. In: Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB 2010), San Francisco, USA, pp. 94–101 (2010)
https://www.pyimagesearch.com/2017/04/03/facial-landmarks-dlib-opencv-python
Xu, B., Wang, N., Chen, T., Li, M.: Empirical evaluation of rectified activations in convolution network. https://arxiv.org/pdf/1505.00853.pdf
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Rao, A., Ajri, S., Guragol, A., Suresh, R., Tripathi, S. (2020). Emotion Recognition from Facial Expressions in Children and Adults Using Deep Neural Network. In: Thampi, S., et al. Intelligent Systems, Technologies and Applications. Advances in Intelligent Systems and Computing, vol 1148. Springer, Singapore. https://doi.org/10.1007/978-981-15-3914-5_4
Download citation
DOI: https://doi.org/10.1007/978-981-15-3914-5_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-3913-8
Online ISBN: 978-981-15-3914-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)