Abstract
Facial Expression Recognition is one of the most active areas of research in computer vision. However, existing approaches lack generalizability and almost all studies ignore the effects of facial attributes, such as age, on expression recognition even though research indicates that facial expression manifestation varies with ages. Recently, a lot of progress has been made in this topic and great improvements in classification task were achieved with the emergence of Deep Learning methods. Such approaches allow to avoid classical hand designed feature extraction methods that generally rely on manual operations with labelled data. In the present work a deep learning approach that utilizes Convolutional Neural Networks (CNNs) to automatically extract features from facial images is evaluated on a benchmark dataset (FACES), the only one present in literature that contains also labelled facial expressions performed by ageing adults. As baselines, with the aim of making a comparison, two traditional machine learning approaches using handcrafted features are evaluated on the same dataset. Our experiments show that the CNN-based approach is very effective in expression recognition performed by ageing adults, significantly improving the baseline approaches, at least with a 8% margin.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Kudlur M et al (2016) Tensor-flow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX symposium on operating systems design and implementation (OSDI), Savannah, Georgia, USA
Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, pp 177–186. Physica Verlag HD
Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models-their training and application. Comput Vis Image Underst 61(1):38–59
Ebner NC, Riediger M, Lindenberger U (2010) FACES—a database of facial expressions in young, middle-aged, and older women and men: development and validation. Behav Res Methods 42(1):351–362
Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recogn 36(1):259–275
Goodfellow IJ, Erhan D, Carrier PL, Courville A, Mirza M, Hamner B, Zhou Y et al (2013) Challenges in representation learning: a report on three machine learning contests. In: International conference on neural information processing, pp 117–124. Springer, Berlin, Heidelberg
Guo G, Guo R, Li X (2013) Facial expression recognition influenced by human aging. IEEE Trans Affect Comput 4(3):291–298
Kahou SE, Pal C, Bouthillier X, Froumenty P, Gülçehre Ç, Memisevic R, Mirza M et al (2013) Combining modality specific deep neural networks for emotion recognition in video. In: Proceedings of the 15th ACM on international conference on multimodal interaction, pp 543–550. ACM
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324
Liu M, Wang R, Li S, Shan S, Huang Z, Chen, X (2014) Combining multiple kernel methods on riemannian manifold for emotion recognition in the wild. In: Proceedings of the 16th international conference on multimodal interaction, pp 494–501. ACM
Lowe DG (1999) Object recognition from local scale-invariant features. In: The proceedings of the seventh IEEE international conference on computer vision, 1999, vol 2, pp 1150–1157. IEEE
Milborrow S, Nicolls F (2014) Active shape models with SIFT descriptors and MARS. In: Proceedings of the 9th international conference on computer vision theory and applications, Lisbon, Portugal, 5–8 Jan 2014
Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814
Pantic M, Rothkrantz LJM (2000) Automatic analysis of facial expressions: the state of the art. IEEE Trans Pattern Anal Mach Intell 22(12):1424–1445
Shan C, Gong S, McOwan PW (2009) Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis Comput 27(6):803–816
United Nations Programme on Ageing, The Ageing of the World’s Population, Dec 2013. http://www.un.org/en/development/desa/population/publications/pdf/ageing/WorldPopulationAgeing2013.pdf. Accessed April 2018
Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154
Wang S, Wu S, Gao Z, Ji Q (2016) Facial expression recognition through modeling age-related spatial patterns. Multimed Tools Appl 75(7):3937–3954
Zeng Z, Pantic M, Roisman GI, Huang TS (2009) A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31(1):39–58
Zuiderveld K (1994) Contrast limited adaptive histogram equalization. Graph Gems 474–485
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Caroppo, A., Leone, A., Siciliano, P. (2019). Facial Expression Recognition in Ageing Adults: A Comparative Study. In: Leone, A., Caroppo, A., Rescio, G., Diraco, G., Siciliano, P. (eds) Ambient Assisted Living. ForItAAL 2018. Lecture Notes in Electrical Engineering, vol 544. Springer, Cham. https://doi.org/10.1007/978-3-030-05921-7_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-05921-7_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05920-0
Online ISBN: 978-3-030-05921-7
eBook Packages: EngineeringEngineering (R0)