Abstract
Recognition of a posed or fake smile is a vital and challenging research topic and a growing interest has been observed from the computer vision and machine learning community. The state-of-the-art algorithms related to this field focus on the facial expressions dynamics, while several psychologists suggest that the main difference between posed and spontaneous smile should be observed in different muscles contractions in the upper part of the face. Therefore, in this work we evaluate the accuracy of recognition based only on the face appearance using the High-Dimensional Local Binary Patterns. The smile authenticity is analyzed on the set of images extracted at the smile apex phase from the UvA-NEMO database. The obtained results indicate that the analyzed algorithms can spot a fake smile much better than a human, but worse than systems that incorporate the facial dynamics.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Calder, A.J., Young, A.W.: Understanding the recognition of facial identity and facial expression? Nat. Rev. Neurosci. 6, 641–651 (2005)
Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025–3032 (2013)
Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. Wavelets Multiresolut. Inf. Process. 02(02), 121–132 (2004)
Dibeklioglu, H., Salah, A., Gevers, T.: Recognition of genuine smiles. IEEE Trans. Multimedia 17(3), 279–294 (2015)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are you really smiling at me? Spontaneous versus posed enjoyment smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_38
Duchenne, G.B.: The mechanism of human facial expression or an electro-physiological analysis of the expression of emotions. Cambridge University Press (1990). Original work published 1862
Ekman, P., Davidson, R.J., Friesen, W.V.: The Duchenne smile: emotional expression and brain physiology: II. J. Person. Soc. Psychol. 58(2), 342–353 (1990)
Ekman, P., Friesen, W.: Facial Action Coding System: Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal Behav. 6(4), 238–252 (1982)
Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-PIE. Image Vis. Comput. 28(5), 807–813 (2010)
Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4295–4304 (2015)
Hoque, M.E., McDuff, D., Picard, R.: Exploring temporal patterns in classifying frustrated and delighted smiles (extended abstract). In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 505–511 (2015)
Kawulok, M., Nalepa, J., Nurzynska, K., Smolka, B.: In search of truth: analysis of smile intensity dynamics to detect deception. In: Montes-y-Gómez, M., Escalante, H.J., Segura, A., Murillo, J.D. (eds.) IBERAMIA 2016. LNCS, vol. 10022, pp. 325–337. Springer, Cham (2016). doi:10.1007/978-3-319-47955-2_27
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)
Li, H.D., Xu, Q.S., Liang, Y.Z.: Random frog: an efficient reversible jump Markov chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. Analytica Chimica Acta 740, 20–26 (2012)
Liu, H., Wu, P.: Comparison of methods for smile deceit detection by training AU6 and AU12 simultaneously. In: 2012 19th IEEE International Conference on Image Processing, pp. 1805–1808 (2012)
Martinez, B., Valstar, M.F.: Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok, M., Celebi, M.E., Smolka, B. (eds.) Advances in Face Detection and Facial Image Analysis, pp. 63–100. Springer, Cham (2016). doi:10.1007/978-3-319-25958-1_4
Mathias, M., Benenson, R., Pedersoli, M., Gool, L.: Face detection without bells and whistles. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 720–735. Springer, Cham (2014). doi:10.1007/978-3-319-10593-2_47
Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1 - Conference A: Computer Vision amp; Image Processing, vol. 1, pp. 582–585 (1994)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Porter, S., Korva, N., Baker, A.: Secrets of the human face: new insights into the face and covert emotions. Psychol. Aotearoa 3(2), 94–99 (2011)
Schmidt, K.L., Ambadar, Z., Cohn, J.F., Reed, L.I.: Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. J. Nonverbal Behav. 30(1), 37–52 (2006)
Suwa, M., Sugie, N., Fujimora, K.: A preliminary note on pattern recognition of human emotional expression. In: International Joint Conference on Pattern Recognition, pp. 408–410 (1978)
Tracy, J.L., Randles, D., Steckler, C.M.: The nonverbal communication of emotions. Curr. Opin. Behav. Sci. 3, 25–30 (2015)
Valstar, M.F., Pantic, M., Ambadar, Z., Cohn, J.F.: Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 162–170 (2006)
Weker, M.M.: Smile and lie? Why we are able to distinguish false smiles from genuine ones. In: Evers, D., Fuller, M., Runehov, A., Sæther, K.-W. (eds.) Issues in Science and Theology: Do Emotions Shape the World?. ISRPESSST, pp. 59–71. Springer, Cham (2016). doi:10.1007/978-3-319-26769-2_5
Wu, P., Liu, H., Zhang, X.: Spontaneous versus posed smile recognition using discriminative local spatial-temporal descriptors. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1240–1244 (2014)
Acknowledgment
This material is based on work supported by the Polish National Science Center (NCN) under the Grant: DEC-2012/07/B/ST6/0122. This work has received funding from statutory funds (BK/213/RAU1/2017) of the Institute of Automatic Control, Silesian University of Technology, Poland.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Radlak, K., Radlak, N., Smolka, B. (2018). Static Posed Versus Genuine Smile Recognition. In: Kurzynski, M., Wozniak, M., Burduk, R. (eds) Proceedings of the 10th International Conference on Computer Recognition Systems CORES 2017. CORES 2017. Advances in Intelligent Systems and Computing, vol 578. Springer, Cham. https://doi.org/10.1007/978-3-319-59162-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-319-59162-9_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59161-2
Online ISBN: 978-3-319-59162-9
eBook Packages: EngineeringEngineering (R0)