Abstract
Facial dynamics contain idiosyncratic information that can help appearance-based systems in a number of tasks. This paper summarizes our research on using facial dynamics as a soft biometric, in establishing the age and kinship similarity, as well as for assessing expression spontaneity. Our findings suggest that high-resolution and high-frequency information gathered from the face can be very informative, and result in systems that go beyond human performance in a number of domains.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jain, A.K., Dass, S.C., Nandakumar, K.: Soft Biometric Traits for Personal Recognition Systems. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004. LNCS, vol. 3072, pp. 731–738. Springer, Heidelberg (2004)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. CVPR 1, 511–518 (2001)
Li, J., Zhang, Y.: Learning surf cascade for fast and accurate object detection. In: CVPR, pp. 3468–3475 (2013)
Mathias, M., Benenson, R., Pedersoli, M., Van Gool, L.: Face Detection without Bells and Whistles. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part IV. LNCS, vol. 8692, pp. 720–735. Springer, Heidelberg (2014)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: A statistical method for 2-d facial landmarking. IEEE Trans. on Image Processing 21, 844–858 (2012)
Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. on PAMI 23, 681–685 (2001)
Cristinacce, D., Cootes, T.: Automatic feature localisation with constrained local models. Pattern Recognition 41, 3054–3067 (2008)
Milborrow, S., Nicolls, F.: Locating Facial Features with an Extended Active Shape Model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)
Xiong, X., De la Torre, F.: Supervised descent method and its applications to face alignment. In: CVPR, pp. 532–539 (2013)
Black, M.J., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: ICCV, pp. 374–381 (1995)
Bourel, F., Chibelushi, C.C., Low, A.A.: Robust facial feature tracking. In: Proc. 11th British Machine Vision Conference (2000)
Tao, H., Huang, T.: Explanation-based facial motion tracking using a piecewise Bezier volume deformation model. CVPR 1, 611–617 (1999)
Patras, I., Pantic, M.: Particle filtering with factorized likelihoods for tracking facial features. In: IEEE AFGR, pp. 97–102 (2004)
Pantic, M., Patras, I.: Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans. on Systems, Man, and Cybernetics, Part B. Cybernetics 36, 433–449 (2006)
Valstar, M.F., Pantic, M.: Fully automatic recognition of the temporal phases of facial actions. IEEE Trans. on Systems, Man, and Cybernetics, Part B. Cybernetics 42, 28–43 (2012)
Yang, S., An, L., Bhanu, B., Thakoor, N.: Improving action units recognition using dense flow-based face registration in video. In: IEEE AFGR, pp. 1–8 (2013)
Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., Bartlett, M.: The computer expression recognition toolbox (cert). In: IEEE AFGR, pp. 298–305 (2011)
Zafeiriou, L., Antonakos, E., Zafeiriou, S., Pantic, M.: Joint Unsupervised Face Alignment and Behaviour Analysis. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part IV. LNCS, vol. 8692, pp. 167–183. Springer, Heidelberg (2014)
Jeni, L.A., L\H{o}rincz, A., Szabó, Z., Cohn, J.F., Kanade, T.: Spatio-temporal Event Classification Using Time-Series Kernel Based Structured Sparsity. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part IV. LNCS, vol. 8692, pp. 135–150. Springer, Heidelberg (2014)
Chen, S., Tian, Y., Liu, Q., Metaxas, D.N.: Segment and recognize expression phase by fusion of motion area and neutral divergence features. In: IEEE AFGR, pp. 330–335 (2011)
Yuce, A., Sorci, M., Thiran, J.P.: Improved local binary pattern based action unit detection using morphological and bilateral filters. In: IEEE AFGR, pp. 1–7 (2013)
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. on PAMI 29, 915–928 (2007)
Zhu, Y., De la Torre, F., Cohn, J.F., Zhang, Y.J.: Dynamic cascades with bidirectional bootstrapping for action unit detection in spontaneous facial behavior. IEEE Trans. on Affective Computing 2, 79–91 (2011)
Wan, S., Aggarwal, J.: Spontaneous facial expression recognition: A robust metric learning approach. Pattern Recognition 47, 1859–1868 (2014)
Sénéchal, T., Turcot, J., El Kaliouby, R.: Smile or smirk? automatic detection of spontaneous asymmetric smiles to understand viewer experience. In: IEEE AFGR, pp. 1–8 (2013)
Girard, J.M., Cohn, J.F., Mahoor, M.H., Mavadati, S., Rosenwald, D.P.: Social risk and depression: Evidence from manual and automatic facial expression analysis. In: IEEE AFGR, pp. 1–8 (2013)
Kaya, H., Salah, A.A.: Eyes whisper depression: A cca based multimodal approach. ACM Multimedia (2014)
Yu, X., Zhang, S., Yu, Y., Dunbar, N., Jensen, M., Burgoon, J.K., Metaxas, D.N.: Automated analysis of interactional synchrony using robust facial tracking and expression recognition. In: IEEE AFGR, 1–6 (2013)
Ekman, P.: Telling lies. Cues to deceit in the marketplace, politics, and marriage. WW. Norton & Company, New York (1992)
Ekman, P., Friesen, W.: The Facial Action Coding System: A Technique For The Measurement of Facial Movement. Consulting Psychologists Press Inc., San Francisco, CA (1978)
Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal. Behav. 6, 238–252 (1982)
Velleman, P.F.: Definition and comparison of robust nonlinear data smoothing algorithms. Journal of the American Statistical Association, 609–615 (1980)
Dibeklioğlu, H., Gevers, T., Salah, A.A., Valenti, R.: A smile can reveal your age: Enabling facial dynamics in age estimation. ACM Multimedia, 209–218 (2012)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: Like father, like son: Facial expression dynamics for kinship verification. In: ICCV, pp. 1497–1504 (2013)
Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. of Wavelets, Multiresolution and Information Processing 2, 121–132 (2004)
Dibeklioğlu, H., Valenti, R., Salah, A.A., Gevers, T.: Eyes do not lie: Spontaneous versus posed smiles. ACM Multimedia, 703–706 (2010)
Pfister, T., Li, X., Zhao, G., Pietikainen, M.: Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework. In: ICCV Workshops, pp. 868–875 (2011)
Sanders, R.: Torsional elasticity of human skin in vivo. Pflügers Archiv European Journal of Physiology 342, 255–260 (1973)
Peleg, G., Katzir, G., Peleg, O., Kamara, M., Brodsky, L., Hel-Or, H., Keren, D., Nevo, E.: Hereditary family signature of facial expression. Proceedings of the National Academy of Sciences 103, 15921–15926 (2006)
Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. on PAMI 27, 1226–1238 (2005)
Fang, R., Tang, K.D., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: IEEE ICIP, pp. 1577–1580 (2010)
Guo, G., Wang, X.: Kinship measurement on salient facial features. IEEE Trans. on Instrumentation and Measurement 61, 2322–2325 (2012)
Zhou, X., Lu, J., Hu, J., Shang, Y.: Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. ACM Multimedia, 725–728 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Dibeklioğlu, H., Salah, A.A., Gürpınar, F. (2015). Measurement of Facial Dynamics for Soft Biometrics. In: Ji, Q., B. Moeslund, T., Hua, G., Nasrollahi, K. (eds) Face and Facial Expression Recognition from Real World Videos. FFER 2014. Lecture Notes in Computer Science(), vol 8912. Springer, Cham. https://doi.org/10.1007/978-3-319-13737-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-13737-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13736-0
Online ISBN: 978-3-319-13737-7
eBook Packages: Computer ScienceComputer Science (R0)