Facial Expression Recognition Based on Quaternion-Space and Multi-features Fusion
There is an increasing trend of using feature fusion technique in facial expression recognition. However, when traditional serial or parallel feature fusion methods are used, the problem of highly dimensional features and insufficient fusion of possible feature categories always exist. In order to solve these problems, a novel facial expression recognition method based on quaternion-space and multi-features fusion is proposed. Firstly, four different kinds of expression features are extracted such as Gabor wavelet, LBP, LPQ and DCT features, then PCA+CCA framework is proposed and used to reduce the dimensions of the four original features. Secondly, quaternion is used to construct the combinative features. Thirdly, a novel quaternion-space HDA method is proposed and used as the dimensional reduction method of the combinative features. Finally, SVM is used and set as the classifier. Experimental results indicate that the proposed method is capable of fusing four kinds of features more effectively while it achieves higher recognition rates than the traditional feature fusion methods.
KeywordsFacial expression recognition Multi-features fusion Quaternion Dimensional reduction Quaternion-space HDA
- 1.Mehrabian, A.: Silent Messages: Implicit Communication of Emotions and Attitudes. Wadsworth, Belmont (1981)Google Scholar
- 5.Kotsia, I., Nikolaidis, N., Pitas, I.: Fusion of geometrical and texture information for facial expression recognition. In: 2006 IEEE International Conference on Image Processing, pp. 2649–2652. IEEE Press, Atlanta (2006)Google Scholar
- 7.Yang, J., Yang, J.Y., Wang, Z.Q., et al.: A novel method of combined feature extraction. J. Chinese J. Comput. 25(6), 570–575 (2002)Google Scholar
- 8.Luo, F., Wang, G.Y., Yang, Y., et al.: Facial expression recognition based on improved parallel features fusion. J. Guangxi Univ. Nat. Sci. Ed. 34(5), 700–703 (2009)Google Scholar
- 9.Bai, G., Jia, W.H., Jin, Y.: Facial expression recognition based on fusion features of lbp and gabor with lda. In: 2nd International Congress on Image and Signal Processing(CISP2 009), pp. 1–5. IEEE Press, Tianjin (2009)Google Scholar
- 10.Yang, Y., Cai, S.B.: Facial expression recognition method based on two-steps dimensionality reduction and parallel feature fusion. J. Chongqing Univ. Posts Telecomm. Nat. Sci. Ed. 27(3), 377–385 (2015)Google Scholar
- 12.Hamilton, W.R.: Elements of Quaternions. Longmans Green and Company, London (1866)Google Scholar
- 14.Verma, R., Dabbagh, M.Y.: Fast facial expression recognition based on local binary patterns. In: 2013 26th Annual IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1–4. IEEE Press, Regina (2013)Google Scholar
- 15.Wang, Z., Ying, Z.L.: Facial Expression Recognition Based on Local Phase Quantization and Sparse Representation. In: 2012 Eighth International Conference on Natural Computation (ICNC), pp. 222–225. IEEE Press, Chongqing (2012)Google Scholar
- 16.Kharat, G.U., Dudul, S.V.: Neural network classifier for human emotion recognition from facial expressions using discrete cosine transform. In: First International Conference on Emerging Trends in Engineering and Technology (ICETET 2008), pp. 653–658. IEEE Press, Nagpur (2008)Google Scholar
- 21.Lyons, M., Akamatsu, S., Kamachi, M., et al.: Coding facial expressions with gabor wavelets. In: Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE Press, Nara (1998)Google Scholar
- 22.Lucey, P., Cohn, J.F., Kanade, T., et al.: The Extended cohn-kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE Press, San Francisco (2010)Google Scholar
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (http://creativecommons.org/licenses/by-nc/2.5/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.