A New Facial Expression Recognition Scheme Based on Parallel Double Channel Convolutional Neural Network
- 270 Downloads
The conventional deep convolutional neural networks in facial expression recognition are confronted with the training inefficiency due to many layered structure with a large number of parameters, in order to cope with this challenge, in this work, an improved convolutional neural network—with parallel double channels, termed as PDC-CNN, is proposed. Within this model, we can get two different sized feature maps for the input image, and the two different sized feature maps are combined for the final recognition and judgment. In addition, in order to prevent over-fitting, we replace the traditional RuLU activation function with the Maxout model in the fully connected layer to optimize the performance of the network. We have trained and tested the new model on JAFFE dataset. Experimental results show that the proposed method can achieve 83% recognition rate, in comparison with the linear SVM, AlexNet and LeNet-5, the recognition rate of this method is improved by 14%–28%.
KeywordsFacial expression recognition Parallel Double channel Convolutional neural network
This work is partially supported by National Natural Science Foundation of China (61762018), the Guangxi 100 Youth Talent Program (F-KA16016) and the Colleges and Universities Key Laboratory of Intelligent Integrated Automation, Guilin University of Electronic Technology, China (GXZDSY2016-03), the research fund of Guangxi Key Lab of Multi-source Information Mining & Security (18-A-02-02), Natural Science Foundation of Guangxi (2018GXNSFAA281310).
- 4.Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: development and applications to human computer interaction. In: 2003 Conference on Computer Vision and Pattern Recognition Workshop. IEEE (2008)Google Scholar
- 7.Dureha, A., Dureha, A.: An accurate algorithm for generating a music playlist based on facial expressions. Int. J. Comput. Appl. 100(9), 33–39 (2014)Google Scholar
- 11.Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., Song, L.: Sphereface: deep hypersphere embedding for face recognition. arXiv, 9 (2017)Google Scholar
- 12.Shan, C., Gong, S., Mcowan, P.W.: Robust facial expression recognition using local binary patterns. In: IEEE International Conference on Image Processing. DBLP (2005)Google Scholar
- 14.Pramerdorfer, C., Kampel, M.: Facial expression recognition using convolutional neural networks: state of the art. arXiv, 6 (2016)Google Scholar
- 15.Lu, G., He, J., Yan, J., Li, H.: Convolutional neural network for facial expression recognition. J. Nanjing Univ. Posts Telecommun. 36, 16–22 (2016)Google Scholar
- 16.Ekman, P., Friesen, W.V.: Facial action coding system (facs): a technique for the measurement of facial action. Rivista di Psichiatria 47(2), 126–138 (1978)Google Scholar
- 17.Torre, F.D.L., Campoy, J., Ambadar, Z., Cohn, J. F.: Temporal segmentation of facial behavior. In: IEEE International Conference on Computer Vision (2007)Google Scholar
- 18.Lopes, A.T., Aguiar, E.D., Oliveira-Santos, T.: A Facial expression recognition system using convolutional networks. In: 28th Sibgrapi Conference on Graphics, Patterns and Images, pp. 273–280 (2015)Google Scholar
- 20.Goodfellow, I.J., Warde-Farley, D., Mirza, M., Courville, A., Bengio, Y.: Maxout networks. Comput. Sci. 28, 1319–1327 (2013)Google Scholar