Abstract
In the community of computer vision, deep learning has been widely applied in many classification tasks. However, the performance of deep networks depends heavily on the large number of labeled samples. In this paper, we propose a multi-view Deep Convolutional Neural Network to recognize facial expression while very small number of samples is available. First, facial images are downsampled to different scales and upsampled as multi-view samples. Then a multi-view DCNN is constructed with twin structure and cooperative learning. After one channel is trained by single view samples, the parameter is transferred to another channel for fine tuning using another view samples. Some experiments are taken on FER2013 and RAF datasets, and the experimental results illustrate that the proposed multi-view DCNN network has a good performance where achieves 72.27% on the private set of FER2013 dataset, and the transfer DCNN model achieves 83.08% on the test set of RAF database.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)
Iliadis, M., et al.: Sparse representation and least squares-based classification in face recognition. In: 2014 22nd European Signal Processing Conference (EUSIPCO), pp. 526–530. IEEE Xplore (2014)
Best-Rowden, L., Jain, A.K.: A longitudinal study of automatic face recognition. In: International Conference on Biometrics (ICB) 2015, pp. 214–221. IEEE Xplore (2015)
Aung, D.M., Aye, N.: A Facial expression classification using histogram based method. In: 2012 4th International Conference on Signal Processing Systems, vol. 58, pp. 1–5 (2012)
Déniz, O., et al.: Face recognition using histograms of oriented gradients. Pattern Recogn. Lett. 32(12), 1598–1603 (2011)
Perikos, I., Ziakopoulos, E., Hatzilygeroudis, I.: Recognize emotions from facial expressions using a SVM and neural network schema. In: Engineering Applications of Neural Networks, pp. 265–274. Springer, Heidelberg (2015)
Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: 2013 Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3476–3481. IEEE (2013)
Hu, G., et al.: When face recognition meets with deep learning: an evaluation of convolutional neural networks for face recognition. In: 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), pp. 384–392 (2015)
Zhou, S., et al.: Facial expression recognition based on multi-scale CNNs. In: Chinese Conference on Biometric Recognition, vol. 9967, pp. 503–510. Springer, Heidelberg (2016)
Mollahosseini, A., Chan, D., Mahoor, M.H.: Going deeper in facial expression recognition using deep neural networks. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–10. IEEE (2016)
Ding, C., Tao, D.: Robust face recognition via multimodal deep face representation. IEEE Trans. Multimedia 17(11), 2049–2058 (2015)
Zhao, S., Cai, H., Liu, H., Zhang, J., Chen, S.: Feature selection mechanism in CNNs for facial expression recognition. In: 2018 British Machine Vision Conference (BMVC), pp. 1–12 (2018)
Giannopoulos, P., Isidoros P., Hatzilygeroudis, I.: Deep learning approaches for facial emotion recognition: a case study on FER-2013. In: Advances in Hybridization of Intelligent Methods, vol. 85, pp. 1–16. Springer, Heidelberg (2018)
Al-Shabi, M., Cheah, W.P., Connie, T.: Facial expression recognition using a hybrid CNN-SIFT aggregator. In: 2017 International Workshop on Multi-disciplinary Trends in Artificial Intelligence, vol. 10607, pp. 139–149. Springer, Heidelberg (2017)
Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: 27th International Conference (NIPS), vol. 2, pp. 3320–3328 (2014)
Sanner, M.F.: Python: a programming language for software integration and development. J. Mol. Graph. Model. 17(1), 57–61 (1999)
Li, S., Deng, W., Du, J.: Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2584–2593. IEEE (2017)
Goodfellow, I., Erhan, D., Luc Carrier, P., et al.: Challenges in representation learning: a report on three machine learning contests. Neural Netw. 1(64), 59–63 (2015)
Tang, Y.: Deep learning using linear support vector machines. In: 2013 International Conference on Machine Learning, vol. 28 (2013)
Liu, Z., Li, S., Deng, W.: Boosting-POOF: boosting part based one vs one feature for facial expression recognition in the wild. In: 2017 IEEE International Conference on Automatic Face & Gesture Recognition, pp. 967–972. IEEE (2017)
Yu, Z., Zhang, C.: Image based static facial expression recognition with multiple deep network learning. In: 2015 Proceedings of the ACM on International Conference on Multi-modal Interaction, pp. 435–442 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Alfakih, A., Yang, S., Hu, T. (2020). Multi-view Cooperative Deep Convolutional Network for Facial Recognition with Small Samples Learning. In: Herrera, F., Matsui , K., Rodríguez-González, S. (eds) Distributed Computing and Artificial Intelligence, 16th International Conference. DCAI 2019. Advances in Intelligent Systems and Computing, vol 1003 . Springer, Cham. https://doi.org/10.1007/978-3-030-23887-2_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-23887-2_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23886-5
Online ISBN: 978-3-030-23887-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)