Abstract
Deep Learning (DL) is capable of excavating features hidden deep in complex data. In this paper, we introduce hierarchical convolutional neural networks (HCNN) to implement the EEG-based emotion classifier (positive, negative and neutral) in a movie-watching task. Differential Entropy (DE) is calculated as features at certain time interval for each channel. We organize features from different channels into two dimensional maps to train HCNN classifier. This approach extracts features contained in the spatial topology of electrodes directly, which is often neglected by the widely-used one-dimensional models. The performance of HCNN was compared with one-dimensional deep model SAE (Stacked Autoencoder), as well as traditional shallow models SVM and KNN. We find that HCNN (88.2% ± 3.5%) is better than SAE (85.4% ± 8.1%), and deep models are more favorable in emotion recognition BCI (Brain-computer Interface) system than shallow models. Moreover, we show that models learned on one person is hard to transfer to others and the individual difference in EEG emotion-related signal is significant among peoples. Finally, we find Beta and Gamma (rather than Delta, Theta and Alpha) waves play the key role in emotion recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kothe, C.A., Makeig, S.: Estimation of task workload from EEG data: new and current tools and perspectives. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6547–6551. IEEE (2011)
Shi, L.C., Lu, B.L.: EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102, 135–143 (2013)
Liu, Y., Sourina, O., Nguyen, M.K.: Real-time EEG-based emotion recognition and its applications. In: Gavrilova, M.L., Tan, C.J.K., Sourin, A., Sourina, O. (eds.). LNCS, vol. 6670, pp. 256–277Springer, Heidelberg (2011). doi:10.1007/978-3-642-22336-5_13
Ahern, G.L., Schwartz, G.E.: Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysis. Neuropsychologia 23(6), 745–755 (1985)
Zheng, W.L., Lu, B.L.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Mental Dev. 7(3), 162–175 (2015)
Dash, M., Liu, H.: Feature selection for classification. Intell. Data Anal. 1(3), 131–156 (1997)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Deselaers, T., Hasan, S., Bender, O., Ney, H.: A deep learning approach to machine transliteration. In: Proceedings of the Fourth Workshop on Statistical Machine Translation, pp. 233–241. Association for Computational Linguistics (2009)
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.A.: Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 3371–3408 (2010)
Hinton, G.E.: Deep belief networks. Scholarpedia 4(5), 5947 (2009)
Li, M., Lu, B.L.: Emotion classification based on gamma-band EEG. In: 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1223–1226. IEEE (2009)
Hadjidimitriou, S.K., Hadjileontiadis, L.J.: EEG-based classification of music appraisal responses using time-frequency analysis and familiarity ratings. IEEE Trans. Affect. Comput. 4(2), 161–172 (2013)
Li, Y., Luo, M.L., Li, K.: A multiwavelet-based time-varying model identification approach for time–frequency analysis of EEG signals. Neurocomputing 193, 106–114 (2016)
Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER), pp. 81–84. IEEE (2013)
Philippot, P.: Inducing and assessing differentiated emotion-feeling states in the laboratory. Cogn. Emot. 7(2), 171–193 (1993)
Acknowledgement
This work was supported by National Natural Science Foundation of China (61271151, 91520202) and Youth Innovation Promotion Association CAS.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Li, J., Zhang, Z., He, H. (2016). Implementation of EEG Emotion Recognition System Based on Hierarchical Convolutional Neural Networks. In: Liu, CL., Hussain, A., Luo, B., Tan, K., Zeng, Y., Zhang, Z. (eds) Advances in Brain Inspired Cognitive Systems. BICS 2016. Lecture Notes in Computer Science(), vol 10023. Springer, Cham. https://doi.org/10.1007/978-3-319-49685-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-49685-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49684-9
Online ISBN: 978-3-319-49685-6
eBook Packages: Computer ScienceComputer Science (R0)