Abstract
In recent times, emotion recognition is in attention in brain computer interface (BCI) and human computer interaction (HCI) research area to provide a very good communication between brain and computer. The aim is to achieve a good recognition rate, although there are numerous researches have been conducted also there has been created several confusions with the definition of human emotions and the difference between emotions and moods. To detect brain signal, Electroencephalogram (EEG) signal has become biological marker. For its low cost, good time and spatial resolution EEG has been used widely in BCI researches. Extraction of features from EEG signals is one of the vital steps of EEG based emotion recognition. The appropriate feature selection for EEG based automatic emotion recognition is still now a big research topic. In this paper, a comprehensive survey is made on feature extraction methods and their comparative merits and limitations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human–computer interaction. Proc. IEEE 91, 1370–1390 (2003)
Frantzidis, C.A., Bratsas, C., Klados, M.A., Konstantinidis, E., Lithari, C.D., Vivas, A.B., Papadelis, C.L., Kaldoudi, E., Pappas, C., Bamidis, P.D.: On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications. IEEE Trans. Inf. Technol. Biomed. 14, 309–318 (2010)
Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)
Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)
Frantzidis, C.A., Bratsas, C., Papadelis, C.L., Konstantinidis, E., Pappas, C., Bamidis, P.D.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)
Goyal, M., Singh, M., Singh, M.: Classification of emotions on ERP feature extraction. In: 2015 1st International Conference on Next Generation Computing Technologies (2015)
Takahashi, K.: Remarks on emotion recognition from multimodal bio-potential signals. In: Proceedings of the International Conference on Industrial Technology, pp. 1138–1143 (2004)
Wang, X., Nie, D., Lu, B.: EEG-based emotion recognition using frequency domain features and support vector machines. In: Proceedings of the International Conference on Neural Information Processing, pp. 734–743 (2011)
Hjorth, B., Elema-Schönander, A.B.: EEG analysis based on time domain properties. Electroencephalogr. Clin. Neurophysiol. 29, 306–310 (1970)
Ansari-asl, K., Chanel, G., Pun, T.: A channel selection method for EEG classification in emotion assessment based on synchronization likelihood. In: 15th European Signal Processing Conference, pp. 1241–1245 (2007)
Jenke, R., Peer, A., Buss, M.: Effect-size-based electrode and feature selection for emotion recognition from EEG. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1217–1221 (2013)
Mehmood, R.M., Lee, H.J.: EEG based emotion recognition from human brain using Hjorth parameters and SVM. Int. J. Bio-sci. Bio-technol. 3, 23–32 (2015)
Kroupi, E., Yazdani, A., Ebrahimi, T.: EEG correlates of different emotional states elicited during watching music videos. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, pp. 457–466 (2011)
Tabanfar, Z., Yousefipoor, F., Firoozabadi, M., Khodakarami, Z., Shankayi, Z.: Recognition of two emotional states of joy and sadness using phase lag index and SVM classifier. In: ICBME (2016)
Kedem, B.: Time Series Analysis by Higher Order Crossings. IEEE Press, Piscataway (1994)
Petrantonakis, P.C., Hadjileontiadis, L.J.: Emotion recognition from EEG using higher order crossings. IEEE Trans. Inf. Technol. Biomed. 14(2), 186–197 (2010)
Petrantonakis, P.C., Hadjileontiadis, L.J.: Emotion recognition from brain signals using hybrid adaptive filtering and higher order crossing analysis. IEEE Trans. Affect. Comput. 1(2), 81–97 (2010)
Li, X., Sun, X.-Q., Qi, X.-Y., Sun, X.-F.: Relevance vector machine based EEG emotion recognition. In: 2016 Sixth International Conference on Instrumentation and Measurement, Computer, Communication and Control (2016)
Jie, X., Cao, R., Li, L.: Emotion recognition based on sample entropy of EEG. Bio-med. Mater. Eng. 24, 1185–1192 (2014)
Zhang, Y., Ji, X., Zhang, S.: An approach to EEG-based emotion recognition using combined feature extraction method. Neurosci. Lett. 633, 152–157 (2016)
Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: Proceedings of the 6th International IEEE/EMBS Conference on Neural Engineering, pp. 81–84 (2013)
Zhu, J.-Y., Zheng, W.-L., Peng, Y., Duan, R.-N., Lu, B.-L.: EEG-based emotion recognition using discriminative graph regularized extreme learning machine. In: 2014 International Joint Conference on Neural Networks (IJCNN) (2014)
Zheng, W.-L., Zhu, J.-Y., Peng, Y., Lu, B.-L.: EEG-based emotion classification using deep belief networks. In: 2014 IEEE International Conference on Multimedia and Expo (ICME) (2014)
Chaia, X., Wanga, Q., Xhao, Y., Liu, X., Bai, O., Li, Y.: Unsupervised domain adaptation techniques based on auto-encoder for non-stationary EEG-based emotion recognition. Comput. Biol. Med. 79, 205–214 (2016)
Zheng, W.-L., Lu, B.-L.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Mental Dev. 7(3), 162–175 (2015)
Hosseini, S.A., Naghibi-Sistani, M.B.: Emotion recognition method using entropy analysis of EEG signals. Int. J. Image Graph. Signal Process. 5, 30–36 (2011)
Ali, M., Haji, A., Al Machot, F., Kyamakya, K.: EEG based emotion recognition approach for e-healthcare applications. In: 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE (2016)
Schaaff, K., Schultz, T.: Towards emotion recognition from electroencephalographic signals. In: International Conference on Affective Computing Intelligent Interaction, pp. 175–180 (2009)
Wang, X., Nie, D., Lu, B.: EEG-based emotion recognition using frequency domain features and support vector machines. In: International Conference on Neural Information Processing, pp. 734–743 (2011)
Liu, Y., Sourina, O.: EEG-based dominance level recognition for emotion-enabled interaction. In: Proceedings of the IEEE International Conference on Multimedia Expo, pp. 1039–1044 (2012)
Nie, D., Wang, X.-W., Shi, L.-C., Lu, B.-L.: EEG-based emotion recognition during watching movies. In: IEEE International Conference on Neural Engineering, pp. 667–670 (2011)
Li, M., Lu, B.-L.: Emotion classification based on gamma-band EEG. In: IEEE International Conference on Engineering in Medicine and Biology Society, vol. 1, pp. 1323–1326 (2009)
Bos, D.O.: EEG-based emotion recognition. Emotion 57(7), 1798–1806 (2006)
Kroupi, E., Yazdani, A., Ebrahimi, T.: EEG correlates of different emotional states elicited during watching music videos. In: International Conference on Affective Computing and Intelligent Interaction, pp. 457–466 (2011)
Horlings, R., Datcu, D., Rothkrantz, L.: Emotion recognition using brain activity. In: International Conference on Computer Systems and Technologies, pp. II.1–1–6 (2008)
Reuderink, B., Muhl, C., Poel, M.: Valence, arousal and dominance in the EEG during game play. Int. J. Auton. Adapt. Commun. Syst. 6(1), 45–62 (2013)
Brown, L., Grundlehner, B., Penders, J.: Towards wireless emotional valence detection from EEG. In: IEEE International Conference on Engineering in Medicine and Biology Society, pp. 2188–2191 (2011)
Rozgic, V., Vitaladevuni, S., Prasad, R.: Robust EEG emotion classification using segment level decision fusion. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1286–1290 (2013)
Soleymani, M., Koelstra, S., Patras, I., Pun, T.: Continuous emotion detection in response to music videos. In: Proceedings of the IEEE International Conference on Automation Face Gesture Recognition, pp. 803–808 (2011)
Hosseini, S., et al.: Higher order spectra analysis of EEG signals in emotional stress states. In: Proceedings of the IEEE International Conference on Information Technology and Computer Science, pp. 60–63 (2010)
Conneau, A.C., Slim, E.: Assessment of new spectral features for EEG-based emotion recognition. In: 2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) (2014)
Lahane, P., Thirugnanam, M.: A novel approach for analyzing human emotions based on electroencephalography (EEG). In: International Conference on Innovations in Power and Advanced Computing Technologies (i-PACT2017) (2017)
Saadat, N., Hossein, P.: An optimal EEG-based emotion recognition algorithm using gabor features. WSEAS Trans. Signal Process. 8, 87–99 (2012)
Vanitha, V., Krishnan, P.: Time-frequency analysis of EEG for improved classification of emotion. Int. J. Biomed. Eng. Technol. 23, 191–212 (2017)
Li, Y., Huang, J., Zhou, H., Zhong, N.: Human emotion recognition with electroencephalographic multidimensional features by hybrid deep neural networks. Appl. Sci. 7, 1060 (2017)
Nivedha, R., Brinda, M., Vasanth, D., Anvitha, M., Suma, K.V.: EEG based emotion recognition using SVM and PSO. In: 2017 International Conference on ICICICT (2017)
Murugappan, M., Rizon, M., Yaacob, S., Zunaidi, I., Hazry, D.: EEG feature extraction for classifying emotions using FCM and FKM. Int. J. Comput. Commun. 1(2), 21–25 (2007)
Murugappan, M., Nagarajan, R., Yaacob, S.: Classification of human emotion from EEG using discrete wavelet transform. J. Biomed. Sci. Eng. 3(4), 390–396 (2010)
Akin, M.: Comparison of wavelet transform and FFT methods in the analysis of EEG signals. J. Med. Syst. 26(3), 241–247 (2002)
Murugappan, M., Rizon, M., Nagarajan, R., Yaacob, S.: Inferring of human emotional states using multichannel EEG. Eur. J. Sci. Res. 48(2), 281–299 (2010)
Srinivas, V., Rama, V., Rama Rao, C.B.: Wavelet based emotion recognition using RBF algorithm. IJIREEICE 4(5) (2016)
Mohammadi, Z., Frounchi, J., Amiri, M.: Wavelet-based emotion recognition system using EEG signal. Neural Comput. Appl. 28, 1985–1990 (2016)
Shankar, T., Ravi Kumar, K.M., Rupali, S., Abhijith, V.: EEG based emotion recognition using Wavelets and neural networks classifier. In: SpringerBriefs in Applied Sciences and Technology (2018)
Huang, D., Zhang, S., Zhang, Y.: EEG-based emotion recognition using empirical wavelet transform. In: ICSAI (2017)
Zhou, Z., Jaing, H., Song, X.: EEG-based emotion recognition using wavelet features. In: 2014 IEEE 5th International Conference on Software Engineering and Service Science (2014)
Acknowledgment
We would like to thank TEQIP III, NIT Silchar for all the support for carrying out the presented review paper work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Phadikar, S., Sinha, N., Ghosh, R. (2020). A Survey on Feature Extraction Methods for EEG Based Emotion Recognition. In: Dawn, S., Balas, V., Esposito, A., Gope, S. (eds) Intelligent Techniques and Applications in Science and Technology. ICIMSAT 2019. Learning and Analytics in Intelligent Systems, vol 12. Springer, Cham. https://doi.org/10.1007/978-3-030-42363-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-42363-6_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-42362-9
Online ISBN: 978-3-030-42363-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)