Skip to main content

A Survey on Feature Extraction Methods for EEG Based Emotion Recognition

  • Conference paper
  • First Online:
Intelligent Techniques and Applications in Science and Technology (ICIMSAT 2019)

Part of the book series: Learning and Analytics in Intelligent Systems ((LAIS,volume 12))

Abstract

In recent times, emotion recognition is in attention in brain computer interface (BCI) and human computer interaction (HCI) research area to provide a very good communication between brain and computer. The aim is to achieve a good recognition rate, although there are numerous researches have been conducted also there has been created several confusions with the definition of human emotions and the difference between emotions and moods. To detect brain signal, Electroencephalogram (EEG) signal has become biological marker. For its low cost, good time and spatial resolution EEG has been used widely in BCI researches. Extraction of features from EEG signals is one of the vital steps of EEG based emotion recognition. The appropriate feature selection for EEG based automatic emotion recognition is still now a big research topic. In this paper, a comprehensive survey is made on feature extraction methods and their comparative merits and limitations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human–computer interaction. Proc. IEEE 91, 1370–1390 (2003)

    Article  Google Scholar 

  2. Frantzidis, C.A., Bratsas, C., Klados, M.A., Konstantinidis, E., Lithari, C.D., Vivas, A.B., Papadelis, C.L., Kaldoudi, E., Pappas, C., Bamidis, P.D.: On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications. IEEE Trans. Inf. Technol. Biomed. 14, 309–318 (2010)

    Article  Google Scholar 

  3. Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)

    Article  Google Scholar 

  4. Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)

    Article  MathSciNet  Google Scholar 

  5. https://en.wikipedia.org/wiki/10%E2%80%9320_system_(EEG)

  6. Frantzidis, C.A., Bratsas, C., Papadelis, C.L., Konstantinidis, E., Pappas, C., Bamidis, P.D.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)

    Article  Google Scholar 

  7. Goyal, M., Singh, M., Singh, M.: Classification of emotions on ERP feature extraction. In: 2015 1st International Conference on Next Generation Computing Technologies (2015)

    Google Scholar 

  8. Takahashi, K.: Remarks on emotion recognition from multimodal bio-potential signals. In: Proceedings of the International Conference on Industrial Technology, pp. 1138–1143 (2004)

    Google Scholar 

  9. Wang, X., Nie, D., Lu, B.: EEG-based emotion recognition using frequency domain features and support vector machines. In: Proceedings of the International Conference on Neural Information Processing, pp. 734–743 (2011)

    Google Scholar 

  10. Hjorth, B., Elema-Schönander, A.B.: EEG analysis based on time domain properties. Electroencephalogr. Clin. Neurophysiol. 29, 306–310 (1970)

    Article  Google Scholar 

  11. Ansari-asl, K., Chanel, G., Pun, T.: A channel selection method for EEG classification in emotion assessment based on synchronization likelihood. In: 15th European Signal Processing Conference, pp. 1241–1245 (2007)

    Google Scholar 

  12. Jenke, R., Peer, A., Buss, M.: Effect-size-based electrode and feature selection for emotion recognition from EEG. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1217–1221 (2013)

    Google Scholar 

  13. Mehmood, R.M., Lee, H.J.: EEG based emotion recognition from human brain using Hjorth parameters and SVM. Int. J. Bio-sci. Bio-technol. 3, 23–32 (2015)

    Article  Google Scholar 

  14. Kroupi, E., Yazdani, A., Ebrahimi, T.: EEG correlates of different emotional states elicited during watching music videos. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, pp. 457–466 (2011)

    Google Scholar 

  15. Tabanfar, Z., Yousefipoor, F., Firoozabadi, M., Khodakarami, Z., Shankayi, Z.: Recognition of two emotional states of joy and sadness using phase lag index and SVM classifier. In: ICBME (2016)

    Google Scholar 

  16. Kedem, B.: Time Series Analysis by Higher Order Crossings. IEEE Press, Piscataway (1994)

    MATH  Google Scholar 

  17. Petrantonakis, P.C., Hadjileontiadis, L.J.: Emotion recognition from EEG using higher order crossings. IEEE Trans. Inf. Technol. Biomed. 14(2), 186–197 (2010)

    Article  Google Scholar 

  18. Petrantonakis, P.C., Hadjileontiadis, L.J.: Emotion recognition from brain signals using hybrid adaptive filtering and higher order crossing analysis. IEEE Trans. Affect. Comput. 1(2), 81–97 (2010)

    Article  Google Scholar 

  19. Li, X., Sun, X.-Q., Qi, X.-Y., Sun, X.-F.: Relevance vector machine based EEG emotion recognition. In: 2016 Sixth International Conference on Instrumentation and Measurement, Computer, Communication and Control (2016)

    Google Scholar 

  20. Jie, X., Cao, R., Li, L.: Emotion recognition based on sample entropy of EEG. Bio-med. Mater. Eng. 24, 1185–1192 (2014)

    Article  Google Scholar 

  21. Zhang, Y., Ji, X., Zhang, S.: An approach to EEG-based emotion recognition using combined feature extraction method. Neurosci. Lett. 633, 152–157 (2016)

    Article  Google Scholar 

  22. Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: Proceedings of the 6th International IEEE/EMBS Conference on Neural Engineering, pp. 81–84 (2013)

    Google Scholar 

  23. Zhu, J.-Y., Zheng, W.-L., Peng, Y., Duan, R.-N., Lu, B.-L.: EEG-based emotion recognition using discriminative graph regularized extreme learning machine. In: 2014 International Joint Conference on Neural Networks (IJCNN) (2014)

    Google Scholar 

  24. Zheng, W.-L., Zhu, J.-Y., Peng, Y., Lu, B.-L.: EEG-based emotion classification using deep belief networks. In: 2014 IEEE International Conference on Multimedia and Expo (ICME) (2014)

    Google Scholar 

  25. Chaia, X., Wanga, Q., Xhao, Y., Liu, X., Bai, O., Li, Y.: Unsupervised domain adaptation techniques based on auto-encoder for non-stationary EEG-based emotion recognition. Comput. Biol. Med. 79, 205–214 (2016)

    Article  Google Scholar 

  26. Zheng, W.-L., Lu, B.-L.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Mental Dev. 7(3), 162–175 (2015)

    Article  Google Scholar 

  27. Hosseini, S.A., Naghibi-Sistani, M.B.: Emotion recognition method using entropy analysis of EEG signals. Int. J. Image Graph. Signal Process. 5, 30–36 (2011)

    Article  Google Scholar 

  28. Ali, M., Haji, A., Al Machot, F., Kyamakya, K.: EEG based emotion recognition approach for e-healthcare applications. In: 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE (2016)

    Google Scholar 

  29. Schaaff, K., Schultz, T.: Towards emotion recognition from electroencephalographic signals. In: International Conference on Affective Computing Intelligent Interaction, pp. 175–180 (2009)

    Google Scholar 

  30. Wang, X., Nie, D., Lu, B.: EEG-based emotion recognition using frequency domain features and support vector machines. In: International Conference on Neural Information Processing, pp. 734–743 (2011)

    Google Scholar 

  31. Liu, Y., Sourina, O.: EEG-based dominance level recognition for emotion-enabled interaction. In: Proceedings of the IEEE International Conference on Multimedia Expo, pp. 1039–1044 (2012)

    Google Scholar 

  32. Nie, D., Wang, X.-W., Shi, L.-C., Lu, B.-L.: EEG-based emotion recognition during watching movies. In: IEEE International Conference on Neural Engineering, pp. 667–670 (2011)

    Google Scholar 

  33. Li, M., Lu, B.-L.: Emotion classification based on gamma-band EEG. In: IEEE International Conference on Engineering in Medicine and Biology Society, vol. 1, pp. 1323–1326 (2009)

    Google Scholar 

  34. Bos, D.O.: EEG-based emotion recognition. Emotion 57(7), 1798–1806 (2006)

    Google Scholar 

  35. Kroupi, E., Yazdani, A., Ebrahimi, T.: EEG correlates of different emotional states elicited during watching music videos. In: International Conference on Affective Computing and Intelligent Interaction, pp. 457–466 (2011)

    Google Scholar 

  36. Horlings, R., Datcu, D., Rothkrantz, L.: Emotion recognition using brain activity. In: International Conference on Computer Systems and Technologies, pp. II.1–1–6 (2008)

    Google Scholar 

  37. Reuderink, B., Muhl, C., Poel, M.: Valence, arousal and dominance in the EEG during game play. Int. J. Auton. Adapt. Commun. Syst. 6(1), 45–62 (2013)

    Article  Google Scholar 

  38. Brown, L., Grundlehner, B., Penders, J.: Towards wireless emotional valence detection from EEG. In: IEEE International Conference on Engineering in Medicine and Biology Society, pp. 2188–2191 (2011)

    Google Scholar 

  39. Rozgic, V., Vitaladevuni, S., Prasad, R.: Robust EEG emotion classification using segment level decision fusion. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1286–1290 (2013)

    Google Scholar 

  40. Soleymani, M., Koelstra, S., Patras, I., Pun, T.: Continuous emotion detection in response to music videos. In: Proceedings of the IEEE International Conference on Automation Face Gesture Recognition, pp. 803–808 (2011)

    Google Scholar 

  41. Hosseini, S., et al.: Higher order spectra analysis of EEG signals in emotional stress states. In: Proceedings of the IEEE International Conference on Information Technology and Computer Science, pp. 60–63 (2010)

    Google Scholar 

  42. Conneau, A.C., Slim, E.: Assessment of new spectral features for EEG-based emotion recognition. In: 2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) (2014)

    Google Scholar 

  43. Lahane, P., Thirugnanam, M.: A novel approach for analyzing human emotions based on electroencephalography (EEG). In: International Conference on Innovations in Power and Advanced Computing Technologies (i-PACT2017) (2017)

    Google Scholar 

  44. Saadat, N., Hossein, P.: An optimal EEG-based emotion recognition algorithm using gabor features. WSEAS Trans. Signal Process. 8, 87–99 (2012)

    Google Scholar 

  45. Vanitha, V., Krishnan, P.: Time-frequency analysis of EEG for improved classification of emotion. Int. J. Biomed. Eng. Technol. 23, 191–212 (2017)

    Article  Google Scholar 

  46. Li, Y., Huang, J., Zhou, H., Zhong, N.: Human emotion recognition with electroencephalographic multidimensional features by hybrid deep neural networks. Appl. Sci. 7, 1060 (2017)

    Article  Google Scholar 

  47. Nivedha, R., Brinda, M., Vasanth, D., Anvitha, M., Suma, K.V.: EEG based emotion recognition using SVM and PSO. In: 2017 International Conference on ICICICT (2017)

    Google Scholar 

  48. Murugappan, M., Rizon, M., Yaacob, S., Zunaidi, I., Hazry, D.: EEG feature extraction for classifying emotions using FCM and FKM. Int. J. Comput. Commun. 1(2), 21–25 (2007)

    Google Scholar 

  49. Murugappan, M., Nagarajan, R., Yaacob, S.: Classification of human emotion from EEG using discrete wavelet transform. J. Biomed. Sci. Eng. 3(4), 390–396 (2010)

    Article  Google Scholar 

  50. Akin, M.: Comparison of wavelet transform and FFT methods in the analysis of EEG signals. J. Med. Syst. 26(3), 241–247 (2002)

    Article  Google Scholar 

  51. Murugappan, M., Rizon, M., Nagarajan, R., Yaacob, S.: Inferring of human emotional states using multichannel EEG. Eur. J. Sci. Res. 48(2), 281–299 (2010)

    Google Scholar 

  52. Srinivas, V., Rama, V., Rama Rao, C.B.: Wavelet based emotion recognition using RBF algorithm. IJIREEICE 4(5) (2016)

    Google Scholar 

  53. Mohammadi, Z., Frounchi, J., Amiri, M.: Wavelet-based emotion recognition system using EEG signal. Neural Comput. Appl. 28, 1985–1990 (2016)

    Article  Google Scholar 

  54. Shankar, T., Ravi Kumar, K.M., Rupali, S., Abhijith, V.: EEG based emotion recognition using Wavelets and neural networks classifier. In: SpringerBriefs in Applied Sciences and Technology (2018)

    Google Scholar 

  55. Huang, D., Zhang, S., Zhang, Y.: EEG-based emotion recognition using empirical wavelet transform. In: ICSAI (2017)

    Google Scholar 

  56. Zhou, Z., Jaing, H., Song, X.: EEG-based emotion recognition using wavelet features. In: 2014 IEEE 5th International Conference on Software Engineering and Service Science (2014)

    Google Scholar 

Download references

Acknowledgment

We would like to thank TEQIP III, NIT Silchar for all the support for carrying out the presented review paper work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Souvik Phadikar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Phadikar, S., Sinha, N., Ghosh, R. (2020). A Survey on Feature Extraction Methods for EEG Based Emotion Recognition. In: Dawn, S., Balas, V., Esposito, A., Gope, S. (eds) Intelligent Techniques and Applications in Science and Technology. ICIMSAT 2019. Learning and Analytics in Intelligent Systems, vol 12. Springer, Cham. https://doi.org/10.1007/978-3-030-42363-6_5

Download citation

Publish with us

Policies and ethics