Exploring the Usage of EEG and Pupil Diameter to Detect Elicited Valence

  • Yasmeen AbdrabouEmail author
  • Khaled Kassem
  • Jailan Salah
  • Reem El-Gendy
  • Mahesty Morsy
  • Yomna Abdelrahman
  • Slim Abdennadher
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 722)


Brain signals are a reliable information source because human beings have limited voluntary control over. We examine EEG readings as a reporting tool concerning human emotions. We examine whether readings from an eye tracker, can enhance the results. We conducted an experiment on 25 users to measure their EEG signals in response to emotional stimuli. All sensors used were off-the-shelf, to test our method using cheap sensors. We used pleasant and unpleasant videos content to elicit emotional responses. Along with Self-Assessment Mannequin (SAM), Alpha symmetry index readings, and pupil diameter, were recorded. Our results show a significant difference in the video clips eliciting different emotions. This implies that EEG can be a valid way to detect emotional state, especially when combined with eye-tracker. We conclude from our findings that EEG can be used as a platform, upon which reliable affect-aware systems and applications can be built.


EEG Eye tracker Affective computing 



This work was supported by the German Federal Ministry of Education and Research, FeuerWeRR Grant No. 13N13481, Amplify project (grant agreement no. 683008) and the German Research Foundation within the SimTech Cluster of Excellence (EXC 310/2).


  1. 1.
    ElKomy, M., Abdelrahman, Y., Funk, M., Dingler, T., Schmidt, A., Abdennadher, S.: ABBAS: an adaptive bio-sensors based assistive system. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2543–2550. ACM (2017)Google Scholar
  2. 2.
    Abdelrahman, Y., Hassib, M., Marquez, M.G., Funk, M., Schmidt, A.: Implicit engagement detection for interactive museums using brain-computer interfaces. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 838–845. ACM (2015)Google Scholar
  3. 3.
    Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., Vetere, F.: Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, no. 33, p. 20 (2017)Google Scholar
  4. 4.
    Kassem, K., Salah, J., Abdrabou, Y., Morsy, M., ElGendy, R., Abdelrahman, Y., Abdennadher, S.: DiVA: exploring the usage of pupil diameter to elicit valence and arousal. In: Proceedings of the 16th International Conference on MUM. ACM (2017)Google Scholar
  5. 5.
    Ng, R., Fishman, I., Bellugi, U.: Frontal asymmetry index in Williams syndrome: evidence for altered emotional brain circuitry? Soc. Neurosci. 10(4), 366–375 (2015)Google Scholar
  6. 6.
    Bos, D.O., et al.: EEG-based emotion recognition. The influence of visual and auditory stimuli, vol. 56, no. 3, pp. 1–17 (2006) Google Scholar
  7. 7.
    Liu, Y., Sourina, O., Nguyen, M.K.: Real-time EEG-based emotion recognition and its applications. In: Transactions on Computational Science, vol. XII, pp. 256–277. Springer (2011)Google Scholar
  8. 8.
    Soleymani, M., Pantic, M., Pun, T.: Multimodal emotion recognition in response to videos. IEEE Trans. Affect. Comput. 3(2), 211–223 (2012)CrossRefGoogle Scholar
  9. 9.
    Lu, Y., Zheng, W.-L., Li, B., Lu, B.-L.: Combining eye movements and EEG to enhance emotion recognition. In: IJCAI, pp. 1170–1176 (2015)Google Scholar
  10. 10.
    Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)CrossRefGoogle Scholar
  11. 11.
    Tomarken, A.J., Davidson, R.J., Wheeler, R.E., Doss, R.C.: Individual differences in anterior brain asymmetry and fundamental dimensions of emotion. J. Pers. Soc. Psychol. 62(4), 676 (1992)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Yasmeen Abdrabou
    • 1
    Email author
  • Khaled Kassem
    • 1
  • Jailan Salah
    • 1
  • Reem El-Gendy
    • 1
  • Mahesty Morsy
    • 1
  • Yomna Abdelrahman
    • 2
  • Slim Abdennadher
    • 1
  1. 1.German University in CairoCairoEgypt
  2. 2.University of StuttgartStuttgartGermany

Personalised recommendations