Exploring the Usage of EEG and Pupil Diameter to Detect Elicited Valence
Brain signals are a reliable information source because human beings have limited voluntary control over. We examine EEG readings as a reporting tool concerning human emotions. We examine whether readings from an eye tracker, can enhance the results. We conducted an experiment on 25 users to measure their EEG signals in response to emotional stimuli. All sensors used were off-the-shelf, to test our method using cheap sensors. We used pleasant and unpleasant videos content to elicit emotional responses. Along with Self-Assessment Mannequin (SAM), Alpha symmetry index readings, and pupil diameter, were recorded. Our results show a significant difference in the video clips eliciting different emotions. This implies that EEG can be a valid way to detect emotional state, especially when combined with eye-tracker. We conclude from our findings that EEG can be used as a platform, upon which reliable affect-aware systems and applications can be built.
KeywordsEEG Eye tracker Affective computing
This work was supported by the German Federal Ministry of Education and Research, FeuerWeRR Grant No. 13N13481, Amplify project (grant agreement no. 683008) and the German Research Foundation within the SimTech Cluster of Excellence (EXC 310/2).
- 1.ElKomy, M., Abdelrahman, Y., Funk, M., Dingler, T., Schmidt, A., Abdennadher, S.: ABBAS: an adaptive bio-sensors based assistive system. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2543–2550. ACM (2017)Google Scholar
- 2.Abdelrahman, Y., Hassib, M., Marquez, M.G., Funk, M., Schmidt, A.: Implicit engagement detection for interactive museums using brain-computer interfaces. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 838–845. ACM (2015)Google Scholar
- 3.Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., Vetere, F.: Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, no. 33, p. 20 (2017)Google Scholar
- 4.Kassem, K., Salah, J., Abdrabou, Y., Morsy, M., ElGendy, R., Abdelrahman, Y., Abdennadher, S.: DiVA: exploring the usage of pupil diameter to elicit valence and arousal. In: Proceedings of the 16th International Conference on MUM. ACM (2017)Google Scholar
- 5.Ng, R., Fishman, I., Bellugi, U.: Frontal asymmetry index in Williams syndrome: evidence for altered emotional brain circuitry? Soc. Neurosci. 10(4), 366–375 (2015)Google Scholar
- 6.Bos, D.O., et al.: EEG-based emotion recognition. The influence of visual and auditory stimuli, vol. 56, no. 3, pp. 1–17 (2006) Google Scholar
- 7.Liu, Y., Sourina, O., Nguyen, M.K.: Real-time EEG-based emotion recognition and its applications. In: Transactions on Computational Science, vol. XII, pp. 256–277. Springer (2011)Google Scholar
- 9.Lu, Y., Zheng, W.-L., Li, B., Lu, B.-L.: Combining eye movements and EEG to enhance emotion recognition. In: IJCAI, pp. 1170–1176 (2015)Google Scholar