An Affective BCI Using Multiple ERP Components Associated to Facial Emotion Processing
P300-based brain computer interfaces (BCIs) have successfully demonstrated that attention to an oddball stimulus can enhance the P300 component of the event-related potential (ERP) phase-locked to the event. However, it was unclear whether the more sophisticated face-evoked potentials can also be modulated by related mental tasks under the oddball paradigm. This study investigated ERP responses to image stimuli of objects, neutral faces, and emotional faces when subjects perform attention, face recognition and discrimination of emotional facial expressions respectively under the oddball paradigm. The results revealed the significant difference between target and non-target ERPs for each mental task. In addition, significant differences among the three mental tasks were observed for vertex-positive potential (VPP) over the fronto-central sites, late positive potential (LPP)/P3b over the centro-parietal sites and N250 over the occipito-temporal sites. These findings indicate that a novel affective BCI paradigm can be developed based on detection of multiple ERP components reflecting human face encoding and emotion processing. The high classification performance for single-trial emotional face-related ERPs demonstrated the effectiveness of the affective BCI.
The work was supported by JSPS Grants-in-Aid for Scientific Research (grant number 24700154) and the National Natural Science Foundation of China (grant number 61202155).
- L. Acqualagnav, M. Treder, M. Schreuder, B. Blankertz, A novel brain-computer interface based on the rapid serial visual presentation paradigm, in Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE (IEEE, 2010), pp. 2686–2689Google Scholar
- S. Makeig, G. Leslie, T. Mullen, D. Sarma, N. Bigdely-Shamlo, C. Kothe, First demonstration of a musical emotion BCI, in Affective Computing and Intelligent Interaction, 2011, pp. 487–496Google Scholar
- A. Nijholt, B. Allison, S. Dunne, D. Heylen et al., Affective brain-computer interfaces (abci 2011), in Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction-Volume Part II (Springer-Verlag (2011), pp. 435–435Google Scholar
- A. Onishi, Y. Zhang, Q. Zhao, A. Cichocki, Fast and reliable P300-based BCI with facial images, in Proceedings of the 5th International Brain-Computer Interface Conference, 2011, pp. 192–195Google Scholar
- J. Wolpaw, N. Birbaumer, D. McFarland, G. Pfurtscheller, T. Vaughan, Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)Google Scholar
- Q. Zhao, A. Onishi, Y. Zhang, J. Cao, L. Zhang, A. Cichocki, A novel oddball paradigm for affective BCIs using emotional faces as stimuli. Lecture Notes in Computer Science, vol. 7062, 2011, pp. 279–286Google Scholar