Abstract
Previous research showed that supervised dimensionality reduction using Neighborhood Components Analysis (NCA) enhanced the performance of 3-class problem emotion recognition using ECG only where features were the statistical distribution of dominant frequencies and the first differences after applying bivariate empirical mode decomposition (BEMD). This paper explores how much NCA enhances emotion recognition using ECG-derived features, esp. standard HRV features with two difference normalization methods and statistical distribution of instantaneous frequencies and the first differences calculated using Hilbert-Huang Transform (HHT) after empirical mode decomposition (EMD) and BEMD. Results with the MAHNOB-HCI database were validated using subject-dependent and subject-independent scenarios with kNN as classifier for 3-class problem in valence and arousal. A t-test was used to assess the results with significance level 0.05. Results show that NCA enhances the performance up to 74% from the implementation without NCA with p-values close to zero in most cases. Different feature extraction methods offered different performance levels in the baseline but the NCA enhanced them such that the performances were close to each other. In most experiments use of combined standardized and normalized HRV-based features improved performance. Using NCA on this database improved the standard deviation significantly for HRV-based features under subject-independent scenario.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ferdinando, H., Seppänen, T., Alasaarela, E.: Enhancing emotion recognition from ECG signals using supervised dimensionality reduction. In: Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, pp. 112–118. Scitepress, Porto (2017)
Ferdinando, H., Seppänen, T., Alasaarela, E.: Comparing features from ECG pattern and HRV analysis for emotion recognition system. In: 2016 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), pp. 1–6. IEEE. Chiang Mai (2016)
Goldberger, J., Roweis, S., Hinton, G., Salakhutdinov, R.: Neighbourhood components analysis. Adv. Neural. Inf. Process. Syst. 17, 1–8 (2004)
Globerson, A., Roweis, S.: Metric learning by collapsing classes. Neural Inf. Process. Syst. 18, 451–458 (2005)
Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10, 207–244 (2009)
Orlitsky, A.: Supervised dimensionality reduction using mixture models. In: Proceedings of the 22nd International Conference on Machine Learning (ICML), pp. 768–775. ACM, Bonn (2005)
Pereira, F., Gordon, G.: The support vector decomposition machine. In: Proceedings of the 23rd International Conference on Machine Learning (ICML), pp. 689–696. ACM, Pittsburgh (2006)
van der Maaten, L.: Matlab Toolbox for Dimensionality Reduction. https://lvdmaaten.github.io/drtoolbox/
Soleymani, M., Lichtenauer, J., Pun, T., Pantic, M.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3, 42–55 (2012)
Ringeval, F., Sonderegger, A., Sauer, J., Lalanne, D.: Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition FG 2013 (2013)
Abadi, M.K., Subramanian, R., Kia, S.M., Avesani, P., Patras, I., Sebe, N.: DECAF: MEG-based multimodal database for decoding affective physiological responses. IEEE Trans. Affect. Comput. 6, 209–222 (2015)
Wagner, J., Kim, J., Andre, E.: From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: 2005 IEEE International Conference on Multimedia and Expo, pp. 940–943. IEEE (2005)
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., Patras, I.: DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3, 18–31 (2012)
Task-force: Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Eur. Heart J. 17, 354–381 (1996)
Valenza, G., Citi, L., Lanatá, A., Scilingo, E.P., Barbieri, R.: Revealing real-time emotional responses: a personalized assessment based on heartbeat dynamics. Sci. Rep. 4, 4998 (2014)
Konar, A., Chakraborty, A.: Emotion Recognition: A Pattern Analysis Approach. Wiley, Hoboken (2015)
Valenza, G., Lanata, A., Scilingo, E.P.: The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans. Affect. Comput. 3, 237–249 (2012)
Agrafioti, F., Hatzinakos, D., Anderson, A.K.: ECG pattern analysis for emotion detection. IEEE Trans. Affect. Comput. 3, 102–115 (2012)
Ferdinando, H., Ye, L., Seppänen, T., Alasaarela, E.: Emotion recognition by heart rate variability. Aust. J. Basic Appl. Sci. 8, 50–55 (2014)
McSharry, P.E., Clifford, G.D., Tarassenko, L., Smith, L.A.: A dynamical model for generating synthetic electrocardiogram signals. IEEE Trans. Biomed. Eng. 50, 289–294 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Ferdinando, H., Seppänen, T., Alasaarela, E. (2018). Emotion Recognition Using Neighborhood Components Analysis and ECG/HRV-Based Features. In: De Marsico, M., di Baja, G., Fred, A. (eds) Pattern Recognition Applications and Methods. ICPRAM 2017. Lecture Notes in Computer Science(), vol 10857. Springer, Cham. https://doi.org/10.1007/978-3-319-93647-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-93647-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93646-8
Online ISBN: 978-3-319-93647-5
eBook Packages: Computer ScienceComputer Science (R0)