Advertisement

Detection of Emotions Induced by Colors in Compare of Two Nonlinear Mapping of Heart Rate Variability Signal: Triangle and Parabolic Phase Space (TPSM, PPSM)

  • Sadaf Moharreri
  • Nader Jafarnia DabanlooEmail author
  • Keivan Maghooli
Original Article
  • 33 Downloads

Abstract

Purpose

Emotions in the word mean understanding, sensing and recognizing something with one’s senses. Emotions are relatively simple responses that the body presents to external or internal stimuli. As the individual’s mental and emotional state changes, the activity of the various parts of the body also changes and increases. This applies to all cultures. So emotion detection from biological signals especially heart rate variability (HRV) signal is considered in this article.

Methods

The behavior of HRV in two nonlinear phase space have been evaluated and the extracted features of these two mapping have been used for emotion detection. Triangle and Parabolic Phase Space Mapping (TPSM and PPSM) are recently introduced methods which are able to indicate hidden aspects of HRV in response to different emotions. The Lead II of electrocardiogram signal was recorded from 32 female students while they were stimulated by four main psychology colors (blue, green, red, and yellow) to induce emotions which were labeled by SAM test.

Results

The results show that the mentioned colors caused emotions pleasure, joy, anger, and sadness, respectively. After rating the results by Kruskal–Wallis test, k-nearest neighbor classifier was used for emotion classification. The obtained accuracy after 10-fold cross validation was 90.91%.

Conclusions

The hypotheses of being a relationship between colors and emotions without awareness of subjects have been proved. Furthermore, by studying the usefulness of TPSM and PPSM as new mapping of HRV, significant results have obtained which indicate the advantages of using them. So it is suggested to use and analyze the usage of these kinds of colors in different psychological situations and for biofeedback tests.

Keywords

Heart rate variability Emotion recognition Triangle phase space mapping Parabolic phase space mapping Colors 

Abbreviations

HRV

Heart rate variability

ECG

Electrocardiogram

kNN

k-Nearest neighbor

ANS

Autonomic nervous system

TPSM

Triangle phase space mapping

PPSM

Parabolic phase space mapping

SAM

Self-assessment manikin

References

  1. 1.
    Agrafioti, F., Hatzinakos, D., & Anderson, A. K. (2012). ECG pattern analysis for emotion detection. IEEE Transactions on Affective Computing, 3(1), 102–115.CrossRefGoogle Scholar
  2. 2.
    Anttonen, J., & Surakka, V. (2005). Emotions and heart rate while sitting on a chair. Paper presented at the SIGCHI Conference of Human Factors in Computing Systems, Portland, Oregon, USA.Google Scholar
  3. 3.
    Averill, J. (1969). Autonomic response patterns during sadness and mirth. Psychophysiology, 5(1), 399–414.CrossRefGoogle Scholar
  4. 4.
    Backs, R. W., da Silva, S. P., & Han, K. (2005). A comparison of younger and older adults’ self-assessment manikin ratings of affective pictures. Experimental Aging Research, 31, 421–440.CrossRefGoogle Scholar
  5. 5.
    Blascovich, J., Seery, M., Mugridge, C., Norris, R., & Weisbuch, M. (2004). Predicting athletic performance from cardiovascular indexes of challenge and threat. Journal of Experimental Social Psychology, 40(5), 683–688.CrossRefGoogle Scholar
  6. 6.
    Bradley, M., & Lang, P. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59.CrossRefGoogle Scholar
  7. 7.
    Chang, C.-Y., Chang, C.-W., Zheng, J.-Y., & Chung, P.-C. (2013). Physiological emotion analysis using support vector regression. Neurocomputing, 122, 79–87.CrossRefGoogle Scholar
  8. 8.
    Dambacher, M., Eichinger, W., Theisen, K., & Frey, A. (1994). RT and systolic blood pressure variability after sympathetic stimulation during positive tilt in healthy volunteers. Computers in Cardiology.  https://doi.org/10.1109/CIC.1994.470127.CrossRefGoogle Scholar
  9. 9.
    Ekman, P., Levenson, R., & Friesen, W. (1983). Autonomic nervous system activity distinguishes among emotions. Science, 221, 1208–1210.CrossRefGoogle Scholar
  10. 10.
    Feldner, M. T., Zvolensky, M. J., Eifert, G. H., & Spira, A. P. (2003). Emotional avoidance: An experimental test of individual differences and response suppression using biological challenge. Behaviour Research and Therapy, 41, 403–411.CrossRefGoogle Scholar
  11. 11.
    Gendolla, G., Richter, M., & Friedrich, A. (2008). Task difficulty effects on cardiac activity. Psychophysiology, 45, 869–875.CrossRefGoogle Scholar
  12. 12.
    Goshvarpour, A., Abbasi, A., & Goshvarpour, A. (2017). A simple emotion discrimination technique based on triangle phase space mapping of HRV signals. International Journal of Engineering and Manufacturing (IJEM), 7(3), 41–48.CrossRefGoogle Scholar
  13. 13.
    Goshvarpour, A., Abbasi, A., & Goshvarpour, A. (2017). Indices from lagged poincare plots of heart rate variability: An efficient nonlinear tool for emotion discrimination. Australasian Physical Scientists and Engineers in Medicine, 40(2), 277–287.CrossRefGoogle Scholar
  14. 14.
    Goshvarpour, A., Abbasi, A., & Goshvarpour, A. (2017). Fusion of heart rate variability and pulse rate variability for emotion recognition using lagged poincare plots. Australasian Physical Scientists and Engineers in Medicine, 40, 617–629.CrossRefGoogle Scholar
  15. 15.
    Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004). Emotion recognition using bio-sensors: first steps towards an automatic system. Affect Dialogue Syst, 12, 36–48.CrossRefGoogle Scholar
  16. 16.
    Honig, F., Batliner, A., & Noth, E. (2007). Real time recognition of the affective user state with physiological signals. Paper presented at the Conference of Affective Computing and Intelligent Interaction.Google Scholar
  17. 17.
    Jafarnia Dabanloo, N., Attarodi, G., Moharreri, S., Parvaneh, S., & Nasrabadi, A. M. (2012). Emotion recognition based on utilizing occurrence sequence of heart rate’s phase space points. In The IASTED International Conference of Biomedical Engineering (BioMed2012), Innsbruck, Austria, (pp. 52–55). IEEE.Google Scholar
  18. 18.
    Jafarnia Dabanloo, N., Moharreri, S., Parvaneh, S., & Nasrabadi, A. M. (2010). New representation of heart rate and evaluation of extracted geometric features. Paper presented at the Computing in Cardiology (CinC), Belfast, Northern Ireland.Google Scholar
  19. 19.
    Jafarnia Dabanloo, N., Moharreri, S., Parvaneh, S., & Nasrabadi, A. M. (2010). Application of novel mapping for heart rate phase space and its role in cardiac arrhythmia diagnosis. Paper presented at the Computing in Cardiology (CinC 2010).Google Scholar
  20. 20.
    Keller, J. M., Gray, M. R., & Givens, J. A. (1985). A fuzzy K-nearest neighbor algorithm. IEEE Transaction on Systems, Man, and Cybernetics, 15(4), 580–585.CrossRefGoogle Scholar
  21. 21.
    Kim, J., & Andre, E. (2008). Emotion recognition based on physiological changes in music listening. IEEE Transaction on Pattern Analysis and machine Intelligence, 30(12), 2067–2083.CrossRefGoogle Scholar
  22. 22.
    Kim, K. H., Bang, S. W., & Kim, S. R. (2004). Emotion recognition system using short-term monitoring of physiological signals. Medical & Biological Engineering & Computing, 42, 419–427.CrossRefGoogle Scholar
  23. 23.
    Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006). Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology, 25(2), 141–158.CrossRefGoogle Scholar
  24. 24.
    Moharreri, S., Jafarnia Dabanloo, N., Parvaneh, S., & Nasrabadi, A. M. (2011).The relation between colors, emotions and heart response using triangle phase space mapping (TPSM). Paper presented at the Computing in Cardiology (CinC).Google Scholar
  25. 25.
    Moharreri, S., Jafarnia Dabanloo, N., Parvaneh, S., & Nasrabadi, A. M. (2011). The relation between colors, emotions and heart response using triangle phase space mapping (TPSM). Paper presented at the Computing in Cardiology (CinC2011).Google Scholar
  26. 26.
    Moharreri, S., Jafarnia Dabanloo, N., Parvaneh, S., & Nasrabadi, A.M. (2011). How to interpret psychology from heart rate variability? In Middle East Conference on Biomedical Engineering (MECBME), Sharjah, UAE, Vol. 1. IEEE.Google Scholar
  27. 27.
    Moharreri, S., Jafarnia Dabanloo, N., Parvaneh, S., Nasrabadi, A. M., & Attarodi, G. (2011). Personality psychology using heart responses to color stimulus. Paper presented at the Computing in Cardiology (CinC2011).Google Scholar
  28. 28.
    Moharreri, S., Rezaei, S., Jafarnia Dabanloo, A., & Parvaneh, S. (2014). Extended parabolic phase space mapping (EPPSM): Novel quadratic function for representation of heart rate variability signal. Paper presented at the Computing in Cardiology (CinC 2014).Google Scholar
  29. 29.
    Moharreri, S., Rezaei, S., Jafarnia Dabanloo, N., & Parvaneh, S. (2014). Study of induced emotion by color stimuli: power spectrum analysis of heart rate variability. Computing in Cardiology, 41, 977–980.Google Scholar
  30. 30.
    Moharreri, S., Rezaei, S., & Salavatian, S. (2013). Discrimination of heart arrhythmia using novel features in heart rate phase space. Paper presented at the Computing in Cardiology (CinC), Zaragoza, Spain.Google Scholar
  31. 31.
    Morris, J. D., Woo, C., Geason, J. A., & Kim, J. (2002). The power of affect: predicting intention. Journal of Advertising Research, 42, 7–17.CrossRefGoogle Scholar
  32. 32.
    Naji, M., Firoozabadi, M., & Azadfallah, P. (2014). Classification of music-induced emotions based on information fusion of forehead biosignals and electrocardiogram. Cognitive Computation, 6, 241–252.CrossRefGoogle Scholar
  33. 33.
    Nasoz, F., Alvarez, K., Lisetti, C., & Finkelstein, N. (2004). Emotion recognition from physiological signals using wireless sensors for presence technologies. International Journal of Cognition, Technology, and Work, 6(1), 4–14.CrossRefGoogle Scholar
  34. 34.
    Nasoz, F., & Lisetti, C. (2006). MAUI avatars: Mirroring the user’s sensed emotions via expressive multi-ethnic facial avatars. Journal of Visual Languages and Computing, 17, 430–444.CrossRefGoogle Scholar
  35. 35.
    Picard, R., Vyzas, E., & Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(10), 1175–1191.CrossRefGoogle Scholar
  36. 36.
    Pramila, R., Sims, J., Brackin, R., & Sarkar, N. (2002). Online stress detection using psychophysiological signals for implict human–robot cooperation. Robotica, 20(6), 673–685.Google Scholar
  37. 37.
    Rezaei, S., Moharreri, S., Ghiasi, S., & Parvaneh, S. (2017). Emotion recognition using parabolic phase space mapping for heart rate variability analysis. Paper presented at the Computing in Cardiology (CinC).Google Scholar
  38. 38.
    Schwarts, G., Weinberger, D. A., & Singer, J. A. (1981). Cardiovascular differentiation of happiness, sadness, anger, and fear following imagery and exercise. Psychosomatic Medicine, 43, 343–364.CrossRefGoogle Scholar
  39. 39.
    Shouldice, R., Heneghan, C., Nolan, P., & Nolan, P. (2003). PR and PP ECG intervals as indicators of autonomic nervous innervation of the cardiac sinoatrial and atrioventricular nodes. Paper presented at the First IEEE International Conference of Neural Engineering.Google Scholar
  40. 40.
    Sinha, R., Lovallo, W., & Parsons, O. (1992). Cardiovascular differentiation of emotions. Psychosomatic Medicine, 54, 422–435.CrossRefGoogle Scholar
  41. 41.
    Stemmler, G., Aue, T., & Wacker, J. (2007). Anger and fear: Separable effects of emotion and motivational direction on somatovisceral responses. International Journal of Psychophysiology, 66, 141–153.CrossRefGoogle Scholar
  42. 42.
    Ue, H., Masuda, I., Yoshitake, Y., Inazumi, Y., & Moritani, T. (2000). Assessment of cardiac autonomic nervous activities by means of ECG RR interval power spectral analysis and cardiac depolarization-repolarization process. Annals of Nininvasive Electrocardiology, 5(4), 336–345.CrossRefGoogle Scholar
  43. 43.
    Virtanen, R., Jula, A., Salminen, J., Voipio-Pulkki, L., Helenius, H., & Kuusela, T. (2003). Anxiety and hostility are associated with reduced baroreflex sensitivity & increased beat to beat blood pressure variability. Psychosomatic Medicine, 65, 751–756.CrossRefGoogle Scholar
  44. 44.
    Wasmund, W., Wasterholm, E., Watenpaugh, D., & Wamund, S. (2002). Interactive effects of mental and physical stress on cardiovascular control. Journal of Applied Physiology, 92, 1828–1834.CrossRefGoogle Scholar

Copyright information

© Taiwanese Society of Biomedical Engineering 2019

Authors and Affiliations

  • Sadaf Moharreri
    • 1
  • Nader Jafarnia Dabanloo
    • 1
    Email author
  • Keivan Maghooli
    • 1
  1. 1.Department of Biomedical Engineering, Science and Research BranchIslamic Azad UniversityTehranIran

Personalised recommendations