Embodied Emotion Recognition System

  • Ayoung Cho
  • Hyunwoo Lee
  • Hyeonsang Hwang
  • Youseop Jo
  • Mincheol WhangEmail author
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 474)


The relationships among body, brain, and environment have been important to recognize emotions according to the embodied emotion theory. Its relationships should be analyzed in real time because the relationships have been changed every moment. Therefore, this study has developed a system that automatically analyzes the complicated interactions based on personal data by path analysis in real time. The system has three phases: First, data have been collected with a wearable and smartphone device to measure photoplethysmogram (PPG), global positioning system (GPS) locations, and ambient noise. Second, features have been extracted by preprocessing. Finally, interactions have been determined by calculating the directed dependencies with path analysis. As a result, the relationships are presented in directed graphs form. This system is expected to be a useful platform to recognize and to predict human behavior based on the interactions among body response, brain response, and environment.


Embodied emotion Life-logging Path analysis 



This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No.2015-0-00312, The development of technology for social life logging based on analyzing social emotion and intelligence of convergence contents)


  1. 1.
    Wilson, M.: Six views of embodied cognition. Psychon. Bull. Rev. 9(4), 625–636 (2002)CrossRefGoogle Scholar
  2. 2.
    Beer, R.D.: The dynamics of brain-body-environment systems: a status report. handbook of cognitive science: An Embodied Approach, Elsevier Science, San Diego, pp. 99–120 (2008)Google Scholar
  3. 3.
    Varela, F.J., Thompson, E., Rosch, E.: The Embodied Mind: Cognitive Science And Human Experience. MIT press, Cambridge (2017)Google Scholar
  4. 4.
    Garbarini, F., Adenzato, M.: At the root of embodied cognition: cognitive science meets neurophysiology. Brain Cogn. 56(1), 100–106 (2004)CrossRefGoogle Scholar
  5. 5.
    Borghi, A.M., Cimatti, F.: Embodied cognition and beyond: acting and sensing the body. Neuropsychologia 48(3), 763–773 (2010)CrossRefGoogle Scholar
  6. 6.
    Hutchins, E.: Cognitive ecology. Top. Cogn. Sci. 2(4), 705–715 (2010)Google Scholar
  7. 7.
    McCraty, R., Watkins, A.: Autonomic assessment report: A comprehensive heart rate variability analysis. Heart math research center reports. Boulder Creek, CA: Institute of Heart Math (1996)Google Scholar
  8. 8.
    Saeb, S., Zhang, M., Karr, C.J., Schueller, S.M., Corden, M.E., Kording, K.P., Mohr, D.C.: Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J. Med. Internet Res., 17, p. 7 (2015)Google Scholar
  9. 9.
    Shenkin, P.S., Erman, B., Mastrandrea, L.D.: Information-theoretical entropy as a measure of sequence variability. Proteins 11(4), 297–313 (1991)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Ayoung Cho
    • 1
  • Hyunwoo Lee
    • 1
  • Hyeonsang Hwang
    • 2
  • Youseop Jo
    • 1
  • Mincheol Whang
    • 3
    Email author
  1. 1.Department of Emotion EngineeringSangmyung UniversitySeoulRepublic of Korea
  2. 2.Department of Computer ScienceSangmyung UniversitySeoulRepublic of Korea
  3. 3.Department of Intelligent Engineering Information for HumanSangmyung UniversitySeoulRepublic of Korea

Personalised recommendations