Skip to main content
SpringerLink
Log in
Book cover

Computational Intelligence and Decision Making pp 323–332Cite as

Affect Recognition

  • Conference paper
  • First Online:

Part of the book series: Intelligent Systems, Control and Automation: Science and Engineering ((ISCA,volume 61))

Abstract

This survey describes the advances in affect recognition from the first emotion theories and models to affective computer techniques used in affect detection. These techniques allow the recognition of human body physical features, such as the facial expression, voice intonation, gestures or movements and physiological aspects such as respiration, skin color, temperature, heartbeat, blood pressure, pupillary dilation. Emotions can then, be inferred from the referred features analysis performed according to any chosen emotion theory.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Picard RW et al (2004) Affective learning — a manifesto. BT Technol J 22(4):253–269

    Article  Google Scholar 

  2. Kleinginna PR, Kleinginna AM (1981) A categorized list of emotion definitions, with suggestions for a consensual definition. Motiv Emot 5(4):345–379

    Article  Google Scholar 

  3. Darwin C (1872) The expression of the emotions in man and animals. John Murray, London

    Book  Google Scholar 

  4. Hess U, Thibault P (2009) Darwin and emotion expression. Am Psychol 64(2):120–128

    Article  Google Scholar 

  5. Ortony A, Turner TJ (1990) What’s basic about basic emotions? Psychol Rev 97(3):315–331

    Article  Google Scholar 

  6. Russell JA, Bachorowski J-A, Fernandez-Dols J-M (2003) Facial and vocal expressions of emotion. Annu Rev Psychol 54:329–349

    Article  Google Scholar 

  7. Ekman P, Friesen WV, Ellsworth P (1982) Emotion in the human face. In: Ekman P (ed) Emotion in the human face, vol 2. Cambridge University Press, New York, p 464

    Google Scholar 

  8. Manstead A, Tetlock PE (1989) Cognitive appraisals and emotional experience: further evidence. Cognit Emot 3:225–240

    Article  Google Scholar 

  9. Smith CA, Ellsworth PC (1985) Patterns of cognitive appraisal in emotion. J Personal Soc Psychol 48(4):813–838

    Article  Google Scholar 

  10. Ortony A, Clore GL, Collins A (1988) The cognitive structure of emotions, vol 18. Cambridge University Press, Cambridge, p 224

    Book  Google Scholar 

  11. Roseman IJ, Spindel MS, Jose PE (1990) Appraisals of emotion-eliciting events: testing a theory of discrete emotions. J Personal Soc Psychol 59(5):899–915

    Article  Google Scholar 

  12. Calvo RA, Mello SD (2010) Affect detection: an interdisciplinary review of models, methods, and their applications. Rev Lit Art Am 1(1):18–37

    Google Scholar 

  13. Wehrle T, Scherer KR (2001) Towards computational modeling of appraisal theories. In: Scherer KR, Schorr A, Johnstone T (eds) Appraisal theories of emotions: theories, methods, research. Oxford University Press, New York, pp 350–365

    Google Scholar 

  14. Chibelushi CC, Bourel F (2002) Facial expression recognition: a brief tutorial overview. School of Computing, Staffordshire University, Staffordshire

    Google Scholar 

  15. Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110(1):145–172

    Article  Google Scholar 

  16. Turner JH, Stets JE (2006) Sociological theories of human emotions. Annu Rev Sociol 32(1):25–52

    Article  Google Scholar 

  17. Dalgleish T, Dunn B, Mobbs D (2009) Affective neuroscience: past, present, and future. Emot Rev 1(4):355–368

    Article  Google Scholar 

  18. Davidson R (2003) Seven sins in the study of emotion: correctives from affective neuroscience. Brain Cognit 52(1):129–132

    Article  Google Scholar 

  19. Liu Y, Sourina O, Nguyen MK (2010) Real-time EEG-based human emotion recognition and Visualization. In: 2010 international conference on cyberworlds, pp 262–269. doi:10.1109/CW.2010.37

  20. Shen L, Wang M, Shen R (2009) Affective e-learning: using ‘emotional’ data to improve learning in pervasive learning environment related work and the pervasive e-learning platform. Learning 12:176–189

    Google Scholar 

  21. Fischer R (October 2004) Automatic facial expression analysis and emotional classification. S.M. thesis, Math & Natural Sciences, MIT/University of Applied Science Darmstadt, Germany

    Google Scholar 

  22. Ekman P, Friesen WV (1978) Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press 1978. Consulting Psychologists Press. Retrieved from http://www.citeulike.org/user/DocNero/article/3171485

  23. Donato GL, Bartlett MS, Hager JC, Ekman P, Sejnowski TJ (1999) Classifying facial actions. IEEE Trans Pattern Anal Mach Intell 21(10):974–989

    Article  Google Scholar 

  24. Gunes H, Piccardi M (2007) Bi-modal emotion recognition from expressive face and body gestures. J Netw Comput Appl 30(4):1334–1345

    Article  Google Scholar 

  25. Bänziger T, Grandjean D, Scherer KR (2009) Emotion recognition from expressions in face, voice, and body: the Multimodal Emotion Recognition Test (MERT). Emotion 9(5):691–704, Washington, DC

    Article  Google Scholar 

  26. Bull P (1987) Posture and gesture. Pergamon Press, New York

    Google Scholar 

  27. Meijer M (1989) The contribution of general features of body movement to the attribution of emotions. J Nonverbal Behav 13(4):247–268

    Article  Google Scholar 

  28. Mota S, Picard RW (2003) Automated posture analysis for detecting learner’s interest level. Media 5:49

    Google Scholar 

  29. Mello SD, Graesser A, Hall D (2009) Automatic detection of learner’s affect from gross body language. Appl Artif Intell 23:123–150

    Article  Google Scholar 

  30. Jakob de Lemos OJ, Sadeghnia Golam Reza, Ólafsdóttir Íris (2008) Measuring emotions using eye tracking. Int J 2008:2008–2008

    Google Scholar 

  31. Partala T (2003) Pupil size variation as an indication of affective processing. Int J Hum Comput Stud 59(1–2):185–198

    Article  Google Scholar 

  32. Dawson ME, Schell AM, Bohmelt AH (1999) Startle modification: implications for neuroscience, cognitive science, and clinical science: implications for neuroscience, cognitive science, and clinical science, vol 14. Cambridge University Press, Cambridge, 383

    Google Scholar 

  33. Calvo MG, Lang PJ (2004) Gaze patterns when looking at emotional pictures: motivationally biased attention. Motiv Emot 28(3):221–243

    Article  Google Scholar 

  34. Duchowski AT (2002) A breadth-first survey of eye-tracking applications. Behavior research methods, instruments, & computers. J Psychon Soc Inc 34(4):455–470

    Google Scholar 

  35. Wu S, Falk TH, Chan W-Y (2010) Automatic speech emotion recognition using modulation spectral features. Speech Commun 53(5):768–785

    Google Scholar 

  36. Scherer KR, Johnstone T, Klasmeyer G (2003) Vocal expression of emotion. In: Davidson RJ, Scherer KR, Barrett LF (eds) Handbook of affective sciences. Oxford University Press, New York, pp 433–456

    Google Scholar 

  37. Andreassi JL (2007) Human Behaviour and Physiological Response. Taylor & Francis e-Library 2009

    Google Scholar 

  38. Panksepp J (1998) Affective neuroscience: the foundations of human and animal emotions. Oxford University Press, New York, p 466

    Google Scholar 

  39. Immordino-Yang MH, Damasio A (2007) We feel, therefore we learn: the relevance of affective and social neuroscience to education. Mind Brain Educ 1(1):3–10

    Article  Google Scholar 

  40. Olofsson JK, Nordin S, Sequeira H, Polich J (2008) Affective picture processing: an integrative review of ERP findings. Biol Psychol 77(3):247–265

    Article  Google Scholar 

  41. Osgood CE, May WH, Miron MS (1975) Cross-cultural universals of affective meaning. University of Illinois Press, Urbana, p 486. Retrieved from http://books.google.com/books?id=Ax9CFVxXYD4C&printsec=frontcover&source=gbs_navlinks_s#v=onepage&q&f=false

    Google Scholar 

  42. Shields CG et al (2005) Emotion language in primary care encounters: reliability and validity of an emotion word count coding system. Patient Educ Counc 57(2):232–238

    Article  Google Scholar 

  43. Hancock J, Landrigan C, Silver C (2007). Expressing emotion in text-based communication. In: Proceedings of the ACM conference on human factors in computing systems (CHI 2007), pp 929–932

    Google Scholar 

  44. Pennebaker JW, Francis ME, Booth RJ (2001) Linguistic inquiry and word count. Word J Int Linguist Assoc: 2–21

    Google Scholar 

  45. Jaimes A, Sebe N (2007) Multimodal human–computer interaction: a survey. Comput Vis Image Underst 108(1–2):116–134

    Article  Google Scholar 

  46. Maat L, Pantic M (2006) Gaze-X: adaptive affective multimodal interface for single-user office scenarios. Human Factors. In: Proceedings of ACM international conference on multimodal interfaces, pp 171–178

    Google Scholar 

  47. Kapoor A, Burleson W, Picard R (2007) Automatic prediction of frustration. Int J Hum Comput Stud 65(8):724–736

    Article  Google Scholar 

  48. Multimodal Human Computer Interaction Project (n.d.) http://itr.beckman.uiuc.edu/index.html. Retrieved 9 May 2011

Download references

Acknowledgments

This work is supported by FEDER Funds through the “Programa Operacional Factores de Competitividade – COMPETE” program and by National Funds through FCT “Fundação para a Ciência e a Tecnologia” under the project: FCOMP-01-0124-FEDER-PEst-OE/EEI/UI0760/2011.

Author information

Authors and Affiliations

  1. Computer Science Department, Institute of Engineering – Polytechnic of Porto (ISEP/IPP), Porto, Portugal

    Raquel Faria & Ana Almeida

  2. GECAD – Knowledge Engineering and Decision Support Research Center, Institute of Engineering – Polytechnic of Porto (ISEP/IPP), Porto, Portugal

    Ana Almeida

Authors
  1. Raquel Faria
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ana Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Raquel Faria or Ana Almeida .

Editor information

Editors and Affiliations

  1. Computer Science Department, Polytechnique Institute of Porto, Rua Dr. Bernardino de Almeida 431, Porto, 4200-072, Portugal

    Ana Madureira

  2. Electrical and Engineering Department, Polytechnique Institute of Porto, Rua Dr. Bernardino de Almeida 431, Porto, 4200-072, Portugal

    Cecilia Reis

  3. , Department of Computer Science and Syste, Polytechnique Institute of Coimbra, Rua Pedro Nunes - Quinta da Nora, Coimbra, 3030-199, Portugal

    Viriato Marques

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht

About this paper

Cite this paper

Faria, R., Almeida, A. (2013). Affect Recognition. In: Madureira, A., Reis, C., Marques, V. (eds) Computational Intelligence and Decision Making. Intelligent Systems, Control and Automation: Science and Engineering, vol 61. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4722-7_30

Download citation

  • DOI: https://doi.org/10.1007/978-94-007-4722-7_30

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-007-4721-0

  • Online ISBN: 978-94-007-4722-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation