Consideration of Multiple Components of Emotions in Human-Technology Interaction

  • Sascha Mahlke
  • Michael Minge
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4868)


The study of users’ emotional behavior as an important aspect of the user experience has been receiving increasing attention for the past few years. In this paper we discuss the multi-component character of emotions and its consideration in the area of human-technology interaction. Based on the approach proposed by Scherer [1], various aspects of emotions were investigated in an interactive context: subjective feelings, physiological activation, motor expression, cognitive appraisals, and behavioral tendencies. In an experiment emotion-related changes were detected for a number of emo tional components by using a variety of methods: rating scales for sub jec tive feelings, electromyography of facial muscles, heart rate, electrodermal activity, perfor mance data and questionnaires on cognitive appraisals. Results are discussed with respect to the correlation between the components and their associated methods. We suggest that a combination of methods provides a comprehensive basis for analyzing emotions as an aspect of the user experience.


Facial Expression Subjective Feeling Cognitive Appraisal Behavioral Tendency Electrodermal Activity 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Scherer, K.R.: On the nature and function of emotion: A component process approach. In: Scherer, K.R., Ekman, P. (eds.) Approaches to emotion, pp. 293–317. Erlbaum, Hillsdale (1984)Google Scholar
  2. 2.
    Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahnemann, D., Diener, E., Schwarz, N. (eds.) Well-Being - the foundations of hedonic psychology, New York, Russel Sage Foundation, pp. 40–60 (1999)Google Scholar
  3. 3.
    Brave, S., Nass, C.: Emotion in HCI. In: Jacko, J., Sears, A. (eds.) The Human-Computer-Interaction Handbook, pp. 81–96. Lawrence Erlbaum, Erlbaum (2003)Google Scholar
  4. 4.
    Izard, C.E.: Human Emotions. Plenum Press, New York (1977)Google Scholar
  5. 5.
    Lazarus, R.S.: Emotion and adaptation. Oxford University Press, New York (1991)Google Scholar
  6. 6.
    Scherer, K.R.: Appraisal considered as a process of multi-level sequential checking. In: Scherer, K.R., Schorr, A., Johnstone, T. (eds.) Appraisal processes in emotion: Theory, methods, research, pp. 92–120. Oxford University Press, New York (2001)Google Scholar
  7. 7.
    Mehrabian, A., Russell, J.A.: An approach to environmental psychology. MIT Press, Cambridge (1974)Google Scholar
  8. 8.
    Russell, J.A.: A circumplex model of affect. Journal of Personality and Social Psychology 39, 1281–1288 (1980)Google Scholar
  9. 9.
    Lang, P.J.: Behavioral treatment and bio-behavioral assessment: Computer applications. In: Sidowski, J.B., Johnson, H., Williams, T.A. (eds.) Technology in Mental Health Care Delivery Systems, Norwood NJ, pp. 119–137. Ablex Publishing, Greenwich (1980)Google Scholar
  10. 10.
    Russell, J.A., Weiss, A., Mendelssohn, G.A.: The Affect Grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology 57, 493–502 (1989)CrossRefGoogle Scholar
  11. 11.
    Ward, R.D., Marsden, P.H.: Physiological responses to different WEB page designs. International Journal of Human-Computer Studies 59, 199–212 (2003)CrossRefGoogle Scholar
  12. 12.
    Herbon, A., Peter, C., Markert, L., van der Meer, E., Voskamp, J.: Emotion studies in HCI - a new approach. In: HCII 2005 proceedings, Lawrence Erlbaum, Mahwah (2005)Google Scholar
  13. 13.
    Fahrenberg, J.: Physiologische Grundlagen und Messmethoden der Herz-Kreislaufaktivit at Physiological fundamentals and measuring methods of cardiovascular activity. In: Rösler, F. (ed.) Grundlagen und Methoden der Psychophysiologie, pp. 317–454. Gottingen, Hogrefe (2001)Google Scholar
  14. 14.
    Bradley, M.M., Greenwald, M.K., Hamm, A.O.: Affective Picture Processing and the semantic differential. Journal of Behavioural Therapy and Experimental Psychiatry 25, 204–215 (1993)Google Scholar
  15. 15.
    Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin 91, 276–292 (1982)CrossRefGoogle Scholar
  16. 16.
    Hess, E.H., Polt, J.M.: Pupil Size in Relation to Interest Value of Visual Stimuli. Science 132, 250–349 (1960)CrossRefGoogle Scholar
  17. 17.
    Ekman, P.: Are there basic emotions. Psychological Review 99, 550–553 (1992)CrossRefGoogle Scholar
  18. 18.
    Cohen, I., Garg, A., Huang, T.S.: Emotion Recognition from Facial Expressions using Multilevel HMM (2000),
  19. 19.
    Cacioppo, J.T., Petty, R.E., Losch., M.E., Kim, H.S.: Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. Journal of Personality and Social Psychology 50, 260–268 (1986)CrossRefGoogle Scholar
  20. 20.
    Dimberg, U.: Facial electromyography and emotional reactions. Psychophysiology 19, 643–647 (1990)CrossRefGoogle Scholar
  21. 21.
    Banse, R., Scherer, K.R.: Acoustic Profiles in Vocal Emotion Expression. Journal of Personality and Social Psychology 70, 614–636 (1996)CrossRefGoogle Scholar
  22. 22.
    Smith, C.A., Ellsworth, P.C.: Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology 48, 813–838 (1985)CrossRefGoogle Scholar
  23. 23.
    Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1988)Google Scholar
  24. 24.
    Frijda, N.H.: The Laws of Emotion. American Psychologist 43, 349–358 (1988)CrossRefGoogle Scholar
  25. 25.
    Ellsworth, P.C., Scherer, K.R.: Appraisal processes in emotion. In: Davidson, R.J., Goldsmith, H., Scherer, K.R. (eds.) Handbook of the Affective Sciences, pp. 572–595. Oxford University Press, New York (2004)Google Scholar
  26. 26.
    Schorr, A.: Subjective measurment in appraisal research: present state and future perspectives. In: Scherer, K.R., Schorr, A., Johnstone, T. (eds.) Appraisal Processes in Emotion: Theory, Methods, Research, pp. 331–349. Oxford University Press, New York (2001)Google Scholar
  27. 27.
    Partala, T., Surakka, V.: The effects of affective interventions in human-computer interaction. Interacting with Computers 16, 295–309 (2004)CrossRefGoogle Scholar
  28. 28.
    Mentis, H., Gay, G.: User Recalled Occurrences of Usability errors: Implications on the User Experience. In: CHI 2003 extended abstracts, pp. 736–737. ACM Press, New York (2003)CrossRefGoogle Scholar
  29. 29.
    Lang, P.J., Greenwald, M.K., Bradley, M.M., Hamm, A.O.: Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 30, 261–273 (1993)Google Scholar
  30. 30.
    Mahlke, S., Thüring, M.: Studying Antecedents of Emotional Experiences in Interactive Contexts. In: CHI 2007 proceedings, pp. 915–918. ACM Press, New York (2007)Google Scholar
  31. 31.
    Carbon, C.-C., Hutzler, F., Minge, M.: Innovativeness in design investigated by eye movements and pupillometry. Psychology Science 48, 173–186 (2006)Google Scholar
  32. 32.
    Hassenzahl, M., Sandweg, N.: From Mental Effort to Perceived Usability: Transforming Experiences into Summary Assessments. In: CHI 2004 extended abstracts, pp. 1283–1286. ACM Press, New York (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Sascha Mahlke
    • 1
  • Michael Minge
    • 1
  1. 1.Centre of Human-Machine-SystemsTechnische Universität Berlin 

Personalised recommendations