Deducing User States of Engagement in Real Time by Using a Purpose Built Unobtrusive Physiological Measurement Device: An Empirical Study and HCI Design Challenges

  • Anthony Psaltis
  • Charalampos Rizopoulos
  • Zacharias Lekkas
  • Constantinos Mourlas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8534)


Human emotion is a psycho-physiological state in most cases not obvious to the subject. Different permutations of emotional constituents sometimes cause similar outward expressions; therefore facial expression methods cannot achieve reliable estimates. Sensing physiological manifestations of hormonal and neural stimulations instigated by emotion and affect is widely accepted as a credible method of detecting psycho-physiological states. A major impediment in interactive environments employing physiological sensing affecting the credibility of measurements is the physical and psychological impairment caused by electrodes and wiring used for the acquisition of signals. In the system described in this paper, the above obstacle has been overcome. Physiological signals acquired via an in-house developed computer mouse and coinciding physiological patterns were investigated as reactions to emotion raising events. A classification algorithm analyzed herein produced a real time allocation model of states of engagement. Experiments have revealed strong correlations between events and respective emotional states.


HCI Biofeedback Measurements Affective Interactions User Evaluation Stress Loading 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    O’Brien, H.L., Toms, E.G.: What is user engagement? A Conceptual Framework for Defining User Engagement with Technology. Journal of the American Society for Information Science & Technology 59, 938–955 (2008)CrossRefGoogle Scholar
  2. 2.
    O’Brien, H.L., Toms, E.G.: The development and evaluation of a survey to measure user engagement in e-commerce environments. Journal of the American Society for Information Science & Technology 61, 50–69 (2010)CrossRefGoogle Scholar
  3. 3.
    Eysenck, M.: Attention and Arousal. Springer, New York (1982)CrossRefGoogle Scholar
  4. 4.
    Eysenck, M.W.: Fundamentals of Cognition. Psychology Press, Hove & New York (2006)Google Scholar
  5. 5.
    Frijda, N.H.: The Emotions. Cambridge University Press, Cambridge (1986)Google Scholar
  6. 6.
    Scherer, K.R.: What Are Emotions? And How Can They Be Measured? Social Science Information 44, 695–729 (2005)CrossRefGoogle Scholar
  7. 7.
    Strongman, K.T.: The Psychology of Emotion: From Everyday Life to Theory, 5th edn. John Wiley & Sons, Chichester (2003)Google Scholar
  8. 8.
    Lykken, D.T., Venables, P.H.: Direct Measurement of Skin Conductance: A Proposal for Standardization. Psychophysiology 8, 656–672 (1971)CrossRefGoogle Scholar
  9. 9.
    Hassett, J.: A Primer of Psychophysiology. W. H. Freeman, San Francisco (1978)Google Scholar
  10. 10.
    Venables, P.H., Christie, M.J.: Electrodermal activity. In: Martin, I., Venables, P.H. (eds.) Techniques in Psychophysiology, pp. 2–67. John Wiley & Sons, New York (1980)Google Scholar
  11. 11.
    Damasio, A.R.: Descartes’ Error: Emotion, Reason, and the Human Brain. Vintage, London (1994/2006)Google Scholar
  12. 12.
    Tsatsou, K.: A Study of Electrodermal Response to Bodily Evoked Potentials. Masters Dissertation, University of Patras, Greece (2006) (in Greek)Google Scholar
  13. 13.
    Fairclough, S.H.: Fundamentals of Physiological Computing. International Journal of Human-Computer Interaction 21, 133–145 (2009)Google Scholar
  14. 14.
    Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)Google Scholar
  15. 15.
    Brave, S., Nass, C.: Emotion in Human-Computer Interaction. In: Sears, A., Jacko, J.A. (eds.) The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, 2nd edn., pp. 77–92. Lawrence Erlbaum Associates, New York and London (2008)Google Scholar
  16. 16.
    Kuniavsky, M.: Smart Things: Ubiquitous Computing User Experience Design. Morgan Kaufmann, Burlington (2010)Google Scholar
  17. 17.
    Norman, D.A.: Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York (2004)Google Scholar
  18. 18.
    Calleja, G.: In-game: From Immersion to Incorporation. MIT Press, Cambridge (2011)Google Scholar
  19. 19.
    Law, E.L.C., Sun, X.: Evaluating User Experience of Adaptive Digital Educational Games With Activity Theory. International Journal of Human-Computer Studies 70, 478–497 (2012)CrossRefGoogle Scholar
  20. 20.
    Psaltis, A., Mourlas, C.: A Real Time Attachment Free, Psycho Physiological Stress and Heart Rate Measurement System. International Journal of Measurement Technologies and Instrumentation Engineering 1, 1–13 (2011)CrossRefGoogle Scholar
  21. 21.
    Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 1161–1178 (1980)CrossRefGoogle Scholar
  22. 22.
    Russell, J.A.: Core Affect and the Psychological Construction of Emotion. Psychological Review 110, 145–172 (2003)CrossRefGoogle Scholar
  23. 23.
    LeDoux, J.: The Emotional Brain. Simon & Schuster, New York (1996)Google Scholar
  24. 24.
    Kim, J., Gorman, J.: The psychobiology of anxiety. Clinical Neuroscience Research 4, 335–347 (2005)CrossRefGoogle Scholar
  25. 25.
    Peter, C., Herbon, A.: Emotion representation and physiology assignments in digital systems. Interacting With Computers 18, 139–170 (2006)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Anthony Psaltis
    • 1
  • Charalampos Rizopoulos
    • 1
    • 2
  • Zacharias Lekkas
    • 1
  • Constantinos Mourlas
    • 1
  1. 1.Department of Communication and Media StudiesNational and Kapodistrian University of AthensGreece
  2. 2.Department of Communication and Internet StudiesCyprus University of TechnologyLimassolCyprus

Personalised recommendations