Skip to main content
SpringerLink
Log in

Recognizing Bodily Expression of Affect in User Tests

  • Conference paper
Affective Computing and Intelligent Interaction (ACII 2011)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6975))

Abstract

We describe our planned research in using affective feedback from body movement and posture to recognize affective states of users. Bodily expression of affect has received far less attention in research than facial expression. The aim of our research is to further investigate how affective states are communicated through bodily expression and to develop an evaluation method for assessing affective states of video gamers based on this knowledge. Current motion capture systems are often intrusive to the user and restricted to lab environments, which results in biasing user experience. We propose a non-intrusive recognition system for bodily expression of affect in a video game context, which can be deployed in the wild.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)

    Article  Google Scholar 

  2. Hassenzahl, M., Tractinsky, N.: User experience – a research agenda. Behaviour & Information Technology 25(2), 91–97 (2006)

    Article  Google Scholar 

  3. McCarthy, J., Wright, P.: Technology as Experience. MIT Press, Cambridge (2004)

    Google Scholar 

  4. Jordan, P.: Designing Pleasurable Products. Taylor & Francis, Abington (2002)

    Google Scholar 

  5. Gaver, W.W., Martin, H.: Alternatives. Exploring information appliances through conceptual design proposals. In: Proceedings of the CHI 2000 Conference on Human Factors in Computing, pp. 209–216. ACM Press, New York (2000)

    Google Scholar 

  6. Hassenzahl, M.: Emotions can be quite ephemeral. We cannot design them. Interactions 11, 46–48 (2004)

    Article  Google Scholar 

  7. Norman, D.A.: Emotional Design. Why we love or hate everyday things. Basic Books, New York (2004)

    Google Scholar 

  8. Bargas-Avila, J.A., Hornbaek, K.: Old Wine in New Bottles or Novel Challenges? A Critical Analysis of Empirical Studies of User Experience. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI 2011), pp. 2689–2698 (2011)

    Google Scholar 

  9. Lottridge, D.: Evaluating human computer interaction through self-rated emotion. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 860–863. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  10. Xu, D., Read, J.C., Sim, G., McManus, B.: Experience it, draw it, rate it: capture children’s experiences with their drawings. In: IDC 2009: Proceedings of the 8th International Conference on Interaction Design and Children, pp. 266–270. ACM Press, New York (2009)

    Google Scholar 

  11. Rinn, W.E.: The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expression. Psychological Bulletin 95(1), 52–77 (1984)

    Article  Google Scholar 

  12. Ekman, P., Friesen, W.V.: Head and body cues in the judgment of emotion: a reformulation. Perceptual and Motor Skills 24(3), 711–724 (1967)

    Article  Google Scholar 

  13. De Gelder, B.: Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Phil. Trans. R. Soc. B 364, 3475–3484 (2009)

    Article  Google Scholar 

  14. James, W.T.: A study of expression of body posture. Journal of General Psychology 7, 405–437 (1932)

    Article  Google Scholar 

  15. Ekman, P., Friesen, W.: Manual for the facial action coding system. Consulting Psychology Press, Palo Alto (1978)

    Google Scholar 

  16. Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28(6), 879–896 (1998)

    Article  Google Scholar 

  17. Riskind, J.H., Gotay, C.C.: Physical Posture: Could It Have Regulatory or Feedback Effects on Motivation and Emotion? Motivation and Emotion 6(3), 273–298 (1982)

    Article  Google Scholar 

  18. Pasch, M., Bianchi-Berthouze, N., van Dijk, B., Nijholt, A.: Movement-based sports video games: Investigating motivation and gaming experience. Entertainment Computing 1(2), 49–61 (2009)

    Article  Google Scholar 

  19. Bianchi-Berthouze, N.: Does body movement affect the player engagement experience? In: Proc. of KEER 2010 - International Conference on Kansei Engineering and Emotion Research, pp. 1953–1963 (2010)

    Google Scholar 

  20. Calvo, R.A., D’Mello, S.: Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Trans. o. Aff. Computing 1(1), 18–37 (2010)

    Article  Google Scholar 

  21. Ekman, P.: Basic emotions. In: Dalgleish, T., Power, M. (eds.) Handbook of Cognition and Emotion. John Wiley & Sons, Sussex (1999)

    Google Scholar 

  22. Ekman, P., Friesen, W.V.: Head and body cues in the judgment of emotion: a reformulation. Perceptual and Motor Skills 24(3), 711–724 (1967)

    Article  Google Scholar 

  23. Coulson, M.: Attributing emotion to static body postures: recognition, accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behaviour 28(2), 117–139 (2004)

    Article  MathSciNet  Google Scholar 

  24. Kudoh, T., Matsumoto, D.: Crosscultural examination of the semantic dimensions of body posture. Journal of Personality and Social Psychology 48(6), 1440–1446 (1985)

    Article  Google Scholar 

  25. Grammer, K., Fink, B., Oberzaucher, E., Atzmüller, M., Blantar, I., Mitteroecker, P.: The representation of self reported affect in body posture and body posture simulation. Collegium Antropologicum 28(suppl. 2), 159–173 (2004)

    Google Scholar 

  26. Kleinsmith, A., De Silva, P.R., Bianchi-Berthouze, N.: Cross-cultural differences in recognizing affect from body posture. Interacting w. Computers 18(6), 1371–1389 (2006)

    Article  Google Scholar 

  27. De Silva, P.R., Bianchi-Berthouze, N.: Modeling human affective postures: an information theoretic characterization of posture features. Computer Animation and Virtual Worlds 15(3-4), 269–276 (2004)

    Article  Google Scholar 

  28. Clay, A., Real, M., Wijdenes, P., Andre, J.M., Lespinet-Najib, V.:: Movement transcriptions of SECs in componential process model. Presented at the CHI 2011, Workshop on Embodied Interaction: Theory and Practice in HCI (2011)

    Google Scholar 

  29. Pitterman, H., Nowicki Jr., S.: A test of the ability to identify emotion in human standing and sitting postures. Genetic, Social, and General Psychology Monographs 130(2), 146–162 (2004)

    Article  Google Scholar 

  30. Pasch, M., Poppe, R.: Person or Puppet? The Role of Stimulus Realism in Attributing Emotion to Static Body Postures. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 83–94. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  31. Höök, K.: Mobile life – innovation in the wild. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 1–2. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  32. Harper, R., Rodden, T., Rogers, Y., Sellen, A. (eds.): Being human: Human-Computer Interaction in the year 2020. Microsoft Research, Cambridge (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Lugano, Via Buffi 13, 6900, Lugano, Switzerland

    Marco Pasch & Monica Landoni

Authors
  1. Marco Pasch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Monica Landoni
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Memphis, 202 Psychology Building, 38152, Memphis, TN, USA

    Sidney D’Mello  & Arthur Graesser  & 

  2. Technische Universität München, Arcisstraße 21, 80333, München, Germany

    Björn Schuller

  3. Laboratoire d’Informatique pour la Mécanique et les Sciences de l’Ingénieur (LIMSI-CNRS), Bâtiment 508, 91403, Orsay Cedex, France

    Jean-Claude Martin

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pasch, M., Landoni, M. (2011). Recognizing Bodily Expression of Affect in User Tests. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6975. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24571-8_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24571-8_29

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24570-1

  • Online ISBN: 978-3-642-24571-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation