Skip to main content

The Significance of Textures for Affective Interfaces

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3661))

Abstract

This paper reports experiments demonstrating that the extent to which subjects ascribe emotions to VR faces is highly dependent on textures applied to the face. We demonstrate this for both a photo-realistic vs. non-photo-realistic texture pair and for a male vs. female texture pair. In both cases, experiments were conducted over the Internet on still frames taken from a well-controlled VR emotion modelling system. Given the enormous extent to which textures determine emotion recognition, we consider this a critical area for future research in affective virtual agents.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Breazeal, C.: Emotion and sociable humanoid robots. International Journal of Human Computer Interaction 59, 119–155 (2003)

    Google Scholar 

  2. Bryson, J.: Personal communication, based on data presented at HCI 2003 by Ward. Bell & Marsden (2004)

    Google Scholar 

  3. Cassell, J.: Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 1–27. MIT Press, London (2000)

    Google Scholar 

  4. Collier, G.: Emotional Expression. Lawrence Erlbaum Associates, London (1985)

    Google Scholar 

  5. Coolican, H.: Research Methods and Statistics in Psychology. Hodder & Stoughton, 2nd edn., London (1994)

    Google Scholar 

  6. Davis, D.N.: Agents, emergence, emotion and representation. In: IECON 2000: 26th Annual Conference of the IEEE Industrial Electronics Society, October 2000, vol. 4, pp. 2577–2582. IEEE, Los Alamitos (2000)

    Google Scholar 

  7. De Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From greta’s mind to her face: Modelling the dynamics of affective states in a conversational agent. International Journal of Human Computer Studies 59, 81–118 (2003)

    Article  Google Scholar 

  8. Ekman, P., Friesen, W., Ellsworth, P.: Emotion in the Human Face: Guidelines for Research and an Integration of Findings. Pergamon Press, New York (1972)

    Google Scholar 

  9. Fabri, M., Moore, D.J., Hobbs, D.J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them!, July 2002, pp. 402–409 (2002)

    Google Scholar 

  10. Ferh, B., Russell, J.A.: Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General 113, 464–486 (1984)

    Article  Google Scholar 

  11. Fox, E., Lester, V., Russo, R., Bowles, R.J., Pichler, A., Dutton, K.: Facial expression of emotion: Are angry faces detected more efficiently? Cognition and Emotion 14(1), 61–92 (2000)

    Article  Google Scholar 

  12. Fox, J.: Factors of emotion recognition in faces: Three perspectives. Journal of Young Investigators (3) (March 2004)

    Google Scholar 

  13. Fridlund, A.J.: The behaviour, ecology and sociality of human faces. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)

    Google Scholar 

  14. Gaggioli, A., Mantovani, F., Castelnuovo, G., Wiederhold, B., Riva, G.: Avatars in clinical psychology: A framework for the clinical use of virtual humans. CyberPsychology and Behavior 6(2), 117–125 (2003)

    Article  Google Scholar 

  15. Haddad, H., Klobas, J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them! (July 2002)

    Google Scholar 

  16. Hansen, C.H., Hansen, R.D.: Finding the face in the crowd: An anger superiority effect. Journal of Personality and Social Psychology 54, 917–924 (1988)

    Article  Google Scholar 

  17. Hara, F., Kobayashi, H.: A face robot able to recognise and produce facial expression. In: IEEE International Conference on Intelligent Robots and Systems (IROS1996), Osaka (1996)

    Google Scholar 

  18. Izard, C.E.: The emotions and emotion constructs in personality and culture research. In: Cattell, R.B. (ed.) Handbook of Modern Personality Theory. Aldine Press, Chicago (1969)

    Google Scholar 

  19. Kahana-Kalman, R., Walker-Andrews, A.S.: The role of person familiarity in young infants perception of emotional expressions. Child Development 72, 352–369 (2001)

    Article  Google Scholar 

  20. Massaro, D.W., Cohen, M.M., Beskow, J., Cole R.A.: Developing and evaluating conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 287–317. MIT Press, London (2000)

    Google Scholar 

  21. Parke, F.I.: Computer graphic models for the human face. In: Proceedings of the IEEE Computer Society’s Third International Computer Software and Applications Conference (COMPSAC 1979), Chicago, November 1979, pp. 724–727 (1979)

    Google Scholar 

  22. Parke, F.I., Waters, K.: Computer Facial Animation. A. K. Peters Ltd. (1996)

    Google Scholar 

  23. Predinger, H., Ishizuka, M. (eds.): Life-Like Characters: Tools, Affective Functions and Applications. Springer, Berlin (1998)

    Google Scholar 

  24. Reeves, B., Naas, C.: The Media Equation: How People Treat Computers, Television and New Media Like Real People and Press. Cambridge University Press, Cambridge (1996)

    Google Scholar 

  25. Shaver, P.R., Wu, S., Schwartz, J.C.: Cross cultural similarities and differences in emotion and it’s representation: A prototype approach. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)

    Google Scholar 

  26. Sloman, A.: Beyond shallow models of emotions. Cognitive Processing 2(1), 177–198 (2001)

    Google Scholar 

  27. Strippgen, S.: INSIGHT: A virtual laboratory for design, test and evaluation of autonomous agents. In: Zobel, R.N., Möller, D.P.F. (eds.) Twelfth European Simulation Multiconference: Simulation — Past, Present and Future, Manchester, UK (June 1998)

    Google Scholar 

  28. Sullivan, L.A., Kirkpatrick, S.W.: Facial interpretation and component consistency. Genetic, Social and General Psychology Monographs 122(4), 389–404 (1996)

    Google Scholar 

  29. Takeuchi, A.: Situated facial displays: Towards social interaction. In: Proceedings of CHI 1994, pp. 450–454. ACM Press, New York (1994)

    Google Scholar 

  30. Tanguy, E.: An abstract muscle model for facial animations. Dissertation about a year project carried out during the third year of a computer science degree in the Univeristy of Sheffield (May 2001)

    Google Scholar 

  31. Tanguy, E.A.R., Willis, P.J., Bryson, J.J.: A layered Dynamic Emotion Representation for the creation of complex facial animation. In: Rist, T., Aylett, R., Ballin, D., Rickel, J. (eds.) Intelligent Virtual Agents, September 2003, pp. 101–105. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  32. Vinayagamoorthy, V., Garau, M., Steed, A., Slater, M.: An eye gaze model for dyadic interaction in an immerse virtual environment: Practice and experience. Computer Graphics Forum 23(1), 1–11 (2004)

    Article  Google Scholar 

  33. Ward, R., Bell, D., Marsden, P.: A exploration of facial expression tracking in affective HCI. In: O’Neill, E., Palanque, P., Johnson, P. (eds.) People and Computers XVII — Designing for Society (HCI 2003), Bath, September 2003, pp. 383–399. Springer, Heidelberg (2003)

    Google Scholar 

  34. Yik, M.S.M., Russell, J.A.: Interpretation of faces: Cross-cultural study of a prediction from Fridlund’s theory. Cognition and Emotion 13(1), 93–104 (1999)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ellis, P.M., Bryson, J.J. (2005). The Significance of Textures for Affective Interfaces. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds) Intelligent Virtual Agents. IVA 2005. Lecture Notes in Computer Science(), vol 3661. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550617_33

Download citation

  • DOI: https://doi.org/10.1007/11550617_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28738-4

  • Online ISBN: 978-3-540-28739-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics