Abstract
This paper reports experiments demonstrating that the extent to which subjects ascribe emotions to VR faces is highly dependent on textures applied to the face. We demonstrate this for both a photo-realistic vs. non-photo-realistic texture pair and for a male vs. female texture pair. In both cases, experiments were conducted over the Internet on still frames taken from a well-controlled VR emotion modelling system. Given the enormous extent to which textures determine emotion recognition, we consider this a critical area for future research in affective virtual agents.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Breazeal, C.: Emotion and sociable humanoid robots. International Journal of Human Computer Interaction 59, 119–155 (2003)
Bryson, J.: Personal communication, based on data presented at HCI 2003 by Ward. Bell & Marsden (2004)
Cassell, J.: Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 1–27. MIT Press, London (2000)
Collier, G.: Emotional Expression. Lawrence Erlbaum Associates, London (1985)
Coolican, H.: Research Methods and Statistics in Psychology. Hodder & Stoughton, 2nd edn., London (1994)
Davis, D.N.: Agents, emergence, emotion and representation. In: IECON 2000: 26th Annual Conference of the IEEE Industrial Electronics Society, October 2000, vol. 4, pp. 2577–2582. IEEE, Los Alamitos (2000)
De Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From greta’s mind to her face: Modelling the dynamics of affective states in a conversational agent. International Journal of Human Computer Studies 59, 81–118 (2003)
Ekman, P., Friesen, W., Ellsworth, P.: Emotion in the Human Face: Guidelines for Research and an Integration of Findings. Pergamon Press, New York (1972)
Fabri, M., Moore, D.J., Hobbs, D.J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them!, July 2002, pp. 402–409 (2002)
Ferh, B., Russell, J.A.: Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General 113, 464–486 (1984)
Fox, E., Lester, V., Russo, R., Bowles, R.J., Pichler, A., Dutton, K.: Facial expression of emotion: Are angry faces detected more efficiently? Cognition and Emotion 14(1), 61–92 (2000)
Fox, J.: Factors of emotion recognition in faces: Three perspectives. Journal of Young Investigators (3) (March 2004)
Fridlund, A.J.: The behaviour, ecology and sociality of human faces. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)
Gaggioli, A., Mantovani, F., Castelnuovo, G., Wiederhold, B., Riva, G.: Avatars in clinical psychology: A framework for the clinical use of virtual humans. CyberPsychology and Behavior 6(2), 117–125 (2003)
Haddad, H., Klobas, J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them! (July 2002)
Hansen, C.H., Hansen, R.D.: Finding the face in the crowd: An anger superiority effect. Journal of Personality and Social Psychology 54, 917–924 (1988)
Hara, F., Kobayashi, H.: A face robot able to recognise and produce facial expression. In: IEEE International Conference on Intelligent Robots and Systems (IROS1996), Osaka (1996)
Izard, C.E.: The emotions and emotion constructs in personality and culture research. In: Cattell, R.B. (ed.) Handbook of Modern Personality Theory. Aldine Press, Chicago (1969)
Kahana-Kalman, R., Walker-Andrews, A.S.: The role of person familiarity in young infants perception of emotional expressions. Child Development 72, 352–369 (2001)
Massaro, D.W., Cohen, M.M., Beskow, J., Cole R.A.: Developing and evaluating conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 287–317. MIT Press, London (2000)
Parke, F.I.: Computer graphic models for the human face. In: Proceedings of the IEEE Computer Society’s Third International Computer Software and Applications Conference (COMPSAC 1979), Chicago, November 1979, pp. 724–727 (1979)
Parke, F.I., Waters, K.: Computer Facial Animation. A. K. Peters Ltd. (1996)
Predinger, H., Ishizuka, M. (eds.): Life-Like Characters: Tools, Affective Functions and Applications. Springer, Berlin (1998)
Reeves, B., Naas, C.: The Media Equation: How People Treat Computers, Television and New Media Like Real People and Press. Cambridge University Press, Cambridge (1996)
Shaver, P.R., Wu, S., Schwartz, J.C.: Cross cultural similarities and differences in emotion and it’s representation: A prototype approach. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)
Sloman, A.: Beyond shallow models of emotions. Cognitive Processing 2(1), 177–198 (2001)
Strippgen, S.: INSIGHT: A virtual laboratory for design, test and evaluation of autonomous agents. In: Zobel, R.N., Möller, D.P.F. (eds.) Twelfth European Simulation Multiconference: Simulation — Past, Present and Future, Manchester, UK (June 1998)
Sullivan, L.A., Kirkpatrick, S.W.: Facial interpretation and component consistency. Genetic, Social and General Psychology Monographs 122(4), 389–404 (1996)
Takeuchi, A.: Situated facial displays: Towards social interaction. In: Proceedings of CHI 1994, pp. 450–454. ACM Press, New York (1994)
Tanguy, E.: An abstract muscle model for facial animations. Dissertation about a year project carried out during the third year of a computer science degree in the Univeristy of Sheffield (May 2001)
Tanguy, E.A.R., Willis, P.J., Bryson, J.J.: A layered Dynamic Emotion Representation for the creation of complex facial animation. In: Rist, T., Aylett, R., Ballin, D., Rickel, J. (eds.) Intelligent Virtual Agents, September 2003, pp. 101–105. Springer, Heidelberg (2003)
Vinayagamoorthy, V., Garau, M., Steed, A., Slater, M.: An eye gaze model for dyadic interaction in an immerse virtual environment: Practice and experience. Computer Graphics Forum 23(1), 1–11 (2004)
Ward, R., Bell, D., Marsden, P.: A exploration of facial expression tracking in affective HCI. In: O’Neill, E., Palanque, P., Johnson, P. (eds.) People and Computers XVII — Designing for Society (HCI 2003), Bath, September 2003, pp. 383–399. Springer, Heidelberg (2003)
Yik, M.S.M., Russell, J.A.: Interpretation of faces: Cross-cultural study of a prediction from Fridlund’s theory. Cognition and Emotion 13(1), 93–104 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ellis, P.M., Bryson, J.J. (2005). The Significance of Textures for Affective Interfaces. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds) Intelligent Virtual Agents. IVA 2005. Lecture Notes in Computer Science(), vol 3661. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550617_33
Download citation
DOI: https://doi.org/10.1007/11550617_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28738-4
Online ISBN: 978-3-540-28739-1
eBook Packages: Computer ScienceComputer Science (R0)