Abstract
The human ability to express and recognize emotions plays an important role in face-to-face communication, and as technology advances it will be increasingly important for computer-generated avatars to be similarly expressive. In this paper, we present the detailed development process for the Lifelike Responsive Avatar Framework (LRAF) and a prototype application for modeling a specific individual to analyze the effectiveness of expressive avatars. In particular, the goals of our pilot study (n = 1,744) are to determine whether the specific avatar being developed is capable of conveying emotional states (Ekmanös six classic emotions) via facial features and whether a realistic avatar is an appropriate vehicle for conveying the emotional states accompanying spoken information. The results of this study show that happiness and sadness are correctly identified with a high degree of accuracy while the other four emotional states show mixed results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yee, N., Bailenson, J., Rickertsen, K.: A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces. In: Proceedings of the SIGCHI conference on Human factors in computing systems (2007)
Ekman, P.: Emotions revealed. Henry Holt, New York (2003)
Bickmore, T., Pfeifer, L., Jack, B.: Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents. In: Proceedings of the 27th international conference on Human factors in computing systems (2009)
Bickmore, T., Picard, R.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput. Hum. Interact. 12(2), 293–327 (2005)
Koda, T., Maes, P.: Agents with faces: the effect of personification. In: 5th IEEE International Workshop on Robot and Human Communication, pp. 189–194 (November 1996)
Ekman, P.: Emotion in the Human Face. Pergamon Press, New York (1972)
Diana, A., Javier, V., Francisco, J.: Generation and visualization of emotional states in virtual characters. Comput. Animat. Virtual Worlds 19(3-4), 259–270 (2008), 1410372
Wallraven, C., Breidt, M., Cunningham, D., Bülthoff, H.: Psychophysical evaluation of animated facial expressions. In: APGV 2005: Proceedings of the 2nd symposium on Applied perception in graphics and visualization (August 2005)
Wallraven, C., Fischer, J., Cunningham, D., Bartz, D., Bülthoff, H.: The evaluation of stylized facial expressions. In: APGV 2006: Proceedings of the 3rd symposium on Applied perception in graphics and visualization (July 2006)
Courgeon, M., Buisine, S., Martin, J.C.: Impact of expressive wrinkles on perception of a virtual character’s facial expressions of emotions. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 201–214. Springer, Heidelberg (2009)
de Melo, C.M., Gratch, J.: Expression of emotions using wrinkles, blushing, sweating and tears. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 188–200. Springer, Heidelberg (2009)
The OGRE Team: Ogre - open source 3d graphics engine, http://www.ogre3d.org
King, S.A., Parent, R.: Creating speech-synchronized animation. IEEE Transactions on Visualization and Computer Graphics 11(3), 341–352 (2005)
DeMara, R.F., Gonzalez, A.J., Hung, V., Leon-Barth, C., Dookhoo, R.A., Jones, S., Johnson, A., Leigh, J., Renambot, L., Lee, S., Carlson, G.: Towards interactive training with an avatar-based human-computer interface. In: The Interservice/Industry Training, Simulation & Education Conference, I/ITSEC (December 2008)
Ekman, P., Davidson, R.J.: The nature of emotion. Oxford Press, New York (1994)
Scherer, K.R., Ekman, P.: Handbook of methods in nonverbal behavior research, p. 593. Cambridge University Press, Cambridge (1982)
Mendolia, M.: Explicit use of categorical and dimensional strategies to decode facial expressions of emotion. Journal of Nonverbal Behavior (January 2007)
Ellison, J., Massaro, D.: Featural evaluation, integration, and judgment of facial affect. Journal of Experimental Psychology: Human Perception and Performance (January 1997)
Stern, S.E., Mullennix, J.W., Yaroslavsky, I.: Persuasion and social perception of human vs. synthetic voice across person as source and computer as source conditions. Int. J. Hum. Comput. Stud. 64(1), 43–52 (2006)
Maddock, S., Edge, J., Sanchez, M.: Movement realism in computer facial animation. In: 19th British HCI Group Annual Conference, Workshop on Human-animated Characters Interaction (January 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, S., Carlson, G., Jones, S., Johnson, A., Leigh, J., Renambot, L. (2010). Designing an Expressive Avatar of a Real Person. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds) Intelligent Virtual Agents. IVA 2010. Lecture Notes in Computer Science(), vol 6356. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15892-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-15892-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15891-9
Online ISBN: 978-3-642-15892-6
eBook Packages: Computer ScienceComputer Science (R0)