Improving Gestural Communication in Virtual Characters

  • María del Puy Carretero
  • Aitor Ardanza
  • Sara García
  • Helen Díez
  • David Oyarzun
  • Nuria Ruiz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7378)


Gestural communication is part of non-verbal communication, but it is also a method that deaf people use to communicate with others through sign languages. In this paper, we present the research to improve communication in virtual characters no matter if it is spoken or signed using non-verbal communication. A brief study of hand gestures has been made to obtain some rules to improve natural behaviour in virtual characters. These rules, like the use of beats, are applied in an animation engine that emulates the behaviour of real people. The behaviour of the virtual character can also be modified by other channels such as user’s input, so the character’s attitude has to be adapted. This paper describes the architecture and main modules of the prototype designed to achieve natural behaviour in virtual characters and present the validation results obtained during the first phase of the development.


3D Virtual Character Natural Behaviour Communication Gestures 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andersen, M.L., Taylor, H.F.: Sociology: The essentials, 4th edn. Thomson Wadsworth, Beltmon (2007)Google Scholar
  2. 2.
    Birdwhistell, R.L.: El lenguaje de la expresión corporal. Ediciones Gustavo Gili, Spain (1979)Google Scholar
  3. 3.
    Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, W., Douville, B., Prevost, S., Stone, M.: Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In: Computer Graphics. Annual Conf. Series, pp. 413–420. ACM (1994)Google Scholar
  4. 4.
    McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, USA (1992)Google Scholar
  5. 5.
    Ekman, P., Friesen, W.: The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. Semiotica 1, 9–98 (1969)Google Scholar
  6. 6.
    Bergmann, K., Kopp, S.: Modeling the Production of Co-Verbal Iconic Gestures by Learning Bayesian Decision Networks. Applied Artificial Intelligence 24(6), 530–551 (2010)CrossRefGoogle Scholar
  7. 7.
    Streeck, J.: Depicting by gesture. Gesture 8(3), 285–301 (2008)CrossRefGoogle Scholar
  8. 8.
    Hostetter, A., Alibali, M.: Raise your hand if you’re spatial–Relations between verbal and spatial skills and gesture production. Gesture 7(1), 73–95 (2007)CrossRefGoogle Scholar
  9. 9.
    Cassell, J.: A Framework For Gesture Generation And Interpretation. In: Cipolla, R., Pentland, A. (eds.) Computer Vision in Human-Machine Interaction. Cambridge University Press (1998)Google Scholar
  10. 10.
    Parrill, F., Sweetser, E.: What we mean by meaning. Gesture 4(2), 197–219 (2004)CrossRefGoogle Scholar
  11. 11.
    Kettebekov, S.: Exploiting Prosodic Structuring of Coverbal Gesticulation. In: Proceedings of the ACM International Conference on Multimodal Interfaces, pp. 105–112 (2004)Google Scholar
  12. 12.
    Alibali, M.W., Kita, S., Young, A.J.: Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes 15(6), 593–613 (2000)CrossRefGoogle Scholar
  13. 13.
    Cienki, A., Müller, C.: Metaphor, gesture, and thought. In: Gibbs Jr., R.W. (ed.) The Cambridge Handbook of Metaphor and Thought. Cambridge University Press, Cambridge (2008)Google Scholar
  14. 14.
    Kobsa, A., Allgayer, J., Reddig, C., Reithinger, N., Schmauks, D., Harbusch, K., Wahlster, W.: Combining deictic gestures and natural language for referent identification. In: Proceedings Eleventh COLING, Bonn, Germany, pp. 356–361 (1986)Google Scholar
  15. 15.
    Giorgolo, G.: Space and Time in Our Hands. PhD. Universiteit Utrecht (2010)Google Scholar
  16. 16.
    Pierrehumbert, J., Hirschberg, J.: The meaning of intonational contours in interpretation of discourse. In: Cohen, P., Morgan, J., Pollack, M. (eds.) Intentions in Communication, ch. 14. MIT Press (1990)Google Scholar
  17. 17.
    Krahmer, E., Swerts, M.: The efects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language 57(3), 396–414 (2007)CrossRefGoogle Scholar
  18. 18.
    Rieger, T.: Avatar Gestures. Journal of WSCG 2003 11(2), 379–386 (2003)MathSciNetGoogle Scholar
  19. 19.
    López, B., Hernández, A., Díaz Pardo de Vera, D., Santos de la Cámara, R., Rodríguez, M.C.: ECA gesture strategies for robust SLDS. In: Convention - Communication, Interaction and Social Intelligence on the Symposium on Multimodal Output Generation, Aberdeen, Scotland (2008)Google Scholar
  20. 20.
    Bergmann, K., Kopp, S.: Multimodal content representation for speech and gesture production. In: Theune, M., van der Sluis, I., Bachvarova, Y., André, E. (eds.) Symposium at the AISB Annual Convention: Multimodal Output Generation, Aberdeen, UK, pp. 61–68 (2008)Google Scholar
  21. 21.
    Rauscher, F.H., Krauss, R.M., Chen, Y.: Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science 7, 226–231 (1996)CrossRefGoogle Scholar
  22. 22.
    Alseid, M., Rigas, D.: Users’ views of facial expressions and body gestures in e-learning interfaces: an empirical evaluation. World Scientific and Engineering Academy and Society, WSEAS (2009)Google Scholar
  23. 23.
    Efthimiou, E., Kouroupetroglou, G. (eds.): Proc. of the 9th International Gesture Workshop, Athens, Greece, May 25-27, 2011, pp. 25–27 (2011)Google Scholar
  24. 24.
    Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., Thórisson, K., Vilhjalmsson, H.: Towards a Common Framework for Multimodal Generation in ECAs: The Behavior Markup Language. In: Proceedings of the 6th International (2006)Google Scholar
  25. 25.
    Marriott, A.: VHML – Virtual Human Markup Language. In: Talking Head Technology Workshop, at OzCHI Conference (2001)Google Scholar
  26. 26.
    Roseman, I., Antoniou, A., Jose, P.: Appraisal determinants of emotions: Constructing a more accurate and comprehensive theory. Cognition and Emotion 10 (1996)Google Scholar
  27. 27.
    Ortiz, A., Oyarzun, D., Carretero, M., Posada, J., Linaza, M.T., Garay-Vitoria, N.: Analysing emotional interaction through avatars. A generic architecture. e-Minds: International Journal on Human-Computer Interaction I(5) (March 2009) ISSN: 1697-9613 (print) - 1887-3022 (online) Google Scholar
  28. 28.
    Kendon, A.: Some functions of gaze direction in social interaction. Acta Psychologica 26, 22–63 (1967)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • María del Puy Carretero
    • 1
  • Aitor Ardanza
    • 1
  • Sara García
    • 1
  • Helen Díez
    • 1
  • David Oyarzun
    • 1
  • Nuria Ruiz
    • 2
  1. 1.3D Animation and Interactive Virtual EnvironmentsVicomtechDonostia-San SebastiánSpain
  2. 2.Elixir Films S.L.Donostia-San SebastiánSpain

Personalised recommendations