Abstract
GESTYLE is a new markup language to annotate text which has to be spoken by Embodied Conversational Agents (ECA), to prescribe the usage of hand-, head- and facial gestures accompanying the speech in order to augment the communication. The annotation ranges from low level (e.g. perform a specific gesture) to high level (e.g. take turn in a conversation) instructions. On top of that, and central to GESTYLE is the notion of style which determines the gesture repertoire and the gesturing manner of the ECA. GESTYLE contains constructs to define and dynamically modify style. The low-level tags, prescribing specific gestures to be performed are generated automatically, based on the style definition and the high-level tags. By using GESTYLE, different aspects of gesturing of an ECA can be defined and tailored to the needs of different application situations or user groups.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aardman Studios, Creature Comforts, http://atomfilms.shockwave.com/af/content/atom_221
Arafa, Y., Kamyab, K., Kshirsagar, S., Guye-Vuilleme, A., Thalmann, N.: Two Approaches to Scripting Character Animation. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)
Ball, G., Breese, J.: Emotion and personality in a conversational agent. In: Cassell et al, pp. 189–219 (2000)
Cassell, J.: A framework for gesture generation and interpretation. In: Cipolla, R., Pentland, A. (eds.) Computer Vision for Human-machine Interaction. Cambridge University Press, Cambridge (1998)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E.: Embodied Conversational Agents. MIT Press, Cambridge (2000)
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: Embodiment in Conversational Interfaces: Rea. In: ACM CHI 1999, Conference Proceedings, Pittsburgh, PA, pp. 520–527 (1999)
Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE Model for Effort and Shape. In: Proc. of Siggraph, pp. 173–182 (2000)
De Carolis, N., Carofiglio, V., Bilvi, M., Pelachaud, C.: APML, a Mark-up Language for Believable Behavior Generation. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)
Eliens, A., Huang, Z., Visser, C.: A platform for Embodied Conversational Agents based on Distributed Logic Programming. In: Porc. of the AAMAS Workshop on “Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)
Gratch, J., Rickel, J., Andre, J., Badler, N., Cassell, J., Petajan, E.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems, pp. 54–63 (July/August 2002)
H-anim 2002, Humanoid animation working group, http://www.hanim.org/Specifications/H-Anim1.1/
Hartmann, B., Mancini, M., Pelachaud, C.: Formational parameters and adaptive prototype instantiation for MPEG-4 compliant gesture synthesis. In: Proc. of Computer Animation, pp. 111–119. IEEE Computer Society Press, Los Alamitos (2002)
Kendon, A.: “Human gesture”. In: Ingold, T., Gibson, K. (eds.) Tools, Language and Intelligence, Cambridge University Press, Cambridge (1993)
Kopp, S., Wachsmuth, I.: Planning and motion control in lifelike gesture: a refined approach. In: Post-proceedings of Computer Animation 2000, pp. 92–97. IEEE Computer Society Press, Los Alamitos (2000)
Krandsted, A., Kopp, S., Wachsmuth, I.: MURML: A Multimodal Utterance Representation Markup Language for Conversational Agents. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)
Lester, J., Voerman, J., Towns, S., Callaway, C.: Deictic believability: Coordinated gesture, locomotion and speech in lifelike pedagogical agents. Applied AI 13(4/5), 383–414 (1999)
McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, Chicago (1991)
Nass, C., Isbister, K., Lee, E.-J.: Truth is beauty: Researching embodied conversational agents. In: Cassell et al, pp. 374–402 (2000)
Noot, H., Ruttkay, Z.: CharToon 2.0 Manual, CWI Report INS-R0004, Amsterdam (2000)
Perlin, K.: Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1(1) (1995)
Piwek, P., Krenn, B., Schröder, M., Grice, M., Baumann, S., Pirker, H.: RRL: A Rich Representation Language for the Description of Agent Behaviour in NECA. In: Proceedings of the AAMAS workshop on Embodied conversational agents - let’s specify and evaluate them!, Bologna, Italy (2002)
Poggi, I.: Mind Markers. In: Mueller, C., Posner, R. (eds.) The Semantics and Pragmatics of Everyday Gestures, Berlin Verlag Arno Spitz (2001)
Prendinger, H., Ishizuka, M.: Social role awareness in animated agents. In: Proc. of Autonomous Agents Conference, Montreal, Canada, pp. 270–277 (2001)
Ruttkay, Z.: Constraint-based facial animation. Int. Journal of Constraints 6, 85–113 (2001)
Ruttkay, Z., Pelachaud, C., Poggi, I., Noot, H.: Excercises of Syle for Virtual Humans. In: Canamero, L., Aylett, R. (eds.) Animating Expressive Characters for Social Interactions. Advances in Consciousness Research Series, John Benjamins Publishing Co., Amsterdam (forthcoming 2004)
Tsutsui, T., Saeyor, S., Ishizuka, M.: MPML: A Multimodal Presentation Markup Language with Character Agent Control Functions. In: Proc(CD-ROM) WebNet 2000 World Conf. on the WWW and Internet, San Antonio, Texas (2000)
Virtual Human Markup Language (VHML), http://www.vhml.org
Van Moppes, V.: Improving the quality of synthesized speech through mark-up of input text with emotions, Master Thesis, VU, Amsterdam (2002)
Walker, J., Sproull, L., Subramani, R.: Using a human face in an interface. In: Proc. of CHI 1994, pp. 85–91 (1994)
Walker, M., Cahn, J., Whittaker, S.: Improvising linguistic style: Social and affective bases for agent personality. In: Proc. of Autonomous Agents Conference (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Noot, H., Ruttkay, Z. (2004). Gesture in Style. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-24598-8_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21072-6
Online ISBN: 978-3-540-24598-8
eBook Packages: Springer Book Archive