Skip to main content

Gesture in Style

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2915))

Abstract

GESTYLE is a new markup language to annotate text which has to be spoken by Embodied Conversational Agents (ECA), to prescribe the usage of hand-, head- and facial gestures accompanying the speech in order to augment the communication. The annotation ranges from low level (e.g. perform a specific gesture) to high level (e.g. take turn in a conversation) instructions. On top of that, and central to GESTYLE is the notion of style which determines the gesture repertoire and the gesturing manner of the ECA. GESTYLE contains constructs to define and dynamically modify style. The low-level tags, prescribing specific gestures to be performed are generated automatically, based on the style definition and the high-level tags. By using GESTYLE, different aspects of gesturing of an ECA can be defined and tailored to the needs of different application situations or user groups.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aardman Studios, Creature Comforts, http://atomfilms.shockwave.com/af/content/atom_221

  2. Arafa, Y., Kamyab, K., Kshirsagar, S., Guye-Vuilleme, A., Thalmann, N.: Two Approaches to Scripting Character Animation. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)

    Google Scholar 

  3. Ball, G., Breese, J.: Emotion and personality in a conversational agent. In: Cassell et al, pp. 189–219 (2000)

    Google Scholar 

  4. Cassell, J.: A framework for gesture generation and interpretation. In: Cipolla, R., Pentland, A. (eds.) Computer Vision for Human-machine Interaction. Cambridge University Press, Cambridge (1998)

    Google Scholar 

  5. Cassell, J., Sullivan, J., Prevost, S., Churchill, E.: Embodied Conversational Agents. MIT Press, Cambridge (2000)

    Google Scholar 

  6. Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: Embodiment in Conversational Interfaces: Rea. In: ACM CHI 1999, Conference Proceedings, Pittsburgh, PA, pp. 520–527 (1999)

    Google Scholar 

  7. Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE Model for Effort and Shape. In: Proc. of Siggraph, pp. 173–182 (2000)

    Google Scholar 

  8. De Carolis, N., Carofiglio, V., Bilvi, M., Pelachaud, C.: APML, a Mark-up Language for Believable Behavior Generation. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)

    Google Scholar 

  9. Eliens, A., Huang, Z., Visser, C.: A platform for Embodied Conversational Agents based on Distributed Logic Programming. In: Porc. of the AAMAS Workshop on “Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)

    Google Scholar 

  10. Gratch, J., Rickel, J., Andre, J., Badler, N., Cassell, J., Petajan, E.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems, pp. 54–63 (July/August 2002)

    Google Scholar 

  11. H-anim 2002, Humanoid animation working group, http://www.hanim.org/Specifications/H-Anim1.1/

  12. Hartmann, B., Mancini, M., Pelachaud, C.: Formational parameters and adaptive prototype instantiation for MPEG-4 compliant gesture synthesis. In: Proc. of Computer Animation, pp. 111–119. IEEE Computer Society Press, Los Alamitos (2002)

    Google Scholar 

  13. Kendon, A.: “Human gesture”. In: Ingold, T., Gibson, K. (eds.) Tools, Language and Intelligence, Cambridge University Press, Cambridge (1993)

    Google Scholar 

  14. Kopp, S., Wachsmuth, I.: Planning and motion control in lifelike gesture: a refined approach. In: Post-proceedings of Computer Animation 2000, pp. 92–97. IEEE Computer Society Press, Los Alamitos (2000)

    Chapter  Google Scholar 

  15. Krandsted, A., Kopp, S., Wachsmuth, I.: MURML: A Multimodal Utterance Representation Markup Language for Conversational Agents. In: Porc. of the AAMAS Workshop on Embodied conversational agents – Let’s specify and evaluate them!, Bologna (2002)

    Google Scholar 

  16. Lester, J., Voerman, J., Towns, S., Callaway, C.: Deictic believability: Coordinated gesture, locomotion and speech in lifelike pedagogical agents. Applied AI 13(4/5), 383–414 (1999)

    Google Scholar 

  17. McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, Chicago (1991)

    Google Scholar 

  18. Nass, C., Isbister, K., Lee, E.-J.: Truth is beauty: Researching embodied conversational agents. In: Cassell et al, pp. 374–402 (2000)

    Google Scholar 

  19. Noot, H., Ruttkay, Z.: CharToon 2.0 Manual, CWI Report INS-R0004, Amsterdam (2000)

    Google Scholar 

  20. Perlin, K.: Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1(1) (1995)

    Google Scholar 

  21. Piwek, P., Krenn, B., Schröder, M., Grice, M., Baumann, S., Pirker, H.: RRL: A Rich Representation Language for the Description of Agent Behaviour in NECA. In: Proceedings of the AAMAS workshop on Embodied conversational agents - let’s specify and evaluate them!, Bologna, Italy (2002)

    Google Scholar 

  22. Poggi, I.: Mind Markers. In: Mueller, C., Posner, R. (eds.) The Semantics and Pragmatics of Everyday Gestures, Berlin Verlag Arno Spitz (2001)

    Google Scholar 

  23. Prendinger, H., Ishizuka, M.: Social role awareness in animated agents. In: Proc. of Autonomous Agents Conference, Montreal, Canada, pp. 270–277 (2001)

    Google Scholar 

  24. Ruttkay, Z.: Constraint-based facial animation. Int. Journal of Constraints 6, 85–113 (2001)

    Article  MATH  Google Scholar 

  25. Ruttkay, Z., Pelachaud, C., Poggi, I., Noot, H.: Excercises of Syle for Virtual Humans. In: Canamero, L., Aylett, R. (eds.) Animating Expressive Characters for Social Interactions. Advances in Consciousness Research Series, John Benjamins Publishing Co., Amsterdam (forthcoming 2004)

    Google Scholar 

  26. Tsutsui, T., Saeyor, S., Ishizuka, M.: MPML: A Multimodal Presentation Markup Language with Character Agent Control Functions. In: Proc(CD-ROM) WebNet 2000 World Conf. on the WWW and Internet, San Antonio, Texas (2000)

    Google Scholar 

  27. Virtual Human Markup Language (VHML), http://www.vhml.org

  28. Van Moppes, V.: Improving the quality of synthesized speech through mark-up of input text with emotions, Master Thesis, VU, Amsterdam (2002)

    Google Scholar 

  29. Walker, J., Sproull, L., Subramani, R.: Using a human face in an interface. In: Proc. of CHI 1994, pp. 85–91 (1994)

    Google Scholar 

  30. Walker, M., Cahn, J., Whittaker, S.: Improvising linguistic style: Social and affective bases for agent personality. In: Proc. of Autonomous Agents Conference (1997)

    Google Scholar 

  31. http://www.apache.org/

  32. http://www.flexvoice.com/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Noot, H., Ruttkay, Z. (2004). Gesture in Style. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24598-8_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21072-6

  • Online ISBN: 978-3-540-24598-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics