Skip to main content

MPML3D: A Reactive Framework for the Multimodal Presentation Markup Language

  • Conference paper
Intelligent Virtual Agents (IVA 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4133))

Included in the following conference series:

Abstract

MPML3D is our first candidate of the next generation of authoring languages aimed at supporting digital content creators in providing highly appealing and highly interactive content with little effort. The language is based on our previously developed family of Multimodal Presentation Markup Languages (MPML) that broadly followed the “sequential” and “parallel” tagging structure scheme for generating pre-synchronized presentations featuring life-like characters and interactions with the user. The new markup language MPML3D deviates from this design framework and proposes a reactive model instead, which is apt to handle interaction-rich scenarios with highly realistic 3D characters. Interaction in previous versions of MPML could be handled only at the cost of considerable scripting effort due to branching. By contrast, MPML3D advocates a reactive model that allows perceptions of other characters or the user interfere with the presentation flow at any time, and thus facilitates natural and unrestricted interaction. MPML3D is designed as a powerful and flexible language that is easy-to-use by non-experts, but it is also extensible as it allows content creators to add functionality such as a narrative model by using popular scripting languages.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Allbeck, J., Badler, N.: Representing and parameterizing agent behaviors. In: Prendinger, Ishizuka (eds.) [14], pp. 19–38

    Google Scholar 

  2. André, E., Rist, T., van Mulken, S., Klesen, M., Baldes, S.: The automated design of believable dialogue for animated presentation teams. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 220–255. The MIT Press, Cambridge (2000)

    Google Scholar 

  3. Arafa, Y., Kamyab, K., Mamdani, E.: Towards a unified scripting language. Lessons learned from developing CML & AML. In: Prendinger, Ishizuka (eds.) [14], pp. 39–63

    Google Scholar 

  4. Bee, N., Prendinger, H., Nakasone, A., André, E., Ishizuka, M.: AutoSelect: What You Want Is What You Get: Real-Time Processing of Visual Attention and Affect. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Weber, M. (eds.) PIT 2006. LNCS (LNAI), vol. 4021, pp. 40–52. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  5. Carolis, B.D., Pelauchaud, C., Poggi, I., Steedman, M.: APML: Mark-up language for communicative character expressions. In: Prendinger, Ishizuka (eds.) [14], pp. 65–85

    Google Scholar 

  6. Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH 2001, pp. 477–486 (2001)

    Google Scholar 

  7. Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Authoring scenes for adaptive, interactive performances. In: Proceedings of 2nd International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2003), pp. 725–732. ACM Press, New York (2003)

    Chapter  Google Scholar 

  8. Ishizuka, M., Prendinger, H.: Describing and generating multimodal contents featuring affective lifelike agents with MPML. New Generation Computing 24, 97–128 (2006)

    Article  Google Scholar 

  9. Kopp, S., Jung, B., Lessmann, N., Wachsmuth, I.: Max – a multimodal assistant in virtual reality construction. KI Zeitschift (German Magazine of Artificial Intelligence) Special Issue on Embodied Conversational Agents 4, 11–17 (2003)

    Google Scholar 

  10. Mateas, M., Stern, A.: A Behavior Language: Joint action and behavioral idioms. In: Prendinger, Ishizuka (eds.) [14], pp. 19–38

    Google Scholar 

  11. Nischt, M., Prendinger, H., André, E., Ishizuka, M.: Creating three-dimensional animated characters: An experience report and recommendations of good practice. Upgrade. The European Journal for the Informatics Professional VII(2), 36–41 (2006)

    Google Scholar 

  12. Piwek, P., Krenn, B., Schröder, M., Grice, M., Baumann, S., Pirker, H.: RRL: a rich representation language for the description of agent behavior in NECA. In: Proceedings AAMAS 2002 Workshop on Embodied conversational agents—let’s specify and evaluate them! (2002)

    Google Scholar 

  13. Prendinger, H., Descamps, S., Ishizuka, M.: MPML: A markup language for controlling the behavior of life-like characters. Journal of Visual Languages and Computing 15(2), 183–203 (2004)

    Article  Google Scholar 

  14. Prendinger, H., Ishizuka, M. (eds.): Life-Like Characters. Tools, Affective Functions, and Applications. Cognitive Technologies. Springer, Heidelberg (2004)

    Google Scholar 

  15. Rist, T.: Issues in the design of scripting and representation languages for life-like characters. In: Prendinger, Ishizuka (eds.) [14], pp. 463–468

    Google Scholar 

  16. Rist, T., André, E., Baldes, S., Gebhard, P., Klesen, M., Kipp, M., Rist, P., Schmitt, M.: A review of the development of embodied presentation agents and their appication fields. In: Prendinger, Ishizuka (eds.) [14], pp. 377–404

    Google Scholar 

  17. Ruttkay, Z., Huang, Z., Eliens, A.: Reusable Gestures for Interactive Web Agents. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 80–87. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  18. SMIL. Synchronized Multimedia Integration Language, URL: http://www.w3.org/AudioVideo

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nischt, M., Prendinger, H., André, E., Ishizuka, M. (2006). MPML3D: A Reactive Framework for the Multimodal Presentation Markup Language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds) Intelligent Virtual Agents. IVA 2006. Lecture Notes in Computer Science(), vol 4133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11821830_18

Download citation

  • DOI: https://doi.org/10.1007/11821830_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-37593-7

  • Online ISBN: 978-3-540-37594-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics