Skip to main content

Talking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4930))

Abstract

Virtual Humans are artificial characters who look and act like humans, but inhabit a simulated environment. One important aspect of many virtual humans is their communicative dialogue ability. In this paper we outline a methodology for study of dialogue behavior and construction of virtual humans. We also consider three architectures for different types of virtual humans that have been built at the Institute for Creative Technologies.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gratch, J., Rickel, J., Andre, E., Cassell, J., Petajan, E., Badler, N.: Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems, 54–63 (2002)

    Google Scholar 

  2. Allwood, J.: An activity based approach to pragmatics. Technical Report (GPTL) 75, Gothenburg Papers in Theoretical Linguistics, University of Göteborg (1995)

    Google Scholar 

  3. Allwood, J.: The Swedish Spoken Language Corpus at Göteborg University. In: Andersson, R., Abelin, Allwood, J., Lindblad, P. (eds.) Fonetik 1999: Proceedings from the Twelfth Swedish Phonetics Conference. Gothenburg Papers in Theoretical Linguistics, Department of Linguistics, Göteborg University, vol. 81, pp. 5–9 (1999)

    Google Scholar 

  4. Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of oz studies – why and how. Knowledge-Based Systems 6(4), 258–266 (1993)

    Article  Google Scholar 

  5. Paris, C.: Description strategies for naive and expert users. In: Proceedings of the 1985 Annual Meeting of the Association for Computational Linguistics (ACL-1986), pp. 238–245 (1985)

    Google Scholar 

  6. Allen, J.F., Schubert, L.K., Ferguson, G., Heeman, P., Hwang, C.H., Kato, T., Light, M., Martin, N., Miller, B., Poesio, M., Traum, D.R.: The TRAINS project: a case study in building a conversational planning agent. Journal of Experimental and Theoretical AI (to appear, 1995)

    Google Scholar 

  7. Allen, J.F., Miller, B.W., Ringger, E.K., Sikorski, T.: A robust system for natural spoken dialogue. In: Proceedings of the 1996 Annual Meeting of the Association for Computational Linguistics (ACL-1996), pp. 62–70 (1996)

    Google Scholar 

  8. Cassell, J.: Sistine gap: Essays in the history and philosophy of artificial life. In: Riskin, J. (ed.) Body Language: Lessons from the Near-Human, University of Chicago Press, Chicago (2007)

    Google Scholar 

  9. Li, S.: Multi-modal Interaction Management for a Robot Companion. PhD thesis, Bielefeld University (2007)

    Google Scholar 

  10. Larsson, S., Traum, D.: Information state and dialogue management in the TRINDI dialogue move engine toolkit. Natural Language Engineering. Special Issue on Spoken Language Dialogue System Engineering 6, 323–340 (2000)

    Google Scholar 

  11. Traum, D., Larsson, S.: The information state approach to dialogue management. In: van Kuppevelt, J., Smith, R. (eds.) Current and New Directions in Discourse and Dialogue, pp. 325–353. Kluwer, Dordrecht (2003)

    Google Scholar 

  12. Voorhees, E.M.: Overview of the trec 2003 question answering track. In: Proceedings of The Twelfth Text Retrieval Conference, pp. 54–69 (2003)

    Google Scholar 

  13. Leuski, A., Pair, J., Traum, D., McNerney, P.J., Georgiou, P., Patel, R.: How to talk to a hologram. In Edmonds. In: Edmonds, E., Riecken, D., Paris, C.L., Sidner, C.L. (eds.) Proceedings of the 11th international conference on Intelligent user interfaces (IUI 2006), Sydney, Australia, pp. 360–362. ACM Press, New York (2006)

    Chapter  Google Scholar 

  14. Leuski, A., Patel, R., Traum, D., Kennedy, B.: Building effective question answering characters. In: Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, pp. 18–27 (2006)

    Google Scholar 

  15. O’Sullivan, C., Cassell, J., Vilhjalmsson, H., Dingaliana, J., Dobbyn, S., McNamee, B., Peters, C., Giang, T.: Levels of detail for crowds and groups. Computer Graphics Forum 21(4) (2002)

    Google Scholar 

  16. Padilha, E., Carletta, J.: A simulation of small group discussion. In: Proceedings of EDILOG 2002: Sixth Workshop on the Semantics and Pragmatics of Dialogue, pp. 117–124 (2002)

    Google Scholar 

  17. Patel, J., Parker, R., Traum, D.: Simulation of small group discussions for middle level of detail crowds. In: Proceedings of the Army Science Conference (2004)

    Google Scholar 

  18. Jan, D., Traum, D.R.: Dialog simulation for background characters. LNCS, pp. 65–74 (2005)

    Google Scholar 

  19. Jan, D., Traum, D.: Dynamic movement and positioning of embodied agents in multiparty conversations. In: proceedings of AAMAS 2007: Sixth International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 59–66 (2007)

    Google Scholar 

  20. Rickel, J., Marsella, S., Gratch, J., Hill, R., Traum, D., Swartout, W.: Toward a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems 17, 32–38 (2002)

    Article  Google Scholar 

  21. Traum, D.R., Rickel, J.: Embodied agents for multi-party dialogue in immersive virtual worlds. In: Proceedings of the first International Joint conference on Autonomous Agents and Multiagent systems, pp. 766–773 (2002)

    Google Scholar 

  22. Traum, D., Rickel, J., Marsella, S., Gratch, J.: Negotiation over tasks in hybrid human-agent teams for simulation-based training. In: proceedings of AAMAS 2003: Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 441–448 (July 2003)

    Google Scholar 

  23. Traum, D.R., Robinson, S., Stephan, J.: Evaluation of multi-party virtual reality dialogue interaction. In: Proceedings of Fourth International Conference on Language Resources and Evaluation (LREC 2004), pp. 1699–1702 (2004)

    Google Scholar 

  24. Traum, D., Swartout, W., Marsella, S., Gratch, J.: Virtual humans for non-team interaction training. In: proceedings of the AAMAS Workshop on Creating Bonds with Embodied Conversational Agents (July 2005)

    Google Scholar 

  25. Traum, D., et al.: Fight, flight, or negotiate: Believable strategies for conversing under crisis. In: Panayiotopoulos, T., et al. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 52–64. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ipke Wachsmuth Günther Knoblich

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Traum, D. (2008). Talking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents. In: Wachsmuth, I., Knoblich, G. (eds) Modeling Communication with Robots and Virtual Humans. Lecture Notes in Computer Science(), vol 4930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79037-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-79037-2_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-79036-5

  • Online ISBN: 978-3-540-79037-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics