Skip to main content

Implementing a Multi-user Tour Guide System with an Embodied Conversational Agent

  • Conference paper
Book cover Active Media Technology (AMT 2009)

Abstract

In recent years, computer-generated interactive virtual characters, called Embodied Conversational Agents (ECAs), are subjects of considerable ongoing research. Nevertheless, their conversational abilities are mediocre compared to real human behaviors. Among limitations, most of ECAs are incapable of participating in natural conversations in which the number of participants can change dynamically. In the ongoing work we investigate principles of integrating a multi-user support in an ECA system. We present experiments and implementation approach of a prototype system in which a tour guide ECA interacts with one or two users. The system combines different technologies to detect and address the system users and draw their attention. Experimental interaction with the system produces encouraging results. The system can address the user’s appearance, departure, decreased level of interest and identify his conversational role.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Traum, D., Rickel, J.: Embodied Agents for Multi-party Dialogue in Immersive Virtual Worlds. In: AAMAS 2002, vol. 2

    Google Scholar 

  2. Traum, D., Bos, J., Cooper, R., Larsson, S., Lewin, I., Matheson, C., Poesio, M.: A model of dialogue moves and information state revision (1999)

    Google Scholar 

  3. Larsson, S., Berman, A., Gronqvist, L., Kronlid, F.: TRINDIKIT 3.0 Manual. Trindi Deliverable D6.4 (2002)

    Google Scholar 

  4. The MITRE Corporation: Midiki User’s Manual, version 0.1.3 beta edition (2005)

    Google Scholar 

  5. Huang, H., Cerekovic, A., Pandzic, I., Nakano, Y., Nishida, T.: The Design of a Generic Framework for Integrating ECA Components. In: Proceedings of 7th International Conference of Autonomous Agents and Multiagent Systems (AAMAS 2008), Estoril, Portugal, May 2008, pp. 128–135 (2008)

    Google Scholar 

  6. Huang, H., Cerekovic, A., Tarasenko, K., Levacic, V., Zoric, G., Pandzic, I., Nakano, Y., Nishida, T.: An Agent Based Multicultural Tour Guide System with Nonverbal User Interface. The International Journal on Multimodal Interfaces 1(1), 41–48 (2007)

    Article  Google Scholar 

  7. Vertegaal, R., Slagter, R., van der Veer, G., Nijholt, A.: Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2001, Seattle, Washington, United States, pp. 301–308. ACM, New York (2001)

    Chapter  Google Scholar 

  8. Rehm, M., André, E., Wissner, M.: Gamble v2.0: social interactions with multiple users. In: Proceedings of the Fourth international Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2005, The Netherlands, July 25 - 29 (2005)

    Google Scholar 

  9. Traum, D.: Issues in multiparty dialogues. In: Dignum, F.P.M. (ed.) ACL 2003. LNCS (LNAI), vol. 2922, pp. 201–211. Springer, Heidelberg (2004)

    Google Scholar 

  10. Lester, J.C., Converse, S.A.: The Persona Effect: Affective Impact of Animated Peda-gogical Agents. In: Pemberton, S. (ed.) Human Factors in Computing Systems: CHI 1997 Conference Proceedings, pp. 359–366. ACM Press, New York (1997)

    Chapter  Google Scholar 

  11. Rehm, M., Andre, E.: Where do they look? Gaze Behaviors of Multiple Users Interacting with an Embodied Conversational Agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 241–252. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Traum, D., Marsella, S., Gratch, J., Lee, J., HartHolt, A.: Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-Modal Virtual Agents. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 117–130. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  13. Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., Thórisson, K., Vilhjálmsson, H.: Towards a Common Framework for Multimodal Generation: The Behavior Markup Language. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  14. Cassell, J.: Embodied Conversational Agents. MIT Press, Cambridge (2000)

    Google Scholar 

  15. http://www.visagetechnologies.com

  16. http://www.omron.com/r_d/coretech/vision/okao.html

  17. http://sourceforge.net/projects/opencvlibrary/

  18. http://www.loquendo.com/en/

  19. http://en.wikipedia.org/wiki/OpenAIR

  20. http://wiki.mindmakers.org/projects:bml:main

  21. Vilhjálmsson, H.H., Cantelmo, N., Cassell, J., Chafai, N.E., Kipp, M., Kopp, S., Mancini, M., Marsella, S.C., Marshall, A.N., Pelachaud, C., Ruttkay, Z., Thórisson, K.R., van Welbergen, H., van der Werf, R.J.: The behavior markup language: Recent developments and challenges. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 99–111. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  22. A.L.I.C.E.: AI Foundation, AIML, Artificial Intelligence Markup Language (2005), http://www.alicebot.org/TR/2005/WD-AIML

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Čereković, A. et al. (2009). Implementing a Multi-user Tour Guide System with an Embodied Conversational Agent. In: Liu, J., Wu, J., Yao, Y., Nishida, T. (eds) Active Media Technology. AMT 2009. Lecture Notes in Computer Science, vol 5820. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04875-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04875-3_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04874-6

  • Online ISBN: 978-3-642-04875-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics