Skip to main content

Virtual Institutions: Normative Environments Facilitating Imitation Learning in Virtual Agents

  • Conference paper
Intelligent Virtual Agents (IVA 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5208))

Included in the following conference series:

Abstract

The most popular two methods of extending the intelligence of virtual agents are explicit programming of the agents’ decision making apparatus and learning agent behaviors from humans or other agents. The major obstacles of the existing approaches are making the agent understand the environment it is situated in and interpreting the actions and goals of other participants. Instead of trying to solve these problems we propose to formalize the environment in a way that these problems are minimized. The proposed solution, called Virtual Institutions, facilitates formalization of participants’ interactions inside Virtual Worlds, helping the agent to interpret the actions of other participants, understand its options and determine the goals of the principal that is conducting the training of the agent. Such formalization creates facilities to express the principal’s goals during training, as well as establishes a way to communicate desires of the human to the agent once the training is completed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gartner, Inc.: Gartner Says 80 Percent of Active Internet Users Will Have A ”Second Life” in the Virtual World by the End of 2011 (2007), http://www.gartner.com/it/page.jsp?id=503861

  2. Cascio, J., Paffendorf, J., Smart, J., Bridges, C., Hummel, J., Hurtsthouse, J., Moss, R.: Metaverse Roadmap: Pathways to the 3D Web. Report on the cross-industry public foresight project, July 4 (2007)

    Google Scholar 

  3. Bauckhage, C., Gorman, B., Thurau, C., Humphrys, M.: Learning Human Behavior from Analyzing Activities in Virtual Environments. MMI-Interaktiv 12, 3–17 (2007)

    Google Scholar 

  4. Livingstone, D.: Turing’s test and believable AI in games. Computers in Entertainment 4(1), 6–18 (2006)

    Article  Google Scholar 

  5. Breazeal, C.: Imitation as social exchange between humans and robots. In: Proc. of the AISB Symposium on Imitation in Animals and Artifacts, pp. 96–104 (1999)

    Google Scholar 

  6. Schaal, S.: Is imitation learning the route to humanoid robots? Trends in cognitive sciences 3(6), 233–242 (1999)

    Article  Google Scholar 

  7. Ekvall, S., Kragic, D.: Grasp recognition for programming by demonstration. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, pp. 748–753 (2005)

    Google Scholar 

  8. Aleotti, J., Caselli, S., Reggiani, M.: Toward Programming of Assembly Tasks by Demonstration in Virtual Environments. In: 12th IEEE Workshop Robot and Human Interactive Communication, pp. 309–314, October 31 - November 2 (2003)

    Google Scholar 

  9. Gorman, B., Thurau, C., Bauckhage, C., Humphrys, M.: Believability Testing and Bayesian Imitation in Interactive Computer Games. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J.C.T., Marocco, D., Meyer, J.-A., Miglino, O., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 655–666. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  10. Le Hy, R., Arrigony, A., Bessiere, P., Lebeltel, O.: Teaching bayesian behaviors to video game characters. Robotics and Autonomous Systems 47, 177–185 (2004)

    Article  Google Scholar 

  11. Thurau, C., Bauckhage, C., Sagerer, G.: Learning Human-Like Movement Behavior for Computer Games. In: Proceedings of the 8-th Simulation of Adaptive Behavior Conference (SAB 2004), pp. 315–323. MIT Press, Cambridge (2004)

    Google Scholar 

  12. Russel, S., Norvig, P.: Artificial Intelligence a Modern Approach. Prentice Hall, Pearson Education International, Upper Saddle River (2003)

    Google Scholar 

  13. Bogdanovych, A.: Virtual Institutions. PhD thesis, University of Technology, Sydney, Australia (2007)

    Google Scholar 

  14. Esteva, M.: Electronic Institutions: From Specification to Development. PhD thesis, Institut d’Investigació en Intelligència Artificial (IIIA), Spain (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Helmut Prendinger James Lester Mitsuru Ishizuka

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bogdanovych, A., Simoff, S., Esteva, M. (2008). Virtual Institutions: Normative Environments Facilitating Imitation Learning in Virtual Agents. In: Prendinger, H., Lester, J., Ishizuka, M. (eds) Intelligent Virtual Agents. IVA 2008. Lecture Notes in Computer Science(), vol 5208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85483-8_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85483-8_45

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85482-1

  • Online ISBN: 978-3-540-85483-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics