Learning Action Sequences Through Imitation in Behavior Based Architectures

  • Willi Richert
  • Bernd Kleinjohann
  • Lisa Kleinjohann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3432)


In this paper a new architecture for learning action sequences through imitation is proposed. Imitation occurs by means of observing and applying sequences of basic behaviors. When an agent has observed another agent and applied the observed action sequence later on, this imitated action sequence can be seen as a meme. Agents that behave similarly can therefore be grouped by their typical behavioral patterns. This paper thus explores imitation from the view of memetic proliferation.

Combining imitation learning with meme theory we show by simulating agent societies that with imitation significant performance improvements can be achieved. The performance is quantified by using an entropy measure to qualitatively evaluating the emerging clusters.

Our approach is demonstrated by the example of a society of emotion driven agents that imitate each other to reach pleasant emotional state.


Emotional State Episode Memory Behavior System Action Sequence Agent Society 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    The Oxford English Dictionary. Oxford University PressGoogle Scholar
  2. 2.
    Alissandrakis, A., Nehaniv, C., Dautenhahn, K.: Learning how to do things with imitation (2000)Google Scholar
  3. 3.
    Arkin, R.C.: Behaviour-Based Robotics. MIT Press, Cambridge (1998)Google Scholar
  4. 4.
    Atkeson, C.G., Schaal, S.: Robot learning from demonstration. In: Proc. 14th International Conference on Machine Learning, pp. 12–20. Morgan Kaufmann, San Francisco (1997)Google Scholar
  5. 5.
    Balch, T.: Behavioral Diversity in Learning Robot Teams. PhD thesis, Georgia Institute of Technology (December 1998)Google Scholar
  6. 6.
    Billard, A.: Learning motor skills by imitation: a biologically inspired robotic model (2000)Google Scholar
  7. 7.
    Blackmore, S.: The Meme Machine. Oxford University Press, Oxford (1999)Google Scholar
  8. 8.
    Breazeal, C., Scassellati, B.: How to build robots that make friends and influence people (1999)Google Scholar
  9. 9.
    Dawkins, R.: The Selfish Gene. Oxford University Press, Oxford (1976)Google Scholar
  10. 10.
    Demiris, J., Hayes, G.: Imitation as a dual-route process featuring predictive and learning components: a biologically-plausible computational model (2001)Google Scholar
  11. 11.
    Borenstein, E., Ruppin, E.: Enhancing autonomous agents evolution with learning by imitation. In: Second International Symposium on Imitation in Animals and Artifacts (2003)Google Scholar
  12. 12.
    Esau, N., Kleinjohan, B., Kleinjohann, L., Stichling, D.: Mexi: Machine with emotionally extended intelligence (2003)Google Scholar
  13. 13.
    Gatsoulis, Y., Maistros, G., Marom, Y., Hayes, G.: Learning to forage through imitation. In: Proceedings of the Second IASTED International Conference on Artificial Intelligence and Applications (AIA 2002), September 2002, pp. 485–491 (2002)Google Scholar
  14. 14.
    Nilsson, N.J.: Artificial Intelligence: A New Synthesis. Morgan Kaufmann Publishers, San Francisco (1998)zbMATHGoogle Scholar
  15. 15.
    Plutchik, R.: The Emotions. University Press of America (1991)Google Scholar
  16. 16.
    Schaal, S.: Dynamic movement primitives – a framework for motor control in humans and humanoid robotics. In: The International Symposium on Adaptive Motion of Animals and Machines (2003)Google Scholar
  17. 17.
    Shannon, C.E.: A mathematical theory of communication. Bell System Technical Journal 27, 379–423, 623–656 (1948)zbMATHMathSciNetGoogle Scholar
  18. 18.
    Sutton, Barto: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)Google Scholar
  19. 19.
    Weicker, K.: Evolutionäre Algorithmen. Teubner, Stuttgart (2002)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Willi Richert
    • 1
  • Bernd Kleinjohann
    • 1
  • Lisa Kleinjohann
    • 1
  1. 1.University of Paderborn / C-LabGermany

Personalised recommendations