Selection of Behavior in Social Situations Application to the Development of Coordinated Movements

  • Samuel Delepoulle⋆
  • Philippe Preux
  • Jean-Claude Darcheville
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2037)


The law of effect is a very simple law which relates the probability of emission of a behavior by a living being to the consequences of the emission of this behavior by this living being in the past. As such, this law models very basic learning. This law can be considered as an experimental fact as far as it has been observed for a whole range of living beings including human beings. In this paper, we first show that this general law can be the result of a selection process such as natural selection. Then, we show that the implementation of this law can lead to the design of adaptive systems which can mimic very closely the way a new-born develops coordinated movements. To sum-up, we show that the ability to learn such coordinated movements and exhibit adaptive behaviors can result from a multi-stage process of selection.


Natural Selection Reinforcement Learning Adaptive Behavior Social Situation Adaptive System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E.L. Thorndike. Animal intelligence: An experimental study of the associative process in animals. Psychology Monographs, 2, 1898.Google Scholar
  2. 2.
    E.L. Thorndike. Animal Intelligence: Experimental Studies. Mac Millan, 1911.Google Scholar
  3. 3.
    J.W. Donahoe and D.C. Palmer. Learning and Complex Behavior. Allyn and bacon, 1994.Google Scholar
  4. 4.
    J.E.R. Staddon. Adaptive behavior and learning. Cambridge University Press, 1983.Google Scholar
  5. 5.
    B.F. Skinner. Selection by consequences. Science, 213:501–514, 1981.CrossRefGoogle Scholar
  6. 6.
    J.M. Baldwin. A new factor in evolution. The american naturalist, 30, 1896. reprinted in [15, pp. 59–80].Google Scholar
  7. 7.
    G.E. Hinton and S.J. Nowlan. How learning can guide evolution. Complex Systems, 1:495–502, 1987. also reproduced in [15], chapter 25, pp. 447-454.zbMATHGoogle Scholar
  8. 8.
    D. Parisi and S. Nolfi. The influence of learning on evolution. In [15], pages 419–428.Google Scholar
  9. 9.
    S. Delepoulle. Coopération entre agents adaptatifs; étude de la sélection des comportements sociaux, expérimentations et simulations. PhD thesis, Université de Lille 3, URECA, Villeneuve d’Ascq, October 2000. Thèse de doctorat de Psychologie.Google Scholar
  10. 10.
    J.B. Sidowski, B. Wyckoff, and L. Tabory. The influence of reinforcement and punishment in a minimal social situation. Journal of Abnormal Social Psychology, 52:115–119, 1956.CrossRefGoogle Scholar
  11. 11.
    S. Delepoulle, Ph. Preux, and J-C. Darcheville. Learning as a consequence of selection, 2001. (submitted).Google Scholar
  12. 12.
    A.G. Barto. Reinforcement learning and adaptive critic methods. In D.A. White and D.A. Sofge, editors, Handbook of intelligent control: neural, fuzzy, and adaptive approach, pages 469–491. Van Nostrand Reinhold, 1992.Google Scholar
  13. 13.
    R.S. Sutton and A.G. Barto. Reinforcement learning: an introduction. MIT Press, 1998.Google Scholar
  14. 14.
    Ph. Preux, S. Delepoulle, and J-C. Darcheville. Selection of behaviors by their consequences in the human baby, software agents, and robots. In Proc. Computational Biology, Genome Information Systems and Technology, March 2001.Google Scholar
  15. 15.
    M. Mitchell and R. Belew, editors. Adaptive Individuals In Evolving Population Models. Santa Fe Institute Studies in the Sciences of Complexity. Addison-Wesley Publishing Company, 1996.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Samuel Delepoulle⋆
    • 1
    • 2
  • Philippe Preux
    • 2
  • Jean-Claude Darcheville
    • 1
  1. 1.Unité de Recherche sur l’Évolution des Comportements et des Apprentissages (URECA)UPRES-EA 1059, Université de Lille 3Villeneuve d’Ascq CedexFrance
  2. 2.Laboratoire d’Informatique du Littoral (LIL)Université du Littoral Côte d’OpaleCalais CedexFrance

Personalised recommendations