Abstract
The paper proposes the framework for an animat control system (the Animat Brain) that is based on the Petr K. Anokhin’s theory of functional systems. We propose the animat control system that consists of a set of functional systems (FSs) and enables predictive and purposeful behavior. Each FS consists of two neural networks: the actor and the predictor. The actors are intended to form chains of actions and the predictors are intended to make prognoses of future events. There are primary and secondary repertoires of behavior: the primary repertoire is formed by evolution; the secondary repertoire is formed by means of learning. This paper describes both principles of the Animat Brain operation and the particular model of predictive behavior in a cellular landmark environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anokhin, P.K.: Biology and Neurophysiology of the Conditioned Reflex and Its Role in Adaptive Behavior. Pergamon, Oxford (1974)
Butz, M.V., Sigaud, O., Gérard, P. (eds.): Anticipatory Behavior in Adaptive Learning Systems. LNCS. Springer-Verlag, Berlin (2003)
Butz, M.V., Sigaud, O., Gérard, P.: Internal Models and Anticipations in Adaptive Learning Systems. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 86–109. Springer, Heidelberg (2003)
Tani, J.: Model-Based Learning for Mobile Robot Navigation from the Dynamical Systems Perspective. IEEE Trans. on Systems, Man, and Cybernetics. Part B: Cybernetics 26, 421–436 (1996)
Paine, R W., Tani, J.: How Hierarchical Control Self-organizes in Artificial Adaptive Systems. Adaptive Behavior 13, 211–225 (2005)
Witkowski, M.: Towards a Four Factor Theory of Anticipatory Learning. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 66–85. Springer, Heidelberg (2003)
Butz, M.V., Goldberg, D.E.: Generalized State Values in an Anticipatory Learning Classifier System. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 282–302. Springer, Heidelberg (2003)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. In: A Bradford Book, MIT Press, Cambridge, MA (1998)
Holland, J.H., Holyoak, K.J., Nisbett, R.E., Thagard, P.: Induction: Processes of Inference, Learning, and Discovery. MIT Press, Cambridge, MA (1986)
Edelman, G.M.: Neural Darwinism: The Theory of Neuronal Group Selection. Oxford University Press, Oxford (1989)
Rumelhart, D.E., Hinton, G.E., Williams, R.G.: Learning Representation by Back-Propagating Error. Nature 323, 533–536 (1986)
Chittka, L., Thomson, J.D., Waser, N.M.: Flower Constancy, Insect Psychology, and Plant Evolution. Naturwissenschaften 86, 361–377 (1999)
Goulson, D., Stout, J.C., Hawson, S.A.: Can Flower Constancy in Nectaring Butterflies Be Explained by Darwin’s Interference Hypothesis? Oecologia 112, 225–231 (1997)
Jackson, R.R., Carter, C.M., Tarsitano, M.S.: Trial-and-error Solving of Confinement Problem by Araneophagic Jumping Spiders, Portia Fimbriata. Behaviour 138, 1215–1234 (2001)
Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor, MI (1975). 2nd edn. MIT Press, Boston, MA (1992)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, London, UK (1989)
Krichmar, J.L., Edelman, G.M.: Machine Psychology: Autonomous Behavior, Perceptual Categorization and Conditioning in a Brain-Based Device. Cerebral Cortex 12, 818–830 (2002)
Krichmar, J.L., Seth, A.K., Nitz, D.A., Fleischer, J.G., Edelman, G.M.: Spatial Navigation and Causal Analysis in a Brain-Based Device Modeling Cortical-Hippocampal Interactions. Neuroinformatics 3, 197–221 (2005)
Red’ko, V.G., Prokhorov, D.V., Burtsev, M.S.: Theory of Functional Systems, Adaptive Critics and Neural Networks. In: Proc. International Joint Conference on Neural Networks (IJCNN 2004), Budapest, pp. 1787–1792 (2004)
Red’ko, V.G., Mosalov, O.P., Prokhorov, D.V.: A Model of Evolution and Learning. Neural Networks 18, 738–745 (2005)
Stanley, K.O., Bryant, B.D., Miikkulainen, R.: Evolving Neural Network Agents in the NERO Video Game. In: Proceedings of the IEEE, Symposium on Computational Intelligence and Games (CIG 2005), Essex University, Colchester, Essex, UK, pp. 182–189 ( 2005)
Wolpert, D.M., Kawato, M.: Multiple Paired Forward and Inverse Models for Motor Control. Neural Networks 11, 1317–1329 (1998)
Haruno, M., Wolpert, D.M., Kawato, M.: MOSAIC Model for Sensorimotor Learning and Control. Neural Computation 13, 2201–2220 (2001)
Fry, S.N., Wehner, R.: Look and Turn: Landmark-Based Goal Navigation in Honey Bees. The. Journal of Experimental Biology 208, 3945–3955 (2005)
Morris, R.G.M., Garrud, P., Rawlins, J.N.P., O’Keefe, J.: Place Navigation Impaired in Rats with Hippocampal Lesions. Nature 297, 681–683 (1982)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Red’ko, V.G. et al. (2007). Project “Animat Brain”: Designing the Animat Control System on the Basis of the Functional Systems Theory. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds) Anticipatory Behavior in Adaptive Learning Systems. ABiALS 2006. Lecture Notes in Computer Science(), vol 4520. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74262-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-74262-3_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74261-6
Online ISBN: 978-3-540-74262-3
eBook Packages: Computer ScienceComputer Science (R0)