Abstract
This paper describes the integration of several cognitively inspired anticipation and anticipatory learning mechanisms in an autonomous agent architecture, the Learning Intelligent Distribution Agent (LIDA) system. We provide computational mechanisms and experimental simulations for variants of payoff, state, and sensorial anticipatory mechanisms. The payoff anticipatory mechanism in LIDA is implicitly realized by the action selection dynamics of LIDA’s decision making component, and is enhanced by importance and discrimination factors. A description of a non-routine problem solving algorithm is presented as a form of state anticipatory mechanism. A technique for action driven sensational and attentional biasing similar to a preafferent signal and preparatory attention is offered as a viable sensorial anticipatory mechanism. We also present an automatization mechanism coupled with an associated deautomatization procedure, and an instructionalist based procedural learning algorithm as forms of implicit and explicit anticipatory learning mechanisms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baars, B.: A Cognitive Theory of Consciousness. Cambridge University Press, New York (1988)
Barsalou, L.W.: Perceptual symbol systems. Behavioral and Brain Sciences 22, 577–609 (1999)
Baddeley, A.D., Hitch, G.J.: Working memory. In: Bower, G.A. (ed.) The Psychology of Learning and Motivation, Academic Press, New York (1974)
Baldassarre, G.: A biologically plausible model of human planning based on neural networks and Dyna-PI models. In: Butz M., Sigaud O., Gérard P., Workshop on Adaptive Behaviour in Anticipatory Learning Systems, pp. 40–60 (2002)
Baluja, S., Pomerleau, D.A.: Using the Representation in a Neural Network’s Hidden Layer for Task-Specific Focus of Attention. In: Mellish, C. (ed.) (IJCAI-95) IJCAI. International Joint Conference on Artificial Intelligence 1995, pp. 133–139. Morgan Kaufmann, San Mateo, CA (1995)
Blank, D.S., Lewis, J.M., Marshall, J.B.: The Multiple Roles of Anticipation in Developmental Robotics. In: AAAI Fall Symposium Workshop Notes, From Reactive to Anticipatory Cognitive Embodied Systems, AAAI Press, Stanford, California, USA (2005)
Brooks, R.A.: A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation RA-2, 14–23 (1986)
Butz, M.V., Sigaud, O., Gerard, P.: Internal models and anticipations in adaptive learning systems. In: Proceedings of the Workshop on Adaptive Behavior in Anticipatory Learning Systems, pp. 1–23 (2002)
Butz, M.V., Goldberg, D.E.: Generalized state values in an anticipatory learning classifier system. In: Proceedings of the Workshop on Adaptive Behavior in Anticipatory Learning Systems, pp. 78–96 (2002)
Cañamero, D.: Modeling Motivations and Emotions as a Basis for Intelligent Behavior. In: AA 1997. Proceedings of the First International Symposium on Autonomous Agents, Marina del Rey, CA, February 5-8, The ACM Press, New York (1997)
Card, S., Moran, T., Newell, A.: The psychology of human-computer interaction. Lawrence Erlbaum Associates, Hillsdale, NJ (1983)
D’Mello, S.K., Franklin, S., Ramamurthy, U., Baars, B.J.: A Cognitive Science Based Machine Learning Architecture (Technical Report SS-06-02). In: AAAI Spring Symposia Technical Series, Stanford CA, USA, pp. 40–45. AAAI Press, Stanford, California, USA (2006)
Drescher, G.: Made Up Minds: A Constructivist Approach to Artificial Intelligence. MIT Press, Cambridge, MA (1991)
Franklin, S.: Automating Human Information Agents. In: Chen, Z., Jain, L.C. (eds.) Practical Applications of Intelligent Agents, Springer-Verlag, Berlin (2001)
Franklin, S., Baars, B.J., Ramamurthy, U., Ventura, M.: The Role of Consciousness in Memory. Brains, Minds and Media, vol.1, bmm150 (urn:nbn:de:0009-3-1505) (2005)
Gerard, P., Stolzmann, W., Sigaud, O.: YACS: a new Learning Classifier System using Anticipation.Soft. Computing 6(3-4), 216–228 (2002)
Glenberg, A.: What memory is for Behavioral and Brain Sciences, vol. 20, pp. 1–55 (1997)
Hartland, C., Bredeche, N.: Evolutionary Robotics: From Simulation to the Real World using Anticipation. In: Third Workshop on Anticipatory Behavior in Adaptive Learning Systems (2006)
Hofstadter, D.R., Mitchell, M.: he Copycat Project: A model of mental fluidity and analogy-making. In: Holyoak, K.J., Barnden, J.A. (eds.) Advances in connectionist and neural computation theory, logical connections, vol. 2, Ablex, Norwood (1994)
Kahneman, D., Chajczyk, D.: Test of automaticity of reading: Dilution of the stroop effect by color-irrelevant stimuli. Journal of Experimental Psychology: Human Perception and Performance 9, 947–509 (1983)
Kay, L.M, Freeman, W.J, Lancaster, L.R.: Simultaneous EEG recordings from olfactory and limbic brain structures: Limbic markers during olfactory perception. In: Gath, I., Inbar, G. (eds.) Advances in Processing and Pattern Analysis of Biological Signals, pp. 71–84. Plenum, New York (1996)
Kunde, W.: Response–effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception & Performance 27, 387–394 (2001)
LaBerge, D.: Attentional processing: the brain’s art of mindfulness. Harvard University Press, Cambridge (1995)
Laird, J.E., Newell, A., Rosenbloom, P.S.: SOAR: An architecture for general intelligence. Artificial Intelligence 33, 1–64 (1987)
Lebiere, C., Anderson, J.R.: A connectionist implementation of the ACT-R production system. In: Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society, Erlbaum, Hillsdalle NJ (1993)
Logan, G.D.: Attention and automaticity in Stroop and priming tasks: Theory and data. Cognitive Psychology 12, 523–553 (1980)
Logan, G.D.: Toward an instance theory of automatization. Psychological Review 95, 583–598 (1998)
Maes, P.: How to do the right thing. Connection Science 1, 291–323 (1989)
Negatu, A.:Cognitively Inspired Decision Making for Software Agents: Integrated Mechanisms for Action Selection, Expectation, Automatization and Non-Routine Problem Solving, Ph.D. Dissertation, The University of Memphis, USA ( 2006)
Negatu, A., McCauley, T.L., Franklin, S.: in review. Automatization for Software Agents.
Newell, A.: Unified theories of cognition. Harvard University Press, Cambridge MA (1990)
Newell, A., Shaw, J.C., Simon, H.A.: Elements of a theory of human problem solving. Psychological Review 65, 151–166 (1958)
Pashler, H.E.: The psychology of attention. MIT Press, Cambridge, MA (1998)
Piaget, J.: The Origins of Intelligence in Children. International Universities Press, New York (1952)
Post, E.L.: Absolutely unsolvable problems and relatively undecidable propositions account of an anticipation. In: Davis, M. (ed.) The undecidable: Basic papers on undecidable propositions, un-solvable problems and computable functions, Raven Press, New York (1965)
Rosen, R.: Anticipatory Systems. Pergamon Press, London (1985)
Sacerdoti, E.: A structure for plans and behavior. American Elsevier, New York (1977)
Schubotz, R.I., von Cramon, D.Y.: Functional organization of the lateral premotor cortex. fMRI reveals different regions activated by anticipation of object properties, location and speed. Cognitive Brain Research 11, 97–112 (2001)
Schneider, W., Shiffrin, R.M.: Controlled and automatic human information processing: I. Detection, search, and attention. Psychological Review 84, 1–66 (1977)
Sloman, A.: What Sort of Architecture is Required for a Human-like Agent? In: Wooldridge, M., Rao, A.S. (eds.) Foundations of Rational Agency, Kluwer Academic Publishers, Dordrecht, Netherlands (1999)
Sutton, R.: Planning by incremental dynamic programming. In: Eight International Workshop on Machine Learning, pp. 353–357. Morgan Kaufmann, San Francisco (1991)
Stolzmann, W.: Anticipatory Classifier Systems. In: Genetic Programming, University of Wisconsin, Madison, Wisconsin, Morgan Kaufmann, Seattle, Washington, USA (1998)
Sun, R.: An agent architecture for on-line learning of procedural and declarative knowledge. In: ICONIP 1997. Proceedings of the International Conference on Neural Information Processing, Singapore, Springer Verlag, Heidelberg (1997)
Tani, J.: Model-based learning for mobile robot navigation from the dynamical systems perspective. IEEE Transaction on Systems, Man and Cybernetics 26B, 421–436 (1996)
Varela, F.J., Thompson, E., Rosch, E.: The Embodied Mind. MIT Press, Cambridge, MA (1991)
Watkins, C.: Learning with delayed rewards. Doctoral dissertation, Psychology Department, University of Cambridge, England (1989)
Witkowski, C.M.: Anticipatory learning: The animat as discovery engine In: Butz, M.V., Gerard, P., Siguad, O. (eds.) Adaptive Behavior in Anticipatory Learning Systems (ABiALS 2002) (2002)
Weng, J.: Developmental Robotics: Theory and Experiments. International Journal of Humanoid Robotics 1(2), 199–235 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Negatu, A., D’Mello, S., Franklin, S. (2007). Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds) Anticipatory Behavior in Adaptive Learning Systems. ABiALS 2006. Lecture Notes in Computer Science(), vol 4520. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74262-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-74262-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74261-6
Online ISBN: 978-3-540-74262-3
eBook Packages: Computer ScienceComputer Science (R0)