Abstract
Motivation is a central concept in the development of autonomous agents and robots. This paper describes an architecture that uses a psychological BDI model of reasoning, combined with a distributed multi-level model of motivation. The robot controlling architecture makes use of a generic set of deliberative components plus an environment taskcentred set of reactive components that reflect the architecture’s embodiment. The architecture has been used in a number of simulated environments and here is used to control a mobile robot. A theoretical framework for motivation and affect is given, and related to the nature of autonomy and embodiment. A BDI model, based on a psychological model of reasoning in a 5 year old child, is described in terms of the nature of motivation and affect within the architecture. Finally, criteria for judging the nature of an agent’s motivation are introduced, and used to validate the motivational constructs implemented within the architecture. Experimental results lead to a comparative discussion.
Similar content being viewed by others
References
C. Stachniss and W. Burgard, Mobile robot mapping and localization in non-static environments. In Proceedings of the Twentieth National Conference on Artificial Intelligence, pages 1324–1329, 2005.
D. Wolf and S. Sukhatme, Mobile robot simultaneous localization and mapping in dynamic environments. Autonomous Robots, 19(1): 53–65, 2005.
M. Fiala and A. Basu, Robot navigation using panoramic tracking. Pattern Recognition, 37(11):2195–2215, 2004.
A. Sloman, The mind as a control system. In Hookway, C. and Peterson, D. editors, Philosophy and Cognitive Science. Cambridge University Press, 1993.
A. Stoytchev, Some Basic Principles of Developmental Robotics, IEEE Transactions on Autonomous Mental Development, 1(2): 122–130, 2009.
D.N. Davis, Reactive and Motivational Agents, Agent Theory, Architecture and Language (ECAI-96), Budapest, 1996.
D.N. Davis, Control States and Complete Agent Architectures, Computational Intelligence, 17(4):621–650, 2001.
D.N. Davis, Linking perception and action through motivation and affect, Journal of Experimental and Theoretical Artificial Intelligence, 20(1):37–60, March 2008.
D.N. Davis and M.V. Vijayakumar, A “Society of Mind” Cognitive Architecture based on the Principles of Artificial Economics. International Journal of Artificial Life Research. 1(1): 51–71, 2010.
B. Subagdja, L. Sonenberg and I. Rahwan, Intentional learning agent architecture, Autonomous Agents and Multi-Agent Systems, 18(3), June, 2009.
J. Gwatkin, robo-CAMAL: Anchoring in a Cognitive Robot, PhD Thesis, Department of Computer Science, University of Hull, 2009.
R. Arkin, Integrating behavioural, perceptual and world knowledge in reactive navigation. Robotics and Autonomous Systems, 6:105–122, 1990.
R. Beck, Motivation: Theories and Principles. Pearson Education, 4/e, 2000.
D. McFarland, What it means for robot behaviour to be adaptive. In J Meyer and S Wilson, editors, From animals to animats: Proceedings of the Third International Conference on Simulation of Adaptive Behaviour. MIT Press, 1991.
D. Westen, Psychology: Mind, Brain, and Culture. John Wiley and Sons, Inc. 1996.
R. Manzotti and V. Tagliasco, From behaviour-based robots to motivation-based robots, Robotics and Autonomous Systems, 51(2), p.175–190, May 2005.
A. Stoytchev and R. Arkin, Incorporating Motivation in a Hybrid Robot Architecture, Journal of Advanced Computational Intelligence and Intelligent Informatics, 8(3): 269–274, May 2004.
S. Harnad, The symbol grounding problem. Physica D, 42:335, 346, 1990.
S. Coradeschi and A. Saffiotti, An introduction to the anchoring problem. Robotics and Autonomous Systems, 43:85–96, 2003.
W. Clancey, Situated Cognition. Cambridge University Press, 1997.
A. Clark, Embodiement and the philosophy of mind. In A O’Hear, editor, Current Issues in Philosophy of Mind: Royal Institute of Philosophy Supplement 43. Cambridge University Press, 1998.
R. Pfeifer and C. Scheier, Understanding Intelligence. MIT Press, 1999.
E. Thelen, G. Schoner, C. Scheier and L. Smith, The dynamics of embodiment: A field theory of infant perservative reaching. Behavioral and Brain Sciences, 24:1–86, 2001.
E. Alpaydin, Introduction to Machine Learning 2/e. MIT Press, 2010.
R. Sutton and A. Barto, Reinforcement Learning. MIT Press, 1998.
E. Sontag, Mathematical control theory: Deterministic finite dimensional systems. Springer, New York, second edition, 1998.
G. Bourgne, Affect-based multi agent architecture (for a 5-aside football simulation). MSc thesis, School of Computer Science, University of Hull, 2003.
M. Georgeff, B. Pell, M. Pollack, M. Tambe and M. Wooldridge, The belief-desire-intention model of agency. In J. Muller, M. Singh, and A. Rao, Eds., Intelligent Agents V: Agent Theories, Architectures and Languages, pp. 1–10, Springer-Verlag, 1999.
K. Bartsch and H. Wellman, Young children’s attribution of action to beliefs and desires. Child Development, 60:946–964, 1989.
S. Wahl and H. Spada, Children’s reasoning about intentions, beliefs and behaviour. Cognitive Science Quarterly, 1:5–34, 2000.
S. Lewis, Computational Models of Emotion and Affect. PhD thesis, School of Computer Science, University of Hull, 2004.
D.N. Davis, Affect and Affordance: Architectures without Emotion, AAAI 2004, Stanford University, California, USA.
R. Picard, Affective Computing. MIT Press, 1998.
R. Plutchik, The Psychology and Biology of Emotion. Harper Collins. New York, 1994.
J. Tooby and L. Cosmides, The past explains the present: emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology. 11: 375–424. 1990.
P. Ekman, The Nature of Emotion: Fundamental Questions. Oxford University Press. New York. 1994.
K. Scherer, Appraisal Considered as a Process of Multilevel Se quential Checking. In K. Scherer, A. Schorr, T. Johnstone (Eds.), Appraisal Processes in Emotion. Oxford University Press. New York, 2001.
K. Oatley, Best Laid Schemes. Cambridge University Press, 1992.
T-T. Teoh, Y-Y. Nguwi and S-Y. Cho, Towards a portable intelligent facial expression recognizer, Intelligent Decision Technologies, 3(3): 181–191, 2009.
A. Zhu and Q. Luo, Study on Speech Emotion Recognition System in E-Learning. In: Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, Lecture Notes in Computer Science, Springer Berlin/Heidelberg, 2007.
D. Corkill, Blackboard systems. AI Expert, 6(9):40–47, 1991.
T. Savage, The grounding of motivation in artificial animals: Indices of motivational behavior. Cognitive Systems Research, 4:23–55, 2003.
N. Sharkey and J. Heemskerk, The neural mind and the robot. In Brown, A. editor, Neural Network Perspectives on Cognition and Adaptive Robotics. IOP Press, 1997.
N. Sharkey and T. Ziemke, Mechanistic verses phenomenal embodiment: Can robot embodiment lead to strong AI? Cognitive Systems Research, 2:251–262, 2001.
A. Epstein, Instinct and motivation as explanations for complex behavior. In Pfaff, D. editor, The Physiological Mechanisms of Motivation. Springer, 1982.
V. Braitenberg, Vehicles, Experiments in Synthetic Psychology. MIT Press, 1984.
R. Brooks, Intelligence without reason. In Proceedings of the International Joint Conference on Artificial Intelligence, 1:569–595, 1991.
V.M. Venkatamuni, A Society of Mind Approach to Cognition and Metacognition in a Cognitive Architecture, PhD Thesis, Computer Science, University of Hull, August 2008.
M. Bratman, Intentions, Plans and Practical Reason. Harvard University Press, 1987.
T. Phung, M. Winikoff and L. Padgham, Learning within the BDI Framework: An Empirical Analysis, In: Lecture Notes in Computer Science, Volume 3683 (Knowledge-Based Intelligent Information and Engineering Systems), Springer Berlin/Heidelberg, 2005.
B. Subagdja and L. Sonenberg, Learning Plans with Patterns of Actions in Bounded-Rational Agents, In: R. Khosla et al. (Eds.): KES 2005, LNAI 3683, pp. 30–36, 2005.
M. Lekavy and P. Navrat, Expressivity of STRIPS-Like and HTNLike Planning. LNAI Vol. 4496 Agent and multi-agent Systems. Technologies and applications. 1st KES International Symposium, KES-AMSTA 2007, Wroclaw, Poland, May/June 2007.—Germany, Springer-Verlag Berlin Heidelberg, 2007. pp. 121–130.
N. Hawes, J. Wyatt and A. Sloman, Exploring Design Space For An Integrated Intelligent System. Knowledge-Based Systems, 22(7), pages 509–515, Elsevier. Published as a best paper from Artificial Intelligence 2008 (AI-2008), The 28th SGAI International Conference on Artificial Intelligence. September 2009.
S. Hanks, M. Pollack and P.R. Cohen, Benchmarks, Test-beds, Controlled Experimentation, and the Design of Agent Architectures, AI Magazine, 14(4):17–42, 1993.
R.V. Belavkin, On the Relation between Emotion and Entropy, In C. Johnson (Ed.), Proceedings of the AISB’04 Symposium: Emotion, Cognition and Affective Computing, York, 2004.
J.R. Anderson and C. Lebiere, The Atomic Components Of Thought. Lawrence Erlbaum Associates, Mahwah, NJ, 1998.
A. Newell, Unified Theories of Cognition. Harvard University Press, Cambridge, Massachusetts, 1990.
G. Konidaris and A. Barto, An Adaptive Robot Motivational System, From Animals to Animats 9, Lecture Notes in Computer Science, Springer Berlin / Heidelberg 1611–3349 Volume 4095 2006.
E. Spier, From Reactive Behaviour to Adaptive Behaviour: Motivational Models for Behaviour in Animals and Robots. PhD thesis, Balliol College, University of Oxford, 1997.
M. Rodriguez, R. Iglesias, C.V. Regueiro, J. Correa and S. Barro, Autonomous and fast robot learning through motivation, Robotics and Autonomous Systems, 55(9), p.735–740, Sep 2007.
S. Whiteson, M.E. Taylor, P. Stone, Empirical Studies in Action Selection with Reinforcement Learning, Adaptive Behavior, 15(1), 2007.
L.W. Barsalou, Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–609, 1999.
L.W. Barsalou, Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society of London: Biological Sciences, 364, 1281–1289, 2009.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Davis, D., Gwatkin, J. robo-CAMAL: A BDI motivational robot. Paladyn 1, 116–129 (2010). https://doi.org/10.2478/s13230-010-0010-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.2478/s13230-010-0010-4