, Volume 1, Issue 2, pp 116–129 | Cite as

robo-CAMAL: A BDI motivational robot

  • Darryl DavisEmail author
  • James Gwatkin
Research Article


Motivation is a central concept in the development of autonomous agents and robots. This paper describes an architecture that uses a psychological BDI model of reasoning, combined with a distributed multi-level model of motivation. The robot controlling architecture makes use of a generic set of deliberative components plus an environment taskcentred set of reactive components that reflect the architecture’s embodiment. The architecture has been used in a number of simulated environments and here is used to control a mobile robot. A theoretical framework for motivation and affect is given, and related to the nature of autonomy and embodiment. A BDI model, based on a psychological model of reasoning in a 5 year old child, is described in terms of the nature of motivation and affect within the architecture. Finally, criteria for judging the nature of an agent’s motivation are introduced, and used to validate the motivational constructs implemented within the architecture. Experimental results lead to a comparative discussion.


cognitive robot motivation anchoring BDI learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    C. Stachniss and W. Burgard, Mobile robot mapping and localization in non-static environments. In Proceedings of the Twentieth National Conference on Artificial Intelligence, pages 1324–1329, 2005.Google Scholar
  2. [2]
    D. Wolf and S. Sukhatme, Mobile robot simultaneous localization and mapping in dynamic environments. Autonomous Robots, 19(1): 53–65, 2005.CrossRefGoogle Scholar
  3. [3]
    M. Fiala and A. Basu, Robot navigation using panoramic tracking. Pattern Recognition, 37(11):2195–2215, 2004.CrossRefGoogle Scholar
  4. [4]
    A. Sloman, The mind as a control system. In Hookway, C. and Peterson, D. editors, Philosophy and Cognitive Science. Cambridge University Press, 1993.Google Scholar
  5. [5]
    A. Stoytchev, Some Basic Principles of Developmental Robotics, IEEE Transactions on Autonomous Mental Development, 1(2): 122–130, 2009.CrossRefGoogle Scholar
  6. [6]
    D.N. Davis, Reactive and Motivational Agents, Agent Theory, Architecture and Language (ECAI-96), Budapest, 1996.Google Scholar
  7. [7]
    D.N. Davis, Control States and Complete Agent Architectures, Computational Intelligence, 17(4):621–650, 2001.CrossRefGoogle Scholar
  8. [8]
    D.N. Davis, Linking perception and action through motivation and affect, Journal of Experimental and Theoretical Artificial Intelligence, 20(1):37–60, March 2008.CrossRefGoogle Scholar
  9. [9]
    D.N. Davis and M.V. Vijayakumar, A “Society of Mind” Cognitive Architecture based on the Principles of Artificial Economics. International Journal of Artificial Life Research. 1(1): 51–71, 2010.Google Scholar
  10. [10]
    B. Subagdja, L. Sonenberg and I. Rahwan, Intentional learning agent architecture, Autonomous Agents and Multi-Agent Systems, 18(3), June, 2009.Google Scholar
  11. [11]
    J. Gwatkin, robo-CAMAL: Anchoring in a Cognitive Robot, PhD Thesis, Department of Computer Science, University of Hull, 2009.Google Scholar
  12. [12]
    R. Arkin, Integrating behavioural, perceptual and world knowledge in reactive navigation. Robotics and Autonomous Systems, 6:105–122, 1990.CrossRefGoogle Scholar
  13. [13]
    R. Beck, Motivation: Theories and Principles. Pearson Education, 4/e, 2000.Google Scholar
  14. [14]
    D. McFarland, What it means for robot behaviour to be adaptive. In J Meyer and S Wilson, editors, From animals to animats: Proceedings of the Third International Conference on Simulation of Adaptive Behaviour. MIT Press, 1991.Google Scholar
  15. [15]
    D. Westen, Psychology: Mind, Brain, and Culture. John Wiley and Sons, Inc. 1996.Google Scholar
  16. [16]
    R. Manzotti and V. Tagliasco, From behaviour-based robots to motivation-based robots, Robotics and Autonomous Systems, 51(2), p.175–190, May 2005.CrossRefGoogle Scholar
  17. [17]
    A. Stoytchev and R. Arkin, Incorporating Motivation in a Hybrid Robot Architecture, Journal of Advanced Computational Intelligence and Intelligent Informatics, 8(3): 269–274, May 2004.Google Scholar
  18. [18]
    S. Harnad, The symbol grounding problem. Physica D, 42:335, 346, 1990.CrossRefGoogle Scholar
  19. [19]
    S. Coradeschi and A. Saffiotti, An introduction to the anchoring problem. Robotics and Autonomous Systems, 43:85–96, 2003.CrossRefGoogle Scholar
  20. [20]
    W. Clancey, Situated Cognition. Cambridge University Press, 1997.Google Scholar
  21. [21]
    A. Clark, Embodiement and the philosophy of mind. In A O’Hear, editor, Current Issues in Philosophy of Mind: Royal Institute of Philosophy Supplement 43. Cambridge University Press, 1998.Google Scholar
  22. [22]
    R. Pfeifer and C. Scheier, Understanding Intelligence. MIT Press, 1999.Google Scholar
  23. [23]
    E. Thelen, G. Schoner, C. Scheier and L. Smith, The dynamics of embodiment: A field theory of infant perservative reaching. Behavioral and Brain Sciences, 24:1–86, 2001.CrossRefGoogle Scholar
  24. [24]
    E. Alpaydin, Introduction to Machine Learning 2/e. MIT Press, 2010.Google Scholar
  25. [25]
    R. Sutton and A. Barto, Reinforcement Learning. MIT Press, 1998.Google Scholar
  26. [26]
    E. Sontag, Mathematical control theory: Deterministic finite dimensional systems. Springer, New York, second edition, 1998.zbMATHGoogle Scholar
  27. [27]
    G. Bourgne, Affect-based multi agent architecture (for a 5-aside football simulation). MSc thesis, School of Computer Science, University of Hull, 2003.Google Scholar
  28. [28]
    M. Georgeff, B. Pell, M. Pollack, M. Tambe and M. Wooldridge, The belief-desire-intention model of agency. In J. Muller, M. Singh, and A. Rao, Eds., Intelligent Agents V: Agent Theories, Architectures and Languages, pp. 1–10, Springer-Verlag, 1999.Google Scholar
  29. [29]
    K. Bartsch and H. Wellman, Young children’s attribution of action to beliefs and desires. Child Development, 60:946–964, 1989.CrossRefGoogle Scholar
  30. [30]
    S. Wahl and H. Spada, Children’s reasoning about intentions, beliefs and behaviour. Cognitive Science Quarterly, 1:5–34, 2000.Google Scholar
  31. [31]
    S. Lewis, Computational Models of Emotion and Affect. PhD thesis, School of Computer Science, University of Hull, 2004.Google Scholar
  32. [32]
    D.N. Davis, Affect and Affordance: Architectures without Emotion, AAAI 2004, Stanford University, California, USA.Google Scholar
  33. [33]
    R. Picard, Affective Computing. MIT Press, 1998.Google Scholar
  34. [34]
    R. Plutchik, The Psychology and Biology of Emotion. Harper Collins. New York, 1994.Google Scholar
  35. [35]
    J. Tooby and L. Cosmides, The past explains the present: emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology. 11: 375–424. 1990.CrossRefGoogle Scholar
  36. [36]
    P. Ekman, The Nature of Emotion: Fundamental Questions. Oxford University Press. New York. 1994.Google Scholar
  37. [37]
    K. Scherer, Appraisal Considered as a Process of Multilevel Se quential Checking. In K. Scherer, A. Schorr, T. Johnstone (Eds.), Appraisal Processes in Emotion. Oxford University Press. New York, 2001.Google Scholar
  38. [38]
    K. Oatley, Best Laid Schemes. Cambridge University Press, 1992.Google Scholar
  39. [39]
    T-T. Teoh, Y-Y. Nguwi and S-Y. Cho, Towards a portable intelligent facial expression recognizer, Intelligent Decision Technologies, 3(3): 181–191, 2009.Google Scholar
  40. [40]
    A. Zhu and Q. Luo, Study on Speech Emotion Recognition System in E-Learning. In: Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, Lecture Notes in Computer Science, Springer Berlin/Heidelberg, 2007.Google Scholar
  41. [41]
    D. Corkill, Blackboard systems. AI Expert, 6(9):40–47, 1991.Google Scholar
  42. [42]
    T. Savage, The grounding of motivation in artificial animals: Indices of motivational behavior. Cognitive Systems Research, 4:23–55, 2003.CrossRefGoogle Scholar
  43. [43]
    N. Sharkey and J. Heemskerk, The neural mind and the robot. In Brown, A. editor, Neural Network Perspectives on Cognition and Adaptive Robotics. IOP Press, 1997.Google Scholar
  44. [44]
    N. Sharkey and T. Ziemke, Mechanistic verses phenomenal embodiment: Can robot embodiment lead to strong AI? Cognitive Systems Research, 2:251–262, 2001.CrossRefGoogle Scholar
  45. [45]
    A. Epstein, Instinct and motivation as explanations for complex behavior. In Pfaff, D. editor, The Physiological Mechanisms of Motivation. Springer, 1982.Google Scholar
  46. [46]
    V. Braitenberg, Vehicles, Experiments in Synthetic Psychology. MIT Press, 1984.Google Scholar
  47. [47]
    R. Brooks, Intelligence without reason. In Proceedings of the International Joint Conference on Artificial Intelligence, 1:569–595, 1991.Google Scholar
  48. [48]
    V.M. Venkatamuni, A Society of Mind Approach to Cognition and Metacognition in a Cognitive Architecture, PhD Thesis, Computer Science, University of Hull, August 2008.Google Scholar
  49. [49]
    M. Bratman, Intentions, Plans and Practical Reason. Harvard University Press, 1987.Google Scholar
  50. [50]
    T. Phung, M. Winikoff and L. Padgham, Learning within the BDI Framework: An Empirical Analysis, In: Lecture Notes in Computer Science, Volume 3683 (Knowledge-Based Intelligent Information and Engineering Systems), Springer Berlin/Heidelberg, 2005.Google Scholar
  51. [51]
    B. Subagdja and L. Sonenberg, Learning Plans with Patterns of Actions in Bounded-Rational Agents, In: R. Khosla et al. (Eds.): KES 2005, LNAI 3683, pp. 30–36, 2005.Google Scholar
  52. [52]
    M. Lekavy and P. Navrat, Expressivity of STRIPS-Like and HTNLike Planning. LNAI Vol. 4496 Agent and multi-agent Systems. Technologies and applications. 1st KES International Symposium, KES-AMSTA 2007, Wroclaw, Poland, May/June 2007.—Germany, Springer-Verlag Berlin Heidelberg, 2007. pp. 121–130.Google Scholar
  53. [53]
    N. Hawes, J. Wyatt and A. Sloman, Exploring Design Space For An Integrated Intelligent System. Knowledge-Based Systems, 22(7), pages 509–515, Elsevier. Published as a best paper from Artificial Intelligence 2008 (AI-2008), The 28th SGAI International Conference on Artificial Intelligence. September 2009.CrossRefGoogle Scholar
  54. [54]
    S. Hanks, M. Pollack and P.R. Cohen, Benchmarks, Test-beds, Controlled Experimentation, and the Design of Agent Architectures, AI Magazine, 14(4):17–42, 1993.Google Scholar
  55. [55]
    R.V. Belavkin, On the Relation between Emotion and Entropy, In C. Johnson (Ed.), Proceedings of the AISB’04 Symposium: Emotion, Cognition and Affective Computing, York, 2004.Google Scholar
  56. [56]
    J.R. Anderson and C. Lebiere, The Atomic Components Of Thought. Lawrence Erlbaum Associates, Mahwah, NJ, 1998.Google Scholar
  57. [57]
    A. Newell, Unified Theories of Cognition. Harvard University Press, Cambridge, Massachusetts, 1990.Google Scholar
  58. [58]
    G. Konidaris and A. Barto, An Adaptive Robot Motivational System, From Animals to Animats 9, Lecture Notes in Computer Science, Springer Berlin / Heidelberg 1611–3349 Volume 4095 2006.Google Scholar
  59. [59]
    E. Spier, From Reactive Behaviour to Adaptive Behaviour: Motivational Models for Behaviour in Animals and Robots. PhD thesis, Balliol College, University of Oxford, 1997.Google Scholar
  60. [60]
    M. Rodriguez, R. Iglesias, C.V. Regueiro, J. Correa and S. Barro, Autonomous and fast robot learning through motivation, Robotics and Autonomous Systems, 55(9), p.735–740, Sep 2007.CrossRefGoogle Scholar
  61. [61]
    S. Whiteson, M.E. Taylor, P. Stone, Empirical Studies in Action Selection with Reinforcement Learning, Adaptive Behavior, 15(1), 2007.Google Scholar
  62. [62]
    L.W. Barsalou, Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–609, 1999.Google Scholar
  63. [63]
    L.W. Barsalou, Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society of London: Biological Sciences, 364, 1281–1289, 2009.CrossRefGoogle Scholar

Copyright information

© © Versita Warsaw and Springer-Verlag Wien 2010

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity of HullHullUK
  2. 2.Portaltech, Isis HouseLondonUK

Personalised recommendations