Bootstrapping Autonomous Skill Learning in the MDB Cognitive Architecture

  • Alejandro Romero
  • Francisco Bellas
  • Jose A. Becerra
  • Richard J. DuroEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11486)


This paper is concerned with motivation in autonomous robots. In particular we focus on the basic structure that is necessary for bootstrapping the initial stages of multiple skill learning within the motivational engine of the MDB cognitive architecture. To this end, taking inspiration from a series of computational models of the use of motivations in infants, we propose an approach that leverages two types of cognitive motivations: exploratory and proficiency based. The latter modulated by the concept of interestingness. We postulate that these make up the minimum set of motivational components required to initiate the unrewarded learning of a skill toolbox that may later be used in order to achieve operational goals. The approach is illustrated through an experiment with a real robot that is learning skills in a real environment.


Cognitive Developmental Robotics Motivational system Skill learning Open-ended learning 



This work has been funded by the EU’s H2020 research programme (grant No 640891 DREAM), MINECO/FEDER (grant TIN2015-63646-C5-1-R), Xunta de Galicia/FEDER (grant ED431C 2017/12), and Spanish Ministry of Education, Culture and Sports for the FPU grant of A. Romero.


  1. 1.
    Asada, M., et al.: Cognitive developmental robotics: a survey. IEEE Trans. Auton. Ment. Dev. 1(1), 12–34 (2009)CrossRefGoogle Scholar
  2. 2.
    Begum, M., Karray, F.: Computational intelligence techniques in bio-inspired robotics. In: Liu, D., Wang, L., Tan, K.C. (eds.) Design and Control of Intelligent Robotic Systems. SCI, vol. 177, pp. 1–28. Springer, Heidelberg (2009). Scholar
  3. 3.
    Bellas, F., Duro, R.J., Faina, A., Souto, D.: Multilevel darwinist brain (MDB): artificial evolution in a cognitive architecture for real robots. IEEE Trans. Auton. Ment. Dev. 2(4), 340–354 (2010)CrossRefGoogle Scholar
  4. 4.
    Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrel, T., Efros, A.: Large-scale study of curiosity-driven learning. arXiv preprint arXiv:1808.04355 (2018)
  5. 5.
    Deci, E.L., Ryan, R.M.: Cognitive evaluation theory. In: Deci, E.L., Ryan, R.M. (eds.) Intrinsic Motivation and Self-Determination in Human Behavior. PSPS, pp. 43–85. Springer, Boston (1985). Scholar
  6. 6.
    Doncieux, S., et al.: Open-ended learning: a conceptual framework based on representational redescription. Front. Neurorob. 12, 59 (2018)CrossRefGoogle Scholar
  7. 7.
    Duro, R.J., Becerra, J., Monroy, J., Bellas, F.: Perceptual generalization and context in a network memory inspired long term memory for artificial cognition. Int. J. Neural Syst. (2019, accepted for publication)Google Scholar
  8. 8.
    Forestier, S., Mollard, Y., Oudeyer, P.Y.: Intrinsically motivated goal exploration processes with automatic curriculum learning. arXiv:1708.02190 (2017)
  9. 9.
    Huang, X., Weng, J.: Novelty and reinforcement learning in the value system of developmental robots. In: Proceedings of the Second International Workshop on Epigenetic Robotics, pp. 47–55 (2002)Google Scholar
  10. 10.
    Maslow, A.H.: A theory of human motivation. Psychol. Rev. 50(13), 370–396 (1943)CrossRefGoogle Scholar
  11. 11.
    Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015)CrossRefGoogle Scholar
  12. 12.
    Di Nocera, D., Finzi, A., Rossi, S., Staffa, M.: The role of intrinsic motivations in attention allocation and shifting. Front. Psychol. 5, 273 (2014)CrossRefGoogle Scholar
  13. 13.
    Oudeyer, P.Y., Kaplan, F.: What is intrinsic motivation? A typology of computational approaches. Front. Neurorob. 1, 6 (2009)Google Scholar
  14. 14.
    Rolf, M., Asada, M.: What are goals ? And if so, how many ? In: Proceedings of Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), pp. 332–339 (2015)Google Scholar
  15. 15.
    Ryan, R., Deci, E.: Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp. Educ. Psychol. 25(1), 54–67 (2000)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Alejandro Romero
    • 1
  • Francisco Bellas
    • 1
  • Jose A. Becerra
    • 1
  • Richard J. Duro
    • 1
    Email author
  1. 1.Integrated Group for Engineering ResearchUniversidade da CoruñaA CoruñaSpain

Personalised recommendations