Abstract
In this article, we present our initial work on sequence prediction of a visual target by implementing a cortically inspired method, namely Hierarchical Temporal Memory (HTM). As a preliminary test, we employ HTM on periodic functions to quantify prediction performance with respect to prediction steps. We then perform simulation experiments on the iCub humanoid robot simulated in the Neurorobotics Platform. We use the robot as embodied agent which enables HTM to receive sequences of visual target position from its camera in order to predict target positions in different trajectories such as horizontal, vertical and sinusoidal. The obtained results indicate that HTM based method can be customized for robotics applications that require adaptation of spatiotemporal changes in the environment and acting accordingly.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Neural Information Processing Systems (NIPS), pp. 1106–1114 (2012)
Glasius, R., Komoda, A., Gielen, S.: Neural network dynamics for path planning and obstacle avoidance. Neural Netw. 8, 125–133 (1995)
Hawkins, J., Blakeslee, S.: On Intelligence. Henry Holt and Company, New York (2004)
Vannucci, L., Ambrosano, A., Cauli, N., Albanese, U., Falotico, E., Ulbrich, S., Pfotzer, L., Hinkel, G., Denninger, O., Peppicelli, D., Guyot, L., Von Arnim, A., Deser, S., Maier, P., Dillman, R., Klinker, G., Levi, P., Knoll, A., Gewaltig, M.-O., Laschi, C.: A visual tracking model implemented on the iCub robot as a use case for a novel neurorobotic toolkit integrating brain and physics simulation. In: IEEE-RAS International Conference on Humanoid Robots, pp. 1179–1184 (2015)
Berthoz, A.: The Brain’s Sense of Movement. Harvard University Press, Cambridge (2002)
Johansson, R.S.: Sensory input and control of grip. Sensory guidance of movement (1998)
Miall, R.C., Wolpert, D.M.: Forward models for physiological motor control. Neural Netw. 9, 1265–1279 (1996)
Nguyen-Tuong, D., Peters, J.: Model learning for robot control: a survey. Cogn. Process. 12, 319–340 (2011)
Gross, H.-M., Heinze, A., Seiler, T., Stephan, V.: Generative character of perception: a neural architecture for sensorimotor anticipation. Neural Netw. 12, 1101–1129 (1999)
Hoffmann, H.: Perception through visuomotor anticipation in a mobile robot. Neural Netw. 20, 22–33 (2007)
Bauml, B., Birbach, O., Wimbock, T., Frese, U., Dietrich, A., Hirzinger, G.: Catching flying balls with a mobile humanoid: system overview and design considerations. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 513–520 (2011)
Kim, S., Billard, A.: Estimating the non-linear dynamics of free-flying objects. Robot. Auton. Syst. 60, 1108–1122 (2012)
Kober, J., Glisson, M., Mistry, M.: Playing catch and juggling with a humanoid robot. In: 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 875–881 (2012)
Falotico, E., Zambrano, D., Muscolo, G.G., Marazzato, L., Dario, P., Laschi, C.: Implementation of a bio-inspired visual tracking model on the iCub robot. In: Proceedings of the 19th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN 2010), pp. 564–569. IEEE (2010)
Vannucci, L., Falotico, E., Di Lecce, N., Dario, P., Laschi, C.: Integrating feedback and predictive control in a bio-inspired model of visual pursuit implemented on a humanoid robot. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) Living Machines 2015. LNCS, vol. 9222, pp. 256–267. Springer, Heidelberg (2015)
Falotico, E., Taiana, M., Zambrano, D., Bernardino, A., Santos-Victor, J., Dario, P., Laschi, C.: Predictive tracking across occlusions in the iCub robot. In: Proceedings of the 9th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2009), pp. 486–491 (2009)
Zambrano, D., Falotico, E., Manfredi, L., Laschi, C.: A model of the smooth pursuit eye movement with prediction and learning. Appl. Bionics Biomech. 7(2), 109–118 (2010)
Cauli, N., Falotico, E., Bernardino, A., Santos-Victor, J., Laschi, C.: Correcting for changes: expected perception-based control for reaching a moving target. IEEE Robot. Autom. Mag. 23, 63–70 (2016)
Datteri, E., Teti, G., Laschi, C., Tamburrini, G., Dario, P., Guglielmelli, E.: Expected perception: an anticipation-based perception-action scheme in robots. In: Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003), vol. 1, pp. 934–939 (2003)
Laschi, C., Asuni, G., Teti, G., Carrozza, M.C., Dario, P., Guglielmelli, E., Johansson, R.: A bio-inspired neural sensory-motor coordination scheme for robot reaching and preshaping. In: The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2006, pp. 531–536 (2006)
Laschi, C., Asuni, G., Guglielmelli, E., Teti, G., Johansson, R., Konosu, H., Wasik, Z., Carrozza, M.C., Dario, P.: A bio-inspired predictive sensory-motor coordination scheme for robot reaching and preshaping. Auton. Robots 25, 85–101 (2008)
Seok, K.H., Kim, Y.S.: A new robot motion authoring method using HTM. In: International Conference on Control, Automation and Systems, pp. 2058–2061 (2008)
Mai, X., Zhang, X., Jin, Y., Yang, Y., Zhang, J.: Simple perception-action strategy based on hierarchical temporal memory. In: 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1759–1764, 12–14 December 2013
Nguyen, V.A., Starzyk, J.A., Tay, A.L.P., Goh, W.: Spatio-temporal sequence learning of visual place cells for robotic navigation. In: The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, 18–23 July 2010
Hawkins, J., George, D.: Hierarchical temporal memory: Concepts, theory and terminology. Technical report, Numenta (2006)
Mountcastle, V.B.: The columnar organization of the neocortex. Brain 120(4), 701–722 (1997)
Hawkins, J., Ahmad, S.: Why Neurons Have Thousands of Synapses. A Theory of Sequence Memory in Neocortex. Frontiers in Neural Circuits (2015)
Cui, Y., Surpur, C., Ahmad, S., Hawkins, J.: Continuous online sequence learning with an unsupervised neural network model (2015). arXiv preprint: arXiv:1512.05463
Hawkins, J., Ahmad, S.: Properties of Sparse Distributed Representations and their Application to Hierarchical Temporal Memory (2015). arXiv preprint: arXiv:1503.07469v1
Acknowledgements
The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 604102 (Human Brain Project). The authors would like to thank the Italian Ministry of Foreign Affairs, General Directorate for the Promotion of the “Country System”, Bilateral and Multilateral Scientific and Technological Cooperation Unit, for the support through the Joint Laboratory on Biorobotics Engineering project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Kirtay, M., Falotico, E., Ambrosano, A., Albanese, U., Vannucci, L., Laschi, C. (2016). Visual Target Sequence Prediction via Hierarchical Temporal Memory Implemented on the iCub Robot. In: Lepora, N., Mura, A., Mangan, M., Verschure, P., Desmulliez, M., Prescott, T. (eds) Biomimetic and Biohybrid Systems. Living Machines 2016. Lecture Notes in Computer Science(), vol 9793. Springer, Cham. https://doi.org/10.1007/978-3-319-42417-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-42417-0_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42416-3
Online ISBN: 978-3-319-42417-0
eBook Packages: Computer ScienceComputer Science (R0)