Abstract
Inferring ego position by recognizing previously seen places in the world is an essential capability for autonomous mobile systems. Recent advances have addressed increasingly challenging recognition problems, e.g. long-term vision-based localization despite severe appearance changes induced by changing illumination, weather or season. Since robots typically move continuously through an environment, there is high correlation within consecutive sensory inputs and across similar trajectories. Exploiting this sequential information is a key element of some of the most successful approaches for place recognition in changing environments. We present a novel, neurally inspired approach that uses sequences for mobile robot localization. It builds upon Hierarchical Temporal Memory (HTM), an established neuroscientific model of working principles of the human neocortex. HTM features two properties that are interesting for place recognition applications: (1) It relies on sparse distributed representations, which are known to have high representational capacity and high robustness towards noise. (2) It heavily exploits the sequential structure of incoming sensory data. In this paper, we discuss the importance of sequence information for mobile robot localization, we provide an introduction to HTM, and discuss theoretical analogies between the problem of place recognition and HTM. We then present a novel approach, applying a modified version of HTM’s higher order sequence memory to mobile robot localization. Finally we demonstrate the capabilities of the proposed approach on a set of simulation-based experiments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
An open source implementation is available: https://www.tu-chemnitz.de/etit/proaut/seqloc.
References
Nilsson, N.J.: Shakey the robot. Technical report 323, AI Center, SRI International, Menlo Park, April 1984
Milford, M., Wyeth, G.F.: SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 1643–1649. IEEE (2012)
Neubert, P.: Superpixels and their application for visual place recognition in changing environments. Ph.D. thesis, Chemnitz University of Technology (2015). http://nbn-resolving.de/urn:nbn:de:bsz:ch1-qucosa-190241
Engelson, S., McDermott, D.: Error correction in mobile robot map-learning. In: International Conference on Robotics and Automation (ICRA), pp. 2555–2560 (1992)
Hawkins, J., Ahmad, S.: Why neurons have thousands of synapses, a theory of sequence memory in neocortex. Front. Neural Circuits 10, 23 (2016). https://www.frontiersin.org/article/10.3389/fncir.2016.00023
Cui, Y., Ahmad, S., Hawkins, J.: Continuous online sequence learning with an unsupervised neural network model. Neural Comput. 28(11), 2474–2504 (2016)
Hawkins, J., Ahmad, S., Purdy, S., Lavin, A.: Biological and machine intelligence (BAMI) (2016). https://numenta.com/resources/biological-and-machine-intelligence/. Initial online release 0.4
Lowry, S., et al.: Visual place recognition: a survey. Trans. Rob. 32(1), 1–19 (2016)
Neubert, P., Protzel, P.: Beyond holistic descriptors, keypoints, and fixed patches: multiscale superpixel grids for place recognition in changing environments. IEEE Robot. Autom. Lett. 1(1), 484–491 (2016)
Cadena, C., Galvez-López, D., Tardos, J.D., Neira, J.: Robust place recognition with stereo sequences. IEEE Trans. Robot. 28(4), 871–885 (2012)
Ho, K.L., Newman, P.: Detecting loop closure with scene sequences. Int. J. Comput. Vis. 74(3), 261–286 (2007)
Johns, E., Yang, G.: Dynamic scene models for incremental, long-term, appearance-based localisation. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 2731–2736. IEEE (2013)
Naseer, T., Spinello, L., Burgard, W., Stachniss, C.: Robust visual robot localization across seasons using network flows. In: Proceedings of AAAI Conference on Artificial Intelligence, AAAI 2014, pp. 2564–2570. AAAI Press (2014)
Milford, M., Wyeth, G., Prasser, D.: RatSLAM: a hippocampal model for simultaneous localization and mapping. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 403–408. IEEE (2004)
Hawkins, J.: On Intelligence (with Sandra Blakeslee). Times Books (2004)
Hawkins, J., Ahmad, S., Cui, Y.: A theory of how columns in the neocortex enable learning the structure of the world. Front. Neural Circuits 11, 81 (2017)
NuPIC. https://github.com/numenta/nupic. Accessed 09 May 2018
Ahmad, S., Hawkins, J.: Properties of sparse distributed representations and their application to hierarchical temporal memory. CoRR abs/1503.07469 (2015)
Neubert, P., Schubert, S., Protzel, P.: Learning vector symbolic architectures for reactive robot behaviours. In: Proceedings of International Conference on Intelligent Robots and Systems (IROS) Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics (2016)
Spruston, N.: Pyramidal neurons: dendritic structure and synaptic integration. Nat. Rev. Neurosci. 9, 206–221 (2008)
Numenta. https://numenta.com/. Accessed 09 May 2018
Purdy, S.: Encoding data for HTM systems. CoRR abs/1602.05925 (2016)
Neubert, P., Protzel, P.: Local region detector + CNN based landmarks for practical place recognition in changing environments. In: Proceedings of European Conference on Mobile Robotics (ECMR), pp. 1–6. IEEE (2015)
Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123–140 (1996)
Grieves, R., Jeffery, K.: The representation of space in the brain. Behav. Process. 135, 113–131 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Neubert, P., Ahmad, S., Protzel, P. (2018). A Sequence-Based Neuronal Model for Mobile Robot Localization. In: Trollmann, F., Turhan, AY. (eds) KI 2018: Advances in Artificial Intelligence. KI 2018. Lecture Notes in Computer Science(), vol 11117. Springer, Cham. https://doi.org/10.1007/978-3-030-00111-7_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-00111-7_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00110-0
Online ISBN: 978-3-030-00111-7
eBook Packages: Computer ScienceComputer Science (R0)