Skip to main content

A Sequence-Based Neuronal Model for Mobile Robot Localization

  • Conference paper
  • First Online:
KI 2018: Advances in Artificial Intelligence (KI 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11117))

Abstract

Inferring ego position by recognizing previously seen places in the world is an essential capability for autonomous mobile systems. Recent advances have addressed increasingly challenging recognition problems, e.g. long-term vision-based localization despite severe appearance changes induced by changing illumination, weather or season. Since robots typically move continuously through an environment, there is high correlation within consecutive sensory inputs and across similar trajectories. Exploiting this sequential information is a key element of some of the most successful approaches for place recognition in changing environments. We present a novel, neurally inspired approach that uses sequences for mobile robot localization. It builds upon Hierarchical Temporal Memory (HTM), an established neuroscientific model of working principles of the human neocortex. HTM features two properties that are interesting for place recognition applications: (1) It relies on sparse distributed representations, which are known to have high representational capacity and high robustness towards noise. (2) It heavily exploits the sequential structure of incoming sensory data. In this paper, we discuss the importance of sequence information for mobile robot localization, we provide an introduction to HTM, and discuss theoretical analogies between the problem of place recognition and HTM. We then present a novel approach, applying a modified version of HTM’s higher order sequence memory to mobile robot localization. Finally we demonstrate the capabilities of the proposed approach on a set of simulation-based experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    An open source implementation is available: https://www.tu-chemnitz.de/etit/proaut/seqloc.

References

  1. Nilsson, N.J.: Shakey the robot. Technical report 323, AI Center, SRI International, Menlo Park, April 1984

    Google Scholar 

  2. Milford, M., Wyeth, G.F.: SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 1643–1649. IEEE (2012)

    Google Scholar 

  3. Neubert, P.: Superpixels and their application for visual place recognition in changing environments. Ph.D. thesis, Chemnitz University of Technology (2015). http://nbn-resolving.de/urn:nbn:de:bsz:ch1-qucosa-190241

  4. Engelson, S., McDermott, D.: Error correction in mobile robot map-learning. In: International Conference on Robotics and Automation (ICRA), pp. 2555–2560 (1992)

    Google Scholar 

  5. Hawkins, J., Ahmad, S.: Why neurons have thousands of synapses, a theory of sequence memory in neocortex. Front. Neural Circuits 10, 23 (2016). https://www.frontiersin.org/article/10.3389/fncir.2016.00023

    Article  Google Scholar 

  6. Cui, Y., Ahmad, S., Hawkins, J.: Continuous online sequence learning with an unsupervised neural network model. Neural Comput. 28(11), 2474–2504 (2016)

    Article  Google Scholar 

  7. Hawkins, J., Ahmad, S., Purdy, S., Lavin, A.: Biological and machine intelligence (BAMI) (2016). https://numenta.com/resources/biological-and-machine-intelligence/. Initial online release 0.4

  8. Lowry, S., et al.: Visual place recognition: a survey. Trans. Rob. 32(1), 1–19 (2016)

    Article  Google Scholar 

  9. Neubert, P., Protzel, P.: Beyond holistic descriptors, keypoints, and fixed patches: multiscale superpixel grids for place recognition in changing environments. IEEE Robot. Autom. Lett. 1(1), 484–491 (2016)

    Article  Google Scholar 

  10. Cadena, C., Galvez-López, D., Tardos, J.D., Neira, J.: Robust place recognition with stereo sequences. IEEE Trans. Robot. 28(4), 871–885 (2012)

    Article  Google Scholar 

  11. Ho, K.L., Newman, P.: Detecting loop closure with scene sequences. Int. J. Comput. Vis. 74(3), 261–286 (2007)

    Article  Google Scholar 

  12. Johns, E., Yang, G.: Dynamic scene models for incremental, long-term, appearance-based localisation. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 2731–2736. IEEE (2013)

    Google Scholar 

  13. Naseer, T., Spinello, L., Burgard, W., Stachniss, C.: Robust visual robot localization across seasons using network flows. In: Proceedings of AAAI Conference on Artificial Intelligence, AAAI 2014, pp. 2564–2570. AAAI Press (2014)

    Google Scholar 

  14. Milford, M., Wyeth, G., Prasser, D.: RatSLAM: a hippocampal model for simultaneous localization and mapping. In: Proceedings of International Conference on Robotics and Automation (ICRA), pp. 403–408. IEEE (2004)

    Google Scholar 

  15. Hawkins, J.: On Intelligence (with Sandra Blakeslee). Times Books (2004)

    Google Scholar 

  16. Hawkins, J., Ahmad, S., Cui, Y.: A theory of how columns in the neocortex enable learning the structure of the world. Front. Neural Circuits 11, 81 (2017)

    Article  Google Scholar 

  17. NuPIC. https://github.com/numenta/nupic. Accessed 09 May 2018

  18. Ahmad, S., Hawkins, J.: Properties of sparse distributed representations and their application to hierarchical temporal memory. CoRR abs/1503.07469 (2015)

    Google Scholar 

  19. Neubert, P., Schubert, S., Protzel, P.: Learning vector symbolic architectures for reactive robot behaviours. In: Proceedings of International Conference on Intelligent Robots and Systems (IROS) Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics (2016)

    Google Scholar 

  20. Spruston, N.: Pyramidal neurons: dendritic structure and synaptic integration. Nat. Rev. Neurosci. 9, 206–221 (2008)

    Article  Google Scholar 

  21. Numenta. https://numenta.com/. Accessed 09 May 2018

  22. Purdy, S.: Encoding data for HTM systems. CoRR abs/1602.05925 (2016)

    Google Scholar 

  23. Neubert, P., Protzel, P.: Local region detector + CNN based landmarks for practical place recognition in changing environments. In: Proceedings of European Conference on Mobile Robotics (ECMR), pp. 1–6. IEEE (2015)

    Google Scholar 

  24. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123–140 (1996)

    MATH  Google Scholar 

  25. Grieves, R., Jeffery, K.: The representation of space in the brain. Behav. Process. 135, 113–131 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peer Neubert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Neubert, P., Ahmad, S., Protzel, P. (2018). A Sequence-Based Neuronal Model for Mobile Robot Localization. In: Trollmann, F., Turhan, AY. (eds) KI 2018: Advances in Artificial Intelligence. KI 2018. Lecture Notes in Computer Science(), vol 11117. Springer, Cham. https://doi.org/10.1007/978-3-030-00111-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00111-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00110-0

  • Online ISBN: 978-3-030-00111-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics