Skip to main content

Improving Self-Localization Using CNN-based Monocular Landmark Detection and Distance Estimation in Virtual Testbeds

  • Conference paper
  • First Online:

Zusammenfassung

Mobile robots often require knowledge of their precise position. However, in many cases the integration of an outside-in tracking system is not feasible. In the exemplary case of autonomous vehicles, Global Navigation Satellite Systems (GNSS) are available but do not fulfill the precision requirements sufficiently strictly. Monocular cameras are another technology which is already built into many commercially available vehicles to enable additional safety and comfort features. Their image streams can be utilized to enhance localization precision using prior knowledge of landmarks along the roads.

In this paper, an integrated architecture for landmark detection, classification, position estimation and landmark-based localization is presented. The system is developed within a virtual testbed allowing for rapid development and evaluation of the employed components. In testing, an accuracy in the order of 10 cm is achieved for localization, constituting a significant improvement compared to systems using positional data from navigation satellites only.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   99.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Literatur

  1. J. Rossmann, N. Wantia, M. Springer, et al.: Rapid Generation of 3D Navigation Maps for Extraterrestrial Landing and Exploration Missions: The Virtual Testbed Approach. In: 11th Symposium on Advanced Space Technologies in Robotics and Automation 2011 (ASTRA). Noordwijk, Niederlande: ESA / ESTEC, 2011, pp. 17.

    Google Scholar 

  2. Y. Jia, E. Shelamer, J. Donahue, et al.: Caffe: Convolutional Architecture for Fast Feature Embedding. In: arXiv preprint (2014). arXiv:1408.5093

  3. M. de Saint Blancard: Road Sign Recognition: A Study of Vision-based Decision Making for Road Environment Recognition. In: Vision-based Vehicle Guidance. Ed. by I. Masaki. New York, NY: Springer New York, 1992, pp. 162172. isbn: 978-1-4612-2778-6. https://doi.org/10.1007/978-1-4612-2778-6_7.

    Google Scholar 

  4. S. Houben, J. Stallkamp, J. Salmen, et al.: Detection of Traffic Signs in Real- World Images: The German Traffic Sign Detection Benchmark. In: International Joint Conference on Neural Networks (submitted). 2013.

    Google Scholar 

  5. Z. Zhu, J. Lu, R. R. Martin, et al.: An Optimization Approach for Localization Refinement of Candidate Traffic Signs. In: IEEE Transactions on Intelligent Transportation Systems PP.99 (2017), pp. 111. issn: 15249050. https://doi.org/10.1109/tits.2017.2665647.

    Article  Google Scholar 

  6. J. Stallkamp, M. Schlipsing, J. Salmen, et al.: The German Traffic Sign Recognition Benchmark: A multi-class classification competition. In: Proceedings of the International Joint Conference on Neural Networks October 2016 (2011), pp. 1453 1460. issn: 2161-4393. https://doi.org/10.1109/ijcnn.2011.6033395.

  7. R. Timofte, K. Zimmermann, and L. Van Gool: Multi-view traffic sign detection, recognition, and 3D localisation. In: Machine Vision and Applications 25.3 (2014), pp. 633647. issn: 14321769. https://doi.org/10.1007/s00138-011-0391-3.

    Article  Google Scholar 

  8. J. Stallkamp, M. Schlipsing, J. Salmen, et al.: Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. In: Neural Networks 32.October 2016 (2012), pp. 323332. issn: 08936080. https://doi.org/10.1016/j.neunet. 2012.02.016.

  9. Z. Zhu, D. Liang, S. Zhang, et al.: Traffic-Sign Detection and Classification in the Wild. In: CVPR Open Access (2016), pp. 21102118. https://doi.org/10.1109/cvpr.2016.232.

  10. G. Stein, O. Mano, and A. Shashua: Vision-based ACC with a single camera: bounds on range and range rate accuracy. In: IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683). IEEE, 2003, pp. 120125. isbn: 0-7803-7848-2. https://doi.org/10.1109/ivs.2003.1212895.

  11. R. Schubert, E. Richter, and G. Wanielik: Comparison and evaluation of advanced motion models for vehicle tracking. In: Information Fusion, 2008 11th International Conference on 1 (2008), pp. 16. https://doi.org/10.1109/icif.2008.4632283.

  12. G. Guennebaud, B. Jacob, et al.: Eigen v3. 2010.

    Google Scholar 

  13. E. a. Wan and R. Van Der Merwe: The unscented Kalman filter for nonlinear estimation. In: Technology v (2000), pp. 153158. issn: 15270297. https://doi.org/10.1109/ASSPCC.2000.882463.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Atanasyan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer-Verlag GmbH Deutschland, ein Teil von Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Atanasyan, A., Roßmann, J. (2019). Improving Self-Localization Using CNN-based Monocular Landmark Detection and Distance Estimation in Virtual Testbeds. In: Schüppstuhl, T., Tracht, K., Roßmann, J. (eds) Tagungsband des 4. Kongresses Montage Handhabung Industrieroboter. Springer Vieweg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-59317-2_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-59317-2_25

  • Published:

  • Publisher Name: Springer Vieweg, Berlin, Heidelberg

  • Print ISBN: 978-3-662-59316-5

  • Online ISBN: 978-3-662-59317-2

  • eBook Packages: Computer Science and Engineering (German Language)

Publish with us

Policies and ethics