Advertisement

Real-Time Point Cloud Alignment for Vehicle Localization in a High Resolution 3D Map

  • Balázs NagyEmail author
  • Csaba Benedek
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11129)

Abstract

In this paper we introduce a Lidar based real time and accurate self localization approach for self driving vehicles (SDV) in high resolution 3D point cloud maps of the environment obtained through Mobile Laser Scanning (MLS). Our solution is able to robustly register the sparse point clouds of the SDVs to the dense MLS point cloud data, starting from a GPS based initial position estimation of the vehicle. The main steps of the method are robust object extraction and transformation estimation based on multiple keypoints extracted from the objects, and additional semantic information derived from the MLS based map. We tested our approach on roads with heavy traffic in the downtown of a large city with large GPS positioning errors, and showed that the proposed method enhances the matching accuracy with an order of magnitude. Comparative tests are provided with various keypoint selection strategies, and against a state-of-the-art technique.

Keywords

Lidar Point cloud Registration Scene understanding 

Notes

Acknowledgment

This work was supported by the National Research, Development and Innovation Fund (grants NKFIA K-120233 and KH-125681), and by the Széchenyi 2020 Program (grants EFOP-3.6.2-16-2017-00013 and 3.6.3-VEKOP-16- 2017-00002). Cs. Benedek also acknowledges the support of the Janos Bolyai Research Scholarship of the Hungarian Academy of Sciences.

References

  1. 1.
    Bayat, B., Crasta, N., Crespi, A., Pascoal, A.M., Ijspeert, A.: Environmental monitoring using autonomous vehicles: a survey of recent searching techniques. Curr. Opin. Biotechnol. 45, 76–84 (2017).  https://doi.org/10.1016/j.copbio.2017.01.009. http://www.sciencedirect.com/science/article/pii/S0958166916302312CrossRefGoogle Scholar
  2. 2.
    Börcs, A., Nagy, B., Benedek, C.: Fast 3-D urban object detection on streaming point clouds. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8926, pp. 628–639. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-16181-5_48CrossRefGoogle Scholar
  3. 3.
    Douillard, B., et al.: Scan segments matching for pairwise 3D alignment. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3033–3040. St. Paul, May 2012.  https://doi.org/10.1109/ICRA.2012.6224788
  4. 4.
    Gálai, B., Nagy, B., Benedek, C.: Crossmodal point cloud registration in the Hough space for mobile laser scanning data. In: International Conference on Pattern Recognition (ICPR), pp. 3374–3379. IEEE, Cancun (2016)Google Scholar
  5. 5.
    Gressin, A., Cannelle, B., Mallet, C., Papelard, J.P.: Trajectory-based registration of 3D LIDAR point clouds acquired with a mobile mapping system. In: ISPRS Annals of Photogrammetry Remote Sensing and Spatial Information Sciences, pp. 117–122, July 2012.  https://doi.org/10.5194/isprsannals-I-3-117-2012CrossRefGoogle Scholar
  6. 6.
    Gressin, A., Mallet, C., David, N.: Improving 3D LIDAR point cloud registration using optimal neighborhood knowledge. In: ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, pp. 111–116, July 2012.  https://doi.org/10.5194/isprsannals-I-3-111-2012CrossRefGoogle Scholar
  7. 7.
    Kang, M., Hur, S., Jeong, W., Park, Y.: Map building based on sensor fusion for autonomous vehicle. In: International Conference on Information Technology: New Generations, pp. 490–495. Las Vegas, April 2014.  https://doi.org/10.1109/ITNG.2014.30
  8. 8.
    Magnusson, M.: The Three-Dimensional Normal-Distributions Transform - an Efficient Representation for Registration, Surface Analysis, and Loop Detection. Ph.D. thesis, Örebro University (December 2009)Google Scholar
  9. 9.
    Matthaei, R., Bagschik, G., Maurer, M.: Map-relative localization in lane-level maps for ADAS and autonomous driving. In: IEEE Intelligent Vehicles Symposium Proceedings, pp. 49–55, Dearborn, June 2014.  https://doi.org/10.1109/IVS.2014.6856428
  10. 10.
    Men, H., Gebre, B., Pochiraju, K.: Color point cloud registration with 4D ICP algorithm. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1511–1516, Shanghai, May 2011.  https://doi.org/10.1109/ICRA.2011.5980407
  11. 11.
    Mian, A., Bennamoun, M., Owens, R.: On the repeatability and quality of keypoints for local feature-based 3D object retrieval from cluttered scenes. Int. J. Comput. Vis. 89(2), 348–361 (2010).  https://doi.org/10.1007/s11263-009-0296-zCrossRefGoogle Scholar
  12. 12.
    Nagy, B., Benedek, C.: 3D CNN based phantom object removing from mobile laser scanning data. In: International Joint Conference on Neural Networks (IJCNN), pp. 4429–4435, Anchorage, May 2017Google Scholar
  13. 13.
    Qi, C., Yi, L., Su, H., Guibas, L.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Conference on Neural Information Processing Systems (NIPS), pp. 5105–5114. Long Beach (2017)Google Scholar
  14. 14.
    Ratha, N.K., Karu, K., Chen, S., Jain, A.K.: A real-time matching system for large fingerprint databases. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 799–813 (1996).  https://doi.org/10.1109/34.531800CrossRefGoogle Scholar
  15. 15.
    Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3212–3217, Kobe, May 2009.  https://doi.org/10.1109/ROBOT.2009.5152473
  16. 16.
    Rusu, R.B., Cousins, S.: 3D is here: point cloud library (PCL). In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1–4, Shanghai, May 2011.  https://doi.org/10.1109/ICRA.2011.5980567
  17. 17.
    Seif, H.G., Hu, X.: Autonomous driving in the iCity—HD maps as a key challenge of the automotive industry. Engineering 2(2), 159–162 (2016).  https://doi.org/10.1016/J.ENG.2016.02.010, http://www.sciencedirect.com/science/article/pii/S2095809916309432CrossRefGoogle Scholar
  18. 18.
    Yu, Y., Li, J., Guan, H., Wang, C.: Automated detection of three-dimensional cars in mobile laser scanning point clouds using DBM-hough-forests. IEEE Trans. Geosci. Rem. Sens. 54(7), 4130–4142 (2016).  https://doi.org/10.1109/TGRS.2016.2537830CrossRefGoogle Scholar
  19. 19.
    Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. Int. J. Comput. Vis. 13(2), 119–152 (1994)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Machine Perception Research LaboratoryInstitute for Computer Science and ControlBudapestHungary
  2. 2.Faculty of Information Technology and BionicsPázmány Péter Catholic UniversityBudapestHungary

Personalised recommendations