A Novel Vehicle Localization System Using Vision Module for Heading Feedback

Conference paper
Part of the Lecture Notes in Mechanical Engineering book series (LNME)


Traditional vehicle localization systems use GNSS signals for global localization or Lidar or vision based systems for Simultaneous Mapping and Localization (SLAM). However, the signals of GNSS might be contaminated or even blocked in areas where there are tall buildings or trees, especially for autonomous sweeper vehicles that usually work along the road. There are additional information that can be used to improve the accuracy and robustness of vehicle localization system when applied in autonomous sweeper vehicles. Thus, a novel vehicle localization system based on GNSS, vision, wheel speed and Inertial Measurement Unit (IMU) is proposed. When the vehicle works in areas where GNSS signals are good, accurate position information from GNSS is used. Besides, wheel speed and IMU information is fused to improve the output rate of position information. When the vehicle enters areas where GNSS signals are unavailable, the heading information from vision is used as measurement to estimate the heading angle of vehicle and then fused with wheel speed and IMU to estimate the position. Real vehicle experiments are conducted to validate the effectiveness of the proposed system.


Vehicle localization Lane map Wheel speed 



This research is supported by “National Key R&D Program of China” (Grant No. 2018YFB0104805 and Grant No. 2016YFB0100901).


  1. 1.
    Noureldin, A., Karamat, T.B., Eberts, M.D., et al.: Performance enhancement of MEMS-based INS/GPS integration for low-cost navigation applications. IEEE Trans. Veh. Technol. 58(3), 1077–1096 (2009)CrossRefGoogle Scholar
  2. 2.
    Skog, I., Handel, P.: Time synchronization errors in loosely coupled GPS-aided inertial navigation systems. IEEE Trans. Intell. Transp. Syst. 12(4), 1014–1023 (2011)CrossRefGoogle Scholar
  3. 3.
    Rohde, J., Volz, B., Mielenz, H., et al.: Precise vehicle localization in dense urban environments. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), 1–4 November 2016Google Scholar
  4. 4.
    Meng, X., Wang, H., Liu, B.: A robust vehicle localization approach based on GNSS/IMU/DMI/LiDAR sensor fusion for autonomous vehicles. Sensors 17(9), 2140 (2017)CrossRefGoogle Scholar
  5. 5.
    Shamseldin, T., Manerikar, A., Elbahnasawy, M., et al.: SLAM-based Pseudo-GNSS/INS localization system for indoor LiDAR mobile mapping systems. In: 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS), pp. 197–208. IEEE (2018)Google Scholar
  6. 6.
    Ndjeng Ndjeng, A., Gruyer, D., Glaser, S., et al.: Low cost IMU-Odometer-GPS ego localization for unusual maneuvers. Inf. Fusion 12(4), 264–274 (2011)CrossRefGoogle Scholar
  7. 7.
    Rezaei, S., Sengupta, R.: Kalman filter-based integration of DGPS and vehicle sensors for localization. IEEE Trans. Control Syst. Technol. 15(6), 1080–1088 (2007)CrossRefGoogle Scholar
  8. 8.
    Crocoll, P., Görcke, L., Trommer, G.F., et al.: Unified model technique for inertial navigation aided by vehicle dynamics model. Navigation 60(3), 179–193 (2013)CrossRefGoogle Scholar
  9. 9.
    Hashemi, M.: Reusability of the output of map-matching algorithms across space and time through machine learning. IEEE Trans. Intell. Transp. Syst. 18(11), 3017–3026 (2017)CrossRefGoogle Scholar
  10. 10.
    Obst, M., Bauer, S., Reisdorf, P., et al.: Multipath detection with 3D digital maps for robust multi-constellation GNSS/INS vehicle localization in urban areas. In: 2012 IEEE Intelligent Vehicles Symposium, 3–7 June 2012Google Scholar
  11. 11.
    Tao, Z., Bonnifait, P., Frémont, V., et al.: Road-centered map-aided localization for driverless cars using single-frequency GNSS receivers. J. Field Robot. 34(5), 1010–1033 (2017)CrossRefGoogle Scholar
  12. 12.
    Gim, J., Ahn, C.: IMU-based virtual road profile sensor for vehicle localization. Sensors 18(10), 3344 (2018)CrossRefGoogle Scholar
  13. 13.
    Li, T., Yang, M., Zhou, X., et al.: A robust terrain-based road vehicle localization algorithm. In: 2016 IEEE Intelligent Vehicles Symposium (IV), 19–22 June 2016Google Scholar
  14. 14.
    Marais, J., Meurie, C., Attia, D., et al.: Toward accurate localization in guided transport: combining GNSS data and imaging information. Transp. Res. Part C: Emerg. Technol. 43, 188–197 (2014)CrossRefGoogle Scholar
  15. 15.
    Gu, Y., Hsu, L.T., Kamijo, S.: GNSS/onboard inertial sensor integration with the aid of 3-D building map for lane-level vehicle self-localization in urban canyon. IEEE Trans. Veh. Technol. 65(6), 4274–4287 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.School of Automotive StudiesTongji UniversityShanghaiChina
  2. 2.Clean Energy Automotive Engineering CenterTongji UniversityShanghaiChina

Personalised recommendations