Abstract
With the rapid development of urban, the scale of the city is expanding day by day. The road environment is becoming more and more complicated. The vehicle ego-localization in complex road environment puts forward imperative requirements for intelligent driving technology. The reliable vehicle ego-localization, including the lane recognition and the vehicle position and attitude estimation, at the complex traffic intersection is significant for the intelligent driving of the vehicle. In this article, we focus on the complex road environment of the city, and propose a pose and position estimation method based on the road sign using only a monocular camera and a common GPS (global positioning system). Associated with the multi-sensor cascade system, this method can be a stable and reliable alternative when the precision of multi-sensor cascade system decreases. The experimental results show that, within 100 meters distance to the road signs, the pose error is less than 2 degrees, and the position error is less than one meter, which can reach the lane-level positioning accuracy. Through the comparison with the Beidou high-precision positioning system L202, our method is more accurate for detecting which lane the vehicle is driving on.
Similar content being viewed by others
References
Abbott H, Powell D. Land-vehicle navigation using GPS. Proceedings of the IEEE, 1999, 87(1): 145–162.
Liu Y, Bai B. Research on GPRS vehicle location network service system. In Proc. IEEE International Conference on Computer, Mechatronics, Control and Electronic Engineering, Aug. 2010, pp.401-404.
Choi B S, Lee J J. Mobile robot localization in indoor environment using RFID and sonar fusion system. In Proc. IEEE International Conference on Intelligent Robots and Systems, Oct. 2009, pp.2039-2044.
Armesto L, Tornero J. Robust and efficient mobile robot self-localization using laser scanner and geometrical maps. In Proc. IEEE International Conference on Intelligent Robots and Systems, Oct. 2006, pp.3080-3085.
Lategahn H, Schreiber M, Ziegler J et al. Urban localization with camera and inertial measurement unit. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2013, pp.719-724.
Wahab A A, Khattab A, Fahmy Y A. Two-way TOA with limited dead reckoning for GPS-free vehicle localization using single RSU. In Proc. the 13th IEEE International Conference on ITS Telecommunications, Nov. 2013, pp.244-249.
Wei L, Cappelle C, Ruichek Y. Camera/laser/GPS fusion method for vehicle positioning under extended NIS-based sensor validation. IEEE Transactions on Instrumentation & Measurement, 2013, 62(11): 3110-3122.
Rezaei S, Sengupta R. Kalman filter-based Integration of DGPS and vehicle sensors for localization. IEEE Transactions on Control Systems Technology, 2007, 15(6): 1080-1088.
Tuna G, Gulez K, Gungor V C et al. Evaluations of different simultaneous localization and mapping (SLAM) algorithms. In Proc. the 38th IEEE Conference on Industrial Electronics Society, Oct. 2012, pp.2693-2698.
Chausse F, Laneurit J, Chapuis R. Vehicle localization on a digital map using particles filtering. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2005, pp.243-248.
Peng J, EI Najjar E B, Pomorski M et al. Virtual 3D city model for intelligent vehicle geo-localization. In Proc. IEEE International Conference on Intelligent Transport Systems Telecommunications, Oct. 2009, pp.477-480.
Uchiyama H, Deguchi D, Takahashi T et al. Egolocalization using streetscape image sequences from in-vehicle cameras. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2009, pp.185-190.
Wong D, Deguchi D, Ide I et al. Single camera vehicle localization using SURF scale and dynamic time warping. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2014, pp.681-686.
Song R, Chen H, Xiao Z, Xu Y, Klette R. Lane detection algorithm based on geometric moment sampling. SCIENTIA SINICA Informationis, 2017, 47(4): 455-467. (in Chinese)
Lai A H S, Yung N H C. Lane detection by orientation and length discrimination. IEEE Transactions on Systems Man & Cybernetics, Part B, 2000, 30(4): 539-548.
Lakshmanan S, Grimmer D. A deformable template approach to detecting straight edges in radar images. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1996, 18(4): 438-443.
Kaliyaperumal K, Lakshmanan S, Kluge K. An algorithm for detecting roads and obstacles in radar images. IEEE Transactions on Vehicular Technology, 2001, 50(1): 170-182.
Nedevschi S, Popescu V, Danescu R et al. Accurate ego-vehicle global localization at intersections through alignment of visual data with digital map. IEEE Transactions on Intelligent Transportation Systems, 2013, 14(2): 673-687.
Ansar A, Daniilidis K. Linear pose estimation from points or lines. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2003, 25(5): 578-589.
Schweighofer G, Pinz A. Globally optimal O(n) solution to the PnP problem for general camera models. In Proc. British Machine Vision Conference, Sept. 2008.
Lepetit V, Moreno-Noguer F, Fua P. EPnP: An accurate O(n) solution to the PnP problem. International Journal of Computer Vision, 2009, 81(2): 155-166.
Lasota M, Skoczylas M. Recognition of multiple traffic signs using keypoints feature detectors. In Proc. IEEE International Conference and Exposition on Electrical and Power Engineering, Oct. 2016, pp.535-540.
Teunissen P J, Odolinski R, Odijk D. Instantaneous Bei-Dou+GPS RTK positioning with high cut-off elevation angles. Journal of Geodesy, 2014, 88(4): 335-350.
Ren F X, Huang J, Jiang R et al. General traffic sign recognition by feature matching. In Proc. IEEE Image and Vision Computing New Zealand, Nov. 2009, pp.409-414.
Ellahyani A, Ansari M E, Jaafari I E. Traffic sign detection and recognition based on random forests. Appl. Soft. Comput., 2016, 46: 805–815.
Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P et al. Road-sign detection and recognition based on support vector machines. IEEE Transactions on Intelligent Transportation Systems, 2007, 8(2): 264-278.
Yuan Y, Xiong Z, Wang Q. An incremental framework for video-based traffic sign detection, tracking, and recognition. IEEE Transactions on Intelligent Transportation Systems, 2017, 18(7): 1918-1929.
Fartaj M, Ghofrani S. Traffic road sign detection and classification. Majlesi Journal of Electrical Engineering, 2012, 6(4): 54-62.
Zhang Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2000, 22(11): 1330-1334.
Author information
Authors and Affiliations
Corresponding authors
Electronic supplementary material
Below is the link to the electronic supplementary material.
ESM 1
(PDF 902 kb)
Rights and permissions
About this article
Cite this article
Yuan, JZ., Chen, H., Zhao, B. et al. Estimation of Vehicle Pose and Position with Monocular Camera at Urban Road Intersections. J. Comput. Sci. Technol. 32, 1150–1161 (2017). https://doi.org/10.1007/s11390-017-1790-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-017-1790-3