Abstract
Vanishing point detection is an essential component of vision-based autonomous navigation for unmanned ground vehicles and mobile robots. In this paper, we propose an accurate and robust vanishing point detection method for unstructured road scenes, where the road scenes lack clear road markings and include complex background interference. Since only the road region provides informative clues for vanishing point detection, we first introduce the manifold ranking method to estimate the road region based on background suppression. Then, we develop a series of principles for voter selection, and propose a dynamic adjustment strategy for the candidate selection that reduces the search scope of the vanishing point to perform candidate selection. Finally, we propose an effective voting strategy, in which the candidate that achieves the greatest number of votes in the voting space is considered to be the vanishing point. The experimental results on a large number of unstructured road images show that our proposed method is more accurate and robust than five existing methods.
Similar content being viewed by others
References
Yang, W., Fang, B., Tang, Y.Y.: Fast and accurate vanishing point detection and its application in inverse perspective mapping of structured road[j]. IEEE Trans. Syst. Man Cybern.: Systems PP(99), 1–12 (2017)
Phung, S.L., Le, M.C., Bouzerdoum, A.: Pedestrian lane detection in unstructured scenes for assistive navigation[J]. Comput. Vis. Image Underst. 149, 186–196 (2016)
Pandey, A., Pandey, S., Parhi, D.R.: Mobile robot navigation and obstacle avoidance techniques: a review[j]. Int. Rob. Auto. J. 2(3), 00022 (2017)
Mur-Artal, R., Tardós, J.D.: Orb-slam2: an open-source slam system for monocular, stereo, and rgb-d cameras[J]. IEEE Trans. Robot. 33(5), 1255–1262 (2017)
Moghadam, P., Starzyk, J.A., Wijesoma, W.S.: Fast vanishing-point detection in unstructured environments[J]. IEEE Trans. Image Process. 21(1), 425–430 (2012)
Weili, D., Yong, L., Wenfeng, W., et al.: Depth estimation of urban road image based on contour understanding[j]. Acta Opt. Sin. 34(7), 0715001 (2014)
Kroeger, T., Dai, D., Van Gool, L.: Joint vanishing point extraction and tracking[C]. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2449–2457 (2015)
Annich, A., El Abderrahmani, A., Satori, K.: Fast and easy 3D reconstruction with the help of geometric constraints and genetic algorithms[J]. 3D Res. 8(3), 30 (2017)
Lee, J.K., Yoon, K.J.: Real-time joint estimation of camera orientation and vanishing points[C]. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1866–1874 (2015)
Kortli, Y., Marzougui, M., Bouallegue, B., et al.: A novel illumination-invariant lane detection system[C]. In: 2017 2nd International Conference on Anti-Cyber Crimes (ICACC), pp. 166–171. IEEE (2017)
Ding, W., Li, Y., Liu, H.: Efficient vanishing point detection method in unstructured road environments based on dark channel prior[J]. IET Comput. Vis. 10(8), 852–860 (2016)
Wu, Z., Fu, W., Xue, R., et al.: A novel line space voting method for vanishing-point detection of general road images[J]. Sensors 16(7), 948 (2016)
Li, Y., Ding, W., Zhang, X.G., et al.: Road detection algorithm for autonomous navigation systems based on dark channel prior and vanishing point in complex road scenes[J]. Robot. Auton. Syst. 85, 1–11 (2016)
Yoo, J.H., Lee, S.W., Park, S.K., et al.: A robust lane detection method based on vanishing point estimation using the relevance of line segments[J]. IEEE Trans. Intell. Transp. Syst. 18(12), 3254–3266 (2017)
She, Q., Lu, Z., Liao, Q.: Vanishing point estimation for challenging road images[C]. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 996–1000. IEEE (2014)
Kong, H., Sarma, S.E., Tang, F.: Generalizing Laplacian of Gaussian filters for vanishing-point detection[J]. IEEE Trans. Intell. Transp. Syst. 14(1), 408–418 (2013)
Fan, X., Chen, Y., Piao, J., et al.: Advanced road vanishing point detection by using weber adaptive local filter[C]. In: International Conference on Internet of Vehicles, pp. 3–13. Springer, Cham (2016)
Kong, H., Audibert, J.Y., Ponce, J.: Vanishing point detection for road detection[C]. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009, pp. 96–103. IEEE (2009)
Nguyen, L., Phung, S.L., Bouzerdoum, A.: Efficient vanishing point estimation for unstructured road scenes[C]. In: 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1–6. IEEE (2016)
Nguyen, L., Phung, S.L., Bouzerdoum, A.: Enhanced pixel-wise voting for image vanishing point detection in road scenes[C]. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1852–1856. IEEE (2017)
Yang, W., Luo, X., Fang, B., et al.: Fast and accurate vanishing point detection in complex scenes[C]. In: 2014 IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), pp. 93–98. IEEE (2014)
Miksik, O.: Rapid vanishing point estimation for general road detection[C]. In: 2012 IEEE International Conference on Robotics and Automation (ICRA), pp. 4844–4849. IEEE (2012)
Shi, J., Wang, J., Fu, F.: Fast and robust vanishing point detection for unstructured road following[J]. IEEE Trans. Intell. Transp. Syst. 17(4), 970–979 (2016)
Zhou, D., Weston, J., Gretton, A., et al.: Ranking on data manifolds[C]. In: Advances in Neural Information Processing Systems, pp. 169–176 (2004)
Wang, Q., Lin, J., Yuan, Y.: Salient band selection for hyperspectral image classification via manifold ranking[J]. IEEE Transactions on Neural Networks and Learning Systems 27(6), 1279–1289 (2016)
Neubert, P., Protzel, P.: Compact watershed and preemptive slic: On improving trade-offs of superpixel segmentation algorithms[C]. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 996-1001. IEEE (2014)
Alvarez, J.M.Á., Lopez, A.M.: Road detection based on illuminant invariance[J]. IEEE Trans. Intell. Transp. Syst. 12(1), 184–193 (2011)
Xiang, Y., Wang, F., Wan, L., et al.: An advanced multiscale edge detector based on gabor filters for SAR Imagery[J]. IEEE Geosci. Remote Sens. Lett. 14(9), 1522–1526 (2017)
Lee, T.S.: Image representation using 2D Gabor wavelets[J]. IEEE Trans. Pattern Anal. Mach. Intell. 18(10), 959–971 (1996)
Xiao, J., Hays, J., Ehinger, K.A., et al.: Sun database: large-scale scene recognition from abbey to zoo[C]. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3485–3492. IEEE (2010)
Fan, X., Riaz, I., Rehman, Y., et al.: Vanishing point detection using random forest and patch-wise weighted soft voting[J]. IET Image Process. 10(11), 900–907 (2016)
Acknowledgments
The authors would like to thank the anonymous reviewers for their comments. This research was supported in part by the National Science Foundation of China (Grant No. 61473144), the Aeronautical Science Foundation of China (Key Laboratory) (Grant No. 20162852031) and the Special scientific instrument development of Ministry of science and technology of China (Grant No. 2016YFF0103702).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Han, J., Yang, Z., Hu, G. et al. Accurate and Robust Vanishing Point Detection Method in Unstructured Road Scenes. J Intell Robot Syst 94, 143–158 (2019). https://doi.org/10.1007/s10846-018-0814-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-018-0814-8