A Novel RGB-T Based Real-Time Road Detection on Low Cost Embedded Devices

  • Wenquan Zhang
  • Xing Cai
  • Kai HuangEmail author
  • Zhiguo Zhang
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 857)


Road detection plays an important role in autonomous driving and driving assistant system. However, the performance of existing methods still suffers from illumination change or bad illumination. In this paper, a novel method is presented which fuses RGB and thermal features to solve these problems. Our method is accurate as well as light-weighted. Evaluating on our RGB-T dataset, the method can achieve 92.01% accuracy and real-time performances on low cost embedded devices.


RGB-Thermal Road detection Illumination-robust Driver assistant system 



This work was supported by Zhuhai Specially Appointed Scholar Program (No. 67000-42070001).

Supplementary material


  1. 1.
    Alvarez, J.M.Á., Lopez, A.M.: Road detection based on illuminant invariance. IEEE Trans. Intell. Transp. Syst. 12(1), 184–193 (2011)CrossRefGoogle Scholar
  2. 2.
    Bar Hillel, A., Lerner, R., Levi, D., Raz, G.: Recent progress in road and lane detection: a survey. Mach. Vis. Appl. 25, 727–745 (2014)CrossRefGoogle Scholar
  3. 3.
    Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., Zhang, J., et al.: End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016)
  4. 4.
    Bojarski, M., Yeres, P., Choromanska, A., Choromanski, K., Firner, B., Jackel, L., Muller, U.: Explaining how a deep neural network trained with end-to-end learning steers a car. arXiv preprint arXiv:1704.07911 (2017)
  5. 5.
    Caltagirone, L., Scheidegger, S., Svensson, L., Wahde, M.: Fast LiDAR-based road detection using convolutional neural networks. arXiv preprint arXiv:1703.03613 (2017)
  6. 6.
    Chen, C., Seff, A., Kornhauser, A., Xiao, J.: DeepDriving: learning affordance for direct perception in autonomous driving. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2722–2730 (2015)Google Scholar
  7. 7.
    Chen, X., Kundu, K., Zhu, Y., Berneshawi, A.G., Ma, H., Fidler, S., Urtasun, R.: 3D object proposals for accurate object class detection. In: Advances in Neural Information Processing Systems, pp. 424–432 (2015)Google Scholar
  8. 8.
    Fritsch, J., Kuhnl, T., Geiger, A.: A new performance measure and evaluation benchmark for road detection algorithms. In: 2013 16th International IEEE Conference on Intelligent Transportation Systems-(ITSC), pp. 1693–1700. IEEE (2013)Google Scholar
  9. 9.
    Kühnl, T., Kummert, F., Fritsch, J.: Spatial ray features for real-time ego-lane extraction. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems (ITSC), pp. 288–293. IEEE (2012)Google Scholar
  10. 10.
    Li, C., Wang, G., Ma, Y., Zheng, A., Luo, B., Tang, J.: A unified RGB-T saliency detection benchmark: dataset, baselines, analysis and a novel approach. arXiv preprint arXiv:1701.02829 (2017)
  11. 11.
    Teichmann, M., Weber, M., Zoellner, M., Cipolla, R., Urtasun, R.: MultiNet: real-time joint semantic reasoning for autonomous driving. arXiv preprint arXiv:1612.07695 (2016)
  12. 12.
    Xiao, L., Wang, R., Dai, B., Fang, Y., Liu, D., Wu, T.: Hybrid conditional random field based camera-LiDAR fusion for road detection. Inf. Sci. 432, 543–558 (2017)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Ying, Z., Li, G., Zang, X., Wang, R., Wang, W.: A novel shadow-free feature extractor for real-time road detection. In: Proceedings of the 2016 ACM on Multimedia Conference, pp. 611–615. ACM (2016)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Wenquan Zhang
    • 1
    • 2
  • Xing Cai
    • 1
    • 2
  • Kai Huang
    • 1
    • 2
    Email author
  • Zhiguo Zhang
    • 1
    • 2
    • 3
  1. 1.Key Laboratory of Machine Intelligence and Advanced ComputingSun Yat-sen University, Ministry of EducationGuangzhouChina
  2. 2.School of Data and Computer ScienceSun Yat-sen UniversityGuangzhouChina
  3. 3.School of Biomedical Engineering, Health Science CenterShenzhen UniversityShenzhenChina

Personalised recommendations