Abstract
Self-driving cars (or autonomous cars) can sense and navigate through an environment without any driver intervention. To achieve this task, they rely on vision sensors working in tandem with accurate algorithms to detect movable and non-movable objects around them. These vision sensors typically include cameras to identify static and non-static objects, Radio Detection and Ranging (RADAR) to detect the speed of the moving objects using Doppler effect and Light Detection and Ranging (LiDAR) to detect the distance to objects. In this paper, we explore a new usage of LiDAR data to classify static objects on the road. We present a pipeline to classify point cloud data grouped in volumetric pixels (voxels). We introduce a novel approach to point cloud data representation for processing within Convolution Neural Networks (CNN). Results show an accuracy exceeding 90% in the detection and classification of road edges, solid and broken lane markings, bike lanes, and lane center lines. Our data pipeline is capable of processing up to 20,000 points per 900ms on a server equipped with 2 Intel Xeon processors 8-core CPU with HyperThreading for a total of 32 threads and 2 NVIDIA Tesla K40 GPUs. Our model outperforms by 2% ResNet applied to camera images for the same road.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rosenzweig, J., Bartl, M.: A review and analysis of literature on autonomous driving. E-J. Mak.-Of Innov. (2015)
Payre, W., Cestac, J., Delhomme, P.: Intention to use a fully automated car: attitudes and a priori acceptability. Transp. Res. Part F: Traffic Psychol. Behav. 27, 252–263 (2014)
Luettel, T., Himmelsbach, M., Wuensche, H.-J.: Autonomous ground vehiclesconcepts and a path to the future. In: Proceedings of the IEEE, vol. 100, no. Special Centennial Issue, pp. 1831–1839 (2012)
Le Vine, S., Zolfaghari, A., Polak, J.: Autonomous cars: the tension between occupant experience and intersection capacity. Transp. Res. Part C: Emerg. Technol. 52, 1–14 (2015)
Jamson, A.H., Merat, N., Carsten, O.M., Lai, F.C.: Behavioural changes in drivers experiencing highly-automated vehicle control in varying traffic conditions. Transp. Res. Part C: Emerg. Technol. 30, 116–125 (2013)
Ross, P.E.: Robot, you can drive my car. IEEE Spectr. 51(6), 60–90 (2014)
Weyer, J., Fink, R.D., Adelt, F.: Human-machine cooperation in smart cars. An empirical investigation of the loss-of-control thesis. Saf. Sci. 72, 199–208 (2015)
Violence and Injury Prevention - World Health Organization: Global status report on road safety 2013: supporting a decade of action. World Health Organization (2013)
Rudin-Brown, C.M., Parker, H.A., Malisia, A.R.: Behavioral adaptation to adaptive cruise control. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 47, no. 16, pp. 1850–1854. SAGE Publications Sage CA, Los Angeles (2003)
Alessandrini, A., Campagna, A., Delle Site, P., Filippi, F., Persia, L.: Automated vehicles and the rethinking of mobility and cities. Transp. Res. Procedia 5, 145–160 (2015)
Low, C.Y., Zamzuri, H., Mazlan, S.A.: Simple robust road lane detection algorithm. In: 2014 5th International Conference on Intelligent and Advanced Systems (ICIAS), pp. 1–4. IEEE (2014)
Aly, M.: Real time detection of lane markers in urban streets. In: Intelligent Vehicles Symposium, 2008 IEEE, pp. 7–12. IEEE (2008)
Weng, S., Li, J., Chen, Y., Wang, C.: Road traffic sign detection and classification from mobile lidar point clouds. In: 2015 ISPRS International Conference on Computer Vision in Remote Sensing, p. 99 010A. International Society for Optics and Photonics (2016)
Caltagirone, L., Scheidegger, S., Svensson, L., Wahde, M.: Fast lidar-based road detection using convolutional neural networks. arXiv preprint arXiv:1703.03613 (2017)
Maturana, D., Scherer, S.: 3D convolutional neural networks for landing zone detection from lidar. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 3471–3478. IEEE (2015)
LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Jackel, L.D., Sharman, D., Stenard, C.E., Strom, B.I., Zuckert, D.: Optical character recognition for self-service banking. AT & T Tech. J. 74(4), 16–24 (1995)
Berg, A., Deng, J., Fei-Fei, L.: Large scale visual recognition challenge (ILSVRC) (2010). http://www.image-net.org/challenges/LSVRC
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467 (2016)
Acknowledgment
This project has been funded with the joint support from the National Council for Scientific Research in Lebanon and the St. Joseph University of Beirut. The authors would like to thank the dean Fadi Geara of the faculty of engineering at St Joseph university for providing us with the material needed for this study, namely, the new deep learning server with multiple NVIDIA Tesla GPUs in collaboration with Murex. We would also like to thank Civil Maps for providing us with the LiDAR data and labels used in this research and Dr. Fabien Chraim from civil maps for his innovative ideas and reviewing the paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sakr, G.E., Eido, L., Maarawi, C. (2019). Convolution Neural Network Application for Road Asset Detection and Classification in LiDAR Point Cloud. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2018. Advances in Intelligent Systems and Computing, vol 868. Springer, Cham. https://doi.org/10.1007/978-3-030-01054-6_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-01054-6_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01053-9
Online ISBN: 978-3-030-01054-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)