Abstract
Automatic License Plate Recognition (ALPR) has been a topic of research for many years now due to its real-life application but hasn’t been any significant breakthrough due to limitations in image processing algorithms to satisfy all the real-life scenarios such an illumination, moving cars, background etc. This paper presents a robust and efficient ALPR system using a combination of the ‘You only Look Once’ (YOLO) neural network architecture and standard Convolutional Neural Network (CNN). In total 3 stages of YOLO and 1 stage of CNN has been used in the proposed system. The last stage of YOLO and CNN have been specifically designed to perform detection (segmentation) and recognition of characters, respectively. We have built our own dataset of 604 car images in natural settings with different lighting conditions and viewing angles for the YOLO stages. In addition, a computer-generated dataset of 42237 characters has been used to train CNN. The resulting system has been tested on 50 random test images not part of training or validation datasets. The validation accuracies of all 4 stages exceed 90% whereas, the overall final accuracy on 50 test images comes to 82% with some fault tolerance. The use of deep learning instead of Image Processing also enabled to detect skewed license plates. The accuracy of stages 1 and 2 of YOLO were 100% on both validation and test sets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (alpr): A state-of-theart review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)
Zhou, W., Li, H., Lu, Y., Tian, Q.: Principal visual word discovery for automatic license plate detection. IEEE Trans. Image Process. 21(9), 4269–4279 (2012)
Anagnostopoulos, C., Anagnostopoulos, I., Loumos, V., Kayafas, E.: A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans. Intell. Transp. Syst. 7(3), 377–392 (2006). 16 Hui Li, Chunhua Shen
Bai, H., Liu, C.: A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of the IEEE International Conference on Pattern Recognition, pp. 831–834 (2004)
Qiu, Y., Sun, M., Zhou, W.: License plate extraction based on vertical edge detection and mathematical morphology. In: Proceedings of the International Conference on Computer Intelligence Software Engineering, pp. 1–5 (2009)
Zheng, D., Zhao, Y., Wang, J.: An efficient method of license plate location. Pattern Recogn. Lett. 26(15), 2431–2438 (2005)
Tan, J., Abu-Bakar, S., Mokji, M.: License plate localization based on edge-geometrical features using morphological approach. In: Proceedings of the IEEE International Conference on Image Processing, pp. 4549–4553 (2013)
Lalimia, M.A., Ghofrania, S., McLernonb, D.: A vehicle license plate detection method using region and edge based methods. Comput. Electron. Eng. 39, 834845 (2013)
Chen, R., Luo, Y.: An improved license plate location method based on edge detection. In: Proceedings of the International Conference on Applications of a Physics Industrial Engine, p. 13501356 (2012)
Rasheed, S., Naeem, A., Ishaq, O.: Automated number plate recognition using hough lines and template matching. In: Proceedings of the World Congress on Engineering and Computer Science, pp. 199–203 (2012)
Deb, K., Jo, K.: Hsi color based vehicle license plate detection. In: Proceedings of the International Conference on Control Automation System, pp. 687–691 (2008)
Montazzolli, S., Jung, C.R.: Real-time brazilian license plate detection and recognition using deep convolutional neural networks. In: 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 55–62, October 2017
Rafique, M.A., Pedrycz, W., Jeon, M.: Vehicle license plate detection using region-based convolutional neural networks. Soft Computing, June 2017. https://doi.org/10.1007/s00500-017-2696-2
Hsu, G.S., Ambikapathi, A., Chung, S.L., Su, C.P.: Robust license plate detection in the wild. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, August 2017
Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and lstms. CoRR, vol. abs/1601.05610, 2016
Bulan, O., Kozitsky, V., Ramesh, P., Shreve, M.: Segmentation and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans. Intell. Transp. Syst. 18(9), 2351–2363 (2017)
Menotti, D., Chiachia, G., Falcao, A.X., Neto, V.J.O.: Vehicle ̃ license plate recognition with random convolutional networks. In: 2014 27th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 298–303, Aug 2014
Zhang, H., Jia, W., He, X., Wu, Q.: Learning-based license plate detection using global and local features. In: Proceedings of the IEEE International Conference on Pattern Recognition, pp. 1102–1105 (2006)
Rayson Laroca, Evair Severo, Luiz A. Zanlorensi, Luiz S. Oliveira, Gabriel Resende Goncalves, William Robson Schwartz, David Menotti, “Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector”
Li, H., Wang, P., Shen, C.: Towards end-to-end car license plates detection and recognition with deep neural networks. CoRR, vol. abs/1709.08828 (2017). http://arxiv.org/abs/1709.08828
Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. CoRR, vol. abs/1703.07330 (2017). http://arxiv.org/abs/1703.07330
Zeiler, M.D.: ADADELTA: An Adaptive Learning Rate Method. arXiv:1212.5701 [cs.LG]
Xu, B., Wang, N., Chen, T., Li, M.: Empirical Evaluation of Rectified Activations in Convolutional Network. arXiv:1505.00853v2 [cs.LG], 27 November 2015
Redmon, J., Farhadi, A.: YOLOv3: An Incremental Improvement
Redmon, J., Farhadi,A.: YOLO9000: Better, Faster, Stronger. arXiv:1612.08242 [cs.CV] 25 DEC 2016
Acknowledgment
We are elated to present this paper as it has extended our boundaries of knowledge and enhanced our capabilities and self-confidence. At the same time, we express our sincere thanks to everyone, who by their direct or indirect contribution have helped us make it possible. We would like to take this opportunity to express our gratitude towards our project guide Associate Prof. Jayshree Kundargi for her constant encouragement and guidance. We would also like to thank the Electronics and Telecommunication Department for providing us with valuable resources and aids as and when required.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Dhedhi, B., Datar, P., Chiplunkar, A., Jain, K., Rangarajan, A., Kundargi, J. (2019). Automatic License Plate Recognition Using Deep Learning. In: Akoglu, L., Ferrara, E., Deivamani, M., Baeza-Yates, R., Yogesh, P. (eds) Advances in Data Science. ICIIT 2018. Communications in Computer and Information Science, vol 941. Springer, Singapore. https://doi.org/10.1007/978-981-13-3582-2_4
Download citation
DOI: https://doi.org/10.1007/978-981-13-3582-2_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3581-5
Online ISBN: 978-981-13-3582-2
eBook Packages: Computer ScienceComputer Science (R0)