Multi-scale Convolutional Neural Networks for Natural Scene License Plate Detection

  • Jia Li
  • Changyong Niu
  • Ming Fan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7368)


We consider the problem of license plate detection in natural scenes using Convolutional Neural Network (CNN). CNNs are global trainable multi-stage architectures that automatically learn shift invariant features from the raw input images. Additionally, they can be easily replicated over the full input making them widely used for object detection. However, such detectors are currently limited to single-scale architecture in which the classifier only use the features extracted by last stage. In this paper, a multi-scale CNN architecture is proposed in which the features extracted by multiple stages are fed to the classifier. Furthermore, additional subsampling layers are added making the presented architecture also easily replicated over the full input. We apply the proposed architecture to detect license plates in natural sense images, and it achieves encouraging detection rate with neither handcrafted features nor controlling the image capturing process.


License plate detection convolutional neural networks natural scene 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Psoroulas, I.D., Loumos, V., Kayafas, E.: License Plate Recognition from Still Images and Video Sequences: A Survey. IEEE Trans. on Intelligent Transportation Systems 9, 377–391 (2008)CrossRefGoogle Scholar
  2. 2.
    Frome, A., Cheung, G., Abdulkader, A., Zennaro, M., Wu, B., Bissacco, A., Adam, H., Neven, H., Vincent, L.: Large-scale Privacy Protection in Google Street View. In: Proc. of Int. Conf. on Computer Vision, pp. 2373–2380 (2009)Google Scholar
  3. 3.
    Matas, J., Zimmermann, K.: Unconstrained License Plate and Text Localization and Recognition. In: Proc. of Int. Conf. on Intelligent Transportation Systems, pp. 572–577 (2005)Google Scholar
  4. 4.
    Bai, H., Liu, C.: A Hybrid License Plate Extraction Method Based on Edge Statistics and Morphology. In: Proc. of Int. Conf. on Pattern Recognition, pp. 831–834 (2004)Google Scholar
  5. 5.
    Chang, S.L., Chen, L.S., Chung, Y.C., Chen, S.W.: Automatic License Plate Recognition. IEEE Trans. on Intelligent Transportation Systems 5, 42–53 (2004)CrossRefGoogle Scholar
  6. 6.
    Dlagnekov, L.: License Plate Detection using AdaBoost. Technical report, Computer Science and Engineering, San Diego (2004)Google Scholar
  7. 7.
    Zhang, H., Jia, W., He, X., Wu, Q.: Learning Based License Plate Detection Using Global and Local Features. In: Proc. of Int. Conf. on Pattern Recognition, pp. 1102–1105 (2006)Google Scholar
  8. 8.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-Based Learning Applied to Document Recognition. Proc. of the IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  9. 9.
    LeCun, Y., Huang, F.-J., Bottou, L.: Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting. In: Proc. of Computer Vision and Pattern Recognition Conference, pp. 97–104 (2004)Google Scholar
  10. 10.
    Garcia, C., Delakis, M.: Convolutional Face Finder: A Neural Architecture for Fast and Robust Face Detection. IEEE Trans. on Pattern Analysis and Machine Intelligence 26(11), 1408–1423 (2004)CrossRefGoogle Scholar
  11. 11.
    Osadchy, M., LeCun, Y., Miller, M.: Synergistic Face Detection and Pose Estimation with Energy-Based Models. Journal of Machine Learning Research 8, 1197–1215 (2007)Google Scholar
  12. 12.
    Chen, Y.N., Han, C.C., Wang, C.T., Jeng, B.S., Fan, K.C.: The Application of a Convolution Neural Network on Face and License Plate Detection. In: Proc. of Int. Conf. on Pattern Recognition, pp. 552–555 (2006)Google Scholar
  13. 13.
    Fan, J., Xu, W., Wu, Y., Gong, Y.: Human Tracking Using Convolutional Neural Networks. IEEE Trans. on Neural Networks 21(10), 1610–1623 (2010)CrossRefGoogle Scholar
  14. 14.
    Sermanet, P., LeCun, Y.: Traffic Sign Recognition with Multi-Scale Convolutional Networks. In: Proc. of Int. Joint Conf. on Neural Networks, pp. 2809–2813 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Jia Li
    • 1
  • Changyong Niu
    • 1
  • Ming Fan
    • 1
  1. 1.School of Information EngineeringZhengzhou UniversityZhengzhouChina

Personalised recommendations