Multimedia Tools and Applications

, Volume 77, Issue 20, pp 27617–27639 | Cite as

Low - resolution vehicle recognition based on deep feature fusion

  • Lixia Xue
  • Xin Zhong
  • Ronggui Wang
  • Juan YangEmail author
  • Min Hu


Recently, convolutional neural networks have achieved great success in image classification. However, the traditional convolutional neural network lacks the ability to distinguish image features, especially for the low resolution images with less feature information. In the vehicle recognition task, it is inevitable to lose some feature information by convolution during the process of the low-level feature is abstracted into the high-level semantic feature. In this paper, an improved convolutional neural network model with higher robustness is proposed, we call it feature fusion convolutional neural network (FFCNN), which can not only produce more discriminative features, but also can avoid interference caused by environmental factors to some extent. Firstly, the strategy of feature fusion is used to fuse the different low-level features in the convolution neural network. Secondly, in order to prevent overfitting, we combine with the network model of sparse and data augmentation to optimize the structure of the network model. The results of the experiment show that the model proposed in this paper has higher recognition accuracy compared with the traditional vehicle recognition methods and the original convolutional neural network models.


Convolutional neural network Feature fusion Sparseness Low resolution Vehicle recognition 



We express our sincere thanks to the anonymous reviewers for their useful comments and suggestions to raise the standard of the paper. This study was supported by the National Natural Science Foundation of China under Grant No. 61672202.


  1. 1.
    Arora S, Bhaskara A, Ge R, Ma T (2014) Provable bounds for learning some deep representations. In: International Conference on Machine Learning, Beijing, pp 584–592Google Scholar
  2. 2.
    Buch N, Orwell J, Velastin SA (2009) 3D Extended Histogram of Oriented Gradients (3DHOG) for classification of road users in urban scenes. In: British Machine Vision Conference, LondonGoogle Scholar
  3. 3.
    Dong C, Chen CL, He K et al (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307CrossRefGoogle Scholar
  4. 4.
    Escalera ADL, Armingol JMA, Mata M (2003) Traffic sign recognition and analysis for intelligent vehicles. Image Vis Comput 21(3):247–258CrossRefGoogle Scholar
  5. 5.
    Girshick RB, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, pp 580–587Google Scholar
  6. 6.
    Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: IEEE International Conference on Computer Vision, Kyoto, pp 349–356Google Scholar
  7. 7.
    Gupte S, Masoud O, Martin RFK et al (2002) Detection and classification of vehicles. IEEE Trans Intell Transp Syst 3(1):37–47CrossRefGoogle Scholar
  8. 8.
    Hasegawa O, Kanade T (2005) Type classification, color estimation, and specific target detection of moving targets on public streets. Mach Vis Appl 16(2):116–121CrossRefGoogle Scholar
  9. 9.
    He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, pp 770–778Google Scholar
  10. 10.
    Hinton GE, Osindero S, Teh YW (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554MathSciNetCrossRefGoogle Scholar
  11. 11.
    Hong C, Yu J, Chen X et al (2015) Image-based 3D human pose recovery with locality sensitive sparse retrieval. IEEE Trans Ind Electron 2013:2103–2108Google Scholar
  12. 12.
    Hong, S, You T, Kwak S, Han B (2015) Online tracking by learning discriminative saliency map with convolutional neural network. In: Proceedings of International Conference on International Conference on Machine Learning, Lille, pp 597–606Google Scholar
  13. 13.
    Jia D, Krause J, Li FF (2013) Fine-grained crowdsourcing for fine-grained recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, Portland, pp 580–587Google Scholar
  14. 14.
    Jia Y, Shelhamer E, Donahue J, Karayev S, Long J (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, pp 675–678Google Scholar
  15. 15.
    Krause J, Stark M, Jia D, Li FF (2014) 3D Object representations for fine-grained categorization. In: IEEE International Conference on Computer Vision Workshops, Sydney, pp 554–561Google Scholar
  16. 16.
    Krause J, Gebru T, Deng J, Li LJ, Li FF (2014) Learning Features and Parts for Fine-Grained Recognition. In: International Conference on Pattern Recognition, Stockholm, pp 26–33Google Scholar
  17. 17.
    Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst 25(2):2012Google Scholar
  18. 18.
    Lécun Y, Bottou L, Bengio Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRefGoogle Scholar
  19. 19.
    Lin M, Chen Q, Yan S (2014) Network in network. In: International Conference on Learning Representations. ArXiv:1312.4400Google Scholar
  20. 20.
    Ouwerkerk JDV (2006) Image super-resolution survey. Image Vis Comput 24(10):1039–1052CrossRefGoogle Scholar
  21. 21.
    Peng X, Hoffman J, Yu SX, Saenko K (2016) Fine-to-coarse knowledge transfer for low-res image classification. In: IEEE International Conference on Image Processing, Phoenix, pp 3683–3687Google Scholar
  22. 22.
    Salvador J, Pérez-Pellitero E (2016) Naive bayes super-resolution forest. In: IEEE International Conference on Computer Vision, Santiago, pp 325–333Google Scholar
  23. 23.
    Sermanet, P, Eigen D, Zhang X, Mathieu M, Fergus R, Lecun Y (2013) OverFeat: integrated recognition, localization and detection using convolutional networks. In: Computer Vision and Pattern Recognition. ArXiv:1312.6229Google Scholar
  24. 24.
    Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 79(10):1337–1342Google Scholar
  25. 25.
    Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Computer Science. ArXiv:1409.1556Google Scholar
  26. 26.
    Szegedy C, LiuW, Jia Y, Sermanet P, Reed, SE, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition, Boston, pp 1–9Google Scholar
  27. 27.
    Tao D, Hong C, Yu J, Wan J, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24(12):5659–5670MathSciNetCrossRefGoogle Scholar
  28. 28.
    Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, pp 3360–3367Google Scholar
  29. 29.
    Wang Z, Chang S, Yang Y, Liu D, Huang TS (2016) Studying very low resolution recognition using deep networks. In: IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, pp 4792–4800Google Scholar
  30. 30.
    Yang L, Luo P, Loy CC, Tang X (2015) A large-scale car dataset for fine-grained categorization and verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), BostonGoogle Scholar
  31. 31.
    Zeiler M D, Fergus R (2014) Visualizing and understanding convolutional networks. In: European Conference on Computer Vision. Springer, Cham, pp 818–833Google Scholar
  32. 32.
    Zhang C, Chen X, Chen W (2006) A PCA-Based Vehicle Classification Framework. In: International Conference on Data Engineering Workshops, 2006. Proceedings, Atlanta, pp 17–17. Multimed Tools ApplGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Lixia Xue
    • 1
  • Xin Zhong
    • 1
  • Ronggui Wang
    • 1
  • Juan Yang
    • 1
    Email author
  • Min Hu
    • 1
  1. 1.School of Computer and InformationHefei University of TechnologyHefeiChina

Personalised recommendations