Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 22, pp 32565–32583 | Cite as

Impact of compressed and down-scaled training images on vehicle detection in remote sensing imagery

  • Shahid KarimEmail author
  • Ye Zhang
  • Shoulin Yin
  • Asif Ali Laghari
  • Ali Anwar Brohi
Article
  • 37 Downloads

Abstract

Vehicle detection in remote sensing imagery is a prominent issue over the last few years. In this application, the processing of optical remote sensing images becomes critical due to the complex environment, large size, occlusions and color variations. However, several approaches have been proposed to improve the training process but still, the efforts are moving towards optimal solutions. The training process is time-consuming and a large amount of memory is required to store those training images. Numerous traditional state-of-the-art approaches are suffering from problematic high computational time. In this paper, a new training methodology which is based on compressed and down-scaled images is implemented to reduce the training time. The training images are compressed at Quality Factor (QF) of 50 and down-scaled by scale factor of 0.5 to evaluate the performance for vehicle detection. The existing approaches of computer vision are taking advantage of high computational Graphical Processing Units (GPUs) to speed up the training process. The proposed framework is also a better way to reduce the computational time. To compare performance, we have trained the RCNN, Fast-RCNN, Faster-RCNN and Cascade detectors by using three types of training image sets and several experiments have been performed. More specifically, our approach makes the training faster than the training based on original images and training based on compressed images provides optimal results.

Keywords

Vehicle detection Machine learning Compressed Down-scaled Regions RCNN 

Notes

Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grants 61471148.

References

  1. 1.
    Bak J-H, Huh J-H (2017) A study on the framework design of Korean-model PLC-integrated drone landing site in mountain regions: A software engineering approach. In: 2017 17th International Conference on Control, Automation and Systems (ICCAS), pp 1185–1190Google Scholar
  2. 2.
    Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110(3):346–359CrossRefGoogle Scholar
  3. 3.
    Benenson R, Mathias M, Timofte R, Van Gool L (2012) Pedestrian detection at 100 frames per second. In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp 2903–2910Google Scholar
  4. 4.
    Brubaker SC, Mullin MD, Rehg JM (2006) Towards optimal training of cascaded detectors. In: European Conference on Computer Vision, pp 325–337Google Scholar
  5. 5.
    Campos V, Sastre F, Yagües M, Bellver M, Giró-i-Nieto X, Torres J (2017) International Conference on Computational Science, ICCS 2017:12–14Google Scholar
  6. 6.
    Chen X, Xiang S, Liu C-L, Pan C-H (2013) Vehicle detection in satellite images by parallel deep convolutional neural networks. In: Pattern Recognition (ACPR), 2013 2nd IAPR Asian Conference on, pp 181–185Google Scholar
  7. 7.
    Chen X, Xiang S, Liu C-L, Pan C-H (2014) Vehicle detection in satellite images by hybrid deep convolutional neural networks. IEEE Geosci Remote Sens Lett 11(10):1797–1801CrossRefGoogle Scholar
  8. 8.
    Cheng G, Han J (2016) A survey on object detection in optical remote sensing images. ISPRS J Photogramm Remote Sens 117:11–28CrossRefGoogle Scholar
  9. 9.
    Cheng G, Zhou P, Han J (2016) Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images. IEEE Trans Geosci Remote Sens 54(12):7405–7415CrossRefGoogle Scholar
  10. 10.
    Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol 1, pp 886–893Google Scholar
  11. 11.
    Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306MathSciNetCrossRefGoogle Scholar
  12. 12.
    El-Bakry HM (2006) A new implementation of pca for fast face detection. Vectors 1:4Google Scholar
  13. 13.
    Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448Google Scholar
  14. 14.
    Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Proc IEEE Conf Comput Vis Pattern Recognit: 580–587Google Scholar
  15. 15.
    Girshick R, Donahue J, Darrell T, Malik J (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38(1):142–158CrossRefGoogle Scholar
  16. 16.
    Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182zbMATHGoogle Scholar
  17. 17.
    Han S, Mao H, Dally WJ (2015) Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv Prepr. arXiv1510.00149Google Scholar
  18. 18.
    Han S, Pool J, Tran J, Dally W (2015) Learning both weights and connections for efficient neural network. Adv Neural Inf Proces Syst: 1135–1143Google Scholar
  19. 19.
    Hassairi S, Ejbali R, Zaied M (2018) A deep stacked wavelet auto-encoders to supervised feature extraction to pattern classification. Multimed Tools Appl 77(5):5443–5459CrossRefGoogle Scholar
  20. 20.
    He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. In: European Conference on Computer Vision, pp 346–361Google Scholar
  21. 21.
    Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507Google Scholar
  22. 22.
    Hosang J, Benenson R, Schiele B (2014) How good are detection proposals, really?. arXiv Prepr. arXiv1406.6962Google Scholar
  23. 23.
    Hu J, Xu T, Zhang J, Yang Y (2016) Fast Vehicle Detection in Satellite Images Using Fully Convolutional Network. In: Chinese Conference on Intelligent Visual Surveillance, pp 122–129Google Scholar
  24. 24.
    Huang Z, Pan Z, Lei B (2017) Transfer learning with deep convolutional neural network for SAR target classification with limited labeled data. Remote Sens 9(9):907CrossRefGoogle Scholar
  25. 25.
    Huh J-H (2018) PLC-integrated sensing technology in mountain regions for drone landing sites: focusing on software technology. Sensors 18(8):2693CrossRefGoogle Scholar
  26. 26.
    Ji C, Ma S (1997) Combined weak classifiers. Adv Neural Inf Proces Syst 9:494–500Google Scholar
  27. 27.
    Jia Z, Saxena A, Chen T (2011) Robotic object detection: Learning to improve the classifiers using sparse graphs for path planning. In: IJCAI, pp 2072–2078Google Scholar
  28. 28.
    Jiang J (1999) Image compression with neural networks–a survey. Signal Process Image Commun 14(9):737–760CrossRefGoogle Scholar
  29. 29.
    Jin R, Kim J (2017) Tracking feature extraction techniques with improved SIFT for video identification. Multimed Tools Appl 76(4):5927–5936CrossRefGoogle Scholar
  30. 30.
    Jolliffe IT (1992) Principal component analysis and exploratory factor analysis. Stat Meth in Med Res 1(1):69–95.Google Scholar
  31. 31.
    Karim S, Zhang Y, Asif MR, Ali S (2017) Comparative analysis of feature extraction methods in satellite imagery. J Appl Remote Sens 11(4):42618CrossRefGoogle Scholar
  32. 32.
    Kato T, Ninomiya Y, Masaki I (2002) Preceding vehicle recognition based on learning from sample images. IEEE Trans Intell Transp Syst 3(4):252–260CrossRefGoogle Scholar
  33. 33.
    Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst, pp 1097–1105Google Scholar
  34. 34.
    Lampert CH, Blaschko MB, Hofmann T (2008) Beyond sliding windows: Object localization by efficient subwindow search. In: Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pp 1–8Google Scholar
  35. 35.
    Lebrun G, Charrier C, Cardot H (2004) SVM training time reduction using vector quantization. In: Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, vol 1, pp 160–163Google Scholar
  36. 36.
    Leitloff J, Hinz S, Stilla U (2010) Vehicle detection in very high resolution satellite images of city areas. IEEE Trans Geosci Remote Sens 48(7):2795–2806CrossRefGoogle Scholar
  37. 37.
    Li M, Wang J (2008) Remote sensing image compression based on classification and detection. In: Progress in Electromagnetics Research Symposium 2008 (PIERS 2008), pp 1–5Google Scholar
  38. 38.
    Liu K, Mattyus G (2015) Fast multiclass vehicle detection on aerial images. IEEE Geosci Remote Sens Lett 12(9):1938–1942CrossRefGoogle Scholar
  39. 39.
    Liu J, Zeng G (2012) Description of interest regions with oriented local self-similarity. Opt Commun 285(10):2549–2557CrossRefGoogle Scholar
  40. 40.
    Long Y, Gong Y, Xiao Z, Liu Q (2017) Accurate object localization in remote sensing images based on convolutional neural networks. IEEE Trans Geosci Remote Sens 55(5):2486–2498CrossRefGoogle Scholar
  41. 41.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  42. 42.
    Maggiori E, Tarabalka Y, Charpiat G, Alliez P (2017) Can Semantic Labeling Methods Generalize to Any City? The Inria Aerial Image Labeling BenchmarkGoogle Scholar
  43. 43.
    Marcus M (2014) JPEG image compression. Dartmouth Coll https://math.dartmouth.edu/archive/m56s14/public_html/proj/Marcus_proj.pdf
  44. 44.
    Matas J, Chum O, Urban M, Pajdla T (2004) Robust wide-baseline stereo from maximally stable extremal regions. Image Vis Comput 22(10):761–767CrossRefGoogle Scholar
  45. 45.
    Mu Y, Yan S, Liu Y, Huang T, Zhou B (2008) Discriminative local binary patterns for human detection in personal album. In: Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pp 1–8Google Scholar
  46. 46.
    Naikal N, Yang AY, Sastry SS (2011) Informative feature selection for object recognition via sparse PCA. In: Computer Vision (ICCV), 2011 IEEE International Conference on, pp 818–825Google Scholar
  47. 47.
    Niyomugabo C, Choi H, Kim TY (2016) A modified Adaboost algorithm to reduce false positives in face detection. Math Probl Eng 2016:6.  https://doi.org/10.1155/2016/5289413
  48. 48.
    O’Hanen B, Wisan M (2005) Jpeg compressionGoogle Scholar
  49. 49.
    Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRefGoogle Scholar
  50. 50.
    Palubinskas G, Kurz F, Reinartz P (2008) Detection of traffic congestion in optical remote sensing imagery. In: Geoscience and Remote Sensing Symposium, 2008. IGARSS 2008. IEEE International, vol 2, pp II–426Google Scholar
  51. 51.
    Qu S, Wang Y, Meng G, Pan C (2016) Vehicle detection in satellite images by incorporating Objectness and convolutional neural network. J Ind Intell Inf Vol 4(2)Google Scholar
  52. 52.
    Razakarivony S, Jurie F (2016) Vehicle detection in aerial imagery: a small target detection benchmark. J Vis Commun Image Represent 34:187–203CrossRefGoogle Scholar
  53. 53.
    Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. Proc IEEE Conf Comput Vis Pattern Recognit, pp 779–788Google Scholar
  54. 54.
    Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Proces Syst, pp 91–99Google Scholar
  55. 55.
    Samuel AL (1967) Some studies in machine learning using the game of checkers. II—recent progress. IBM J Res Dev 11(6):601–617CrossRefGoogle Scholar
  56. 56.
    Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. In: Computer Vision and Pattern Recognition, 2007. CVPR’07. IEEE Conference on, pp 1–8Google Scholar
  57. 57.
    Strang G (1999) The discrete cosine transform. SIAM Rev 41(1):135–147MathSciNetCrossRefGoogle Scholar
  58. 58.
    Sun Z, Bebis G, Miller R (2006) On-road vehicle detection: a review. IEEE Trans Pattern Anal Mach Intell 28(5):694–711CrossRefGoogle Scholar
  59. 59.
    Sundaram N (2012) Making computer vision computationally efficient. University of California, BerkeleyGoogle Scholar
  60. 60.
    Tang T, Zhou S, Deng Z, Lei L, Zou H (2017) Arbitrary-oriented vehicle detection in aerial imagery with single convolutional neural networks. Remote Sens 9(11):1170CrossRefGoogle Scholar
  61. 61.
    Taubman D, Marcellin M (2012) JPEG2000 image compression fundamentals, standards and practice: image compression fundamentals, standards and practice, vol 642. Springer Science & Business Media, New YearGoogle Scholar
  62. 62.
    Tekalp AM (2015) Digital video processing. Prentice Hall Press, Upper Saddle RiverGoogle Scholar
  63. 63.
    Teo CH, Tay YH, Lai WK (2005) A novel approach to improve the training time of convolutional networks for object recognition. In: Proceedings of the Twelfth International Conference on Neural Information Processing (ICONIP 2005), Taipei, Taiwan ROC, pp 17–22Google Scholar
  64. 64.
    Trier ØD, Jain AK, Taxt T (1996) Feature extraction methods for character recognition-a survey. Pattern Recogn 29(4):641–662CrossRefGoogle Scholar
  65. 65.
    Uijlings JRR, Van De Sande KEA, Gevers T, Smeulders AWM (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRefGoogle Scholar
  66. 66.
    Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd ACM international conference on Multimedia, pp 689–692Google Scholar
  67. 67.
    Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, vol 1, pp I–IGoogle Scholar
  68. 68.
    Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154CrossRefGoogle Scholar
  69. 69.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRefGoogle Scholar
  70. 70.
    Wang L, Zhao X, Liu Y (2016) Reduce false positives for object detection by a priori probability in videos. Neurocomputing 208:325–332CrossRefGoogle Scholar
  71. 71.
    Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRefGoogle Scholar
  72. 72.
    Xia G-S et al (2018) DOTA: A large-scale dataset for object detection in aerial images. In: Proc. CVPRGoogle Scholar
  73. 73.
    Yao S, Wang T, Shen W, Pan S, Chong Y, Ding F (2015) Feature selection and pedestrian detection based on sparse representation. PLoS One 10(8):e0134242CrossRefGoogle Scholar
  74. 74.
    Zhang W, Zelinsky G, Samaras D (2007) Real-time accurate object detection using multiple resolutions. In: Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pp 1–8Google Scholar
  75. 75.
    Zhu X, Vondrick C, Ramanan D, Fowlkes CC (2012) Do We Need More Training Data or Better Models for Object Detection?. In: BMVC, vol 3, p 5Google Scholar
  76. 76.
    Zitnick CL, Dollár P (2014) Edge boxes: Locating object proposals from edges. In: European Conference on Computer Vision, pp 391–405Google Scholar
  77. 77.
    Zou H, Hastie T, Tibshirani R (2006) Sparse principal component analysis. J Comput Graph Stat 15(2):265–286MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  • Shahid Karim
    • 1
    Email author
  • Ye Zhang
    • 1
  • Shoulin Yin
    • 1
  • Asif Ali Laghari
    • 2
  • Ali Anwar Brohi
    • 3
  1. 1.School of Electronics and Information EngineeringHarbin Institute of TechnologyHarbinChina
  2. 2.School of Computer Science and TechnologyHarbin Institute of TechnologyHarbinChina
  3. 3.School of Energy Science and EngineeringHarbin Institute of TechnologyHarbinChina

Personalised recommendations