Skip to main content
SpringerLink
Log in

Real-time implementation of moving object detection in UAV videos using GPUs

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Unmanned aerial vehicles (UAVs) are being increasingly used for video surveillance and remote sensing. Moving object detection is an important algorithm for many such applications. Real-time processing of moving object detection is required for various decision-making tasks in many of these applications. However, being compute-intensive in nature, it is difficult to process high-resolution UAV-sourced videos in real-time. GPU vendors regularly release newer architectures with new features to speed up various kinds of applications. Hence, it becomes imperative to explore parallel implementations of such algorithms using the new GPU architectures. This paper describes parallel implementation strategies for algorithms like feature detection, feature matching, image transformation, frame differencing, morphological processing and connected component labeling which are used to detect moving objects in UAV-sourced videos. The implementation is tested on different NVIDIA GPU microarchitectures (Fermi, Maxwell, and Pascal). Experimental results show the achieved frame processing rates of 43.1 fps, 35.5 fps and 9.1 fps for 1080p videos on Pascal, Maxwell, and Fermi microarchitectures respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Ibrahim, A.W.N., Ching, P.W., Seet, G.L.G., Lau, W.S.M., Czajewski, W.: Moving objects detection and tracking framework for UAV-based surveillance. In 2010 Fourth Pacific-Rim Symposium on Image and Video Technology, pp. 456–461 (2010)

  2. Cheraghi, S.A., Sheikh, U.U.: Moving object detection using image registration for a moving camera platform. In 2012 IEEE International Conference on Control System, Computing and Engineering, pp. 355–359 (2012)

  3. Teutsch, M., Krüger, W., Beyerer, J.: Moving object detection in top-view aerial videos improved by image stacking. Opt. Eng. 56(8), 1 (2017)

    Article  Google Scholar 

  4. Wei, Q., Lao, S., Bai, L.: Panorama Stitching, Moving Object Detection and Tracking in UAV Videos. In: 2017 International Conference on Vision, Image and Signal Processing (ICVISP), vol. 2017–Novem, pp. 46–50 (2017)

  5. Baykara, H.C., Biyik, E., Gul, G., Onural, D., Ozturk, A.S., Yildiz, I.: Real-time detection, tracking and classification of multiple moving objects in UAV videos. In: 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 945–950 (2017)

  6. Huang, C., Chen, P., Yang, X., Cheng, K.-T. T.: REDBEE: a visual-inertial drone system for real-time moving object detection. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 2017–Septe, pp. 1725–1731 (2017)

  7. Chen, P., Dang, Y., Liang, R., Zhu, W., He, X.: Real-time object tracking on a drone with multi-inertial sensing data. IEEE Trans. Intell. Transp. Syst. 19(1), 131–139 (2018)

    Article  Google Scholar 

  8. Tang, J.W., Shaikh-Husin, N., Sheikh, U.U., Marsono, M.N.: FPGA-based real-time moving target detection system for unmanned aerial vehicle application. Int. J. Reconfigurable Comput. 2016, 1–16 (2016)

    Article  Google Scholar 

  9. Sajjanar, S., Mankani, S.K., Dongrekar, P.R., Kumar, N.S., Mohana, Aradhya, H.V.R.: Implementation of real time moving object detection and tracking on FPGA for video surveillance applications. In: 2016 IEEE Distributed Computing, VLSI. Electrical Circuits and Robotics (DISCOVER), 289–295 (2016)

  10. Saifullah, A., Agrawal, K., Lu, C., Gill, C.: Multi-core real-time scheduling for generalized parallel task models. In: 2011 IEEE 32nd Real-Time Systems Symposium, pp. 217–226 (2011)

  11. Garland, M., Kirk, D.B.: Understanding throughput-oriented architectures. Commun. ACM 53(11), 58 (2010)

    Article  Google Scholar 

  12. Ciznicki, M., Kierzynka, M., Kopta, P., Kurowski, K., Gepner, P.: Benchmarking data and compute intensive applications on modern CPU and GPU architectures. Proced. Comput. Sci. 9, 1900–1909 (2012)

    Article  Google Scholar 

  13. Gutierrez, J., Nina-Paravecino, F., Kaeli, D.: A fast level-set segmentation algorithm for image processing designed for parallel architectures. In: 2016 6th Workshop on Irregular Applications: Architecture and Algorithms (IA3), pp. 66–69 (2016)

  14. Liu, J., Feld, D., Xue, Y., Garcke, J., Soddemann, T.: Multicore processors and graphics processing unit accelerators for parallel retrieval of aerosol optical depth from satellite data: implementation, performance, and energy efficiency. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 8(5), 2306–2317 (2015)

    Article  Google Scholar 

  15. Samet, R., Bay, O.F., Aydin, S., Tural, S., Bayram, A.: Real-time image processing applications on multicore CPUs and GPGPU. Int Conf. Parallel Distrib. Process Techn. Appl. 1, 116–122 (2015)

    Google Scholar 

  16. Huqqani, A.A., Schikuta, E., Ye, S., Chen, P.: Multicore and GPU parallelization of neural networks for face recognition. Proced. Comput. Sci. 18, 349–358 (2013)

    Article  Google Scholar 

  17. Asaduzzaman, A., Martinez, A., Sepehri, A.: A time-efficient image processing algorithm for multicore/manycore parallel computing. SoutheastCon 2015, 1–5 (2015)

    Google Scholar 

  18. Sánchez, M.G., Vidal, V., Arnal, J., Vidal, A.: Image noise removal on heterogeneous CPU-GPU configurations. Proced. Comput. Sci. 29, 2219–2229 (2014)

    Article  Google Scholar 

  19. Kumar, P., Singhal, A., Mehta, S., Mittal, A.: Real-time moving object detection algorithm on high-resolution videos using GPUs. J. Real-Time Image Process. 11(1), 93–109 (2016)

    Article  Google Scholar 

  20. Shi, J., Tomasi, C.: Good features to track. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94, pp. 593–600 (1994)

  21. Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20(10), 1025–1039 (1998)

    Article  Google Scholar 

  22. Nickolls, J., Kirk, D.: Graphics and Computing GPUs. In: Computer Organization and Design: The Hardware/Software Interface, pp. C3-A75

  23. NVIDIA Corporation: Tuning Cuda Applications for Pascal, pp. 1–14 (2014)

  24. Park, J., Looney, C.G., Chen, H.: Fast connected component labeling algorithm using a divide and conquer technique. In: 15th International Conference on Computers and their Applications, vol. 4, pp. 4–7 (2000)

  25. NVIDIA Corporation: Cooperative groups. In: CUDA C PROGRAMMING GUIDE (CUDA 9.2), pp. 147–155 (2018)

Download references

Author information

Authors and Affiliations

  1. Visvesvaraya National Institute of Technology, Nagpur, 440010, India

    Deepak Jaiswal & Praveen Kumar

Authors
  1. Deepak Jaiswal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Praveen Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Deepak Jaiswal.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jaiswal, D., Kumar, P. Real-time implementation of moving object detection in UAV videos using GPUs. J Real-Time Image Proc 17, 1301–1317 (2020). https://doi.org/10.1007/s11554-019-00888-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-019-00888-5

Keywords

Search

Navigation