Abstract
With the advancement in digital video technology, video surveillance has been playing its vital role for ensuring safety and security. The surveillance systems are deployed in wide range of applications to invigilate stuffs and to analyse the activities in the environment. From the single or multi surveillance camera, a huge amount of data is generated, stored and processed for security purpose. Due to time constraints, it is a very tedious process for an analyst to go through the full content. This limitation has been overcome by the use of video summarization. The video summarization is intended to afford comprehensible analysis of video by removing duplications and extracting key frames from the video. To make an easily interpreted outline, the various available video summarization methods will try to shot the summary of the main occurrences, scenes, or objects in a frame. Depending on the applications, it is required to summarize the happenings in the scene and detect the objects (static/dynamic) which is recorded in the video. Hence this paper provides the various methods used for video summarization and a comparative study of different techniques. It also presents different object detection, object classification and object tracking algorithms available in the literature.
Similar content being viewed by others
References
Adeel M, Weichen Z, Antoni BC (2014) Joint motion segmentation and background estimation in dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 368–375
Adesh H, Dattatray B, Vibha W (2015) Moving object detection using background subtraction shadow removal and post processing. Int J Comput Appl Int Confer Comput Technol 1–5
Ajmal M, Muhammad HA, Muhammad S, Yasir A, Faiz AS (2012) Video summarization: techniques and classification. In: Springer-Verlag Berlin Heidelberg, ICCVG, pp. 1–13
Baohan X, Wang X, Yu-Gang J (2016) Fast summarization of user-generated videos using semantic, emotional and quality clues. Proceedings of the IEEE Multimedia 1–8
Barga D, Dalton Meitei T (2014) A survey on moving object tracking in video. Int J Inf Theory (IJIT) 3(3):31–46
Chandrika K (2005) Background subtraction for detection of moving object. KOGSIAKS Universitaet Karlsruhe, UCRLWEB214348 1–3
Chenggang Y, Yongdong Z, Jizheng X, Feng D, Liang L, Qionghai D, Feng W (2014) A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors. IEEE Signal Process Lett 21:573–576
Chenggang Y, Yongdong Z, Jizheng X, Feng D, Jun Z, Qionghai D, Feng W (2014) Efficient parallel framework for HEVC motion estimation on many-Core processors. Circuits Syst Video Technol IEEE Trans 24:2077–2089
Chenggang Y, Hongtao X, Dongbao Y, Jian Y, Yongdong Z, Qionghai D (2017) Supervised hash coding with deep neural network for environment perception of intelligent vehicles. IEEE Trans Intell Transp Syst 99:1–12
Chenggang Y, Hongtao X, Shun L, Jian Y, Yongdong Z, Qionghai D (2017) Effective uyghur language text detection in complex background images for traffic prompt identification. IEEE Trans Intell Transp Syst 99:1–10
Chinh D, Hayder R (2014) RPCA-KFE: key frame extraction for video using robust principal component analysis. IEEE Trans Image Process 11982:1–12
Chung YC, Lu TC, Yeh MT, Huang YX, Wu CY (2015) Applying the video summarization algorithm to surveillance systems. J Image Graph 3(1):20–24
Congcong L, Yi-Ta W, Shiaw-Shian Y, Tsuhan C (2009) Motion-focusing key frame extraction and video summarization for lane surveillance system. IEEE:4329–4332
Correia PL, Pereira F (2003) Objective evaluation of video segmentation quality. IEEE Trans Image Process 12(2):186–200
Deepak Kumar P, Sukadev M (2007) Detection of moving objects using fuzzy color difference histogram based background subtraction. Journal of Latex Class Files 6(1):1–8
Divyani P, Galiyawala HJ (2015) A review on moving object detection and tracking. Int J Comput Appl (2250–1797) 5(3):168–175
El Khattabi Z, Tabii Y, Benkaddour A (2015) Video summarization: techniques and application. Int J Comput Electr Autom Control Inf Eng World Acad Sci Eng Technol 9(4):928–933
Fang-Lue Z, Xian W, Hao-Tian Z, Jue W, Shi-Min H (2016) Robust background identification for dynamic video editing. ACM Trans Graph 35(6):197.1–197.12
Gopal T, Kalpana S, Ghose MK (2014) Moving object detection and segmentation using frame differencing and summing technique. Int J Comput Appl(0975–8887) 102(7):20–25
Hua H, Hong L, Zhang L (2014) VideoWeb: space-time aware Presentationof a Videoclip collection. IEEE J Emerg Sel Top Circuits Syst 4(1):142–152
Imrankhan P, Chetan C (2015) A survey on moving object detection and tracking methods. Int J Comput Sci Inf Technol 6(6):5212–5215
Jeba Veera SJ, Nancy Emymal S (2013) A critical survey of moving object detection techniques and related proposed research. Int J Comput Appl Eng Sci 3:37–40
Kansagara R, Thakore D, Joshi M (2014) A study on video summarization techniques. Int J Innov Res Comput Commun Eng 2:2962–2969
Karasulu B (2010) Review and evaluation of well-known methods for moving object detection and tracking in videos. J Aeronautics Space Technol 4(4):11–22
Kinjal AJ, Darshak GT (2012) A survey on moving object detection and tracking in video surveillance system. Int J Soft Comput Eng (IJSCE) 2(3):44–48
Klaus S, Marco AH, Jochen H (2015) Video interaction tools: a survey of recent work. ACM Comput Surv 48(1):4.1–4.34
Kulchandani JS, Dangarwala KJ (2015) Moving object detection: review of recent research trends. IEEE 22:747–757
Lin-Xie T, Tao M, Xian-Sheng H (2009) Near-lossless video summarization. In: ACM, pp. 351–360
Mahesh CP, Narkhede NS, Saurabh SA (2014) Detection of moving object based on background subtraction. Int J Emerg Trends Technol Comput Sci (IJETTCS) 3(3):215–218
Mei H, Ayesh BM, Daniel FD (2004) Automatic performance evaluation for video summarization. In: MDA904–02-C-0406
Neha G, Neelam B, Shipra A (2016) Motion detection, tracking and classification for automated video surveillanc. In: IEEE International Conference on Power Electronics. Intelligent Control and Energy Systems (ICPEICES), pp. 1–5
Paolo N, Giuseppe B, Francesco T (2015) Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy. IEEE Trans Image Process 24(11):3266–3281
Paygude SS, Vibha V, Manisha C (2013) Vehicle detection and tracking using the opticalflow and background subtraction. Elsevier, pp. 741–747
Perazzi F, Pont-Tuset J, McWilliams B, Van Gool L, Gross M, Sorkine-Hornung A (2016) A benchmark dataset and evaluation methodology for video object segmentation. In: Computer Vision and Pattern Recognition (CVPR), IEEE, pp. 724–732
Peter O, Jitendra M, Thomas B (2013) Segmentation of moving objects by long term video analysis. IEEE Trans Patt Anal Mach Intell 1–14
Pritee G, Yashpal S, Manoj G (2014) Moving object detection using frame difference, background subtraction and sobs for video surveillance application. In: 3rd International Conference on System Modeling & Advancement in Research Trends (SMART), pp. 151–156
Rodriguez-Canosa GR, Stephen T, del Jaime C, Antonio B, MacDonald B (2012) A real-time method to detect and track moving objects (DATMO) from unmanned aerial vehicles (UAVs) using a single camera. Remote Sensing, pp. 1090–1111
Roshani KD, Dipali YS (2016) Moving object detection with static and dynamic camera for automated videoanalysis. J Inf Knowl Res Comput Eng:769–775
Sandra EF, da Antonio L Jr, de Arnaldo AA, Matthieu C (2008) VSUMM: An Approach for Automatic Video Summarization and Quantitative Evaluation. In: Computer Graphics and Image Processing, ISSN 1530–1834
Sanjay KK, Kunal BR, Ananda SC (2015) Multi-view video summarization using bipartite matching constrained optimum-path Forest clustering. IEEE Trans Multimedia 17(8):1166–1173
Sepehr A, Mahdavi-Nasab H (2013) Optical flow based moving object detection and tracking for traffic surveillance. Int J Electr Comput Energ Electron Commun Eng 7(9):1252–1256
Shaikh SH, et al (2014) Moving object detection using background subtraction. SpringerBriefs in Computer Science 5–14
Shi L, Irwin K, Michael RL (2004) Video summarization by video structure analysis and graph optimization. IEEE Int Conf Multi Expo (ICME) 1959-1962
Shilpa, Prathap HL, Sunitha MR (2016) A survey on moving object detection and tracking techniques. Int J Eng Comput Sci ISSN: 2319–7242 5(4):16263–16269
Shu Z, Yingying Z, Roy-Chowdhury AK (2016) Context-aware surveillance video summarization. IEEE Trans Image Process 25(11):5469–5478
Shun-Hsing O, Chia-Han L, Srinivasa Somayazulu V, Yen-Kuang C, Shao-Yi C (2015) On-line multi-view video summarization for wireless video sensor network. IEEE J Sel Top Sign Proces 9(1):165–179
Srinivas Rao C, Darwin P (2012) Frame difference and Kalman filter techniques for detection of moving vehicles in video surveillance. Int J Eng Res Appl 2(6):1168–1170
Suganya Devi K, Malmurugan N (2014) OFGM-SMED: an effiecient and robust foreground object detection in compressed video sequences. Eng Apll Artif Intell 28:210–217
Suganya Devi K, Srinivasan P (2015) A survey on compressed video segementation. Aust J Basic Appl Sci 9(21):115–119
Tinumol S, Jiby JP (2015) A survey on video summarization techniques. Int J Comput Appl (0975–8887) 132(13):31–33
Xu LQ (2007) Issues in video analytics and surveillance systems: research / prototyping vs. applications / user requirements (panel discussion). IEEE 23:10–14
Yasmin SK, Soudamini P (2015) Video summarization: survey on event detection and summarization in soccer videos. (IJACSA) Int J Adv Comput Sci Appl 6(11):256–259
Ying Z, Roger Z (2015) Efficient summarization from multiple georeferenced user-generated videos. IEEE 2:1–30
Yong-Jin L, Cuixia M, Guozhen Z, Xiaolan F, Hongan W, Guozhong D, Lexing X (2015) An interactive spiraltape video summarization. IEEE 7:1–14
Yuanyuan W, Xiaohai H, Truong QN, Fellow (2015) Moving objects detection with freely moving camera via background motion subtraction. IEEE:1–13
Zhang L, Qian-Kun X, Lei-Zheng N, Hua H (2013) VideoGraph: a non-linear video representation for efficient Exploration. In: Springer-Verlag, Berlin Heidelberg
Zhang K, Wei-Lun C, Fei S, Kristen G (2016) Video summarization with long short-term memory. In: European Conference on Computer Vision (ECCV), pp. 1–17
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Senthil Murugan, A., Suganya Devi, K., Sivaranjani, A. et al. A study on various methods used for video summarization and moving object detection for video surveillance applications. Multimed Tools Appl 77, 23273–23290 (2018). https://doi.org/10.1007/s11042-018-5671-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-5671-8