Abstract
This paper presents a new method for detecting abnormal events in the surveillance systems. This method does not employ object detection or tracking and thus it does not fail in the crowded scenes. In the first step of proposed method, the appropriate cell size is determined by calculating the prevalent size of the connected components. Then, the redundant information is eliminated and the important regions are extracted from training data. This preprocessing significantly reduces the volume of training data in the learning phase. Next, using the HOG descriptors and a multivariate Gaussian model, the appearance anomalies i.e. the abnormality in terms of physical characteristics is detected. Besides that, a simple algorithm is provided to detect the abnormal motion using the average optical flow of the cells. Experimental results on the UCSD-PED2 datasets show that the proposed method can reliably detect abnormal events in video sequences, outperforming the current state-of-the-art methods.
Similar content being viewed by others
References
Albusac J, Vallejo D, Jimenez L et al (2009) Intelligent surveillance based on normality analysis to detect abnormal behaviors. Pattern Recognit Artif Intell 23(7):1223–1244
Barron JL, Fleet DJ, Beauchemin SS, Burkitt TA (1994) Performance of optical flow techniques. Int J Comput Vis 12(1):43–77
Bertini M, Bimbo DA, Seidenari L (2012) Multi-scale and real-time nonparametric approach for anomaly detection and localization. Comput Vis Image Underst 116(3):320–329
Biswas S, Babu RV (2015) Anomaly detection in compressed H.264/AVC video. Multimed Tools Appl 74(24):11099–11115
Calderara S, Cucchiara R, Prati A (2007) Detection of abnormal behaviors using a mixture of Von Mises distributions. IEEE Conference on Advanced Video and Signal Based Surveillance, pp 141–146
Cheng KW, Chen YT, Fang WH (2015) Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation. IEEE Trans Image Process 24(12):5288–5301
Cong Y, Yuan J, Yandong T (2013) Video anomaly search in crowded scenes via spatio-temporal motion context. IEEE Trans Inf Forensics Secur 8(10):1590–1599
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Conference on Computer Vision and Pattern Recognition, pp 886–893
Dalal N, Triggs B, Schmid C (2006) Human detection using oriented histograms of flow and appearance. European Conference on Computer Vision, pp 428–441
Diamantopoulos G, Spann M (2005) Event detection for intelligent car park video surveillance. Real Time Imaging 11(3):233–243
Dong N, Jia Z, Shao J, et al (2010) Traffic abnormality detection through directional motion behavior map. IEEE International Conference on Advanced Video and Signal Based Surveillance, pp 80–84
Duque D, Santos H, Cortez P (2007) Prediction of abnormal behaviors for intelligent video surveillance system. IEEE Symposium on Computational Intelligence and Data Mining, pp 362–367
Fang Z, Fei F, Fang Y et al (2016) Abnormal event detection in crowded scenes based on deep learning. Multimed Tools Appl 75(22):14617–14639
Kim J, Grauman K (2009) Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. IEEE Conference on Computer Vision and Pattern Recognition, pp 2921-2928
Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18–32
Li N, Wu X, Guo H (2015) Anomaly Detection in video surveillance via Gaussian process. Int J Pattern Recognit Artif Intell 29(6):1–25
Li T, Chang H, Wang M, Ni B, Hong R, Yan S (2015) Crowded scene analysis: a survey. IEEE Trans Circ Syst Video Technol 25(3):367–386
Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. IEEE Conference on Computer Vision and Pattern Recognition, pp 1975-1981
Makantasis K, Protopapadakis E, Doulamis A, et al (2012) Monocular camera fall detection system exploiting 3d measures: a semi-supervised learning approach, Workshops and demonstrations, Lecture Notes in Computer Science, pp 81-90
Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. IEEE Conference on Computer Vision and Pattern Recognition, pp 935-942
Member T, Gong SH (2008) Video behavior profiling for anomaly detection. IEEE Trans Pattern Anal Mach Intell 30(5):893–908
Ojala T, Pietikainen M, Maenpaa T (2002) Multi resolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Piciarelli C, Micheloni C, Foresti G.L (2008) Trajectory-based anomalous event detection. IEEE Trans Circ Syst Video Technol 18(11):1544-1554
Reddy V, Sanderson C, Lovell B (2011) Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture. International Workshop on Machine Learning for Vision based Motion Analysis, pp.55-61
Roshtkhari MJ, Levine MD (2013) An on-line, real-time learning method for detecting anomalies in videos using spatio-temporal compositions. Comput Vis Image Underst 117(10):1436–1452
Sodemann A, Ross M, Borghetti B (2012) A review of anomaly detection in automated surveillance. IEEE Trans Syst Man Cybern 42(6):1257–1272
Tang S, Andriluka M, Schiele B (2014) Detection and tracking of occluded people. Int J Comput Vis 110(1):58–69
Vallejo D, Albusac J, Jimenez L et al (2009) A cognitive surveillance system for detecting incorrect traffic behaviors. Expert Syst Appl 36(7):10503–10511
Varadarajan J, Odobez J (2009) Topic models for scene analysis and abnormality detection. IEEE International Conference on Computer Vision Workshops, pp 1338–1345
Vincent P, Larochelle H, Bengio Y, Manzagol P.A (2008) Extracting and composing robust features with denoising autoencoders. International Conference on machine Learning, pp 1096–1103
Xu D, Song R, Wu X, Li N, Feng W, Qian H (2014) Video anomaly detection based on a hierarchical activity discovery within spatiotemporal contexts. Neurocomputing 143(1):144–152
Xu D, Yan Y, Ricci E, Sebe N (2017) Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst 156(C):117–127
Zaharescu A, Wildes R (2010) Anomalous behaviour detection using spatiotemporal oriented energies, subset inclusion histogram comparison and event-driven processing .European Conference on Computer Vision, pp. 563–576
Zhang C, Chen W, Chen X et al (2010) A multiple instance learning and relevance feedback framework for retrieving abnormal incidents in surveillance videos. J Multimed 5(4):310–321
Zhang T et al (2016) A new method for violence detection in surveillance scenes. Multimed Tools Appl 75(12):7327–7349
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Amraee, S., Vafaei, A., Jamshidi, K. et al. Anomaly detection and localization in crowded scenes using connected component analysis. Multimed Tools Appl 77, 14767–14782 (2018). https://doi.org/10.1007/s11042-017-5061-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5061-7