Skip to main content
SpringerLink
Log in

Anomaly detection and localization in crowded scenes using connected component analysis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a new method for detecting abnormal events in the surveillance systems. This method does not employ object detection or tracking and thus it does not fail in the crowded scenes. In the first step of proposed method, the appropriate cell size is determined by calculating the prevalent size of the connected components. Then, the redundant information is eliminated and the important regions are extracted from training data. This preprocessing significantly reduces the volume of training data in the learning phase. Next, using the HOG descriptors and a multivariate Gaussian model, the appearance anomalies i.e. the abnormality in terms of physical characteristics is detected. Besides that, a simple algorithm is provided to detect the abnormal motion using the average optical flow of the cells. Experimental results on the UCSD-PED2 datasets show that the proposed method can reliably detect abnormal events in video sequences, outperforming the current state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Albusac J, Vallejo D, Jimenez L et al (2009) Intelligent surveillance based on normality analysis to detect abnormal behaviors. Pattern Recognit Artif Intell 23(7):1223–1244

    Article  Google Scholar 

  2. Barron JL, Fleet DJ, Beauchemin SS, Burkitt TA (1994) Performance of optical flow techniques. Int J Comput Vis 12(1):43–77

    Article  Google Scholar 

  3. Bertini M, Bimbo DA, Seidenari L (2012) Multi-scale and real-time nonparametric approach for anomaly detection and localization. Comput Vis Image Underst 116(3):320–329

    Article  Google Scholar 

  4. Biswas S, Babu RV (2015) Anomaly detection in compressed H.264/AVC video. Multimed Tools Appl 74(24):11099–11115

    Article  Google Scholar 

  5. Calderara S, Cucchiara R, Prati A (2007) Detection of abnormal behaviors using a mixture of Von Mises distributions. IEEE Conference on Advanced Video and Signal Based Surveillance, pp 141–146

  6. Cheng KW, Chen YT, Fang WH (2015) Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation. IEEE Trans Image Process 24(12):5288–5301

    Article  MathSciNet  Google Scholar 

  7. Cong Y, Yuan J, Yandong T (2013) Video anomaly search in crowded scenes via spatio-temporal motion context. IEEE Trans Inf Forensics Secur 8(10):1590–1599

    Article  Google Scholar 

  8. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Conference on Computer Vision and Pattern Recognition, pp 886–893

  9. Dalal N, Triggs B, Schmid C (2006) Human detection using oriented histograms of flow and appearance. European Conference on Computer Vision, pp 428–441

  10. Diamantopoulos G, Spann M (2005) Event detection for intelligent car park video surveillance. Real Time Imaging 11(3):233–243

    Article  Google Scholar 

  11. Dong N, Jia Z, Shao J, et al (2010) Traffic abnormality detection through directional motion behavior map. IEEE International Conference on Advanced Video and Signal Based Surveillance, pp 80–84

  12. Duque D, Santos H, Cortez P (2007) Prediction of abnormal behaviors for intelligent video surveillance system. IEEE Symposium on Computational Intelligence and Data Mining, pp 362–367

  13. Fang Z, Fei F, Fang Y et al (2016) Abnormal event detection in crowded scenes based on deep learning. Multimed Tools Appl 75(22):14617–14639

    Article  Google Scholar 

  14. Kim J, Grauman K (2009) Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. IEEE Conference on Computer Vision and Pattern Recognition, pp 2921-2928

  15. Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18–32

    Article  Google Scholar 

  16. Li N, Wu X, Guo H (2015) Anomaly Detection in video surveillance via Gaussian process. Int J Pattern Recognit Artif Intell 29(6):1–25

    Article  Google Scholar 

  17. Li T, Chang H, Wang M, Ni B, Hong R, Yan S (2015) Crowded scene analysis: a survey. IEEE Trans Circ Syst Video Technol 25(3):367–386

    Article  Google Scholar 

  18. Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. IEEE Conference on Computer Vision and Pattern Recognition, pp 1975-1981

  19. Makantasis K, Protopapadakis E, Doulamis A, et al (2012) Monocular camera fall detection system exploiting 3d measures: a semi-supervised learning approach, Workshops and demonstrations, Lecture Notes in Computer Science, pp 81-90

  20. Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. IEEE Conference on Computer Vision and Pattern Recognition, pp 935-942

  21. Member T, Gong SH (2008) Video behavior profiling for anomaly detection. IEEE Trans Pattern Anal Mach Intell 30(5):893–908

    Article  Google Scholar 

  22. Ojala T, Pietikainen M, Maenpaa T (2002) Multi resolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  MATH  Google Scholar 

  23. Piciarelli C, Micheloni C, Foresti G.L (2008) Trajectory-based anomalous event detection. IEEE Trans Circ Syst Video Technol 18(11):1544-1554

  24. Reddy V, Sanderson C, Lovell B (2011) Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture. International Workshop on Machine Learning for Vision based Motion Analysis, pp.55-61

  25. Roshtkhari MJ, Levine MD (2013) An on-line, real-time learning method for detecting anomalies in videos using spatio-temporal compositions. Comput Vis Image Underst 117(10):1436–1452

    Article  Google Scholar 

  26. Sodemann A, Ross M, Borghetti B (2012) A review of anomaly detection in automated surveillance. IEEE Trans Syst Man Cybern 42(6):1257–1272

    Article  Google Scholar 

  27. Tang S, Andriluka M, Schiele B (2014) Detection and tracking of occluded people. Int J Comput Vis 110(1):58–69

    Article  Google Scholar 

  28. Vallejo D, Albusac J, Jimenez L et al (2009) A cognitive surveillance system for detecting incorrect traffic behaviors. Expert Syst Appl 36(7):10503–10511

    Article  Google Scholar 

  29. Varadarajan J, Odobez J (2009) Topic models for scene analysis and abnormality detection. IEEE International Conference on Computer Vision Workshops, pp 1338–1345

  30. Vincent P, Larochelle H, Bengio Y, Manzagol P.A (2008) Extracting and composing robust features with denoising autoencoders. International Conference on machine Learning, pp 1096–1103

  31. Xu D, Song R, Wu X, Li N, Feng W, Qian H (2014) Video anomaly detection based on a hierarchical activity discovery within spatiotemporal contexts. Neurocomputing 143(1):144–152

    Article  Google Scholar 

  32. Xu D, Yan Y, Ricci E, Sebe N (2017) Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst 156(C):117–127

    Article  Google Scholar 

  33. Zaharescu A, Wildes R (2010) Anomalous behaviour detection using spatiotemporal oriented energies, subset inclusion histogram comparison and event-driven processing .European Conference on Computer Vision, pp. 563–576

  34. Zhang C, Chen W, Chen X et al (2010) A multiple instance learning and relevance feedback framework for retrieving abnormal incidents in surveillance videos. J Multimed 5(4):310–321

    Google Scholar 

  35. Zhang T et al (2016) A new method for violence detection in surveillance scenes. Multimed Tools Appl 75(12):7327–7349

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran

    Somaieh Amraee, Abbas Vafaei, Kamal Jamshidi & Peyman Adibi

Authors
  1. Somaieh Amraee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abbas Vafaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kamal Jamshidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peyman Adibi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abbas Vafaei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amraee, S., Vafaei, A., Jamshidi, K. et al. Anomaly detection and localization in crowded scenes using connected component analysis. Multimed Tools Appl 77, 14767–14782 (2018). https://doi.org/10.1007/s11042-017-5061-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5061-7

Keywords

Search

Navigation