Multimedia Tools and Applications

, Volume 78, Issue 22, pp 31101–31120 | Cite as

Detecting anomalous crowd scenes by oriented Tracklets’ approach in active contour region

  • Sonu LambaEmail author
  • Neeta Nain


Video imagery based crowd analysis has become a topic of great interest for public safety at the venues of mass gathering events. This paper presents a novel approach to detect anomalous scene in high density crowded places. We propose an oriented tracklets approach in active contour region and measure the entropy and temporal occupancy deviation of oriented tracklets over the frames. To this end, an oriented trajectory algorithm is designed to extract tracklets of moving crowd. For trajectory extraction, spatio-temporal interest points are detected by adopting Harris corner features. The detected interest points are tracked over the frames within the optimized region. An active contour segmentation approach is applied to optimize the tracking region as a moving crowd is not distributed in entire frame region. The flow direction of each oriented tracklet is distributed into histogram bins at a specified interval, which defines the flow of collective motion pattern. A real-time scene updating procedure is also followed to adapt the changes of crowd scenes. Further, an entropy of histogram of oriented tracklets is computed based on the probability of occurrence of the tracklets. It has been shown that entropy of flow direction changes markedly in the unusual state of affairs. A simulation on a large number of the anomalous scene has been exercised to see the characteristics of an entropy. Also, temporal occupancy deviation is computed which measures the area occupied by the extracted tracklets of the crowd during a certain interval of time. If entropy and temporal occupancy deviation increase beyond a certain threshold, an alert is issued to detect anomaly to prevent potentially dangerous crowd-related disasters. Experiments conducted on three publicly available benchmark crowd datasets such as UMN, UCF Web, and Violent Flows, obtained interesting and promising results. We also evaluated some manually collected challenging real-world crowd video sequences. We compared the proposed approach with various state-of-the-art methods, and achieve remarkable accuracy while maintaining the lower computational complexity.


Anomalous scene detection Oriented tracklets Active contour segmentation Entropy 



  1. 1.
    2006 umn dataset. Unusualcrowdactivitydatasetofuniversityofminnesota. onlineGoogle Scholar
  2. 2.
    Ali S, Shah M (2007) A lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: 2007. CVPR’07. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 1–6Google Scholar
  3. 3.
    Benabbas Y, Ihaddadene N, Djeraba C (2011) Motion pattern extraction and event detection for automatic visual surveillance. EURASIP J Image Video Process 2011(1):163682Google Scholar
  4. 4.
    Chan TF, Vese LA (2001) Active contours without edges. IEEE Trans Image Process 10(2):266–277CrossRefGoogle Scholar
  5. 5.
    Cong Y, Yuan J, Liu J (2013) Abnormal event detection in crowded scenes using sparse representation. Pattern Recogn 46(7):1851–1864CrossRefGoogle Scholar
  6. 6.
    Gao Y, Liu H, Sun X, Wang C, Liu Y (2016) Violence detection using oriented violent flows. Image Vis Comput 48:37–41CrossRefGoogle Scholar
  7. 7.
    Gracia IS, Suarez OD, Garcia GB, Kim T-K (2015) Fast fight detection. PLoS One 10(4):e0120448CrossRefGoogle Scholar
  8. 8.
    Gu X, Cui J, Zhu Q (2014) Abnormal crowd behavior detection by using the particle entropy. Optik-Int J Light Electron Opt 125(14):3428–3433CrossRefGoogle Scholar
  9. 9.
    Gunale K, Mukherji P (2018) Deep learning with a spatiotemporal descriptor of appearance and motion estimation for video anomaly detection. J Imaging 4(6):79CrossRefGoogle Scholar
  10. 10.
    Hassner T, Itcher Y, Kliper-Gross O (2012) Violent flows: Real-time detection of violent crowd behavior. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, pp 1–6Google Scholar
  11. 11.
    Hu M, Ali S, Shah M (2008) Learning motion patterns in crowded scenes using motion flow field. In: ICPR, pp 1–5Google Scholar
  12. 12.
    Krausz B, Bauckhage C (2012) Loveparade 2010: Automatic video analysis of a crowd disaster. Comput Vis Image Underst 116(3):307–319CrossRefGoogle Scholar
  13. 13.
    Lamba S, Nain N (2018) A texture based mani-fold approach for crowd density estimation using gaussian markov random field. Multimed Tools Appl 78(5):1–20CrossRefGoogle Scholar
  14. 14.
    Lloyd K, Rosin PL, Marshall D, Moore SC (2017) Detecting violent and abnormal crowd activity using temporal analysis of grey level co-occurrence matrix (glcm)-based texture measures. Mach Vis Appl 28(3-4):361–371CrossRefGoogle Scholar
  15. 15.
    Loy CC, Xiang T, Gong S (2009) Modelling multi-object activity by gaussian processes. In: BMVC. Citeseer, pp 1–11Google Scholar
  16. 16.
    Luvison B, Chateau T, Lapreste J-T, Sayd P, Pham QC (2011) Automatic detection of unexpected events in dense areas for videosurveillance applications. In: Video Surveillance. InTech.Google Scholar
  17. 17.
    Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1975–1981Google Scholar
  18. 18.
    Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: 2009. CVPR 2009. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 935–942Google Scholar
  19. 19.
    Mehran R, Moore BE, Shah M (2010) A streakline representation of flow in crowded scenes. In: European conference on computer vision. Springer, pp 439–452Google Scholar
  20. 20.
    Mousavi H, Mohammadi S, Perina A, Chellali R, Murino V (2015) Analyzing tracklets for the detection of abnormal crowd behavior. In: 2015 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, pp 148–155Google Scholar
  21. 21.
    Pennisi A, Bloisi DD, Iocchi L (2016) Online real-time crowd behavior detection in video sequences. Comput Vis Image Underst 144:166–176CrossRefGoogle Scholar
  22. 22.
    Rao AS, Gubbi J, Marusic S, Palaniswami M (2016) Crowd event detection on optical flow manifolds. IEEE Trans Cybern 46(7):1524–1537CrossRefGoogle Scholar
  23. 23.
    Shao J, Change Loy C, Wang X (2014) Scene-independent group profiling in crowd. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2219–2226Google Scholar
  24. 24.
    Tomasi C, Kanade (1991) Detection and tracking of point featuresGoogle Scholar
  25. 25.
    Wang X, Ma X, Grimson WEL (2009) Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Trans Pattern Anal Mach Intell 31(3):539–555CrossRefGoogle Scholar
  26. 26.
    Wang L, Dong M (2012) Real-time detection of abnormal crowd behavior using a matrix approximation-based approach. In: 2012 19th IEEE International Conference on Image Processing (ICIP). IEEE, pp 2701–2704Google Scholar
  27. 27.
    Xu L, Gong C, Yang J, Wu Q, Yao L (2014) Violent video detection based on mosift feature and sparse coding. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp 3538–3542Google Scholar
  28. 28.
    Yan J, Pollefeys M (2004) Video synchronization via space-time interest point distribution. In: Advanced Concepts for Intelligent Vision Systems, vol 1, pp 12–21Google Scholar
  29. 29.
    Yuan Y, Fang J, Wang Q (2015) Online anomaly detection in crowd scenes via structure analysis. IEEE Trans Cybern 45(3):548–561CrossRefGoogle Scholar
  30. 30.
    Yuan Y, Wang D, Wang Q (2017) Anomaly detection in traffic scenes via spatial-aware motion reconstruction. IEEE Trans Intell Transp Syst 18(5):1198–1209CrossRefGoogle Scholar
  31. 31.
    Zhou B, Wang X, Tang X (2012) Understanding collective crowd behaviors: Learning a mixture model of dynamic pedestrian-agents. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 2871–2878Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Malaviya National Institute of Technology JaipurRajasthanIndia

Personalised recommendations