Skip to main content
SpringerLink
Log in

Visual data mining for crowd anomaly detection using artificial bacteria colony

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a novel method for global anomaly detection in crowded scenes. The optical flow of frames is used to extract the foreground of areas with people motions in the crowd in the form of layers. The optical flow between two frames generates one layer. The proposed method applies the metaheuristic of artificial bacteria colony as a robust algorithm to optimize the extracted layers. Artificial bacteria cover all regions of interest that have high movement between frames. The artificial bacteria colony adapts quickly to the most varied scenarios. Moreover, the algorithm has low sensibility to noise and to sudden changes in video lighting as captured by optical flow. The bacteria population of the colonies, its food storage and the colony’s centroid position regarding each optical flow layer, are used as input to train a Kohonen’s neural network. Once trained the network is able to detect specific events based on behavior patterns similarity, as produced by the bacteria colony during such events. Experiments are conducted on available public dataset. The achieved results show that the proposed method captures the dynamics of the crowd behavior successfully, revealing that the proposed scheme outperforms the available state-of-the-art algorithms for global anomaly detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Andrade EL, Blunsden S, Fisher RB (2006) Modelling crowd scenes for event detection. In: 18th International Conference on Pattern Recognition (ICPR’06), vol 1. IEEE, pp 175–178

  2. Brostow GJ, Cipolla R (2006) Unsupervised bayesian detection of independent motion in crowds. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), vol 1, pp 594–601

  3. Chaaraoui AA, Climent-Pérez P, Flórez-Revuelta F (2012) A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst Appl 39(12):10873–10888

    Article  Google Scholar 

  4. Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 3449–3456

  5. Dataset UMN (2006) Unusual crowd activity dataset of university of minnesota, available in http://mha.cs.umn.edu/movies/crowdactivity-all.avi. Minessota

  6. Feng J, Zhang C, Hao P (2010) Online learning with self-organizing maps for anomaly detection in crowd scenes. In: 2010 20th International Conference on Pattern Recognition (ICPR). IEEE, pp 3599–3602

  7. Garate C, Bilinsky P, Bremond F (2009) Crowd event recognition using hog tracker. In: 2009 Twelfth IEEE international workshop on performance evaluation of tracking and surveillance (PETS-Winter), pp 1–6

  8. Horn BKP, Schunck BG (1981) Determining optical flow. Artificial intelligence 17(1–3):185–203

    Article  Google Scholar 

  9. Kajo I, Malik AS, Kamel N (2015) Motion estimation of crowd flow using optical flow techniques: a review. In: 2015 9th International Conference on Signal Processing and Communication Systems (ICSPCS). IEEE, pp 1–9

  10. Kaltsa Vagia, Briassouli Alexia, Kompatsiaris Ioannis, Hadjileontiadis Leontios J, Strintzis Michael Gerasimos (2015) Swarm intelligence for detecting interesting events in crowded environments. IEEE Trans Image Process 24(7):2153–2166

    Article  MathSciNet  Google Scholar 

  11. Kaltsa V, Briassouli A, Kompatsiaris I, Strintzis MG (2014) Swarm-based motion features for anomaly detection in crowds. In: 2014 IEEE international conference on image processing (ICIP). IEEE, Paris, pp 2353–2357

  12. Lui YM (2012) Tangent bundles on special manifolds for action recognition. IEEE Transactions on Circuits and Systems for Video Technology 22(6):930–942

    Article  Google Scholar 

  13. Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: CVPR, vol 249, p 250

  14. Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: IEEE conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE, p 2009

  15. Murray JD (2002) Mathematical biology i: an introduction, vol 17 of interdisciplinary applied mathematics

  16. Passino KM (2002) Biomimicry of bacterial foraging for distributed optimization and control. IEEE Control Syst 22(3):52–67

    Article  MathSciNet  Google Scholar 

  17. Popoola OP, Wang K (2012) Video based abnormal human behavior recognition a review. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):865–878

    Article  Google Scholar 

  18. Raghavendra R, Del Bue A, Cristani M, Murino V (2011) Optimizing interaction force for global anomaly detection in crowded scenes. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), IEEE, pp 136–143

  19. Rao AS, Gubbi J, Marusic S, Stanley P, Palaniswami M (2013) Crowd density estimation based on optical flow and hierarchical clustering. In: 2013 international conference on advances in computing, communications and informatics (ICACCI). IEEE, p 2013

  20. Thida M, Eng H-L, Remagnino P (2013) Laplacian eigenmap with temporal constraints for local abnormality detection in crowded scenes. IEEE Trans Cybern 43 (6):2147–2156

    Article  Google Scholar 

  21. Shandong W, Moore BE, Shah M (2010) Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, p 2010

  22. Xinxiao W, Dong X, Duan L, Luo J, Jia Y (2013) Action recognition using multilevel features and latent structural svm. IEEE Transactions on Circuits and Systems for Video Technology 23(8):1422–1431

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics Engineering and Telecommunications, Faculty of Engineering, State University of Rio de Janeiro, Rio de Janeiro, Brazil

    Joelmir Ramos & Nadia Nedjah

  2. Department of Systems Engineering and Computation, Faculty of Engineering, State University of Rio de Janeiro, Rio de Janeiro, Brazil

    Luiza de Macedo Mourelle

  3. Department of Computer Engineering, National Institute of Technology Kurukshetra, Kurukshetra, India

    Brij B. Gupta

Authors
  1. Joelmir Ramos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nadia Nedjah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luiza de Macedo Mourelle
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Brij B. Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joelmir Ramos.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramos, J., Nedjah, N., de Macedo Mourelle, L. et al. Visual data mining for crowd anomaly detection using artificial bacteria colony. Multimed Tools Appl 77, 17755–17777 (2018). https://doi.org/10.1007/s11042-017-5382-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5382-6

Keywords

Search

Navigation