Skip to main content
SpringerLink
Log in

Machine Learning Methods from Group to Crowd Behaviour Analysis

  • Conference paper
  • First Online:
Advances in Computational Intelligence (IWANN 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10306))

Included in the following conference series:

Abstract

The human behaviour analysis has been a subject of study in various fields of science (e.g. sociology, psychology, computer science). Specifically, the automated understanding of the behaviour of both individuals and groups remains a very challenging problem from the sensor systems to artificial intelligence techniques. Being aware of the extent of the topic, the objective of this paper is to review the state of the art focusing on machine learning techniques and computer vision as sensor system to the artificial intelligence techniques. Moreover, a lack of review comparing the level of abstraction in terms of activities duration is found in the literature. In this paper, a review of the methods and techniques based on machine learning to classify group behaviour in sequence of images is presented. The review take into account the different levels of understanding and the number of people in the group.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Orts-Escolano, S.: Self-organizing activity description map to represent and classify human behaviour. In: IJCNN 2015 (2015)

    Google Scholar 

  2. Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst. Appl. 39(12), 10873–10888 (2012)

    Article  Google Scholar 

  3. Cardinaux, F., Deepayan, B., Charith, A., Hawley, M.S., Mark, S., Bhowmik, D., Abhayaratne, C.: Video based technology for ambient assisted living: a review of the literature. J. Ambient Intell. Smart Environ. (JAISE) 1364(3), 253–269 (2011)

    Google Scholar 

  4. Turaga, P., Chellappa, R., Subrahmanian, V., Udrea, O.: Machine recognition of human activities: a survey. IEEE Trans. Circ. Syst. Video Technol. 18, 1473–1488 (2008)

    Article  Google Scholar 

  5. Ryoo, M.S., Aggarwal, J.K.: Recognition of high-level group activities based on activities of individual members. In: 2008 IEEE Workshop on Motion and Video Computing, WMVC 2008, January 2008

    Google Scholar 

  6. Mihaylova, L., Carmi, A.Y., Septier, F., Gning, A., Pang, S.K., Godsill, S.: Overview of Bayesian sequential Monte Carlo methods for group and extended object tracking. Digit. Sig. Process.: Rev. J. 25(1), 1–16 (2014)

    Google Scholar 

  7. Climent-Pérez, P., Mauduit, A., Monekosso, D.N., Remagnino, P.: Detecting events in crowded scenes using tracklet plots. In: Proceedings of the International Conference on Computer Vision Theory and Applications (2014)

    Google Scholar 

  8. Vishwakarma, S., Agrawal, A.: A survey on activity recognition and behavior understanding in video surveillance. Vis. Comput. 29(10), 983–1009 (2013)

    Article  Google Scholar 

  9. Blunsden, S., Fisher, R.B.: The BEHAVE video dataset: ground truthed video for multi-person behavior classification. Ann. BMVA 2010(4), 1–11 (2010)

    Google Scholar 

  10. Chaquet, J.M., Carmona, E.J., Fernández-Caballero, A.: A survey of video datasets for human action and activity recognition. Comput. Vis. Image Underst. 117(6), 633–659 (2013)

    Article  Google Scholar 

  11. Banos, O., Damas, M., Pomares, H., Rojas, F., Delgado-Marquez, B., Valenzuela, O.: Human activity recognition based on a sensor weighting hierarchical classifier. Soft Comput. 17(2), 333–343 (2013)

    Article  Google Scholar 

  12. Bruckner, D., Yin, G.Q., Faltinger, A.: Relieved commissioning and human behavior detection in ambient assisted living systems. Elektrotechnik und Informationstechnik 129(4), 293–298 (2012)

    Article  Google Scholar 

  13. Wu, Y., Jia, Z., Ming, Y., Sun, J., Cao, L.: Human behavior recognition based on 3D features and hidden markov models. Sign. Image Video Process. 10(3), 495–502 (2015)

    Article  Google Scholar 

  14. Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Cazorla, M., Signes-Pont, M.T.: Group activity description and recognition based on trajectory analysis and neural networks, pp. 1585–1592 (2016)

    Google Scholar 

  15. Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Oliver-Albert, A.: A predictive model for recognizing human behaviour based on trajectory representation. In: International Joint Conference on Neural Networks (IJCNN), pp. 1494–1501 (2014)

    Google Scholar 

  16. Andrade, E., Blunsden, S., Fisher, R.: Hidden markov models for optical flow analysis in crowds. In: 18th International Conference on Pattern Recognition, pp. 460–463, January 2006

    Google Scholar 

  17. Hu, Y., Zhang, Y., Davis, L.S.: Unsupervised abnormal crowd activity detection using semiparametric scan statistic. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 1, pp. 767–774 (2013)

    Google Scholar 

  18. Ge, W., Collins, R.T., Ruback, B.: Automatically detecting the small group structure of a crowd. In: 2009 Workshop on Applications of Computer Vision, WACV 2009 (2009)

    Google Scholar 

  19. Goel, K., Robicquet, A.: Learning causalities behind human trajectories (2015)

    Google Scholar 

  20. Maksai, A., Wang, X., Fua, P.: Globally consistent multi-people tracking using motion patterns, vol. 1 (2016). arXiv preprint arXiv:1612.00604

  21. Shao, J., Loy, C.C., Wang, X.: Scene-independent group profiling in crowd, pp. 2219–2226 (2014)

    Google Scholar 

  22. Yi, S., Li, H., Wang, X.: Pedestrian travel time estimation in crowded scenes. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, pp. 3137–3145 (2015)

    Google Scholar 

  23. Yi, S., Li, H., Wang, X.: Understanding pedestrian behaviors from stationary crowd groups. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 07–12 June 2015, pp. 3488–3496 (2015)

    Google Scholar 

  24. Al-Raziqi, A., Denzler, J.: Unsupervised framework for interactions modeling between multiple objects. In: Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP, vol. 4, pp. 509–516 (2016)

    Google Scholar 

  25. Shen, C., Xie, R., Zhang, L., Song, L.: Small group people behavior analysis based on temporal recursive trajectory identification. Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University, Cooperative Medianet Innovation Center (2015)

    Google Scholar 

  26. Vascon, S., Mequanint, E.Z., Cristani, M., Hung, H., Pelillo, M., Murino, V.: Detecting conversational groups in images, sequences: a robust game-theoretic approach. Comput. Vis. Image Underst. 143, 11–24 (2016)

    Article  Google Scholar 

  27. Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)

    Article  Google Scholar 

  28. Liu, J., Tong, X., Li, W., Wang, T., Zhang, Y., Wang, H., Yang, B., Sun, L., Yang, S.: Automatic player detection, labeling and tracking in broadcast soccer video. In: Proceedings of the British Machine Vision Conference 2007, pp. 3.1–3.10 (2007)

    Google Scholar 

  29. Lin, W., Sun, M.-T., Poovandran, R., Zhang, Z.: Human activity recognition for video surveillance. In: IEEE International Symposium on Circuits and Systems, pp. 2737–2740, June 2008

    Google Scholar 

  30. Harmon, M., Lucey, P., Klabjan, D.: Predicting shot making in basketball using convolutional neural networks learnt from adversarial multiagent trajectories (2016). arXiv preprint arXiv:1609.04849

  31. Camplani, M., Paiement, A., Mirmehdi, M., Damen, D., Hannuna, S., Burghardt, T., Tao, L.: Multiple human tracking in RGB-D data: a survey, June 2016

    Google Scholar 

  32. Wickramaratna, K., Chen, M., Chen, S.C., Shyu, M.L.: Neural network based framework for goal event detection in soccer videos. In: Proceedings - Seventh IEEE International Symposium on Multimedia, ISM 2005, vol. 2005, pp. 21–28 (2005)

    Google Scholar 

  33. Hamidreza Rabiee, H.M., Haddadnia, J.: Emotion-based crowd representation for abnormality detection hamidreza. Int. J. Artif. Intell. Tools (2016)

    Google Scholar 

  34. Fradi, H., Dugelay, J.L.: Spatial and temporal variations of feature tracks for crowd behavior analysis. J. Multimodal User Interfaces 10(4), 307–317 (2016)

    Article  Google Scholar 

  35. Gong, S., Cristani, M., Yan, S., Loy, C.C.: Person re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.) ACVPR. Springer, London (2014)

    Google Scholar 

  36. Cao, L., Huang, K.: Video-based crowd density estimation and prediction system for wide-area surveillance. China Commun. 10(5), 79–88 (2013)

    Article  Google Scholar 

  37. Liao, H., Xiang, J., Sun, W., Feng, Q., Dai, J.: An abnormal event recognition in crowd scene. In: Proceedings - 6th International Conference on Image and Graphics, ICIG 2011, pp. 731–736, September 2011

    Google Scholar 

  38. Chang, M.C., Krahnstoever, N., Lim, S., Yu, T.: Group level activity recognition in crowded environments across multiple cameras. In: Proceedings - IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS 2010, pp. 56–63, February 2010

    Google Scholar 

  39. Gning, A., Mihaylova, L., Maskell, S., Pang, S.K., Godsill, S.: Group object structure and state estimation with evolving networks and Monte Carlo methods. IEEE Trans. Sig. Process. 59(4), 1383–1396 (2011)

    Article  Google Scholar 

  40. Pellegrini, S., Ess, A., Tanaskovic, M.: Wrong turn-no dead end: a stochastic pedestrian motion model. In: 2010 IEEE Computer Society Conference on CVPRW (2010)

    Google Scholar 

  41. Perše, M., Kristan, M., Kovačič, S., Vučkovič, G., Perš, J.: A trajectory-based analysis of coordinated team activity in a basketball game. Comput. Vis. Image Underst. 113(5), 612–621 (2009)

    Article  Google Scholar 

  42. Yin, Y., Yang, G., Man, H.: Small human group detection and event representation based on cognitive semantics. In: Proceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013, pp. 64–69, September 2013

    Google Scholar 

  43. Ge, W., Collins, R.T., Ruback, R.B.: Vision-based analysis of small groups in pedestrian crowds. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 1003–1016 (2012)

    Article  Google Scholar 

  44. Lau, B., Arras, K.O., Burgard, W.: Multi-model hypothesis group tracking and group size estimation. Int. J. Soc. Robot. 2(1), 19–30 (2010)

    Article  Google Scholar 

  45. Jacques, J.C.S., Braun, A., Soldera, J., Musse, S.R., Jung, C.R.: Understanding people motion in video sequences using Voronoi diagrams. Pattern Anal. Appl. 10(4), 321–332 (2007)

    Article  MathSciNet  Google Scholar 

  46. Schuldt, C., Barbara, L., Stockholm, S.: Rcognizing human actions: a local SVM approach. Department of Numerical Analysis and Computer Science. In: Pattern Recognition, Proceedings of the 17th International Conference on ICPPR 2004, vol. 3, pp. 32–36 (2004)

    Google Scholar 

  47. Andrade, E.L., Blunsden, S., Fisher, R.B.: Modelling crowd scenes for event detection (2006)

    Google Scholar 

  48. Kilambi, P., Ribnick, E., Joshi, A.J., Masoud, O., Papanikolopoulos, N.: Estimating pedestrian counts in groups. Comput. Vis. Image Underst. 110(1), 43–59 (2008)

    Article  Google Scholar 

  49. Zhang, C., Yang, X., Lin, W., Zhu, J.: Recognizing human group behaviors with multi-group causalities. In: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology Workshops, WIIAT 2012, pp. 44–48 (2012)

    Google Scholar 

  50. Brostow, G.J., Cipolla, R.: Brostow: unsupervised bayesian detection of independent motion in crowds (2006)

    Google Scholar 

  51. Ge, W., Collins, R.T.: Marked point processes for crowd counting. In: IEEE Computer Vision and Pattern Recognition 2009, pp. 2913–2920 (2009)

    Google Scholar 

  52. Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behaviour detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, no. 2, pp. 935–942 (2009)

    Google Scholar 

  53. Cupillard, F., Brémond, F., Thonnat, M.: Tracking groups of people for video surveillance. In: Remagnino, P., Jones, G.A., Paragios, N., Regazzoni, C.S. (eds.) Video-Based Surveillance Systems, pp. 89–100. Springer, USA (2002)

    Chapter  Google Scholar 

  54. Kong, D., Gray, D., Tao, H.: A viewpoint invariant approach for crowd counting. In: Proceedings - International Conference on Pattern Recognition, vol. 3, pp. 1187–1190 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidad Central del Ecuador, Ciudadela Universitaria Av. América, Quito, Ecuador

    Luis Felipe Borja-Borja

  2. Computer Technology Department, University of Alicante, Carretera San Vicente s/n, 03690, San Vicente del Raspeig, Spain

    Marcelo Saval-Calvo & Jorge Azorin-Lopez

Authors
  1. Luis Felipe Borja-Borja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marcelo Saval-Calvo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jorge Azorin-Lopez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jorge Azorin-Lopez .

Editor information

Editors and Affiliations

  1. Universidad de Granada, Granada, Spain

    Ignacio Rojas

  2. University of Malaga, Malaga, Spain

    Gonzalo Joya

  3. Polytechnic University of Catalonia, Vilanova i la Geltrú, Barcelona, Spain

    Andreu Catala

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Borja-Borja, L.F., Saval-Calvo, M., Azorin-Lopez, J. (2017). Machine Learning Methods from Group to Crowd Behaviour Analysis. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2017. Lecture Notes in Computer Science(), vol 10306. Springer, Cham. https://doi.org/10.1007/978-3-319-59147-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59147-6_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59146-9

  • Online ISBN: 978-3-319-59147-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation