Social Groups Detection in Crowd through Shape-Augmented Structured Learning

  • Francesco Solera
  • Simone Calderara
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8156)


Most of the behaviors people exhibit while being part of a crowd are social processes that tend to emerge among groups and as a consequence, detecting groups in crowds is becoming an important issue in modern behavior analysis. We propose a supervised correlation clustering technique that employs Structural SVM and a proxemic based feature to learn how to partition people trajectories in groups, by injecting in the model socially plausible shape configurations. By taking into account social groups patterns, the system is able to outperform state of the art methods on two publicly available benchmark sets of videos.


group detection proxemic theory Structural SVM 


  1. 1.
    Moussaïd, M., Perozo, N., Garnier, S., Helbing, D.: The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd Dynamics. In: PLoS ONE, vol. 5 (2010)Google Scholar
  2. 2.
    Pang, S.K., Li, J., Godsill, S.J.: Models and Algorithms for Detection and Tracking of Coordinated Groups. In: Aerospace Conference, pp. 1–17 (2008)Google Scholar
  3. 3.
    Feldmann, M., Fränken, D., Koch, W.: Tracking of Extended Objects and Group Targets Using Random Matrices. IEEE Trans. Signal Processing 59 (2011)Google Scholar
  4. 4.
    Lau, B., Arras, K., Burgard, W.: Multi-Model Hypothesis Group Tracking and Group Size Estimation. I. J. Social Robotics 2, 19–30 (2010)CrossRefGoogle Scholar
  5. 5.
    Lin, W.C., Liu, Y.: A Lattice-Based MRF Model for Dynamic Near-Regular Texture Tracking. PAMI 29, 777–792 (2007)CrossRefGoogle Scholar
  6. 6.
    Pellegrini, S., Ess, A., Van Gool, L.: Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 452–465. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Yamaguchi, K., Berg, A.C., Ortiz, L.E., Berg, T.L.: Who Are You with and Where Are You Going? In: CVPR, pp. 1345–1352 (2011)Google Scholar
  8. 8.
    Ge, W., Collins, R.T., Ruback, R.B.: Vision-Based Analysis of Small Groups in Pedestrian Crowds. PAMI 34, 1003–1016 (2012)CrossRefGoogle Scholar
  9. 9.
    Rodriguez, M., Laptev, I., Sivic, J., Audibert, J.-Y.: Density-Aware Person Detection and Tracking in Crowds. In: ICCV, pp. 2423–2430 (2011)Google Scholar
  10. 10.
    Hall, E.T.: The Hidden Dimension. Doubleday (1966)Google Scholar
  11. 11.
    Finley, T., Joachims, T.: Supervised Clustering with Support Vector Machines. In: ICML, pp. 217–224 (2005)Google Scholar
  12. 12.
    Calderara, S., Cucchiara, R.: Understanding Dyadic Interactions Applying Proxemic Theory on Videosurveillance Trajectories. In: CVPRW, pp. 20–27 (2012)Google Scholar
  13. 13.
    Solera, F., Calderara, S., Cucchiara, R.: Structured learning for detection of social groups in crowd. In: Proc. of Advanced Video and Signal-Based Surveillance (2013)Google Scholar
  14. 14.
    Bansal, N., Blum, A., Chawla, S.: Correlation Clustering. Machine Learning 56, 89–113 (2004)CrossRefzbMATHGoogle Scholar
  15. 15.
    Tsochantaridis, I., Hofmann, T., Joachims, T., Altun, Y.: Support Vector Machine Learning for Interdependent and Structured Output Spaces. In: ICML (2004)Google Scholar
  16. 16.
    Bandini, S., Gorrini, A., Manenti, L., Vizzari, G.: Crowd and Pedestrian Dynamics: Empirical Investigation and Simulation. In: Proc. of the Measuring Behavior (2012)Google Scholar
  17. 17.
    Cardie, C., Wagstaff, K.: Noun Phrase Coreference As Clustering. In: Proc. of the Empirical Methods in NLP and Very Large Corpora (1999)Google Scholar
  18. 18.
    Vilain, M., Burger, J., Aberdeen, J., Connolly, D., Hirschman, L.: A Model-Theoretic Coreference Scoring Scheme. In: Conf. on Message Understanding (1995)Google Scholar
  19. 19.
    Lee, C., Jang, M.-G.: Fast Training of Structured SVM Using Fixed-Threshold Sequential Minimal Optimization. Etri Journal 31, 121–128 (2009)CrossRefGoogle Scholar
  20. 20.
    Lerner, A., Chrysanthou, Y., Lischinski, D.: Crowds by Example. Computer Graphics Forum 26, 655–664 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Francesco Solera
    • 1
  • Simone Calderara
    • 1
  1. 1.DIEF University of Modena and Reggio EmiliaItaly

Personalised recommendations