Skip to main content

Automatic Detection and Tracking of Pedestrians in Videos with Various Crowd Densities

  • Conference paper
  • First Online:
Pedestrian and Evacuation Dynamics 2012

Abstract

Manual analysis of pedestrians and crowds is often impractical for massive datasets of surveillance videos. Automatic tracking of humans is one of the essential abilities for computerized analysis of such videos. In this keynote paper, we present two state of the art methods for automatic pedestrian tracking in videos with low and high crowd density. For videos with low density, first we detect each person using a part-based human detector. Then, we employ a global data association method based on Generalized Graphs for tracking each individual in the whole video. In videos with high crowd-density, we track individuals using a scene structured force model and crowd flow modeling. Additionally, we present an alternative approach which utilizes contextual information without the need to learn the structure of the scene. Performed evaluations show the presented methods outperform the currently available algorithms on several benchmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. E. Osuna, R. Freund, and F. Girosi, “Training Support Vector Machines: An Application to Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130–136, 1997.

    Google Scholar 

  2. C. Papageorgiou, T. Evgeniou, and T. Poggio, “A Trainable Pedestrian Detection System,” Proc. Symp. Intelligent Vehicles, pp. 241–246, 1998.

    Google Scholar 

  3. P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 511–518, 2001.

    Google Scholar 

  4. Y. Wu, T. Yu, and G. Hua, “A Statistical Field Model for Pedestrian Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1023–1030, 2005.

    Google Scholar 

  5. N. Dalal and B. Triggs, “Histograms of Oriented Gradients for Human Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 886–893, 2005.

    Google Scholar 

  6. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. In PAMI, 2010.

    Google Scholar 

  7. B. Benfold and I. Reid. Stable multi-target tracking in realtime surveillance video. In CVPR, 2011.

    Google Scholar 

  8. M. Rodriguez, I. Laptev, J. Sivic, and J.-Y. Audibert. Density-aware person detection and tracking in crowds. In ICCV, 2011.

    Google Scholar 

  9. G. Shu, A. Dehghan, O. Oreifej, E. Hand, M. Shah. Part-based Multiple-Person Tracking with Partial Occlusion Handling. In CVPR, 2012.

    Google Scholar 

  10. Amir Roshan Zamir, Afshin Dehghan, and M. Shah. GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs. In ECCV, 2012.

    Google Scholar 

  11. Feremans, C., Labbe, M., Laporte, G.. Generalized network design problems. In: EJOR, 2003.

    Google Scholar 

  12. Kasturi, R., et al.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. In: PAMI. (2009).

    Google Scholar 

  13. Benfold, B., Reid, I.: Stable multi-target tracking in real time surveillance video. In: CVPR.(2011)

    Google Scholar 

  14. Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using networkflows. In: CVPR. (2008)

    Google Scholar 

  15. Pellegrini, S., Ess, A., Van Gool, L.: Improving data association by joint modeling of pedestrian trajectories and groupings. In: ECCV. (2010)

    Google Scholar 

  16. Yamaguchi, K., Berg, A., Ortiz, L., Berg, T.: who are you with and where are you going? In: CVPR. (2011)

    Google Scholar 

  17. Leal-Taixe, L., Pons-Moll, G., Rosenhahn, B.: Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker. In: ICCV Workshops. (2011)

    Google Scholar 

  18. Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Gool, L.V.: Robust tracking-by-detection using a detector confidence particle filter. In: ICCV. (2009)

    Google Scholar 

  19. Brendel, W., Amer, M., Todorovic, S.: Multiobject tracking as maximum weight independent set. In: CVPR. (2011)

    Google Scholar 

  20. Andriyenko, A., Schindler, K.: Multi-target tracking by continuous energy minimization. In:CVPR. (2011)

    Google Scholar 

  21. Berclaz, J., Fleuret, F., Turetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. In: PAMI. (2011)

    Google Scholar 

  22. Shitrit, H.B., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global appearance constraints. In: ICCV. (2011)

    Google Scholar 

  23. Henriques, J.F., Caseiro, R., Batista, J.: Globally optimal solution to multi-object tracking with merged measurements. In: ICCV. (2011)

    Google Scholar 

  24. S. Ali and M. Shah, A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis, IEEE CVPR, 2007.

    Google Scholar 

  25. S. Ali and M. Shah, Floor Fields for Tracking in High Density Crowded Scenes, ECCV 2008.

    Google Scholar 

  26. H.Idrees, N. Warner and M.Shah, Tracking in Dense Crowds using Prominence and Neighborhood Motion Concurrence, Submitted to CVIU Journal, 2012.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mubarak Shah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Dehghan, A., Idrees, H., Zamir, A.R., Shah, M. (2014). Automatic Detection and Tracking of Pedestrians in Videos with Various Crowd Densities. In: Weidmann, U., Kirsch, U., Schreckenberg, M. (eds) Pedestrian and Evacuation Dynamics 2012. Springer, Cham. https://doi.org/10.1007/978-3-319-02447-9_1

Download citation

Publish with us

Policies and ethics