Efficient Multiple People Tracking Using Minimum Cost Arborescences

  • Roberto HenschelEmail author
  • Laura Leal-Taixé
  • Bodo Rosenhahn
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8753)


We present a new global optimization approach for multiple people tracking based on a hierarchical tracklet framework. A new type of tracklets is introduced, which we call tree tracklets. They contain bifurcations to naturally deal with ambiguous tracking situations. Difficult decisions are postponed to a later iteration of the hierarchical framework, when more information is available. We cast the optimization problem as a minimum cost arborescence problem in an acyclic directed graph, where a tracking solution can be obtained in linear time. Experiments on six publicly available datasets show that the method performs well when compared to state-of-the art tracking algorithms.


Time Complexity False Detection Data Association Hierarchical Framework Social Force Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: CVPR (2011)Google Scholar
  2. 2.
    Berclaz, J., Fleuret, F., Türetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. TPAMI 33(9), 1806–1819 (2011)CrossRefGoogle Scholar
  3. 3.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR (2005)Google Scholar
  4. 4.
    Dicle, C., Sznaier, M., Camps, O.: The way they move: tracking targets with similar appearance. In: ICCV (2013)Google Scholar
  5. 5.
    Edmonds, J.: Optimum branchings. J. Res. Natl. Bur. Stan. B. Math. Sci. 71B(4), 233–240 (1967)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: CVPR (2008)Google Scholar
  7. 7.
    Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. TPAMI 32(9), 1627–1645 (2010)CrossRefGoogle Scholar
  8. 8.
    Gall, J., Yao, A., Razavi, N., van Gool, L., Lempitsky, V.: Hough forests for object detection, tracking and action recognition. TPAMI 33(11), 2188–2202 (2011)CrossRefGoogle Scholar
  9. 9.
    Gibbons, A.: Algorithmic Graph Theory. Cambridge University Press, Cambridge (1985)zbMATHGoogle Scholar
  10. 10.
    Henriques, J.F., Caseiro, R., Batista, J.: Globally optimal solution to multi-object tracking with merged measurements. In: ICCV (2011)Google Scholar
  11. 11.
    Huang, C., Wu, B., Nevatia, R.: Robust object tracking by hierarchical association of detection responses. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 788–801. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  12. 12.
    Jiang, H., Fels, S., Little, J.: A linear programming approach for multiple object tracking. In: CVPR (2007)Google Scholar
  13. 13.
    Kamiyama, N.: Arborescence problems in directed graphs: theorems and algorithms. Interdisc. Inf. Sci. 20(1), 51–70 (2014). Graduate School of Information Sciences, Tohoku UniversityMathSciNetzbMATHGoogle Scholar
  14. 14.
    Kuhn, H.W.: The hungarian method for the assignment problem. Naval Res. Logist. Q. 2(1–2), 83–97 (1955)CrossRefGoogle Scholar
  15. 15.
    Kuo, C.H., Huang, C., Nevatia, R.: Multi-target tracking by on-line learned discriminative appearance models. In: CVPR (2010)Google Scholar
  16. 16.
    Leal-Taixé, L., Fenzi, M., Kuznetsova, A., Rosenhahn, B., Savarese, S.: Learning an image-based motion context for multiple people tracking. In: CVPR (2014)Google Scholar
  17. 17.
    Leal-Taixé, L., Pons-Moll, G., Rosenhahn, B.: Everybody needs somebody: modeling social and grouping behavior on a linear programming multiple people tracker. In: ICCV Workshops, 1st Workshop on Modeling, Simulation and Visual Analysis of Large Crowds (2011)Google Scholar
  18. 18.
    Li, Y., Huang, C., Nevatia, R.: Learning to associate: hybrid boosted multi-target tracker for crowded scene. In: CVPR (2009)Google Scholar
  19. 19.
    Pellegrini, S., Ess, A., Schindler, K., van Gool, L.: You’ll never walk alone: modeling social behavior for multi-target tracking. In: ICCV (2009)Google Scholar
  20. 20.
    Pirsiavash, H., Ramanan, D., Fowlkes, C.: Globally-optimal greedy algorithms for tracking a variable number of objects. In: CVPR (2011)Google Scholar
  21. 21.
    Qin, Z., Shelton, C.R.: Improving multi-target tracking via social grouping. In: CVPR (2012)Google Scholar
  22. 22.
    Yang, B., Nevatia, R.: An online learned CRF model for multi-target tracking. In: CVPR (2012)Google Scholar
  23. 23.
    Yang, B., Nevatia, R.: Multi-target tracking by online learning of non-linear motion patterns and robust appearance models. In: CVPR (2012)Google Scholar
  24. 24.
    Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: CVPR (2008)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Roberto Henschel
    • 1
    Email author
  • Laura Leal-Taixé
    • 2
  • Bodo Rosenhahn
    • 1
  1. 1.Institut Für InformationsverarbeitungLeibniz Universität HannoverHannoverGermany
  2. 2.Institute of Geodesy and PhotogrammetryETH ZurichZurichSwitzerland

Personalised recommendations