Abstract
Re-identification is usually defined as the problem of deciding whether a person currently in the field of view of a camera has been seen earlier either by that camera or another. However, a different version of the problem arises even when people are seen by multiple cameras with overlapping fields of view. Current tracking algorithms can easily get confused when people come close to each other and merge trajectory fragments into trajectories that include erroneous identity switches. Preventing this means re-identifying people across trajectory fragments. In this chapter, we show that this can be done very effectively by formulating the problem as a minimum-cost maximum-flow linear program. This version of the re-identification problem can be solved in real-time and produces trajectories without identity switches. We demonstrate the power of our approach both in single- and multicamera setups to track pedestrians, soccer players, and basketball players.
This work was funded in part by the Swiss National Science Foundation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Abramson, Y., Steux, B., Ghorayeb, H.: YEF Real-time object detection. In: International Workshop on Automatic Learning and Real-Time (ALaRT) (2005)
Ahonen, T., Hadid, A., Pietikïinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: Conference on Computer Vision and Pattern Recognition (2008)
Andriluka, M., Roth, S., Schiele, B.: Monocular 3D pose estimation and tracking by detection. In: Conference on Computer Vision and Pattern Recognition (2010)
Andriyenko, A., Schindler, K.: Globally optimal multi-target tracking on a hexagonal lattice. In: European Conference on Computer Vision (2010)
Andriyenko, A., Schindler, K., Roth, S.: Discrete-continuous optimization for multi-target tracking. In: Conference on Computer Vision and Pattern Recognition (2012)
APIDIS European Project FP7-ICT-216023: (2008–2010). www.apidis.org
Barinova, O., Lempitsky, V., Kohli, P.: On detection of multiple object instances using hough transforms. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1773–1784 (2012)
Bazaraa, M.S., Jarvis, J.J., Sherali, H.D.: Linear programming and network flows. Wiley, Hiedelberg (2010)
BenShitrit, H., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global apperance constraints. In: International Conference on Computer Vision (2011)
BenShitrit, H., Berclaz, J., Fleuret, F., Fua, P.: Multi-commodity network flow for tracking multiple people. IEEE Transactions on Pattern Analysis and Machine Intelligence (2013). Submitted for publication. Available as technical report EPFL-ARTICLE-181551.
Berclaz, J., Fleuret, F., Türetken, E., Fua, P.: Multiple object tracking using K-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1806–1819 (2011). http://cvlab.epfl.ch/software/ksp
Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. EURASIP J. Image Video Process. (2008)
Bimbo, A.D., Lisanti, G., Masi, I., Pernici, F.: Person detection using temporal and geometric context with a Pan Tilt zoom camera. In: International Conference on Pattern Recognition (2010)
Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. (2011). http://www.csie.ntu.edu.tw/~cjlin/libsvm
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Conference on Computer Vision and Pattern Recognition (2005)
Dantzig, G.B.: Linear programming and extensions. Princeton University Press, Princeton (1963)
D’Orazio, T., Leo, M., Mosca, N., Spagnolo, P., Mazzeo, P.L.: A semi-automatic system for ground truth generation of soccer video sequences. In: International Conference on Advanced Video and Signal Based Surveillance (2009)
Ellis, A., Shahrokni, A., Ferryman, J.: Pets 2009 and winter pets 2009 results, a combined evaluation. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (2009)
Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Knowledge Discovery and Data Mining (1996)
Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)
Fleuret, F., Berclaz, J., Lengagne, R., Fua, P.: Multi-camera people tracking with a probabilistic occupancy map. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 267–282 (2008). http://cvlab.epfl.ch/software/pom
Jiang, H., Fels, S., Little, J.: A linear programming approach for multiple object tracking. In: Conference on Computer Vision and Pattern Recognition (2007)
Karmarkar, N.: A new polynomial time algorithm for linear programming. Combinatorica 4(4), 373–395 (1984)
Misu, T., Matsui, A., Clippingdale, S., Fujii, M., Yagi, N.: Probabilistic integration of tracking and recognition of soccer players. In: Advances in Multimedia Modeling (2009)
Perera, A., Srinivas, C., Hoogs, A., Brooksby, G., Wensheng, H.: Multi-object tracking through simultaneous long occlusions and split-merge conditions. In: Conference on Computer Vision and Pattern Recognition (2006)
Pirsiavash, H., Ramanan, D.: Steerable part models. In: Conference on Computer Vision and Pattern Recognition (2012)
Pirsiavash, H., Ramanan, D., Fowlkes, C.: Globally-optimal greedy algorithms for tracking a variable number of objects. In: Conference on Computer Vision and Pattern Recognition (2011). http://www.ics.uci.edu/%7edramanan/
Storms, P., Spieksma, F.: An LP-based algorithm for the data association problem in multitarget tracking. Computers and Operations Research 30(7), 1067–1085 (2003)
Suurballe, J.W.: Disjoint paths in a network. Networks 4, 125–145 (1974)
Tsai, R.: A versatile cameras calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. Int. J. Robot. Autom. 3(4), 323–344 (1987)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Conference on Computer Vision and Pattern Recognition (2001)
Wu, T., Lin, C.: Weng, R. C.: Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. 5, 975–1005 (2004)
Yuan, L., Bo, W., Nevatia, R.: Human detection by searching in 3D space using camera and scene knowledge. In: International Conference on Pattern Recognition (2008)
Zervos, M., BenShitrit, H., Fleuret, F., Fua, P.: Facial descriptors for identity-preserving multiple people tracking. Tech. Rep. EPFL-REPORT-187534, EPFL (2013)
Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: Conference on Computer Vision and Pattern Recognition (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Fleuret, F., Shitrit, H.B., Fua, P. (2014). Re-identification for Improved People Tracking. In: Gong, S., Cristani, M., Yan, S., Loy, C. (eds) Person Re-Identification. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-6296-4_15
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6296-4_15
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6295-7
Online ISBN: 978-1-4471-6296-4
eBook Packages: Computer ScienceComputer Science (R0)